2024-09-11T23:52:06.449 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:52:06.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:52:06.575 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7901825' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMg2HswkFT7jcAw7WmQK+ycZDr9L2yEkAS1o6QDbuGQhFNu+PW5mds+Rdv9Ibbxjj1TsxOz+lIVKLNrWUsIh5G8= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPBTd6iHLBWbi2V2YJ0bVZc8iMq1UFyrE+E1mVQt0MV+uXeji3qM7guHigIGdSPGUVo974OE38V/fsns5t8m6Q= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:52:06.576 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-11T23:52:06.576 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-11T23:52:06.577 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:52:06.578 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:52:06.608 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-11T23:52:06.608 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:52:06.608 INFO:teuthology.packaging:ref: None 2024-09-11T23:52:06.608 INFO:teuthology.packaging:tag: None 2024-09-11T23:52:06.608 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-11T23:52:06.609 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:52:06.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-11T23:52:06.770 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753.gd011c522 2024-09-11T23:52:06.772 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:52:06.780 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:52:06.780 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:52:06.792 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:52:06.810 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:52:06.820 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:52:06.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:46:57.266883', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMg2HswkFT7jcAw7WmQK+ycZDr9L2yEkAS1o6QDbuGQhFNu+PW5mds+Rdv9Ibbxjj1TsxOz+lIVKLNrWUsIh5G8='} 2024-09-11T23:52:06.880 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:46:57.268102', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPBTd6iHLBWbi2V2YJ0bVZc8iMq1UFyrE+E1mVQt0MV+uXeji3qM7guHigIGdSPGUVo974OE38V/fsns5t8m6Q='} 2024-09-11T23:52:06.881 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:52:06.889 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T23:52:06.890 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T23:52:06.890 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:52:06.972 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fce74cbb490>, signals=[15]) 2024-09-11T23:52:06.972 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:52:06.981 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:52:06.981 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-09-11T23:52:06.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:52:07.100 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-11T23:52:07.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:52:07.193 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:52:07.201 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-09-11T23:52:07.220 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-09-11T23:52:07.220 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-09-11T23:52:07.278 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-09-11T23:52:07.278 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-09-11T23:52:07.278 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-09-11T23:52:07.278 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:52:07.278 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:52:07.279 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:52:07.280 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-09-11T23:52:07.310 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-11T23:52:07.329 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-11T23:52:07.329 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-11T23:52:07.387 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-11T23:52:07.388 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-11T23:52:07.388 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-11T23:52:07.388 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:52:07.388 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-11T23:52:07.388 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:52:07.389 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:52:07.389 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-11T23:52:07.389 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:52:07.389 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:52:07.389 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:52:07.389 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:52:07.389 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:52:07.390 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:52:07.390 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-11T23:52:07.418 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:52:07.429 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:52:07.438 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:52:07.438 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:52:07.441 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:52:07.459 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:52:07.468 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:52:07.468 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:52:07.499 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:52:07.593 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:52:07.659 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:52:07.678 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:52:07.678 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T23:52:07.678 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:52:07.679 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:52:07.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:52:07.697 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-09-11T23:52:07.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:52:07.699 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-11T23:52:07.755 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:52:07.756 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.14.0-503.el9.x86_64 2024-09-11T23:52:07.756 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2024-09-11T23:52:07.757 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:52:07.757 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-503.el9.x86_64 2024-09-11T23:52:07.757 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-09-11T23:52:10.241 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T23:52:11.353 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-11T23:52:13.221 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-11T23:52:14.250 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-09-11T23:52:17.613 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-11T23:52:19.589 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 19 kB 00:00 2024-09-11T23:52:19.984 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-11T23:52:20.376 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-11T23:52:21.767 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-11T23:52:22.679 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T23:52:25.948 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T23:52:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:52:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:52:28.123 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:52:28.130 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:52:28.131 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T23:52:28.131 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-09-11T23:52:28.131 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-11T23:52:28.131 INFO:teuthology.orchestra.run.smithi033.stdout:Install 4 Packages 2024-09-11T23:52:28.131 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T23:52:28.131 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 79 M 2024-09-11T23:52:28.132 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 126 M 2024-09-11T23:52:28.132 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-09-11T23:52:28.151 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T23:52:28.241 INFO:teuthology.orchestra.run.smithi033.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 256 kB/s | 23 kB 00:00 2024-09-11T23:52:28.608 INFO:teuthology.orchestra.run.smithi033.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-11T23:52:29.017 INFO:teuthology.orchestra.run.smithi033.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 40 MB/s | 35 MB 00:00 2024-09-11T23:52:29.442 INFO:teuthology.orchestra.run.smithi033.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-11T23:52:29.443 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:52:29.443 INFO:teuthology.orchestra.run.smithi033.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-11T23:52:30.149 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:52:30.150 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:52:30.158 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-09-11T23:52:30.236 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-11T23:52:30.248 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-11T23:52:30.249 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-11T23:52:30.249 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-11T23:52:30.249 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-11T23:52:30.249 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 79 M 2024-09-11T23:52:30.249 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 126 M 2024-09-11T23:52:30.249 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-11T23:52:30.436 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 354 kB/s | 23 kB 00:00 2024-09-11T23:52:30.530 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-09-11T23:52:30.530 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-09-11T23:52:31.521 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-09-11T23:52:31.521 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-09-11T23:52:34.102 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-09-11T23:52:34.286 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-09-11T23:52:34.761 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.6 MB/s | 29 MB 00:04 2024-09-11T23:52:34.769 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:52:34.859 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:52:35.219 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 7.1 MB/s | 35 MB 00:04 2024-09-11T23:52:35.219 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:52:35.220 INFO:teuthology.orchestra.run.smithi162.stdout:Total 16 MB/s | 79 MB 00:04 2024-09-11T23:52:35.899 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-11T23:52:36.280 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-11T23:52:36.280 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-11T23:52:37.242 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-11T23:52:37.242 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-11T23:52:37.665 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:52:37.797 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:52:39.710 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-11T23:52:40.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:52:40.460 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:52:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:52:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:43.264 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:52:43.420 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:52:48.101 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:48.284 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:52:48.379 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:53.225 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:27.534 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:27.936 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:27.936 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:53:27.936 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:53:27.937 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T23:53:28.837 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-11T23:53:29.180 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:53:29.264 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:53:29.265 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:53:29.265 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:53:29.265 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:53:29.265 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:53:29.265 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T23:53:29.265 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:53:29.266 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:53:29.324 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:53:29.324 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:53:29.325 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2024-09-11T23:53:29.355 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.06 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 82.el9 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Group : Unspecified 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 8274670 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:53:29.356 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : builder@centos.org 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : CentOS 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T23:53:29.357 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:53:29.358 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:53:29.358 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:53:29.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:53:29.971 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2024-09-11T23:53:31.365 INFO:teuthology.orchestra.run.smithi033.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:53:31.395 INFO:teuthology.orchestra.run.smithi033.stderr:done 2024-09-11T23:53:31.397 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-09-11T23:53:31.412 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.bu8wPMBXYX 2024-09-11T23:53:31.412 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bu8wPMBXYX 2024-09-11T23:53:31.477 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.bu8wPMBXYX 2024-09-11T23:53:31.624 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.bu8wPMBXYX is 6KB 2024-09-11T23:53:31.673 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.bu8wPMBXYX 2024-09-11T23:53:31.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:53:31.755 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:53:31.755 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:53:31.755 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:53:31.755 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:53:31.756 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:53:31.839 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:31.908 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2024-09-11T23:53:32.222 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:32.222 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:53:32.222 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:53:32.223 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:53:33.058 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:53:33.058 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-11T23:53:33.058 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-11T23:53:33.058 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:53:33.058 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:53:33.058 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:53:33.058 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:53:33.058 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-11T23:53:33.059 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-11T23:53:33.430 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:53:33.513 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:53:33.513 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:53:33.513 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:53:33.513 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:53:33.514 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:53:33.514 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T23:53:33.514 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:53:33.514 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:53:33.572 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:53:33.573 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:53:33.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-09-11T23:53:33.605 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-09-11T23:53:33.605 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-09-11T23:53:33.605 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-09-11T23:53:33.605 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 82.el9 2024-09-11T23:53:33.605 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-09-11T23:53:33.605 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8274670 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-11T23:53:33.606 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:53:33.607 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:53:33.607 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:53:33.607 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-09-11T23:53:33.607 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-11T23:53:33.607 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:53:33.608 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:53:33.608 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:53:33.608 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:53:34.282 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-09-11T23:53:35.625 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:53:35.643 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-09-11T23:53:35.646 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-11T23:53:35.661 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.KJCCSSpyUQ 2024-09-11T23:53:35.661 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KJCCSSpyUQ 2024-09-11T23:53:35.728 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.KJCCSSpyUQ 2024-09-11T23:53:35.869 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.KJCCSSpyUQ is 6KB 2024-09-11T23:53:35.918 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.KJCCSSpyUQ 2024-09-11T23:53:35.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:53:35.996 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:53:35.996 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:53:35.996 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:53:35.996 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:53:35.997 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:53:36.144 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-09-11T23:54:01.936 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T23:54:01.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-11T23:54:01.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:54:06.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T23:54:06.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-11T23:54:06.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:54:20.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-09-11T23:54:24.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-11T23:54:29.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-11T23:54:29.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:54:33.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-11T23:54:33.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:54:36.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-11T23:54:47.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-09-11T23:54:48.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-11T23:54:48.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:54:59.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-11T23:54:59.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:55:00.809 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-09-11T23:55:01.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-11T23:55:01.249 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:55:01.249 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-09-11T23:55:01.264 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:55:01.265 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:55:01.265 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:55:01.265 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:55:02.265 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T23:55:02.266 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:55:02.371 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2024-09-11T23:55:02.418 DEBUG:teuthology.parallel:result is None 2024-09-11T23:55:07.201 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-11T23:55:22.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-11T23:55:22.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:55:22.625 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-11T23:55:22.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-11T23:55:22.979 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:55:22.979 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-11T23:55:22.993 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:55:22.994 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:55:22.994 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:55:22.994 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:55:23.994 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T23:55:23.995 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:55:24.101 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-09-11T23:55:24.116 DEBUG:teuthology.parallel:result is None 2024-09-11T23:55:24.116 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:55:24.125 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:55:24.125 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:55:24.129 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:55:24.146 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:55:24.158 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:55:24.173 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:55:24.173 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:55:24.189 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:55:24.215 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:55:24.226 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:55:24.226 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:55:24.253 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:55:24.280 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:55:24.287 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:55:24.290 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:55:24.298 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:55:24.300 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:55:24.310 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:55:24.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:55:24.343 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:55:24.369 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:55:24.383 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:55:24.383 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:55:24.413 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:55:24.428 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:55:24.522 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:55:24.567 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:55:24.660 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:55:24.693 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-11T23:55:24.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:55:24.761 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:55:24.811 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:55:24.840 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:55:24.929 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:55:24.956 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-11T23:55:24.957 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:55:25.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-09-11T23:55:25.021 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-11T23:55:25.060 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:55:25.121 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:55:25.576 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:55:25.588 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:55:25.588 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:55:25.610 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:55:25.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-09-11T23:55:25.690 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-09-11T23:55:25.692 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-11T23:55:25.798 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-11T23:55:25.800 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:55:25.801 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-09-11T23:55:25.821 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-09-11T23:55:25.821 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-11T23:55:25.842 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-11T23:55:25.842 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-11T23:55:25.843 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T23:55:25.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:55:25.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T23:55:25.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:55:25.917 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:55:25.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:55:25.968 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:55:25.997 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:55:26.009 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:55:26.021 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:55:26.022 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:59:14.083 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-11T23:59:14.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-11T23:59:14.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:59:14.225 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-09-11T23:59:14.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-11T23:59:14.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-11T23:59:14.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:59:14.394 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-11T23:59:14.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-11T23:59:14.472 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:59:14.486 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:59:14.486 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:59:14.487 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:59:14.489 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:59:14.489 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:59:14.519 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:59:14.535 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:59:14.542 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:59:14.556 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:59:14.561 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-09-11T23:59:14.573 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-09-11T23:59:14.580 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-11T23:59:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:59:14.591 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-11T23:59:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:59:14.606 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:59:14.620 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:59:14.663 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:59:14.666 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:59:14.666 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-09-11T23:59:14.666 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:59:14.666 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:59:14.666 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:59:14.666 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:59:14.683 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:59:14.686 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:59:14.686 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-11T23:59:14.686 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:59:14.686 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:59:14.686 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:59:14.686 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:59:14.687 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:59:14.695 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:59:14.695 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-11T23:59:14.695 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-11T23:59:14.695 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:59:14.701 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:59:14.701 INFO:teuthology.task.install:extra packages: [] 2024-09-11T23:59:14.701 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-11T23:59:14.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:59:14.704 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-11T23:59:14.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:59:14.859 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-11T23:59:14.859 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-11T23:59:14.871 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-11T23:59:14.872 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-11T23:59:14.982 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:59:14.982 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-11T23:59:14.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:59:14.992 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:59:14.992 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-11T23:59:14.992 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:59:15.010 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-11T23:59:15.010 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:59:15.019 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-11T23:59:15.019 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:59:15.078 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:59:15.085 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:59:15.155 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:59:15.159 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:59:15.220 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-09-11T23:59:15.222 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-09-11T23:59:15.224 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-11T23:59:15.225 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-11T23:59:15.452 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-11T23:59:15.468 INFO:teuthology.orchestra.run.smithi033.stdout:45 files removed 2024-09-11T23:59:15.480 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-11T23:59:15.495 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-11T23:59:16.048 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-11T23:59:16.056 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 322 kB/s | 84 kB 00:00 2024-09-11T23:59:16.340 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-11T23:59:16.356 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-11T23:59:16.624 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-11T23:59:16.632 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-11T23:59:17.174 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-11T23:59:17.241 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-11T23:59:18.892 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-11T23:59:20.534 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 20 MB 00:02 2024-09-11T23:59:23.417 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-11T23:59:25.018 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-11T23:59:25.884 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-11T23:59:26.157 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T23:59:27.393 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 114 kB/s | 19 kB 00:00 2024-09-11T23:59:28.139 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-11T23:59:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-09-11T23:59:33.520 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T23:59:34.308 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:59:34.309 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:59:34.408 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================================== 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================================== 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-11T23:59:34.433 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-11T23:59:34.434 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-11T23:59:34.435 INFO:teuthology.orchestra.run.smithi033.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-11T23:59:34.436 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-11T23:59:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-11T23:59:34.438 INFO:teuthology.orchestra.run.smithi033.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-11T23:59:34.439 INFO:teuthology.orchestra.run.smithi033.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-11T23:59:34.440 INFO:teuthology.orchestra.run.smithi033.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-11T23:59:34.441 INFO:teuthology.orchestra.run.smithi033.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-11T23:59:34.442 INFO:teuthology.orchestra.run.smithi033.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-11T23:59:34.443 INFO:teuthology.orchestra.run.smithi033.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-11T23:59:34.444 INFO:teuthology.orchestra.run.smithi033.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-11T23:59:34.445 INFO:teuthology.orchestra.run.smithi033.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-11T23:59:34.446 INFO:teuthology.orchestra.run.smithi033.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-11T23:59:34.447 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:59:34.448 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:59:34.449 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:59:34.450 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:59:34.451 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-11T23:59:34.452 INFO:teuthology.orchestra.run.smithi033.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-11T23:59:34.453 INFO:teuthology.orchestra.run.smithi033.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-11T23:59:34.454 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================================== 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout:Install 283 Packages 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 2 Packages 2024-09-11T23:59:34.455 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T23:59:34.456 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 327 M 2024-09-11T23:59:34.456 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-09-11T23:59:35.037 INFO:teuthology.orchestra.run.smithi033.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-11T23:59:35.238 INFO:teuthology.orchestra.run.smithi033.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 4.4 MB/s | 899 kB 00:00 2024-09-11T23:59:35.321 INFO:teuthology.orchestra.run.smithi033.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 1.7 MB/s | 145 kB 00:00 2024-09-11T23:59:35.405 INFO:teuthology.orchestra.run.smithi033.stdout:(4/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-11T23:59:35.497 INFO:teuthology.orchestra.run.smithi033.stdout:(5/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-11T23:59:35.639 INFO:teuthology.orchestra.run.smithi033.stdout:(6/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 7.5 MB/s | 2.4 MB 00:00 2024-09-11T23:59:35.755 INFO:teuthology.orchestra.run.smithi033.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 19 MB/s | 4.8 MB 00:00 2024-09-11T23:59:35.830 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:59:35.830 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:59:35.922 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-11T23:59:35.949 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================================== 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================================== 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-11T23:59:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-11T23:59:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-11T23:59:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-11T23:59:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-11T23:59:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:59:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-11T23:59:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-11T23:59:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-11T23:59:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-11T23:59:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-11T23:59:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-11T23:59:35.961 INFO:teuthology.orchestra.run.smithi162.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T23:59:35.962 INFO:teuthology.orchestra.run.smithi162.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-11T23:59:35.963 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:59:35.963 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:59:35.963 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:59:35.963 INFO:teuthology.orchestra.run.smithi162.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-11T23:59:35.963 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:59:35.963 INFO:teuthology.orchestra.run.smithi162.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-11T23:59:35.963 INFO:teuthology.orchestra.run.smithi162.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-11T23:59:35.963 INFO:teuthology.orchestra.run.smithi162.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:59:35.964 INFO:teuthology.orchestra.run.smithi162.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-11T23:59:35.965 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-11T23:59:35.966 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:59:35.967 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:59:35.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:59:35.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:59:35.970 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-11T23:59:35.971 INFO:teuthology.orchestra.run.smithi162.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-11T23:59:35.972 INFO:teuthology.orchestra.run.smithi162.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================================== 2024-09-11T23:59:35.973 INFO:teuthology.orchestra.run.smithi162.stdout:Install 283 Packages 2024-09-11T23:59:35.974 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 2 Packages 2024-09-11T23:59:35.974 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-11T23:59:35.976 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 327 M 2024-09-11T23:59:35.976 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-11T23:59:36.081 INFO:teuthology.orchestra.run.smithi033.stdout:(8/285): ceph-common-19.3.0-4753.gd011c522.el9. 19 MB/s | 22 MB 00:01 2024-09-11T23:59:36.123 INFO:teuthology.orchestra.run.smithi033.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 608 kB/s | 25 kB 00:00 2024-09-11T23:59:36.331 INFO:teuthology.orchestra.run.smithi033.stdout:(10/285): ceph-radosgw-19.3.0-4753.gd011c522.el 19 MB/s | 11 MB 00:00 2024-09-11T23:59:36.390 INFO:teuthology.orchestra.run.smithi033.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 547 kB/s | 32 kB 00:00 2024-09-11T23:59:36.482 INFO:teuthology.orchestra.run.smithi033.stdout:(12/285): libcephfs2-19.3.0-4753.gd011c522.el9. 8.0 MB/s | 755 kB 00:00 2024-09-11T23:59:36.557 INFO:teuthology.orchestra.run.smithi033.stdout:(13/285): libcephsqlite-19.3.0-4753.gd011c522.e 2.1 MB/s | 161 kB 00:00 2024-09-11T23:59:36.653 INFO:teuthology.orchestra.run.smithi162.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-09-11T23:59:36.733 INFO:teuthology.orchestra.run.smithi033.stdout:(14/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 16 MB/s | 17 MB 00:01 2024-09-11T23:59:36.757 INFO:teuthology.orchestra.run.smithi033.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 632 kB/s | 126 kB 00:00 2024-09-11T23:59:36.800 INFO:teuthology.orchestra.run.smithi033.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 7.5 MB/s | 508 kB 00:00 2024-09-11T23:59:36.900 INFO:teuthology.orchestra.run.smithi033.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 451 kB/s | 45 kB 00:00 2024-09-11T23:59:37.001 INFO:teuthology.orchestra.run.smithi033.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 1.4 MB/s | 143 kB 00:00 2024-09-11T23:59:37.070 INFO:teuthology.orchestra.run.smithi162.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 2.1 MB/s | 899 kB 00:00 2024-09-11T23:59:37.100 INFO:teuthology.orchestra.run.smithi033.stdout:(19/285): librgw2-19.3.0-4753.gd011c522.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-11T23:59:37.125 INFO:teuthology.orchestra.run.smithi033.stdout:(20/285): python3-cephfs-19.3.0-4753.gd011c522. 1.3 MB/s | 161 kB 00:00 2024-09-11T23:59:37.168 INFO:teuthology.orchestra.run.smithi033.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 4.7 MB/s | 322 kB 00:00 2024-09-11T23:59:37.171 INFO:teuthology.orchestra.run.smithi162.stdout:(3/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 7.6 MB/s | 5.5 MB 00:00 2024-09-11T23:59:37.193 INFO:teuthology.orchestra.run.smithi033.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 4.5 MB/s | 306 kB 00:00 2024-09-11T23:59:37.196 INFO:teuthology.orchestra.run.smithi162.stdout:(4/285): ceph-immutable-object-cache-19.3.0-475 1.1 MB/s | 145 kB 00:00 2024-09-11T23:59:37.243 INFO:teuthology.orchestra.run.smithi033.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.3 MB/s | 99 kB 00:00 2024-09-11T23:59:37.269 INFO:teuthology.orchestra.run.smithi033.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-11T23:59:37.479 INFO:teuthology.orchestra.run.smithi162.stdout:(5/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 7.7 MB/s | 2.4 MB 00:00 2024-09-11T23:59:37.502 INFO:teuthology.orchestra.run.smithi033.stdout:(25/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 12 MB/s | 3.2 MB 00:00 2024-09-11T23:59:37.569 INFO:teuthology.orchestra.run.smithi033.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4753.g 516 kB/s | 34 kB 00:00 2024-09-11T23:59:37.644 INFO:teuthology.orchestra.run.smithi033.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 2.0 MB/s | 154 kB 00:00 2024-09-11T23:59:37.763 INFO:teuthology.orchestra.run.smithi162.stdout:(6/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-09-11T23:59:37.886 INFO:teuthology.orchestra.run.smithi033.stdout:(28/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 276 kB/s | 170 kB 00:00 2024-09-11T23:59:38.097 INFO:teuthology.orchestra.run.smithi162.stdout:(7/285): ceph-common-19.3.0-4753.gd011c522.el9. 13 MB/s | 22 MB 00:01 2024-09-11T23:59:38.180 INFO:teuthology.orchestra.run.smithi162.stdout:(8/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 6.8 MB/s | 4.8 MB 00:00 2024-09-11T23:59:38.272 INFO:teuthology.orchestra.run.smithi162.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 275 kB/s | 25 kB 00:00 2024-09-11T23:59:38.428 INFO:teuthology.orchestra.run.smithi033.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-11T23:59:38.570 INFO:teuthology.orchestra.run.smithi033.stdout:(30/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 15 MB/s | 14 MB 00:00 2024-09-11T23:59:38.595 INFO:teuthology.orchestra.run.smithi033.stdout:(31/285): ceph-mgr-modules-core-19.3.0-4753.gd0 1.7 MB/s | 291 kB 00:00 2024-09-11T23:59:38.637 INFO:teuthology.orchestra.run.smithi033.stdout:(32/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 740 kB/s | 49 kB 00:00 2024-09-11T23:59:38.663 INFO:teuthology.orchestra.run.smithi033.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4753.gd 245 kB/s | 16 kB 00:00 2024-09-11T23:59:38.705 INFO:teuthology.orchestra.run.smithi033.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 4.2 MB/s | 285 kB 00:00 2024-09-11T23:59:38.747 INFO:teuthology.orchestra.run.smithi033.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 9.1 MB/s | 782 kB 00:00 2024-09-11T23:59:38.789 INFO:teuthology.orchestra.run.smithi162.stdout:(10/285): ceph-radosgw-19.3.0-4753.gd011c522.el 16 MB/s | 11 MB 00:00 2024-09-11T23:59:38.831 INFO:teuthology.orchestra.run.smithi162.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 766 kB/s | 32 kB 00:00 2024-09-11T23:59:38.898 INFO:teuthology.orchestra.run.smithi162.stdout:(12/285): libcephfs2-19.3.0-4753.gd011c522.el9. 11 MB/s | 755 kB 00:00 2024-09-11T23:59:38.930 INFO:teuthology.orchestra.run.smithi033.stdout:(36/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.5 MB/s | 335 kB 00:00 2024-09-11T23:59:38.940 INFO:teuthology.orchestra.run.smithi162.stdout:(13/285): libcephsqlite-19.3.0-4753.gd011c522.e 3.8 MB/s | 161 kB 00:00 2024-09-11T23:59:38.955 INFO:teuthology.orchestra.run.smithi033.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 406 kB/s | 85 kB 00:00 2024-09-11T23:59:38.997 INFO:teuthology.orchestra.run.smithi033.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-11T23:59:38.998 INFO:teuthology.orchestra.run.smithi162.stdout:(14/285): librados-devel-19.3.0-4753.gd011c522. 2.1 MB/s | 126 kB 00:00 2024-09-11T23:59:39.056 INFO:teuthology.orchestra.run.smithi033.stdout:(39/285): fuse-2.9.9-16.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-09-11T23:59:39.057 INFO:teuthology.orchestra.run.smithi162.stdout:(15/285): libradosstriper1-19.3.0-4753.gd011c52 8.5 MB/s | 508 kB 00:00 2024-09-11T23:59:39.081 INFO:teuthology.orchestra.run.smithi033.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.0 MB/s | 262 kB 00:00 2024-09-11T23:59:39.307 INFO:teuthology.orchestra.run.smithi162.stdout:(16/285): librgw2-19.3.0-4753.gd011c522.el9.x86 22 MB/s | 5.5 MB 00:00 2024-09-11T23:59:39.358 INFO:teuthology.orchestra.run.smithi162.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 904 kB/s | 45 kB 00:00 2024-09-11T23:59:39.408 INFO:teuthology.orchestra.run.smithi162.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 2.8 MB/s | 143 kB 00:00 2024-09-11T23:59:39.458 INFO:teuthology.orchestra.run.smithi162.stdout:(19/285): python3-cephfs-19.3.0-4753.gd011c522. 3.2 MB/s | 161 kB 00:00 2024-09-11T23:59:39.508 INFO:teuthology.orchestra.run.smithi162.stdout:(20/285): python3-rados-19.3.0-4753.gd011c522.e 6.3 MB/s | 322 kB 00:00 2024-09-11T23:59:39.532 INFO:teuthology.orchestra.run.smithi033.stdout:(41/285): ceph-test-19.3.0-4753.gd011c522.el9.x 15 MB/s | 50 MB 00:03 2024-09-11T23:59:39.556 INFO:teuthology.orchestra.run.smithi033.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 57 kB/s | 27 kB 00:00 2024-09-11T23:59:39.558 INFO:teuthology.orchestra.run.smithi162.stdout:(21/285): python3-rbd-19.3.0-4753.gd011c522.el9 6.0 MB/s | 306 kB 00:00 2024-09-11T23:59:39.599 INFO:teuthology.orchestra.run.smithi033.stdout:(43/285): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-11T23:59:39.600 INFO:teuthology.orchestra.run.smithi162.stdout:(22/285): python3-rgw-19.3.0-4753.gd011c522.el9 2.3 MB/s | 99 kB 00:00 2024-09-11T23:59:39.640 INFO:teuthology.orchestra.run.smithi033.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-09-11T23:59:39.652 INFO:teuthology.orchestra.run.smithi162.stdout:(23/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-11T23:59:39.682 INFO:teuthology.orchestra.run.smithi033.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-11T23:59:39.741 INFO:teuthology.orchestra.run.smithi033.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-11T23:59:39.766 INFO:teuthology.orchestra.run.smithi033.stdout:(47/285): libquadmath-11.5.0-2.el9.x86_64.rpm 816 kB/s | 191 kB 00:00 2024-09-11T23:59:39.808 INFO:teuthology.orchestra.run.smithi033.stdout:(48/285): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-11T23:59:39.809 INFO:teuthology.orchestra.run.smithi162.stdout:(24/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 20 MB/s | 3.2 MB 00:00 2024-09-11T23:59:39.833 INFO:teuthology.orchestra.run.smithi033.stdout:(49/285): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-11T23:59:39.859 INFO:teuthology.orchestra.run.smithi033.stdout:(50/285): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-11T23:59:39.860 INFO:teuthology.orchestra.run.smithi162.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-11T23:59:39.884 INFO:teuthology.orchestra.run.smithi033.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-11T23:59:39.910 INFO:teuthology.orchestra.run.smithi162.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4753.g 687 kB/s | 34 kB 00:00 2024-09-11T23:59:39.960 INFO:teuthology.orchestra.run.smithi162.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 3.0 MB/s | 154 kB 00:00 2024-09-11T23:59:40.101 INFO:teuthology.orchestra.run.smithi033.stdout:(52/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.4 MB/s | 523 kB 00:00 2024-09-11T23:59:40.135 INFO:teuthology.orchestra.run.smithi033.stdout:(53/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.3 MB/s | 650 kB 00:00 2024-09-11T23:59:40.160 INFO:teuthology.orchestra.run.smithi033.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-11T23:59:40.194 INFO:teuthology.orchestra.run.smithi033.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 5.0 MB/s | 302 kB 00:00 2024-09-11T23:59:40.227 INFO:teuthology.orchestra.run.smithi033.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 4.1 MB/s | 283 kB 00:00 2024-09-11T23:59:40.286 INFO:teuthology.orchestra.run.smithi033.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 6.0 MB/s | 559 kB 00:00 2024-09-11T23:59:40.311 INFO:teuthology.orchestra.run.smithi033.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-09-11T23:59:40.344 INFO:teuthology.orchestra.run.smithi033.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.2 MB/s | 195 kB 00:00 2024-09-11T23:59:40.370 INFO:teuthology.orchestra.run.smithi033.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 398 kB/s | 23 kB 00:00 2024-09-11T23:59:40.403 INFO:teuthology.orchestra.run.smithi033.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T23:59:40.429 INFO:teuthology.orchestra.run.smithi033.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 254 kB/s | 15 kB 00:00 2024-09-11T23:59:40.454 INFO:teuthology.orchestra.run.smithi033.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-11T23:59:40.479 INFO:teuthology.orchestra.run.smithi033.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-11T23:59:40.505 INFO:teuthology.orchestra.run.smithi033.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-11T23:59:40.519 INFO:teuthology.orchestra.run.smithi162.stdout:(28/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 25 MB/s | 14 MB 00:00 2024-09-11T23:59:40.530 INFO:teuthology.orchestra.run.smithi033.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-11T23:59:40.555 INFO:teuthology.orchestra.run.smithi033.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 561 kB/s | 28 kB 00:00 2024-09-11T23:59:40.581 INFO:teuthology.orchestra.run.smithi033.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-09-11T23:59:40.639 INFO:teuthology.orchestra.run.smithi033.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 6.1 MB/s | 525 kB 00:00 2024-09-11T23:59:40.706 INFO:teuthology.orchestra.run.smithi033.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 7.7 MB/s | 980 kB 00:00 2024-09-11T23:59:40.764 INFO:teuthology.orchestra.run.smithi033.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-11T23:59:40.790 INFO:teuthology.orchestra.run.smithi033.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.8 MB/s | 325 kB 00:00 2024-09-11T23:59:40.827 INFO:teuthology.orchestra.run.smithi162.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 24 MB/s | 7.4 MB 00:00 2024-09-11T23:59:40.840 INFO:teuthology.orchestra.run.smithi033.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.8 MB/s | 218 kB 00:00 2024-09-11T23:59:40.882 INFO:teuthology.orchestra.run.smithi033.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 518 kB/s | 22 kB 00:00 2024-09-11T23:59:40.932 INFO:teuthology.orchestra.run.smithi033.stdout:(75/285): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-11T23:59:40.991 INFO:teuthology.orchestra.run.smithi033.stdout:(76/285): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-09-11T23:59:41.036 INFO:teuthology.orchestra.run.smithi162.stdout:(30/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 5.2 MB/s | 17 MB 00:03 2024-09-11T23:59:41.041 INFO:teuthology.orchestra.run.smithi033.stdout:(77/285): flatpak-1.12.9-1.el9.x86_64.rpm 6.8 MB/s | 1.7 MB 00:00 2024-09-11T23:59:41.061 INFO:teuthology.orchestra.run.smithi162.stdout:(31/285): ceph-mgr-modules-core-19.3.0-4753.gd0 1.2 MB/s | 291 kB 00:00 2024-09-11T23:59:41.087 INFO:teuthology.orchestra.run.smithi162.stdout:(32/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 986 kB/s | 49 kB 00:00 2024-09-11T23:59:41.100 INFO:teuthology.orchestra.run.smithi033.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-09-11T23:59:41.112 INFO:teuthology.orchestra.run.smithi162.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4753.gd 328 kB/s | 16 kB 00:00 2024-09-11T23:59:41.158 INFO:teuthology.orchestra.run.smithi033.stdout:(79/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-11T23:59:41.162 INFO:teuthology.orchestra.run.smithi162.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 3.7 MB/s | 285 kB 00:00 2024-09-11T23:59:41.204 INFO:teuthology.orchestra.run.smithi162.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 8.3 MB/s | 782 kB 00:00 2024-09-11T23:59:41.217 INFO:teuthology.orchestra.run.smithi033.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-11T23:59:41.301 INFO:teuthology.orchestra.run.smithi033.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 583 kB/s | 49 kB 00:00 2024-09-11T23:59:41.340 INFO:teuthology.orchestra.run.smithi162.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 626 kB/s | 85 kB 00:00 2024-09-11T23:59:41.365 INFO:teuthology.orchestra.run.smithi162.stdout:(37/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.6 MB/s | 335 kB 00:00 2024-09-11T23:59:41.399 INFO:teuthology.orchestra.run.smithi162.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 844 kB/s | 49 kB 00:00 2024-09-11T23:59:41.424 INFO:teuthology.orchestra.run.smithi162.stdout:(39/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 4.4 MB/s | 262 kB 00:00 2024-09-11T23:59:41.434 INFO:teuthology.orchestra.run.smithi033.stdout:(82/285): adwaita-icon-theme-40.1.1-3.el9.noarc 7.6 MB/s | 12 MB 00:01 2024-09-11T23:59:41.458 INFO:teuthology.orchestra.run.smithi162.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-09-11T23:59:41.484 INFO:teuthology.orchestra.run.smithi033.stdout:(83/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.1 MB/s | 3.0 MB 00:00 2024-09-11T23:59:41.509 INFO:teuthology.orchestra.run.smithi162.stdout:(41/285): libgfortran-11.5.0-2.el9.x86_64.rpm 9.4 MB/s | 801 kB 00:00 2024-09-11T23:59:41.518 INFO:teuthology.orchestra.run.smithi033.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 771 kB/s | 64 kB 00:00 2024-09-11T23:59:41.533 INFO:teuthology.orchestra.run.smithi162.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 358 kB/s | 27 kB 00:00 2024-09-11T23:59:41.559 INFO:teuthology.orchestra.run.smithi162.stdout:(43/285): libquadmath-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:59:41.592 INFO:teuthology.orchestra.run.smithi162.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-09-11T23:59:41.618 INFO:teuthology.orchestra.run.smithi162.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-11T23:59:41.661 INFO:teuthology.orchestra.run.smithi033.stdout:(85/285): google-guice-4.2.3-9.el9.noarch.rpm 1.3 MB/s | 473 kB 00:00 2024-09-11T23:59:41.685 INFO:teuthology.orchestra.run.smithi162.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-11T23:59:41.735 INFO:teuthology.orchestra.run.smithi162.stdout:(47/285): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T23:59:41.752 INFO:teuthology.orchestra.run.smithi033.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 127 kB/s | 34 kB 00:00 2024-09-11T23:59:41.769 INFO:teuthology.orchestra.run.smithi162.stdout:(48/285): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-11T23:59:41.794 INFO:teuthology.orchestra.run.smithi162.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-11T23:59:41.819 INFO:teuthology.orchestra.run.smithi162.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-11T23:59:42.036 INFO:teuthology.orchestra.run.smithi033.stdout:(87/285): gstreamer1-plugins-base-1.22.1-2.el9. 6.0 MB/s | 2.2 MB 00:00 2024-09-11T23:59:42.061 INFO:teuthology.orchestra.run.smithi033.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 107 kB/s | 33 kB 00:00 2024-09-11T23:59:42.161 INFO:teuthology.orchestra.run.smithi033.stdout:(89/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 2.2 MB/s | 1.4 MB 00:00 2024-09-11T23:59:42.261 INFO:teuthology.orchestra.run.smithi162.stdout:(51/285): ceph-test-19.3.0-4753.gd011c522.el9.x 13 MB/s | 50 MB 00:03 2024-09-11T23:59:42.345 INFO:teuthology.orchestra.run.smithi033.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 1.2 MB/s | 219 kB 00:00 2024-09-11T23:59:42.453 INFO:teuthology.orchestra.run.smithi162.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 987 kB/s | 650 kB 00:00 2024-09-11T23:59:42.470 INFO:teuthology.orchestra.run.smithi033.stdout:(91/285): httpcomponents-client-4.5.13-3.el9.no 5.1 MB/s | 657 kB 00:00 2024-09-11T23:59:42.478 INFO:teuthology.orchestra.run.smithi162.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.4 MB/s | 523 kB 00:00 2024-09-11T23:59:42.504 INFO:teuthology.orchestra.run.smithi162.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-11T23:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 302 kB 00:00 2024-09-11T23:59:42.563 INFO:teuthology.orchestra.run.smithi162.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-11T23:59:42.587 INFO:teuthology.orchestra.run.smithi033.stdout:(92/285): httpcomponents-core-4.4.13-7.el9.noar 5.3 MB/s | 632 kB 00:00 2024-09-11T23:59:42.629 INFO:teuthology.orchestra.run.smithi033.stdout:(93/285): guava-30.1-6.el9.noarch.rpm 4.1 MB/s | 2.3 MB 00:00 2024-09-11T23:59:42.687 INFO:teuthology.orchestra.run.smithi033.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 776 kB/s | 45 kB 00:00 2024-09-11T23:59:42.729 INFO:teuthology.orchestra.run.smithi162.stdout:(57/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 521 kB/s | 87 kB 00:00 2024-09-11T23:59:42.754 INFO:teuthology.orchestra.run.smithi033.stdout:(95/285): gtk3-3.24.31-5.el9.x86_64.rpm 6.8 MB/s | 4.9 MB 00:00 2024-09-11T23:59:42.763 INFO:teuthology.orchestra.run.smithi162.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 2.3 MB/s | 559 kB 00:00 2024-09-11T23:59:42.780 INFO:teuthology.orchestra.run.smithi033.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 1.2 MB/s | 110 kB 00:00 2024-09-11T23:59:42.822 INFO:teuthology.orchestra.run.smithi162.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-09-11T23:59:42.838 INFO:teuthology.orchestra.run.smithi033.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 4.8 MB/s | 413 kB 00:00 2024-09-11T23:59:42.838 INFO:teuthology.orchestra.run.smithi162.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 309 kB/s | 23 kB 00:00 2024-09-11T23:59:42.889 INFO:teuthology.orchestra.run.smithi162.stdout:(61/285): avahi-glib-0.8-21.el9.x86_64.rpm 298 kB/s | 15 kB 00:00 2024-09-11T23:59:42.916 INFO:teuthology.orchestra.run.smithi162.stdout:(62/285): atk-2.36.0-5.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-11T23:59:42.948 INFO:teuthology.orchestra.run.smithi162.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-11T23:59:42.973 INFO:teuthology.orchestra.run.smithi162.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 904 kB/s | 53 kB 00:00 2024-09-11T23:59:43.007 INFO:teuthology.orchestra.run.smithi162.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-09-11T23:59:43.032 INFO:teuthology.orchestra.run.smithi162.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-11T23:59:43.058 INFO:teuthology.orchestra.run.smithi162.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 563 kB/s | 28 kB 00:00 2024-09-11T23:59:43.083 INFO:teuthology.orchestra.run.smithi162.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-09-11T23:59:43.122 INFO:teuthology.orchestra.run.smithi033.stdout:(98/285): iso-codes-4.6.0-3.el9.noarch.rpm 6.6 MB/s | 3.5 MB 00:00 2024-09-11T23:59:43.142 INFO:teuthology.orchestra.run.smithi162.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 6.1 MB/s | 525 kB 00:00 2024-09-11T23:59:43.172 INFO:teuthology.orchestra.run.smithi033.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 261 kB/s | 13 kB 00:00 2024-09-11T23:59:43.239 INFO:teuthology.orchestra.run.smithi033.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 796 kB/s | 53 kB 00:00 2024-09-11T23:59:43.242 INFO:teuthology.orchestra.run.smithi162.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 6.0 MB/s | 980 kB 00:00 2024-09-11T23:59:43.284 INFO:teuthology.orchestra.run.smithi162.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 5.4 MB/s | 781 kB 00:00 2024-09-11T23:59:43.297 INFO:teuthology.orchestra.run.smithi033.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 412 kB/s | 24 kB 00:00 2024-09-11T23:59:43.342 INFO:teuthology.orchestra.run.smithi162.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 325 kB 00:00 2024-09-11T23:59:43.368 INFO:teuthology.orchestra.run.smithi162.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-09-11T23:59:43.381 INFO:teuthology.orchestra.run.smithi033.stdout:(102/285): jsoup-1.13.1-10.el9.noarch.rpm 4.4 MB/s | 377 kB 00:00 2024-09-11T23:59:43.418 INFO:teuthology.orchestra.run.smithi162.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 432 kB/s | 22 kB 00:00 2024-09-11T23:59:43.431 INFO:teuthology.orchestra.run.smithi033.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 710 kB/s | 35 kB 00:00 2024-09-11T23:59:43.469 INFO:teuthology.orchestra.run.smithi162.stdout:(75/285): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-11T23:59:43.507 INFO:teuthology.orchestra.run.smithi033.stdout:(104/285): lcms2-2.12-3.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2024-09-11T23:59:43.519 INFO:teuthology.orchestra.run.smithi162.stdout:(76/285): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-11T23:59:43.557 INFO:teuthology.orchestra.run.smithi033.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 222 kB/s | 11 kB 00:00 2024-09-11T23:59:43.607 INFO:teuthology.orchestra.run.smithi033.stdout:(106/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 484 kB/s | 24 kB 00:00 2024-09-11T23:59:43.619 INFO:teuthology.orchestra.run.smithi162.stdout:(77/285): flatpak-1.12.9-1.el9.x86_64.rpm 6.2 MB/s | 1.7 MB 00:00 2024-09-11T23:59:43.657 INFO:teuthology.orchestra.run.smithi033.stdout:(107/285): java-11-openjdk-devel-11.0.20.1.1-2. 3.8 MB/s | 3.3 MB 00:00 2024-09-11T23:59:43.678 INFO:teuthology.orchestra.run.smithi162.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-09-11T23:59:43.682 INFO:teuthology.orchestra.run.smithi033.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 410 kB/s | 31 kB 00:00 2024-09-11T23:59:43.700 INFO:teuthology.orchestra.run.smithi033.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 545 kB/s | 23 kB 00:00 2024-09-11T23:59:43.725 INFO:teuthology.orchestra.run.smithi033.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 472 kB/s | 20 kB 00:00 2024-09-11T23:59:43.736 INFO:teuthology.orchestra.run.smithi162.stdout:(79/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-11T23:59:43.741 INFO:teuthology.orchestra.run.smithi033.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 949 kB/s | 40 kB 00:00 2024-09-11T23:59:43.767 INFO:teuthology.orchestra.run.smithi033.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 359 kB/s | 15 kB 00:00 2024-09-11T23:59:43.784 INFO:teuthology.orchestra.run.smithi033.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 679 kB/s | 28 kB 00:00 2024-09-11T23:59:43.803 INFO:teuthology.orchestra.run.smithi162.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 124 kB 00:00 2024-09-11T23:59:43.809 INFO:teuthology.orchestra.run.smithi033.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 512 kB/s | 21 kB 00:00 2024-09-11T23:59:43.835 INFO:teuthology.orchestra.run.smithi033.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 377 kB/s | 19 kB 00:00 2024-09-11T23:59:43.860 INFO:teuthology.orchestra.run.smithi033.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-09-11T23:59:43.862 INFO:teuthology.orchestra.run.smithi162.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 834 kB/s | 49 kB 00:00 2024-09-11T23:59:43.885 INFO:teuthology.orchestra.run.smithi033.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 608 kB/s | 30 kB 00:00 2024-09-11T23:59:43.912 INFO:teuthology.orchestra.run.smithi162.stdout:(82/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-09-11T23:59:43.919 INFO:teuthology.orchestra.run.smithi033.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-11T23:59:43.944 INFO:teuthology.orchestra.run.smithi033.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 543 kB/s | 32 kB 00:00 2024-09-11T23:59:43.971 INFO:teuthology.orchestra.run.smithi162.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 4.3 MB/s | 473 kB 00:00 2024-09-11T23:59:43.978 INFO:teuthology.orchestra.run.smithi033.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-11T23:59:43.996 INFO:teuthology.orchestra.run.smithi162.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 770 kB/s | 64 kB 00:00 2024-09-11T23:59:44.022 INFO:teuthology.orchestra.run.smithi162.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 680 kB/s | 34 kB 00:00 2024-09-11T23:59:44.036 INFO:teuthology.orchestra.run.smithi033.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-09-11T23:59:44.095 INFO:teuthology.orchestra.run.smithi033.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 3.6 MB/s | 435 kB 00:00 2024-09-11T23:59:44.120 INFO:teuthology.orchestra.run.smithi033.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 370 kB/s | 31 kB 00:00 2024-09-11T23:59:44.147 INFO:teuthology.orchestra.run.smithi162.stdout:(86/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-11T23:59:44.154 INFO:teuthology.orchestra.run.smithi033.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-11T23:59:44.179 INFO:teuthology.orchestra.run.smithi033.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-11T23:59:44.213 INFO:teuthology.orchestra.run.smithi033.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 628 kB/s | 37 kB 00:00 2024-09-11T23:59:44.263 INFO:teuthology.orchestra.run.smithi033.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.7 MB/s | 142 kB 00:00 2024-09-11T23:59:44.313 INFO:teuthology.orchestra.run.smithi033.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 2.5 MB/s | 256 kB 00:00 2024-09-11T23:59:44.339 INFO:teuthology.orchestra.run.smithi033.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-09-11T23:59:44.356 INFO:teuthology.orchestra.run.smithi162.stdout:(87/285): adwaita-icon-theme-40.1.1-3.el9.noarc 4.7 MB/s | 12 MB 00:02 2024-09-11T23:59:44.364 INFO:teuthology.orchestra.run.smithi033.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-11T23:59:44.381 INFO:teuthology.orchestra.run.smithi162.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 141 kB/s | 33 kB 00:00 2024-09-11T23:59:44.389 INFO:teuthology.orchestra.run.smithi033.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 825 kB/s | 41 kB 00:00 2024-09-11T23:59:44.414 INFO:teuthology.orchestra.run.smithi033.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 867 kB/s | 44 kB 00:00 2024-09-11T23:59:44.449 INFO:teuthology.orchestra.run.smithi033.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 574 kB/s | 34 kB 00:00 2024-09-11T23:59:44.456 INFO:teuthology.orchestra.run.smithi162.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 5.2 MB/s | 2.2 MB 00:00 2024-09-11T23:59:44.507 INFO:teuthology.orchestra.run.smithi033.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 3.4 MB/s | 319 kB 00:00 2024-09-11T23:59:44.515 INFO:teuthology.orchestra.run.smithi162.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 3.7 MB/s | 219 kB 00:00 2024-09-11T23:59:44.557 INFO:teuthology.orchestra.run.smithi033.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-11T23:59:44.582 INFO:teuthology.orchestra.run.smithi033.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-11T23:59:44.633 INFO:teuthology.orchestra.run.smithi033.stdout:(137/285): libsbc-1.4-9.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-11T23:59:44.640 INFO:teuthology.orchestra.run.smithi162.stdout:(91/285): guava-30.1-6.el9.noarch.rpm 8.9 MB/s | 2.3 MB 00:00 2024-09-11T23:59:44.666 INFO:teuthology.orchestra.run.smithi162.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 4.3 MB/s | 657 kB 00:00 2024-09-11T23:59:44.691 INFO:teuthology.orchestra.run.smithi033.stdout:(138/285): libsndfile-1.0.31-8.el9.x86_64.rpm 3.5 MB/s | 206 kB 00:00 2024-09-11T23:59:44.724 INFO:teuthology.orchestra.run.smithi162.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 7.4 MB/s | 632 kB 00:00 2024-09-11T23:59:44.750 INFO:teuthology.orchestra.run.smithi033.stdout:(139/285): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-11T23:59:44.766 INFO:teuthology.orchestra.run.smithi162.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 1.1 MB/s | 45 kB 00:00 2024-09-11T23:59:44.775 INFO:teuthology.orchestra.run.smithi033.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 1.9 MB/s | 164 kB 00:00 2024-09-11T23:59:44.825 INFO:teuthology.orchestra.run.smithi162.stdout:(95/285): jansi-2.3.3-6.el9.x86_64.rpm 1.8 MB/s | 110 kB 00:00 2024-09-11T23:59:44.825 INFO:teuthology.orchestra.run.smithi033.stdout:(141/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 714 kB/s | 36 kB 00:00 2024-09-11T23:59:44.851 INFO:teuthology.orchestra.run.smithi033.stdout:(142/285): libtiff-4.4.0-13.el9.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2024-09-11T23:59:44.901 INFO:teuthology.orchestra.run.smithi033.stdout:(143/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-09-11T23:59:44.908 INFO:teuthology.orchestra.run.smithi162.stdout:(96/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 4.8 MB/s | 413 kB 00:00 2024-09-11T23:59:44.935 INFO:teuthology.orchestra.run.smithi033.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 2.9 MB/s | 324 kB 00:00 2024-09-11T23:59:44.993 INFO:teuthology.orchestra.run.smithi033.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 2.0 MB/s | 193 kB 00:00 2024-09-11T23:59:45.010 INFO:teuthology.orchestra.run.smithi033.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 444 kB/s | 33 kB 00:00 2024-09-11T23:59:45.036 INFO:teuthology.orchestra.run.smithi033.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 463 kB/s | 19 kB 00:00 2024-09-11T23:59:45.061 INFO:teuthology.orchestra.run.smithi033.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 255 kB/s | 13 kB 00:00 2024-09-11T23:59:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:(97/285): gtk3-3.24.31-5.el9.x86_64.rpm 6.7 MB/s | 4.9 MB 00:00 2024-09-11T23:59:45.086 INFO:teuthology.orchestra.run.smithi033.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 832 kB/s | 42 kB 00:00 2024-09-11T23:59:45.136 INFO:teuthology.orchestra.run.smithi033.stdout:(150/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-11T23:59:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:(98/285): iso-codes-4.6.0-3.el9.noarch.rpm 7.4 MB/s | 3.5 MB 00:00 2024-09-11T23:59:45.162 INFO:teuthology.orchestra.run.smithi033.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 2.7 MB/s | 277 kB 00:00 2024-09-11T23:59:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 262 kB/s | 13 kB 00:00 2024-09-11T23:59:45.195 INFO:teuthology.orchestra.run.smithi033.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 215 kB/s | 13 kB 00:00 2024-09-11T23:59:45.221 INFO:teuthology.orchestra.run.smithi033.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 611 kB/s | 36 kB 00:00 2024-09-11T23:59:45.268 INFO:teuthology.orchestra.run.smithi162.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 706 kB/s | 53 kB 00:00 2024-09-11T23:59:45.279 INFO:teuthology.orchestra.run.smithi033.stdout:(154/285): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-11T23:59:45.313 INFO:teuthology.orchestra.run.smithi033.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T23:59:45.326 INFO:teuthology.orchestra.run.smithi162.stdout:(101/285): java-11-openjdk-devel-11.0.20.1.1-2. 7.9 MB/s | 3.3 MB 00:00 2024-09-11T23:59:45.338 INFO:teuthology.orchestra.run.smithi033.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-11T23:59:45.352 INFO:teuthology.orchestra.run.smithi162.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 287 kB/s | 24 kB 00:00 2024-09-11T23:59:45.363 INFO:teuthology.orchestra.run.smithi033.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 353 kB/s | 18 kB 00:00 2024-09-11T23:59:45.385 INFO:teuthology.orchestra.run.smithi162.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-11T23:59:45.411 INFO:teuthology.orchestra.run.smithi162.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 605 kB/s | 35 kB 00:00 2024-09-11T23:59:45.413 INFO:teuthology.orchestra.run.smithi033.stdout:(158/285): maven-openjdk11-3.6.3-15.el9.noarch. 180 kB/s | 9.0 kB 00:00 2024-09-11T23:59:45.436 INFO:teuthology.orchestra.run.smithi162.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-09-11T23:59:45.461 INFO:teuthology.orchestra.run.smithi162.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 220 kB/s | 11 kB 00:00 2024-09-11T23:59:45.486 INFO:teuthology.orchestra.run.smithi162.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-11T23:59:45.512 INFO:teuthology.orchestra.run.smithi162.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 612 kB/s | 31 kB 00:00 2024-09-11T23:59:45.537 INFO:teuthology.orchestra.run.smithi162.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 454 kB/s | 23 kB 00:00 2024-09-11T23:59:45.562 INFO:teuthology.orchestra.run.smithi162.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-11T23:59:45.572 INFO:teuthology.orchestra.run.smithi033.stdout:(159/285): maven-lib-3.6.3-15.el9.noarch.rpm 6.3 MB/s | 1.5 MB 00:00 2024-09-11T23:59:45.588 INFO:teuthology.orchestra.run.smithi162.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 785 kB/s | 40 kB 00:00 2024-09-11T23:59:45.598 INFO:teuthology.orchestra.run.smithi033.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 2.8 MB/s | 517 kB 00:00 2024-09-11T23:59:45.613 INFO:teuthology.orchestra.run.smithi162.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-09-11T23:59:45.638 INFO:teuthology.orchestra.run.smithi162.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 565 kB/s | 28 kB 00:00 2024-09-11T23:59:45.648 INFO:teuthology.orchestra.run.smithi033.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.0 MB/s | 151 kB 00:00 2024-09-11T23:59:45.664 INFO:teuthology.orchestra.run.smithi162.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 426 kB/s | 21 kB 00:00 2024-09-11T23:59:45.673 INFO:teuthology.orchestra.run.smithi033.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.5 MB/s | 112 kB 00:00 2024-09-11T23:59:45.689 INFO:teuthology.orchestra.run.smithi162.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 381 kB/s | 19 kB 00:00 2024-09-11T23:59:45.714 INFO:teuthology.orchestra.run.smithi162.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-09-11T23:59:45.723 INFO:teuthology.orchestra.run.smithi033.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 225 kB/s | 11 kB 00:00 2024-09-11T23:59:45.740 INFO:teuthology.orchestra.run.smithi162.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 601 kB/s | 30 kB 00:00 2024-09-11T23:59:45.765 INFO:teuthology.orchestra.run.smithi162.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-11T23:59:45.782 INFO:teuthology.orchestra.run.smithi033.stdout:(164/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-11T23:59:45.790 INFO:teuthology.orchestra.run.smithi162.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 632 kB/s | 32 kB 00:00 2024-09-11T23:59:45.824 INFO:teuthology.orchestra.run.smithi162.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-11T23:59:45.841 INFO:teuthology.orchestra.run.smithi033.stdout:(165/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-11T23:59:45.849 INFO:teuthology.orchestra.run.smithi162.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-09-11T23:59:45.899 INFO:teuthology.orchestra.run.smithi033.stdout:(166/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 624 kB/s | 36 kB 00:00 2024-09-11T23:59:45.899 INFO:teuthology.orchestra.run.smithi162.stdout:(122/285): libfontenc-1.1.3-17.el9.x86_64.rpm 621 kB/s | 31 kB 00:00 2024-09-11T23:59:45.925 INFO:teuthology.orchestra.run.smithi162.stdout:(123/285): libexif-0.6.22-6.el9.x86_64.rpm 4.2 MB/s | 435 kB 00:00 2024-09-11T23:59:45.958 INFO:teuthology.orchestra.run.smithi033.stdout:(167/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 788 kB/s | 46 kB 00:00 2024-09-11T23:59:45.958 INFO:teuthology.orchestra.run.smithi162.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-11T23:59:46.017 INFO:teuthology.orchestra.run.smithi162.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.4 MB/s | 135 kB 00:00 2024-09-11T23:59:46.043 INFO:teuthology.orchestra.run.smithi162.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 439 kB/s | 37 kB 00:00 2024-09-11T23:59:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:(168/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 276 kB/s | 32 kB 00:00 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi162.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-11T23:59:46.102 INFO:teuthology.orchestra.run.smithi162.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-11T23:59:46.133 INFO:teuthology.orchestra.run.smithi033.stdout:(169/285): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-11T23:59:46.135 INFO:teuthology.orchestra.run.smithi162.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-11T23:59:46.152 INFO:teuthology.orchestra.run.smithi162.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-11T23:59:46.177 INFO:teuthology.orchestra.run.smithi162.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 984 kB/s | 41 kB 00:00 2024-09-11T23:59:46.194 INFO:teuthology.orchestra.run.smithi162.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-09-11T23:59:46.220 INFO:teuthology.orchestra.run.smithi162.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 801 kB/s | 34 kB 00:00 2024-09-11T23:59:46.253 INFO:teuthology.orchestra.run.smithi162.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-11T23:59:46.278 INFO:teuthology.orchestra.run.smithi162.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-11T23:59:46.304 INFO:teuthology.orchestra.run.smithi162.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-11T23:59:46.354 INFO:teuthology.orchestra.run.smithi162.stdout:(137/285): libsbc-1.4-9.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-11T23:59:46.413 INFO:teuthology.orchestra.run.smithi162.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-11T23:59:46.438 INFO:teuthology.orchestra.run.smithi162.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 2.4 MB/s | 206 kB 00:00 2024-09-11T23:59:46.472 INFO:teuthology.orchestra.run.smithi162.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-11T23:59:46.497 INFO:teuthology.orchestra.run.smithi162.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-11T23:59:46.531 INFO:teuthology.orchestra.run.smithi162.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 610 kB/s | 36 kB 00:00 2024-09-11T23:59:46.556 INFO:teuthology.orchestra.run.smithi162.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 5.4 MB/s | 324 kB 00:00 2024-09-11T23:59:46.590 INFO:teuthology.orchestra.run.smithi162.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-11T23:59:46.615 INFO:teuthology.orchestra.run.smithi162.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-11T23:59:46.649 INFO:teuthology.orchestra.run.smithi162.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 569 kB/s | 33 kB 00:00 2024-09-11T23:59:46.674 INFO:teuthology.orchestra.run.smithi162.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 331 kB/s | 19 kB 00:00 2024-09-11T23:59:46.700 INFO:teuthology.orchestra.run.smithi162.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 255 kB/s | 13 kB 00:00 2024-09-11T23:59:46.725 INFO:teuthology.orchestra.run.smithi162.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 830 kB/s | 42 kB 00:00 2024-09-11T23:59:46.775 INFO:teuthology.orchestra.run.smithi033.stdout:(170/285): java-11-openjdk-headless-11.0.20.1.1 9.9 MB/s | 39 MB 00:03 2024-09-11T23:59:46.783 INFO:teuthology.orchestra.run.smithi162.stdout:(150/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-11T23:59:46.817 INFO:teuthology.orchestra.run.smithi162.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 2.3 MB/s | 277 kB 00:00 2024-09-11T23:59:46.842 INFO:teuthology.orchestra.run.smithi162.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 215 kB/s | 13 kB 00:00 2024-09-11T23:59:46.875 INFO:teuthology.orchestra.run.smithi033.stdout:(171/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 7.1 MB/s | 8.8 MB 00:01 2024-09-11T23:59:46.876 INFO:teuthology.orchestra.run.smithi162.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 613 kB/s | 36 kB 00:00 2024-09-11T23:59:46.901 INFO:teuthology.orchestra.run.smithi033.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.3 MB/s | 163 kB 00:00 2024-09-11T23:59:46.901 INFO:teuthology.orchestra.run.smithi162.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T23:59:46.935 INFO:teuthology.orchestra.run.smithi162.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-11T23:59:46.959 INFO:teuthology.orchestra.run.smithi033.stdout:(173/285): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-11T23:59:46.960 INFO:teuthology.orchestra.run.smithi162.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-11T23:59:46.985 INFO:teuthology.orchestra.run.smithi033.stdout:(174/285): opus-1.3.1-10.el9.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-09-11T23:59:46.986 INFO:teuthology.orchestra.run.smithi162.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 351 kB/s | 18 kB 00:00 2024-09-11T23:59:47.035 INFO:teuthology.orchestra.run.smithi033.stdout:(175/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.4 MB/s | 74 kB 00:00 2024-09-11T23:59:47.036 INFO:teuthology.orchestra.run.smithi162.stdout:(158/285): maven-openjdk11-3.6.3-15.el9.noarch. 181 kB/s | 9.0 kB 00:00 2024-09-11T23:59:47.085 INFO:teuthology.orchestra.run.smithi033.stdout:(176/285): osinfo-db-20240701-2.el9.noarch.rpm 4.1 MB/s | 531 kB 00:00 2024-09-11T23:59:47.136 INFO:teuthology.orchestra.run.smithi162.stdout:(159/285): maven-lib-3.6.3-15.el9.noarch.rpm 8.5 MB/s | 1.5 MB 00:00 2024-09-11T23:59:47.144 INFO:teuthology.orchestra.run.smithi033.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 4.2 MB/s | 468 kB 00:00 2024-09-11T23:59:47.161 INFO:teuthology.orchestra.run.smithi162.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 4.0 MB/s | 517 kB 00:00 2024-09-11T23:59:47.169 INFO:teuthology.orchestra.run.smithi033.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 2.9 MB/s | 246 kB 00:00 2024-09-11T23:59:47.195 INFO:teuthology.orchestra.run.smithi162.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-11T23:59:47.203 INFO:teuthology.orchestra.run.smithi033.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-11T23:59:47.212 INFO:teuthology.orchestra.run.smithi162.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-11T23:59:47.220 INFO:teuthology.orchestra.run.smithi033.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-11T23:59:47.246 INFO:teuthology.orchestra.run.smithi033.stdout:(181/285): pipewire-jack-audio-connection-kit-1 219 kB/s | 9.1 kB 00:00 2024-09-11T23:59:47.254 INFO:teuthology.orchestra.run.smithi162.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 271 kB/s | 11 kB 00:00 2024-09-11T23:59:47.271 INFO:teuthology.orchestra.run.smithi033.stdout:(182/285): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-11T23:59:47.305 INFO:teuthology.orchestra.run.smithi162.stdout:(164/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.7 MB/s | 139 kB 00:00 2024-09-11T23:59:47.329 INFO:teuthology.orchestra.run.smithi033.stdout:(183/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-11T23:59:47.363 INFO:teuthology.orchestra.run.smithi162.stdout:(165/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-11T23:59:47.388 INFO:teuthology.orchestra.run.smithi033.stdout:(184/285): plexus-cipher-1.7-27.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-11T23:59:47.413 INFO:teuthology.orchestra.run.smithi162.stdout:(166/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 722 kB/s | 36 kB 00:00 2024-09-11T23:59:47.456 INFO:teuthology.orchestra.run.smithi162.stdout:(167/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 1.1 MB/s | 46 kB 00:00 2024-09-11T23:59:47.463 INFO:teuthology.orchestra.run.smithi033.stdout:(185/285): openblas-openmp-0.3.26-2.el9.x86_64. 3.7 MB/s | 4.9 MB 00:01 2024-09-11T23:59:47.488 INFO:teuthology.orchestra.run.smithi033.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 599 kB/s | 60 kB 00:00 2024-09-11T23:59:47.511 INFO:teuthology.orchestra.run.smithi162.stdout:(168/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 585 kB/s | 32 kB 00:00 2024-09-11T23:59:47.513 INFO:teuthology.orchestra.run.smithi033.stdout:(187/285): plexus-containers-component-annotati 366 kB/s | 18 kB 00:00 2024-09-11T23:59:47.556 INFO:teuthology.orchestra.run.smithi033.stdout:(188/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 6.2 MB/s | 1.9 MB 00:00 2024-09-11T23:59:47.570 INFO:teuthology.orchestra.run.smithi162.stdout:(169/285): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-11T23:59:47.581 INFO:teuthology.orchestra.run.smithi033.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 502 kB/s | 34 kB 00:00 2024-09-11T23:59:47.606 INFO:teuthology.orchestra.run.smithi033.stdout:(190/285): plexus-interpolation-1.26-11.el9.noa 678 kB/s | 80 kB 00:00 2024-09-11T23:59:47.631 INFO:teuthology.orchestra.run.smithi033.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-11T23:59:47.690 INFO:teuthology.orchestra.run.smithi033.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.5 MB/s | 152 kB 00:00 2024-09-11T23:59:47.807 INFO:teuthology.orchestra.run.smithi033.stdout:(193/285): poppler-21.01.0-21.el9.x86_64.rpm 4.7 MB/s | 1.1 MB 00:00 2024-09-11T23:59:47.841 INFO:teuthology.orchestra.run.smithi033.stdout:(194/285): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-11T23:59:47.845 INFO:teuthology.orchestra.run.smithi162.stdout:(170/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 13 MB/s | 8.8 MB 00:00 2024-09-11T23:59:47.866 INFO:teuthology.orchestra.run.smithi033.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.4 MB/s | 83 kB 00:00 2024-09-11T23:59:47.904 INFO:teuthology.orchestra.run.smithi162.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-11T23:59:47.907 INFO:teuthology.orchestra.run.smithi033.stdout:(196/285): poppler-data-0.4.9-9.el9.noarch.rpm 6.2 MB/s | 1.9 MB 00:00 2024-09-11T23:59:47.962 INFO:teuthology.orchestra.run.smithi162.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-09-11T23:59:47.966 INFO:teuthology.orchestra.run.smithi033.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.3 MB/s | 679 kB 00:00 2024-09-11T23:59:47.991 INFO:teuthology.orchestra.run.smithi033.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 2.9 MB/s | 245 kB 00:00 2024-09-11T23:59:48.021 INFO:teuthology.orchestra.run.smithi162.stdout:(173/285): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-11T23:59:48.025 INFO:teuthology.orchestra.run.smithi033.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-09-11T23:59:48.050 INFO:teuthology.orchestra.run.smithi033.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 437 kB/s | 26 kB 00:00 2024-09-11T23:59:48.084 INFO:teuthology.orchestra.run.smithi033.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 327 kB/s | 19 kB 00:00 2024-09-11T23:59:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:(174/285): osinfo-db-20240701-2.el9.noarch.rpm 7.8 MB/s | 531 kB 00:00 2024-09-11T23:59:48.109 INFO:teuthology.orchestra.run.smithi033.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T23:59:48.134 INFO:teuthology.orchestra.run.smithi033.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 694 kB/s | 35 kB 00:00 2024-09-11T23:59:48.146 INFO:teuthology.orchestra.run.smithi162.stdout:(175/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-11T23:59:48.193 INFO:teuthology.orchestra.run.smithi033.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-11T23:59:48.252 INFO:teuthology.orchestra.run.smithi033.stdout:(205/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-11T23:59:48.255 INFO:teuthology.orchestra.run.smithi162.stdout:(176/285): openblas-openmp-0.3.26-2.el9.x86_64. 7.2 MB/s | 4.9 MB 00:00 2024-09-11T23:59:48.280 INFO:teuthology.orchestra.run.smithi162.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 3.4 MB/s | 468 kB 00:00 2024-09-11T23:59:48.302 INFO:teuthology.orchestra.run.smithi033.stdout:(206/285): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-11T23:59:48.314 INFO:teuthology.orchestra.run.smithi162.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-11T23:59:48.339 INFO:teuthology.orchestra.run.smithi162.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-11T23:59:48.361 INFO:teuthology.orchestra.run.smithi033.stdout:(207/285): python3-prettytable-0.7.2-27.el9.noa 724 kB/s | 42 kB 00:00 2024-09-11T23:59:48.373 INFO:teuthology.orchestra.run.smithi162.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 978 kB/s | 57 kB 00:00 2024-09-11T23:59:48.398 INFO:teuthology.orchestra.run.smithi162.stdout:(181/285): pipewire-jack-audio-connection-kit-1 156 kB/s | 9.1 kB 00:00 2024-09-11T23:59:48.428 INFO:teuthology.orchestra.run.smithi033.stdout:(208/285): python3-protobuf-3.14.0-13.el9.noarc 3.9 MB/s | 269 kB 00:00 2024-09-11T23:59:48.432 INFO:teuthology.orchestra.run.smithi162.stdout:(182/285): pipewire-jack-audio-connection-kit-l 2.3 MB/s | 135 kB 00:00 2024-09-11T23:59:48.486 INFO:teuthology.orchestra.run.smithi033.stdout:(209/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-09-11T23:59:48.490 INFO:teuthology.orchestra.run.smithi162.stdout:(183/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-11T23:59:48.545 INFO:teuthology.orchestra.run.smithi033.stdout:(210/285): python3-pyasn1-modules-0.4.8-6.el9.n 4.7 MB/s | 279 kB 00:00 2024-09-11T23:59:48.558 INFO:teuthology.orchestra.run.smithi162.stdout:(184/285): plexus-cipher-1.7-27.el9.noarch.rpm 386 kB/s | 26 kB 00:00 2024-09-11T23:59:48.595 INFO:teuthology.orchestra.run.smithi033.stdout:(211/285): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T23:59:48.600 INFO:teuthology.orchestra.run.smithi162.stdout:(185/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 9.6 MB/s | 1.9 MB 00:00 2024-09-11T23:59:48.625 INFO:teuthology.orchestra.run.smithi162.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 895 kB/s | 60 kB 00:00 2024-09-11T23:59:48.645 INFO:teuthology.orchestra.run.smithi033.stdout:(212/285): python3-requests-oauthlib-1.3.0-12.e 1.1 MB/s | 54 kB 00:00 2024-09-11T23:59:48.650 INFO:teuthology.orchestra.run.smithi162.stdout:(187/285): plexus-containers-component-annotati 364 kB/s | 18 kB 00:00 2024-09-11T23:59:48.676 INFO:teuthology.orchestra.run.smithi162.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 1.6 MB/s | 80 kB 00:00 2024-09-11T23:59:48.771 INFO:teuthology.orchestra.run.smithi033.stdout:(213/285): python3-numpy-1.20.1-5.el9.x86_64.rp 7.7 MB/s | 5.1 MB 00:00 2024-09-11T23:59:48.821 INFO:teuthology.orchestra.run.smithi033.stdout:(214/285): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-11T23:59:48.879 INFO:teuthology.orchestra.run.smithi033.stdout:(215/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T23:59:48.930 INFO:teuthology.orchestra.run.smithi033.stdout:(216/285): qatlib-service-24.02.0-1.el9.x86_64. 717 kB/s | 36 kB 00:00 2024-09-11T23:59:48.972 INFO:teuthology.orchestra.run.smithi033.stdout:(217/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-11T23:59:49.034 INFO:teuthology.orchestra.run.smithi162.stdout:(189/285): java-11-openjdk-headless-11.0.20.1.1 9.9 MB/s | 39 MB 00:03 2024-09-11T23:59:49.047 INFO:teuthology.orchestra.run.smithi033.stdout:(218/285): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-11T23:59:49.060 INFO:teuthology.orchestra.run.smithi162.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 82 kB/s | 34 kB 00:00 2024-09-11T23:59:49.064 INFO:teuthology.orchestra.run.smithi033.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 609 kB/s | 56 kB 00:00 2024-09-11T23:59:49.085 INFO:teuthology.orchestra.run.smithi162.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 621 kB/s | 254 kB 00:00 2024-09-11T23:59:49.123 INFO:teuthology.orchestra.run.smithi033.stdout:(220/285): slf4j-1.7.30-13.el9.noarch.rpm 1.2 MB/s | 69 kB 00:00 2024-09-11T23:59:49.177 INFO:teuthology.orchestra.run.smithi162.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.6 MB/s | 152 kB 00:00 2024-09-11T23:59:49.181 INFO:teuthology.orchestra.run.smithi033.stdout:(221/285): sisu-0.3.4-10.el9.noarch.rpm 3.7 MB/s | 510 kB 00:00 2024-09-11T23:59:49.206 INFO:teuthology.orchestra.run.smithi033.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-11T23:59:49.244 INFO:teuthology.orchestra.run.smithi162.stdout:(193/285): poppler-21.01.0-21.el9.x86_64.rpm 5.1 MB/s | 1.1 MB 00:00 2024-09-11T23:59:49.257 INFO:teuthology.orchestra.run.smithi033.stdout:(223/285): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-11T23:59:49.290 INFO:teuthology.orchestra.run.smithi033.stdout:(224/285): sound-theme-freedesktop-0.8-17.el9.n 3.4 MB/s | 383 kB 00:00 2024-09-11T23:59:49.302 INFO:teuthology.orchestra.run.smithi162.stdout:(194/285): publicsuffix-list-20210518-3.el9.noa 1.4 MB/s | 83 kB 00:00 2024-09-11T23:59:49.344 INFO:teuthology.orchestra.run.smithi162.stdout:(195/285): poppler-data-0.4.9-9.el9.noarch.rpm 6.6 MB/s | 1.9 MB 00:00 2024-09-11T23:59:49.357 INFO:teuthology.orchestra.run.smithi033.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 5.4 MB/s | 555 kB 00:00 2024-09-11T23:59:49.378 INFO:teuthology.orchestra.run.smithi162.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-11T23:59:49.416 INFO:teuthology.orchestra.run.smithi033.stdout:(226/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 917 kB/s | 53 kB 00:00 2024-09-11T23:59:49.420 INFO:teuthology.orchestra.run.smithi162.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.7 MB/s | 679 kB 00:00 2024-09-11T23:59:49.445 INFO:teuthology.orchestra.run.smithi162.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-11T23:59:49.475 INFO:teuthology.orchestra.run.smithi033.stdout:(227/285): tracker-miners-3.1.2-4.el9.x86_64.rp 5.0 MB/s | 944 kB 00:00 2024-09-11T23:59:49.487 INFO:teuthology.orchestra.run.smithi162.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 3.6 MB/s | 248 kB 00:00 2024-09-11T23:59:49.500 INFO:teuthology.orchestra.run.smithi033.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-11T23:59:49.513 INFO:teuthology.orchestra.run.smithi162.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 383 kB/s | 26 kB 00:00 2024-09-11T23:59:49.538 INFO:teuthology.orchestra.run.smithi162.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-09-11T23:59:49.571 INFO:teuthology.orchestra.run.smithi162.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T23:59:49.597 INFO:teuthology.orchestra.run.smithi162.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 594 kB/s | 35 kB 00:00 2024-09-11T23:59:49.655 INFO:teuthology.orchestra.run.smithi162.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-11T23:59:49.675 INFO:teuthology.orchestra.run.smithi033.stdout:(229/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-11T23:59:49.700 INFO:teuthology.orchestra.run.smithi033.stdout:(230/285): upower-0.99.11-11.el9.x86_64.rpm 766 kB/s | 173 kB 00:00 2024-09-11T23:59:49.714 INFO:teuthology.orchestra.run.smithi162.stdout:(205/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-11T23:59:49.725 INFO:teuthology.orchestra.run.smithi033.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 1.3 MB/s | 306 kB 00:00 2024-09-11T23:59:49.751 INFO:teuthology.orchestra.run.smithi033.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.3 MB/s | 96 kB 00:00 2024-09-11T23:59:49.776 INFO:teuthology.orchestra.run.smithi033.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 846 kB/s | 42 kB 00:00 2024-09-11T23:59:49.789 INFO:teuthology.orchestra.run.smithi162.stdout:(206/285): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-11T23:59:49.810 INFO:teuthology.orchestra.run.smithi033.stdout:(234/285): wireplumber-libs-0.4.14-1.el9.x86_64 3.2 MB/s | 358 kB 00:00 2024-09-11T23:59:49.814 INFO:teuthology.orchestra.run.smithi162.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 768 kB/s | 77 kB 00:00 2024-09-11T23:59:49.826 INFO:teuthology.orchestra.run.smithi033.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-11T23:59:49.840 INFO:teuthology.orchestra.run.smithi162.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 844 kB/s | 42 kB 00:00 2024-09-11T23:59:49.852 INFO:teuthology.orchestra.run.smithi033.stdout:(236/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.7 MB/s | 385 kB 00:00 2024-09-11T23:59:49.877 INFO:teuthology.orchestra.run.smithi033.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T23:59:49.882 INFO:teuthology.orchestra.run.smithi162.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 3.9 MB/s | 269 kB 00:00 2024-09-11T23:59:49.907 INFO:teuthology.orchestra.run.smithi162.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.3 MB/s | 159 kB 00:00 2024-09-11T23:59:49.919 INFO:teuthology.orchestra.run.smithi033.stdout:(238/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 7.3 MB/s | 505 kB 00:00 2024-09-11T23:59:49.941 INFO:teuthology.orchestra.run.smithi162.stdout:(211/285): python3-pyasn1-modules-0.4.8-6.el9.n 4.6 MB/s | 279 kB 00:00 2024-09-11T23:59:49.966 INFO:teuthology.orchestra.run.smithi162.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 867 kB/s | 51 kB 00:00 2024-09-11T23:59:49.986 INFO:teuthology.orchestra.run.smithi033.stdout:(239/285): xkeyboard-config-2.33-2.el9.noarch.r 4.8 MB/s | 859 kB 00:00 2024-09-11T23:59:49.992 INFO:teuthology.orchestra.run.smithi162.stdout:(213/285): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-11T23:59:50.012 INFO:teuthology.orchestra.run.smithi033.stdout:(240/285): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-11T23:59:50.042 INFO:teuthology.orchestra.run.smithi162.stdout:(214/285): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-09-11T23:59:50.070 INFO:teuthology.orchestra.run.smithi033.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-11T23:59:50.095 INFO:teuthology.orchestra.run.smithi033.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 788 kB/s | 19 kB 00:00 2024-09-11T23:59:50.100 INFO:teuthology.orchestra.run.smithi162.stdout:(215/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T23:59:50.121 INFO:teuthology.orchestra.run.smithi033.stdout:(243/285): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-11T23:59:50.146 INFO:teuthology.orchestra.run.smithi033.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:59:50.159 INFO:teuthology.orchestra.run.smithi162.stdout:(216/285): qatlib-service-24.02.0-1.el9.x86_64. 615 kB/s | 36 kB 00:00 2024-09-11T23:59:50.171 INFO:teuthology.orchestra.run.smithi033.stdout:(245/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-09-11T23:59:50.205 INFO:teuthology.orchestra.run.smithi033.stdout:(246/285): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2024-09-11T23:59:50.260 INFO:teuthology.orchestra.run.smithi162.stdout:(217/285): python3-numpy-1.20.1-5.el9.x86_64.rp 7.4 MB/s | 5.1 MB 00:00 2024-09-11T23:59:50.260 INFO:teuthology.orchestra.run.smithi033.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 2.8 MB/s | 151 kB 00:00 2024-09-11T23:59:50.285 INFO:teuthology.orchestra.run.smithi162.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-11T23:59:50.288 INFO:teuthology.orchestra.run.smithi033.stdout:(248/285): libunwind-1.6.2-1.el9.x86_64.rpm 576 kB/s | 67 kB 00:00 2024-09-11T23:59:50.318 INFO:teuthology.orchestra.run.smithi162.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 961 kB/s | 56 kB 00:00 2024-09-11T23:59:50.339 INFO:teuthology.orchestra.run.smithi033.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 10 MB/s | 839 kB 00:00 2024-09-11T23:59:50.364 INFO:teuthology.orchestra.run.smithi033.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:59:50.386 INFO:teuthology.orchestra.run.smithi162.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 5.0 MB/s | 510 kB 00:00 2024-09-11T23:59:50.389 INFO:teuthology.orchestra.run.smithi033.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:59:50.411 INFO:teuthology.orchestra.run.smithi162.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 749 kB/s | 69 kB 00:00 2024-09-11T23:59:50.414 INFO:teuthology.orchestra.run.smithi033.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-11T23:59:50.440 INFO:teuthology.orchestra.run.smithi033.stdout:(253/285): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-11T23:59:50.444 INFO:teuthology.orchestra.run.smithi162.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-11T23:59:50.465 INFO:teuthology.orchestra.run.smithi033.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:59:50.499 INFO:teuthology.orchestra.run.smithi033.stdout:(255/285): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-11T23:59:50.503 INFO:teuthology.orchestra.run.smithi162.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 4.1 MB/s | 383 kB 00:00 2024-09-11T23:59:50.524 INFO:teuthology.orchestra.run.smithi033.stdout:(256/285): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-11T23:59:50.528 INFO:teuthology.orchestra.run.smithi162.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 1.8 MB/s | 152 kB 00:00 2024-09-11T23:59:50.549 INFO:teuthology.orchestra.run.smithi033.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T23:59:50.575 INFO:teuthology.orchestra.run.smithi033.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-11T23:59:50.592 INFO:teuthology.orchestra.run.smithi033.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T23:59:50.609 INFO:teuthology.orchestra.run.smithi033.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-11T23:59:50.612 INFO:teuthology.orchestra.run.smithi162.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 5.0 MB/s | 555 kB 00:00 2024-09-11T23:59:50.634 INFO:teuthology.orchestra.run.smithi033.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 788 kB/s | 19 kB 00:00 2024-09-11T23:59:50.637 INFO:teuthology.orchestra.run.smithi162.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 8.5 MB/s | 944 kB 00:00 2024-09-11T23:59:50.659 INFO:teuthology.orchestra.run.smithi033.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-11T23:59:50.662 INFO:teuthology.orchestra.run.smithi162.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-11T23:59:50.697 INFO:teuthology.orchestra.run.smithi162.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-11T23:59:50.721 INFO:teuthology.orchestra.run.smithi162.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-11T23:59:50.726 INFO:teuthology.orchestra.run.smithi033.stdout:(263/285): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-11T23:59:50.841 INFO:teuthology.orchestra.run.smithi033.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 406 kB/s | 46 kB 00:00 2024-09-11T23:59:50.880 INFO:teuthology.orchestra.run.smithi162.stdout:(230/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-11T23:59:50.893 INFO:teuthology.orchestra.run.smithi033.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-11T23:59:50.905 INFO:teuthology.orchestra.run.smithi162.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 525 kB/s | 96 kB 00:00 2024-09-11T23:59:50.927 INFO:teuthology.orchestra.run.smithi033.stdout:(266/285): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-09-11T23:59:50.961 INFO:teuthology.orchestra.run.smithi033.stdout:(267/285): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-11T23:59:50.972 INFO:teuthology.orchestra.run.smithi162.stdout:(232/285): webrtc-audio-processing-0.3.1-8.el9. 1.1 MB/s | 306 kB 00:00 2024-09-11T23:59:51.028 INFO:teuthology.orchestra.run.smithi033.stdout:(268/285): libarrow-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-09-11T23:59:51.031 INFO:teuthology.orchestra.run.smithi162.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 338 kB/s | 42 kB 00:00 2024-09-11T23:59:51.053 INFO:teuthology.orchestra.run.smithi033.stdout:(269/285): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-09-11T23:59:51.056 INFO:teuthology.orchestra.run.smithi162.stdout:(234/285): wireplumber-libs-0.4.14-1.el9.x86_64 2.0 MB/s | 358 kB 00:00 2024-09-11T23:59:51.078 INFO:teuthology.orchestra.run.smithi033.stdout:(270/285): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-11T23:59:51.081 INFO:teuthology.orchestra.run.smithi162.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.5 MB/s | 385 kB 00:00 2024-09-11T23:59:51.104 INFO:teuthology.orchestra.run.smithi033.stdout:(271/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-11T23:59:51.107 INFO:teuthology.orchestra.run.smithi162.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 134 kB 00:00 2024-09-11T23:59:51.129 INFO:teuthology.orchestra.run.smithi033.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T23:59:51.132 INFO:teuthology.orchestra.run.smithi162.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T23:59:51.154 INFO:teuthology.orchestra.run.smithi033.stdout:(273/285): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-11T23:59:51.158 INFO:teuthology.orchestra.run.smithi162.stdout:(238/285): xkeyboard-config-2.33-2.el9.noarch.r 8.3 MB/s | 859 kB 00:00 2024-09-11T23:59:51.180 INFO:teuthology.orchestra.run.smithi033.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-11T23:59:51.205 INFO:teuthology.orchestra.run.smithi033.stdout:(275/285): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-11T23:59:51.230 INFO:teuthology.orchestra.run.smithi033.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-11T23:59:51.233 INFO:teuthology.orchestra.run.smithi162.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 3.9 MB/s | 505 kB 00:00 2024-09-11T23:59:51.255 INFO:teuthology.orchestra.run.smithi033.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-11T23:59:51.258 INFO:teuthology.orchestra.run.smithi162.stdout:(240/285): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-11T23:59:51.281 INFO:teuthology.orchestra.run.smithi033.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T23:59:51.306 INFO:teuthology.orchestra.run.smithi033.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T23:59:51.317 INFO:teuthology.orchestra.run.smithi162.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-11T23:59:51.331 INFO:teuthology.orchestra.run.smithi033.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:59:51.342 INFO:teuthology.orchestra.run.smithi162.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 851 kB/s | 19 kB 00:00 2024-09-11T23:59:51.357 INFO:teuthology.orchestra.run.smithi033.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T23:59:51.376 INFO:teuthology.orchestra.run.smithi162.stdout:(243/285): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-11T23:59:51.382 INFO:teuthology.orchestra.run.smithi033.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-11T23:59:51.401 INFO:teuthology.orchestra.run.smithi162.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:59:51.432 INFO:teuthology.orchestra.run.smithi033.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:59:51.435 INFO:teuthology.orchestra.run.smithi162.stdout:(245/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-11T23:59:51.460 INFO:teuthology.orchestra.run.smithi162.stdout:(246/285): liboath-2.6.7-2.el9.x86_64.rpm 828 kB/s | 49 kB 00:00 2024-09-11T23:59:51.497 INFO:teuthology.orchestra.run.smithi162.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 5.8 MB/s | 151 kB 00:00 2024-09-11T23:59:51.527 INFO:teuthology.orchestra.run.smithi162.stdout:(248/285): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-09-11T23:59:51.569 INFO:teuthology.orchestra.run.smithi162.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-11T23:59:51.594 INFO:teuthology.orchestra.run.smithi162.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:59:51.620 INFO:teuthology.orchestra.run.smithi162.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:59:51.632 INFO:teuthology.orchestra.run.smithi033.stdout:(284/285): librados2-19.3.0-4753.gd011c522.el9. 13 MB/s | 3.5 MB 00:00 2024-09-11T23:59:51.645 INFO:teuthology.orchestra.run.smithi162.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-11T23:59:51.679 INFO:teuthology.orchestra.run.smithi162.stdout:(253/285): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-11T23:59:51.696 INFO:teuthology.orchestra.run.smithi162.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:59:51.729 INFO:teuthology.orchestra.run.smithi162.stdout:(255/285): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-11T23:59:51.763 INFO:teuthology.orchestra.run.smithi162.stdout:(256/285): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-11T23:59:51.765 INFO:teuthology.orchestra.run.smithi033.stdout:(285/285): librbd1-19.3.0-4753.gd011c522.el9.x8 8.4 MB/s | 3.2 MB 00:00 2024-09-11T23:59:51.772 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:59:51.772 INFO:teuthology.orchestra.run.smithi033.stdout:Total 19 MB/s | 327 MB 00:17 2024-09-11T23:59:51.796 INFO:teuthology.orchestra.run.smithi162.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T23:59:51.822 INFO:teuthology.orchestra.run.smithi162.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-11T23:59:51.847 INFO:teuthology.orchestra.run.smithi162.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-11T23:59:51.873 INFO:teuthology.orchestra.run.smithi162.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-11T23:59:51.898 INFO:teuthology.orchestra.run.smithi162.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-11T23:59:51.923 INFO:teuthology.orchestra.run.smithi162.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-11T23:59:51.998 INFO:teuthology.orchestra.run.smithi162.stdout:(263/285): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-11T23:59:52.024 INFO:teuthology.orchestra.run.smithi162.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi162.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:59:52.075 INFO:teuthology.orchestra.run.smithi162.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:59:52.117 INFO:teuthology.orchestra.run.smithi162.stdout:(267/285): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-09-11T23:59:52.150 INFO:teuthology.orchestra.run.smithi162.stdout:(268/285): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-11T23:59:52.167 INFO:teuthology.orchestra.run.smithi162.stdout:(269/285): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-11T23:59:52.192 INFO:teuthology.orchestra.run.smithi162.stdout:(270/285): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-11T23:59:52.218 INFO:teuthology.orchestra.run.smithi162.stdout:(271/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-11T23:59:52.243 INFO:teuthology.orchestra.run.smithi162.stdout:(272/285): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-11T23:59:52.268 INFO:teuthology.orchestra.run.smithi162.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-11T23:59:52.294 INFO:teuthology.orchestra.run.smithi162.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-11T23:59:52.319 INFO:teuthology.orchestra.run.smithi162.stdout:(275/285): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-11T23:59:52.336 INFO:teuthology.orchestra.run.smithi162.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-11T23:59:52.361 INFO:teuthology.orchestra.run.smithi162.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-11T23:59:52.386 INFO:teuthology.orchestra.run.smithi162.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-11T23:59:52.412 INFO:teuthology.orchestra.run.smithi162.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-11T23:59:52.437 INFO:teuthology.orchestra.run.smithi162.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:59:52.462 INFO:teuthology.orchestra.run.smithi162.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-11T23:59:52.488 INFO:teuthology.orchestra.run.smithi162.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-11T23:59:52.546 INFO:teuthology.orchestra.run.smithi162.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T23:59:52.771 INFO:teuthology.orchestra.run.smithi162.stdout:(284/285): librbd1-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-11T23:59:52.988 INFO:teuthology.orchestra.run.smithi162.stdout:(285/285): librados2-19.3.0-4753.gd011c522.el9. 6.6 MB/s | 3.5 MB 00:00 2024-09-11T23:59:52.995 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:59:52.995 INFO:teuthology.orchestra.run.smithi162.stdout:Total 19 MB/s | 327 MB 00:17 2024-09-11T23:59:54.916 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-09-11T23:59:55.121 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-09-11T23:59:55.121 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-09-11T23:59:56.010 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-11T23:59:56.198 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-11T23:59:56.198 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-11T23:59:58.550 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-09-11T23:59:58.551 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-09-11T23:59:59.381 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-11T23:59:59.381 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-12T00:00:08.938 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:00:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:00:09.305 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-09-12T00:00:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:00:09.417 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:00:09.599 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:00:09.654 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:00:09.715 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:00:09.765 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:00:09.789 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:00:09.851 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:00:10.081 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:00:10.237 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:00:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:00:10.340 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:00:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-12T00:00:10.449 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:00:10.475 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:00:10.561 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:00:10.569 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:00:10.588 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:00:10.618 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:00:10.627 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:00:10.657 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:00:10.684 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:00:10.686 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:00:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:00:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:00:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:00:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:00:10.820 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:00:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:00:10.845 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:00:10.894 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:00:10.969 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:00:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:00:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:00:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:00:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:00:11.240 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:00:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:00:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:00:11.346 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:00:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:00:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:00:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:00:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:00:11.470 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:00:11.498 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:00:11.590 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:00:11.618 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:00:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:00:11.658 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:00:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:00:11.686 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:00:11.712 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:00:11.738 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:00:11.770 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:00:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:00:11.795 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:00:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:00:11.824 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:00:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:00:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:00:11.950 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:00:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:00:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:00:12.060 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:00:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:00:12.097 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:00:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:00:12.170 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:00:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:00:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:00:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:00:12.259 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:00:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:00:12.288 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:00:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:00:12.334 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:00:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:00:12.359 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:00:12.382 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:00:12.409 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:00:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:00:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:00:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:00:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:00:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:00:12.621 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:00:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:00:12.661 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:00:12.711 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:00:12.741 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:00:12.768 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:00:12.786 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:00:12.792 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:00:12.827 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:00:12.827 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:00:12.892 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:00:12.905 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:00:12.936 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:00:12.969 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:00:13.012 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:00:13.045 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:00:13.052 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:00:13.071 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:00:13.096 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:00:13.105 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:00:13.122 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:00:13.153 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:00:13.183 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:00:13.208 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:00:13.241 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:00:13.265 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:00:13.329 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:00:13.391 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:00:13.422 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:00:13.465 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:00:13.501 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:00:13.533 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:00:13.610 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:00:13.643 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:00:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:00:13.687 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:00:13.730 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:00:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:00:13.795 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:00:13.805 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:00:13.867 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:00:13.917 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:00:13.954 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:00:13.965 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:00:13.983 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:00:14.015 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:00:14.058 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:00:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:00:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:00:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:00:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:00:14.260 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:00:14.290 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:00:14.340 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:00:14.400 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:00:14.433 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:00:14.470 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:00:14.556 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:00:14.567 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:00:14.637 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:00:14.642 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:00:14.670 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:00:14.712 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:00:14.740 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:00:14.747 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:00:14.776 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:00:14.786 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:00:14.812 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:00:14.929 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:00:14.929 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:00:14.930 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:00:14.930 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:00:14.930 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:00:14.945 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:00:14.970 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:00:15.005 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:00:15.043 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:00:15.066 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:00:15.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:00:15.152 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:00:15.154 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:00:15.208 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:00:15.243 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:00:15.255 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:00:15.279 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:00:15.296 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:00:15.337 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:00:15.372 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:00:15.377 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:00:15.401 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:00:15.436 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:00:15.487 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:00:15.518 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:00:15.548 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:00:15.585 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:00:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:00:15.631 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:00:15.662 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:00:15.677 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:00:15.719 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:00:15.857 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:00:15.882 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:00:15.904 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:00:15.930 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:00:15.946 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:00:15.961 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:00:15.991 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:00:16.033 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:00:16.051 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:00:16.060 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:00:16.075 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:00:16.075 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:00:16.075 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:16.088 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:00:16.129 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:00:16.161 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:00:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:00:16.265 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:00:16.268 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:00:16.357 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:00:16.398 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:00:16.439 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:00:16.629 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:00:16.651 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:00:16.691 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:00:16.717 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:00:16.721 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:00:16.742 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:00:16.751 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:00:16.768 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:00:16.793 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:00:16.825 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:00:16.834 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:00:16.835 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:00:16.835 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:17.018 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:00:17.089 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:00:17.137 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:00:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:00:17.162 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:00:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:00:17.186 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:00:17.194 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:00:17.194 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:00:17.195 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:17.213 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:00:17.237 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:00:17.271 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:00:17.304 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:00:17.347 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:00:17.381 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:00:17.473 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:00:17.528 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:00:17.558 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:00:17.656 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:00:17.668 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:00:17.693 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:00:17.705 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:00:17.705 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:00:17.706 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:17.727 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:00:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:00:17.800 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:00:17.833 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:00:17.883 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:00:17.918 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:00:18.015 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:00:18.065 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:00:18.247 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:00:18.448 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:00:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:00:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:00:18.566 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:00:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:00:18.703 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:00:18.756 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:00:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:00:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:00:19.044 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:00:19.306 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:00:19.363 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:00:19.397 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:00:19.497 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:00:19.545 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:00:19.588 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:00:19.655 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:00:19.691 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:00:19.733 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:00:19.738 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:00:19.766 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:00:19.786 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:00:19.837 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:00:19.958 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:00:19.989 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:00:20.069 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:00:20.344 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:00:20.404 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:00:20.441 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:00:20.475 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:00:20.508 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:00:20.693 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:00:20.740 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:00:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:00:20.817 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:00:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:00:21.479 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:00:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:00:22.283 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:00:22.366 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:00:22.419 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:00:22.460 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:00:22.487 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:00:22.533 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:00:22.548 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:00:22.548 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:00:22.548 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:22.592 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:00:22.620 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:00:22.649 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:00:22.870 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:00:22.952 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:00:22.986 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:00:22.994 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:00:23.029 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:00:23.036 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:00:23.057 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:00:23.087 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:00:23.098 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:00:23.098 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:00:23.098 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:23.137 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:00:23.145 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:00:23.169 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:00:23.174 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:00:23.201 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:00:23.205 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:00:23.230 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:00:23.294 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:00:23.329 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:00:23.354 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:00:23.399 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:00:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:00:23.523 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:00:23.568 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:00:23.665 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:00:23.697 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:00:23.701 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:00:23.737 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:00:23.738 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:00:23.765 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:00:23.767 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:00:23.791 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:00:23.817 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:00:23.826 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:00:23.842 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:00:23.858 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:00:23.867 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:00:23.875 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:00:23.895 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:00:23.911 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:00:23.932 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:00:23.939 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:00:23.984 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:00:24.015 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:00:24.063 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:00:24.098 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:00:24.175 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:00:24.225 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:00:24.254 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:00:24.279 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:00:24.305 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:00:24.330 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:00:24.355 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:00:24.385 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:00:24.419 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:00:24.462 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:00:24.495 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:00:24.543 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:00:24.570 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:00:24.574 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:00:24.723 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:00:24.780 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:00:24.796 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:00:24.825 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:00:24.895 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:00:24.940 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:00:24.963 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:00:24.984 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:00:25.010 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:00:25.036 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:00:25.061 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:00:25.067 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:00:25.091 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:00:25.198 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:00:25.255 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:00:25.280 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:00:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:00:25.390 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:00:25.432 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:00:25.456 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:00:25.476 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:00:25.502 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:00:25.529 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:00:25.560 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:00:25.584 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:00:37.099 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:00:37.140 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:00:37.168 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:00:37.206 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:00:37.218 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:00:37.249 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:00:37.251 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:00:37.281 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:00:37.288 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:00:37.323 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:00:37.352 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:00:37.389 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:00:37.828 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:00:37.858 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:00:37.894 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:00:37.918 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:00:37.939 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:00:37.969 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:00:37.997 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:00:38.020 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:00:40.335 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:00:40.367 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:00:40.463 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:00:40.509 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:00:40.942 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:00:40.995 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:00:41.090 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:00:41.091 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:00:41.091 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:00:41.091 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:00:41.113 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:00:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:00:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:00:41.261 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:00:41.261 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:00:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:00:50.520 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:00:50.520 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-12T00:00:50.521 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-12T00:00:50.521 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-12T00:00:50.521 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-12T00:00:50.521 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-12T00:00:50.521 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-12T00:00:50.521 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-12T00:00:50.521 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:50.688 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:00:50.704 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:00:50.704 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:50.704 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:00:50.704 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:00:51.176 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-09-12T00:00:51.176 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-09-12T00:00:51.176 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-09-12T00:00:51.176 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-09-12T00:00:51.176 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-09-12T00:00:51.176 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /root 2024-09-12T00:00:51.177 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-09-12T00:00:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:00:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:00:51.378 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:51.378 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:00:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:52.164 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:00:52.190 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:00:52.190 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:52.190 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:00:52.190 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:00:52.191 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:00:52.191 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:52.414 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:00:52.437 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:00:52.437 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:52.437 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:00:52.437 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:00:52.437 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:00:52.437 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:52.881 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:00:52.904 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:00:52.904 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:52.904 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:00:52.904 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:00:52.904 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:00:52.904 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:00:52.920 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:00:52.949 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:00:52.949 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:52.949 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:00:52.949 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:00:52.949 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:00:52.949 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:53.008 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:00:53.188 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:00:53.212 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:00:53.212 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:53.212 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:00:53.212 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:00:53.212 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:00:53.212 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:53.688 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:00:53.713 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:00:53.713 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:53.713 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:00:53.713 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:00:53.713 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:00:53.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:00:53.818 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:00:55.847 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:00:55.950 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:00:56.006 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:00:56.065 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:00:56.256 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:00:56.305 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:00:56.382 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:00:56.474 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:00:56.611 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:00:56.654 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:00:56.696 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:00:56.894 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:00:56.998 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:00:57.056 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:00:57.121 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:00:57.316 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:00:57.367 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:00:57.441 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:00:57.539 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:00:57.558 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:00:57.611 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:00:57.683 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:00:57.726 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:00:57.760 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:00:57.980 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:00:58.018 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:00:58.040 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:00:58.068 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:00:58.103 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:00:58.140 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:00:58.167 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:00:58.193 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:00:58.219 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:00:58.244 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:00:58.270 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:00:58.295 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:00:58.322 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:00:58.354 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:00:58.381 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:00:58.415 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:00:58.443 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:00:58.474 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:00:58.508 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:00:58.542 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:00:58.579 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:00:58.617 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:00:58.651 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:00:58.666 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:00:58.696 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:00:58.715 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:00:58.728 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:00:58.751 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:00:58.804 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:00:58.845 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:00:58.875 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:00:58.905 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:00:58.930 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:00:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:00:59.118 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:00:59.130 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:00:59.155 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:00:59.157 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:00:59.184 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:00:59.186 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:00:59.213 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:00:59.217 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:00:59.249 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:00:59.286 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:00:59.313 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:00:59.339 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:00:59.346 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:00:59.389 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:00:59.408 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:00:59.415 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:00:59.441 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:00:59.467 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:00:59.478 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:00:59.498 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:00:59.514 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:00:59.526 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:00:59.553 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:00:59.589 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:00:59.619 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:00:59.622 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:00:59.653 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:00:59.678 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:00:59.687 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:00:59.693 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:00:59.723 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:00:59.724 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:00:59.746 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:00:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:00:59.806 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:00:59.850 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:00:59.898 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:00:59.929 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:00:59.989 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:01:00.023 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:01:00.053 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:01:00.082 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:01:00.107 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:01:00.170 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:01:00.200 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:01:00.217 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:01:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:01:00.218 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:01:00.434 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:01:00.441 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:01:00.468 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:01:00.495 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:01:00.497 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:01:00.528 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:01:00.543 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:01:00.580 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:01:00.605 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:01:00.666 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:01:00.820 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:01:00.889 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:01:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:01:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:01:01.063 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:01:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:01:01.102 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:01:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:01:01.117 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:01:01.149 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:01:01.171 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:01:01.550 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:01:01.607 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:01:01.633 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:01:01.637 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:01:01.654 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:01:01.654 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:01:01.654 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:01.687 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:01:01.718 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:01:01.908 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:01:01.919 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:01:01.977 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:01:01.994 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:01:02.011 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:01:02.033 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:01:02.038 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:01:02.063 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:01:02.074 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:01:02.100 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:01:02.126 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:01:02.165 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:01:02.176 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:01:02.208 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:01:02.231 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:01:02.258 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:01:02.491 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:01:02.520 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:01:02.537 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:01:02.701 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:01:02.731 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:01:02.764 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:01:02.831 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:01:02.855 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:01:03.146 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:01:03.261 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:01:03.295 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:01:03.325 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:01:03.532 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:01:03.595 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:01:03.629 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:01:03.651 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:01:03.679 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:01:03.745 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:01:03.785 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:01:03.816 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:01:03.838 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:01:03.867 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:01:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:01:04.298 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:01:04.332 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:01:04.403 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:01:04.430 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:01:06.048 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:01:06.111 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:01:07.073 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:01:07.105 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:01:07.219 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:01:07.381 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:01:07.413 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:01:07.436 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:01:07.436 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:01:07.436 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:01:07.436 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:01:07.437 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:01:07.437 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:07.480 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:01:07.492 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:01:07.515 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:01:07.543 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:01:07.592 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:01:07.615 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:01:07.631 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:01:07.631 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:01:07.631 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:07.827 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:01:07.887 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:01:08.635 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:01:08.660 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:01:08.661 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:01:08.661 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:01:08.661 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:01:08.661 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:01:08.661 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:08.702 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:01:08.725 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:01:08.726 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:01:08.726 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:01:08.726 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:01:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:01:09.046 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:01:09.052 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:01:09.069 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:01:09.070 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:01:09.070 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:01:09.070 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:01:09.070 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:01:09.070 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:01:09.281 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:01:09.307 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:01:09.307 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:01:09.307 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:01:09.307 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:01:09.307 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:01:09.307 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:09.356 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:01:09.369 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:01:09.400 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:01:09.429 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:01:09.478 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:01:09.509 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:01:09.525 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:01:09.526 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:01:09.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:10.535 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:01:10.560 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:01:10.560 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:01:10.560 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:01:10.560 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:01:10.560 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:01:10.560 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:10.611 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:01:10.635 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:01:10.635 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:01:10.635 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:01:10.635 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:10.961 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:01:10.986 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:01:10.986 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:01:10.986 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:01:10.986 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:01:10.986 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:01:10.986 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:13.774 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:01:13.823 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:01:13.863 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:01:13.968 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:01:14.023 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:01:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:01:14.055 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:01:14.147 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:01:14.148 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:01:14.238 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:01:14.253 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:01:14.260 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:01:14.268 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:01:14.278 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:01:14.279 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:01:14.279 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:01:14.279 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:14.344 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:01:14.412 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:01:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:01:16.018 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:01:16.049 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:01:16.158 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:01:16.221 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:01:16.249 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:01:16.249 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:01:16.342 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:01:16.342 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:01:16.441 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:01:16.459 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:01:16.465 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:01:16.474 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:01:16.485 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:01:16.485 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:01:16.486 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:01:16.486 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:16.544 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:01:16.617 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:01:24.829 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:01:24.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:01:24.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:01:24.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:01:24.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:01:24.829 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:01:24.830 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:01:24.831 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:01:24.832 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:01:24.833 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:01:24.834 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:01:24.835 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:01:24.836 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:01:24.837 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:01:24.838 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:01:24.839 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:01:24.840 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:01:24.841 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:01:24.842 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:01:24.843 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:01:24.844 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:01:24.845 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:01:24.847 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:01:24.848 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:01:24.849 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:01:24.850 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:01:24.851 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:01:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:01:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:01:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:01:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:01:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:01:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:01:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:01:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:01:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:01:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:01:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:01:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:01:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:01:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:01:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:01:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:01:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:01:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:01:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:01:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:01:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:01:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:01:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:01:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:01:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:01:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:01:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:01:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:01:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:01:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:01:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:01:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:01:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:01:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:01:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:01:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:01:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:01:28.266 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:01:28.266 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:28.266 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-12T00:01:28.266 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.266 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.266 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-12T00:01:28.266 INFO:teuthology.orchestra.run.smithi162.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:01:28.266 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:01:28.267 INFO:teuthology.orchestra.run.smithi162.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.268 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.269 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:01:28.270 INFO:teuthology.orchestra.run.smithi162.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:01:28.271 INFO:teuthology.orchestra.run.smithi162.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:01:28.272 INFO:teuthology.orchestra.run.smithi162.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:01:28.273 INFO:teuthology.orchestra.run.smithi162.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:01:28.274 INFO:teuthology.orchestra.run.smithi162.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:01:28.274 INFO:teuthology.orchestra.run.smithi162.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:01:28.274 INFO:teuthology.orchestra.run.smithi162.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:01:28.275 INFO:teuthology.orchestra.run.smithi162.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:01:28.276 INFO:teuthology.orchestra.run.smithi162.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:01:28.277 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:01:28.278 INFO:teuthology.orchestra.run.smithi162.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:01:28.279 INFO:teuthology.orchestra.run.smithi162.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:01:28.280 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:01:28.281 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:01:28.282 INFO:teuthology.orchestra.run.smithi162.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:01:28.283 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:01:28.284 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:01:28.285 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.286 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:01:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:01:28.288 INFO:teuthology.orchestra.run.smithi162.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:01:28.289 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:01:28.290 INFO:teuthology.orchestra.run.smithi162.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:01:28.290 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:28.290 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-12T00:01:28.684 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:30.315 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:01:30.315 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:30.315 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-09-12T00:01:30.315 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.315 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.315 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-09-12T00:01:30.315 INFO:teuthology.orchestra.run.smithi033.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:01:30.316 INFO:teuthology.orchestra.run.smithi033.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.317 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.318 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.318 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.318 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.318 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.318 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.318 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.318 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.318 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:01:30.319 INFO:teuthology.orchestra.run.smithi033.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:01:30.320 INFO:teuthology.orchestra.run.smithi033.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:01:30.321 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:01:30.322 INFO:teuthology.orchestra.run.smithi033.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:01:30.323 INFO:teuthology.orchestra.run.smithi033.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:01:30.324 INFO:teuthology.orchestra.run.smithi033.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:01:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:01:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:01:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:01:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:01:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:01:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:01:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:01:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:01:30.329 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:01:30.330 INFO:teuthology.orchestra.run.smithi033.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:01:30.331 INFO:teuthology.orchestra.run.smithi033.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.332 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:01:30.333 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:01:30.334 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:01:30.340 INFO:teuthology.orchestra.run.smithi033.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:01:30.340 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:30.340 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-12T00:01:30.744 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:30.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:01:30.909 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:01:30.981 INFO:teuthology.orchestra.run.smithi033.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:01:30.982 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:01:30.982 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:01:30.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:01:31.129 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:01:31.208 INFO:teuthology.orchestra.run.smithi162.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:01:31.209 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:01:31.209 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:01:31.211 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:01:31.212 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:31.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:01:31.256 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:01:31.256 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:01:31.303 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:01:31.303 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:31.303 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:01:31.345 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:01:31.425 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:01:31.425 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:01:31.469 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:01:31.551 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:01:31.551 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:31.551 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:01:31.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:01:31.672 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:01:31.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:01:31.712 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:01:31.792 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:01:31.793 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:31.793 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:01:31.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:01:31.915 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:01:31.916 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:01:31.954 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:01:32.033 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:01:32.168 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:01:32.168 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2024-09-12T00:01:32.171 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-09-12T00:01:32.209 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:01:32.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:01:32.251 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:01:32.291 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:01:32.291 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:01:32.333 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:01:32.381 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:01:32.381 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:01:32.381 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7901825', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi033.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMg2HswkFT7jcAw7WmQK+ycZDr9L2yEkAS1o6QDbuGQhFNu+PW5mds+Rdv9Ibbxjj1TsxOz+lIVKLNrWUsIh5G8=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPBTd6iHLBWbi2V2YJ0bVZc8iMq1UFyrE+E1mVQt0MV+uXeji3qM7guHigIGdSPGUVo974OE38V/fsns5t8m6Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:01:32.382 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:01:32.412 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:01:32.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:01:32.483 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:01:32.522 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:32.522 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:01:32.591 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:01:32.591 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-09-12T00:01:32.660 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:01:32.660 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:01:32.660 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T00:01:32.661 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:01:32.661 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:01:32.661 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 00:01:17.654562635 +0000 2024-09-12T00:01:32.661 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-11 23:58:54.120486220 +0000 2024-09-12T00:01:32.661 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-11 23:58:54.120486220 +0000 2024-09-12T00:01:32.661 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-11 23:58:54.120486220 +0000 2024-09-12T00:01:32.661 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:01:32.740 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-12T00:01:32.740 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-12T00:01:32.740 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000306885 s, 1.7 MB/s 2024-09-12T00:01:32.741 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:01:32.817 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-09-12T00:01:32.890 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:01:32.890 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:01:32.890 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T00:01:32.890 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:01:32.890 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:01:32.890 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 00:01:17.655562621 +0000 2024-09-12T00:01:32.890 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-11 23:58:54.455481477 +0000 2024-09-12T00:01:32.891 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-11 23:58:54.455481477 +0000 2024-09-12T00:01:32.891 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-11 23:58:54.455481477 +0000 2024-09-12T00:01:32.891 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:01:32.971 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-12T00:01:32.971 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-12T00:01:32.971 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000220277 s, 2.3 MB/s 2024-09-12T00:01:32.974 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:01:33.044 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-09-12T00:01:33.114 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:01:33.114 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:01:33.114 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T00:01:33.114 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:01:33.115 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:01:33.115 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 00:01:17.655562621 +0000 2024-09-12T00:01:33.115 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-11 23:58:54.772476988 +0000 2024-09-12T00:01:33.115 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-11 23:58:54.772476988 +0000 2024-09-12T00:01:33.115 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-11 23:58:54.772476988 +0000 2024-09-12T00:01:33.115 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:01:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-12T00:01:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-12T00:01:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000187998 s, 2.7 MB/s 2024-09-12T00:01:33.194 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:01:33.265 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-09-12T00:01:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:01:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:01:33.335 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T00:01:33.335 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:01:33.335 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:01:33.335 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-12 00:01:17.655562621 +0000 2024-09-12T00:01:33.335 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-11 23:58:55.125471989 +0000 2024-09-12T00:01:33.335 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-11 23:58:55.125471989 +0000 2024-09-12T00:01:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-11 23:58:55.125471989 +0000 2024-09-12T00:01:33.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:01:33.413 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-12T00:01:33.413 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-12T00:01:33.413 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000197338 s, 2.6 MB/s 2024-09-12T00:01:33.414 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:01:33.484 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:33.484 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:01:33.485 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:01:33.518 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:01:33.518 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-12T00:01:33.591 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:01:33.591 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:01:33.591 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T00:01:33.591 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:01:33.591 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:01:33.591 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-12 00:01:15.439441699 +0000 2024-09-12T00:01:33.592 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-11 23:58:50.808844941 +0000 2024-09-12T00:01:33.592 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-11 23:58:50.808844941 +0000 2024-09-12T00:01:33.592 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-11 23:58:50.808844941 +0000 2024-09-12T00:01:33.592 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:01:33.670 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-12T00:01:33.671 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-12T00:01:33.671 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000214643 s, 2.4 MB/s 2024-09-12T00:01:33.672 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:01:33.743 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-12T00:01:33.815 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:01:33.815 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:01:33.815 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T00:01:33.816 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:01:33.816 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:01:33.816 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-12 00:01:15.440441679 +0000 2024-09-12T00:01:33.816 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-11 23:58:51.134838243 +0000 2024-09-12T00:01:33.816 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-11 23:58:51.134838243 +0000 2024-09-12T00:01:33.816 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-11 23:58:51.134838243 +0000 2024-09-12T00:01:33.816 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:01:33.894 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-12T00:01:33.895 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-12T00:01:33.895 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000212767 s, 2.4 MB/s 2024-09-12T00:01:33.896 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:01:33.967 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-12T00:01:34.036 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:01:34.036 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:01:34.036 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T00:01:34.036 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:01:34.036 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:01:34.036 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-12 00:01:15.441441658 +0000 2024-09-12T00:01:34.036 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-11 23:58:51.464831463 +0000 2024-09-12T00:01:34.036 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-11 23:58:51.464831463 +0000 2024-09-12T00:01:34.037 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-11 23:58:51.464831463 +0000 2024-09-12T00:01:34.037 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:01:34.113 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-12T00:01:34.113 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-12T00:01:34.113 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.00018208 s, 2.8 MB/s 2024-09-12T00:01:34.114 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:01:34.184 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-12T00:01:34.253 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:01:34.254 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:01:34.254 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T00:01:34.254 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:01:34.254 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:01:34.254 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-12 00:01:15.441441658 +0000 2024-09-12T00:01:34.254 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-11 23:58:51.787824827 +0000 2024-09-12T00:01:34.254 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-11 23:58:51.787824827 +0000 2024-09-12T00:01:34.254 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-11 23:58:51.787824827 +0000 2024-09-12T00:01:34.254 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:01:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-12T00:01:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-12T00:01:34.332 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000191294 s, 2.7 MB/s 2024-09-12T00:01:34.337 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:01:34.410 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:34.411 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:01:34.411 INFO:tasks.ceph:Generating config... 2024-09-12T00:01:34.412 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:01:34.412 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T00:01:34.413 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T00:01:34.414 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:01:34.414 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:01:34.414 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:01:34.414 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:01:34.414 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:01:34.414 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:01:34.414 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:01:34.414 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:01:34.414 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:01:34.415 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T00:01:34.415 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:01:34.415 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:01:34.415 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:01:34.415 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:01:34.415 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:01:34.415 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:01:34.415 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:01:34.415 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T00:01:34.415 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:01:34.415 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:01:34.415 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:01:34.416 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:01:34.416 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:01:34.416 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:01:34.416 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:01:34.416 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:01:34.416 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:01:34.416 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:01:34.417 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:01:34.417 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:01:34.417 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:01:34.417 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:01:34.417 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:01:34.417 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T00:01:34.417 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:01:34.417 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:01:34.417 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:01:34.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:01:34.494 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:01:34.497 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:01:34.559 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:01:34.599 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.33'), ('mon.c', '[v2:172.21.15.33:3301,v1:172.21.15.33:6790]'), ('mon.b', '172.21.15.162')] 2024-09-12T00:01:34.600 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.33,[v2:172.21.15.33:3301,v1:172.21.15.33:6790],172.21.15.162', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:01:34.601 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:34.601 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:01:34.670 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.33 --addv c '[v2:172.21.15.33:3301,v1:172.21.15.33:6790]' --add b 172.21.15.162 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:34.772 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:01:34.772 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:01:34.772 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:34.772 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: generated fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = quincy 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 0 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:min_mon_release 17 (quincy) 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:election_strategy: 1 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:01:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:01:34.774 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:01:34.804 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 69d022f9-3312-45e8-ade0-937e32c87c81... 2024-09-12T00:01:34.805 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:01:34.846 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.904 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.905 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:01:34.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.33,[v2:172.21.15.33:3301,v1:172.21.15.33:6790],172.21.15.162" 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: mon client directed command retry = 5 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: ms inject socket failures = 5000 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: osd heartbeat grace = 40 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:01:34.907 INFO:teuthology.orchestra.run.smithi033.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2024-09-12T00:01:34.908 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug trim objects = true 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:01:34.909 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = bitmap 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: debug objclass = 20 2024-09-12T00:01:34.910 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: osd fast shutdown = False 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: osd shutdown pgref assert = True 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-09-12T00:01:34.911 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2024-09-12T00:01:34.912 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd crush smoke test = False 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = True 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: debug rgw = 20 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: debug rgw notification = 20 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: rgw bucket counters cache = True 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: rgw crypt require ssl = False 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:01:34.914 INFO:teuthology.orchestra.run.smithi033.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw max chunk size = 4194304 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw obj stripe size = 6291456 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw s3 auth use sts = True 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw torrent flag = True 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: rgw user counters cache = True 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: setgroup = ceph 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout: setuser = ceph 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2024-09-12T00:01:34.915 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2024-09-12T00:01:34.917 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-09-12T00:01:34.917 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-09-12T00:01:34.917 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:01:34.917 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-09-12T00:01:34.917 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.918 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:01:34.919 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.33,[v2:172.21.15.33:3301,v1:172.21.15.33:6790],172.21.15.162" 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: mon client directed command retry = 5 2024-09-12T00:01:34.920 INFO:teuthology.orchestra.run.smithi162.stdout: ms inject socket failures = 5000 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: osd heartbeat grace = 40 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.921 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-09-12T00:01:34.922 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2024-09-12T00:01:34.923 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: debug objclass = 20 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: osd fast shutdown = False 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: osd shutdown pgref assert = True 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-09-12T00:01:34.924 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-09-12T00:01:34.925 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:01:34.926 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd crush smoke test = False 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = True 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:01:34.927 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: debug rgw = 20 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: debug rgw notification = 20 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw bucket counters cache = True 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw crypt require ssl = False 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw max chunk size = 4194304 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw obj stripe size = 6291456 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:01:34.928 INFO:teuthology.orchestra.run.smithi162.stdout: rgw s3 auth use sts = True 2024-09-12T00:01:34.929 INFO:teuthology.orchestra.run.smithi162.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:01:34.929 INFO:teuthology.orchestra.run.smithi162.stdout: rgw torrent flag = True 2024-09-12T00:01:34.929 INFO:teuthology.orchestra.run.smithi162.stdout: rgw user counters cache = True 2024-09-12T00:01:34.929 INFO:teuthology.orchestra.run.smithi162.stdout: setgroup = ceph 2024-09-12T00:01:34.929 INFO:teuthology.orchestra.run.smithi162.stdout: setuser = ceph 2024-09-12T00:01:34.929 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-09-12T00:01:34.929 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-09-12T00:01:34.929 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-09-12T00:01:34.930 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:01:34.930 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:01:35.002 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:01:35.002 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:35.003 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:01:35.032 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:35.032 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:01:35.101 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T00:01:35.101 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:35.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:01:35.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:01:35.191 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:01:35.191 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:35.261 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T00:01:35.261 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:01:35.261 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:01:35.261 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:01:35.310 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:01:35.311 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:35.379 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:01:35.379 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:01:35.380 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:01:35.446 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:01:35.449 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:01:35.521 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:01:35.524 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:01:35.524 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:01:35.524 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:01:35.581 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:01:35.595 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:01:35.650 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:01:35.663 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:01:35.663 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:01:35.663 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:01:35.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:35.704 INFO:tasks.ceph:role: osd.0 2024-09-12T00:01:35.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T00:01:35.704 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:01:35.790 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:35.791 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:36.298 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-09-12T00:01:36.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-09-12T00:01:36.301 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:01:36.439 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:01:36.488 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:01:36.530 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:36.530 INFO:tasks.ceph:role: osd.1 2024-09-12T00:01:36.530 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T00:01:36.530 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:01:36.631 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:36.632 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:36.632 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:36.632 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:36.632 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:37.070 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-09-12T00:01:37.072 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-09-12T00:01:37.072 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:01:37.137 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:01:37.182 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:01:37.223 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:37.223 INFO:tasks.ceph:role: osd.2 2024-09-12T00:01:37.223 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T00:01:37.223 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:37.311 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:37.797 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-09-12T00:01:37.799 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-09-12T00:01:37.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:01:37.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:01:37.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:01:37.955 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:37.955 INFO:tasks.ceph:role: osd.3 2024-09-12T00:01:37.955 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T00:01:37.955 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:38.043 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:38.551 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-09-12T00:01:38.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-09-12T00:01:38.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:01:38.651 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:01:38.700 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:38.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:38.806+0000 7f601161c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:01:38.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:38.811+0000 7f601161c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:01:38.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:38.812+0000 7f601161c640 -1 bdev(0x55d149815800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:38.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:38.812+0000 7f601161c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:01:42.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:01:42.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:42.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:42.326+0000 7f7f2561e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:01:42.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:42.326+0000 7f7f2561e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:01:42.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:42.326+0000 7f7f2561e640 -1 bdev(0x56290eb47800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:42.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:42.326+0000 7f7f2561e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:01:45.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:01:45.295 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:45.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:45.360+0000 7fe55f211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:01:45.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:45.361+0000 7fe55f211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:01:45.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:45.361+0000 7fe55f211640 -1 bdev(0x555f058b7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:45.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:45.361+0000 7fe55f211640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:01:48.523 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:01:48.567 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:48.673+0000 7f9ac31a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:01:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:48.673+0000 7f9ac31a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:01:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:48.673+0000 7f9ac31a8640 -1 bdev(0x5650f1c7d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:01:48.673+0000 7f9ac31a8640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:01:51.831 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:01:51.879 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:01:51.925 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:51.925 INFO:tasks.ceph:role: osd.4 2024-09-12T00:01:51.925 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T00:01:51.925 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:01:51.975 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:51.975 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:51.975 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:51.975 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:51.975 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:51.975 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:51.976 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:51.976 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:51.976 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:51.976 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:52.484 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-12T00:01:52.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-12T00:01:52.487 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:01:52.578 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:01:52.625 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:01:52.663 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:52.663 INFO:tasks.ceph:role: osd.5 2024-09-12T00:01:52.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T00:01:52.664 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:01:52.750 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:52.750 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:52.750 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:52.750 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:52.750 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:52.750 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:52.751 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:52.751 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:52.751 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:52.751 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:53.210 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-12T00:01:53.211 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-12T00:01:53.212 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:01:53.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:01:53.299 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:01:53.378 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:53.378 INFO:tasks.ceph:role: osd.6 2024-09-12T00:01:53.378 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T00:01:53.378 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:01:53.464 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:53.465 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:53.960 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-12T00:01:53.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-12T00:01:53.962 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:01:54.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:01:54.093 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:01:54.134 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:54.135 INFO:tasks.ceph:role: osd.7 2024-09-12T00:01:54.135 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T00:01:54.135 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:01:54.222 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:54.222 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:54.222 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:54.222 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:54.222 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:54.222 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:54.222 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:54.222 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:54.223 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:54.223 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:54.742 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-12T00:01:54.745 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-12T00:01:54.745 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:01:54.873 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:01:54.918 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:54.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:01:54.990+0000 7f1213f02640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:01:54.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:01:54.994+0000 7f1213f02640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:01:54.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:01:54.994+0000 7f1213f02640 -1 bdev(0x563244483800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:54.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:01:54.995+0000 7f1213f02640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:01:57.898 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:01:57.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:58.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:01:58.046+0000 7fcfb4c1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:01:58.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:01:58.047+0000 7fcfb4c1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:01:58.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:01:58.047+0000 7fcfb4c1a640 -1 bdev(0x55cf0412b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:58.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:01:58.047+0000 7fcfb4c1a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:02:01.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:02:01.248 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:01.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:02:01.353+0000 7f3b4681d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:02:01.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:02:01.353+0000 7f3b4681d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:02:01.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:02:01.353+0000 7f3b4681d640 -1 bdev(0x563f7e57f800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:01.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:02:01.353+0000 7f3b4681d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:02:04.252 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:02:04.291 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:04.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:02:04.391+0000 7f25a9660640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:02:04.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:02:04.391+0000 7f25a9660640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:02:04.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:02:04.391+0000 7f25a9660640 -1 bdev(0x56463766f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:02:04.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-12T00:02:04.392+0000 7f25a9660640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:02:07.309 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:02:07.352 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:02:07.353 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:07.353 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:02:07.401 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:07.401 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:02:07.485 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:07.485 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:02:07.568 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:07.568 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:02:07.650 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:07.650 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:02:07.732 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:07.732 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:02:07.778 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:07.778 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:02:07.861 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:07.861 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:02:07.942 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:07.942 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:02:08.024 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:08.024 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:02:08.104 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:08.105 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:02:08.138 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:08.139 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:02:08.174 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:02:08.175 DEBUG:teuthology.orchestra.run.smithi033:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:02:08.181 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:02:08.220 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.y] 2024-09-12T00:02:08.220 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBfL+JmTDjBGhAAgawrbtVdEohzpH2BYDVacw== 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.0] 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBiL+JmG9wbMBAAXUJolVOPsby1GLTyw1qU7g== 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.1] 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBmL+JmjFd8ExAAlxBCCGab7UWmfEV84xEzhg== 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.2] 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBpL+JmDweQFRAARFdknqz81DlpI5DIHuN+MA== 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.3] 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBsL+JmPRMyKBAA1I7rmzyn7Y98/2MvBdy2MA== 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.x] 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBfL+Jmxe80HxAASUnRXl5R8e33FQg2eJ5DMA== 2024-09-12T00:02:08.221 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.4] 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQByL+JmwqAcOxAAo1MpSFpHSJpkxD2wzLYAKg== 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.5] 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB2L+Jmzw/YAhAAO9lDBcn6rukTyqPgO3s9CA== 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.6] 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB5L+Jm1FIfFRAAhH+bfj/h7uf4VVt24tQTWg== 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.7] 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB8L+JmLkdkFxAAAfGxkQy16UIL0e0AMHBBqA== 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBfL+JmQYjAIhAA/cmv/fT9c+fOgKSJNU0Qpg== 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout:[client.1] 2024-09-12T00:02:08.222 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBfL+JmeL7lJhAAJNXD0u+6A+v+7OhQ0VveCQ== 2024-09-12T00:02:08.251 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-09-12T00:02:08.251 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBfL+JmTDjBGhAAgawrbtVdEohzpH2BYDVacw== 2024-09-12T00:02:08.251 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-09-12T00:02:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBiL+JmG9wbMBAAXUJolVOPsby1GLTyw1qU7g== 2024-09-12T00:02:08.252 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-09-12T00:02:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBmL+JmjFd8ExAAlxBCCGab7UWmfEV84xEzhg== 2024-09-12T00:02:08.252 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-09-12T00:02:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBpL+JmDweQFRAARFdknqz81DlpI5DIHuN+MA== 2024-09-12T00:02:08.252 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-09-12T00:02:08.252 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBsL+JmPRMyKBAA1I7rmzyn7Y98/2MvBdy2MA== 2024-09-12T00:02:08.252 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBfL+Jmxe80HxAASUnRXl5R8e33FQg2eJ5DMA== 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQByL+JmwqAcOxAAo1MpSFpHSJpkxD2wzLYAKg== 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB2L+Jmzw/YAhAAO9lDBcn6rukTyqPgO3s9CA== 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB5L+Jm1FIfFRAAhH+bfj/h7uf4VVt24tQTWg== 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB8L+JmLkdkFxAAAfGxkQy16UIL0e0AMHBBqA== 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBfL+JmQYjAIhAA/cmv/fT9c+fOgKSJNU0Qpg== 2024-09-12T00:02:08.253 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-09-12T00:02:08.254 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBfL+JmeL7lJhAAJNXD0u+6A+v+7OhQ0VveCQ== 2024-09-12T00:02:08.255 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:02:08.266 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:02:08.360 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.363 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.428 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.431 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.495 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.498 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.563 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.565 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.630 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:02:08.633 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:02:08.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.701 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.766 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.768 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.834 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.899 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.902 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:02:08.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:02:08.969 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:02:09.036 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:02:09.039 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:02:09.108 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:02:09.108 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:02:09.147 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:02:09.262 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:02:09.303 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:02:09.383 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:02:09.493 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:02:09.534 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:02:09.572 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:02:09.683 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:02:09.721 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:09.724 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:02:09.791 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:02:09.791 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:02:09.792 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:02:09.794 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:02:09.794 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:02:09.795 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:02:09.797 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:02:09.797 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:02:09.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:02:09.834 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:02:09.835 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:02:09.835 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:02:09.835 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:02:09.837 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:02:09.837 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:02:09.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:02:09.839 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:02:09.840 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:02:09.840 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:02:09.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:02:16.040 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-09-12T00:02:16.049 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:02:16.049 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:02:16.050 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:16.050 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:02:16.090 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:16.090 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:02:16.170 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:16.170 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:02:16.249 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:16.249 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:02:16.331 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:16.331 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:02:16.370 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:16.371 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:02:16.453 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:16.453 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:02:16.533 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-12T00:02:16.533 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:02:16.612 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 50767dc8-4c58-4765-bf1e-43835790e3b5 0 2024-09-12T00:02:16.852 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-09-12T00:02:16.863 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new ad7bf85b-fc8a-4331-a594-3bbb3a650d65 1 2024-09-12T00:02:17.063 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-12T00:02:17.074 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new d5b4c9d7-bfbb-42ee-91c1-6d5af5370e8f 2 2024-09-12T00:02:17.285 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-09-12T00:02:17.297 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new c0ee6c10-9d80-496d-8494-d28fda128cf0 3 2024-09-12T00:02:17.497 INFO:teuthology.orchestra.run.smithi162.stdout:3 2024-09-12T00:02:17.508 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new fc605b1b-c3c9-476c-a907-cc77fcef4ee5 4 2024-09-12T00:02:17.716 INFO:teuthology.orchestra.run.smithi162.stdout:4 2024-09-12T00:02:17.728 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 41f07182-4c0f-486e-a0a0-3405ba5d17f1 5 2024-09-12T00:02:17.925 INFO:teuthology.orchestra.run.smithi162.stdout:5 2024-09-12T00:02:17.936 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new f260a4ee-a1f9-4def-809a-76b7bdf7ff24 6 2024-09-12T00:02:18.131 INFO:teuthology.orchestra.run.smithi162.stdout:6 2024-09-12T00:02:18.142 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new b71d17e0-f235-4987-aaf6-19d832f74366 7 2024-09-12T00:02:18.335 INFO:teuthology.orchestra.run.smithi162.stdout:7 2024-09-12T00:02:18.347 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:02:18.348 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:02:18.351 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:02:18.351 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:02:18.351 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:02:18.354 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:02:18.354 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:02:18.355 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:02:18.357 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:02:18.358 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:02:18.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:02:18.361 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:02:18.362 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:02:18.362 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:02:18.365 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:02:18.365 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:02:18.365 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:02:18.368 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:02:18.368 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:02:18.368 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:02:18.371 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:02:18.371 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:02:18.372 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:02:18.375 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:02:18.375 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:02:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:02:18.592 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"fsid":"69d022f9-3312-45e8-ade0-937e32c87c81","created":"2024-09-12T00:02:15.117539+0000","modified":"2024-09-12T00:02:18.335955+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:02:18.335955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"50767dc8-4c58-4765-bf1e-43835790e3b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ad7bf85b-fc8a-4331-a594-3bbb3a650d65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5b4c9d7-bfbb-42ee-91c1-6d5af5370e8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0ee6c10-9d80-496d-8494-d28fda128cf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fc605b1b-c3c9-476c-a907-cc77fcef4ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"41f07182-4c0f-486e-a0a0-3405ba5d17f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f260a4ee-a1f9-4def-809a-76b7bdf7ff24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b71d17e0-f235-4987-aaf6-19d832f74366","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:02:18.603 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:02:18.603 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:02:19.410 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:02:19.582 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-09-12T00:02:19.583+0000 7f9f2e60b640 -1 Falling back to public interface 2024-09-12T00:02:19.591 INFO:teuthology.misc.health.smithi033.stdout: 2024-09-12T00:02:19.591 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":10,"fsid":"69d022f9-3312-45e8-ade0-937e32c87c81","created":"2024-09-12T00:02:15.117539+0000","modified":"2024-09-12T00:02:18.335955+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:02:18.335955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"50767dc8-4c58-4765-bf1e-43835790e3b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ad7bf85b-fc8a-4331-a594-3bbb3a650d65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5b4c9d7-bfbb-42ee-91c1-6d5af5370e8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0ee6c10-9d80-496d-8494-d28fda128cf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fc605b1b-c3c9-476c-a907-cc77fcef4ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"41f07182-4c0f-486e-a0a0-3405ba5d17f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f260a4ee-a1f9-4def-809a-76b7bdf7ff24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b71d17e0-f235-4987-aaf6-19d832f74366","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:02:19.596 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-09-12T00:02:19.597+0000 7fb022c0f640 -1 Falling back to public interface 2024-09-12T00:02:19.601 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:02:19.609 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-09-12T00:02:19.610+0000 7f3e9b02e640 -1 Falling back to public interface 2024-09-12T00:02:19.610 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-09-12T00:02:19.611+0000 7f3b19fdb640 -1 Falling back to public interface 2024-09-12T00:02:19.863 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-12T00:02:19.864+0000 7f9db901c640 -1 Falling back to public interface 2024-09-12T00:02:19.868 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-12T00:02:19.869+0000 7f6590129640 -1 Falling back to public interface 2024-09-12T00:02:20.078 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-12T00:02:20.079+0000 7f1f0b01a640 -1 Falling back to public interface 2024-09-12T00:02:20.088 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-12T00:02:20.090+0000 7f2b77119640 -1 Falling back to public interface 2024-09-12T00:02:20.751 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-12T00:02:20.752+0000 7f7f47787640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:02:20.752 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-09-12T00:02:20.753+0000 7f7f47787640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:02:23.098 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-09-12T00:02:23.099+0000 7f9f2e60b640 -1 osd.0 0 log_to_monitors true 2024-09-12T00:02:23.152 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-09-12T00:02:23.153+0000 7fb022c0f640 -1 osd.2 0 log_to_monitors true 2024-09-12T00:02:23.420 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-12T00:02:23.421+0000 7f9db901c640 -1 osd.5 0 log_to_monitors true 2024-09-12T00:02:23.653 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-12T00:02:23.655+0000 7f6590129640 -1 osd.7 0 log_to_monitors true 2024-09-12T00:02:23.709 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-09-12T00:02:23.710+0000 7f3e9b02e640 -1 osd.1 0 log_to_monitors true 2024-09-12T00:02:23.943 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-09-12T00:02:23.944+0000 7f3b19fdb640 -1 osd.3 0 log_to_monitors true 2024-09-12T00:02:24.077 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-12T00:02:24.078+0000 7f1f0b01a640 -1 osd.4 0 log_to_monitors true 2024-09-12T00:02:24.127 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-12T00:02:24.128+0000 7f2b77119640 -1 osd.6 0 log_to_monitors true 2024-09-12T00:02:25.048 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-09-12T00:02:25.049+0000 7f9f2a835640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:02:25.062 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-09-12T00:02:25.060+0000 7f9f21e40640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:02:26.409 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:02:26.920 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-09-12T00:02:26.921+0000 7fb01e621640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:02:26.930 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-09-12T00:02:26.931+0000 7f3b15f6f640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:02:26.936 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-09-12T00:02:26.937+0000 7fb016440640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:02:26.937 INFO:teuthology.misc.health.smithi033.stdout: 2024-09-12T00:02:26.937 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":14,"fsid":"69d022f9-3312-45e8-ade0-937e32c87c81","created":"2024-09-12T00:02:15.117539+0000","modified":"2024-09-12T00:02:26.487784+0000","last_up_change":"2024-09-12T00:02:25.144326+0000","last_in_change":"2024-09-12T00:02:18.335955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"50767dc8-4c58-4765-bf1e-43835790e3b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6801","nonce":659192624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6803","nonce":659192624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6807","nonce":659192624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6805","nonce":659192624}]},"public_addr":"172.21.15.33:6801/659192624","cluster_addr":"172.21.15.33:6803/659192624","heartbeat_back_addr":"172.21.15.33:6807/659192624","heartbeat_front_addr":"172.21.15.33:6805/659192624","state":["exists","up"]},{"osd":1,"uuid":"ad7bf85b-fc8a-4331-a594-3bbb3a650d65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5b4c9d7-bfbb-42ee-91c1-6d5af5370e8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0ee6c10-9d80-496d-8494-d28fda128cf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fc605b1b-c3c9-476c-a907-cc77fcef4ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"41f07182-4c0f-486e-a0a0-3405ba5d17f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f260a4ee-a1f9-4def-809a-76b7bdf7ff24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b71d17e0-f235-4987-aaf6-19d832f74366","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.134226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:02:26.943 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-09-12T00:02:26.944+0000 7f3b0dd8e640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:02:26.949 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T00:02:26.957 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-09-12T00:02:26.959+0000 7f3e9663f640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:02:26.975 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-09-12T00:02:26.976+0000 7f3e8e45e640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:02:27.220 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-12T00:02:27.220+0000 7f658c0bd640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:02:27.232 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-12T00:02:27.232+0000 7f9db490d640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:02:27.234 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-12T00:02:27.234+0000 7f6583edc640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:02:27.249 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-12T00:02:27.250+0000 7f9dac73d640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:02:27.260 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-12T00:02:27.260+0000 7f1f077c2640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:02:27.263 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-12T00:02:27.263+0000 7f2b738c1640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:02:27.272 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-12T00:02:27.272+0000 7f1efedcd640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:02:27.273 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-12T00:02:27.272+0000 7f2b6aecc640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:02:33.756 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:02:34.080 INFO:teuthology.misc.health.smithi033.stdout: 2024-09-12T00:02:34.080 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":19,"fsid":"69d022f9-3312-45e8-ade0-937e32c87c81","created":"2024-09-12T00:02:15.117539+0000","modified":"2024-09-12T00:02:31.959629+0000","last_up_change":"2024-09-12T00:02:27.935891+0000","last_in_change":"2024-09-12T00:02:18.335955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:02:29.761733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"50767dc8-4c58-4765-bf1e-43835790e3b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6801","nonce":659192624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6803","nonce":659192624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6807","nonce":659192624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6805","nonce":659192624}]},"public_addr":"172.21.15.33:6801/659192624","cluster_addr":"172.21.15.33:6803/659192624","heartbeat_back_addr":"172.21.15.33:6807/659192624","heartbeat_front_addr":"172.21.15.33:6805/659192624","state":["exists","up"]},{"osd":1,"uuid":"ad7bf85b-fc8a-4331-a594-3bbb3a650d65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6817","nonce":3131120991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6819","nonce":3131120991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6827","nonce":3131120991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6823","nonce":3131120991}]},"public_addr":"172.21.15.33:6817/3131120991","cluster_addr":"172.21.15.33:6819/3131120991","heartbeat_back_addr":"172.21.15.33:6827/3131120991","heartbeat_front_addr":"172.21.15.33:6823/3131120991","state":["exists","up"]},{"osd":2,"uuid":"d5b4c9d7-bfbb-42ee-91c1-6d5af5370e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6809","nonce":2826150194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6811","nonce":2826150194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6815","nonce":2826150194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6813","nonce":2826150194}]},"public_addr":"172.21.15.33:6809/2826150194","cluster_addr":"172.21.15.33:6811/2826150194","heartbeat_back_addr":"172.21.15.33:6815/2826150194","heartbeat_front_addr":"172.21.15.33:6813/2826150194","state":["exists","up"]},{"osd":3,"uuid":"c0ee6c10-9d80-496d-8494-d28fda128cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6822","nonce":1243170537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6826","nonce":1243170537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6831","nonce":1243170537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6829","nonce":1243170537}]},"public_addr":"172.21.15.33:6822/1243170537","cluster_addr":"172.21.15.33:6826/1243170537","heartbeat_back_addr":"172.21.15.33:6831/1243170537","heartbeat_front_addr":"172.21.15.33:6829/1243170537","state":["exists","up"]},{"osd":4,"uuid":"fc605b1b-c3c9-476c-a907-cc77fcef4ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6817","nonce":3412691534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6819","nonce":3412691534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6823","nonce":3412691534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6821","nonce":3412691534}]},"public_addr":"172.21.15.162:6817/3412691534","cluster_addr":"172.21.15.162:6819/3412691534","heartbeat_back_addr":"172.21.15.162:6823/3412691534","heartbeat_front_addr":"172.21.15.162:6821/3412691534","state":["exists","up"]},{"osd":5,"uuid":"41f07182-4c0f-486e-a0a0-3405ba5d17f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6801","nonce":85576769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6803","nonce":85576769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6807","nonce":85576769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6805","nonce":85576769}]},"public_addr":"172.21.15.162:6801/85576769","cluster_addr":"172.21.15.162:6803/85576769","heartbeat_back_addr":"172.21.15.162:6807/85576769","heartbeat_front_addr":"172.21.15.162:6805/85576769","state":["exists","up"]},{"osd":6,"uuid":"f260a4ee-a1f9-4def-809a-76b7bdf7ff24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6825","nonce":3281183708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6827","nonce":3281183708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6831","nonce":3281183708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6829","nonce":3281183708}]},"public_addr":"172.21.15.162:6825/3281183708","cluster_addr":"172.21.15.162:6827/3281183708","heartbeat_back_addr":"172.21.15.162:6831/3281183708","heartbeat_front_addr":"172.21.15.162:6829/3281183708","state":["exists","up"]},{"osd":7,"uuid":"b71d17e0-f235-4987-aaf6-19d832f74366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6809","nonce":3549921352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6811","nonce":3549921352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6815","nonce":3549921352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6813","nonce":3549921352}]},"public_addr":"172.21.15.162:6809/3549921352","cluster_addr":"172.21.15.162:6811/3549921352","heartbeat_back_addr":"172.21.15.162:6815/3549921352","heartbeat_front_addr":"172.21.15.162:6813/3549921352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.134226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.677635+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.201058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.927137+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:25.075067+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.446938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:25.141076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.654872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:02:34.092 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:02:34.092 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:02:34.092 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:02:34.974 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'rbd' created 2024-09-12T00:02:34.992 DEBUG:teuthology.orchestra.run.smithi033:> rbd --cluster ceph pool init rbd 2024-09-12T00:02:35.053 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:38.008 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:02:38.009 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:02:38.009 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:02:38.335 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:02:38.348 INFO:teuthology.orchestra.run.smithi033.stdout:[{"version":9,"timestamp":"2024-09-12T00:02:27.268692+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5344.291068"}]}] 2024-09-12T00:02:38.348 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:02:38.349 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:02:38.349 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:02:38.349 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:02:38.712 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:02:38.723 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1036841236},{"type":"v1","addr":"172.21.15.33:6833","nonce":1036841236}]},"active_addr":"172.21.15.33:6833/1036841236","active_change":"2024-09-12T00:02:19.740453+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1774407188}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1546648408}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1369152234}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1785717190}]}]} 2024-09-12T00:02:38.729 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:02:38.729 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:02:38.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:02:39.043 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:02:39.043 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"fsid":"69d022f9-3312-45e8-ade0-937e32c87c81","created":"2024-09-12T00:02:15.117539+0000","modified":"2024-09-12T00:02:37.989416+0000","last_up_change":"2024-09-12T00:02:27.935891+0000","last_in_change":"2024-09-12T00:02:18.335955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:02:29.761733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:02:34.408783+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"50767dc8-4c58-4765-bf1e-43835790e3b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6801","nonce":659192624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6803","nonce":659192624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6807","nonce":659192624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6805","nonce":659192624}]},"public_addr":"172.21.15.33:6801/659192624","cluster_addr":"172.21.15.33:6803/659192624","heartbeat_back_addr":"172.21.15.33:6807/659192624","heartbeat_front_addr":"172.21.15.33:6805/659192624","state":["exists","up"]},{"osd":1,"uuid":"ad7bf85b-fc8a-4331-a594-3bbb3a650d65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6817","nonce":3131120991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6819","nonce":3131120991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6827","nonce":3131120991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6823","nonce":3131120991}]},"public_addr":"172.21.15.33:6817/3131120991","cluster_addr":"172.21.15.33:6819/3131120991","heartbeat_back_addr":"172.21.15.33:6827/3131120991","heartbeat_front_addr":"172.21.15.33:6823/3131120991","state":["exists","up"]},{"osd":2,"uuid":"d5b4c9d7-bfbb-42ee-91c1-6d5af5370e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6809","nonce":2826150194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6811","nonce":2826150194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6815","nonce":2826150194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6813","nonce":2826150194}]},"public_addr":"172.21.15.33:6809/2826150194","cluster_addr":"172.21.15.33:6811/2826150194","heartbeat_back_addr":"172.21.15.33:6815/2826150194","heartbeat_front_addr":"172.21.15.33:6813/2826150194","state":["exists","up"]},{"osd":3,"uuid":"c0ee6c10-9d80-496d-8494-d28fda128cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6822","nonce":1243170537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6826","nonce":1243170537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6831","nonce":1243170537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6829","nonce":1243170537}]},"public_addr":"172.21.15.33:6822/1243170537","cluster_addr":"172.21.15.33:6826/1243170537","heartbeat_back_addr":"172.21.15.33:6831/1243170537","heartbeat_front_addr":"172.21.15.33:6829/1243170537","state":["exists","up"]},{"osd":4,"uuid":"fc605b1b-c3c9-476c-a907-cc77fcef4ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6817","nonce":3412691534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6819","nonce":3412691534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6823","nonce":3412691534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6821","nonce":3412691534}]},"public_addr":"172.21.15.162:6817/3412691534","cluster_addr":"172.21.15.162:6819/3412691534","heartbeat_back_addr":"172.21.15.162:6823/3412691534","heartbeat_front_addr":"172.21.15.162:6821/3412691534","state":["exists","up"]},{"osd":5,"uuid":"41f07182-4c0f-486e-a0a0-3405ba5d17f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6801","nonce":85576769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6803","nonce":85576769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6807","nonce":85576769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6805","nonce":85576769}]},"public_addr":"172.21.15.162:6801/85576769","cluster_addr":"172.21.15.162:6803/85576769","heartbeat_back_addr":"172.21.15.162:6807/85576769","heartbeat_front_addr":"172.21.15.162:6805/85576769","state":["exists","up"]},{"osd":6,"uuid":"f260a4ee-a1f9-4def-809a-76b7bdf7ff24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6825","nonce":3281183708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6827","nonce":3281183708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6831","nonce":3281183708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6829","nonce":3281183708}]},"public_addr":"172.21.15.162:6825/3281183708","cluster_addr":"172.21.15.162:6827/3281183708","heartbeat_back_addr":"172.21.15.162:6831/3281183708","heartbeat_front_addr":"172.21.15.162:6829/3281183708","state":["exists","up"]},{"osd":7,"uuid":"b71d17e0-f235-4987-aaf6-19d832f74366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6809","nonce":3549921352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6811","nonce":3549921352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6815","nonce":3549921352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6813","nonce":3549921352}]},"public_addr":"172.21.15.162:6809/3549921352","cluster_addr":"172.21.15.162:6811/3549921352","heartbeat_back_addr":"172.21.15.162:6815/3549921352","heartbeat_front_addr":"172.21.15.162:6813/3549921352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.134226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.677635+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.201058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.927137+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:25.075067+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.446938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:25.141076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.654872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:02:39.056 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:02:39.056 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:02:39.372 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:02:39.372 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"fsid":"69d022f9-3312-45e8-ade0-937e32c87c81","created":"2024-09-12T00:02:15.117539+0000","modified":"2024-09-12T00:02:37.989416+0000","last_up_change":"2024-09-12T00:02:27.935891+0000","last_in_change":"2024-09-12T00:02:18.335955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:02:29.761733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:02:34.408783+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"50767dc8-4c58-4765-bf1e-43835790e3b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6801","nonce":659192624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6803","nonce":659192624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6807","nonce":659192624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6805","nonce":659192624}]},"public_addr":"172.21.15.33:6801/659192624","cluster_addr":"172.21.15.33:6803/659192624","heartbeat_back_addr":"172.21.15.33:6807/659192624","heartbeat_front_addr":"172.21.15.33:6805/659192624","state":["exists","up"]},{"osd":1,"uuid":"ad7bf85b-fc8a-4331-a594-3bbb3a650d65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6817","nonce":3131120991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6819","nonce":3131120991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6827","nonce":3131120991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6823","nonce":3131120991}]},"public_addr":"172.21.15.33:6817/3131120991","cluster_addr":"172.21.15.33:6819/3131120991","heartbeat_back_addr":"172.21.15.33:6827/3131120991","heartbeat_front_addr":"172.21.15.33:6823/3131120991","state":["exists","up"]},{"osd":2,"uuid":"d5b4c9d7-bfbb-42ee-91c1-6d5af5370e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6809","nonce":2826150194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6811","nonce":2826150194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6815","nonce":2826150194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6813","nonce":2826150194}]},"public_addr":"172.21.15.33:6809/2826150194","cluster_addr":"172.21.15.33:6811/2826150194","heartbeat_back_addr":"172.21.15.33:6815/2826150194","heartbeat_front_addr":"172.21.15.33:6813/2826150194","state":["exists","up"]},{"osd":3,"uuid":"c0ee6c10-9d80-496d-8494-d28fda128cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6822","nonce":1243170537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6826","nonce":1243170537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6831","nonce":1243170537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6829","nonce":1243170537}]},"public_addr":"172.21.15.33:6822/1243170537","cluster_addr":"172.21.15.33:6826/1243170537","heartbeat_back_addr":"172.21.15.33:6831/1243170537","heartbeat_front_addr":"172.21.15.33:6829/1243170537","state":["exists","up"]},{"osd":4,"uuid":"fc605b1b-c3c9-476c-a907-cc77fcef4ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6817","nonce":3412691534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6819","nonce":3412691534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6823","nonce":3412691534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6821","nonce":3412691534}]},"public_addr":"172.21.15.162:6817/3412691534","cluster_addr":"172.21.15.162:6819/3412691534","heartbeat_back_addr":"172.21.15.162:6823/3412691534","heartbeat_front_addr":"172.21.15.162:6821/3412691534","state":["exists","up"]},{"osd":5,"uuid":"41f07182-4c0f-486e-a0a0-3405ba5d17f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6801","nonce":85576769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6803","nonce":85576769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6807","nonce":85576769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6805","nonce":85576769}]},"public_addr":"172.21.15.162:6801/85576769","cluster_addr":"172.21.15.162:6803/85576769","heartbeat_back_addr":"172.21.15.162:6807/85576769","heartbeat_front_addr":"172.21.15.162:6805/85576769","state":["exists","up"]},{"osd":6,"uuid":"f260a4ee-a1f9-4def-809a-76b7bdf7ff24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6825","nonce":3281183708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6827","nonce":3281183708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6831","nonce":3281183708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6829","nonce":3281183708}]},"public_addr":"172.21.15.162:6825/3281183708","cluster_addr":"172.21.15.162:6827/3281183708","heartbeat_back_addr":"172.21.15.162:6831/3281183708","heartbeat_front_addr":"172.21.15.162:6829/3281183708","state":["exists","up"]},{"osd":7,"uuid":"b71d17e0-f235-4987-aaf6-19d832f74366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6809","nonce":3549921352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6811","nonce":3549921352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6815","nonce":3549921352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6813","nonce":3549921352}]},"public_addr":"172.21.15.162:6809/3549921352","cluster_addr":"172.21.15.162:6811/3549921352","heartbeat_back_addr":"172.21.15.162:6815/3549921352","heartbeat_front_addr":"172.21.15.162:6813/3549921352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.134226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.677635+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.201058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.927137+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:25.075067+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.446938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:25.141076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.654872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:02:39.385 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:02:39.385 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:02:39.386 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:02:39.386 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:02:39.386 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:02:39.387 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:02:39.387 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:02:39.387 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:02:39.662 INFO:teuthology.orchestra.run.smithi033.stdout:64424509446 2024-09-12T00:02:39.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:02:39.667 INFO:teuthology.orchestra.run.smithi033.stdout:64424509444 2024-09-12T00:02:39.667 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:02:39.668 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2024-09-12T00:02:39.668 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:02:39.669 INFO:teuthology.orchestra.run.smithi033.stdout:64424509445 2024-09-12T00:02:39.670 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:02:39.670 INFO:teuthology.orchestra.run.smithi033.stdout:64424509445 2024-09-12T00:02:39.671 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:02:39.673 INFO:teuthology.orchestra.run.smithi033.stdout:64424509444 2024-09-12T00:02:39.673 INFO:teuthology.orchestra.run.smithi033.stdout:64424509446 2024-09-12T00:02:39.674 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:02:39.674 INFO:teuthology.orchestra.run.smithi033.stdout:64424509446 2024-09-12T00:02:39.674 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:02:39.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:02:40.275 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2024-09-12T00:02:40.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-09-12T00:02:40.296 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:40.303 INFO:teuthology.orchestra.run.smithi033.stdout:64424509444 2024-09-12T00:02:40.303 INFO:teuthology.orchestra.run.smithi033.stdout:64424509446 2024-09-12T00:02:40.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-12T00:02:40.318 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:40.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.3 2024-09-12T00:02:40.322 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:40.333 INFO:teuthology.orchestra.run.smithi033.stdout:64424509444 2024-09-12T00:02:40.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.2 2024-09-12T00:02:40.346 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:40.363 INFO:teuthology.orchestra.run.smithi033.stdout:64424509446 2024-09-12T00:02:40.369 INFO:teuthology.orchestra.run.smithi033.stdout:64424509446 2024-09-12T00:02:40.370 INFO:teuthology.orchestra.run.smithi033.stdout:64424509445 2024-09-12T00:02:40.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-12T00:02:40.385 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:40.387 INFO:teuthology.orchestra.run.smithi033.stdout:64424509445 2024-09-12T00:02:40.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.4 2024-09-12T00:02:40.389 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:40.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-12T00:02:40.390 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:40.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-12T00:02:40.401 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:40.401 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:02:40.402 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:02:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:02:40.755 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T00:02:40.767 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T00:02:39.749569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219244,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755476,"statfs":{"total":773094113280,"available":772869607424,"internally_reserved":0,"allocated":3063808,"data_stored":1814350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.772916"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.760187+0000","last_change":"2024-09-12T00:02:38.760426+0000","last_active":"2024-09-12T00:02:38.760187+0000","last_peered":"2024-09-12T00:02:38.760187+0000","last_clean":"2024-09-12T00:02:38.760187+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T00:02:38.760187+0000","last_undegraded":"2024-09-12T00:02:38.760187+0000","last_fullsized":"2024-09-12T00:02:38.760187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:03.698275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.007684+0000","last_change":"2024-09-12T00:02:38.007684+0000","last_active":"2024-09-12T00:02:38.007684+0000","last_peered":"2024-09-12T00:02:38.007684+0000","last_clean":"2024-09-12T00:02:38.007684+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T00:02:38.007684+0000","last_undegraded":"2024-09-12T00:02:38.007684+0000","last_fullsized":"2024-09-12T00:02:38.007684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.596959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:37.999991+0000","last_change":"2024-09-12T00:02:37.999991+0000","last_active":"2024-09-12T00:02:37.999991+0000","last_peered":"2024-09-12T00:02:37.999991+0000","last_clean":"2024-09-12T00:02:37.999991+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T00:02:37.999991+0000","last_undegraded":"2024-09-12T00:02:37.999991+0000","last_fullsized":"2024-09-12T00:02:37.999991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.007657+0000","last_change":"2024-09-12T00:02:38.007657+0000","last_active":"2024-09-12T00:02:38.007657+0000","last_peered":"2024-09-12T00:02:38.007657+0000","last_clean":"2024-09-12T00:02:38.007657+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T00:02:38.007657+0000","last_undegraded":"2024-09-12T00:02:38.007657+0000","last_fullsized":"2024-09-12T00:02:38.007657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:40.382288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.004823+0000","last_change":"2024-09-12T00:02:38.004050+0000","last_active":"2024-09-12T00:02:38.004823+0000","last_peered":"2024-09-12T00:02:38.004823+0000","last_clean":"2024-09-12T00:02:38.004823+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T00:02:38.004823+0000","last_undegraded":"2024-09-12T00:02:38.004823+0000","last_fullsized":"2024-09-12T00:02:38.004823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:14.983821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:37.999935+0000","last_change":"2024-09-12T00:02:37.999935+0000","last_active":"2024-09-12T00:02:37.999935+0000","last_peered":"2024-09-12T00:02:37.999935+0000","last_clean":"2024-09-12T00:02:37.999935+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T00:02:37.999935+0000","last_undegraded":"2024-09-12T00:02:37.999935+0000","last_fullsized":"2024-09-12T00:02:37.999935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:36.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:37.999892+0000","last_change":"2024-09-12T00:02:37.999892+0000","last_active":"2024-09-12T00:02:37.999892+0000","last_peered":"2024-09-12T00:02:37.999892+0000","last_clean":"2024-09-12T00:02:37.999892+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T00:02:37.999892+0000","last_undegraded":"2024-09-12T00:02:37.999892+0000","last_fullsized":"2024-09-12T00:02:37.999892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.336025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.003392+0000","last_change":"2024-09-12T00:02:38.003392+0000","last_active":"2024-09-12T00:02:38.003392+0000","last_peered":"2024-09-12T00:02:38.003392+0000","last_clean":"2024-09-12T00:02:38.003392+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T00:02:38.003392+0000","last_undegraded":"2024-09-12T00:02:38.003392+0000","last_fullsized":"2024-09-12T00:02:38.003392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.472492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:37.999440+0000","last_change":"2024-09-12T00:02:31.950306+0000","last_active":"2024-09-12T00:02:37.999440+0000","last_peered":"2024-09-12T00:02:37.999440+0000","last_clean":"2024-09-12T00:02:37.999440+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T00:02:37.999440+0000","last_undegraded":"2024-09-12T00:02:37.999440+0000","last_fullsized":"2024-09-12T00:02:37.999440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_clean_scrub_stamp":"2024-09-12T00:02:29.944268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.076017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":669565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":79216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":669565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:02:40.768 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:02:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:02:41.078 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T00:02:41.089 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T00:02:39.749569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219244,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755476,"statfs":{"total":773094113280,"available":772869607424,"internally_reserved":0,"allocated":3063808,"data_stored":1814350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.772916"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.760187+0000","last_change":"2024-09-12T00:02:38.760426+0000","last_active":"2024-09-12T00:02:38.760187+0000","last_peered":"2024-09-12T00:02:38.760187+0000","last_clean":"2024-09-12T00:02:38.760187+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T00:02:38.760187+0000","last_undegraded":"2024-09-12T00:02:38.760187+0000","last_fullsized":"2024-09-12T00:02:38.760187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:03.698275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.007684+0000","last_change":"2024-09-12T00:02:38.007684+0000","last_active":"2024-09-12T00:02:38.007684+0000","last_peered":"2024-09-12T00:02:38.007684+0000","last_clean":"2024-09-12T00:02:38.007684+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T00:02:38.007684+0000","last_undegraded":"2024-09-12T00:02:38.007684+0000","last_fullsized":"2024-09-12T00:02:38.007684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.596959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:37.999991+0000","last_change":"2024-09-12T00:02:37.999991+0000","last_active":"2024-09-12T00:02:37.999991+0000","last_peered":"2024-09-12T00:02:37.999991+0000","last_clean":"2024-09-12T00:02:37.999991+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T00:02:37.999991+0000","last_undegraded":"2024-09-12T00:02:37.999991+0000","last_fullsized":"2024-09-12T00:02:37.999991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.007657+0000","last_change":"2024-09-12T00:02:38.007657+0000","last_active":"2024-09-12T00:02:38.007657+0000","last_peered":"2024-09-12T00:02:38.007657+0000","last_clean":"2024-09-12T00:02:38.007657+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T00:02:38.007657+0000","last_undegraded":"2024-09-12T00:02:38.007657+0000","last_fullsized":"2024-09-12T00:02:38.007657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:40.382288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.004823+0000","last_change":"2024-09-12T00:02:38.004050+0000","last_active":"2024-09-12T00:02:38.004823+0000","last_peered":"2024-09-12T00:02:38.004823+0000","last_clean":"2024-09-12T00:02:38.004823+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T00:02:38.004823+0000","last_undegraded":"2024-09-12T00:02:38.004823+0000","last_fullsized":"2024-09-12T00:02:38.004823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:14.983821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:37.999935+0000","last_change":"2024-09-12T00:02:37.999935+0000","last_active":"2024-09-12T00:02:37.999935+0000","last_peered":"2024-09-12T00:02:37.999935+0000","last_clean":"2024-09-12T00:02:37.999935+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T00:02:37.999935+0000","last_undegraded":"2024-09-12T00:02:37.999935+0000","last_fullsized":"2024-09-12T00:02:37.999935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:36.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:37.999892+0000","last_change":"2024-09-12T00:02:37.999892+0000","last_active":"2024-09-12T00:02:37.999892+0000","last_peered":"2024-09-12T00:02:37.999892+0000","last_clean":"2024-09-12T00:02:37.999892+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T00:02:37.999892+0000","last_undegraded":"2024-09-12T00:02:37.999892+0000","last_fullsized":"2024-09-12T00:02:37.999892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.336025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:38.003392+0000","last_change":"2024-09-12T00:02:38.003392+0000","last_active":"2024-09-12T00:02:38.003392+0000","last_peered":"2024-09-12T00:02:38.003392+0000","last_clean":"2024-09-12T00:02:38.003392+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T00:02:38.003392+0000","last_undegraded":"2024-09-12T00:02:38.003392+0000","last_fullsized":"2024-09-12T00:02:38.003392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.472492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:02:37.999440+0000","last_change":"2024-09-12T00:02:31.950306+0000","last_active":"2024-09-12T00:02:37.999440+0000","last_peered":"2024-09-12T00:02:37.999440+0000","last_clean":"2024-09-12T00:02:37.999440+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T00:02:37.999440+0000","last_undegraded":"2024-09-12T00:02:37.999440+0000","last_fullsized":"2024-09-12T00:02:37.999440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_clean_scrub_stamp":"2024-09-12T00:02:29.944268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.076017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":669565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":79216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":669565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:02:41.090 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:02:41.090 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:02:41.090 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:02:41.090 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:02:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:02:41.445 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:02:41.457 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:02:41.458 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:02:41.498 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:02:41.499 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:02:41.530 DEBUG:teuthology.orchestra.run.smithi033:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:02:41.681 INFO:teuthology.orchestra.run.smithi033.stderr:.............+.+...........+.+........+.+.....+...+.+..+............+...+....+......+........+....+...+...+..+....+...+..+.........+.+......+.....+....+..............+..........+...........+.+.....+....+......+.................+.......+.....+...+......+.+......+..............................+..+..........+...+++++++++++++++++++++++++++++++++++++++++++++*........+.....................+........+.+..+.........+++++++++++++++++++++++++++++++++++++++++++++*....+...........+....+...+...+..+...................+...+++++ 2024-09-12T00:02:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:..+.+.....+......+.......+.....+...+...+....+..+.+...+...........+...............+....+++++++++++++++++++++++++++++++++++++++++++++*...........+...........+............+...+....+..+...+++++++++++++++++++++++++++++++++++++++++++++*..+.............+.................+.+.....................+...+.....+.............+..+.........................+........+...+....+..+...............+...+..................+...+.......+.......................+.+...........+....+........+............+.+........+.........................+.....+.+.........+..............+......+.......+..+.............+.........+......+.....+.......+..+...+...+.........................+..+.......+...+.....+.......+........+...+...+.....................+.+...+..+...+..........+..+.......+..+...+.+......+......+........+..........+............+..+.+.................+...+....+...................................+.+............+...+..+.......+..+.+........+......+....+..+.......+..+..........+.........+...........+...+.+...............+..+...+.........+...+...+.+........+.+.....................+...........+....+.........+.....+......+.+...+......+...........+.......+...........+.........+.......+.....+.............+...........+.+...+..+......+.........+.............+..+...+......+.+...+...........+....+++++ 2024-09-12T00:02:42.143 INFO:teuthology.orchestra.run.smithi033.stderr:----- 2024-09-12T00:02:42.152 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T00:02:42.192 DEBUG:teuthology.orchestra.run.smithi033:> sudo update-ca-trust 2024-09-12T00:02:43.332 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:02:43.361 DEBUG:teuthology.orchestra.run.smithi033:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi033.front.sepia.ceph.com 2024-09-12T00:02:43.465 INFO:teuthology.orchestra.run.smithi033.stderr:....+++++++++++++++++++++++++++++++++++++++*.+...+...+.........+......+++++++++++++++++++++++++++++++++++++++*.....+...+...+....+..+.+...+..+..........+...+..++++++ 2024-09-12T00:02:43.465 INFO:teuthology.orchestra.run.smithi033.stderr:..+......+.....+.+.....+.+........+.......+..+......+.......+..+...+...+.......+.....+.............+......+........+.+.........+++++++++++++++++++++++++++++++++++++++*.........+...+.....+.......+...+......+..+...........................+.+......+...+..+...................+.........+...+++++++++++++++++++++++++++++++++++++++*......+....................+....+...........+...+.+........+......+........................+.+..+.......++++++ 2024-09-12T00:02:43.465 INFO:teuthology.orchestra.run.smithi033.stderr:----- 2024-09-12T00:02:43.465 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:02:43.465 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:02:43.534 DEBUG:teuthology.orchestra.run.smithi033:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:02:43.613 INFO:teuthology.orchestra.run.smithi033.stderr:Certificate request self-signature ok 2024-09-12T00:02:43.613 INFO:teuthology.orchestra.run.smithi033.stderr:subject=CN=smithi033.front.sepia.ceph.com 2024-09-12T00:02:43.623 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:02:43.694 DEBUG:teuthology.orchestra.run.smithi033:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:02:43.767 INFO:teuthology.orchestra.run.smithi033.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:02:43.767 DEBUG:teuthology.orchestra.run.smithi033:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:02:43.836 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:02:43.916 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T00:02:43.916 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:02:43.916 INFO:tasks.rgw:Creating data pools 2024-09-12T00:02:43.916 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:02:43.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T00:02:44.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:02:47.028 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:02:47.051 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:02:48.023 INFO:teuthology.orchestra.run.smithi033.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:02:48.066 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:02:49.055 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:02:49.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:02:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:02:50.088 DEBUG:tasks.rgw:Pools created 2024-09-12T00:02:50.089 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:02:50.089 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:02:50.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:02:50.090 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:02:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:52.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.099+0000 7f2c6aaa9640 0 -- 172.21.15.33:0/3461142568 >> [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] conn(0x7f2b40076380 msgr2=0x7f2b40078840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:02:52.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.103+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.105+0000 7f2c6b2aa640 0 -- 172.21.15.33:0/2246796333 >> [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] conn(0x7f2b30076470 msgr2=0x7f2b30078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:02:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.106+0000 7f2c6ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.106+0000 7f2c6ed1f800 20 realm 2024-09-12T00:02:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.106+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.106+0000 7f2c6ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.106+0000 7f2c6ed1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:02:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.106+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.106+0000 7f2c6ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.106+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.108+0000 7f2c6ed1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.108+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.109+0000 7f2c6ed1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:02:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.109+0000 7f2c6ed1f800 20 searching for the correct realm 2024-09-12T00:02:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:02:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:02:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:02:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:02:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:02:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:02:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.121+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.122+0000 7f2c6ed1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.122+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:02:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 20 zone default found 2024-09-12T00:02:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 4 Realm: () 2024-09-12T00:02:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:02:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:02:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:02:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 20 zonegroup default 2024-09-12T00:02:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:52.123+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:54.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:54.069+0000 7f2c6ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:54.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:54.069+0000 7f2c6ed1f800 20 rados->read ofs=0 len=0 2024-09-12T00:02:54.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:54.071+0000 7f2c6ed1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:54.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:54.071+0000 7f2c6ed1f800 20 started sync module instance, tier type = 2024-09-12T00:02:54.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:54.071+0000 7f2c6ed1f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:02:56.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.102+0000 7f2c6ed1f800 20 add_watcher() i=0 2024-09-12T00:02:56.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.102+0000 7f2c6ed1f800 20 add_watcher() i=1 2024-09-12T00:02:56.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.102+0000 7f2c6ed1f800 20 add_watcher() i=2 2024-09-12T00:02:56.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.102+0000 7f2c6ed1f800 20 add_watcher() i=3 2024-09-12T00:02:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.102+0000 7f2c6ed1f800 20 add_watcher() i=4 2024-09-12T00:02:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.102+0000 7f2c6ed1f800 20 add_watcher() i=5 2024-09-12T00:02:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.102+0000 7f2c6ed1f800 20 add_watcher() i=6 2024-09-12T00:02:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.103+0000 7f2c6ed1f800 20 add_watcher() i=7 2024-09-12T00:02:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.103+0000 7f2c6ed1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:02:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.104+0000 7f2c6ed1f800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:02:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.104+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:02:56.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.104+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.104+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:02:56.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.104+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:02:56.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.104+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:02:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:02:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:02:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:02:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:02:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:02:56.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:02:56.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:02:56.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.105+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.106+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:02:56.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:02:56.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:02:56.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:02:56.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:02:56.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:02:56.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:02:56.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.107+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.108+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:02:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:02:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:02:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:02:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.109+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:02:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:02:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:02:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:02:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:02:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:02:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:02:56.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:02:56.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.110+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:02:56.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.111+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:02:56.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.112+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:02:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:02:56.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:02:56.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:02:56.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.113+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:02:56.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.114+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.115+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.116+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:02:56.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.117+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.118+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.119+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.120+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.121+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.122+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.123+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.124+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:02:56.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:02:56.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:02:56.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:02:56.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:02:56.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:02:56.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.125+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:02:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.126+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:02:56.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.127+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.128+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.128+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.128+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.128+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.128+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.128+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:02:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.129+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:02:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.130+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.131+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:02:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.132+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:02:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.133+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.134+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:02:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.135+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:02:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.136+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:02:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.137+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:02:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.138+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:02:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.139+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.140+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:02:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.140+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:02:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.140+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.140+0000 7f2c6ed1f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:02:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.140+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:02:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.141+0000 7f2c6ed1f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:56.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.148+0000 7f2b1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:56.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.148+0000 7f2c6ed1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:56.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:56.148+0000 7f2c6ed1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:59.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.081+0000 7f2c6ed1f800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:02:59.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.081+0000 7f2c6ed1f800 5 note: GC not initialized 2024-09-12T00:02:59.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.082+0000 7f2c6ed1f800 20 init_complete bucket index max shards: 11 2024-09-12T00:02:59.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.082+0000 7f2c6ed1f800 20 Filter name: none 2024-09-12T00:02:59.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.082+0000 7f2a7dffb640 20 reqs_thread_entry: start 2024-09-12T00:02:59.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.082+0000 7f2a7ffff640 20 reqs_thread_entry: start 2024-09-12T00:02:59.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.114+0000 7f2b1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:59.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.117+0000 7f2c6ed1f800 20 remove_watcher() i=0 2024-09-12T00:02:59.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.117+0000 7f2c6ed1f800 2 removed watcher, disabling cache 2024-09-12T00:02:59.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.118+0000 7f2c6ed1f800 20 remove_watcher() i=1 2024-09-12T00:02:59.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.120+0000 7f2c6ed1f800 20 remove_watcher() i=2 2024-09-12T00:02:59.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.121+0000 7f2c6ed1f800 20 remove_watcher() i=3 2024-09-12T00:02:59.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.123+0000 7f2c6ed1f800 20 remove_watcher() i=4 2024-09-12T00:02:59.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.124+0000 7f2c6ed1f800 20 remove_watcher() i=5 2024-09-12T00:02:59.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.125+0000 7f2c6ed1f800 20 remove_watcher() i=6 2024-09-12T00:02:59.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.127+0000 7f2c6ed1f800 20 remove_watcher() i=7 2024-09-12T00:02:59.145 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T00:02:59.145 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:02:59.146 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:02:59.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:02:59.146 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:02:59.213 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:59.213 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:59.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.242+0000 7f7261614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:59.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.242+0000 7f7261614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:59.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.246+0000 7f711b7fe640 20 reqs_thread_entry: start 2024-09-12T00:02:59.263 INFO:teuthology.orchestra.run.smithi033.stdout:{"id":"46a733b9-e1d0-4fb4-b303-ac8b84c0769e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:02:59.263 DEBUG:tasks.util.rgw: json result: {'id': '46a733b9-e1d0-4fb4-b303-ac8b84c0769e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:02:59.263 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T00:02:59.264 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p /tmp/rgw_datacache 2024-09-12T00:02:59.294 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T00:02:59.374 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:02:59.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:02:59.374 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:02:59.472 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:59.472 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:59.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.710+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.712+0000 7f5216c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:59.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.712+0000 7f5216c20800 20 realm 2024-09-12T00:02:59.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.712+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.712+0000 7f5216c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:59.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.712+0000 7f5216c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:02:59.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.712+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.713+0000 7f5216c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:59.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.713+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.714+0000 7f5216c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:59.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.714+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.715+0000 7f5216c20800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:02:59.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.715+0000 7f5216c20800 20 searching for the correct realm 2024-09-12T00:02:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.717+0000 7f5213f10640 0 -- 172.21.15.33:0/1632450168 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f5204099040 msgr2=0x7f520408a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:02:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.722+0000 7f5214711640 0 -- 172.21.15.33:0/1632450168 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f520808cbd0 msgr2=0x7f52080525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:02:59.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.928+0000 7f5216c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:02:59.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.928+0000 7f5216c20800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:02:59.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.928+0000 7f5216c20800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:02:59.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.928+0000 7f5216c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:02:59.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.928+0000 7f5216c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:02:59.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.928+0000 7f5216c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:02:59.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.928+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:59.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:59.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 20 zone default found 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 4 Realm: () 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 20 zonegroup default 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.929+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.930+0000 7f5216c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.930+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.930+0000 7f5216c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.930+0000 7f5216c20800 20 rados->read ofs=0 len=0 2024-09-12T00:02:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.930+0000 7f5216c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:59.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.931+0000 7f5216c20800 20 started sync module instance, tier type = 2024-09-12T00:02:59.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.931+0000 7f5216c20800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:02:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.943+0000 7f5216c20800 20 add_watcher() i=0 2024-09-12T00:02:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.943+0000 7f5216c20800 20 add_watcher() i=1 2024-09-12T00:02:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.943+0000 7f5216c20800 20 add_watcher() i=2 2024-09-12T00:02:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.943+0000 7f5216c20800 20 add_watcher() i=3 2024-09-12T00:02:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.943+0000 7f5216c20800 20 add_watcher() i=4 2024-09-12T00:02:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.943+0000 7f5216c20800 20 add_watcher() i=5 2024-09-12T00:02:59.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.943+0000 7f5216c20800 20 add_watcher() i=6 2024-09-12T00:02:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.944+0000 7f5216c20800 20 add_watcher() i=7 2024-09-12T00:02:59.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.944+0000 7f5216c20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:02:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.946+0000 7f50cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.946+0000 7f5216c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.946+0000 7f5216c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:59.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.946+0000 7f5216c20800 5 note: GC not initialized 2024-09-12T00:02:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.946+0000 7f50c9fdb640 20 reqs_thread_entry: start 2024-09-12T00:02:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.946+0000 7f5216c20800 20 init_complete bucket index max shards: 11 2024-09-12T00:02:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.946+0000 7f5216c20800 20 Filter name: none 2024-09-12T00:02:59.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.947+0000 7f503b7fe640 20 reqs_thread_entry: start 2024-09-12T00:02:59.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.957+0000 7f50cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:59.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.960+0000 7f5216c20800 20 remove_watcher() i=0 2024-09-12T00:02:59.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.960+0000 7f5216c20800 2 removed watcher, disabling cache 2024-09-12T00:02:59.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.961+0000 7f5216c20800 20 remove_watcher() i=1 2024-09-12T00:02:59.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.962+0000 7f5216c20800 20 remove_watcher() i=2 2024-09-12T00:02:59.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.963+0000 7f5216c20800 20 remove_watcher() i=3 2024-09-12T00:02:59.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.964+0000 7f5216c20800 20 remove_watcher() i=4 2024-09-12T00:02:59.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.966+0000 7f5216c20800 20 remove_watcher() i=5 2024-09-12T00:02:59.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.967+0000 7f5216c20800 20 remove_watcher() i=6 2024-09-12T00:02:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:02:59.968+0000 7f5216c20800 20 remove_watcher() i=7 2024-09-12T00:02:59.978 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-09-12T00:02:59.979 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:02:59.979 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:02:59.979 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:02:59.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:02:59.979 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:03:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:00.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.073+0000 7f6039f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:00.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.073+0000 7f6039f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.077+0000 7f5e6bfff640 20 reqs_thread_entry: start 2024-09-12T00:03:00.096 INFO:teuthology.orchestra.run.smithi033.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:03:00.096 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:03:00.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:03:00.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:03:00.096 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:03:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:00.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.191+0000 7fd884a17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:00.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.191+0000 7fd884a17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:00.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.195+0000 7fd73e7fc640 20 reqs_thread_entry: start 2024-09-12T00:03:00.210 INFO:teuthology.orchestra.run.smithi033.stdout:{"id":"46a733b9-e1d0-4fb4-b303-ac8b84c0769e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:03:00.211 DEBUG:tasks.util.rgw: json result: {'id': '46a733b9-e1d0-4fb4-b303-ac8b84c0769e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:03:00.211 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:03:00.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:03:00.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:03:00.211 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:03:00.275 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:00.275 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:00.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.303+0000 7f69cc5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:00.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.303+0000 7f69cc5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.308+0000 7f688d7e2640 20 reqs_thread_entry: start 2024-09-12T00:03:00.321 INFO:teuthology.orchestra.run.smithi033.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:03:00.322 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:03:00.322 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:03:00.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:03:00.323 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:03:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.418+0000 7f4aaa575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:00.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.418+0000 7f4aaa575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:03:00.423+0000 7f49667fc640 20 reqs_thread_entry: start 2024-09-12T00:03:00.437 INFO:teuthology.orchestra.run.smithi033.stdout:{"id":"46a733b9-e1d0-4fb4-b303-ac8b84c0769e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:03:00.438 DEBUG:tasks.util.rgw: json result: {'id': '46a733b9-e1d0-4fb4-b303-ac8b84c0769e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:03:00.438 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:03:00.438 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T00:03:00.438 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:03:00.438 DEBUG:teuthology.orchestra.run.smithi033:> sudo echo -n https://smithi033.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:03:00.481 INFO:teuthology.orchestra.run.smithi033.stdout:https://smithi033.front.sepia.ceph.com:443 2024-09-12T00:03:00.481 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:03:00.561 DEBUG:teuthology.orchestra.run.smithi033:> sudo keytool -import -alias smithi033.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:03:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:03:00.931 INFO:teuthology.orchestra.run.smithi033.stderr:Certificate was added to keystore 2024-09-12T00:03:00.958 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T00:03:00.959 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:03:00.959 DEBUG:teuthology.orchestra.run.smithi033:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:03:00.961 INFO:tasks.rgw.client.0:Started 2024-09-12T00:03:00.961 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi033.front.sepia.ceph.com:443/ 2024-09-12T00:03:00.961 DEBUG:teuthology.orchestra.run.smithi033:> curl https://smithi033.front.sepia.ceph.com:443/ 2024-09-12T00:03:00.999 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:00.999 INFO:teuthology.orchestra.run.smithi033.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:01.000 INFO:teuthology.orchestra.run.smithi033.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:01.000 INFO:teuthology.orchestra.run.smithi033.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:01.000 INFO:teuthology.orchestra.run.smithi033.stderr:curl: (7) Failed to connect to smithi033.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:03:02.001 DEBUG:teuthology.orchestra.run.smithi033:> curl https://smithi033.front.sepia.ceph.com:443/ 2024-09-12T00:03:02.036 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:02.037 INFO:teuthology.orchestra.run.smithi033.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:02.037 INFO:teuthology.orchestra.run.smithi033.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:02.037 INFO:teuthology.orchestra.run.smithi033.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:02.037 INFO:teuthology.orchestra.run.smithi033.stderr:curl: (7) Failed to connect to smithi033.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:03:04.037 DEBUG:teuthology.orchestra.run.smithi033:> curl https://smithi033.front.sepia.ceph.com:443/ 2024-09-12T00:03:04.074 INFO:teuthology.orchestra.run.smithi033.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:04.074 INFO:teuthology.orchestra.run.smithi033.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:04.076 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:04.076 INFO:teuthology.orchestra.run.smithi033.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:04.076 INFO:teuthology.orchestra.run.smithi033.stderr:curl: (7) Failed to connect to smithi033.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:03:08.077 DEBUG:teuthology.orchestra.run.smithi033:> curl https://smithi033.front.sepia.ceph.com:443/ 2024-09-12T00:03:08.111 INFO:teuthology.orchestra.run.smithi033.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:08.112 INFO:teuthology.orchestra.run.smithi033.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:08.112 INFO:teuthology.orchestra.run.smithi033.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:08.113 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:08.114 INFO:teuthology.orchestra.run.smithi033.stderr:curl: (7) Failed to connect to smithi033.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:03:16.115 DEBUG:teuthology.orchestra.run.smithi033:> curl https://smithi033.front.sepia.ceph.com:443/ 2024-09-12T00:03:16.151 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:03:16.151 INFO:teuthology.orchestra.run.smithi033.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:16.151 INFO:teuthology.orchestra.run.smithi033.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:16.151 INFO:teuthology.orchestra.run.smithi033.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:03:16.152 INFO:teuthology.orchestra.run.smithi033.stderr:curl: (7) Failed to connect to smithi033.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:03:25.336 INFO:tasks.rgw.client.0.smithi033.stdout:2024-09-12T00:03:25.073+0000 a1be240 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:03:32.152 DEBUG:teuthology.orchestra.run.smithi033:> curl https://smithi033.front.sepia.ceph.com:443/ 2024-09-12T00:03:32.193 INFO:teuthology.orchestra.run.smithi033.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:03:32.193 INFO:teuthology.orchestra.run.smithi033.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:03:33.225 INFO:teuthology.orchestra.run.smithi033.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 181 0 --:--:-- 0:00:01 --:--:-- 181 2024-09-12T00:03:33.226 INFO:teuthology.orchestra.run.smithi033.stdout:anonymous 2024-09-12T00:03:33.226 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:03:33.240 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:03:33.240 DEBUG:teuthology.orchestra.run.smithi033:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:03:35.621 DEBUG:teuthology.orchestra.run.smithi033:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:03:36.165 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting tox==3.15.0 2024-09-12T00:03:36.229 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:03:36.348 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:03:36.363 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:03:36.452 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:03:36.466 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:03:36.569 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting toml>=0.9.4 2024-09-12T00:03:36.584 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:03:36.672 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:03:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:03:36.804 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:03:36.818 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:03:37.091 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:03:37.108 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:03:37.348 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting packaging>=14 2024-09-12T00:03:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:03:37.492 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:03:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:03:37.614 INFO:teuthology.orchestra.run.smithi033.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:03:37.628 INFO:teuthology.orchestra.run.smithi033.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:03:37.755 INFO:teuthology.orchestra.run.smithi033.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T00:03:38.616 INFO:teuthology.orchestra.run.smithi033.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:03:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T00:03:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T00:03:38.883 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:03:38.900 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:03:38.901 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:03:38.901 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:38.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:03:38.933 INFO:teuthology.orchestra.run.smithi033.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:03:38.933 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:39.004 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:39.004 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:03:39.073 INFO:tasks.workunit:timeout=3h 2024-09-12T00:03:39.073 INFO:tasks.workunit:cleanup=True 2024-09-12T00:03:39.074 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:03:39.144 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:04:25.357 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:04:25.358 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:04:25.358 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:04:25.358 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:04:25.358 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:04:25.358 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:04:25.358 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:04:25.359 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:04:25.359 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:04:25.359 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-09-12T00:04:25.359 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:04:25.359 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-09-12T00:04:25.359 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:04:25.359 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-09-12T00:04:25.360 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:04:25.360 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:04:25.360 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:04:25.360 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:04:25.362 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:04:25.442 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:04:25.444 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:04:25.444 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:04:25.997 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:04:26.070 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:04:26.112 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:04:26.112 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:04:26.112 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:04:26.152 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:04:26.156 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:04:26.156 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:04:26.225 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T00:04:26.227 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T00:04:26.227 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:04:26.300 INFO:tasks.workunit.client.0.smithi033.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:04:26.301 INFO:tasks.workunit.client.0.smithi033.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:04:26.301 INFO:tasks.workunit.client.0.smithi033.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:04:28.719 INFO:tasks.workunit.client.0.smithi033.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:04:28.719 INFO:tasks.workunit.client.0.smithi033.stderr:++ deactivate nondestructive 2024-09-12T00:04:28.719 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:04:28.719 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:04:28.719 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:04:28.719 INFO:tasks.workunit.client.0.smithi033.stderr:++ hash -r 2024-09-12T00:04:28.719 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:04:28.720 INFO:tasks.workunit.client.0.smithi033.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:04:28.720 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:04:28.720 INFO:tasks.workunit.client.0.smithi033.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:04:28.720 INFO:tasks.workunit.client.0.smithi033.stderr:++ export VIRTUAL_ENV 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ export PATH 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -z '' ']' 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ PS1='(rgw) ' 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ export PS1 2024-09-12T00:04:28.721 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:04:28.722 INFO:tasks.workunit.client.0.smithi033.stderr:++ hash -r 2024-09-12T00:04:28.722 INFO:tasks.workunit.client.0.smithi033.stderr:+ pip install pip --upgrade 2024-09-12T00:04:28.958 INFO:tasks.workunit.client.0.smithi033.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:04:29.144 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting pip 2024-09-12T00:04:29.198 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:04:29.357 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: pip 2024-09-12T00:04:29.357 INFO:tasks.workunit.client.0.smithi033.stdout: Attempting uninstall: pip 2024-09-12T00:04:29.357 INFO:tasks.workunit.client.0.smithi033.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:04:29.520 INFO:tasks.workunit.client.0.smithi033.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:04:29.525 INFO:tasks.workunit.client.0.smithi033.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:04:30.291 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed pip-24.2 2024-09-12T00:04:30.537 INFO:tasks.workunit.client.0.smithi033.stderr:+ pip install configobj 2024-09-12T00:04:30.930 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting configobj 2024-09-12T00:04:30.974 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T00:04:31.082 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting six (from configobj) 2024-09-12T00:04:31.096 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:04:31.160 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T00:04:31.240 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:04:31.304 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: six, configobj 2024-09-12T00:04:31.429 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T00:04:31.479 INFO:tasks.workunit.client.0.smithi033.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T00:04:31.512 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T00:04:31.512 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T00:04:31.513 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:31.514 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T00:04:31.514 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:04:31.514 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T00:04:31.584 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:31.585 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 44315/valgrind \ntcp6 0 0 :::443 :::* LISTEN 44315/valgrind \n' 2024-09-12T00:04:31.585 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:radosgw port: 443 2024-09-12T00:04:31.585 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T00:04:31.585 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T00:04:31.607 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:31.608 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b'' 2024-09-12T00:04:31.608 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T00:04:31.779 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:31.780 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T00:04:31.726521Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T00:04:31.726508Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T00:04:31.780 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:Creating s3cmd config... 2024-09-12T00:04:31.780 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:proto for s3cmd config is https 2024-09-12T00:04:31.780 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:s3cmd config written 2024-09-12T00:04:31.780 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T00:04:32.479 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:32.479 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T00:04:32.479 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T00:04:35.128 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:35.128 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 2.3 seconds, 2.99 MB/s) [1 of 1]\n" 2024-09-12T00:04:35.128 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T00:04:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 1.0 seconds, 6.91 MB/s)\n" 2024-09-12T00:04:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T00:04:36.821 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:36.821 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340228,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "zstd",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194414\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194414,\n "len": 3145814\n }\n ]\n },\n "etag": "c72e0bc14a08c138dea177efb4c44e30",\n "tag": "46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3042001645132514723",\n "manifest": {\n "objs": [],\n "obj_size": 7340228,\n "explicit_objs": false,\n "head_size": 4194304,\n "max_head_size": 4194304,\n "prefix": ".pwqRHuwP5lz1Zcky46pIzjmIpNELuiK_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4194304,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1",\n "bucket_id": "46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1",\n "bucket_id": "46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4194304,\n "stripe_ofs": 4194304,\n "ofs": 7340228,\n "stripe_size": 3145924,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1",\n "bucket_id": "46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".pwqRHuwP5lz1Zcky46pIzjmIpNELuiK_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T00:04:34.957735Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3042001645132514723",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726099471/ctime:1726099471/gid:1333/gname:ubuntu/md5:c72e0bc14a08c138dea177efb4c44e30/mode:33188/mtime:1726099471/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T00:04:36.821 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:Cached object name is: .pwqRHuwP5lz1Zcky46pIzjmIpNELuiK_ 2024-09-12T00:04:36.821 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T00:04:36.836 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:command succeeded 2024-09-12T00:04:36.837 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:b'0\n' 2024-09-12T00:04:36.837 INFO:tasks.workunit.client.0.smithi033.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T00:04:36.837 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T00:04:36.837 INFO:tasks.workunit.client.0.smithi033.stderr:INFO:root:Completed Datacache tests 2024-09-12T00:04:36.843 INFO:tasks.workunit.client.0.smithi033.stderr:+ deactivate 2024-09-12T00:04:36.843 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:04:36.843 INFO:tasks.workunit.client.0.smithi033.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:04:36.843 INFO:tasks.workunit.client.0.smithi033.stderr:+ export PATH 2024-09-12T00:04:36.843 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:04:36.843 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n '' ']' 2024-09-12T00:04:36.843 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:04:36.844 INFO:tasks.workunit.client.0.smithi033.stderr:+ hash -r 2024-09-12T00:04:36.844 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n '' ']' 2024-09-12T00:04:36.844 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:04:36.844 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:04:36.844 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset -f deactivate 2024-09-12T00:04:36.844 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo OK. 2024-09-12T00:04:36.845 INFO:tasks.workunit.client.0.smithi033.stdout:OK. 2024-09-12T00:04:36.845 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:04:36.845 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:04:36.929 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T00:04:36.929 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:04:37.277 DEBUG:teuthology.parallel:result is None 2024-09-12T00:04:37.277 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:04:37.318 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:04:37.318 DEBUG:teuthology.orchestra.run.smithi033:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:04:37.402 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:04:37.402 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:04:37.411 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:04:37.412 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:04:37.412 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:04:37.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:04:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:04:37.474 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:04:37.545 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:04:37.545 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:04:37.616 INFO:tasks.workunit:timeout=3h 2024-09-12T00:04:37.616 INFO:tasks.workunit:cleanup=True 2024-09-12T00:04:37.617 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:04:37.687 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:05:24.273 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:24.274 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-09-12T00:05:24.275 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:24.275 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:05:24.275 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:24.275 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:05:24.278 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:05:24.347 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:05:24.350 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:05:24.350 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:05:24.400 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:05:24.451 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:05:24.492 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:05:24.494 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:05:24.494 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:05:24.533 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:05:24.537 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:05:24.537 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:05:24.607 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:05:24.608 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:05:24.608 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:05:24.681 INFO:tasks.workunit.client.0.smithi033.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:05:24.682 INFO:tasks.workunit.client.0.smithi033.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:05:24.682 INFO:tasks.workunit.client.0.smithi033.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:05:26.960 INFO:tasks.workunit.client.0.smithi033.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:05:26.960 INFO:tasks.workunit.client.0.smithi033.stderr:++ deactivate nondestructive 2024-09-12T00:05:26.960 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:05:26.960 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:05:26.960 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:05:26.960 INFO:tasks.workunit.client.0.smithi033.stderr:++ hash -r 2024-09-12T00:05:26.960 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:05:26.960 INFO:tasks.workunit.client.0.smithi033.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:05:26.961 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:05:26.961 INFO:tasks.workunit.client.0.smithi033.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:05:26.961 INFO:tasks.workunit.client.0.smithi033.stderr:++ export VIRTUAL_ENV 2024-09-12T00:05:26.961 INFO:tasks.workunit.client.0.smithi033.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ export PATH 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -z '' ']' 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ PS1='(rgw) ' 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ export PS1 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:++ hash -r 2024-09-12T00:05:26.962 INFO:tasks.workunit.client.0.smithi033.stderr:+ pip install pip --upgrade 2024-09-12T00:05:27.213 INFO:tasks.workunit.client.0.smithi033.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:05:27.496 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting pip 2024-09-12T00:05:27.501 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:05:27.548 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: pip 2024-09-12T00:05:27.549 INFO:tasks.workunit.client.0.smithi033.stdout: Attempting uninstall: pip 2024-09-12T00:05:27.549 INFO:tasks.workunit.client.0.smithi033.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:05:27.712 INFO:tasks.workunit.client.0.smithi033.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:05:27.718 INFO:tasks.workunit.client.0.smithi033.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:05:28.493 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed pip-24.2 2024-09-12T00:05:28.545 INFO:tasks.workunit.client.0.smithi033.stderr:+ pip install boto3 2024-09-12T00:05:29.429 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting boto3 2024-09-12T00:05:29.473 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:05:30.102 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:05:30.118 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:05:30.220 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:05:30.235 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:05:30.361 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:05:30.388 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:05:30.529 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:05:30.543 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:05:30.700 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:05:30.720 INFO:tasks.workunit.client.0.smithi033.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:05:30.994 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:05:30.995 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:05:31.019 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:05:31.099 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:05:31.525 INFO:tasks.workunit.client.0.smithi033.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 29.9 MB/s eta 0:00:00 2024-09-12T00:05:31.539 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:05:31.603 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:05:31.670 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:05:31.738 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:05:31.783 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:05:31.865 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:05:32.935 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:05:33.054 INFO:tasks.workunit.client.0.smithi033.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:05:33.193 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:05:33.229 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:33.229 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:33.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.269+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.271+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.271+0000 7fe16a00e800 20 realm 2024-09-12T00:05:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.271+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.271+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.271+0000 7fe16a00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.271+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.271+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.271+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.272+0000 7fe16a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.272+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.273+0000 7fe16a00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:33.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.273+0000 7fe16a00e800 20 searching for the correct realm 2024-09-12T00:05:33.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.276+0000 7fe165e5a640 0 -- 172.21.15.33:0/3728639760 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5612f5e6fad0 msgr2=0x5612f5e71f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:33.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.279+0000 7fe165659640 0 -- 172.21.15.33:0/3728639760 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fe15c04dc70 msgr2=0x7fe15c061600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.285+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 zone default found 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 4 Realm: () 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 zonegroup default 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 started sync module instance, tier type = 2024-09-12T00:05:33.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.286+0000 7fe16a00e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:33.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.304+0000 7fe16a00e800 20 add_watcher() i=0 2024-09-12T00:05:33.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.304+0000 7fe16a00e800 20 add_watcher() i=1 2024-09-12T00:05:33.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.304+0000 7fe16a00e800 20 add_watcher() i=2 2024-09-12T00:05:33.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.304+0000 7fe16a00e800 20 add_watcher() i=3 2024-09-12T00:05:33.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.304+0000 7fe16a00e800 20 add_watcher() i=4 2024-09-12T00:05:33.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.304+0000 7fe16a00e800 20 add_watcher() i=5 2024-09-12T00:05:33.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.304+0000 7fe16a00e800 20 add_watcher() i=6 2024-09-12T00:05:33.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.305+0000 7fe16a00e800 20 add_watcher() i=7 2024-09-12T00:05:33.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.305+0000 7fe16a00e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:33.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.308+0000 7fe01b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.308+0000 7fe16a00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.308+0000 7fe16a00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe16a00e800 5 note: GC not initialized 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe01a7e4640 20 reqs_thread_entry: start 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe16a00e800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe16a00e800 20 Filter name: none 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fdf8bfff640 20 reqs_thread_entry: start 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe16a00e800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:05:33.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe16a00e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:05:33.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.309+0000 7fe16a00e800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:05:33.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.310+0000 7fe16a00e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:05:33.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.310+0000 7fe16a00e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:33.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.310+0000 7fe16a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:33.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.310+0000 7fe16a00e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:05:33.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.310+0000 7fe16a00e800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:05:33.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.310+0000 7fe16a00e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:05:33.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.310+0000 7fe16a00e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:05:33.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.311+0000 7fe16a00e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:05:33.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.311+0000 7fe16a00e800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:05:33.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.311+0000 7fe16a00e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:05:33.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.312+0000 7fe048ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 180388626433 cookie 94639434972208 notifier 4644 bl.length()=593 2024-09-12T00:05:33.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.312+0000 7fe048ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:05:33.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.312+0000 7fe048ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:05:33.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.315+0000 7fe16a00e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:05:33.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.315+0000 7fe16a00e800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:05:33.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.315+0000 7fe16a00e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:05:33.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.315+0000 7fe048ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 180388626432 cookie 94639434960240 notifier 4644 bl.length()=186 2024-09-12T00:05:33.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.315+0000 7fe048ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:05:33.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.315+0000 7fe048ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:05:33.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.318+0000 7fe01b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:33.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.323+0000 7fe16a00e800 20 remove_watcher() i=0 2024-09-12T00:05:33.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.323+0000 7fe16a00e800 2 removed watcher, disabling cache 2024-09-12T00:05:33.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.324+0000 7fe16a00e800 20 remove_watcher() i=1 2024-09-12T00:05:33.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.327+0000 7fe16a00e800 20 remove_watcher() i=2 2024-09-12T00:05:33.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.328+0000 7fe16a00e800 20 remove_watcher() i=3 2024-09-12T00:05:33.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.332+0000 7fe16a00e800 20 remove_watcher() i=4 2024-09-12T00:05:33.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.333+0000 7fe16a00e800 20 remove_watcher() i=5 2024-09-12T00:05:33.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.334+0000 7fe16a00e800 20 remove_watcher() i=6 2024-09-12T00:05:33.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:33.338+0000 7fe16a00e800 20 remove_watcher() i=7 2024-09-12T00:05:33.538 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.538 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:33.588 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.588 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:33.660 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.660 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:33.715 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.715 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:33.769 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.769 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:33.793 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.793 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:33.839 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.839 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:33.865 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.865 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:33.956 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:33.956 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:34.065 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:34.065 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:34.102 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:34.102 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:34.153 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:34.153 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:34.179 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:34.179 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:34.234 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:34.234 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:34.262 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:34.262 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:34.351 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:34.351 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:34.375 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:05:34.375 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:34.376 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:05:34.407 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:34.407 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:34.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.447+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.449+0000 7fdc87326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.449+0000 7fdc87326800 20 realm 2024-09-12T00:05:34.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.449+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.449+0000 7fdc87326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.449+0000 7fdc87326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:34.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.449+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.449+0000 7fdc87326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.449+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.450+0000 7fdc87326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:34.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.450+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.451+0000 7fdc87326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:34.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.451+0000 7fdc87326800 20 searching for the correct realm 2024-09-12T00:05:34.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.454+0000 7fdc82fd9640 0 -- 172.21.15.33:0/916595940 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fdc7c07e070 msgr2=0x7fdc7c0c3970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:34.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.457+0000 7fdc82fd9640 0 -- 172.21.15.33:0/916595940 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fdc780745f0 msgr2=0x7fdc7805f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:34.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:34.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.664+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:34.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:34.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 20 zone default found 2024-09-12T00:05:34.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 4 Realm: () 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 20 zonegroup default 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.665+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.666+0000 7fdc87326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.666+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.666+0000 7fdc87326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.666+0000 7fdc87326800 20 started sync module instance, tier type = 2024-09-12T00:05:34.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.666+0000 7fdc87326800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:34.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.679+0000 7fdc87326800 20 add_watcher() i=0 2024-09-12T00:05:34.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.679+0000 7fdc87326800 20 add_watcher() i=1 2024-09-12T00:05:34.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.679+0000 7fdc87326800 20 add_watcher() i=2 2024-09-12T00:05:34.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.679+0000 7fdc87326800 20 add_watcher() i=3 2024-09-12T00:05:34.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.679+0000 7fdc87326800 20 add_watcher() i=4 2024-09-12T00:05:34.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.679+0000 7fdc87326800 20 add_watcher() i=5 2024-09-12T00:05:34.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.679+0000 7fdc87326800 20 add_watcher() i=6 2024-09-12T00:05:34.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.680+0000 7fdc87326800 20 add_watcher() i=7 2024-09-12T00:05:34.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.680+0000 7fdc87326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:34.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.682+0000 7fdb397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.682+0000 7fdc87326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.682+0000 7fdc87326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.682+0000 7fdc87326800 5 note: GC not initialized 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.683+0000 7fdab3fff640 20 reqs_thread_entry: start 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.683+0000 7fdc87326800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.683+0000 7fdc87326800 20 Filter name: none 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.683+0000 7fdab1ffb640 20 reqs_thread_entry: start 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.683+0000 7fdc87326800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:34.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.683+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:34.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:34.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:34.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:34.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:34.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:34.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:34.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:34.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:34.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:34.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.684+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:34.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.685+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:34.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.686+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:34.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.686+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:34.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.687+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:34.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.687+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:34.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.687+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:34.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.688+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:34.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.689+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:34.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.689+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:34.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.690+0000 7fdc87326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:34.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.699+0000 7fdb397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:34.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.703+0000 7fdc87326800 20 remove_watcher() i=0 2024-09-12T00:05:34.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.703+0000 7fdc87326800 2 removed watcher, disabling cache 2024-09-12T00:05:34.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.704+0000 7fdc87326800 20 remove_watcher() i=1 2024-09-12T00:05:34.704 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.704+0000 7fdc87326800 20 remove_watcher() i=2 2024-09-12T00:05:34.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.705+0000 7fdc87326800 20 remove_watcher() i=3 2024-09-12T00:05:34.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.707+0000 7fdc87326800 20 remove_watcher() i=4 2024-09-12T00:05:34.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.708+0000 7fdc87326800 20 remove_watcher() i=5 2024-09-12T00:05:34.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.709+0000 7fdc87326800 20 remove_watcher() i=6 2024-09-12T00:05:34.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.710+0000 7fdc87326800 20 remove_watcher() i=7 2024-09-12T00:05:34.723 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:05:34.752 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:34.752 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:34.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.793+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.795+0000 7f2589daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.795+0000 7f2589daf800 20 realm 2024-09-12T00:05:34.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.795+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.795+0000 7f2589daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.795+0000 7f2589daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:34.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.795+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.795+0000 7f2589daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.795+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.796+0000 7f2589daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:34.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.796+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.797+0000 7f2589daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:34.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.797+0000 7f2589daf800 20 searching for the correct realm 2024-09-12T00:05:34.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.798+0000 7f2587899640 0 -- 172.21.15.33:0/1791268071 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x555e5123ff00 msgr2=0x7f258002f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:34.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.802+0000 7f2587098640 0 -- 172.21.15.33:0/1791268071 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f257807f060 msgr2=0x7f257804f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:34.810 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.808+0000 7f2589daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:34.810 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.808+0000 7f2589daf800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:34.810 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.808+0000 7f2589daf800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:34.810 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.808+0000 7f2589daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:34.810 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.808+0000 7f2589daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:34.810 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.808+0000 7f2589daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.808+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 20 zone default found 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 4 Realm: () 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:34.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 20 zonegroup default 2024-09-12T00:05:34.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.809+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.810+0000 7f2589daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.810+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.810+0000 7f2589daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.810+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.810+0000 7f2589daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.810+0000 7f2589daf800 20 started sync module instance, tier type = 2024-09-12T00:05:34.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.810+0000 7f2589daf800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:34.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.824+0000 7f2589daf800 20 add_watcher() i=0 2024-09-12T00:05:34.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.824+0000 7f2589daf800 20 add_watcher() i=1 2024-09-12T00:05:34.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.824+0000 7f2589daf800 20 add_watcher() i=2 2024-09-12T00:05:34.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.824+0000 7f2589daf800 20 add_watcher() i=3 2024-09-12T00:05:34.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.824+0000 7f2589daf800 20 add_watcher() i=4 2024-09-12T00:05:34.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.824+0000 7f2589daf800 20 add_watcher() i=5 2024-09-12T00:05:34.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.826+0000 7f2589daf800 20 add_watcher() i=6 2024-09-12T00:05:34.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.826+0000 7f2589daf800 20 add_watcher() i=7 2024-09-12T00:05:34.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.826+0000 7f2589daf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:34.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.828+0000 7f243dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.828+0000 7f2589daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.828+0000 7f2589daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.828+0000 7f2589daf800 5 note: GC not initialized 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.828+0000 7f243cfe1640 20 reqs_thread_entry: start 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.828+0000 7f2589daf800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.829+0000 7f2589daf800 20 Filter name: none 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.829+0000 7f23b67fc640 20 reqs_thread_entry: start 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.829+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.829+0000 7f2589daf800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.829+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.829+0000 7f2589daf800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:34.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.829+0000 7f2589daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:34.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.829+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.830+0000 7f2589daf800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:34.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.830+0000 7f2589daf800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.830+0000 7f2589daf800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:34.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.830+0000 7f2589daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:34.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.832+0000 7f243dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:34.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.834+0000 7f2589daf800 20 remove_watcher() i=0 2024-09-12T00:05:34.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.834+0000 7f2589daf800 2 removed watcher, disabling cache 2024-09-12T00:05:34.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.835+0000 7f2589daf800 20 remove_watcher() i=1 2024-09-12T00:05:34.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.836+0000 7f2589daf800 20 remove_watcher() i=2 2024-09-12T00:05:34.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.837+0000 7f2589daf800 20 remove_watcher() i=3 2024-09-12T00:05:34.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.839+0000 7f2589daf800 20 remove_watcher() i=4 2024-09-12T00:05:34.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.840+0000 7f2589daf800 20 remove_watcher() i=5 2024-09-12T00:05:34.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.843+0000 7f2589daf800 20 remove_watcher() i=6 2024-09-12T00:05:34.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.844+0000 7f2589daf800 20 remove_watcher() i=7 2024-09-12T00:05:34.855 INFO:tasks.workunit.client.0.smithi033.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 61, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:05:34.855 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:05:34.855 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:34.857 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:05:34.890 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:34.891 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:34.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.931+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.932+0000 7f6dd1dad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.932+0000 7f6dd1dad800 20 realm 2024-09-12T00:05:34.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.932+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.932+0000 7f6dd1dad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.932+0000 7f6dd1dad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:34.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.932+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.933+0000 7f6dd1dad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.933+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.933+0000 7f6dd1dad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:34.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.933+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.934+0000 7f6dd1dad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:34.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.934+0000 7f6dd1dad800 20 searching for the correct realm 2024-09-12T00:05:34.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.937+0000 7f6dd0098640 0 -- 172.21.15.33:0/3158852953 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x55ac8bf5b6e0 msgr2=0x55ac8bf5db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:34.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.941+0000 7f6dc7096640 0 -- 172.21.15.33:0/3158852953 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55ac8bf63200 msgr2=0x55ac8bf655f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:34.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:34.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.945+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:34.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 20 zone default found 2024-09-12T00:05:34.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 4 Realm: () 2024-09-12T00:05:34.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:34.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:34.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 20 zonegroup default 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.946+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.947+0000 7f6dd1dad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.947+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.947+0000 7f6dd1dad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.947+0000 7f6dd1dad800 20 started sync module instance, tier type = 2024-09-12T00:05:34.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.947+0000 7f6dd1dad800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:34.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.960+0000 7f6dd1dad800 20 add_watcher() i=0 2024-09-12T00:05:34.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.960+0000 7f6dd1dad800 20 add_watcher() i=1 2024-09-12T00:05:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.960+0000 7f6dd1dad800 20 add_watcher() i=2 2024-09-12T00:05:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.960+0000 7f6dd1dad800 20 add_watcher() i=3 2024-09-12T00:05:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.960+0000 7f6dd1dad800 20 add_watcher() i=4 2024-09-12T00:05:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.960+0000 7f6dd1dad800 20 add_watcher() i=5 2024-09-12T00:05:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.960+0000 7f6dd1dad800 20 add_watcher() i=6 2024-09-12T00:05:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.961+0000 7f6dd1dad800 20 add_watcher() i=7 2024-09-12T00:05:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.961+0000 7f6dd1dad800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:34.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.962+0000 7f6c85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.962+0000 7f6dd1dad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.962+0000 7f6dd1dad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.962+0000 7f6dd1dad800 5 note: GC not initialized 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6c84fe1640 20 reqs_thread_entry: start 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 20 Filter name: none 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6bfe7fc640 20 reqs_thread_entry: start 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:34.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:34.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:34.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:34.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:34.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.963+0000 7f6dd1dad800 20 rados->read ofs=0 len=0 2024-09-12T00:05:34.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.964+0000 7f6dd1dad800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:34.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.964+0000 7f6dd1dad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:34.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.964+0000 7f6dd1dad800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:34.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.964+0000 7f6dd1dad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:34.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.964+0000 7f6dd1dad800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:34.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.964+0000 7f6dd1dad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:34.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.964+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.965+0000 7f6dd1dad800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:05:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.965+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.965+0000 7f6dd1dad800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:05:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.965+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.966+0000 7f6dd1dad800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:05:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.966+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.966+0000 7f6dd1dad800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:05:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.966+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:34.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.966+0000 7f6dd1dad800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:05:34.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.966+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:34.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.967+0000 7f6dd1dad800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:05:34.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.967+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:34.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.968+0000 7f6dd1dad800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:05:34.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.968+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:34.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.968+0000 7f6dd1dad800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:05:34.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.968+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:34.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.969+0000 7f6dd1dad800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:05:34.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.969+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:34.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.971+0000 7f6dd1dad800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:05:34.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.971+0000 7f6dd1dad800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:34.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.971+0000 7f6dd1dad800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:05:34.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.971+0000 7f6dd1dad800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:05:34.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.971+0000 7f6c85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:34.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.973+0000 7f6dd1dad800 20 remove_watcher() i=0 2024-09-12T00:05:34.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.973+0000 7f6dd1dad800 2 removed watcher, disabling cache 2024-09-12T00:05:34.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.974+0000 7f6dd1dad800 20 remove_watcher() i=1 2024-09-12T00:05:34.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.975+0000 7f6dd1dad800 20 remove_watcher() i=2 2024-09-12T00:05:34.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.976+0000 7f6dd1dad800 20 remove_watcher() i=3 2024-09-12T00:05:34.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.977+0000 7f6dd1dad800 20 remove_watcher() i=4 2024-09-12T00:05:34.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.979+0000 7f6dd1dad800 20 remove_watcher() i=5 2024-09-12T00:05:34.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.980+0000 7f6dd1dad800 20 remove_watcher() i=6 2024-09-12T00:05:34.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:34.981+0000 7f6dd1dad800 20 remove_watcher() i=7 2024-09-12T00:05:34.993 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:05:35.406 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:05:36.820 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:36.820 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:36.922 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:05:36.924 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:05:36.958 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:36.958 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:37.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.002+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.004+0000 7f8de6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.004+0000 7f8de6521800 20 realm 2024-09-12T00:05:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.004+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.004+0000 7f8de6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.004+0000 7f8de6521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.004+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.005+0000 7f8de6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.005+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.006+0000 7f8de6521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:37.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.006+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.007+0000 7f8de6521800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:37.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.007+0000 7f8de6521800 20 searching for the correct realm 2024-09-12T00:05:37.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.010+0000 7f8de2957640 0 -- 172.21.15.33:0/2421787342 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x55c0197a56b0 msgr2=0x55c0197a7ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:37.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.014+0000 7f8de1955640 0 -- 172.21.15.33:0/2421787342 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55c0197ad160 msgr2=0x55c0197af550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:37.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:37.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:37.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:37.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:37.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:37.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:37.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:37.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.018+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:37.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 20 zone default found 2024-09-12T00:05:37.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 4 Realm: () 2024-09-12T00:05:37.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:37.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:37.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:37.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 20 zonegroup default 2024-09-12T00:05:37.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.019+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.020+0000 7f8de6521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.020+0000 7f8de6521800 20 started sync module instance, tier type = 2024-09-12T00:05:37.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.020+0000 7f8de6521800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:37.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.035+0000 7f8de6521800 20 add_watcher() i=0 2024-09-12T00:05:37.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.035+0000 7f8de6521800 20 add_watcher() i=1 2024-09-12T00:05:37.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.035+0000 7f8de6521800 20 add_watcher() i=2 2024-09-12T00:05:37.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.035+0000 7f8de6521800 20 add_watcher() i=3 2024-09-12T00:05:37.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.035+0000 7f8de6521800 20 add_watcher() i=4 2024-09-12T00:05:37.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.035+0000 7f8de6521800 20 add_watcher() i=5 2024-09-12T00:05:37.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.035+0000 7f8de6521800 20 add_watcher() i=6 2024-09-12T00:05:37.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.038+0000 7f8de6521800 20 add_watcher() i=7 2024-09-12T00:05:37.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.038+0000 7f8de6521800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:37.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.040+0000 7f8c98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:37.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8de6521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:37.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8de6521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:37.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8de6521800 5 note: GC not initialized 2024-09-12T00:05:37.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8c137fe640 20 reqs_thread_entry: start 2024-09-12T00:05:37.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8de6521800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:37.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8de6521800 20 Filter name: none 2024-09-12T00:05:37.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8c117fa640 20 reqs_thread_entry: start 2024-09-12T00:05:37.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8de6521800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.041+0000 7f8de6521800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.042+0000 7f8de6521800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.042+0000 7f8de6521800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.042+0000 7f8de6521800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.042+0000 7f8de6521800 20 INFO: main: starting shard=0 2024-09-12T00:05:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.042+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 INFO: main: starting shard=1 2024-09-12T00:05:37.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:37.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 INFO: main: starting shard=2 2024-09-12T00:05:37.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:37.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 INFO: main: starting shard=3 2024-09-12T00:05:37.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.043+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:37.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.044+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.044+0000 7f8de6521800 20 INFO: main: starting shard=4 2024-09-12T00:05:37.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.044+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:37.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.044+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.044+0000 7f8de6521800 20 INFO: main: starting shard=5 2024-09-12T00:05:37.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.044+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:37.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.045+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.045+0000 7f8de6521800 20 INFO: main: starting shard=6 2024-09-12T00:05:37.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.045+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:37.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.045+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.045+0000 7f8de6521800 20 INFO: main: starting shard=7 2024-09-12T00:05:37.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.045+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:37.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.046+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.046+0000 7f8de6521800 20 INFO: main: starting shard=8 2024-09-12T00:05:37.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.046+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.046+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.047+0000 7f8de6521800 20 INFO: main: starting shard=9 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.047+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.047+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.047+0000 7f8de6521800 20 INFO: main: starting shard=10 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.047+0000 7f8de6521800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.048+0000 7f8de6521800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.048+0000 7f8de6521800 20 INFO: main: done 2024-09-12T00:05:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.048+0000 7f8c98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:37.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.051+0000 7f8de6521800 20 remove_watcher() i=0 2024-09-12T00:05:37.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.051+0000 7f8de6521800 2 removed watcher, disabling cache 2024-09-12T00:05:37.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.052+0000 7f8de6521800 20 remove_watcher() i=1 2024-09-12T00:05:37.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.053+0000 7f8de6521800 20 remove_watcher() i=2 2024-09-12T00:05:37.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.054+0000 7f8de6521800 20 remove_watcher() i=3 2024-09-12T00:05:37.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.055+0000 7f8de6521800 20 remove_watcher() i=4 2024-09-12T00:05:37.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.056+0000 7f8de6521800 20 remove_watcher() i=5 2024-09-12T00:05:37.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.058+0000 7f8de6521800 20 remove_watcher() i=6 2024-09-12T00:05:37.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.059+0000 7f8de6521800 20 remove_watcher() i=7 2024-09-12T00:05:37.071 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:37.071 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:37.097 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:37.097 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:37.180 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:05:37.181 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:05:37.213 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:37.213 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:37.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.254+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.255+0000 7fa592d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.255+0000 7fa592d2a800 20 realm 2024-09-12T00:05:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.255+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.256+0000 7fa592d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.256+0000 7fa592d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.256+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.256+0000 7fa592d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.256+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.257+0000 7fa592d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:37.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.257+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.258+0000 7fa592d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:37.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.258+0000 7fa592d2a800 20 searching for the correct realm 2024-09-12T00:05:37.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.261+0000 7fa58f250640 0 -- 172.21.15.33:0/248294173 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x555583221d00 msgr2=0x5555832241a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:05:37.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.265+0000 7fa58ea4f640 0 -- 172.21.15.33:0/248294173 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa584040410 msgr2=0x7fa584040890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:37.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.471+0000 7fa592d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:37.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.471+0000 7fa592d2a800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:37.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.471+0000 7fa592d2a800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:37.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.471+0000 7fa592d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:37.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.471+0000 7fa592d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:37.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.471+0000 7fa592d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:37.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.471+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:37.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:37.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 20 zone default found 2024-09-12T00:05:37.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 4 Realm: () 2024-09-12T00:05:37.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:37.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:37.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 20 zonegroup default 2024-09-12T00:05:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.472+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.473+0000 7fa592d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.473+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.473+0000 7fa592d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.473+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.473+0000 7fa592d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.473+0000 7fa592d2a800 20 started sync module instance, tier type = 2024-09-12T00:05:37.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.473+0000 7fa592d2a800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:37.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.489+0000 7fa592d2a800 20 add_watcher() i=0 2024-09-12T00:05:37.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.489+0000 7fa592d2a800 20 add_watcher() i=1 2024-09-12T00:05:37.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.489+0000 7fa592d2a800 20 add_watcher() i=2 2024-09-12T00:05:37.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.489+0000 7fa592d2a800 20 add_watcher() i=3 2024-09-12T00:05:37.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.489+0000 7fa592d2a800 20 add_watcher() i=4 2024-09-12T00:05:37.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.489+0000 7fa592d2a800 20 add_watcher() i=5 2024-09-12T00:05:37.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.489+0000 7fa592d2a800 20 add_watcher() i=6 2024-09-12T00:05:37.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.490+0000 7fa592d2a800 20 add_watcher() i=7 2024-09-12T00:05:37.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.490+0000 7fa592d2a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:37.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.492+0000 7fa4457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:37.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.492+0000 7fa592d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:37.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.492+0000 7fa592d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:37.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.492+0000 7fa592d2a800 5 note: GC not initialized 2024-09-12T00:05:37.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.492+0000 7fa3bffff640 20 reqs_thread_entry: start 2024-09-12T00:05:37.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.492+0000 7fa592d2a800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:37.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.492+0000 7fa592d2a800 20 Filter name: none 2024-09-12T00:05:37.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.492+0000 7fa3bdffb640 20 reqs_thread_entry: start 2024-09-12T00:05:37.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.493+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.493+0000 7fa592d2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.493+0000 7fa592d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.493+0000 7fa592d2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.493+0000 7fa592d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.493+0000 7fa592d2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.493+0000 7fa592d2a800 20 INFO: main: starting shard=0 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.493+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.494+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.494+0000 7fa592d2a800 20 INFO: main: starting shard=1 2024-09-12T00:05:37.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.494+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:37.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.495+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.495+0000 7fa592d2a800 20 INFO: main: starting shard=2 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.495+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.495+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.495+0000 7fa592d2a800 20 INFO: main: starting shard=3 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.495+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 INFO: main: starting shard=4 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 INFO: main: starting shard=5 2024-09-12T00:05:37.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:37.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:05:37.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 INFO: main: starting shard=6 2024-09-12T00:05:37.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.496+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:37.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.497+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.497+0000 7fa592d2a800 20 INFO: main: starting shard=7 2024-09-12T00:05:37.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.497+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:37.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.498+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.498+0000 7fa592d2a800 20 INFO: main: starting shard=8 2024-09-12T00:05:37.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.498+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:37.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.498+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.498+0000 7fa592d2a800 20 INFO: main: starting shard=9 2024-09-12T00:05:37.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.498+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:37.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.499+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.499+0000 7fa592d2a800 20 INFO: main: starting shard=10 2024-09-12T00:05:37.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.499+0000 7fa592d2a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:37.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.499+0000 7fa592d2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.499+0000 7fa592d2a800 20 INFO: main: done 2024-09-12T00:05:37.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.500+0000 7fa4457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:37.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.502+0000 7fa592d2a800 20 remove_watcher() i=0 2024-09-12T00:05:37.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.502+0000 7fa592d2a800 2 removed watcher, disabling cache 2024-09-12T00:05:37.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.504+0000 7fa592d2a800 20 remove_watcher() i=1 2024-09-12T00:05:37.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.505+0000 7fa592d2a800 20 remove_watcher() i=2 2024-09-12T00:05:37.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.506+0000 7fa592d2a800 20 remove_watcher() i=3 2024-09-12T00:05:37.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.508+0000 7fa592d2a800 20 remove_watcher() i=4 2024-09-12T00:05:37.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.509+0000 7fa592d2a800 20 remove_watcher() i=5 2024-09-12T00:05:37.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.510+0000 7fa592d2a800 20 remove_watcher() i=6 2024-09-12T00:05:37.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.511+0000 7fa592d2a800 20 remove_watcher() i=7 2024-09-12T00:05:37.523 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:37.523 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:37.547 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:37.547 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:37.571 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:37.571 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:37.653 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:05:37.654 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:05:37.688 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:37.688 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:37.727 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.728+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.730+0000 7ffae4d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.730+0000 7ffae4d25800 20 realm 2024-09-12T00:05:37.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.730+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.730+0000 7ffae4d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.730+0000 7ffae4d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:37.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.730+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.731+0000 7ffae4d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.731+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.732+0000 7ffae4d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:37.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.732+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.732+0000 7ffae4d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:37.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.732+0000 7ffae4d25800 20 searching for the correct realm 2024-09-12T00:05:37.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.736+0000 7ffae01ad640 0 -- 172.21.15.33:0/242540595 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x562674e5ec40 msgr2=0x562674e61030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:05:37.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.740+0000 7ffae01ad640 0 -- 172.21.15.33:0/242540595 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x7ff9ac0841c0 msgr2=0x7ff9ac0865f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.745+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 20 zone default found 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 4 Realm: () 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:37.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 20 zonegroup default 2024-09-12T00:05:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.746+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.747+0000 7ffae4d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.747+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.747+0000 7ffae4d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.747+0000 7ffae4d25800 20 started sync module instance, tier type = 2024-09-12T00:05:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.747+0000 7ffae4d25800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:37.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.763+0000 7ffae4d25800 20 add_watcher() i=0 2024-09-12T00:05:37.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.763+0000 7ffae4d25800 20 add_watcher() i=1 2024-09-12T00:05:37.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.763+0000 7ffae4d25800 20 add_watcher() i=2 2024-09-12T00:05:37.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.763+0000 7ffae4d25800 20 add_watcher() i=3 2024-09-12T00:05:37.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.763+0000 7ffae4d25800 20 add_watcher() i=4 2024-09-12T00:05:37.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.763+0000 7ffae4d25800 20 add_watcher() i=5 2024-09-12T00:05:37.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.763+0000 7ffae4d25800 20 add_watcher() i=6 2024-09-12T00:05:37.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.764+0000 7ffae4d25800 20 add_watcher() i=7 2024-09-12T00:05:37.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.764+0000 7ffae4d25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:37.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.766+0000 7ff996fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:37.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.766+0000 7ffae4d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:37.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.766+0000 7ffae4d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:37.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.766+0000 7ffae4d25800 5 note: GC not initialized 2024-09-12T00:05:37.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.767+0000 7ff995fe3640 20 reqs_thread_entry: start 2024-09-12T00:05:37.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.767+0000 7ffae4d25800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:37.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.767+0000 7ffae4d25800 20 Filter name: none 2024-09-12T00:05:37.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.767+0000 7ff9077fe640 20 reqs_thread_entry: start 2024-09-12T00:05:37.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.767+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.767+0000 7ffae4d25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:37.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.767+0000 7ffae4d25800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.768+0000 7ffae4d25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:37.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.768+0000 7ffae4d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:37.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.768+0000 7ffae4d25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:37.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.768+0000 7ffae4d25800 20 INFO: main: starting shard=0 2024-09-12T00:05:37.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.768+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:37.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.768+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.768+0000 7ffae4d25800 20 INFO: main: starting shard=1 2024-09-12T00:05:37.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.768+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:37.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.769+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:05:37.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.769+0000 7ffae4d25800 20 INFO: main: starting shard=2 2024-09-12T00:05:37.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.769+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:37.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.769+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.769+0000 7ffae4d25800 20 INFO: main: starting shard=3 2024-09-12T00:05:37.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.769+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 INFO: main: starting shard=4 2024-09-12T00:05:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 INFO: main: starting shard=5 2024-09-12T00:05:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 INFO: main: starting shard=6 2024-09-12T00:05:37.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.770+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:37.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.771+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.771+0000 7ffae4d25800 20 INFO: main: starting shard=7 2024-09-12T00:05:37.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.771+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.772+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.772+0000 7ffae4d25800 20 INFO: main: starting shard=8 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.772+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.772+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.772+0000 7ffae4d25800 20 INFO: main: starting shard=9 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.772+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.773+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.773+0000 7ffae4d25800 20 INFO: main: starting shard=10 2024-09-12T00:05:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.773+0000 7ffae4d25800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:37.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.773+0000 7ffae4d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:37.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.773+0000 7ffae4d25800 20 INFO: main: done 2024-09-12T00:05:37.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.774+0000 7ff996fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:37.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.777+0000 7ffae4d25800 20 remove_watcher() i=0 2024-09-12T00:05:37.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.777+0000 7ffae4d25800 2 removed watcher, disabling cache 2024-09-12T00:05:37.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.778+0000 7ffae4d25800 20 remove_watcher() i=1 2024-09-12T00:05:37.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.779+0000 7ffae4d25800 20 remove_watcher() i=2 2024-09-12T00:05:37.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.780+0000 7ffae4d25800 20 remove_watcher() i=3 2024-09-12T00:05:37.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.781+0000 7ffae4d25800 20 remove_watcher() i=4 2024-09-12T00:05:37.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.782+0000 7ffae4d25800 20 remove_watcher() i=5 2024-09-12T00:05:37.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.783+0000 7ffae4d25800 20 remove_watcher() i=6 2024-09-12T00:05:37.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.784+0000 7ffae4d25800 20 remove_watcher() i=7 2024-09-12T00:05:37.797 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:37.797 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:37.821 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:37.821 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:37.905 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:05:37.906 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:05:37.940 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:37.940 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:37.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.983+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.985+0000 7f9864744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.985+0000 7f9864744800 20 realm 2024-09-12T00:05:37.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.985+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.985+0000 7f9864744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.985+0000 7f9864744800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:37.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.985+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.986+0000 7f9864744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:37.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.986+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.987+0000 7f9864744800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:37.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.987+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:37.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.988+0000 7f9864744800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:37.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.988+0000 7f9864744800 20 searching for the correct realm 2024-09-12T00:05:37.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.990+0000 7f985fcf3640 0 -- 172.21.15.33:0/2040559909 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f985008a070 msgr2=0x7f985008e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:37.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:37.994+0000 7f98604f4640 0 -- 172.21.15.33:0/2040559909 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f98540961a0 msgr2=0x7f9854090880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:38.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:38.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:38.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:38.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:38.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:38.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:38.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:38.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:38.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.201+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 20 zone default found 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 4 Realm: () 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 20 zonegroup default 2024-09-12T00:05:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.202+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.203+0000 7f9864744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.203+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.203+0000 7f9864744800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.203+0000 7f9864744800 20 started sync module instance, tier type = 2024-09-12T00:05:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.203+0000 7f9864744800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:38.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.216+0000 7f9864744800 20 add_watcher() i=0 2024-09-12T00:05:38.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.216+0000 7f9864744800 20 add_watcher() i=1 2024-09-12T00:05:38.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.216+0000 7f9864744800 20 add_watcher() i=2 2024-09-12T00:05:38.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.216+0000 7f9864744800 20 add_watcher() i=3 2024-09-12T00:05:38.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.216+0000 7f9864744800 20 add_watcher() i=4 2024-09-12T00:05:38.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.216+0000 7f9864744800 20 add_watcher() i=5 2024-09-12T00:05:38.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.216+0000 7f9864744800 20 add_watcher() i=6 2024-09-12T00:05:38.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.217+0000 7f9864744800 20 add_watcher() i=7 2024-09-12T00:05:38.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.217+0000 7f9864744800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:38.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.219+0000 7f9716fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:38.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.219+0000 7f9864744800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:38.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.219+0000 7f9864744800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:38.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.219+0000 7f9864744800 5 note: GC not initialized 2024-09-12T00:05:38.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.219+0000 7f9715fdb640 20 reqs_thread_entry: start 2024-09-12T00:05:38.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.220+0000 7f9864744800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:38.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.220+0000 7f9864744800 20 Filter name: none 2024-09-12T00:05:38.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.220+0000 7f96877fe640 20 reqs_thread_entry: start 2024-09-12T00:05:38.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.220+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.220+0000 7f9864744800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.220+0000 7f9864744800 20 rados->read ofs=0 len=0 2024-09-12T00:05:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.221+0000 7f9864744800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.221+0000 7f9864744800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.221+0000 7f9864744800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.221+0000 7f9864744800 20 INFO: main: starting shard=0 2024-09-12T00:05:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.221+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:38.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.221+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.221+0000 7f9864744800 20 INFO: main: starting shard=1 2024-09-12T00:05:38.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.221+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:38.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.222+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.222+0000 7f9864744800 20 INFO: main: starting shard=2 2024-09-12T00:05:38.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.222+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:38.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.222+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.222+0000 7f9864744800 20 INFO: main: starting shard=3 2024-09-12T00:05:38.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.222+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.223+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.223+0000 7f9864744800 20 INFO: main: starting shard=4 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.223+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.223+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.223+0000 7f9864744800 20 INFO: main: starting shard=5 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.223+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.224+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.224+0000 7f9864744800 20 INFO: main: starting shard=6 2024-09-12T00:05:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.224+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:38.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.224+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.224+0000 7f9864744800 20 INFO: main: starting shard=7 2024-09-12T00:05:38.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.224+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:38.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.225+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.225+0000 7f9864744800 20 INFO: main: starting shard=8 2024-09-12T00:05:38.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.225+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:38.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.225+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.225+0000 7f9864744800 20 INFO: main: starting shard=9 2024-09-12T00:05:38.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.225+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:38.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.226+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:38.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.226+0000 7f9864744800 20 INFO: main: starting shard=10 2024-09-12T00:05:38.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.226+0000 7f9864744800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:38.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.226+0000 7f9864744800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:05:38.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.226+0000 7f9864744800 20 INFO: main: done 2024-09-12T00:05:38.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.227+0000 7f9716fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:38.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.229+0000 7f9864744800 20 remove_watcher() i=0 2024-09-12T00:05:38.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.229+0000 7f9864744800 2 removed watcher, disabling cache 2024-09-12T00:05:38.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.231+0000 7f9864744800 20 remove_watcher() i=1 2024-09-12T00:05:38.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.232+0000 7f9864744800 20 remove_watcher() i=2 2024-09-12T00:05:38.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.233+0000 7f9864744800 20 remove_watcher() i=3 2024-09-12T00:05:38.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.234+0000 7f9864744800 20 remove_watcher() i=4 2024-09-12T00:05:38.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.235+0000 7f9864744800 20 remove_watcher() i=5 2024-09-12T00:05:38.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.236+0000 7f9864744800 20 remove_watcher() i=6 2024-09-12T00:05:38.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:38.237+0000 7f9864744800 20 remove_watcher() i=7 2024-09-12T00:05:38.250 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:38.250 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:38.273 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:05:38.696 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:05:39.107 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:05:39.107 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:39.108 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:05:39.142 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:39.142 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:39.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.184+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.185+0000 7fe710240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.185+0000 7fe710240800 20 realm 2024-09-12T00:05:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.185+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.185+0000 7fe710240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.185+0000 7fe710240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.185+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.185+0000 7fe710240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.185+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.186+0000 7fe710240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:39.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.186+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.187+0000 7fe710240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:39.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.187+0000 7fe710240800 20 searching for the correct realm 2024-09-12T00:05:39.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.191+0000 7fe70d529640 0 -- 172.21.15.33:0/3424405167 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55cc0e41bfb0 msgr2=0x55cc0e41e3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:39.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.195+0000 7fe70e52b640 0 -- 172.21.15.33:0/3424405167 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fe70402b070 msgr2=0x7fe704066b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:39.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.198+0000 7fe710240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:39.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.198+0000 7fe710240800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:39.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.198+0000 7fe710240800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:39.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.198+0000 7fe710240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:39.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.198+0000 7fe710240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:39.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.198+0000 7fe710240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:39.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.198+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 20 zone default found 2024-09-12T00:05:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 4 Realm: () 2024-09-12T00:05:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 20 zonegroup default 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.199+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.200+0000 7fe710240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.200+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.200+0000 7fe710240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.200+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.200+0000 7fe710240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.200+0000 7fe710240800 20 started sync module instance, tier type = 2024-09-12T00:05:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.200+0000 7fe710240800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:39.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.214+0000 7fe710240800 20 add_watcher() i=0 2024-09-12T00:05:39.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.214+0000 7fe710240800 20 add_watcher() i=1 2024-09-12T00:05:39.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.214+0000 7fe710240800 20 add_watcher() i=2 2024-09-12T00:05:39.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.214+0000 7fe710240800 20 add_watcher() i=3 2024-09-12T00:05:39.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.214+0000 7fe710240800 20 add_watcher() i=4 2024-09-12T00:05:39.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.214+0000 7fe710240800 20 add_watcher() i=5 2024-09-12T00:05:39.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.214+0000 7fe710240800 20 add_watcher() i=6 2024-09-12T00:05:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.218+0000 7fe710240800 20 add_watcher() i=7 2024-09-12T00:05:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.218+0000 7fe710240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:39.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.220+0000 7fe5bffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.220+0000 7fe710240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.220+0000 7fe710240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.220+0000 7fe710240800 5 note: GC not initialized 2024-09-12T00:05:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.220+0000 7fe5beffd640 20 reqs_thread_entry: start 2024-09-12T00:05:39.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.220+0000 7fe710240800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:39.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.220+0000 7fe710240800 20 Filter name: none 2024-09-12T00:05:39.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe5bcff9640 20 reqs_thread_entry: start 2024-09-12T00:05:39.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:39.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.221+0000 7fe710240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.222+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.222+0000 7fe710240800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:05:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.222+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.223+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.223+0000 7fe710240800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:05:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.223+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.224+0000 7fe710240800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:05:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.224+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.224+0000 7fe710240800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:05:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.224+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.225+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.225+0000 7fe710240800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:05:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.225+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.226+0000 7fe710240800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:05:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.226+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.226+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:39.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.227+0000 7fe710240800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:05:39.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.227+0000 7fe710240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.227+0000 7fe710240800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T00:05:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.227+0000 7fe710240800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:05:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.227+0000 7fe710240800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:05:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.227+0000 7fe710240800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T00:05:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.227+0000 7fe710240800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:05:39.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.228+0000 7fe5bffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.231+0000 7fe710240800 20 remove_watcher() i=0 2024-09-12T00:05:39.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.231+0000 7fe710240800 2 removed watcher, disabling cache 2024-09-12T00:05:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.232+0000 7fe710240800 20 remove_watcher() i=1 2024-09-12T00:05:39.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.233+0000 7fe710240800 20 remove_watcher() i=2 2024-09-12T00:05:39.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.234+0000 7fe710240800 20 remove_watcher() i=3 2024-09-12T00:05:39.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.235+0000 7fe710240800 20 remove_watcher() i=4 2024-09-12T00:05:39.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.236+0000 7fe710240800 20 remove_watcher() i=5 2024-09-12T00:05:39.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.237+0000 7fe710240800 20 remove_watcher() i=6 2024-09-12T00:05:39.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.238+0000 7fe710240800 20 remove_watcher() i=7 2024-09-12T00:05:39.248 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: unlinked entries are not listable 2024-09-12T00:05:39.248 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:39.250 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.251 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.372 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:05:39.372 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:39.374 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.374 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.442 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.442 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.503 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:05:39.503 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:39.504 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:05:39.540 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:39.540 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:39.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.582+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.583+0000 7ff27d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.583+0000 7ff27d746800 20 realm 2024-09-12T00:05:39.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.583+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.583+0000 7ff27d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.583+0000 7ff27d746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:39.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.583+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.584+0000 7ff27d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.584+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.584+0000 7ff27d746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:39.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.584+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.585+0000 7ff27aa36640 0 -- 172.21.15.33:0/1367835539 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5562460eed60 msgr2=0x5562460f1150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:39.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.585+0000 7ff27d746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:39.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.585+0000 7ff27d746800 20 searching for the correct realm 2024-09-12T00:05:39.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.588+0000 7ff27ba38640 0 -- 172.21.15.33:0/1367835539 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5562460ef820 msgr2=0x5562460efcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:39.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:39.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:39.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:39.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:39.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:39.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:39.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.597+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:39.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 20 zone default found 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 4 Realm: () 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 20 zonegroup default 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.598+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.599+0000 7ff27d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.599+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.599+0000 7ff27d746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:39.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.599+0000 7ff27d746800 20 started sync module instance, tier type = 2024-09-12T00:05:39.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.599+0000 7ff27d746800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:39.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 20 add_watcher() i=0 2024-09-12T00:05:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 20 add_watcher() i=1 2024-09-12T00:05:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 20 add_watcher() i=2 2024-09-12T00:05:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 20 add_watcher() i=3 2024-09-12T00:05:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 20 add_watcher() i=4 2024-09-12T00:05:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 20 add_watcher() i=5 2024-09-12T00:05:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 20 add_watcher() i=6 2024-09-12T00:05:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 20 add_watcher() i=7 2024-09-12T00:05:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.614+0000 7ff27d746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:39.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.616+0000 7ff131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:39.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff27d746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:39.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff27d746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:39.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff27d746800 5 note: GC not initialized 2024-09-12T00:05:39.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff130fe1640 20 reqs_thread_entry: start 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff27d746800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff27d746800 20 Filter name: none 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff0aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff27d746800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.617+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:39.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 20 rados->read ofs=0 len=0 2024-09-12T00:05:39.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:39.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:39.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:39.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:39.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:39.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:39.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.618+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:39.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.619+0000 7ff27d746800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:05:39.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.619+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:39.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.619+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:39.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.620+0000 7ff27d746800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:05:39.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.620+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:39.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.620+0000 7ff27d746800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:05:39.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.620+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:39.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.621+0000 7ff27d746800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:05:39.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.621+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.621+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:39.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.622+0000 7ff27d746800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:05:39.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.622+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:39.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.622+0000 7ff27d746800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:05:39.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.622+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.623+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:39.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.623+0000 7ff27d746800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:05:39.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.623+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:39.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.624+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:39.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.624+0000 7ff27d746800 20 get_obj_state: octx=0x556245e5c690 obj=check-bucket:e state=0x5562461220c8 s->prefetch_data=0 2024-09-12T00:05:39.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.624+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.624+0000 7ff27d746800 20 get_obj_state: octx=0x556245e85170 obj=check-bucket:d state=0x5562461244c8 s->prefetch_data=0 2024-09-12T00:05:39.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.624+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state: octx=0x55624612a6b0 obj=check-bucket:c state=0x55624611d868 s->prefetch_data=0 2024-09-12T00:05:39.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state: octx=0x556246124eb0 obj=check-bucket:f state=0x5562461bcba8 s->prefetch_data=0 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state: setting s->obj_tag to gn3b6g6vmbas5edy3cuyf8mqy91xsorc 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state_impl: setting s->olh_tag to 026hqoyx4vqzj8gv0qipp7cxg4y5z18x 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=026hqoyx4vqzj8gv0qipp7cxg4y5z18x 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state: setting s->obj_tag to zjbanl0mmrjpdc7s1fda5uhowkdnrec7 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state_impl: setting s->olh_tag to 7r3yy1wd5ksmqdyc0zfpyn3r776cv8by 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7r3yy1wd5ksmqdyc0zfpyn3r776cv8by 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state: setting s->obj_tag to l84stjyu8vx5ejfzwpchx6fu8tto73ok 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state_impl: setting s->olh_tag to aqyivtd6ivre2qfmf4a84et148chhnv3 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=aqyivtd6ivre2qfmf4a84et148chhnv3 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state: setting s->obj_tag to 74vay44hxqv4tbfvsrql10fj6m4ij7od 2024-09-12T00:05:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 get_obj_state_impl: setting s->olh_tag to tphw1n15iy48lg7akj9i6b1cn0u1t4kn 2024-09-12T00:05:39.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.625+0000 7ff27d746800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=tphw1n15iy48lg7akj9i6b1cn0u1t4kn 2024-09-12T00:05:39.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.627+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:39.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.627+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 20 olh_log_entry: epoch=3 op=3 key=d[fDxnJAD6EUk3cgjCNRnQUFr6yfUSony] 2024-09-12T00:05:39.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 20 get_obj_state: octx=0x556245e85170 obj=check-bucket:_:fDxnJAD6EUk3cgjCNRnQUFr6yfUSony_d state=0x5562461d31a8 s->prefetch_data=0 2024-09-12T00:05:39.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 10 manifest: total_size = 22 2024-09-12T00:05:39.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18366130168752447654 2024-09-12T00:05:39.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 20 get_obj_state: octx=0x556245e85170 obj=check-bucket:_:fDxnJAD6EUk3cgjCNRnQUFr6yfUSony_d state=0x5562461d31a8 s->prefetch_data=0 2024-09-12T00:05:39.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 20 prepare_atomic_modification: state is not atomic. state=0x5562461d31a8 2024-09-12T00:05:39.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.629+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.630+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:39.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.631+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.631+0000 7ff27d746800 20 olh_log_entry: epoch=3 op=3 key=c[7.j2VF3gguEYYRbp22lXAdfhn0DU6xq] 2024-09-12T00:05:39.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.631+0000 7ff27d746800 20 get_obj_state: octx=0x55624612a6b0 obj=check-bucket:_:7.j2VF3gguEYYRbp22lXAdfhn0DU6xq_c state=0x5562461d6198 s->prefetch_data=0 2024-09-12T00:05:39.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.632+0000 7ff27d746800 10 manifest: total_size = 22 2024-09-12T00:05:39.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.632+0000 7ff27d746800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5684986732345878693 2024-09-12T00:05:39.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.632+0000 7ff27d746800 20 get_obj_state: octx=0x55624612a6b0 obj=check-bucket:_:7.j2VF3gguEYYRbp22lXAdfhn0DU6xq_c state=0x5562461d6198 s->prefetch_data=0 2024-09-12T00:05:39.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.632+0000 7ff27d746800 20 prepare_atomic_modification: state is not atomic. state=0x5562461d6198 2024-09-12T00:05:39.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.632+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.632+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:39.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 20 olh_log_entry: epoch=2 op=3 key=e[DvE3NX9X.ADATrkJkpiLshYIpv-gx2F] 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 20 get_obj_state: octx=0x556245e5c690 obj=check-bucket:_:DvE3NX9X.ADATrkJkpiLshYIpv-gx2F_e state=0x5562461e7ec8 s->prefetch_data=0 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 10 manifest: total_size = 22 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13805969927567132764 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 20 get_obj_state: octx=0x556245e5c690 obj=check-bucket:_:DvE3NX9X.ADATrkJkpiLshYIpv-gx2F_e state=0x5562461e7ec8 s->prefetch_data=0 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 20 prepare_atomic_modification: state is not atomic. state=0x5562461e7ec8 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.633+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.634+0000 7ff27d746800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.634+0000 7ff27d746800 20 olh_log_entry: epoch=2 op=3 key=f[9cn9McHHGuffHS03m4V2n7.An-dwFII] 2024-09-12T00:05:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.634+0000 7ff27d746800 20 get_obj_state: octx=0x556246124eb0 obj=check-bucket:_:9cn9McHHGuffHS03m4V2n7.An-dwFII_f state=0x5562461f4528 s->prefetch_data=0 2024-09-12T00:05:39.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.635+0000 7ff27d746800 10 manifest: total_size = 22 2024-09-12T00:05:39.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.635+0000 7ff27d746800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6993327099481137177 2024-09-12T00:05:39.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.635+0000 7ff27d746800 20 get_obj_state: octx=0x556246124eb0 obj=check-bucket:_:9cn9McHHGuffHS03m4V2n7.An-dwFII_f state=0x5562461f4528 s->prefetch_data=0 2024-09-12T00:05:39.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.635+0000 7ff27d746800 20 prepare_atomic_modification: state is not atomic. state=0x5562461f4528 2024-09-12T00:05:39.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.635+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:39.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.635+0000 7ff15e7fc640 20 handle_completion(): completion ok for obj=d[fDxnJAD6EUk3cgjCNRnQUFr6yfUSony] 2024-09-12T00:05:39.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.636+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.636+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.637+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:39.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.637+0000 7ff27d746800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:05:39.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.638+0000 7ff15e7fc640 20 handle_completion(): completion ok for obj=c[7.j2VF3gguEYYRbp22lXAdfhn0DU6xq] 2024-09-12T00:05:39.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.640+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.640+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.643+0000 7ff15effd640 20 handle_completion(): completion ok for obj=e[DvE3NX9X.ADATrkJkpiLshYIpv-gx2F] 2024-09-12T00:05:39.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.643+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:39.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.643+0000 7ff27d746800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:05:39.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.643+0000 7ff27d746800 20 get_obj_state: octx=0x556245e5c690 obj=check-bucket:e state=0x5562461220c8 s->prefetch_data=0 2024-09-12T00:05:39.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.643+0000 7ff27d746800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=026hqoyx4vqzj8gv0qipp7cxg4y5z18x 2024-09-12T00:05:39.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.644+0000 7ff15e7fc640 20 handle_completion(): completion ok for obj=f[9cn9McHHGuffHS03m4V2n7.An-dwFII] 2024-09-12T00:05:39.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.645+0000 7ff27d746800 20 get_obj_state: octx=0x556246124eb0 obj=check-bucket:f state=0x5562461bcba8 s->prefetch_data=0 2024-09-12T00:05:39.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.645+0000 7ff27d746800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=tphw1n15iy48lg7akj9i6b1cn0u1t4kn 2024-09-12T00:05:39.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.651+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:39.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.657+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:39.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.657+0000 7ff27d746800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:05:39.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.657+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:39.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.659+0000 7ff27d746800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:39.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.659+0000 7ff27d746800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:05:39.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.659+0000 7ff27d746800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:05:39.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.660+0000 7ff131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:39.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.665+0000 7ff27d746800 20 remove_watcher() i=0 2024-09-12T00:05:39.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.665+0000 7ff27d746800 2 removed watcher, disabling cache 2024-09-12T00:05:39.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.666+0000 7ff27d746800 20 remove_watcher() i=1 2024-09-12T00:05:39.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.667+0000 7ff27d746800 20 remove_watcher() i=2 2024-09-12T00:05:39.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.669+0000 7ff27d746800 20 remove_watcher() i=3 2024-09-12T00:05:39.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.670+0000 7ff27d746800 20 remove_watcher() i=4 2024-09-12T00:05:39.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.671+0000 7ff27d746800 20 remove_watcher() i=5 2024-09-12T00:05:39.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.672+0000 7ff27d746800 20 remove_watcher() i=6 2024-09-12T00:05:39.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:39.673+0000 7ff27d746800 20 remove_watcher() i=7 2024-09-12T00:05:39.686 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.686 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.706 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.707 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.727 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.727 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.749 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.749 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.769 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:05:39.769 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:39.770 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.770 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.845 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.845 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.869 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.869 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.893 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.893 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.918 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:39.918 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:39.941 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:05:39.941 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:39.942 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:05:39.977 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:39.978 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:40.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.020+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.022+0000 7f8572b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.022+0000 7f8572b2e800 20 realm 2024-09-12T00:05:40.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.022+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.022+0000 7f8572b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.022+0000 7f8572b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:40.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.022+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.022+0000 7f8572b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.022+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.023+0000 7f8572b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:40.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.023+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.024+0000 7f8572b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:40.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.024+0000 7f8572b2e800 20 searching for the correct realm 2024-09-12T00:05:40.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.025+0000 7f856e8dd640 0 -- 172.21.15.33:0/2614435959 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f8568061040 msgr2=0x7f85680affd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:40.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.230+0000 7f856e0dc640 0 -- 172.21.15.33:0/2614435959 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f8560017070 msgr2=0x7f856002e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.237+0000 7f8572b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 20 zone default found 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 4 Realm: () 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 20 zonegroup default 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.238+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.239+0000 7f8572b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.239+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.239+0000 7f8572b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.239+0000 7f8572b2e800 20 started sync module instance, tier type = 2024-09-12T00:05:40.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.239+0000 7f8572b2e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:40.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.251+0000 7f8572b2e800 20 add_watcher() i=0 2024-09-12T00:05:40.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.251+0000 7f8572b2e800 20 add_watcher() i=1 2024-09-12T00:05:40.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.251+0000 7f8572b2e800 20 add_watcher() i=2 2024-09-12T00:05:40.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.251+0000 7f8572b2e800 20 add_watcher() i=3 2024-09-12T00:05:40.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.251+0000 7f8572b2e800 20 add_watcher() i=4 2024-09-12T00:05:40.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.251+0000 7f8572b2e800 20 add_watcher() i=5 2024-09-12T00:05:40.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.251+0000 7f8572b2e800 20 add_watcher() i=6 2024-09-12T00:05:40.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.252+0000 7f8572b2e800 20 add_watcher() i=7 2024-09-12T00:05:40.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.252+0000 7f8572b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:40.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.253+0000 7f84257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:40.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f8572b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:40.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f8572b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:40.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f8572b2e800 5 note: GC not initialized 2024-09-12T00:05:40.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f839ffff640 20 reqs_thread_entry: start 2024-09-12T00:05:40.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f8572b2e800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:40.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f8572b2e800 20 Filter name: none 2024-09-12T00:05:40.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f839dffb640 20 reqs_thread_entry: start 2024-09-12T00:05:40.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f8572b2e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.254+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:40.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:40.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.255+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:40.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.256+0000 7f8572b2e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:05:40.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.256+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:40.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.256+0000 7f8572b2e800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:05:40.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.256+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:40.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.257+0000 7f8572b2e800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:05:40.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.257+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.257+0000 7f8572b2e800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.257+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.258+0000 7f8572b2e800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.258+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.258+0000 7f8572b2e800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.258+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.259+0000 7f8572b2e800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.259+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.259+0000 7f8572b2e800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:05:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.259+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:40.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.260+0000 7f8572b2e800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:05:40.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.260+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:40.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.260+0000 7f8572b2e800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:05:40.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.260+0000 7f8572b2e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:40.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.261+0000 7f8572b2e800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:05:40.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.261+0000 7f8572b2e800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:05:40.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.262+0000 7f84257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:40.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.264+0000 7f8572b2e800 20 remove_watcher() i=0 2024-09-12T00:05:40.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.264+0000 7f8572b2e800 2 removed watcher, disabling cache 2024-09-12T00:05:40.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.265+0000 7f8572b2e800 20 remove_watcher() i=1 2024-09-12T00:05:40.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.267+0000 7f8572b2e800 20 remove_watcher() i=2 2024-09-12T00:05:40.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.268+0000 7f8572b2e800 20 remove_watcher() i=3 2024-09-12T00:05:40.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.270+0000 7f8572b2e800 20 remove_watcher() i=4 2024-09-12T00:05:40.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.271+0000 7f8572b2e800 20 remove_watcher() i=5 2024-09-12T00:05:40.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.272+0000 7f8572b2e800 20 remove_watcher() i=6 2024-09-12T00:05:40.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.273+0000 7f8572b2e800 20 remove_watcher() i=7 2024-09-12T00:05:40.286 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:40.286 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:40.407 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:40.407 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:40.455 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:05:40.486 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:40.486 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:40.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.527+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.529+0000 7f4a8180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.529+0000 7f4a8180e800 20 realm 2024-09-12T00:05:40.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.529+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.529+0000 7f4a8180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.529+0000 7f4a8180e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:40.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.529+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.530+0000 7f4a8180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.530+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.531+0000 7f4a8180e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:40.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.531+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.531+0000 7f4a8180e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:40.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.531+0000 7f4a8180e800 20 searching for the correct realm 2024-09-12T00:05:40.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.535+0000 7f4a7476a640 0 -- 172.21.15.33:0/3518409013 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5571347f7b50 msgr2=0x5571347f9f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:40.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.541+0000 7f4a7cf6b640 0 -- 172.21.15.33:0/3518409013 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f4a6405b910 msgr2=0x7f4a64033400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:40.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:40.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:40.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:40.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:40.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:40.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:40.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:40.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.749+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:40.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 20 zone default found 2024-09-12T00:05:40.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 4 Realm: () 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 20 zonegroup default 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.750+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.751+0000 7f4a8180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.751+0000 7f4a8180e800 20 started sync module instance, tier type = 2024-09-12T00:05:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.751+0000 7f4a8180e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:40.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.765+0000 7f4a8180e800 20 add_watcher() i=0 2024-09-12T00:05:40.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.765+0000 7f4a8180e800 20 add_watcher() i=1 2024-09-12T00:05:40.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.765+0000 7f4a8180e800 20 add_watcher() i=2 2024-09-12T00:05:40.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.765+0000 7f4a8180e800 20 add_watcher() i=3 2024-09-12T00:05:40.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.765+0000 7f4a8180e800 20 add_watcher() i=4 2024-09-12T00:05:40.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.765+0000 7f4a8180e800 20 add_watcher() i=5 2024-09-12T00:05:40.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.765+0000 7f4a8180e800 20 add_watcher() i=6 2024-09-12T00:05:40.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.766+0000 7f4a8180e800 20 add_watcher() i=7 2024-09-12T00:05:40.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.766+0000 7f4a8180e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:40.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.769+0000 7f4932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:40.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.769+0000 7f4a8180e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:40.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.769+0000 7f4a8180e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:40.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.769+0000 7f4a8180e800 5 note: GC not initialized 2024-09-12T00:05:40.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.770+0000 7f4931fe3640 20 reqs_thread_entry: start 2024-09-12T00:05:40.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.770+0000 7f4a8180e800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:40.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.770+0000 7f4a8180e800 20 Filter name: none 2024-09-12T00:05:40.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.770+0000 7f48a37fe640 20 reqs_thread_entry: start 2024-09-12T00:05:40.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.770+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.771+0000 7f4a8180e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:40.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.771+0000 7f4a8180e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.771+0000 7f4a8180e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:40.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.771+0000 7f4a8180e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:40.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.771+0000 7f4a8180e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:40.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.771+0000 7f4a8180e800 20 INFO: main: starting shard=0 2024-09-12T00:05:40.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.771+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:40.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.773+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.773+0000 7f4a8180e800 20 INFO: main: starting shard=1 2024-09-12T00:05:40.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.773+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:40.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.773+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.773+0000 7f4a8180e800 20 INFO: main: starting shard=2 2024-09-12T00:05:40.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.774+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:40.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.774+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.774+0000 7f4a8180e800 20 INFO: main: starting shard=3 2024-09-12T00:05:40.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.774+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:40.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.775+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.775+0000 7f4a8180e800 20 INFO: main: starting shard=4 2024-09-12T00:05:40.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.775+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:40.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.775+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.775+0000 7f4a8180e800 20 INFO: main: starting shard=5 2024-09-12T00:05:40.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.775+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:40.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.776+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.776+0000 7f4a8180e800 20 INFO: main: starting shard=6 2024-09-12T00:05:40.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.776+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:40.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.776+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.776+0000 7f4a8180e800 20 INFO: main: starting shard=7 2024-09-12T00:05:40.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.776+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:40.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.777+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.777+0000 7f4a8180e800 20 INFO: main: starting shard=8 2024-09-12T00:05:40.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.777+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:40.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.777+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:05:40.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.777+0000 7f4a8180e800 20 INFO: main: starting shard=9 2024-09-12T00:05:40.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.777+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:40.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.778+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.778+0000 7f4a8180e800 20 INFO: main: starting shard=10 2024-09-12T00:05:40.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.778+0000 7f4a8180e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:40.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.779+0000 7f4a8180e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.779+0000 7f4a8180e800 20 INFO: main: done 2024-09-12T00:05:40.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.780+0000 7f4932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:40.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.782+0000 7f4a8180e800 20 remove_watcher() i=0 2024-09-12T00:05:40.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.782+0000 7f4a8180e800 2 removed watcher, disabling cache 2024-09-12T00:05:40.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.787+0000 7f4a8180e800 20 remove_watcher() i=1 2024-09-12T00:05:40.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.788+0000 7f4a8180e800 20 remove_watcher() i=2 2024-09-12T00:05:40.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.789+0000 7f4a8180e800 20 remove_watcher() i=3 2024-09-12T00:05:40.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.791+0000 7f4a8180e800 20 remove_watcher() i=4 2024-09-12T00:05:40.790 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.792+0000 7f4a8180e800 20 remove_watcher() i=5 2024-09-12T00:05:40.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.793+0000 7f4a8180e800 20 remove_watcher() i=6 2024-09-12T00:05:40.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.794+0000 7f4a8180e800 20 remove_watcher() i=7 2024-09-12T00:05:40.806 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:05:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:40.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.878+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.881+0000 7fee26346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.881+0000 7fee26346800 20 realm 2024-09-12T00:05:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.881+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.881+0000 7fee26346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.881+0000 7fee26346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.881+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.881+0000 7fee26346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.881+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.882+0000 7fee26346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:40.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.882+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.883+0000 7fee26346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:40.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.883+0000 7fee26346800 20 searching for the correct realm 2024-09-12T00:05:40.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.885+0000 7fee24638640 0 -- 172.21.15.33:0/1466729865 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55d7c30b6be0 msgr2=0x55d7c30b90a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:40.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.889+0000 7fee23e37640 0 -- 172.21.15.33:0/1466729865 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fee18069f30 msgr2=0x7fee18083840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:40.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:40.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:40.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:40.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:40.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:40.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:40.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:40.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.893+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:40.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 20 zone default found 2024-09-12T00:05:40.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 4 Realm: () 2024-09-12T00:05:40.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:40.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:40.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:40.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 20 zonegroup default 2024-09-12T00:05:40.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.894+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.895+0000 7fee26346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:40.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.895+0000 7fee26346800 20 started sync module instance, tier type = 2024-09-12T00:05:40.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.895+0000 7fee26346800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:40.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.907+0000 7fee26346800 20 add_watcher() i=0 2024-09-12T00:05:40.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.907+0000 7fee26346800 20 add_watcher() i=1 2024-09-12T00:05:40.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.907+0000 7fee26346800 20 add_watcher() i=2 2024-09-12T00:05:40.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.907+0000 7fee26346800 20 add_watcher() i=3 2024-09-12T00:05:40.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.907+0000 7fee26346800 20 add_watcher() i=4 2024-09-12T00:05:40.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.907+0000 7fee26346800 20 add_watcher() i=5 2024-09-12T00:05:40.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.907+0000 7fee26346800 20 add_watcher() i=6 2024-09-12T00:05:40.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.908+0000 7fee26346800 20 add_watcher() i=7 2024-09-12T00:05:40.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.908+0000 7fee26346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:40.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.911+0000 7fecd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:40.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.911+0000 7fee26346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:40.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.911+0000 7fee26346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:40.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.911+0000 7fee26346800 5 note: GC not initialized 2024-09-12T00:05:40.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.911+0000 7fecd8fe1640 20 reqs_thread_entry: start 2024-09-12T00:05:40.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.912+0000 7fee26346800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:40.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.912+0000 7fee26346800 20 Filter name: none 2024-09-12T00:05:40.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.912+0000 7fec527fc640 20 reqs_thread_entry: start 2024-09-12T00:05:40.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.912+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.912+0000 7fee26346800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:40.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.912+0000 7fee26346800 20 rados->read ofs=0 len=0 2024-09-12T00:05:40.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.913+0000 7fee26346800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:40.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.913+0000 7fee26346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:40.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.913+0000 7fee26346800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:40.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.913+0000 7fee26346800 20 INFO: main: starting shard=0 2024-09-12T00:05:40.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.913+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:40.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.913+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.913+0000 7fee26346800 20 INFO: main: starting shard=1 2024-09-12T00:05:40.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.913+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.914+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.914+0000 7fee26346800 20 INFO: main: starting shard=2 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.914+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.914+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.914+0000 7fee26346800 20 INFO: main: starting shard=3 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.914+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 INFO: main: starting shard=4 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 INFO: main: starting shard=5 2024-09-12T00:05:40.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:40.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:05:40.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 INFO: main: starting shard=6 2024-09-12T00:05:40.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.915+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:40.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.916+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.916+0000 7fee26346800 20 INFO: main: starting shard=7 2024-09-12T00:05:40.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.916+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:40.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.917+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.917+0000 7fee26346800 20 INFO: main: starting shard=8 2024-09-12T00:05:40.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.917+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.917+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.917+0000 7fee26346800 20 INFO: main: starting shard=9 2024-09-12T00:05:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.917+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.918+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.918+0000 7fee26346800 20 INFO: main: starting shard=10 2024-09-12T00:05:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.918+0000 7fee26346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.918+0000 7fee26346800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.918+0000 7fee26346800 20 INFO: main: done 2024-09-12T00:05:40.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.919+0000 7fecd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:40.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.921+0000 7fee26346800 20 remove_watcher() i=0 2024-09-12T00:05:40.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.921+0000 7fee26346800 2 removed watcher, disabling cache 2024-09-12T00:05:40.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.923+0000 7fee26346800 20 remove_watcher() i=1 2024-09-12T00:05:40.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.924+0000 7fee26346800 20 remove_watcher() i=2 2024-09-12T00:05:40.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.925+0000 7fee26346800 20 remove_watcher() i=3 2024-09-12T00:05:40.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.927+0000 7fee26346800 20 remove_watcher() i=4 2024-09-12T00:05:40.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.928+0000 7fee26346800 20 remove_watcher() i=5 2024-09-12T00:05:40.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.928+0000 7fee26346800 20 remove_watcher() i=6 2024-09-12T00:05:40.928 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:40.929+0000 7fee26346800 20 remove_watcher() i=7 2024-09-12T00:05:40.939 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:05:40.939 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:40.942 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:05:40.973 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:40.973 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:41.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.015+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.016+0000 7eff30375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.016+0000 7eff30375800 20 realm 2024-09-12T00:05:41.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.016+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.016+0000 7eff30375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.016+0000 7eff30375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:41.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.016+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.017+0000 7eff30375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.017+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.018+0000 7eff30375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.018+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.018+0000 7eff30375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:41.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.018+0000 7eff30375800 20 searching for the correct realm 2024-09-12T00:05:41.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.021+0000 7eff2e660640 0 -- 172.21.15.33:0/1968085991 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x560d02dd70d0 msgr2=0x560d02dd9590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:41.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.025+0000 7eff2de5f640 0 -- 172.21.15.33:0/1968085991 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7eff2408f040 msgr2=0x7eff24090820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:41.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.029+0000 7eff30375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:41.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.029+0000 7eff30375800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:41.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.029+0000 7eff30375800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:41.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.029+0000 7eff30375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:41.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.029+0000 7eff30375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.029+0000 7eff30375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.029+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:41.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 20 zone default found 2024-09-12T00:05:41.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 4 Realm: () 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 20 zonegroup default 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.030+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.031+0000 7eff30375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.031+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.031+0000 7eff30375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.031+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.031+0000 7eff30375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.031+0000 7eff30375800 20 started sync module instance, tier type = 2024-09-12T00:05:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.031+0000 7eff30375800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:41.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.041+0000 7eff30375800 20 add_watcher() i=0 2024-09-12T00:05:41.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.041+0000 7eff30375800 20 add_watcher() i=1 2024-09-12T00:05:41.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.041+0000 7eff30375800 20 add_watcher() i=2 2024-09-12T00:05:41.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.041+0000 7eff30375800 20 add_watcher() i=3 2024-09-12T00:05:41.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.041+0000 7eff30375800 20 add_watcher() i=4 2024-09-12T00:05:41.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.041+0000 7eff30375800 20 add_watcher() i=5 2024-09-12T00:05:41.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.041+0000 7eff30375800 20 add_watcher() i=6 2024-09-12T00:05:41.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.043+0000 7eff30375800 20 add_watcher() i=7 2024-09-12T00:05:41.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.043+0000 7eff30375800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:41.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.045+0000 7efdbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:41.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.045+0000 7eff30375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.045+0000 7eff30375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.045+0000 7eff30375800 5 note: GC not initialized 2024-09-12T00:05:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.045+0000 7efdbe7fc640 20 reqs_thread_entry: start 2024-09-12T00:05:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 20 Filter name: none 2024-09-12T00:05:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7efd53fff640 20 reqs_thread_entry: start 2024-09-12T00:05:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:41.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:41.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:41.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:41.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.046+0000 7eff30375800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.047+0000 7eff30375800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.047+0000 7eff30375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.047+0000 7eff30375800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.047+0000 7eff30375800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.047+0000 7eff30375800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.047+0000 7eff30375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.047+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.048+0000 7eff30375800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:05:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.048+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:41.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.048+0000 7eff30375800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:05:41.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.048+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:41.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.049+0000 7eff30375800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:05:41.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.049+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:41.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.049+0000 7eff30375800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:05:41.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.049+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:41.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.050+0000 7eff30375800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:05:41.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.050+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:41.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.050+0000 7eff30375800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:05:41.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.050+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:41.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.051+0000 7eff30375800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:05:41.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.051+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:41.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.052+0000 7eff30375800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:05:41.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.052+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:41.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.052+0000 7eff30375800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:05:41.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.052+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:41.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.053+0000 7eff30375800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:05:41.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.053+0000 7eff30375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:41.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.054+0000 7eff30375800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:05:41.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.054+0000 7eff30375800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:05:41.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.054+0000 7efdbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:41.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.057+0000 7eff30375800 20 remove_watcher() i=0 2024-09-12T00:05:41.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.057+0000 7eff30375800 2 removed watcher, disabling cache 2024-09-12T00:05:41.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.058+0000 7eff30375800 20 remove_watcher() i=1 2024-09-12T00:05:41.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.059+0000 7eff30375800 20 remove_watcher() i=2 2024-09-12T00:05:41.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.060+0000 7eff30375800 20 remove_watcher() i=3 2024-09-12T00:05:41.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.061+0000 7eff30375800 20 remove_watcher() i=4 2024-09-12T00:05:41.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.062+0000 7eff30375800 20 remove_watcher() i=5 2024-09-12T00:05:41.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.063+0000 7eff30375800 20 remove_watcher() i=6 2024-09-12T00:05:41.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.064+0000 7eff30375800 20 remove_watcher() i=7 2024-09-12T00:05:41.074 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:05:41.074 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:41.075 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:05:41.109 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:41.109 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:41.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.150+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.152+0000 7f4943126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.152+0000 7f4943126800 20 realm 2024-09-12T00:05:41.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.152+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.152+0000 7f4943126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.152+0000 7f4943126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:41.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.152+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.152+0000 7f4943126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.152+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.153+0000 7f4943126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.153+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.154+0000 7f4943126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:41.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.154+0000 7f4943126800 20 searching for the correct realm 2024-09-12T00:05:41.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.157+0000 7f493ed09640 0 -- 172.21.15.33:0/1837854408 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f4938061040 msgr2=0x7f4938055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:41.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.160+0000 7f493ed09640 0 -- 172.21.15.33:0/1837854408 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f493401a420 msgr2=0x7f493401a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.367+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:41.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 20 zone default found 2024-09-12T00:05:41.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 4 Realm: () 2024-09-12T00:05:41.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 20 zonegroup default 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.368+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.369+0000 7f4943126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.369+0000 7f4943126800 20 started sync module instance, tier type = 2024-09-12T00:05:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.369+0000 7f4943126800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:41.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.386+0000 7f4943126800 20 add_watcher() i=0 2024-09-12T00:05:41.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.386+0000 7f4943126800 20 add_watcher() i=1 2024-09-12T00:05:41.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.386+0000 7f4943126800 20 add_watcher() i=2 2024-09-12T00:05:41.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.386+0000 7f4943126800 20 add_watcher() i=3 2024-09-12T00:05:41.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.386+0000 7f4943126800 20 add_watcher() i=4 2024-09-12T00:05:41.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.386+0000 7f4943126800 20 add_watcher() i=5 2024-09-12T00:05:41.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.388+0000 7f4943126800 20 add_watcher() i=6 2024-09-12T00:05:41.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.388+0000 7f4943126800 20 add_watcher() i=7 2024-09-12T00:05:41.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.388+0000 7f4943126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.389+0000 7f47f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f4943126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f4943126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f4943126800 5 note: GC not initialized 2024-09-12T00:05:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f476ffff640 20 reqs_thread_entry: start 2024-09-12T00:05:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f4943126800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f4943126800 20 Filter name: none 2024-09-12T00:05:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f476dffb640 20 reqs_thread_entry: start 2024-09-12T00:05:41.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f4943126800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:41.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.390+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:41.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:41.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:41.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.391+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:41.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.392+0000 7f4943126800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:05:41.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.392+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:41.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.392+0000 7f4943126800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:05:41.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.392+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.393+0000 7f4943126800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:05:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.393+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.393+0000 7f4943126800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:05:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.393+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.393+0000 7f4943126800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:05:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.393+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.394+0000 7f4943126800 20 get_obj_state: octx=0x55f96f59b660 obj=check-bucket:d state=0x55f96f86d368 s->prefetch_data=0 2024-09-12T00:05:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.394+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:41.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.395+0000 7f4943126800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:05:41.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.395+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:41.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.396+0000 7f4943126800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:05:41.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.396+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:41.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.396+0000 7f4943126800 20 get_obj_state: octx=0x55f96f5c4160 obj=check-bucket:c state=0x55f96f8627e8 s->prefetch_data=0 2024-09-12T00:05:41.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.396+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:41.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.397+0000 7f4943126800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:05:41.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.397+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:41.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:05:41.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 get_obj_state: setting s->obj_tag to zjbanl0mmrjpdc7s1fda5uhowkdnrec7 2024-09-12T00:05:41.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 get_obj_state_impl: setting s->olh_tag to 7r3yy1wd5ksmqdyc0zfpyn3r776cv8by 2024-09-12T00:05:41.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:41.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 get_obj_state: setting s->obj_tag to l84stjyu8vx5ejfzwpchx6fu8tto73ok 2024-09-12T00:05:41.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 get_obj_state_impl: setting s->olh_tag to aqyivtd6ivre2qfmf4a84et148chhnv3 2024-09-12T00:05:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:05:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 olh_log_entry: epoch=4 op=3 key=d[7PZveMVjX4hlY1hP8QjHTTfLGh1eW6w] 2024-09-12T00:05:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 get_obj_state: octx=0x55f96f8a15b0 obj=check-bucket:_:7PZveMVjX4hlY1hP8QjHTTfLGh1eW6w_d state=0x55f96f8c5ff8 s->prefetch_data=0 2024-09-12T00:05:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:05:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 olh_log_entry: epoch=4 op=3 key=c[hsJsvmUd3wO6oJk1EPRDwqKWF9SwmPU] 2024-09-12T00:05:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.398+0000 7f4943126800 20 get_obj_state: octx=0x55f96f8c15b0 obj=check-bucket:_:hsJsvmUd3wO6oJk1EPRDwqKWF9SwmPU_c state=0x55f96f8ce488 s->prefetch_data=0 2024-09-12T00:05:41.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.401+0000 7f4943126800 20 get_obj_state: octx=0x55f96f8c15b0 obj=check-bucket:c state=0x55f96f8ce488 s->prefetch_data=0 2024-09-12T00:05:41.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.401+0000 7f4943126800 20 get_obj_state: octx=0x55f96f8a15b0 obj=check-bucket:d state=0x55f96f8cb4f8 s->prefetch_data=0 2024-09-12T00:05:41.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.401+0000 7f4943126800 20 get_obj_state: setting s->obj_tag to l84stjyu8vx5ejfzwpchx6fu8tto73ok 2024-09-12T00:05:41.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.401+0000 7f4943126800 20 get_obj_state_impl: setting s->olh_tag to aqyivtd6ivre2qfmf4a84et148chhnv3 2024-09-12T00:05:41.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.401+0000 7f4943126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=aqyivtd6ivre2qfmf4a84et148chhnv3 2024-09-12T00:05:41.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.401+0000 7f4943126800 20 get_obj_state: setting s->obj_tag to zjbanl0mmrjpdc7s1fda5uhowkdnrec7 2024-09-12T00:05:41.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.401+0000 7f4943126800 20 get_obj_state_impl: setting s->olh_tag to 7r3yy1wd5ksmqdyc0zfpyn3r776cv8by 2024-09-12T00:05:41.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.401+0000 7f4943126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7r3yy1wd5ksmqdyc0zfpyn3r776cv8by 2024-09-12T00:05:41.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.406+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:41.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.406+0000 7f4943126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:41.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.407+0000 7f4943126800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:05:41.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.407+0000 7f4943126800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:05:41.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.407+0000 7f4943126800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:05:41.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.408+0000 7f47f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:41.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.411+0000 7f4943126800 20 remove_watcher() i=0 2024-09-12T00:05:41.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.411+0000 7f4943126800 2 removed watcher, disabling cache 2024-09-12T00:05:41.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.411+0000 7f4943126800 20 remove_watcher() i=1 2024-09-12T00:05:41.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.413+0000 7f4943126800 20 remove_watcher() i=2 2024-09-12T00:05:41.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.414+0000 7f4943126800 20 remove_watcher() i=3 2024-09-12T00:05:41.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.415+0000 7f4943126800 20 remove_watcher() i=4 2024-09-12T00:05:41.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.416+0000 7f4943126800 20 remove_watcher() i=5 2024-09-12T00:05:41.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.419+0000 7f4943126800 20 remove_watcher() i=6 2024-09-12T00:05:41.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.420+0000 7f4943126800 20 remove_watcher() i=7 2024-09-12T00:05:41.431 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:05:41.463 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:41.463 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:41.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.504+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.506+0000 7f36b0f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.506+0000 7f36b0f22800 20 realm 2024-09-12T00:05:41.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.506+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.506+0000 7f36b0f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.506+0000 7f36b0f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:41.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.506+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.506+0000 7f36b0f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.506+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.507+0000 7f36b0f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.507+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.508+0000 7f36b0f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:41.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.508+0000 7f36b0f22800 20 searching for the correct realm 2024-09-12T00:05:41.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.511+0000 7f36ad303640 0 -- 172.21.15.33:0/3585256269 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f3694064040 msgr2=0x7f3694060e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:41.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.718+0000 7f36acb02640 0 -- 172.21.15.33:0/3585256269 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x55b41fc8c380 msgr2=0x55b41fc8e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:41.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.720+0000 7f36b0f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:41.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.720+0000 7f36b0f22800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:41.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.720+0000 7f36b0f22800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:41.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.720+0000 7f36b0f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:41.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.720+0000 7f36b0f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:41.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.720+0000 7f36b0f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:41.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.720+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:41.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 20 zone default found 2024-09-12T00:05:41.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 4 Realm: () 2024-09-12T00:05:41.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 20 zonegroup default 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.721+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.722+0000 7f36b0f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.722+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.722+0000 7f36b0f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.722+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.722+0000 7f36b0f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.722+0000 7f36b0f22800 20 started sync module instance, tier type = 2024-09-12T00:05:41.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.722+0000 7f36b0f22800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:41.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.735+0000 7f36b0f22800 20 add_watcher() i=0 2024-09-12T00:05:41.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.735+0000 7f36b0f22800 20 add_watcher() i=1 2024-09-12T00:05:41.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.735+0000 7f36b0f22800 20 add_watcher() i=2 2024-09-12T00:05:41.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.735+0000 7f36b0f22800 20 add_watcher() i=3 2024-09-12T00:05:41.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.735+0000 7f36b0f22800 20 add_watcher() i=4 2024-09-12T00:05:41.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.735+0000 7f36b0f22800 20 add_watcher() i=5 2024-09-12T00:05:41.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.735+0000 7f36b0f22800 20 add_watcher() i=6 2024-09-12T00:05:41.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.736+0000 7f36b0f22800 20 add_watcher() i=7 2024-09-12T00:05:41.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.736+0000 7f36b0f22800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:41.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.738+0000 7f3562fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:41.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.738+0000 7f36b0f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:41.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.738+0000 7f36b0f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:41.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.738+0000 7f36b0f22800 5 note: GC not initialized 2024-09-12T00:05:41.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.739+0000 7f3561fe3640 20 reqs_thread_entry: start 2024-09-12T00:05:41.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.739+0000 7f36b0f22800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:41.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.739+0000 7f36b0f22800 20 Filter name: none 2024-09-12T00:05:41.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.739+0000 7f34d37fe640 20 reqs_thread_entry: start 2024-09-12T00:05:41.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.739+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.739+0000 7f36b0f22800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:41.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.739+0000 7f36b0f22800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.740+0000 7f36b0f22800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:41.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.740+0000 7f36b0f22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:41.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.740+0000 7f36b0f22800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:41.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.740+0000 7f36b0f22800 20 INFO: main: starting shard=0 2024-09-12T00:05:41.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.740+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:41.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.740+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.740+0000 7f36b0f22800 20 INFO: main: starting shard=1 2024-09-12T00:05:41.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.740+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.741+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.741+0000 7f36b0f22800 20 INFO: main: starting shard=2 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.741+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.741+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.741+0000 7f36b0f22800 20 INFO: main: starting shard=3 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.741+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.742+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.742+0000 7f36b0f22800 20 INFO: main: starting shard=4 2024-09-12T00:05:41.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.742+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:41.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.742+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.742+0000 7f36b0f22800 20 INFO: main: starting shard=5 2024-09-12T00:05:41.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.742+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:41.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.743+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.743+0000 7f36b0f22800 20 INFO: main: starting shard=6 2024-09-12T00:05:41.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.743+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:41.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.744+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.744+0000 7f36b0f22800 20 INFO: main: starting shard=7 2024-09-12T00:05:41.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.744+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:41.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.744+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.744+0000 7f36b0f22800 20 INFO: main: starting shard=8 2024-09-12T00:05:41.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.744+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:41.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.745+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.745+0000 7f36b0f22800 20 INFO: main: starting shard=9 2024-09-12T00:05:41.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.745+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:41.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.745+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.745+0000 7f36b0f22800 20 INFO: main: starting shard=10 2024-09-12T00:05:41.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.745+0000 7f36b0f22800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:41.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.746+0000 7f36b0f22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.746+0000 7f36b0f22800 20 INFO: main: done 2024-09-12T00:05:41.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.746+0000 7f3562fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:41.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.749+0000 7f36b0f22800 20 remove_watcher() i=0 2024-09-12T00:05:41.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.749+0000 7f36b0f22800 2 removed watcher, disabling cache 2024-09-12T00:05:41.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.750+0000 7f36b0f22800 20 remove_watcher() i=1 2024-09-12T00:05:41.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.751+0000 7f36b0f22800 20 remove_watcher() i=2 2024-09-12T00:05:41.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.753+0000 7f36b0f22800 20 remove_watcher() i=3 2024-09-12T00:05:41.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.753+0000 7f36b0f22800 20 remove_watcher() i=4 2024-09-12T00:05:41.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.755+0000 7f36b0f22800 20 remove_watcher() i=5 2024-09-12T00:05:41.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.756+0000 7f36b0f22800 20 remove_watcher() i=6 2024-09-12T00:05:41.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.757+0000 7f36b0f22800 20 remove_watcher() i=7 2024-09-12T00:05:41.769 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:05:41.800 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:41.801 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:41.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.841+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.843+0000 7f15b4b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.843+0000 7f15b4b23800 20 realm 2024-09-12T00:05:41.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.843+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.843+0000 7f15b4b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.843+0000 7f15b4b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:41.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.843+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.843+0000 7f15b4b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.843+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.844+0000 7f15b4b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.844+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.845+0000 7f15b4b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:41.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.845+0000 7f15b4b23800 20 searching for the correct realm 2024-09-12T00:05:41.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.848+0000 7f15b100d640 0 -- 172.21.15.33:0/802880041 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x5645cc840b70 msgr2=0x5645cc843030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:05:41.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.852+0000 7f15b080c640 0 -- 172.21.15.33:0/802880041 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f15a4077920 msgr2=0x7f15a409c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:41.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:41.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:41.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:41.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:41.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:41.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:41.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.856+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 zone default found 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 4 Realm: () 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 zonegroup default 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.857+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.858+0000 7f15b4b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.858+0000 7f15b4b23800 20 started sync module instance, tier type = 2024-09-12T00:05:41.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.858+0000 7f15b4b23800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:41.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.867+0000 7f15b4b23800 20 add_watcher() i=0 2024-09-12T00:05:41.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.867+0000 7f15b4b23800 20 add_watcher() i=1 2024-09-12T00:05:41.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.867+0000 7f15b4b23800 20 add_watcher() i=2 2024-09-12T00:05:41.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.867+0000 7f15b4b23800 20 add_watcher() i=3 2024-09-12T00:05:41.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.867+0000 7f15b4b23800 20 add_watcher() i=4 2024-09-12T00:05:41.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.869+0000 7f15b4b23800 20 add_watcher() i=5 2024-09-12T00:05:41.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.872+0000 7f15b4b23800 20 add_watcher() i=6 2024-09-12T00:05:41.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.872+0000 7f15b4b23800 20 add_watcher() i=7 2024-09-12T00:05:41.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.872+0000 7f15b4b23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:41.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.873+0000 7f1466fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:41.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.874+0000 7f15b4b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:41.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.874+0000 7f15b4b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:41.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.874+0000 7f15b4b23800 5 note: GC not initialized 2024-09-12T00:05:41.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.874+0000 7f1465fe3640 20 reqs_thread_entry: start 2024-09-12T00:05:41.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.874+0000 7f15b4b23800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:41.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.874+0000 7f15b4b23800 20 Filter name: none 2024-09-12T00:05:41.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.874+0000 7f13d77fe640 20 reqs_thread_entry: start 2024-09-12T00:05:41.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.874+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.875+0000 7f15b4b23800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.875+0000 7f15b4b23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.875+0000 7f15b4b23800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.875+0000 7f15b4b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.875+0000 7f15b4b23800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.875+0000 7f15b4b23800 20 INFO: main: starting shard=0 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.875+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.876+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.876+0000 7f15b4b23800 20 INFO: main: starting shard=1 2024-09-12T00:05:41.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.876+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.876+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.876+0000 7f15b4b23800 20 INFO: main: starting shard=2 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.876+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.877+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.877+0000 7f15b4b23800 20 INFO: main: starting shard=3 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.877+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.877+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.877+0000 7f15b4b23800 20 INFO: main: starting shard=4 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.877+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:41.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.878+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.878+0000 7f15b4b23800 20 INFO: main: starting shard=5 2024-09-12T00:05:41.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.878+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:41.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.878+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.878+0000 7f15b4b23800 20 INFO: main: starting shard=6 2024-09-12T00:05:41.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.878+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.879+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.879+0000 7f15b4b23800 20 INFO: main: starting shard=7 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.879+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.879+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.879+0000 7f15b4b23800 20 INFO: main: starting shard=8 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.879+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.880+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.880+0000 7f15b4b23800 20 INFO: main: starting shard=9 2024-09-12T00:05:41.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.880+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:41.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.881+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.881+0000 7f15b4b23800 20 INFO: main: starting shard=10 2024-09-12T00:05:41.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.881+0000 7f15b4b23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:41.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.881+0000 7f15b4b23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:41.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.881+0000 7f15b4b23800 20 INFO: main: done 2024-09-12T00:05:41.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.882+0000 7f1466fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:41.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.884+0000 7f15b4b23800 20 remove_watcher() i=0 2024-09-12T00:05:41.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.884+0000 7f15b4b23800 2 removed watcher, disabling cache 2024-09-12T00:05:41.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.885+0000 7f15b4b23800 20 remove_watcher() i=1 2024-09-12T00:05:41.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.887+0000 7f15b4b23800 20 remove_watcher() i=2 2024-09-12T00:05:41.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.888+0000 7f15b4b23800 20 remove_watcher() i=3 2024-09-12T00:05:41.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.889+0000 7f15b4b23800 20 remove_watcher() i=4 2024-09-12T00:05:41.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.891+0000 7f15b4b23800 20 remove_watcher() i=5 2024-09-12T00:05:41.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.893+0000 7f15b4b23800 20 remove_watcher() i=6 2024-09-12T00:05:41.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.894+0000 7f15b4b23800 20 remove_watcher() i=7 2024-09-12T00:05:41.904 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:05:41.904 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:41.906 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:05:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:41.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.978+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.980+0000 7fbf08b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.980+0000 7fbf08b3e800 20 realm 2024-09-12T00:05:41.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.980+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.980+0000 7fbf08b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.980+0000 7fbf08b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:41.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.980+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.980+0000 7fbf08b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:41.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.980+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.981+0000 7fbf08b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:41.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.981+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:41.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.982+0000 7fbf08b3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:41.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.982+0000 7fbf08b3e800 20 searching for the correct realm 2024-09-12T00:05:41.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.984+0000 7fbf040bf640 0 -- 172.21.15.33:0/860560023 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fbef4027020 msgr2=0x7fbef409aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:41.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:41.988+0000 7fbf048c0640 0 -- 172.21.15.33:0/860560023 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fbef8048900 msgr2=0x7fbef8030450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:42.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:42.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:42.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:42.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:42.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:42.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:42.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:42.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:42.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.195+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 zone default found 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 4 Realm: () 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:42.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 zonegroup default 2024-09-12T00:05:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.196+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.197+0000 7fbf08b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.197+0000 7fbf08b3e800 20 started sync module instance, tier type = 2024-09-12T00:05:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.197+0000 7fbf08b3e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:42.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.214+0000 7fbf08b3e800 20 add_watcher() i=0 2024-09-12T00:05:42.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.214+0000 7fbf08b3e800 20 add_watcher() i=1 2024-09-12T00:05:42.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.214+0000 7fbf08b3e800 20 add_watcher() i=2 2024-09-12T00:05:42.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.214+0000 7fbf08b3e800 20 add_watcher() i=3 2024-09-12T00:05:42.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.214+0000 7fbf08b3e800 20 add_watcher() i=4 2024-09-12T00:05:42.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.214+0000 7fbf08b3e800 20 add_watcher() i=5 2024-09-12T00:05:42.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.214+0000 7fbf08b3e800 20 add_watcher() i=6 2024-09-12T00:05:42.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.215+0000 7fbf08b3e800 20 add_watcher() i=7 2024-09-12T00:05:42.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.215+0000 7fbf08b3e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:42.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.217+0000 7fbdbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:42.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.217+0000 7fbf08b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:42.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.217+0000 7fbf08b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:42.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.217+0000 7fbf08b3e800 5 note: GC not initialized 2024-09-12T00:05:42.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.217+0000 7fbdba7e4640 20 reqs_thread_entry: start 2024-09-12T00:05:42.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:42.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 20 Filter name: none 2024-09-12T00:05:42.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbdb3fff640 20 reqs_thread_entry: start 2024-09-12T00:05:42.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:42.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:42.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:42.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:42.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:42.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:42.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:42.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:42.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:42.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:42.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:42.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:42.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.218+0000 7fbf08b3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:42.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.219+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:42.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.219+0000 7fbf08b3e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:05:42.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.219+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.220+0000 7fbf08b3e800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.220+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.220+0000 7fbf08b3e800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.220+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.220+0000 7fbf08b3e800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.220+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.221+0000 7fbf08b3e800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.221+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.221+0000 7fbf08b3e800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:05:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.221+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:42.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.222+0000 7fbf08b3e800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:05:42.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.222+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:42.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.222+0000 7fbf08b3e800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:05:42.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.222+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:42.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.223+0000 7fbf08b3e800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:05:42.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.223+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:42.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.224+0000 7fbf08b3e800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:05:42.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.224+0000 7fbf08b3e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:42.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.224+0000 7fbf08b3e800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:05:42.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.224+0000 7fbf08b3e800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:05:42.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.225+0000 7fbdbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:42.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.227+0000 7fbf08b3e800 20 remove_watcher() i=0 2024-09-12T00:05:42.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.227+0000 7fbf08b3e800 2 removed watcher, disabling cache 2024-09-12T00:05:42.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.228+0000 7fbf08b3e800 20 remove_watcher() i=1 2024-09-12T00:05:42.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.229+0000 7fbf08b3e800 20 remove_watcher() i=2 2024-09-12T00:05:42.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.230+0000 7fbf08b3e800 20 remove_watcher() i=3 2024-09-12T00:05:42.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.232+0000 7fbf08b3e800 20 remove_watcher() i=4 2024-09-12T00:05:42.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.233+0000 7fbf08b3e800 20 remove_watcher() i=5 2024-09-12T00:05:42.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.234+0000 7fbf08b3e800 20 remove_watcher() i=6 2024-09-12T00:05:42.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:42.235+0000 7fbf08b3e800 20 remove_watcher() i=7 2024-09-12T00:05:42.244 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:05:42.244 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:42.247 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.247 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.271 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.271 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.295 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.295 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.367 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:05:42.367 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:05:42.368 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.368 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.441 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.444 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.650 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.705 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.705 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.730 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.730 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.781 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.781 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.806 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.806 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.857 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.857 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.882 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.882 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.937 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.937 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:42.961 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:42.961 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:43.012 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:43.012 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:43.038 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:43.038 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:43.091 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:43.092 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:43.117 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:05:43.521 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:05:44.930 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:44.931 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:45.017 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:05:45.018 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:05:45.052 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:45.052 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:45.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.098+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.099+0000 7efc3cb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.099+0000 7efc3cb31800 20 realm 2024-09-12T00:05:45.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.099+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.099+0000 7efc3cb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.099+0000 7efc3cb31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:45.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.099+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.100+0000 7efc3cb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.100+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.100+0000 7efc3cb31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:45.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.101+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.101+0000 7efc3cb31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:45.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.101+0000 7efc3cb31800 20 searching for the correct realm 2024-09-12T00:05:45.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.104+0000 7efc38075640 0 -- 172.21.15.33:0/1655287205 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x56043137d120 msgr2=0x56043137f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:45.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.108+0000 7efc38876640 0 -- 172.21.15.33:0/1655287205 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7efc2c0695e0 msgr2=0x7efc2c08f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:45.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:45.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:45.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:45.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:45.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:45.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:45.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.315+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 20 zone default found 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 4 Realm: () 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 20 zonegroup default 2024-09-12T00:05:45.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.316+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.317+0000 7efc3cb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.317+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.317+0000 7efc3cb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.317+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.317+0000 7efc3cb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.317+0000 7efc3cb31800 20 started sync module instance, tier type = 2024-09-12T00:05:45.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.317+0000 7efc3cb31800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:45.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.333+0000 7efc3cb31800 20 add_watcher() i=0 2024-09-12T00:05:45.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.333+0000 7efc3cb31800 20 add_watcher() i=1 2024-09-12T00:05:45.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.333+0000 7efc3cb31800 20 add_watcher() i=2 2024-09-12T00:05:45.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.333+0000 7efc3cb31800 20 add_watcher() i=3 2024-09-12T00:05:45.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.333+0000 7efc3cb31800 20 add_watcher() i=4 2024-09-12T00:05:45.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.333+0000 7efc3cb31800 20 add_watcher() i=5 2024-09-12T00:05:45.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.333+0000 7efc3cb31800 20 add_watcher() i=6 2024-09-12T00:05:45.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.336+0000 7efc3cb31800 20 add_watcher() i=7 2024-09-12T00:05:45.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.336+0000 7efc3cb31800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:45.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.338+0000 7efaeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:45.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.338+0000 7efc3cb31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:45.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.338+0000 7efc3cb31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:45.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.338+0000 7efc3cb31800 5 note: GC not initialized 2024-09-12T00:05:45.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.338+0000 7efaedfe3640 20 reqs_thread_entry: start 2024-09-12T00:05:45.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:45.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 Filter name: none 2024-09-12T00:05:45.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efa5f7fe640 20 reqs_thread_entry: start 2024-09-12T00:05:45.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:45.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:45.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:45.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:45.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 INFO: main: starting shard=0 2024-09-12T00:05:45.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.339+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.340+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.340+0000 7efc3cb31800 20 INFO: main: starting shard=1 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.340+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.341+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.341+0000 7efc3cb31800 20 INFO: main: starting shard=2 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.341+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.341+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.341+0000 7efc3cb31800 20 INFO: main: starting shard=3 2024-09-12T00:05:45.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.341+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:45.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.342+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.342+0000 7efc3cb31800 20 INFO: main: starting shard=4 2024-09-12T00:05:45.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.342+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:45.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.342+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.342+0000 7efc3cb31800 20 INFO: main: starting shard=5 2024-09-12T00:05:45.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.342+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:45.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.343+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.343+0000 7efc3cb31800 20 INFO: main: starting shard=6 2024-09-12T00:05:45.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.343+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:45.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.343+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.343+0000 7efc3cb31800 20 INFO: main: starting shard=7 2024-09-12T00:05:45.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.343+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:45.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.344+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.344+0000 7efc3cb31800 20 INFO: main: starting shard=8 2024-09-12T00:05:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.344+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.344+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:05:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.344+0000 7efc3cb31800 20 INFO: main: starting shard=9 2024-09-12T00:05:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.344+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.345+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.345+0000 7efc3cb31800 20 INFO: main: starting shard=10 2024-09-12T00:05:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.345+0000 7efc3cb31800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.345+0000 7efc3cb31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.345+0000 7efc3cb31800 20 INFO: main: done 2024-09-12T00:05:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.346+0000 7efaeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:45.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.349+0000 7efc3cb31800 20 remove_watcher() i=0 2024-09-12T00:05:45.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.349+0000 7efc3cb31800 2 removed watcher, disabling cache 2024-09-12T00:05:45.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.350+0000 7efc3cb31800 20 remove_watcher() i=1 2024-09-12T00:05:45.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.351+0000 7efc3cb31800 20 remove_watcher() i=2 2024-09-12T00:05:45.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.353+0000 7efc3cb31800 20 remove_watcher() i=3 2024-09-12T00:05:45.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.354+0000 7efc3cb31800 20 remove_watcher() i=4 2024-09-12T00:05:45.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.355+0000 7efc3cb31800 20 remove_watcher() i=5 2024-09-12T00:05:45.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.357+0000 7efc3cb31800 20 remove_watcher() i=6 2024-09-12T00:05:45.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.358+0000 7efc3cb31800 20 remove_watcher() i=7 2024-09-12T00:05:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:45.371 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:45.395 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:45.395 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:45.478 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:05:45.479 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:05:45.513 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:45.513 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:45.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.555+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.557+0000 7fe80a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.557+0000 7fe80a12e800 20 realm 2024-09-12T00:05:45.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.557+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.557+0000 7fe80a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.557+0000 7fe80a12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:45.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.557+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.557+0000 7fe80a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.557+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.558+0000 7fe80a12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:45.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.558+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.560+0000 7fe80a12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:45.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.560+0000 7fe80a12e800 20 searching for the correct realm 2024-09-12T00:05:45.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.561+0000 7fe805edd640 0 -- 172.21.15.33:0/3778725334 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fe7f00082a0 msgr2=0x7fe800065b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:45.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.563+0000 7fe8056dc640 0 -- 172.21.15.33:0/3778725334 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x5609f5c5bff0 msgr2=0x5609f5c5e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:05:45.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:45.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:45.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:45.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:45.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:45.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:45.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.572+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:45.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:45.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 20 zone default found 2024-09-12T00:05:45.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 4 Realm: () 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 20 zonegroup default 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.573+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.574+0000 7fe80a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.574+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.574+0000 7fe80a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.574+0000 7fe80a12e800 20 started sync module instance, tier type = 2024-09-12T00:05:45.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.574+0000 7fe80a12e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:45.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.588+0000 7fe80a12e800 20 add_watcher() i=0 2024-09-12T00:05:45.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.588+0000 7fe80a12e800 20 add_watcher() i=1 2024-09-12T00:05:45.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.588+0000 7fe80a12e800 20 add_watcher() i=2 2024-09-12T00:05:45.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.588+0000 7fe80a12e800 20 add_watcher() i=3 2024-09-12T00:05:45.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.588+0000 7fe80a12e800 20 add_watcher() i=4 2024-09-12T00:05:45.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.588+0000 7fe80a12e800 20 add_watcher() i=5 2024-09-12T00:05:45.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.588+0000 7fe80a12e800 20 add_watcher() i=6 2024-09-12T00:05:45.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.589+0000 7fe80a12e800 20 add_watcher() i=7 2024-09-12T00:05:45.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.589+0000 7fe80a12e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:45.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.591+0000 7fe6b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:45.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.592+0000 7fe80a12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:45.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.592+0000 7fe80a12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:45.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.592+0000 7fe80a12e800 5 note: GC not initialized 2024-09-12T00:05:45.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.592+0000 7fe6b67fc640 20 reqs_thread_entry: start 2024-09-12T00:05:45.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.592+0000 7fe80a12e800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:45.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.592+0000 7fe80a12e800 20 Filter name: none 2024-09-12T00:05:45.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.592+0000 7fe627fff640 20 reqs_thread_entry: start 2024-09-12T00:05:45.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.592+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.593+0000 7fe80a12e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:45.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.593+0000 7fe80a12e800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.593+0000 7fe80a12e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:45.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.593+0000 7fe80a12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:45.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.593+0000 7fe80a12e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:45.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.593+0000 7fe80a12e800 20 INFO: main: starting shard=0 2024-09-12T00:05:45.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.593+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:45.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.594+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.594+0000 7fe80a12e800 20 INFO: main: starting shard=1 2024-09-12T00:05:45.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.594+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:45.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.594+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.594+0000 7fe80a12e800 20 INFO: main: starting shard=2 2024-09-12T00:05:45.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.594+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:45.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.595+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.595+0000 7fe80a12e800 20 INFO: main: starting shard=3 2024-09-12T00:05:45.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.595+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:45.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.595+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.595+0000 7fe80a12e800 20 INFO: main: starting shard=4 2024-09-12T00:05:45.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.595+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:45.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.596+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.596+0000 7fe80a12e800 20 INFO: main: starting shard=5 2024-09-12T00:05:45.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.596+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:45.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.596+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:05:45.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.596+0000 7fe80a12e800 20 INFO: main: starting shard=6 2024-09-12T00:05:45.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.596+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:45.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.597+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.597+0000 7fe80a12e800 20 INFO: main: starting shard=7 2024-09-12T00:05:45.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.597+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:45.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.598+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.598+0000 7fe80a12e800 20 INFO: main: starting shard=8 2024-09-12T00:05:45.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.598+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:45.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.598+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.598+0000 7fe80a12e800 20 INFO: main: starting shard=9 2024-09-12T00:05:45.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.598+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:45.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.599+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.599+0000 7fe80a12e800 20 INFO: main: starting shard=10 2024-09-12T00:05:45.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.599+0000 7fe80a12e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:45.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.600+0000 7fe80a12e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:45.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.600+0000 7fe80a12e800 20 INFO: main: done 2024-09-12T00:05:45.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.600+0000 7fe6b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:45.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.603+0000 7fe80a12e800 20 remove_watcher() i=0 2024-09-12T00:05:45.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.603+0000 7fe80a12e800 2 removed watcher, disabling cache 2024-09-12T00:05:45.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.604+0000 7fe80a12e800 20 remove_watcher() i=1 2024-09-12T00:05:45.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.606+0000 7fe80a12e800 20 remove_watcher() i=2 2024-09-12T00:05:45.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.607+0000 7fe80a12e800 20 remove_watcher() i=3 2024-09-12T00:05:45.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.608+0000 7fe80a12e800 20 remove_watcher() i=4 2024-09-12T00:05:45.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.609+0000 7fe80a12e800 20 remove_watcher() i=5 2024-09-12T00:05:45.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.610+0000 7fe80a12e800 20 remove_watcher() i=6 2024-09-12T00:05:45.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.611+0000 7fe80a12e800 20 remove_watcher() i=7 2024-09-12T00:05:45.623 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:45.624 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:45.647 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:45.647 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:45.729 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:05:45.730 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:05:45.761 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:45.762 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:45.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.802+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.804+0000 7f00cfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.804+0000 7f00cfc0f800 20 realm 2024-09-12T00:05:45.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.804+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.805+0000 7f00cfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.805+0000 7f00cfc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:45.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.805+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.805+0000 7f00cfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:45.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.805+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.806+0000 7f00cfc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:45.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.806+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:45.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.807+0000 7f00cfc0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:45.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.807+0000 7f00cfc0f800 20 searching for the correct realm 2024-09-12T00:05:45.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.809+0000 7f00cd700640 0 -- 172.21.15.33:0/3819802084 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f00c8073070 msgr2=0x7f00c80e5ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:45.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:45.813+0000 7f00cd700640 0 -- 172.21.15.33:0/3819802084 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f00c4047960 msgr2=0x7f00c4035410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:46.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:46.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:46.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:46.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:46.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:46.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:46.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:46.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.020+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:46.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 20 zone default found 2024-09-12T00:05:46.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 4 Realm: () 2024-09-12T00:05:46.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 20 zonegroup default 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.021+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.022+0000 7f00cfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.022+0000 7f00cfc0f800 20 started sync module instance, tier type = 2024-09-12T00:05:46.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.022+0000 7f00cfc0f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:46.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.039+0000 7f00cfc0f800 20 add_watcher() i=0 2024-09-12T00:05:46.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.039+0000 7f00cfc0f800 20 add_watcher() i=1 2024-09-12T00:05:46.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.039+0000 7f00cfc0f800 20 add_watcher() i=2 2024-09-12T00:05:46.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.039+0000 7f00cfc0f800 20 add_watcher() i=3 2024-09-12T00:05:46.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.039+0000 7f00cfc0f800 20 add_watcher() i=4 2024-09-12T00:05:46.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.039+0000 7f00cfc0f800 20 add_watcher() i=5 2024-09-12T00:05:46.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.039+0000 7f00cfc0f800 20 add_watcher() i=6 2024-09-12T00:05:46.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.042+0000 7f00cfc0f800 20 add_watcher() i=7 2024-09-12T00:05:46.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.042+0000 7f00cfc0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:46.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.044+0000 7eff83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:46.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.044+0000 7f00cfc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:46.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.044+0000 7f00cfc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:46.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.044+0000 7f00cfc0f800 5 note: GC not initialized 2024-09-12T00:05:46.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.044+0000 7eff82fe5640 20 reqs_thread_entry: start 2024-09-12T00:05:46.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.044+0000 7f00cfc0f800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:46.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.044+0000 7f00cfc0f800 20 Filter name: none 2024-09-12T00:05:46.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.044+0000 7eff80fe1640 20 reqs_thread_entry: start 2024-09-12T00:05:46.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.045+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.045+0000 7f00cfc0f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.045+0000 7f00cfc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.045+0000 7f00cfc0f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.045+0000 7f00cfc0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.045+0000 7f00cfc0f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.045+0000 7f00cfc0f800 20 INFO: main: starting shard=0 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.045+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.046+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.046+0000 7f00cfc0f800 20 INFO: main: starting shard=1 2024-09-12T00:05:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.046+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:46.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.047+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:05:46.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.047+0000 7f00cfc0f800 20 INFO: main: starting shard=2 2024-09-12T00:05:46.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.047+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:46.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.047+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.047+0000 7f00cfc0f800 20 INFO: main: starting shard=3 2024-09-12T00:05:46.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.047+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:46.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 INFO: main: starting shard=4 2024-09-12T00:05:46.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:46.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 INFO: main: starting shard=5 2024-09-12T00:05:46.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:46.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 INFO: main: starting shard=6 2024-09-12T00:05:46.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.048+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.049+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.049+0000 7f00cfc0f800 20 INFO: main: starting shard=7 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.049+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.050+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.050+0000 7f00cfc0f800 20 INFO: main: starting shard=8 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.050+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.050+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.050+0000 7f00cfc0f800 20 INFO: main: starting shard=9 2024-09-12T00:05:46.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.050+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:46.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.051+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.051+0000 7f00cfc0f800 20 INFO: main: starting shard=10 2024-09-12T00:05:46.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.051+0000 7f00cfc0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:46.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.051+0000 7f00cfc0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.051+0000 7f00cfc0f800 20 INFO: main: done 2024-09-12T00:05:46.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.052+0000 7eff83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:46.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.055+0000 7f00cfc0f800 20 remove_watcher() i=0 2024-09-12T00:05:46.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.055+0000 7f00cfc0f800 2 removed watcher, disabling cache 2024-09-12T00:05:46.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.056+0000 7f00cfc0f800 20 remove_watcher() i=1 2024-09-12T00:05:46.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.057+0000 7f00cfc0f800 20 remove_watcher() i=2 2024-09-12T00:05:46.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.058+0000 7f00cfc0f800 20 remove_watcher() i=3 2024-09-12T00:05:46.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.060+0000 7f00cfc0f800 20 remove_watcher() i=4 2024-09-12T00:05:46.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.061+0000 7f00cfc0f800 20 remove_watcher() i=5 2024-09-12T00:05:46.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.062+0000 7f00cfc0f800 20 remove_watcher() i=6 2024-09-12T00:05:46.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.063+0000 7f00cfc0f800 20 remove_watcher() i=7 2024-09-12T00:05:46.077 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:46.077 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:46.100 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:46.100 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:46.183 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:05:46.184 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:05:46.217 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:46.217 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:46.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.259+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.261+0000 7f8840946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.261+0000 7f8840946800 20 realm 2024-09-12T00:05:46.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.261+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.261+0000 7f8840946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.261+0000 7f8840946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:46.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.261+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.261+0000 7f8840946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.261+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.262+0000 7f8840946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:46.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.262+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.263+0000 7f8840946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:46.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.263+0000 7f8840946800 20 searching for the correct realm 2024-09-12T00:05:46.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.265+0000 7f883e437640 0 -- 172.21.15.33:0/3980387722 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f8838061dd0 msgr2=0x7f8838060840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:05:46.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.270+0000 7f883e437640 0 -- 172.21.15.33:0/3980387722 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f8834094020 msgr2=0x7f8834057290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:46.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.476+0000 7f8840946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:46.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.476+0000 7f8840946800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:46.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.476+0000 7f8840946800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:46.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.476+0000 7f8840946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:46.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.476+0000 7f8840946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:46.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.476+0000 7f8840946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:46.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.476+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:46.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 20 zone default found 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 4 Realm: () 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 20 zonegroup default 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.477+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.478+0000 7f8840946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.478+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.478+0000 7f8840946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.478+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.478+0000 7f8840946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:46.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.478+0000 7f8840946800 20 started sync module instance, tier type = 2024-09-12T00:05:46.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.478+0000 7f8840946800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:46.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.495+0000 7f8840946800 20 add_watcher() i=0 2024-09-12T00:05:46.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.495+0000 7f8840946800 20 add_watcher() i=1 2024-09-12T00:05:46.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.495+0000 7f8840946800 20 add_watcher() i=2 2024-09-12T00:05:46.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.495+0000 7f8840946800 20 add_watcher() i=3 2024-09-12T00:05:46.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.495+0000 7f8840946800 20 add_watcher() i=4 2024-09-12T00:05:46.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.495+0000 7f8840946800 20 add_watcher() i=5 2024-09-12T00:05:46.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.495+0000 7f8840946800 20 add_watcher() i=6 2024-09-12T00:05:46.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.497+0000 7f8840946800 20 add_watcher() i=7 2024-09-12T00:05:46.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.497+0000 7f8840946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:46.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.499+0000 7f86f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:46.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.499+0000 7f8840946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:46.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.499+0000 7f8840946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:46.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.500+0000 7f8840946800 5 note: GC not initialized 2024-09-12T00:05:46.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.500+0000 7f866f7fe640 20 reqs_thread_entry: start 2024-09-12T00:05:46.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.500+0000 7f8840946800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:46.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.500+0000 7f8840946800 20 Filter name: none 2024-09-12T00:05:46.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.500+0000 7f866d7fa640 20 reqs_thread_entry: start 2024-09-12T00:05:46.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.500+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.500+0000 7f8840946800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:46.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.500+0000 7f8840946800 20 rados->read ofs=0 len=0 2024-09-12T00:05:46.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.501+0000 7f8840946800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:46.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.501+0000 7f8840946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:46.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.501+0000 7f8840946800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:05:46.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.501+0000 7f8840946800 20 INFO: main: starting shard=0 2024-09-12T00:05:46.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.501+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:46.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.502+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.502+0000 7f8840946800 20 INFO: main: starting shard=1 2024-09-12T00:05:46.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.502+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:46.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.502+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.502+0000 7f8840946800 20 INFO: main: starting shard=2 2024-09-12T00:05:46.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.502+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:46.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.503+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.503+0000 7f8840946800 20 INFO: main: starting shard=3 2024-09-12T00:05:46.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.503+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:46.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.503+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.503+0000 7f8840946800 20 INFO: main: starting shard=4 2024-09-12T00:05:46.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.503+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:46.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.504+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.504+0000 7f8840946800 20 INFO: main: starting shard=5 2024-09-12T00:05:46.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.504+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:46.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.504+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.504+0000 7f8840946800 20 INFO: main: starting shard=6 2024-09-12T00:05:46.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.504+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:46.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.505+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.505+0000 7f8840946800 20 INFO: main: starting shard=7 2024-09-12T00:05:46.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.505+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:46.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.505+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.506+0000 7f8840946800 20 INFO: main: starting shard=8 2024-09-12T00:05:46.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.506+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:46.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.506+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.506+0000 7f8840946800 20 INFO: main: starting shard=9 2024-09-12T00:05:46.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.506+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:46.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.507+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:05:46.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.507+0000 7f8840946800 20 INFO: main: starting shard=10 2024-09-12T00:05:46.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.507+0000 7f8840946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:46.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.507+0000 7f8840946800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:05:46.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.507+0000 7f8840946800 20 INFO: main: done 2024-09-12T00:05:46.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.508+0000 7f86f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:46.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.511+0000 7f8840946800 20 remove_watcher() i=0 2024-09-12T00:05:46.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.511+0000 7f8840946800 2 removed watcher, disabling cache 2024-09-12T00:05:46.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.512+0000 7f8840946800 20 remove_watcher() i=1 2024-09-12T00:05:46.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.513+0000 7f8840946800 20 remove_watcher() i=2 2024-09-12T00:05:46.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.514+0000 7f8840946800 20 remove_watcher() i=3 2024-09-12T00:05:46.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.515+0000 7f8840946800 20 remove_watcher() i=4 2024-09-12T00:05:46.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.516+0000 7f8840946800 20 remove_watcher() i=5 2024-09-12T00:05:46.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.517+0000 7f8840946800 20 remove_watcher() i=6 2024-09-12T00:05:46.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:46.518+0000 7f8840946800 20 remove_watcher() i=7 2024-09-12T00:05:46.530 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:46.530 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:46.554 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:05:46.986 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:05:47.405 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:05:47.435 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:47.435 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:47.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.477+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.479+0000 7f8180a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.479+0000 7f8180a13800 20 realm 2024-09-12T00:05:47.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.479+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.479+0000 7f8180a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.479+0000 7f8180a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:47.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.479+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.479+0000 7f8180a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.479+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.480+0000 7f8180a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:47.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.480+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.481+0000 7f8180a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:47.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.481+0000 7f8180a13800 20 searching for the correct realm 2024-09-12T00:05:47.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.484+0000 7f817c949640 0 -- 172.21.15.33:0/2191842426 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x5626ca71b480 msgr2=0x5626ca71d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:05:47.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.488+0000 7f817c148640 0 -- 172.21.15.33:0/2191842426 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f8170001c20 msgr2=0x7f81700a00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.493+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 20 zone default found 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 4 Realm: () 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 20 zonegroup default 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.494+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.495+0000 7f8180a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.495+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.495+0000 7f8180a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.495+0000 7f8180a13800 20 started sync module instance, tier type = 2024-09-12T00:05:47.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.495+0000 7f8180a13800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:47.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.506+0000 7f8180a13800 20 add_watcher() i=0 2024-09-12T00:05:47.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.506+0000 7f8180a13800 20 add_watcher() i=1 2024-09-12T00:05:47.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.506+0000 7f8180a13800 20 add_watcher() i=2 2024-09-12T00:05:47.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.506+0000 7f8180a13800 20 add_watcher() i=3 2024-09-12T00:05:47.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.506+0000 7f8180a13800 20 add_watcher() i=4 2024-09-12T00:05:47.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.506+0000 7f8180a13800 20 add_watcher() i=5 2024-09-12T00:05:47.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.507+0000 7f8180a13800 20 add_watcher() i=6 2024-09-12T00:05:47.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.507+0000 7f8180a13800 20 add_watcher() i=7 2024-09-12T00:05:47.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.507+0000 7f8180a13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:47.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.509+0000 7f8032fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:47.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f8180a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:47.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f8180a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:47.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f8180a13800 5 note: GC not initialized 2024-09-12T00:05:47.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f8031fdb640 20 reqs_thread_entry: start 2024-09-12T00:05:47.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f8180a13800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f8180a13800 20 Filter name: none 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f7fa37fe640 20 reqs_thread_entry: start 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f8180a13800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.510+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:47.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:47.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:47.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:47.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:47.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:47.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:47.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.511+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:47.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.512+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:47.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.512+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:47.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.513+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:47.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.513+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:47.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.514+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.514+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:47.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.515+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:47.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.515+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.516+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:47.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.517+0000 7f8180a13800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:47.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.525+0000 7f8032fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:47.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.528+0000 7f8180a13800 20 remove_watcher() i=0 2024-09-12T00:05:47.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.528+0000 7f8180a13800 2 removed watcher, disabling cache 2024-09-12T00:05:47.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.529+0000 7f8180a13800 20 remove_watcher() i=1 2024-09-12T00:05:47.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.530+0000 7f8180a13800 20 remove_watcher() i=2 2024-09-12T00:05:47.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.531+0000 7f8180a13800 20 remove_watcher() i=3 2024-09-12T00:05:47.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.532+0000 7f8180a13800 20 remove_watcher() i=4 2024-09-12T00:05:47.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.533+0000 7f8180a13800 20 remove_watcher() i=5 2024-09-12T00:05:47.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.534+0000 7f8180a13800 20 remove_watcher() i=6 2024-09-12T00:05:47.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.535+0000 7f8180a13800 20 remove_watcher() i=7 2024-09-12T00:05:47.547 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:05:47.583 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:47.583 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:47.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.624+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.625+0000 7f7673f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.625+0000 7f7673f23800 20 realm 2024-09-12T00:05:47.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.625+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.625+0000 7f7673f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.625+0000 7f7673f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:47.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.625+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.625+0000 7f7673f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.625+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.627+0000 7f7673f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:47.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.627+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.628+0000 7f7673f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:47.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.628+0000 7f7673f23800 20 searching for the correct realm 2024-09-12T00:05:47.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.631+0000 7f767040d640 0 -- 172.21.15.33:0/296602571 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5625319cf650 msgr2=0x5625319d1b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:47.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.635+0000 7f766fc0c640 0 -- 172.21.15.33:0/296602571 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f7658030410 msgr2=0x7f7658030890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.639+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 20 zone default found 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 4 Realm: () 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 20 zonegroup default 2024-09-12T00:05:47.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.640+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.641+0000 7f7673f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.641+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.641+0000 7f7673f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:47.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.641+0000 7f7673f23800 20 started sync module instance, tier type = 2024-09-12T00:05:47.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.641+0000 7f7673f23800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:47.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.654+0000 7f7673f23800 20 add_watcher() i=0 2024-09-12T00:05:47.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.654+0000 7f7673f23800 20 add_watcher() i=1 2024-09-12T00:05:47.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.654+0000 7f7673f23800 20 add_watcher() i=2 2024-09-12T00:05:47.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.654+0000 7f7673f23800 20 add_watcher() i=3 2024-09-12T00:05:47.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.654+0000 7f7673f23800 20 add_watcher() i=4 2024-09-12T00:05:47.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.654+0000 7f7673f23800 20 add_watcher() i=5 2024-09-12T00:05:47.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.657+0000 7f7673f23800 20 add_watcher() i=6 2024-09-12T00:05:47.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.657+0000 7f7673f23800 20 add_watcher() i=7 2024-09-12T00:05:47.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.657+0000 7f7673f23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:47.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.658+0000 7f7525fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f7673f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f7673f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f7673f23800 5 note: GC not initialized 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f7524fe1640 20 reqs_thread_entry: start 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f7673f23800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f7673f23800 20 Filter name: none 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f749e7fc640 20 reqs_thread_entry: start 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f7673f23800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:05:47.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.659+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:47.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:05:47.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:05:47.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 : miss 2024-09-12T00:05:47.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 20 rados->read ofs=0 len=0 2024-09-12T00:05:47.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:47.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 info.flags=0x17 2024-09-12T00:05:47.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 to cache LRU end 2024-09-12T00:05:47.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:05:47.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:05:47.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2 2024-09-12T00:05:47.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.660+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.0 2024-09-12T00:05:47.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.661+0000 7f7673f23800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:05:47.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.661+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:47.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.662+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.2 2024-09-12T00:05:47.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.662+0000 7f7673f23800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:05:47.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.662+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.3 2024-09-12T00:05:47.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.662+0000 7f7673f23800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:05:47.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.662+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.4 2024-09-12T00:05:47.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.663+0000 7f7673f23800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:05:47.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.663+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.663+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.6 2024-09-12T00:05:47.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.664+0000 7f7673f23800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:05:47.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.664+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.7 2024-09-12T00:05:47.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.665+0000 7f7673f23800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:05:47.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.665+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.665+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.9 2024-09-12T00:05:47.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.666+0000 7f7673f23800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:05:47.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.666+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:47.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.666+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:47.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.667+0000 7f7673f23800 20 get_obj_state: octx=0x562531737690 obj=check-bucket:e state=0x562531a017c8 s->prefetch_data=0 2024-09-12T00:05:47.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.667+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.667+0000 7f7673f23800 20 get_obj_state: octx=0x562531760170 obj=check-bucket:d state=0x562531a00368 s->prefetch_data=0 2024-09-12T00:05:47.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.667+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.667+0000 7f7673f23800 20 get_obj_state: octx=0x5625319fcbc0 obj=check-bucket:c state=0x5625319fbe98 s->prefetch_data=0 2024-09-12T00:05:47.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.667+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:47.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.667+0000 7f7673f23800 20 get_obj_state: octx=0x5625319feec0 obj=check-bucket:f state=0x562531a9ae48 s->prefetch_data=0 2024-09-12T00:05:47.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 get_obj_state: setting s->obj_tag to 47xnjyzhc3c26d1x5u4v01w6qmohlgpn 2024-09-12T00:05:47.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 get_obj_state_impl: setting s->olh_tag to r0f10054ejs1w8ryt14hwku0no7nzf9w 2024-09-12T00:05:47.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=r0f10054ejs1w8ryt14hwku0no7nzf9w 2024-09-12T00:05:47.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 get_obj_state: setting s->obj_tag to pcngzg1tvka3rxs4opbvlo2l3jfy068b 2024-09-12T00:05:47.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 get_obj_state_impl: setting s->olh_tag to b55szb6ch1p1hjndf28xe0us6bmuob3t 2024-09-12T00:05:47.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=b55szb6ch1p1hjndf28xe0us6bmuob3t 2024-09-12T00:05:47.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 get_obj_state: setting s->obj_tag to 4zc60d2xkyxfya2iney1jykj03jf8jtw 2024-09-12T00:05:47.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 get_obj_state_impl: setting s->olh_tag to sobdh2tv9of7huwkxtzk5aal292zmfex 2024-09-12T00:05:47.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sobdh2tv9of7huwkxtzk5aal292zmfex 2024-09-12T00:05:47.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 get_obj_state: setting s->obj_tag to 8n50enzddk4hd61rahv8ze0kjbjk8ktb 2024-09-12T00:05:47.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 get_obj_state_impl: setting s->olh_tag to ivlx6v0z42c9jeoes5wb2s9pkudiphnu 2024-09-12T00:05:47.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.668+0000 7f7673f23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ivlx6v0z42c9jeoes5wb2s9pkudiphnu 2024-09-12T00:05:47.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.669+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.669+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.670+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:47.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.671+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.671+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.671+0000 7f7673f23800 20 olh_log_entry: epoch=3 op=3 key=d[DZd6PES-7NDt5euAwVlWUm5UcoN.Nw8] 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 get_obj_state: octx=0x562531760170 obj=check-bucket:_:DZd6PES-7NDt5euAwVlWUm5UcoN.Nw8_d state=0x562531ab27a8 s->prefetch_data=0 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 olh_log_entry: epoch=3 op=3 key=c[QKlyMnyqUhYQs0raX8zK6SbmkNGWCVX] 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 get_obj_state: octx=0x5625319fcbc0 obj=check-bucket:_:QKlyMnyqUhYQs0raX8zK6SbmkNGWCVX_c state=0x562531ab7348 s->prefetch_data=0 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 10 manifest: total_size = 12 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7948982608198428751 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 get_obj_state: octx=0x562531760170 obj=check-bucket:_:DZd6PES-7NDt5euAwVlWUm5UcoN.Nw8_d state=0x562531ab27a8 s->prefetch_data=0 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 prepare_atomic_modification: state is not atomic. state=0x562531ab27a8 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 10 manifest: total_size = 9 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6460855438024910490 2024-09-12T00:05:47.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 get_obj_state: octx=0x5625319fcbc0 obj=check-bucket:_:QKlyMnyqUhYQs0raX8zK6SbmkNGWCVX_c state=0x562531ab7348 s->prefetch_data=0 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 prepare_atomic_modification: state is not atomic. state=0x562531ab7348 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.672+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.673+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.674+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.675+0000 7f7673f23800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.675+0000 7f7673f23800 20 olh_log_entry: epoch=2 op=3 key=f[SzqDO8Q7KtcGNcSY5btIvcQVtLchjXk] 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.675+0000 7f7673f23800 20 get_obj_state: octx=0x5625319feec0 obj=check-bucket:_:SzqDO8Q7KtcGNcSY5btIvcQVtLchjXk_f state=0x562531ac50a8 s->prefetch_data=0 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.675+0000 7f7673f23800 10 manifest: total_size = 12 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.675+0000 7f7673f23800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2524687202937020341 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.675+0000 7f7673f23800 20 get_obj_state: octx=0x5625319feec0 obj=check-bucket:_:SzqDO8Q7KtcGNcSY5btIvcQVtLchjXk_f state=0x562531ac50a8 s->prefetch_data=0 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.675+0000 7f7673f23800 20 prepare_atomic_modification: state is not atomic. state=0x562531ac50a8 2024-09-12T00:05:47.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.675+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:47.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.678+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:47.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.678+0000 7f7673f23800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:05:47.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.678+0000 7f7673f23800 20 olh_log_entry: epoch=2 op=3 key=e[exwTcrjhoZtQEDhtdA1LTnQQRP3ZOwV] 2024-09-12T00:05:47.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.678+0000 7f7673f23800 20 get_obj_state: octx=0x562531737690 obj=check-bucket:_:exwTcrjhoZtQEDhtdA1LTnQQRP3ZOwV_e state=0x562531ad19e8 s->prefetch_data=0 2024-09-12T00:05:47.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.679+0000 7f7673f23800 10 manifest: total_size = 12 2024-09-12T00:05:47.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.679+0000 7f7673f23800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1820895035638943445 2024-09-12T00:05:47.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.679+0000 7f7673f23800 20 get_obj_state: octx=0x562531737690 obj=check-bucket:_:exwTcrjhoZtQEDhtdA1LTnQQRP3ZOwV_e state=0x562531ad19e8 s->prefetch_data=0 2024-09-12T00:05:47.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.679+0000 7f7673f23800 20 prepare_atomic_modification: state is not atomic. state=0x562531ad19e8 2024-09-12T00:05:47.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.679+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:47.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.680+0000 7f754effd640 20 handle_completion(): completion ok for obj=d[DZd6PES-7NDt5euAwVlWUm5UcoN.Nw8] 2024-09-12T00:05:47.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.683+0000 7f754effd640 20 handle_completion(): completion ok for obj=c[QKlyMnyqUhYQs0raX8zK6SbmkNGWCVX] 2024-09-12T00:05:47.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.683+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.683+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.683+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.683+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.685+0000 7f754e7fc640 20 handle_completion(): completion ok for obj=f[SzqDO8Q7KtcGNcSY5btIvcQVtLchjXk] 2024-09-12T00:05:47.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.685+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.5 2024-09-12T00:05:47.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.685+0000 7f7673f23800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:05:47.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.685+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.8 2024-09-12T00:05:47.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.685+0000 7f7673f23800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:05:47.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.686+0000 7f7673f23800 20 get_obj_state: octx=0x5625319feec0 obj=check-bucket:f state=0x562531a9ae48 s->prefetch_data=0 2024-09-12T00:05:47.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.686+0000 7f7673f23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ivlx6v0z42c9jeoes5wb2s9pkudiphnu 2024-09-12T00:05:47.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.689+0000 7f754effd640 20 handle_completion(): completion ok for obj=e[exwTcrjhoZtQEDhtdA1LTnQQRP3ZOwV] 2024-09-12T00:05:47.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.690+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:47.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.691+0000 7f7673f23800 20 get_obj_state: octx=0x562531737690 obj=check-bucket:e state=0x562531a017c8 s->prefetch_data=0 2024-09-12T00:05:47.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.691+0000 7f7673f23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=b55szb6ch1p1hjndf28xe0us6bmuob3t 2024-09-12T00:05:47.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.693+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.10 2024-09-12T00:05:47.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.693+0000 7f7673f23800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:05:47.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.700+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:47.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.704+0000 7f7673f23800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2.1 2024-09-12T00:05:47.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.704+0000 7f7673f23800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:05:47.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.704+0000 7f7673f23800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:05:47.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.704+0000 7f7525fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:47.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.707+0000 7f7673f23800 20 remove_watcher() i=0 2024-09-12T00:05:47.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.707+0000 7f7673f23800 2 removed watcher, disabling cache 2024-09-12T00:05:47.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.708+0000 7f7673f23800 20 remove_watcher() i=1 2024-09-12T00:05:47.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.709+0000 7f7673f23800 20 remove_watcher() i=2 2024-09-12T00:05:47.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.710+0000 7f7673f23800 20 remove_watcher() i=3 2024-09-12T00:05:47.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.711+0000 7f7673f23800 20 remove_watcher() i=4 2024-09-12T00:05:47.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.713+0000 7f7673f23800 20 remove_watcher() i=5 2024-09-12T00:05:47.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.714+0000 7f7673f23800 20 remove_watcher() i=6 2024-09-12T00:05:47.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:47.715+0000 7f7673f23800 20 remove_watcher() i=7 2024-09-12T00:05:47.727 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:47.727 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:47.765 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:47.769 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:47.938 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:05:47.967 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:05:47.967 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:05:48.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.209+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.211+0000 7f9aa8b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:48.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.211+0000 7f9aa8b46800 20 realm 2024-09-12T00:05:48.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.211+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.211+0000 7f9aa8b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:48.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.211+0000 7f9aa8b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:05:48.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.211+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.211+0000 7f9aa8b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:48.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.211+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.214+0000 7f9aa8b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:48.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.214+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.214+0000 7f9aa8b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:05:48.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.214+0000 7f9aa8b46800 20 searching for the correct realm 2024-09-12T00:05:48.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.216+0000 7f9aa5e36640 0 -- 172.21.15.33:0/4294222949 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f9a9804d700 msgr2=0x7f9a980e4a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:05:48.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.422+0000 7f9aa6637640 0 -- 172.21.15.33:0/4294222949 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f9a9c05ec40 msgr2=0x7f9a9c061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:05:48.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:05:48.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:05:48.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:05:48.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:05:48.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:05:48.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:05:48.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:48.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.630+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 20 zone default found 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 4 Realm: () 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 20 zonegroup default 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:48.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.631+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.632+0000 7f9aa8b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:48.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.632+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.632+0000 7f9aa8b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:05:48.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.632+0000 7f9aa8b46800 20 started sync module instance, tier type = 2024-09-12T00:05:48.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.632+0000 7f9aa8b46800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:05:48.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.643+0000 7f9aa8b46800 20 add_watcher() i=0 2024-09-12T00:05:48.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.643+0000 7f9aa8b46800 20 add_watcher() i=1 2024-09-12T00:05:48.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.643+0000 7f9aa8b46800 20 add_watcher() i=2 2024-09-12T00:05:48.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.643+0000 7f9aa8b46800 20 add_watcher() i=3 2024-09-12T00:05:48.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.643+0000 7f9aa8b46800 20 add_watcher() i=4 2024-09-12T00:05:48.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.643+0000 7f9aa8b46800 20 add_watcher() i=5 2024-09-12T00:05:48.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.643+0000 7f9aa8b46800 20 add_watcher() i=6 2024-09-12T00:05:48.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.644+0000 7f9aa8b46800 20 add_watcher() i=7 2024-09-12T00:05:48.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.644+0000 7f9aa8b46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:05:48.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.645+0000 7f995cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:48.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.646+0000 7f9aa8b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:05:48.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.646+0000 7f9aa8b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:05:48.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.646+0000 7f9aa8b46800 5 note: GC not initialized 2024-09-12T00:05:48.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.646+0000 7f98d77fe640 20 reqs_thread_entry: start 2024-09-12T00:05:48.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.646+0000 7f9aa8b46800 20 init_complete bucket index max shards: 11 2024-09-12T00:05:48.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.646+0000 7f9aa8b46800 20 Filter name: none 2024-09-12T00:05:48.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.646+0000 7f98d57fa640 20 reqs_thread_entry: start 2024-09-12T00:05:48.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.646+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.647+0000 7f9aa8b46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:48.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.647+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.647+0000 7f9aa8b46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:48.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.647+0000 7f9aa8b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:48.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.647+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.648+0000 7f9aa8b46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:05:48.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.648+0000 7f9aa8b46800 20 rados->read ofs=0 len=0 2024-09-12T00:05:48.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.648+0000 7f9aa8b46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:05:48.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.648+0000 7f9aa8b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:05:48.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.651+0000 7f995cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:05:48.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.653+0000 7f9aa8b46800 20 remove_watcher() i=0 2024-09-12T00:05:48.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.653+0000 7f9aa8b46800 2 removed watcher, disabling cache 2024-09-12T00:05:48.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.654+0000 7f9aa8b46800 20 remove_watcher() i=1 2024-09-12T00:05:48.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.655+0000 7f9aa8b46800 20 remove_watcher() i=2 2024-09-12T00:05:48.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.656+0000 7f9aa8b46800 20 remove_watcher() i=3 2024-09-12T00:05:48.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.657+0000 7f9aa8b46800 20 remove_watcher() i=4 2024-09-12T00:05:48.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.658+0000 7f9aa8b46800 20 remove_watcher() i=5 2024-09-12T00:05:48.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.660+0000 7f9aa8b46800 20 remove_watcher() i=6 2024-09-12T00:05:48.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:05:48.661+0000 7f9aa8b46800 20 remove_watcher() i=7 2024-09-12T00:05:48.672 INFO:tasks.workunit.client.0.smithi033.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:05:48.672 INFO:tasks.workunit.client.0.smithi033.stderr:Deleting bucket check-bucket 2024-09-12T00:05:48.673 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:48.673 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:48.707 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:05:48.708 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:05:48.917 INFO:tasks.workunit.client.0.smithi033.stderr:Completed bucket check tests 2024-09-12T00:05:48.917 INFO:tasks.workunit.client.0.smithi033.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:05:48.917 INFO:tasks.workunit.client.0.smithi033.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:05:48.917 INFO:tasks.workunit.client.0.smithi033.stdout:connected to https://localhost:443 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ deactivate 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ export PATH 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n '' ']' 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ hash -r 2024-09-12T00:05:48.981 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n '' ']' 2024-09-12T00:05:48.982 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:05:48.982 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:05:48.982 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset -f deactivate 2024-09-12T00:05:48.982 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo OK. 2024-09-12T00:05:48.983 INFO:tasks.workunit.client.0.smithi033.stdout:OK. 2024-09-12T00:05:48.983 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:05:48.984 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:05:49.025 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:05:49.025 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:05:49.418 DEBUG:teuthology.parallel:result is None 2024-09-12T00:05:49.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:05:49.458 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:05:49.458 DEBUG:teuthology.orchestra.run.smithi033:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:05:49.528 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:05:49.528 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:05:49.583 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:05:49.583 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:05:49.584 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:05:49.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:05:49.614 INFO:teuthology.orchestra.run.smithi033.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:05:49.615 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:05:49.684 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:05:49.684 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:05:49.754 INFO:tasks.workunit:timeout=3h 2024-09-12T00:05:49.754 INFO:tasks.workunit:cleanup=True 2024-09-12T00:05:49.754 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:05:49.825 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:06:35.660 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:06:35.661 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:06:35.661 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:06:35.661 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:06:35.661 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:06:35.661 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:06:35.662 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:06:35.663 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:06:35.663 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:06:35.665 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:06:35.734 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:06:35.737 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:06:35.737 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:06:35.788 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:06:35.840 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:06:35.879 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:06:35.881 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:06:35.881 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:06:35.921 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:06:35.924 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:06:35.924 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:06:35.996 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:06:35.998 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:06:35.999 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:06:36.082 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2024-09-12T00:06:36.082 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:06:36.082 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:06:36.082 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:06:36.082 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:06:37.391 INFO:tasks.workunit.client.0.smithi033.stdout:lock: mylock 2024-09-12T00:06:37.391 INFO:tasks.workunit.client.0.smithi033.stdout: lock_type: exclusive 2024-09-12T00:06:37.391 INFO:tasks.workunit.client.0.smithi033.stdout: tag: 2024-09-12T00:06:37.392 INFO:tasks.workunit.client.0.smithi033.stdout: lockers: 2024-09-12T00:06:37.392 INFO:tasks.workunit.client.0.smithi033.stdout: client.5151 expiration=2024-09-12T00:08:37.389825+0000 addr=v1:172.21.15.33:0/3213050986 cookie= 2024-09-12T00:06:37.395 INFO:tasks.workunit.client.0.smithi033.stdout:lock: mylock 2024-09-12T00:06:37.395 INFO:tasks.workunit.client.0.smithi033.stdout: lock_type: shared 2024-09-12T00:06:37.396 INFO:tasks.workunit.client.0.smithi033.stdout: tag: 2024-09-12T00:06:37.396 INFO:tasks.workunit.client.0.smithi033.stdout: lockers: 2024-09-12T00:06:37.396 INFO:tasks.workunit.client.0.smithi033.stdout: client.5151 expiration=2024-09-12T00:08:37.396687+0000 addr=v1:172.21.15.33:0/3213050986 cookie= 2024-09-12T00:06:37.396 INFO:tasks.workunit.client.0.smithi033.stdout: client.5157 expiration=0.000000 addr=v1:172.21.15.33:0/1927835116 cookie= 2024-09-12T00:06:37.397 INFO:tasks.workunit.client.0.smithi033.stdout:lock: mylock 2024-09-12T00:06:37.397 INFO:tasks.workunit.client.0.smithi033.stdout: lock_type: shared 2024-09-12T00:06:37.397 INFO:tasks.workunit.client.0.smithi033.stdout: tag: 2024-09-12T00:06:37.397 INFO:tasks.workunit.client.0.smithi033.stdout: lockers: 2024-09-12T00:06:37.397 INFO:tasks.workunit.client.0.smithi033.stdout: client.5157 expiration=0.000000 addr=v1:172.21.15.33:0/1927835116 cookie= 2024-09-12T00:06:38.367 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestMultiLocking (2285 ms) 2024-09-12T00:06:38.367 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:06:40.810 INFO:tasks.workunit.client.0.smithi033.stdout:lock: mylock 2024-09-12T00:06:40.810 INFO:tasks.workunit.client.0.smithi033.stdout: lock_type: shared 2024-09-12T00:06:40.810 INFO:tasks.workunit.client.0.smithi033.stdout: tag: 2024-09-12T00:06:40.810 INFO:tasks.workunit.client.0.smithi033.stdout: lockers: 2024-09-12T00:06:40.810 INFO:tasks.workunit.client.0.smithi033.stdout: client.5169 expiration=0.000000 addr=v1:172.21.15.33:0/787082003 cookie= 2024-09-12T00:06:40.813 INFO:tasks.workunit.client.0.smithi033.stdout:lock: mylock 2024-09-12T00:06:40.813 INFO:tasks.workunit.client.0.smithi033.stdout: lock_type: exclusive 2024-09-12T00:06:40.813 INFO:tasks.workunit.client.0.smithi033.stdout: tag: new_tag 2024-09-12T00:06:40.813 INFO:tasks.workunit.client.0.smithi033.stdout: lockers: 2024-09-12T00:06:40.813 INFO:tasks.workunit.client.0.smithi033.stdout: client.5009 expiration=0.000000 addr=v1:172.21.15.33:0/866500319 cookie= 2024-09-12T00:06:41.373 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestMeta (3006 ms) 2024-09-12T00:06:41.374 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:06:43.421 INFO:tasks.workunit.client.0.smithi033.stdout:lock: mylock 2024-09-12T00:06:43.421 INFO:tasks.workunit.client.0.smithi033.stdout: lock_type: exclusive 2024-09-12T00:06:43.421 INFO:tasks.workunit.client.0.smithi033.stdout: tag: 2024-09-12T00:06:43.422 INFO:tasks.workunit.client.0.smithi033.stdout: lockers: 2024-09-12T00:06:43.423 INFO:tasks.workunit.client.0.smithi033.stdout:lock: mylock 2024-09-12T00:06:43.423 INFO:tasks.workunit.client.0.smithi033.stdout: lock_type: shared 2024-09-12T00:06:43.423 INFO:tasks.workunit.client.0.smithi033.stdout: tag: 2024-09-12T00:06:43.424 INFO:tasks.workunit.client.0.smithi033.stdout: lockers: 2024-09-12T00:06:43.424 INFO:tasks.workunit.client.0.smithi033.stdout: client.5178 expiration=0.000000 addr=v1:172.21.15.33:0/1570678952 cookie= 2024-09-12T00:06:43.424 INFO:tasks.workunit.client.0.smithi033.stdout: client.5178 expiration=0.000000 addr=v1:172.21.15.33:0/1570678952 cookie=new cookie 2024-09-12T00:06:44.415 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestCookie (3041 ms) 2024-09-12T00:06:44.415 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:06:47.432 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestMultipleLocks (3017 ms) 2024-09-12T00:06:47.432 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:06:54.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestLockDuration (7450 ms) 2024-09-12T00:06:54.882 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:06:57.914 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestAssertLocked (3033 ms) 2024-09-12T00:06:57.914 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:07:00.937 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestSetCookie (3023 ms) 2024-09-12T00:07:00.937 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:07:22.002 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestRenew (21064 ms) 2024-09-12T00:07:22.002 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:07:28.088 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6087 ms) 2024-09-12T00:07:28.089 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:07:35.175 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7086 ms) 2024-09-12T00:07:35.176 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:07:43.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8037 ms) 2024-09-12T00:07:43.212 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 11 tests from ClsLock (67129 ms total) 2024-09-12T00:07:43.212 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:07:43.212 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:07:43.213 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 11 tests from 1 test suite ran. (67129 ms total) 2024-09-12T00:07:43.213 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 11 tests. 2024-09-12T00:07:43.215 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:07:43.215 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:07:43.260 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:07:43.261 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:07:43.262 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:07:43.310 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2024-09-12T00:07:43.310 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:07:43.310 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:07:43.310 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 4 tests from cls_log 2024-09-12T00:07:43.310 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:07:46.246 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_log.test_log_add_same_time (2936 ms) 2024-09-12T00:07:46.246 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:07:49.246 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_log.test_log_add_different_time (2998 ms) 2024-09-12T00:07:49.246 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:07:52.279 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_log.trim_by_time (3034 ms) 2024-09-12T00:07:52.279 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:07:55.288 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_log.trim_by_marker (3010 ms) 2024-09-12T00:07:55.288 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 4 tests from cls_log (11978 ms total) 2024-09-12T00:07:55.288 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:07:55.289 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:07:55.289 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 4 tests from 1 test suite ran. (11978 ms total) 2024-09-12T00:07:55.289 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 4 tests. 2024-09-12T00:07:55.291 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:07:55.291 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:07:55.337 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:07:55.338 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:07:55.338 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:07:55.388 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2024-09-12T00:07:55.388 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:07:55.388 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:07:55.388 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:07:55.388 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:07:58.319 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.test_implicit (2931 ms) 2024-09-12T00:07:58.320 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:08:01.341 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3022 ms) 2024-09-12T00:08:01.341 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:08:10.381 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.test_put_snap (9037 ms) 2024-09-12T00:08:10.381 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:08:13.413 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.test_explicit (3033 ms) 2024-09-12T00:08:13.413 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:08:16.439 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.set (3028 ms) 2024-09-12T00:08:16.439 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:08:23.465 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.test_implicit_ec (7025 ms) 2024-09-12T00:08:23.469 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:08:30.506 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7042 ms) 2024-09-12T00:08:30.507 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:08:42.639 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.test_put_snap_ec (12133 ms) 2024-09-12T00:08:42.639 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:08:49.649 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.test_explicit_ec (7009 ms) 2024-09-12T00:08:49.649 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:08:56.701 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_refcount.set_ec (7053 ms) 2024-09-12T00:08:56.702 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 10 tests from cls_refcount (61313 ms total) 2024-09-12T00:08:56.702 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:08:56.702 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:08:56.702 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 10 tests from 1 test suite ran. (61313 ms total) 2024-09-12T00:08:56.702 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 10 tests. 2024-09-12T00:08:56.705 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:08:56.706 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:08:56.753 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:08:56.754 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:08:56.754 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:08:56.804 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2024-09-12T00:08:56.804 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:08:56.805 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:08:56.805 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:08:58.723 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:08:58.764 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.index_basic (41 ms) 2024-09-12T00:08:58.764 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:08:58.798 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (34 ms) 2024-09-12T00:08:58.799 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:08:58.842 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.index_remove_object (44 ms) 2024-09-12T00:08:58.843 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:09:00.366 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.index_suggest (1524 ms) 2024-09-12T00:09:00.366 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:09:00.372 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2024-09-12T00:09:00.372 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:09:00.400 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.index_list (28 ms) 2024-09-12T00:09:00.401 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:09:21.675 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.index_list_delimited (21275 ms) 2024-09-12T00:09:21.675 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:09:21.749 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.bi_list (74 ms) 2024-09-12T00:09:21.749 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:09:21.760 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.gc_set (11 ms) 2024-09-12T00:09:21.760 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:09:21.769 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.gc_list (9 ms) 2024-09-12T00:09:21.769 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:09:28.973 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.gc_defer (7204 ms) 2024-09-12T00:09:28.974 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:09:29.053 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.usage_basic (80 ms) 2024-09-12T00:09:29.053 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:09:29.054 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-12T00:09:29.054 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:09:29.152 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.usage_clear (98 ms) 2024-09-12T00:09:29.152 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:09:29.194 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.bi_log_trim (42 ms) 2024-09-12T00:09:29.194 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:09:29.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.index_racing_removes (18 ms) 2024-09-12T00:09:29.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:09:29.233 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.reshardlog_list (21 ms) 2024-09-12T00:09:29.233 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:09:29.244 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.reshardlog_num (11 ms) 2024-09-12T00:09:29.244 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:09:29.266 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw.bi_put_entries (22 ms) 2024-09-12T00:09:29.986 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 19 tests from cls_rgw (30543 ms total) 2024-09-12T00:09:29.986 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:09:29.986 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:29.986 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 19 tests from 1 test suite ran. (33182 ms total) 2024-09-12T00:09:29.986 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 19 tests. 2024-09-12T00:09:29.989 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:09:29.989 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:09:30.034 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:09:30.035 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:09:30.035 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:09:30.122 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2024-09-12T00:09:30.123 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:09:30.123 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:30.123 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:09:30.123 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:09:31.987 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.init (1865 ms) 2024-09-12T00:09:31.988 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:09:32.014 INFO:tasks.workunit.client.0.smithi033.stderr:[ ] list info tag = chain-0 2024-09-12T00:09:32.014 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (27 ms) 2024-09-12T00:09:32.014 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:09:32.020 INFO:tasks.workunit.client.0.smithi033.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:09:32.021 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-12T00:09:32.021 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:09:32.029 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-12T00:09:32.029 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:09:32.369 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (340 ms) 2024-09-12T00:09:32.369 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:09:32.526 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (157 ms) 2024-09-12T00:09:32.526 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:09:32.536 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (10 ms) 2024-09-12T00:09:32.536 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:09:32.545 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2024-09-12T00:09:32.545 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:09:33.002 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_gc.finalize (456 ms) 2024-09-12T00:09:33.002 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 9 tests from cls_rgw_gc (2879 ms total) 2024-09-12T00:09:33.002 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:09:33.002 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:33.002 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 9 tests from 1 test suite ran. (2879 ms total) 2024-09-12T00:09:33.002 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 9 tests. 2024-09-12T00:09:33.004 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:09:33.004 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:09:33.048 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:09:33.050 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:09:33.050 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:09:33.144 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:09:33.145 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:09:33.145 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:09:33.145 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:35.012 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:09:35.012 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:09:35.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.027+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=HR0EK4X9LXWN type=del size=90526 2024-09-12T00:09:35.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.030+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~2LF6OGIY09FA.0 size=1048576 2024-09-12T00:09:35.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.031+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~2LF6OGIY09FA.1 size=120529 2024-09-12T00:09:35.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.031+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=2LF6OGIY09FA tag=KNY2T3RV4EJA type=write size=2217681 2024-09-12T00:09:35.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.032+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=OP118A8PYI2F type=del size=45039 2024-09-12T00:09:35.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.034+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=GW4ZQ55X43OI type=del size=769755 2024-09-12T00:09:35.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.037+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~Y0PH41CES2Q6.0 size=276559 2024-09-12T00:09:35.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.037+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=Y0PH41CES2Q6 tag=CA0Z8RCENO7J type=write size=1325135 2024-09-12T00:09:35.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.039+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~GXZWLK3MGSLY.0 size=962531 2024-09-12T00:09:35.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.039+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=GXZWLK3MGSLY tag=3AD6E9P70IJ1 type=write size=2011107 2024-09-12T00:09:35.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.041+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=QW2A8XPITEHB type=del size=745255 2024-09-12T00:09:35.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.043+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~TJROYT2V5IST.0 size=1048576 2024-09-12T00:09:35.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.044+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~TJROYT2V5IST.1 size=1048576 2024-09-12T00:09:35.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.045+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~TJROYT2V5IST.2 size=679103 2024-09-12T00:09:35.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.045+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=TJROYT2V5IST tag=AWU239RQKYX3 type=write size=3824831 2024-09-12T00:09:35.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.047+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=4X69J9UIZSE0 type=del size=3910082 2024-09-12T00:09:35.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.048+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=H9AMXA44OXH3 type=del size=2037352 2024-09-12T00:09:35.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.051+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~VO3EOYGB3LSR.0 size=867632 2024-09-12T00:09:35.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.051+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=VO3EOYGB3LSR tag=VIKSG9N5DF3Q type=write size=1916208 2024-09-12T00:09:35.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.052+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=L1J6EGSFKQHD type=write size=881143 2024-09-12T00:09:35.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.055+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=WJHLF9DI3TRS type=del size=816105 2024-09-12T00:09:35.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.060+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~3KTUOO1HEA5D.0 size=333766 2024-09-12T00:09:35.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.060+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=3KTUOO1HEA5D tag=0NS00UVPREZQ type=write size=1382342 2024-09-12T00:09:35.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.064+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~ZWPMFW8T5RGX.0 size=12232 2024-09-12T00:09:35.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.064+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=ZWPMFW8T5RGX tag=9W930D3O5ER3 type=write size=1060808 2024-09-12T00:09:35.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.065+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=0Y2HDD3B3C9T type=del size=3014654 2024-09-12T00:09:35.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.066+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=HR0EK4X9LXWN type=del 2024-09-12T00:09:35.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.069+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~021IGERTJ0UT.0 size=1048576 2024-09-12T00:09:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.070+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~021IGERTJ0UT.1 size=1048576 2024-09-12T00:09:35.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.071+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~021IGERTJ0UT.2 size=667979 2024-09-12T00:09:35.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.071+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=021IGERTJ0UT tag=4ISCMQM4VOW4 type=write size=3813707 2024-09-12T00:09:35.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.071+0000 7f3dc2c18780 1 < canceled part key=_multipart_UJDQEIAIRVDW.2~2LF6OGIY09FA.0 size=1048576 2024-09-12T00:09:35.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.072+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~2LF6OGIY09FA.1 size=120529 2024-09-12T00:09:35.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.075+0000 7f3dc2c18780 1 < canceled multipart upload key=UJDQEIAIRVDW upload=2LF6OGIY09FA tag=KNY2T3RV4EJA type=write size=2217681 2024-09-12T00:09:35.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.077+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~61QZ74W9BFML.0 size=1048576 2024-09-12T00:09:35.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.078+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~61QZ74W9BFML.1 size=1048576 2024-09-12T00:09:35.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.079+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~61QZ74W9BFML.2 size=538391 2024-09-12T00:09:35.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.079+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=61QZ74W9BFML tag=O9VZU0RSFU21 type=write size=3684119 2024-09-12T00:09:35.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.081+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=OP118A8PYI2F type=del 2024-09-12T00:09:35.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.082+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=GA8R4F1W6WGI type=write size=1025518 2024-09-12T00:09:35.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.083+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=GW4ZQ55X43OI type=del 2024-09-12T00:09:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.085+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=A7BDM1I2V7Q8 type=del size=459838 2024-09-12T00:09:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.085+0000 7f3dc2c18780 1 < canceled part key=_multipart_OGRGDIUO2W8B.2~Y0PH41CES2Q6.0 size=276559 2024-09-12T00:09:35.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.088+0000 7f3dc2c18780 1 < canceled multipart upload key=OGRGDIUO2W8B upload=Y0PH41CES2Q6 tag=CA0Z8RCENO7J type=write size=1325135 2024-09-12T00:09:35.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.089+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=YZMDGKHBDXXT type=del size=3241816 2024-09-12T00:09:35.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.091+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~GXZWLK3MGSLY.0 size=962531 2024-09-12T00:09:35.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.093+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=GXZWLK3MGSLY tag=3AD6E9P70IJ1 type=write size=2011107 2024-09-12T00:09:35.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.095+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=AKB0HS0VQKA1 type=write size=234321 2024-09-12T00:09:35.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.098+0000 7f3dc2c18780 1 < suggested update operation key=WRR6LAYIWOCE tag=QW2A8XPITEHB type=del size=745255 2024-09-12T00:09:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.100+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~85BK9ZAC0ZQ7.0 size=114231 2024-09-12T00:09:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.100+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=85BK9ZAC0ZQ7 tag=OEUZQEM93RAY type=write size=1162807 2024-09-12T00:09:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.101+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~TJROYT2V5IST.0 size=1048576 2024-09-12T00:09:35.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.102+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~TJROYT2V5IST.1 size=1048576 2024-09-12T00:09:35.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.102+0000 7f3dc2c18780 1 < canceled part key=_multipart_5MAV2RJ4E31S.2~TJROYT2V5IST.2 size=679103 2024-09-12T00:09:35.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.104+0000 7f3dc2c18780 1 < canceled multipart upload key=5MAV2RJ4E31S upload=TJROYT2V5IST tag=AWU239RQKYX3 type=write size=3824831 2024-09-12T00:09:35.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.106+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=F3NTVGCZ4DMH type=del size=236255 2024-09-12T00:09:35.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.107+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=4X69J9UIZSE0 type=del 2024-09-12T00:09:35.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.109+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~JUUEL7ZOTLFG.0 size=1048576 2024-09-12T00:09:35.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.110+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~JUUEL7ZOTLFG.1 size=22300 2024-09-12T00:09:35.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.110+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=JUUEL7ZOTLFG tag=EBLVR2RPXN0W type=write size=2119452 2024-09-12T00:09:35.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.113+0000 7f3dc2c18780 1 < suggested remove operation key=5MAV2RJ4E31S tag=H9AMXA44OXH3 type=del 2024-09-12T00:09:35.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.114+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=UPX5JUYW7J53 type=write size=463665 2024-09-12T00:09:35.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.116+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~VO3EOYGB3LSR.0 size=867632 2024-09-12T00:09:35.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.118+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=VO3EOYGB3LSR tag=VIKSG9N5DF3Q type=write size=1916208 2024-09-12T00:09:35.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.120+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~68UOFLUFYQXT.0 size=1048576 2024-09-12T00:09:35.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.121+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~68UOFLUFYQXT.1 size=930148 2024-09-12T00:09:35.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.121+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=68UOFLUFYQXT tag=XLI1JRE220UH type=write size=3027300 2024-09-12T00:09:35.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.122+0000 7f3dc2c18780 1 < canceled operation key=OGRGDIUO2W8B tag=L1J6EGSFKQHD type=write size=881143 2024-09-12T00:09:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.124+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~YQOMUHG0ULDG.0 size=595609 2024-09-12T00:09:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.124+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=YQOMUHG0ULDG tag=1CZZHWY0ETMF type=write size=1644185 2024-09-12T00:09:35.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.126+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=WJHLF9DI3TRS type=del 2024-09-12T00:09:35.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.128+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~F3I28USJBPPP.0 size=1048576 2024-09-12T00:09:35.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.129+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~F3I28USJBPPP.1 size=1048576 2024-09-12T00:09:35.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.130+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~F3I28USJBPPP.2 size=576238 2024-09-12T00:09:35.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.130+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=F3I28USJBPPP tag=O84TORW22MZ5 type=write size=3721966 2024-09-12T00:09:35.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.132+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~3KTUOO1HEA5D.0 size=333766 2024-09-12T00:09:35.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.134+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=3KTUOO1HEA5D tag=0NS00UVPREZQ type=write size=1382342 2024-09-12T00:09:35.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.135+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=AEHINKYHHVXB type=del size=2238202 2024-09-12T00:09:35.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.136+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~ZWPMFW8T5RGX.0 size=12232 2024-09-12T00:09:35.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.138+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=ZWPMFW8T5RGX tag=9W930D3O5ER3 type=write size=1060808 2024-09-12T00:09:35.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.139+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=U7HXOX7Y4G5N type=del size=2144720 2024-09-12T00:09:35.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.141+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=0Y2HDD3B3C9T type=del 2024-09-12T00:09:35.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.142+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=ODUWGWP4HET6 type=del size=2832845 2024-09-12T00:09:35.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.143+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~021IGERTJ0UT.0 size=1048576 2024-09-12T00:09:35.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.143+0000 7f3dc2c18780 1 < canceled part key=_multipart_5F0BB9U7Y6ZZ.2~021IGERTJ0UT.1 size=1048576 2024-09-12T00:09:35.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.144+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~021IGERTJ0UT.2 size=667979 2024-09-12T00:09:35.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.146+0000 7f3dc2c18780 1 < canceled multipart upload key=5F0BB9U7Y6ZZ upload=021IGERTJ0UT tag=4ISCMQM4VOW4 type=write size=3813707 2024-09-12T00:09:35.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.149+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~78ATRBT8D8FD.0 size=1048576 2024-09-12T00:09:35.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.150+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~78ATRBT8D8FD.1 size=1001344 2024-09-12T00:09:35.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.150+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=78ATRBT8D8FD tag=J302807V60QR type=write size=3098496 2024-09-12T00:09:35.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.151+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~61QZ74W9BFML.0 size=1048576 2024-09-12T00:09:35.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.152+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~61QZ74W9BFML.1 size=1048576 2024-09-12T00:09:35.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.153+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~61QZ74W9BFML.2 size=538391 2024-09-12T00:09:35.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.155+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=61QZ74W9BFML tag=O9VZU0RSFU21 type=write size=3684119 2024-09-12T00:09:35.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.156+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=WSVNZ9V0D68F type=del size=144179 2024-09-12T00:09:35.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.157+0000 7f3dc2c18780 1 < completed write operation key=65DTZR8A5OHF tag=GA8R4F1W6WGI type=write size=1025518 2024-09-12T00:09:35.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.159+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~25IVA1F860WS.0 size=830444 2024-09-12T00:09:35.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.159+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=25IVA1F860WS tag=EWVWIDUL3DMH type=write size=1879020 2024-09-12T00:09:35.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.161+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=A7BDM1I2V7Q8 type=del 2024-09-12T00:09:35.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.162+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=33ZQAJEMCG2R type=del size=1790359 2024-09-12T00:09:35.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.164+0000 7f3dc2c18780 1 < suggested update operation key=GP3MLWX9586T tag=YZMDGKHBDXXT type=del size=3241816 2024-09-12T00:09:35.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.166+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=4O5C8YTIQ6FK type=del size=3767575 2024-09-12T00:09:35.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.167+0000 7f3dc2c18780 1 < completed write operation key=A4O7JFS2ULY0 tag=AKB0HS0VQKA1 type=write size=234321 2024-09-12T00:09:35.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.169+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=ESJW6VOL1MS0 type=write size=233996 2024-09-12T00:09:35.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.170+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~85BK9ZAC0ZQ7.0 size=114231 2024-09-12T00:09:35.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.172+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=85BK9ZAC0ZQ7 tag=OEUZQEM93RAY type=write size=1162807 2024-09-12T00:09:35.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.174+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~VNJENRH4741G.0 size=1048576 2024-09-12T00:09:35.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.175+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~VNJENRH4741G.1 size=1048576 2024-09-12T00:09:35.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.176+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~VNJENRH4741G.2 size=748137 2024-09-12T00:09:35.175 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.176+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=VNJENRH4741G tag=RMLLXAN2DOWS type=write size=3893865 2024-09-12T00:09:35.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.177+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=F3NTVGCZ4DMH type=del 2024-09-12T00:09:35.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.179+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~6QHRJHTGMF6A.0 size=1048576 2024-09-12T00:09:35.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.180+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~6QHRJHTGMF6A.1 size=28052 2024-09-12T00:09:35.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.180+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=6QHRJHTGMF6A tag=GNODCIZOROP4 type=write size=2125204 2024-09-12T00:09:35.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.181+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~JUUEL7ZOTLFG.0 size=1048576 2024-09-12T00:09:35.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.182+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~JUUEL7ZOTLFG.1 size=22300 2024-09-12T00:09:35.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.184+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=JUUEL7ZOTLFG tag=EBLVR2RPXN0W type=write size=2119452 2024-09-12T00:09:35.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.186+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~EQLL4G3OZMBD.0 size=1048576 2024-09-12T00:09:35.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.187+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~EQLL4G3OZMBD.1 size=1048576 2024-09-12T00:09:35.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.188+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~EQLL4G3OZMBD.2 size=1022983 2024-09-12T00:09:35.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.188+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=EQLL4G3OZMBD tag=2GH3RESGJIKP type=write size=4168711 2024-09-12T00:09:35.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.189+0000 7f3dc2c18780 -1 < failed to complete operation key=GP3MLWX9586T tag=UPX5JUYW7J53 type=write size=463665: (22) Invalid argument 2024-09-12T00:09:35.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.192+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~8T6Z46K0T8YN.0 size=287152 2024-09-12T00:09:35.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.192+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=8T6Z46K0T8YN tag=YJOGHJJZXU7X type=write size=1335728 2024-09-12T00:09:35.191 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.193+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~68UOFLUFYQXT.0 size=1048576 2024-09-12T00:09:35.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.194+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~68UOFLUFYQXT.1 size=930148 2024-09-12T00:09:35.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.196+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=68UOFLUFYQXT tag=XLI1JRE220UH type=write size=3027300 2024-09-12T00:09:35.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.198+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~V9SWJGZ9E1JG.0 size=1048576 2024-09-12T00:09:35.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.199+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~V9SWJGZ9E1JG.1 size=817335 2024-09-12T00:09:35.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.199+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=V9SWJGZ9E1JG tag=BA84R2GIOATC type=write size=2914487 2024-09-12T00:09:35.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.200+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~YQOMUHG0ULDG.0 size=595609 2024-09-12T00:09:35.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.202+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=YQOMUHG0ULDG tag=1CZZHWY0ETMF type=write size=1644185 2024-09-12T00:09:35.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.203+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=21E6EHJLWNRX type=del size=1144735 2024-09-12T00:09:35.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.205+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~F3I28USJBPPP.0 size=1048576 2024-09-12T00:09:35.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.205+0000 7f3dc2c18780 1 < canceled part key=_multipart_25CF1N8J81Y9.2~F3I28USJBPPP.1 size=1048576 2024-09-12T00:09:35.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.206+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~F3I28USJBPPP.2 size=576238 2024-09-12T00:09:35.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.208+0000 7f3dc2c18780 1 < canceled multipart upload key=25CF1N8J81Y9 upload=F3I28USJBPPP tag=O84TORW22MZ5 type=write size=3721966 2024-09-12T00:09:35.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.210+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~9AY36FJD1TI8.0 size=1048576 2024-09-12T00:09:35.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.211+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~9AY36FJD1TI8.1 size=697214 2024-09-12T00:09:35.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.211+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=9AY36FJD1TI8 tag=EHHD4PYGU82I type=write size=2794366 2024-09-12T00:09:35.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.212+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=AEHINKYHHVXB type=del 2024-09-12T00:09:35.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.213+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=FB84D1U4JP8Z type=del size=3901434 2024-09-12T00:09:35.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.215+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=U7HXOX7Y4G5N type=del 2024-09-12T00:09:35.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.216+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=AGUYWIYA36BQ type=write size=620081 2024-09-12T00:09:35.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.217+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=ODUWGWP4HET6 type=del 2024-09-12T00:09:35.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.219+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~58PMO802PDX0.0 size=1048576 2024-09-12T00:09:35.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.220+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~58PMO802PDX0.1 size=115440 2024-09-12T00:09:35.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.220+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=58PMO802PDX0 tag=IHSB861PE0WS type=write size=2212592 2024-09-12T00:09:35.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.221+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~78ATRBT8D8FD.0 size=1048576 2024-09-12T00:09:35.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.221+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~78ATRBT8D8FD.1 size=1001344 2024-09-12T00:09:35.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.223+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=78ATRBT8D8FD tag=J302807V60QR type=write size=3098496 2024-09-12T00:09:35.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.225+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~H01SWALT901B.0 size=1048576 2024-09-12T00:09:35.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.226+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~H01SWALT901B.1 size=1048576 2024-09-12T00:09:35.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.227+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~H01SWALT901B.2 size=166223 2024-09-12T00:09:35.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.227+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=H01SWALT901B tag=IQCS8G4OXAUK type=write size=3311951 2024-09-12T00:09:35.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.229+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=WSVNZ9V0D68F type=del 2024-09-12T00:09:35.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.230+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=FFB5KU54GM8Z type=del size=3905862 2024-09-12T00:09:35.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.231+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~25IVA1F860WS.0 size=830444 2024-09-12T00:09:35.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.233+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=25IVA1F860WS tag=EWVWIDUL3DMH type=write size=1879020 2024-09-12T00:09:35.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.235+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~00HJF6BG6T0V.0 size=1048576 2024-09-12T00:09:35.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.236+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~00HJF6BG6T0V.1 size=164704 2024-09-12T00:09:35.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.236+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=00HJF6BG6T0V tag=HQVNGUI5ZIZW type=write size=2261856 2024-09-12T00:09:35.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.237+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=33ZQAJEMCG2R type=del 2024-09-12T00:09:35.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.240+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~X0270MPKE2NP.0 size=1044443 2024-09-12T00:09:35.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.240+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=X0270MPKE2NP tag=SU8WSLOP6E1N type=write size=2093019 2024-09-12T00:09:35.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.241+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=4O5C8YTIQ6FK type=del 2024-09-12T00:09:35.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.242+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=27WRUAB8938I type=del size=391245 2024-09-12T00:09:35.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.243+0000 7f3dc2c18780 1 < completed write operation key=KQWXE62PF5F7 tag=ESJW6VOL1MS0 type=write size=233996 2024-09-12T00:09:35.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.245+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~UJA2STY4FD5Y.0 size=612154 2024-09-12T00:09:35.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.245+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=UJA2STY4FD5Y tag=IODITCAPVK71 type=write size=1660730 2024-09-12T00:09:35.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.247+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~VNJENRH4741G.0 size=1048576 2024-09-12T00:09:35.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.247+0000 7f3dc2c18780 1 < canceled part key=_multipart_65DTZR8A5OHF.2~VNJENRH4741G.1 size=1048576 2024-09-12T00:09:35.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.248+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~VNJENRH4741G.2 size=748137 2024-09-12T00:09:35.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.250+0000 7f3dc2c18780 1 < canceled multipart upload key=65DTZR8A5OHF upload=VNJENRH4741G tag=RMLLXAN2DOWS type=write size=3893865 2024-09-12T00:09:35.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.252+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~811VKQ0W1VN1.0 size=1048576 2024-09-12T00:09:35.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.253+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~811VKQ0W1VN1.1 size=1048576 2024-09-12T00:09:35.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.254+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~811VKQ0W1VN1.2 size=609101 2024-09-12T00:09:35.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.254+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=811VKQ0W1VN1 tag=3U83XHXOKL07 type=write size=3754829 2024-09-12T00:09:35.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.255+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~6QHRJHTGMF6A.0 size=1048576 2024-09-12T00:09:35.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.256+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~6QHRJHTGMF6A.1 size=28052 2024-09-12T00:09:35.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.259+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=6QHRJHTGMF6A tag=GNODCIZOROP4 type=write size=2125204 2024-09-12T00:09:35.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.260+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=E1I12K6K5RDU type=write size=193262 2024-09-12T00:09:35.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.261+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~EQLL4G3OZMBD.0 size=1048576 2024-09-12T00:09:35.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.262+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~EQLL4G3OZMBD.1 size=1048576 2024-09-12T00:09:35.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.263+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~EQLL4G3OZMBD.2 size=1022983 2024-09-12T00:09:35.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.265+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=EQLL4G3OZMBD tag=2GH3RESGJIKP type=write size=4168711 2024-09-12T00:09:35.266 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.267+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~1PQJFVU8MDNH.0 size=1048576 2024-09-12T00:09:35.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.268+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~1PQJFVU8MDNH.1 size=706604 2024-09-12T00:09:35.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.268+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=1PQJFVU8MDNH tag=0MFF1EW51X9K type=write size=2803756 2024-09-12T00:09:35.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.269+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~8T6Z46K0T8YN.0 size=287152 2024-09-12T00:09:35.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.271+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=8T6Z46K0T8YN tag=YJOGHJJZXU7X type=write size=1335728 2024-09-12T00:09:35.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.272+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=B710NZ7E6BZZ type=del size=249267 2024-09-12T00:09:35.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.274+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~V9SWJGZ9E1JG.0 size=1048576 2024-09-12T00:09:35.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.275+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~V9SWJGZ9E1JG.1 size=817335 2024-09-12T00:09:35.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.277+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=V9SWJGZ9E1JG tag=BA84R2GIOATC type=write size=2914487 2024-09-12T00:09:35.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.280+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~M5EU42KHQJNU.0 size=73803 2024-09-12T00:09:35.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.280+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=M5EU42KHQJNU tag=GY0TXVBB33OU type=write size=1122379 2024-09-12T00:09:35.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.281+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=21E6EHJLWNRX type=del 2024-09-12T00:09:35.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.283+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~QOAP67T171SB.0 size=1048576 2024-09-12T00:09:35.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.284+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~QOAP67T171SB.1 size=657802 2024-09-12T00:09:35.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.284+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=QOAP67T171SB tag=HUOS5E4H36XU type=write size=2754954 2024-09-12T00:09:35.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.285+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~9AY36FJD1TI8.0 size=1048576 2024-09-12T00:09:35.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.286+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~9AY36FJD1TI8.1 size=697214 2024-09-12T00:09:35.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.288+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=9AY36FJD1TI8 tag=EHHD4PYGU82I type=write size=2794366 2024-09-12T00:09:35.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.290+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~NVRC3GDAE20B.0 size=946437 2024-09-12T00:09:35.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.290+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=NVRC3GDAE20B tag=8V7ODCAYR39J type=write size=1995013 2024-09-12T00:09:35.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.291+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=FB84D1U4JP8Z type=del 2024-09-12T00:09:35.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.292+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=2172D26GH917 type=del size=1872431 2024-09-12T00:09:35.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.294+0000 7f3dc2c18780 1 < completed write operation key=TSL3IDD0EDT0 tag=AGUYWIYA36BQ type=write size=620081 2024-09-12T00:09:35.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.295+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=XEVEYHPN0RNJ type=del size=742164 2024-09-12T00:09:35.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.297+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~58PMO802PDX0.0 size=1048576 2024-09-12T00:09:35.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.298+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~58PMO802PDX0.1 size=115440 2024-09-12T00:09:35.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.300+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=58PMO802PDX0 tag=IHSB861PE0WS type=write size=2212592 2024-09-12T00:09:35.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.302+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~AJ29O10NA5E6.0 size=1048576 2024-09-12T00:09:35.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.303+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~AJ29O10NA5E6.1 size=778835 2024-09-12T00:09:35.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.303+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=AJ29O10NA5E6 tag=28A79WOQSC82 type=write size=2875987 2024-09-12T00:09:35.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.304+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~H01SWALT901B.0 size=1048576 2024-09-12T00:09:35.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.305+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~H01SWALT901B.1 size=1048576 2024-09-12T00:09:35.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.307+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~H01SWALT901B.2 size=166223 2024-09-12T00:09:35.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.309+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=H01SWALT901B tag=IQCS8G4OXAUK type=write size=3311951 2024-09-12T00:09:35.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.311+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~VND5XRE5JY88.0 size=130711 2024-09-12T00:09:35.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.311+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=VND5XRE5JY88 tag=APABAZOLNNER type=write size=1179287 2024-09-12T00:09:35.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.314+0000 7f3dc2c18780 1 < suggested remove operation key=0ICU4WV9K1RG tag=FFB5KU54GM8Z type=del 2024-09-12T00:09:35.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.316+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=4LPFTMNXGYC2 type=del size=2886119 2024-09-12T00:09:35.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.317+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~00HJF6BG6T0V.0 size=1048576 2024-09-12T00:09:35.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.317+0000 7f3dc2c18780 1 < canceled part key=_multipart_Y40G8SLO6AVH.2~00HJF6BG6T0V.1 size=164704 2024-09-12T00:09:35.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.319+0000 7f3dc2c18780 1 < canceled multipart upload key=Y40G8SLO6AVH upload=00HJF6BG6T0V tag=HQVNGUI5ZIZW type=write size=2261856 2024-09-12T00:09:35.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.322+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~2NWG6MYSR3TU.0 size=1048576 2024-09-12T00:09:35.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.323+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~2NWG6MYSR3TU.1 size=1048576 2024-09-12T00:09:35.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.324+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~2NWG6MYSR3TU.2 size=43446 2024-09-12T00:09:35.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.324+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=2NWG6MYSR3TU tag=NFV84R2S5T2P type=write size=3189174 2024-09-12T00:09:35.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.325+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~X0270MPKE2NP.0 size=1044443 2024-09-12T00:09:35.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.328+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=X0270MPKE2NP tag=SU8WSLOP6E1N type=write size=2093019 2024-09-12T00:09:35.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.329+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=551QFZ4W1BYY type=del size=514925 2024-09-12T00:09:35.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.330+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=27WRUAB8938I type=del 2024-09-12T00:09:35.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.332+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~L8Z90DO5QCAD.0 size=992053 2024-09-12T00:09:35.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.332+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=L8Z90DO5QCAD tag=1Y0MO8RL3ERU type=write size=2040629 2024-09-12T00:09:35.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.333+0000 7f3dc2c18780 1 < canceled part key=_multipart_4POD73U0LAC0.2~UJA2STY4FD5Y.0 size=612154 2024-09-12T00:09:35.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.335+0000 7f3dc2c18780 1 < canceled multipart upload key=4POD73U0LAC0 upload=UJA2STY4FD5Y tag=IODITCAPVK71 type=write size=1660730 2024-09-12T00:09:35.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.336+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=2HX3WGX6NNX7 type=del size=4029897 2024-09-12T00:09:35.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.337+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~811VKQ0W1VN1.0 size=1048576 2024-09-12T00:09:35.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.338+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~811VKQ0W1VN1.1 size=1048576 2024-09-12T00:09:35.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.339+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~811VKQ0W1VN1.2 size=609101 2024-09-12T00:09:35.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.341+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=811VKQ0W1VN1 tag=3U83XHXOKL07 type=write size=3754829 2024-09-12T00:09:35.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.342+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=56I41JDNC3GV type=write size=166761 2024-09-12T00:09:35.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.344+0000 7f3dc2c18780 1 < completed write operation key=65DTZR8A5OHF tag=E1I12K6K5RDU type=write size=193262 2024-09-12T00:09:35.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.346+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~M7LZSPE39ZY8.0 size=1048576 2024-09-12T00:09:35.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.347+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~M7LZSPE39ZY8.1 size=1048576 2024-09-12T00:09:35.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.348+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~M7LZSPE39ZY8.2 size=734991 2024-09-12T00:09:35.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.348+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=M7LZSPE39ZY8 tag=U7C6WEM0Y3NQ type=write size=3880719 2024-09-12T00:09:35.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.348+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRBBH64CISJZ.2~1PQJFVU8MDNH.0 size=1048576 2024-09-12T00:09:35.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.349+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~1PQJFVU8MDNH.1 size=706604 2024-09-12T00:09:35.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.351+0000 7f3dc2c18780 1 < canceled multipart upload key=WRBBH64CISJZ upload=1PQJFVU8MDNH tag=0MFF1EW51X9K type=write size=2803756 2024-09-12T00:09:35.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.354+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~L9114DHVTLAF.0 size=1033110 2024-09-12T00:09:35.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.354+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=L9114DHVTLAF tag=MJJGC0U06GB6 type=write size=2081686 2024-09-12T00:09:35.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.356+0000 7f3dc2c18780 1 < suggested remove operation key=OGRGDIUO2W8B tag=B710NZ7E6BZZ type=del 2024-09-12T00:09:35.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.357+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=4DMDCPKIFDRB type=del size=2019099 2024-09-12T00:09:35.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.359+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~M5EU42KHQJNU.0 size=73803 2024-09-12T00:09:35.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.361+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=M5EU42KHQJNU tag=GY0TXVBB33OU type=write size=1122379 2024-09-12T00:09:35.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.362+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=RTDWY3YGPUF7 type=del size=3344676 2024-09-12T00:09:35.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.363+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~QOAP67T171SB.0 size=1048576 2024-09-12T00:09:35.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.364+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~QOAP67T171SB.1 size=657802 2024-09-12T00:09:35.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.366+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=QOAP67T171SB tag=HUOS5E4H36XU type=write size=2754954 2024-09-12T00:09:35.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.368+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~5YVTN7YXCHTX.0 size=384035 2024-09-12T00:09:35.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.368+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=5YVTN7YXCHTX tag=Z8QLROXFL2XX type=write size=1432611 2024-09-12T00:09:35.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.370+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~NVRC3GDAE20B.0 size=946437 2024-09-12T00:09:35.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.372+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=NVRC3GDAE20B tag=8V7ODCAYR39J type=write size=1995013 2024-09-12T00:09:35.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.373+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=NSJFN7E614JG type=del size=4057062 2024-09-12T00:09:35.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.374+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=2172D26GH917 type=del 2024-09-12T00:09:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.375+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=28RF9BRBZUON type=write size=203523 2024-09-12T00:09:35.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.376+0000 7f3dc2c18780 -1 < failed to complete operation key=0ICU4WV9K1RG tag=XEVEYHPN0RNJ type=del size=742164: (22) Invalid argument 2024-09-12T00:09:35.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.379+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~F2LEFLGGBGIR.0 size=141841 2024-09-12T00:09:35.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.379+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=F2LEFLGGBGIR tag=AYZV7L6NMZT5 type=write size=1190417 2024-09-12T00:09:35.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.380+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~AJ29O10NA5E6.0 size=1048576 2024-09-12T00:09:35.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.381+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~AJ29O10NA5E6.1 size=778835 2024-09-12T00:09:35.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.383+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=AJ29O10NA5E6 tag=28A79WOQSC82 type=write size=2875987 2024-09-12T00:09:35.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.385+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~L75IMS05N3FL.0 size=1048576 2024-09-12T00:09:35.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.386+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~L75IMS05N3FL.1 size=1030394 2024-09-12T00:09:35.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.386+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=L75IMS05N3FL tag=7CNB2SO7N3SM type=write size=3127546 2024-09-12T00:09:35.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.387+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~VND5XRE5JY88.0 size=130711 2024-09-12T00:09:35.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.392+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=VND5XRE5JY88 tag=APABAZOLNNER type=write size=1179287 2024-09-12T00:09:35.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.395+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DZRA4Q1MVZON.0 size=1048576 2024-09-12T00:09:35.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.396+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DZRA4Q1MVZON.1 size=1048576 2024-09-12T00:09:35.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.397+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DZRA4Q1MVZON.2 size=877940 2024-09-12T00:09:35.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.397+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=DZRA4Q1MVZON tag=45IS8SENXCU6 type=write size=4023668 2024-09-12T00:09:35.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.399+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=4LPFTMNXGYC2 type=del 2024-09-12T00:09:35.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.400+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=EURGKK87XRP0 type=del size=293770 2024-09-12T00:09:35.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.401+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~2NWG6MYSR3TU.0 size=1048576 2024-09-12T00:09:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.402+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~2NWG6MYSR3TU.1 size=1048576 2024-09-12T00:09:35.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.403+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~2NWG6MYSR3TU.2 size=43446 2024-09-12T00:09:35.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.405+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=2NWG6MYSR3TU tag=NFV84R2S5T2P type=write size=3189174 2024-09-12T00:09:35.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.406+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=7P1VUG0A104N type=write size=28010 2024-09-12T00:09:35.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.407+0000 7f3dc2c18780 1 < canceled operation key=TSL3IDD0EDT0 tag=551QFZ4W1BYY type=del size=514925 2024-09-12T00:09:35.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.409+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~9KHJHUJ8ZM8Z.0 size=1048576 2024-09-12T00:09:35.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.410+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~9KHJHUJ8ZM8Z.1 size=868277 2024-09-12T00:09:35.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.410+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=9KHJHUJ8ZM8Z tag=750O32W27T0V type=write size=2965429 2024-09-12T00:09:35.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.412+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~L8Z90DO5QCAD.0 size=992053 2024-09-12T00:09:35.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.413+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=L8Z90DO5QCAD tag=1Y0MO8RL3ERU type=write size=2040629 2024-09-12T00:09:35.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.416+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~BKOASNNKDB0W.0 size=1048576 2024-09-12T00:09:35.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.417+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~BKOASNNKDB0W.1 size=1048576 2024-09-12T00:09:35.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.417+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~BKOASNNKDB0W.2 size=461551 2024-09-12T00:09:35.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.417+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=BKOASNNKDB0W tag=RHTUGK0ZFWYW type=write size=3607279 2024-09-12T00:09:35.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.419+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=2HX3WGX6NNX7 type=del 2024-09-12T00:09:35.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.421+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~VXJRZZ5OZA8K.0 size=888404 2024-09-12T00:09:35.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.421+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=VXJRZZ5OZA8K tag=9SMIGIRKXQJZ type=write size=1936980 2024-09-12T00:09:35.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.423+0000 7f3dc2c18780 1 < completed write operation key=0ICU4WV9K1RG tag=56I41JDNC3GV type=write size=166761 2024-09-12T00:09:35.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.425+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~G5FSV28AWFVJ.0 size=1048576 2024-09-12T00:09:35.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.426+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~G5FSV28AWFVJ.1 size=1048576 2024-09-12T00:09:35.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.427+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~G5FSV28AWFVJ.2 size=398044 2024-09-12T00:09:35.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.427+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=G5FSV28AWFVJ tag=UQBMGTA621U6 type=write size=3543772 2024-09-12T00:09:35.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.428+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~M7LZSPE39ZY8.0 size=1048576 2024-09-12T00:09:35.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.429+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~M7LZSPE39ZY8.1 size=1048576 2024-09-12T00:09:35.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.430+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~M7LZSPE39ZY8.2 size=734991 2024-09-12T00:09:35.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.432+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=M7LZSPE39ZY8 tag=U7C6WEM0Y3NQ type=write size=3880719 2024-09-12T00:09:35.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.434+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=OC4Q62ENU0ER type=del size=3060469 2024-09-12T00:09:35.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.435+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~L9114DHVTLAF.0 size=1033110 2024-09-12T00:09:35.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.437+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=L9114DHVTLAF tag=MJJGC0U06GB6 type=write size=2081686 2024-09-12T00:09:35.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.438+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=Y7DSJZORCLF1 type=del size=1534051 2024-09-12T00:09:35.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.440+0000 7f3dc2c18780 1 < canceled operation key=GLAOX3ZNNILD tag=4DMDCPKIFDRB type=del size=2019099 2024-09-12T00:09:35.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.442+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~MN98YLI32WF6.0 size=1048576 2024-09-12T00:09:35.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.443+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~MN98YLI32WF6.1 size=998356 2024-09-12T00:09:35.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.443+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=MN98YLI32WF6 tag=V4UCIGCJ8YRK type=write size=3095508 2024-09-12T00:09:35.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.444+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=RTDWY3YGPUF7 type=del 2024-09-12T00:09:35.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.446+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~DWUMQMEUA3SW.0 size=1048576 2024-09-12T00:09:35.446 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.447+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~DWUMQMEUA3SW.1 size=1048576 2024-09-12T00:09:35.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.448+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~DWUMQMEUA3SW.2 size=898696 2024-09-12T00:09:35.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.448+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=DWUMQMEUA3SW tag=LH360608E5FY type=write size=4044424 2024-09-12T00:09:35.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.450+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~5YVTN7YXCHTX.0 size=384035 2024-09-12T00:09:35.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.452+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=5YVTN7YXCHTX tag=Z8QLROXFL2XX type=write size=1432611 2024-09-12T00:09:35.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.453+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=RQJFJH702HEI type=write size=822067 2024-09-12T00:09:35.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.455+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=NSJFN7E614JG type=del 2024-09-12T00:09:35.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.456+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=MV2IE0HOZQGX type=del size=1070173 2024-09-12T00:09:35.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.457+0000 7f3dc2c18780 1 < completed write operation key=QJ3KML910OEL tag=28RF9BRBZUON type=write size=203523 2024-09-12T00:09:35.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.458+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=X7NBKXND54TB type=write size=763999 2024-09-12T00:09:35.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.459+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~F2LEFLGGBGIR.0 size=141841 2024-09-12T00:09:35.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.462+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=F2LEFLGGBGIR tag=AYZV7L6NMZT5 type=write size=1190417 2024-09-12T00:09:35.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.463+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=9WDPGJ76OQFP type=write size=836345 2024-09-12T00:09:35.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.464+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~L75IMS05N3FL.0 size=1048576 2024-09-12T00:09:35.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.465+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~L75IMS05N3FL.1 size=1030394 2024-09-12T00:09:35.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.468+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=L75IMS05N3FL tag=7CNB2SO7N3SM type=write size=3127546 2024-09-12T00:09:35.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.469+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=PYNFJNC9IRC0 type=del size=2268355 2024-09-12T00:09:35.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.470+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DZRA4Q1MVZON.0 size=1048576 2024-09-12T00:09:35.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.471+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DZRA4Q1MVZON.1 size=1048576 2024-09-12T00:09:35.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.473+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DZRA4Q1MVZON.2 size=877940 2024-09-12T00:09:35.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.475+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=DZRA4Q1MVZON tag=45IS8SENXCU6 type=write size=4023668 2024-09-12T00:09:35.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.476+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=P0E85EYCJSVB type=del size=315906 2024-09-12T00:09:35.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.478+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=EURGKK87XRP0 type=del 2024-09-12T00:09:35.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.479+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=FCW6Q3H08ID2 type=del size=1609673 2024-09-12T00:09:35.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.480+0000 7f3dc2c18780 1 < completed write operation key=7JVCFTM2QMGY tag=7P1VUG0A104N type=write size=28010 2024-09-12T00:09:35.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.481+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=VGVY5KPA6AY8 type=del size=2947372 2024-09-12T00:09:35.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.483+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~9KHJHUJ8ZM8Z.0 size=1048576 2024-09-12T00:09:35.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.484+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~9KHJHUJ8ZM8Z.1 size=868277 2024-09-12T00:09:35.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.486+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=9KHJHUJ8ZM8Z tag=750O32W27T0V type=write size=2965429 2024-09-12T00:09:35.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.488+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~M97LR04E0CHF.0 size=1048576 2024-09-12T00:09:35.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.489+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~M97LR04E0CHF.1 size=1048576 2024-09-12T00:09:35.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.490+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~M97LR04E0CHF.2 size=138470 2024-09-12T00:09:35.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.490+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=M97LR04E0CHF tag=G9A1APJIUS57 type=write size=3284198 2024-09-12T00:09:35.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.491+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~BKOASNNKDB0W.0 size=1048576 2024-09-12T00:09:35.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.492+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~BKOASNNKDB0W.1 size=1048576 2024-09-12T00:09:35.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.492+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~BKOASNNKDB0W.2 size=461551 2024-09-12T00:09:35.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.494+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=BKOASNNKDB0W tag=RHTUGK0ZFWYW type=write size=3607279 2024-09-12T00:09:35.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.496+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~I0EPGDVJUPME.0 size=1048576 2024-09-12T00:09:35.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.497+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~I0EPGDVJUPME.1 size=546187 2024-09-12T00:09:35.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.497+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=I0EPGDVJUPME tag=UWQKF4YBQYT4 type=write size=2643339 2024-09-12T00:09:35.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.498+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~VXJRZZ5OZA8K.0 size=888404 2024-09-12T00:09:35.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.500+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=VXJRZZ5OZA8K tag=9SMIGIRKXQJZ type=write size=1936980 2024-09-12T00:09:35.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.501+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=SNCGABT2KXZV type=del size=585359 2024-09-12T00:09:35.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.501+0000 7f3dc2c18780 1 < canceled part key=_multipart_GLAOX3ZNNILD.2~G5FSV28AWFVJ.0 size=1048576 2024-09-12T00:09:35.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.502+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~G5FSV28AWFVJ.1 size=1048576 2024-09-12T00:09:35.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.503+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~G5FSV28AWFVJ.2 size=398044 2024-09-12T00:09:35.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.506+0000 7f3dc2c18780 1 < canceled multipart upload key=GLAOX3ZNNILD upload=G5FSV28AWFVJ tag=UQBMGTA621U6 type=write size=3543772 2024-09-12T00:09:35.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.507+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=VD4MO4PUNCX8 type=del size=310149 2024-09-12T00:09:35.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.509+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=OC4Q62ENU0ER type=del 2024-09-12T00:09:35.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.510+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=AO4KTMCDO7XK type=del size=801160 2024-09-12T00:09:35.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.511+0000 7f3dc2c18780 1 < canceled operation key=25CF1N8J81Y9 tag=Y7DSJZORCLF1 type=del size=1534051 2024-09-12T00:09:35.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.512+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=RLPYX838QGQ3 type=del size=1130161 2024-09-12T00:09:35.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.513+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~MN98YLI32WF6.0 size=1048576 2024-09-12T00:09:35.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.514+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~MN98YLI32WF6.1 size=998356 2024-09-12T00:09:35.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.517+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=MN98YLI32WF6 tag=V4UCIGCJ8YRK type=write size=3095508 2024-09-12T00:09:35.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.518+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=ML3UP2NPOHKM type=write size=1022247 2024-09-12T00:09:35.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.519+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~DWUMQMEUA3SW.0 size=1048576 2024-09-12T00:09:35.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.520+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~DWUMQMEUA3SW.1 size=1048576 2024-09-12T00:09:35.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.521+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~DWUMQMEUA3SW.2 size=898696 2024-09-12T00:09:35.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.523+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=DWUMQMEUA3SW tag=LH360608E5FY type=write size=4044424 2024-09-12T00:09:35.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.524+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=7WK0G8I3OGRY type=del size=795115 2024-09-12T00:09:35.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.526+0000 7f3dc2c18780 1 < completed write operation key=A4O7JFS2ULY0 tag=RQJFJH702HEI type=write size=822067 2024-09-12T00:09:35.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.527+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=IO59GX4L2PAC type=del size=1909579 2024-09-12T00:09:35.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.528+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=MV2IE0HOZQGX type=del 2024-09-12T00:09:35.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.530+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~JH7GD13PPONM.0 size=1048576 2024-09-12T00:09:35.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.531+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~JH7GD13PPONM.1 size=831973 2024-09-12T00:09:35.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.531+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=JH7GD13PPONM tag=MATOQUF3H4CE type=write size=2929125 2024-09-12T00:09:35.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.532+0000 7f3dc2c18780 1 < completed write operation key=4POD73U0LAC0 tag=X7NBKXND54TB type=write size=763999 2024-09-12T00:09:35.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.534+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=CMZ4Q2I4QZSR type=del size=2413526 2024-09-12T00:09:35.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.535+0000 7f3dc2c18780 1 < completed write operation key=TSL3IDD0EDT0 tag=9WDPGJ76OQFP type=write size=836345 2024-09-12T00:09:35.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.536+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=W6KSG9ZZTO1U type=del size=2676264 2024-09-12T00:09:35.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.538+0000 7f3dc2c18780 1 < suggested update operation key=TSL3IDD0EDT0 tag=PYNFJNC9IRC0 type=del size=2268355 2024-09-12T00:09:35.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.539+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=ZBT3NHYZNJCC type=write size=948986 2024-09-12T00:09:35.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.542+0000 7f3dc2c18780 1 < suggested remove operation key=2SO8HBZSAMRX tag=P0E85EYCJSVB type=del 2024-09-12T00:09:35.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.543+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=BA5JLO819JCK type=del size=2359631 2024-09-12T00:09:35.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.544+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=FCW6Q3H08ID2 type=del 2024-09-12T00:09:35.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.546+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~3O2H7H8RKR60.0 size=1048576 2024-09-12T00:09:35.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.547+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~3O2H7H8RKR60.1 size=1048576 2024-09-12T00:09:35.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.548+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~3O2H7H8RKR60.2 size=940397 2024-09-12T00:09:35.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.548+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=3O2H7H8RKR60 tag=2JTGWM0CBRAR type=write size=4086125 2024-09-12T00:09:35.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.549+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=VGVY5KPA6AY8 type=del 2024-09-12T00:09:35.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.551+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=BOTCRJRS1F7S type=del size=732216 2024-09-12T00:09:35.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.552+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~M97LR04E0CHF.0 size=1048576 2024-09-12T00:09:35.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.552+0000 7f3dc2c18780 1 < canceled part key=_multipart_65DTZR8A5OHF.2~M97LR04E0CHF.1 size=1048576 2024-09-12T00:09:35.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.553+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~M97LR04E0CHF.2 size=138470 2024-09-12T00:09:35.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.555+0000 7f3dc2c18780 1 < canceled multipart upload key=65DTZR8A5OHF upload=M97LR04E0CHF tag=G9A1APJIUS57 type=write size=3284198 2024-09-12T00:09:35.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.557+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~P7HPL6BEH8NF.0 size=1048576 2024-09-12T00:09:35.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.558+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~P7HPL6BEH8NF.1 size=787544 2024-09-12T00:09:35.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.558+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=P7HPL6BEH8NF tag=4ZHYTOO27GKH type=write size=2884696 2024-09-12T00:09:35.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.559+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~I0EPGDVJUPME.0 size=1048576 2024-09-12T00:09:35.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.560+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~I0EPGDVJUPME.1 size=546187 2024-09-12T00:09:35.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.562+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=I0EPGDVJUPME tag=UWQKF4YBQYT4 type=write size=2643339 2024-09-12T00:09:35.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.564+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=R58XGWF9WA9B type=del size=3847137 2024-09-12T00:09:35.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.565+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=SNCGABT2KXZV type=del 2024-09-12T00:09:35.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.566+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=EVOQNVAZ77GH type=del size=3512328 2024-09-12T00:09:35.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.567+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=VD4MO4PUNCX8 type=del 2024-09-12T00:09:35.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.570+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~KOIKW5GMXJ2T.0 size=246148 2024-09-12T00:09:35.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.570+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=KOIKW5GMXJ2T tag=S5FX5O8HXUSK type=write size=1294724 2024-09-12T00:09:35.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.571+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=AO4KTMCDO7XK type=del 2024-09-12T00:09:35.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.572+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=0QW5QF3QICWC type=del size=2973747 2024-09-12T00:09:35.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.573+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=RLPYX838QGQ3 type=del 2024-09-12T00:09:35.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.576+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~W1MYPA707VRP.0 size=97221 2024-09-12T00:09:35.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.576+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=W1MYPA707VRP tag=4SZPAA6CWWB1 type=write size=1145797 2024-09-12T00:09:35.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.577+0000 7f3dc2c18780 -1 < failed to complete operation key=2SO8HBZSAMRX tag=ML3UP2NPOHKM type=write size=1022247: (22) Invalid argument 2024-09-12T00:09:35.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.578+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=5RECVTJ93MKE type=del size=4013156 2024-09-12T00:09:35.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.579+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=7WK0G8I3OGRY type=del 2024-09-12T00:09:35.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.581+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~34PTR63VIOVQ.0 size=1048576 2024-09-12T00:09:35.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.582+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~34PTR63VIOVQ.1 size=706711 2024-09-12T00:09:35.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.582+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=34PTR63VIOVQ tag=90AV104JSHQ3 type=write size=2803863 2024-09-12T00:09:35.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.583+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=IO59GX4L2PAC type=del 2024-09-12T00:09:35.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.584+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=3R8FO7ZMW7U0 type=del size=2035562 2024-09-12T00:09:35.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.586+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~JH7GD13PPONM.0 size=1048576 2024-09-12T00:09:35.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.587+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~JH7GD13PPONM.1 size=831973 2024-09-12T00:09:35.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.588+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=JH7GD13PPONM tag=MATOQUF3H4CE type=write size=2929125 2024-09-12T00:09:35.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.591+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~464DLC1D02Q3.0 size=1048576 2024-09-12T00:09:35.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.591+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~464DLC1D02Q3.1 size=1048576 2024-09-12T00:09:35.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.592+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~464DLC1D02Q3.2 size=907594 2024-09-12T00:09:35.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.592+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=464DLC1D02Q3 tag=Q24SK07SM67A type=write size=4053322 2024-09-12T00:09:35.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.594+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=CMZ4Q2I4QZSR type=del 2024-09-12T00:09:35.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.596+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~U1HGJX29RD8R.0 size=1048576 2024-09-12T00:09:35.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.597+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~U1HGJX29RD8R.1 size=1048576 2024-09-12T00:09:35.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.598+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~U1HGJX29RD8R.2 size=393355 2024-09-12T00:09:35.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.598+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=U1HGJX29RD8R tag=FAUSCCKYWHT2 type=write size=3539083 2024-09-12T00:09:35.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.599+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=W6KSG9ZZTO1U type=del 2024-09-12T00:09:35.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.601+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~R83QO1HDCY2Y.0 size=64593 2024-09-12T00:09:35.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.601+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=R83QO1HDCY2Y tag=L48A4XDZCVSB type=write size=1113169 2024-09-12T00:09:35.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.602+0000 7f3dc2c18780 1 < completed write operation key=4POD73U0LAC0 tag=ZBT3NHYZNJCC type=write size=948986 2024-09-12T00:09:35.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.604+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=2R18JY316CBN type=del size=1155564 2024-09-12T00:09:35.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.605+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=BA5JLO819JCK type=del 2024-09-12T00:09:35.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.606+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=XL3MBJR2LZEP type=write size=301863 2024-09-12T00:09:35.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.608+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~3O2H7H8RKR60.0 size=1048576 2024-09-12T00:09:35.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.609+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~3O2H7H8RKR60.1 size=1048576 2024-09-12T00:09:35.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.610+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~3O2H7H8RKR60.2 size=940397 2024-09-12T00:09:35.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.612+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=3O2H7H8RKR60 tag=2JTGWM0CBRAR type=write size=4086125 2024-09-12T00:09:35.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.613+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=PH9L06H9ELKI type=del size=1658235 2024-09-12T00:09:35.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.615+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=BOTCRJRS1F7S type=del 2024-09-12T00:09:35.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.616+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=5CSF31Z9GKGZ type=del size=3144711 2024-09-12T00:09:35.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.617+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~P7HPL6BEH8NF.0 size=1048576 2024-09-12T00:09:35.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.617+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRBBH64CISJZ.2~P7HPL6BEH8NF.1 size=787544 2024-09-12T00:09:35.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.620+0000 7f3dc2c18780 1 < canceled multipart upload key=WRBBH64CISJZ upload=P7HPL6BEH8NF tag=4ZHYTOO27GKH type=write size=2884696 2024-09-12T00:09:35.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.622+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~WMEVPSQQC6UQ.0 size=414248 2024-09-12T00:09:35.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.622+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=WMEVPSQQC6UQ tag=ICQTK1GLUCX1 type=write size=1462824 2024-09-12T00:09:35.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.625+0000 7f3dc2c18780 1 < suggested remove operation key=KDHO7IEGICDA tag=R58XGWF9WA9B type=del 2024-09-12T00:09:35.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.626+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=VZESB1YA89Q4 type=del size=405347 2024-09-12T00:09:35.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.627+0000 7f3dc2c18780 1 < canceled operation key=OGRGDIUO2W8B tag=EVOQNVAZ77GH type=del size=3512328 2024-09-12T00:09:35.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.629+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=FF52Y71Y5GZB type=write size=809378 2024-09-12T00:09:35.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.630+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~KOIKW5GMXJ2T.0 size=246148 2024-09-12T00:09:35.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.632+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=KOIKW5GMXJ2T tag=S5FX5O8HXUSK type=write size=1294724 2024-09-12T00:09:35.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.633+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=8YVFKDO655A6 type=del size=1269686 2024-09-12T00:09:35.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.634+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=0QW5QF3QICWC type=del 2024-09-12T00:09:35.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.637+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~3EOZG2SYIJMF.0 size=1048576 2024-09-12T00:09:35.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.638+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~3EOZG2SYIJMF.1 size=1048576 2024-09-12T00:09:35.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.639+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~3EOZG2SYIJMF.2 size=745729 2024-09-12T00:09:35.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.639+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=3EOZG2SYIJMF tag=0927N23GTCXQ type=write size=3891457 2024-09-12T00:09:35.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.639+0000 7f3dc2c18780 1 < canceled part key=_multipart_L9C014T8YLNV.2~W1MYPA707VRP.0 size=97221 2024-09-12T00:09:35.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.641+0000 7f3dc2c18780 1 < canceled multipart upload key=L9C014T8YLNV upload=W1MYPA707VRP tag=4SZPAA6CWWB1 type=write size=1145797 2024-09-12T00:09:35.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.642+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=3S3WO3EKUUD2 type=del size=2146490 2024-09-12T00:09:35.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.644+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=5RECVTJ93MKE type=del 2024-09-12T00:09:35.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.645+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=EMWTRWKFL9VK type=write size=460449 2024-09-12T00:09:35.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.646+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~34PTR63VIOVQ.0 size=1048576 2024-09-12T00:09:35.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.647+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~34PTR63VIOVQ.1 size=706711 2024-09-12T00:09:35.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.649+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=34PTR63VIOVQ tag=90AV104JSHQ3 type=write size=2803863 2024-09-12T00:09:35.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.650+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=5IF2YBUF02VF type=del size=2169677 2024-09-12T00:09:35.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.652+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=3R8FO7ZMW7U0 type=del size=2035562 2024-09-12T00:09:35.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.654+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=DRW7R2C9PVP7 type=del size=2754223 2024-09-12T00:09:35.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.655+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~464DLC1D02Q3.0 size=1048576 2024-09-12T00:09:35.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.656+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~464DLC1D02Q3.1 size=1048576 2024-09-12T00:09:35.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.657+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~464DLC1D02Q3.2 size=907594 2024-09-12T00:09:35.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.659+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=464DLC1D02Q3 tag=Q24SK07SM67A type=write size=4053322 2024-09-12T00:09:35.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.660+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=Y3A8L4PWN99Y type=del size=903329 2024-09-12T00:09:35.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.661+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~U1HGJX29RD8R.0 size=1048576 2024-09-12T00:09:35.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.661+0000 7f3dc2c18780 1 < canceled part key=_multipart_25CF1N8J81Y9.2~U1HGJX29RD8R.1 size=1048576 2024-09-12T00:09:35.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.662+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~U1HGJX29RD8R.2 size=393355 2024-09-12T00:09:35.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.664+0000 7f3dc2c18780 1 < canceled multipart upload key=25CF1N8J81Y9 upload=U1HGJX29RD8R tag=FAUSCCKYWHT2 type=write size=3539083 2024-09-12T00:09:35.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.665+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=Y37M7RXBXEJ3 type=del size=1025706 2024-09-12T00:09:35.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.666+0000 7f3dc2c18780 1 < canceled part key=_multipart_OGRGDIUO2W8B.2~R83QO1HDCY2Y.0 size=64593 2024-09-12T00:09:35.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.667+0000 7f3dc2c18780 1 < canceled multipart upload key=OGRGDIUO2W8B upload=R83QO1HDCY2Y tag=L48A4XDZCVSB type=write size=1113169 2024-09-12T00:09:35.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.669+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=TDX0JSRMALCP type=del size=831903 2024-09-12T00:09:35.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.670+0000 7f3dc2c18780 -1 < failed to complete operation key=KDHO7IEGICDA tag=2R18JY316CBN type=del size=1155564: (22) Invalid argument 2024-09-12T00:09:35.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.673+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~1OJZIEQDZ2L4.0 size=1048576 2024-09-12T00:09:35.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.674+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~1OJZIEQDZ2L4.1 size=1048576 2024-09-12T00:09:35.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.675+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~1OJZIEQDZ2L4.2 size=762084 2024-09-12T00:09:35.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.675+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=1OJZIEQDZ2L4 tag=8XNDTKR3Y3G4 type=write size=3907812 2024-09-12T00:09:35.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.676+0000 7f3dc2c18780 1 < completed write operation key=0ICU4WV9K1RG tag=XL3MBJR2LZEP type=write size=301863 2024-09-12T00:09:35.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.677+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=64WQPVCJWC5V type=del size=2034204 2024-09-12T00:09:35.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.678+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=PH9L06H9ELKI type=del 2024-09-12T00:09:35.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.680+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=LOKKJB2POAI9 type=del size=2292085 2024-09-12T00:09:35.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.681+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=5CSF31Z9GKGZ type=del 2024-09-12T00:09:35.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.683+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~L2BAJXQ6IP22.0 size=1048576 2024-09-12T00:09:35.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.684+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~L2BAJXQ6IP22.1 size=1048576 2024-09-12T00:09:35.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.685+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~L2BAJXQ6IP22.2 size=91336 2024-09-12T00:09:35.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.685+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=L2BAJXQ6IP22 tag=0GU36LTGEIH0 type=write size=3237064 2024-09-12T00:09:35.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.686+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~WMEVPSQQC6UQ.0 size=414248 2024-09-12T00:09:35.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.688+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=WMEVPSQQC6UQ tag=ICQTK1GLUCX1 type=write size=1462824 2024-09-12T00:09:35.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.690+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=FI24ABY3BKJ6 type=del size=1643127 2024-09-12T00:09:35.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.691+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=VZESB1YA89Q4 type=del 2024-09-12T00:09:35.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.692+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=YQV5BWI2F84T type=write size=764127 2024-09-12T00:09:35.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.693+0000 7f3dc2c18780 1 < completed write operation key=UJDQEIAIRVDW tag=FF52Y71Y5GZB type=write size=809378 2024-09-12T00:09:35.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.696+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~ZCXHL7QKHXV6.0 size=1048576 2024-09-12T00:09:35.695 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.697+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~ZCXHL7QKHXV6.1 size=1048576 2024-09-12T00:09:35.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.698+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~ZCXHL7QKHXV6.2 size=11636 2024-09-12T00:09:35.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.698+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=ZCXHL7QKHXV6 tag=2WRLVC2DD0IA type=write size=3157364 2024-09-12T00:09:35.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.700+0000 7f3dc2c18780 1 < suggested update operation key=U2H0A1GZROT7 tag=8YVFKDO655A6 type=del size=1269686 2024-09-12T00:09:35.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.701+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=SEFFY3KY7YH9 type=del size=2508593 2024-09-12T00:09:35.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.703+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~3EOZG2SYIJMF.0 size=1048576 2024-09-12T00:09:35.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.704+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~3EOZG2SYIJMF.1 size=1048576 2024-09-12T00:09:35.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.705+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~3EOZG2SYIJMF.2 size=745729 2024-09-12T00:09:35.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.707+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=3EOZG2SYIJMF tag=0927N23GTCXQ type=write size=3891457 2024-09-12T00:09:35.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.709+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~8G6841UJC8LQ.0 size=1048576 2024-09-12T00:09:35.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.710+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~8G6841UJC8LQ.1 size=1048576 2024-09-12T00:09:35.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.711+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~8G6841UJC8LQ.2 size=200994 2024-09-12T00:09:35.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.711+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=8G6841UJC8LQ tag=E8UQ042BHRZR type=write size=3346722 2024-09-12T00:09:35.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.712+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=3S3WO3EKUUD2 type=del 2024-09-12T00:09:35.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.714+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~UJ8AAXPVTGKD.0 size=501533 2024-09-12T00:09:35.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.714+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=UJ8AAXPVTGKD tag=74K327X6L9VS type=write size=1550109 2024-09-12T00:09:35.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.715+0000 7f3dc2c18780 1 < completed write operation key=5F0BB9U7Y6ZZ tag=EMWTRWKFL9VK type=write size=460449 2024-09-12T00:09:35.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.718+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~SHLKYOYOJQBN.0 size=1048576 2024-09-12T00:09:35.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.718+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~SHLKYOYOJQBN.1 size=1048576 2024-09-12T00:09:35.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.719+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~SHLKYOYOJQBN.2 size=573562 2024-09-12T00:09:35.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.719+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=SHLKYOYOJQBN tag=DZG7H2LXL3Q0 type=write size=3719290 2024-09-12T00:09:35.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.721+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=5IF2YBUF02VF type=del 2024-09-12T00:09:35.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.722+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=K0JNSDK55RJC type=del size=1691731 2024-09-12T00:09:35.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.723+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=DRW7R2C9PVP7 type=del 2024-09-12T00:09:35.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.724+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=8VRRN44TVL1F type=del size=3990348 2024-09-12T00:09:35.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.726+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=Y3A8L4PWN99Y type=del 2024-09-12T00:09:35.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.727+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=RVAWXHC0OHB8 type=del size=1565369 2024-09-12T00:09:35.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.728+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=Y37M7RXBXEJ3 type=del 2024-09-12T00:09:35.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.729+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=65LC36OQMGTX type=del size=863708 2024-09-12T00:09:35.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.732+0000 7f3dc2c18780 1 < suggested remove operation key=XNZNORKYEOPV tag=TDX0JSRMALCP type=del 2024-09-12T00:09:35.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.733+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=50YC5B7Y449B type=del size=424685 2024-09-12T00:09:35.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.735+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~1OJZIEQDZ2L4.0 size=1048576 2024-09-12T00:09:35.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.736+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~1OJZIEQDZ2L4.1 size=1048576 2024-09-12T00:09:35.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.737+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~1OJZIEQDZ2L4.2 size=762084 2024-09-12T00:09:35.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.739+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=1OJZIEQDZ2L4 tag=8XNDTKR3Y3G4 type=write size=3907812 2024-09-12T00:09:35.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.740+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=15LIYE119BES type=del size=1023646 2024-09-12T00:09:35.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.741+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=64WQPVCJWC5V type=del 2024-09-12T00:09:35.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.742+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=VPRSDMNVDQOA type=del size=3196574 2024-09-12T00:09:35.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.744+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=LOKKJB2POAI9 type=del 2024-09-12T00:09:35.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.746+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~4AWXPISFVZR3.0 size=1048576 2024-09-12T00:09:35.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.747+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~4AWXPISFVZR3.1 size=1048576 2024-09-12T00:09:35.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.748+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~4AWXPISFVZR3.2 size=842749 2024-09-12T00:09:35.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.748+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=4AWXPISFVZR3 tag=SFGP1E4IFA29 type=write size=3988477 2024-09-12T00:09:35.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.748+0000 7f3dc2c18780 1 < canceled part key=_multipart_U2H0A1GZROT7.2~L2BAJXQ6IP22.0 size=1048576 2024-09-12T00:09:35.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.749+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~L2BAJXQ6IP22.1 size=1048576 2024-09-12T00:09:35.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.750+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~L2BAJXQ6IP22.2 size=91336 2024-09-12T00:09:35.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.752+0000 7f3dc2c18780 1 < canceled multipart upload key=U2H0A1GZROT7 upload=L2BAJXQ6IP22 tag=0GU36LTGEIH0 type=write size=3237064 2024-09-12T00:09:35.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.754+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~791GU9QMYSYJ.0 size=1048576 2024-09-12T00:09:35.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.755+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~791GU9QMYSYJ.1 size=55843 2024-09-12T00:09:35.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.755+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=791GU9QMYSYJ tag=K3UB44SRWFBW type=write size=2152995 2024-09-12T00:09:35.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.756+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=FI24ABY3BKJ6 type=del 2024-09-12T00:09:35.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.759+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~SRYAG86FF8YV.0 size=1048576 2024-09-12T00:09:35.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.760+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~SRYAG86FF8YV.1 size=448704 2024-09-12T00:09:35.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.760+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=SRYAG86FF8YV tag=7WJ8VE919OIK type=write size=2545856 2024-09-12T00:09:35.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.761+0000 7f3dc2c18780 1 < completed write operation key=KQWXE62PF5F7 tag=YQV5BWI2F84T type=write size=764127 2024-09-12T00:09:35.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.762+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=DSX6ZK55PIP2 type=write size=738823 2024-09-12T00:09:35.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.763+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~ZCXHL7QKHXV6.0 size=1048576 2024-09-12T00:09:35.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.764+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~ZCXHL7QKHXV6.1 size=1048576 2024-09-12T00:09:35.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.765+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~ZCXHL7QKHXV6.2 size=11636 2024-09-12T00:09:35.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.768+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=ZCXHL7QKHXV6 tag=2WRLVC2DD0IA type=write size=3157364 2024-09-12T00:09:35.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.770+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~FB68FQ1A8F7A.0 size=734993 2024-09-12T00:09:35.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.770+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=FB68FQ1A8F7A tag=DV98ZMBEX6I3 type=write size=1783569 2024-09-12T00:09:35.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.771+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=SEFFY3KY7YH9 type=del 2024-09-12T00:09:35.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.773+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~63RCZ6SUZ57Z.0 size=1048576 2024-09-12T00:09:35.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.774+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~63RCZ6SUZ57Z.1 size=837189 2024-09-12T00:09:35.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.774+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=63RCZ6SUZ57Z tag=VCREA2I4T0HL type=write size=2934341 2024-09-12T00:09:35.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.776+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~8G6841UJC8LQ.0 size=1048576 2024-09-12T00:09:35.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.777+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~8G6841UJC8LQ.1 size=1048576 2024-09-12T00:09:35.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.778+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~8G6841UJC8LQ.2 size=200994 2024-09-12T00:09:35.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.780+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=8G6841UJC8LQ tag=E8UQ042BHRZR type=write size=3346722 2024-09-12T00:09:35.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.781+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=42PX9E3VNM3W type=del size=128462 2024-09-12T00:09:35.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.782+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~UJ8AAXPVTGKD.0 size=501533 2024-09-12T00:09:35.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.784+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=UJ8AAXPVTGKD tag=74K327X6L9VS type=write size=1550109 2024-09-12T00:09:35.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.786+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=KR4H1IQHN947 type=del size=1218427 2024-09-12T00:09:35.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.787+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~SHLKYOYOJQBN.0 size=1048576 2024-09-12T00:09:35.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.788+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~SHLKYOYOJQBN.1 size=1048576 2024-09-12T00:09:35.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.788+0000 7f3dc2c18780 1 < canceled part key=_multipart_5MAV2RJ4E31S.2~SHLKYOYOJQBN.2 size=573562 2024-09-12T00:09:35.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.790+0000 7f3dc2c18780 1 < canceled multipart upload key=5MAV2RJ4E31S upload=SHLKYOYOJQBN tag=DZG7H2LXL3Q0 type=write size=3719290 2024-09-12T00:09:35.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.793+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~YUJMOJUD2HJW.0 size=1048576 2024-09-12T00:09:35.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.793+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~YUJMOJUD2HJW.1 size=1048576 2024-09-12T00:09:35.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.794+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~YUJMOJUD2HJW.2 size=541987 2024-09-12T00:09:35.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.794+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=YUJMOJUD2HJW tag=ZRC4EZ1H745E type=write size=3687715 2024-09-12T00:09:35.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.797+0000 7f3dc2c18780 1 < suggested update operation key=U2H0A1GZROT7 tag=K0JNSDK55RJC type=del size=1691731 2024-09-12T00:09:35.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.799+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~T0UKE615RN28.0 size=398335 2024-09-12T00:09:35.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.799+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=T0UKE615RN28 tag=X1PZ6UG0KOI6 type=write size=1446911 2024-09-12T00:09:35.800 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.801+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=8VRRN44TVL1F type=del 2024-09-12T00:09:35.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.803+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~2M90PWZ1Q5HP.0 size=845966 2024-09-12T00:09:35.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.803+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=2M90PWZ1Q5HP tag=3LDZ4PPAH1KJ type=write size=1894542 2024-09-12T00:09:35.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.805+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=RVAWXHC0OHB8 type=del 2024-09-12T00:09:35.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.806+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=MFBSK3U3Q0JT type=del size=2183634 2024-09-12T00:09:35.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.808+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=65LC36OQMGTX type=del 2024-09-12T00:09:35.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.809+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=L3ZPZBWZH1G3 type=write size=754359 2024-09-12T00:09:35.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.810+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=50YC5B7Y449B type=del 2024-09-12T00:09:35.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.812+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~IC57LA5X2FEE.0 size=790737 2024-09-12T00:09:35.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.812+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=IC57LA5X2FEE tag=9IGZ8R8JNEK6 type=write size=1839313 2024-09-12T00:09:35.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.813+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=15LIYE119BES type=del 2024-09-12T00:09:35.813 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.815+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=1V5NU3PNVDZC type=del size=3284845 2024-09-12T00:09:35.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.816+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=VPRSDMNVDQOA type=del 2024-09-12T00:09:35.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.817+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=OY439CHDGDDY type=del size=4003343 2024-09-12T00:09:35.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.819+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~4AWXPISFVZR3.0 size=1048576 2024-09-12T00:09:35.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.820+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~4AWXPISFVZR3.1 size=1048576 2024-09-12T00:09:35.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.821+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~4AWXPISFVZR3.2 size=842749 2024-09-12T00:09:35.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.823+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=4AWXPISFVZR3 tag=SFGP1E4IFA29 type=write size=3988477 2024-09-12T00:09:35.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.824+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=OTDHNQCGX3O1 type=del size=2342979 2024-09-12T00:09:35.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.825+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~791GU9QMYSYJ.0 size=1048576 2024-09-12T00:09:35.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.826+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~791GU9QMYSYJ.1 size=55843 2024-09-12T00:09:35.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.828+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=791GU9QMYSYJ tag=K3UB44SRWFBW type=write size=2152995 2024-09-12T00:09:35.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.830+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~JHK9TSX9TZBZ.0 size=1048576 2024-09-12T00:09:35.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.831+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~JHK9TSX9TZBZ.1 size=1048576 2024-09-12T00:09:35.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.832+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~JHK9TSX9TZBZ.2 size=922301 2024-09-12T00:09:35.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.832+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=JHK9TSX9TZBZ tag=WBDDPNRHNOYI type=write size=4068029 2024-09-12T00:09:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.833+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~SRYAG86FF8YV.0 size=1048576 2024-09-12T00:09:35.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.834+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~SRYAG86FF8YV.1 size=448704 2024-09-12T00:09:35.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.836+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=SRYAG86FF8YV tag=7WJ8VE919OIK type=write size=2545856 2024-09-12T00:09:35.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.839+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~7VITVS7080B6.0 size=856522 2024-09-12T00:09:35.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.839+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=7VITVS7080B6 tag=1G028FFHC1RK type=write size=1905098 2024-09-12T00:09:35.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.840+0000 7f3dc2c18780 1 < canceled operation key=3WUIB2OMX77J tag=DSX6ZK55PIP2 type=write size=738823 2024-09-12T00:09:35.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.841+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=F3FAFU2IJUAA type=write size=257293 2024-09-12T00:09:35.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.843+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~FB68FQ1A8F7A.0 size=734993 2024-09-12T00:09:35.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.845+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=FB68FQ1A8F7A tag=DV98ZMBEX6I3 type=write size=1783569 2024-09-12T00:09:35.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.846+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=DNFOZ9IWOWW7 type=write size=988569 2024-09-12T00:09:35.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.847+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~63RCZ6SUZ57Z.0 size=1048576 2024-09-12T00:09:35.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.849+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~63RCZ6SUZ57Z.1 size=837189 2024-09-12T00:09:35.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.851+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=63RCZ6SUZ57Z tag=VCREA2I4T0HL type=write size=2934341 2024-09-12T00:09:35.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.853+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=23DNZ65X6AVZ type=write size=776590 2024-09-12T00:09:35.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.854+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=42PX9E3VNM3W type=del 2024-09-12T00:09:35.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.855+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=1CUDVCF54LY2 type=del size=17992 2024-09-12T00:09:35.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.857+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=KR4H1IQHN947 type=del 2024-09-12T00:09:35.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.859+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~YWMPVFZCHIYS.0 size=258549 2024-09-12T00:09:35.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.859+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=YWMPVFZCHIYS tag=U002TPZZ8Z3C type=write size=1307125 2024-09-12T00:09:35.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.861+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~YUJMOJUD2HJW.0 size=1048576 2024-09-12T00:09:35.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.862+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~YUJMOJUD2HJW.1 size=1048576 2024-09-12T00:09:35.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.863+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~YUJMOJUD2HJW.2 size=541987 2024-09-12T00:09:35.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.865+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=YUJMOJUD2HJW tag=ZRC4EZ1H745E type=write size=3687715 2024-09-12T00:09:35.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.866+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=9JETNQZ5GZD3 type=del size=960944 2024-09-12T00:09:35.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.867+0000 7f3dc2c18780 1 < canceled part key=_multipart_U2H0A1GZROT7.2~T0UKE615RN28.0 size=398335 2024-09-12T00:09:35.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.869+0000 7f3dc2c18780 1 < canceled multipart upload key=U2H0A1GZROT7 upload=T0UKE615RN28 tag=X1PZ6UG0KOI6 type=write size=1446911 2024-09-12T00:09:35.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.871+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~0PVMVUZLD0LZ.0 size=1048576 2024-09-12T00:09:35.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.873+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~0PVMVUZLD0LZ.1 size=390007 2024-09-12T00:09:35.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.873+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=0PVMVUZLD0LZ tag=478AA4894QY2 type=write size=2487159 2024-09-12T00:09:35.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.874+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~2M90PWZ1Q5HP.0 size=845966 2024-09-12T00:09:35.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.876+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=2M90PWZ1Q5HP tag=3LDZ4PPAH1KJ type=write size=1894542 2024-09-12T00:09:35.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.877+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=13UTVDD7G0KL type=write size=120151 2024-09-12T00:09:35.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.878+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=MFBSK3U3Q0JT type=del 2024-09-12T00:09:35.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.880+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=737Q32Z7CDCO type=del size=4010707 2024-09-12T00:09:35.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.881+0000 7f3dc2c18780 1 < completed write operation key=5BM1TMLRBHTS tag=L3ZPZBWZH1G3 type=write size=754359 2024-09-12T00:09:35.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.883+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~FQJL6IHI2825.0 size=1048576 2024-09-12T00:09:35.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.884+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~FQJL6IHI2825.1 size=1048576 2024-09-12T00:09:35.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.885+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~FQJL6IHI2825.2 size=447494 2024-09-12T00:09:35.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.885+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=FQJL6IHI2825 tag=591S2RMBL3W4 type=write size=3593222 2024-09-12T00:09:35.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.886+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~IC57LA5X2FEE.0 size=790737 2024-09-12T00:09:35.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.888+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=IC57LA5X2FEE tag=9IGZ8R8JNEK6 type=write size=1839313 2024-09-12T00:09:35.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.890+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=YLXQVFCL8IB1 type=del size=1226829 2024-09-12T00:09:35.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.891+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=1V5NU3PNVDZC type=del 2024-09-12T00:09:35.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.893+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~TQ6QLAF2M73L.0 size=1001859 2024-09-12T00:09:35.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.893+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=TQ6QLAF2M73L tag=00LFOETPX3XE type=write size=2050435 2024-09-12T00:09:35.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.895+0000 7f3dc2c18780 1 < suggested remove operation key=V0K5FRKYGJ0K tag=OY439CHDGDDY type=del 2024-09-12T00:09:35.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.898+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~TSLPJ9FSAZX8.0 size=1048576 2024-09-12T00:09:35.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.899+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~TSLPJ9FSAZX8.1 size=413676 2024-09-12T00:09:35.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.899+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=TSLPJ9FSAZX8 tag=966AI2W2SPXJ type=write size=2510828 2024-09-12T00:09:35.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.900+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=OTDHNQCGX3O1 type=del 2024-09-12T00:09:35.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.902+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~WZC0K3BV0SN0.0 size=1048576 2024-09-12T00:09:35.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.903+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~WZC0K3BV0SN0.1 size=486134 2024-09-12T00:09:35.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.903+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=WZC0K3BV0SN0 tag=YPWNQG7YDBHU type=write size=2583286 2024-09-12T00:09:35.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.905+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~JHK9TSX9TZBZ.0 size=1048576 2024-09-12T00:09:35.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.906+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~JHK9TSX9TZBZ.1 size=1048576 2024-09-12T00:09:35.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.907+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~JHK9TSX9TZBZ.2 size=922301 2024-09-12T00:09:35.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.909+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=JHK9TSX9TZBZ tag=WBDDPNRHNOYI type=write size=4068029 2024-09-12T00:09:35.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.910+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=346DDWF38E2V type=del size=2840604 2024-09-12T00:09:35.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.911+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~7VITVS7080B6.0 size=856522 2024-09-12T00:09:35.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.914+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=7VITVS7080B6 tag=1G028FFHC1RK type=write size=1905098 2024-09-12T00:09:35.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.916+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~GSJ6CH1A172Q.0 size=1048576 2024-09-12T00:09:35.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.917+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~GSJ6CH1A172Q.1 size=820039 2024-09-12T00:09:35.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.917+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=GSJ6CH1A172Q tag=WWYOTBERZXFM type=write size=2917191 2024-09-12T00:09:35.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.918+0000 7f3dc2c18780 1 < completed write operation key=25CF1N8J81Y9 tag=F3FAFU2IJUAA type=write size=257293 2024-09-12T00:09:35.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.920+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~OOW4VW3MOP0S.0 size=1048576 2024-09-12T00:09:35.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.921+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~OOW4VW3MOP0S.1 size=503318 2024-09-12T00:09:35.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.921+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=OOW4VW3MOP0S tag=8SUMBQVWKE0J type=write size=2600470 2024-09-12T00:09:35.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.923+0000 7f3dc2c18780 1 < completed write operation key=5MAV2RJ4E31S tag=DNFOZ9IWOWW7 type=write size=988569 2024-09-12T00:09:35.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.924+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=2EMB1SJE1Q53 type=del size=870972 2024-09-12T00:09:35.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.926+0000 7f3dc2c18780 1 < suggested remove operation key=5F0BB9U7Y6ZZ tag=23DNZ65X6AVZ type=write 2024-09-12T00:09:35.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.928+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=TJKLGH9KUJSY type=del size=569525 2024-09-12T00:09:35.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.929+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=1CUDVCF54LY2 type=del 2024-09-12T00:09:35.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.931+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~3LYT2P0IIR3A.0 size=1048576 2024-09-12T00:09:35.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.932+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~3LYT2P0IIR3A.1 size=1048576 2024-09-12T00:09:35.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.933+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~3LYT2P0IIR3A.2 size=912334 2024-09-12T00:09:35.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.933+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=3LYT2P0IIR3A tag=P4DT0E4F8D52 type=write size=4058062 2024-09-12T00:09:35.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.934+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~YWMPVFZCHIYS.0 size=258549 2024-09-12T00:09:35.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.936+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=YWMPVFZCHIYS tag=U002TPZZ8Z3C type=write size=1307125 2024-09-12T00:09:35.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.937+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=6QZQ08GLMPJD type=del size=2291582 2024-09-12T00:09:35.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.938+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=9JETNQZ5GZD3 type=del 2024-09-12T00:09:35.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.940+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=JGKP51WDN39K type=del size=3485656 2024-09-12T00:09:35.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.940+0000 7f3dc2c18780 1 < canceled part key=_multipart_0ICU4WV9K1RG.2~0PVMVUZLD0LZ.0 size=1048576 2024-09-12T00:09:35.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.941+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~0PVMVUZLD0LZ.1 size=390007 2024-09-12T00:09:35.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.943+0000 7f3dc2c18780 1 < canceled multipart upload key=0ICU4WV9K1RG upload=0PVMVUZLD0LZ tag=478AA4894QY2 type=write size=2487159 2024-09-12T00:09:35.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.944+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=M737G7O9XC01 type=del size=3613048 2024-09-12T00:09:35.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.945+0000 7f3dc2c18780 1 < completed write operation key=Y40G8SLO6AVH tag=13UTVDD7G0KL type=write size=120151 2024-09-12T00:09:35.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.946+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=Y1JPC63EN9ZJ type=del size=932486 2024-09-12T00:09:35.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.949+0000 7f3dc2c18780 1 < suggested remove operation key=GP3MLWX9586T tag=737Q32Z7CDCO type=del 2024-09-12T00:09:35.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.950+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=W99F1U3GA90F type=del size=117075 2024-09-12T00:09:35.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.951+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~FQJL6IHI2825.0 size=1048576 2024-09-12T00:09:35.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.952+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~FQJL6IHI2825.1 size=1048576 2024-09-12T00:09:35.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.953+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~FQJL6IHI2825.2 size=447494 2024-09-12T00:09:35.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.955+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=FQJL6IHI2825 tag=591S2RMBL3W4 type=write size=3593222 2024-09-12T00:09:35.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.957+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~7YIMXUDZ6GKY.0 size=1048576 2024-09-12T00:09:35.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.958+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~7YIMXUDZ6GKY.1 size=1048576 2024-09-12T00:09:35.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.959+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~7YIMXUDZ6GKY.2 size=238737 2024-09-12T00:09:35.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.959+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=7YIMXUDZ6GKY tag=QVINYGR02SX6 type=write size=3384465 2024-09-12T00:09:35.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.960+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=YLXQVFCL8IB1 type=del 2024-09-12T00:09:35.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.962+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~LO383IXXJUG6.0 size=1048576 2024-09-12T00:09:35.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.964+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~LO383IXXJUG6.1 size=946427 2024-09-12T00:09:35.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.964+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=LO383IXXJUG6 tag=P0Z8PBFEWGHJ type=write size=3043579 2024-09-12T00:09:35.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.965+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~TQ6QLAF2M73L.0 size=1001859 2024-09-12T00:09:35.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.967+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=TQ6QLAF2M73L tag=00LFOETPX3XE type=write size=2050435 2024-09-12T00:09:35.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.970+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~W3LWP5TETU51.0 size=1048576 2024-09-12T00:09:35.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.971+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~W3LWP5TETU51.1 size=1040177 2024-09-12T00:09:35.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.971+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=W3LWP5TETU51 tag=Q86DM9LPSTK5 type=write size=3137329 2024-09-12T00:09:35.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.971+0000 7f3dc2c18780 1 < canceled part key=_multipart_4POD73U0LAC0.2~TSLPJ9FSAZX8.0 size=1048576 2024-09-12T00:09:35.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.972+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~TSLPJ9FSAZX8.1 size=413676 2024-09-12T00:09:35.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.974+0000 7f3dc2c18780 1 < canceled multipart upload key=4POD73U0LAC0 upload=TSLPJ9FSAZX8 tag=966AI2W2SPXJ type=write size=2510828 2024-09-12T00:09:35.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.976+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~SETZ195XV09J.0 size=1048576 2024-09-12T00:09:35.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.977+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~SETZ195XV09J.1 size=563709 2024-09-12T00:09:35.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.977+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=SETZ195XV09J tag=EFF69HENDZCZ type=write size=2660861 2024-09-12T00:09:35.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.979+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~WZC0K3BV0SN0.0 size=1048576 2024-09-12T00:09:35.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.979+0000 7f3dc2c18780 1 < canceled part key=_multipart_V0K5FRKYGJ0K.2~WZC0K3BV0SN0.1 size=486134 2024-09-12T00:09:35.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.981+0000 7f3dc2c18780 1 < canceled multipart upload key=V0K5FRKYGJ0K upload=WZC0K3BV0SN0 tag=YPWNQG7YDBHU type=write size=2583286 2024-09-12T00:09:35.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.982+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=JOAE0GW41JI3 type=del size=3623290 2024-09-12T00:09:35.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.983+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=346DDWF38E2V type=del 2024-09-12T00:09:35.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.985+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~HNHO012TIBV4.0 size=1048576 2024-09-12T00:09:35.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.986+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~HNHO012TIBV4.1 size=449621 2024-09-12T00:09:35.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.986+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=HNHO012TIBV4 tag=BIZJJO2XWUDN type=write size=2546773 2024-09-12T00:09:35.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.988+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~GSJ6CH1A172Q.0 size=1048576 2024-09-12T00:09:35.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.989+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~GSJ6CH1A172Q.1 size=820039 2024-09-12T00:09:35.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.991+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=GSJ6CH1A172Q tag=WWYOTBERZXFM type=write size=2917191 2024-09-12T00:09:35.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.992+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=M5JV87S6S23I type=del size=1469701 2024-09-12T00:09:35.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.993+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~OOW4VW3MOP0S.0 size=1048576 2024-09-12T00:09:35.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.994+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~OOW4VW3MOP0S.1 size=503318 2024-09-12T00:09:35.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.996+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=OOW4VW3MOP0S tag=8SUMBQVWKE0J type=write size=2600470 2024-09-12T00:09:35.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.997+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=65FQINWHLQMO type=del size=3400694 2024-09-12T00:09:35.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:35.999+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=2EMB1SJE1Q53 type=del 2024-09-12T00:09:35.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.000+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=Z3LUSP0B2UCE type=del size=1129371 2024-09-12T00:09:36.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.001+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=TJKLGH9KUJSY type=del 2024-09-12T00:09:36.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.002+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=81GR2DEG5HIN type=del size=556971 2024-09-12T00:09:36.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.004+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~3LYT2P0IIR3A.0 size=1048576 2024-09-12T00:09:36.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.005+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~3LYT2P0IIR3A.1 size=1048576 2024-09-12T00:09:36.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.008+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~3LYT2P0IIR3A.2 size=912334 2024-09-12T00:09:36.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.015+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=3LYT2P0IIR3A tag=P4DT0E4F8D52 type=write size=4058062 2024-09-12T00:09:36.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.016+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=24KUJPUHE78A type=del size=2617593 2024-09-12T00:09:36.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.017+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=6QZQ08GLMPJD type=del 2024-09-12T00:09:36.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.019+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=FUKECA5Y1BYC type=del size=3968349 2024-09-12T00:09:36.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.020+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=JGKP51WDN39K type=del 2024-09-12T00:09:36.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.021+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=6UXIA5R6FOMG type=del size=211758 2024-09-12T00:09:36.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.022+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=M737G7O9XC01 type=del 2024-09-12T00:09:36.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.024+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=2ZWQS2BOH5DO type=write size=766495 2024-09-12T00:09:36.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.025+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=Y1JPC63EN9ZJ type=del 2024-09-12T00:09:36.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.026+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=ZRIWJ8EM3G06 type=del size=746244 2024-09-12T00:09:36.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.027+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=W99F1U3GA90F type=del 2024-09-12T00:09:36.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.028+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=19N983S4USWL type=del size=1151593 2024-09-12T00:09:36.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.030+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~7YIMXUDZ6GKY.0 size=1048576 2024-09-12T00:09:36.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.031+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~7YIMXUDZ6GKY.1 size=1048576 2024-09-12T00:09:36.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.032+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~7YIMXUDZ6GKY.2 size=238737 2024-09-12T00:09:36.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.034+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=7YIMXUDZ6GKY tag=QVINYGR02SX6 type=write size=3384465 2024-09-12T00:09:36.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.036+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~ZKER03LT273R.0 size=291621 2024-09-12T00:09:36.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.036+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=ZKER03LT273R tag=9FDYLJMXGJ6X type=write size=1340197 2024-09-12T00:09:36.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.037+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~LO383IXXJUG6.0 size=1048576 2024-09-12T00:09:36.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.038+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~LO383IXXJUG6.1 size=946427 2024-09-12T00:09:36.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.040+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=LO383IXXJUG6 tag=P0Z8PBFEWGHJ type=write size=3043579 2024-09-12T00:09:36.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.042+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=RRSZY5V6T2ER type=del size=4031311 2024-09-12T00:09:36.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.043+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~W3LWP5TETU51.0 size=1048576 2024-09-12T00:09:36.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.045+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~W3LWP5TETU51.1 size=1040177 2024-09-12T00:09:36.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.047+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=W3LWP5TETU51 tag=Q86DM9LPSTK5 type=write size=3137329 2024-09-12T00:09:36.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.048+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=1JLZYWNJXUE4 type=del size=3253004 2024-09-12T00:09:36.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.049+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~SETZ195XV09J.0 size=1048576 2024-09-12T00:09:36.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.051+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~SETZ195XV09J.1 size=563709 2024-09-12T00:09:36.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.053+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=SETZ195XV09J tag=EFF69HENDZCZ type=write size=2660861 2024-09-12T00:09:36.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.054+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=DI173E76RYM8 type=write size=556395 2024-09-12T00:09:36.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.057+0000 7f3dc2c18780 1 < suggested update operation key=415OYT4ML329 tag=JOAE0GW41JI3 type=del size=3623290 2024-09-12T00:09:36.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.059+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=ONXFMF93WAKY type=write size=553522 2024-09-12T00:09:36.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.060+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~HNHO012TIBV4.0 size=1048576 2024-09-12T00:09:36.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.061+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~HNHO012TIBV4.1 size=449621 2024-09-12T00:09:36.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.063+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=HNHO012TIBV4 tag=BIZJJO2XWUDN type=write size=2546773 2024-09-12T00:09:36.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.065+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=AR4GO1QBFG9I type=write size=576142 2024-09-12T00:09:36.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.067+0000 7f3dc2c18780 1 < suggested update operation key=4POD73U0LAC0 tag=M5JV87S6S23I type=del size=1469701 2024-09-12T00:09:36.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.069+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~8G0CWIZ7PKFW.0 size=321029 2024-09-12T00:09:36.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.069+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=8G0CWIZ7PKFW tag=SL563SJMQQJY type=write size=1369605 2024-09-12T00:09:36.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.070+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=65FQINWHLQMO type=del 2024-09-12T00:09:36.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.071+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=PMIZVZYK6UC2 type=del size=1022695 2024-09-12T00:09:36.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.073+0000 7f3dc2c18780 1 < canceled operation key=C7ZOCTAR2BEP tag=Z3LUSP0B2UCE type=del size=1129371 2024-09-12T00:09:36.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.075+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~KYZBORFKJV86.0 size=1048576 2024-09-12T00:09:36.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.076+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~KYZBORFKJV86.1 size=271495 2024-09-12T00:09:36.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.076+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=KYZBORFKJV86 tag=OY95J1R16G7X type=write size=2368647 2024-09-12T00:09:36.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.077+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=81GR2DEG5HIN type=del 2024-09-12T00:09:36.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.079+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~DX8EMGU83K9P.0 size=444856 2024-09-12T00:09:36.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.079+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=DX8EMGU83K9P tag=E71SPOQ7P228 type=write size=1493432 2024-09-12T00:09:36.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.080+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=24KUJPUHE78A type=del 2024-09-12T00:09:36.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.081+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=RVTXB0U49ICY type=del size=4090714 2024-09-12T00:09:36.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.083+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=FUKECA5Y1BYC type=del 2024-09-12T00:09:36.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.084+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=8SKC16KNS8J3 type=del size=1502999 2024-09-12T00:09:36.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.086+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=6UXIA5R6FOMG type=del 2024-09-12T00:09:36.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.089+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~YWII6V2DYQD9.0 size=508308 2024-09-12T00:09:36.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.089+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=YWII6V2DYQD9 tag=QHI2GXU4AL2G type=write size=1556884 2024-09-12T00:09:36.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.090+0000 7f3dc2c18780 1 < completed write operation key=5BM1TMLRBHTS tag=2ZWQS2BOH5DO type=write size=766495 2024-09-12T00:09:36.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.093+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=K1PH0Y1JIL4J type=del size=3070503 2024-09-12T00:09:36.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.094+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=ZRIWJ8EM3G06 type=del 2024-09-12T00:09:36.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.095+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=QNRV0LMPBWKT type=write size=505781 2024-09-12T00:09:36.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.097+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=19N983S4USWL type=del 2024-09-12T00:09:36.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.099+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~I9D5H15UHTHO.0 size=1048576 2024-09-12T00:09:36.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.100+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~I9D5H15UHTHO.1 size=464876 2024-09-12T00:09:36.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.100+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=I9D5H15UHTHO tag=KH014YVTKQJQ type=write size=2562028 2024-09-12T00:09:36.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.101+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~ZKER03LT273R.0 size=291621 2024-09-12T00:09:36.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.103+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=ZKER03LT273R tag=9FDYLJMXGJ6X type=write size=1340197 2024-09-12T00:09:36.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.105+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=R7DLXM9O09DH type=del size=3130188 2024-09-12T00:09:36.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.106+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=RRSZY5V6T2ER type=del 2024-09-12T00:09:36.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.108+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~K6G9Z3T8ZF3U.0 size=1048576 2024-09-12T00:09:36.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.109+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~K6G9Z3T8ZF3U.1 size=1048576 2024-09-12T00:09:36.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.110+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~K6G9Z3T8ZF3U.2 size=351970 2024-09-12T00:09:36.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.110+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=K6G9Z3T8ZF3U tag=9BNL3WAGH5G6 type=write size=3497698 2024-09-12T00:09:36.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.112+0000 7f3dc2c18780 1 < suggested remove operation key=2SO8HBZSAMRX tag=1JLZYWNJXUE4 type=del 2024-09-12T00:09:36.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.114+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=D1GXC0AMO652 type=del size=1980410 2024-09-12T00:09:36.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.116+0000 7f3dc2c18780 1 < suggested remove operation key=WRR6LAYIWOCE tag=DI173E76RYM8 type=write 2024-09-12T00:09:36.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.117+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=MI578DF2PJHO type=del size=4148720 2024-09-12T00:09:36.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.119+0000 7f3dc2c18780 1 < completed write operation key=0ICU4WV9K1RG tag=ONXFMF93WAKY type=write size=553522 2024-09-12T00:09:36.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.121+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~400ALU6ZCZZ8.0 size=1048576 2024-09-12T00:09:36.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.122+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~400ALU6ZCZZ8.1 size=20997 2024-09-12T00:09:36.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.122+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=400ALU6ZCZZ8 tag=MN5O22AA3FJP type=write size=2118149 2024-09-12T00:09:36.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.123+0000 7f3dc2c18780 1 < canceled operation key=WRBBH64CISJZ tag=AR4GO1QBFG9I type=write size=576142 2024-09-12T00:09:36.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.125+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=B5VSYSBNLM81 type=del size=3962123 2024-09-12T00:09:36.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.126+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~8G0CWIZ7PKFW.0 size=321029 2024-09-12T00:09:36.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.128+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=8G0CWIZ7PKFW tag=SL563SJMQQJY type=write size=1369605 2024-09-12T00:09:36.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.129+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=2WC2UEHLYS64 type=del size=2214252 2024-09-12T00:09:36.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.130+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=PMIZVZYK6UC2 type=del 2024-09-12T00:09:36.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.133+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~ZDJ304J1D7ZR.0 size=623502 2024-09-12T00:09:36.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.133+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=ZDJ304J1D7ZR tag=4IMHSCTIB2KT type=write size=1672078 2024-09-12T00:09:36.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.133+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~KYZBORFKJV86.0 size=1048576 2024-09-12T00:09:36.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.134+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~KYZBORFKJV86.1 size=271495 2024-09-12T00:09:36.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.136+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=KYZBORFKJV86 tag=OY95J1R16G7X type=write size=2368647 2024-09-12T00:09:36.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.139+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~M2ZEAWUGLYXO.0 size=1048576 2024-09-12T00:09:36.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.140+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~M2ZEAWUGLYXO.1 size=712570 2024-09-12T00:09:36.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.140+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=M2ZEAWUGLYXO tag=KEP3QL1ACZ97 type=write size=2809722 2024-09-12T00:09:36.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.142+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~DX8EMGU83K9P.0 size=444856 2024-09-12T00:09:36.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.144+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=DX8EMGU83K9P tag=E71SPOQ7P228 type=write size=1493432 2024-09-12T00:09:36.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.145+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=7QGR59E34UR5 type=write size=858022 2024-09-12T00:09:36.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.147+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=RVTXB0U49ICY type=del 2024-09-12T00:09:36.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.148+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=D3P105QR7QSL type=write size=96536 2024-09-12T00:09:36.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.149+0000 7f3dc2c18780 1 < canceled operation key=65DTZR8A5OHF tag=8SKC16KNS8J3 type=del size=1502999 2024-09-12T00:09:36.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.150+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=86M2F81CL0YU type=del size=438269 2024-09-12T00:09:36.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.151+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~YWII6V2DYQD9.0 size=508308 2024-09-12T00:09:36.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.154+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=YWII6V2DYQD9 tag=QHI2GXU4AL2G type=write size=1556884 2024-09-12T00:09:36.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.156+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~3D3O63IA6AJ0.0 size=1048576 2024-09-12T00:09:36.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.157+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~3D3O63IA6AJ0.1 size=1048576 2024-09-12T00:09:36.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.158+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~3D3O63IA6AJ0.2 size=400643 2024-09-12T00:09:36.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.158+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=3D3O63IA6AJ0 tag=DRBUDTHZIWT7 type=write size=3546371 2024-09-12T00:09:36.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.159+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=K1PH0Y1JIL4J type=del 2024-09-12T00:09:36.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.161+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~RKMZFX75RMUJ.0 size=128686 2024-09-12T00:09:36.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.161+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=RKMZFX75RMUJ tag=TQKP28LPGVO0 type=write size=1177262 2024-09-12T00:09:36.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.163+0000 7f3dc2c18780 1 < suggested update operation key=A4O7JFS2ULY0 tag=QNRV0LMPBWKT type=write size=505781 2024-09-12T00:09:36.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.164+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=A9JDRZ1SQ5HJ type=del size=2324222 2024-09-12T00:09:36.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.166+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~I9D5H15UHTHO.0 size=1048576 2024-09-12T00:09:36.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.167+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~I9D5H15UHTHO.1 size=464876 2024-09-12T00:09:36.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.169+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=I9D5H15UHTHO tag=KH014YVTKQJQ type=write size=2562028 2024-09-12T00:09:36.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.170+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=EOFHPJ5I5APZ type=del size=3141188 2024-09-12T00:09:36.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.171+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=R7DLXM9O09DH type=del 2024-09-12T00:09:36.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.172+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=24F0CIMNTGF1 type=del size=49908 2024-09-12T00:09:36.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.174+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~K6G9Z3T8ZF3U.0 size=1048576 2024-09-12T00:09:36.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.175+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~K6G9Z3T8ZF3U.1 size=1048576 2024-09-12T00:09:36.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.176+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~K6G9Z3T8ZF3U.2 size=351970 2024-09-12T00:09:36.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.178+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=K6G9Z3T8ZF3U tag=9BNL3WAGH5G6 type=write size=3497698 2024-09-12T00:09:36.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.179+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=ARLJK5TKTUH6 type=del size=944732 2024-09-12T00:09:36.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.181+0000 7f3dc2c18780 1 < suggested remove operation key=7JVCFTM2QMGY tag=D1GXC0AMO652 type=del 2024-09-12T00:09:36.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.183+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=794R4ISN3UW3 type=del size=2226031 2024-09-12T00:09:36.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.184+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=MI578DF2PJHO type=del 2024-09-12T00:09:36.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.186+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~96WG81RYC5EN.0 size=599639 2024-09-12T00:09:36.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.186+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=96WG81RYC5EN tag=A8VOLN4XFPHW type=write size=1648215 2024-09-12T00:09:36.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.187+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~400ALU6ZCZZ8.0 size=1048576 2024-09-12T00:09:36.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.187+0000 7f3dc2c18780 1 < canceled part key=_multipart_C7ZOCTAR2BEP.2~400ALU6ZCZZ8.1 size=20997 2024-09-12T00:09:36.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.189+0000 7f3dc2c18780 1 < canceled multipart upload key=C7ZOCTAR2BEP upload=400ALU6ZCZZ8 tag=MN5O22AA3FJP type=write size=2118149 2024-09-12T00:09:36.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.191+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~2DKQBA32XWVX.0 size=654060 2024-09-12T00:09:36.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.191+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=2DKQBA32XWVX tag=6Y6ZYIDX67JQ type=write size=1702636 2024-09-12T00:09:36.191 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.193+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=B5VSYSBNLM81 type=del 2024-09-12T00:09:36.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.194+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=74ZI1ZMBK4OL type=del size=1475116 2024-09-12T00:09:36.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.195+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=2WC2UEHLYS64 type=del 2024-09-12T00:09:36.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.196+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=X4CDV7NE080B type=del size=1379970 2024-09-12T00:09:36.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.198+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~ZDJ304J1D7ZR.0 size=623502 2024-09-12T00:09:36.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.200+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=ZDJ304J1D7ZR tag=4IMHSCTIB2KT type=write size=1672078 2024-09-12T00:09:36.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.201+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=6Z1D4ULQDTNI type=del size=1762761 2024-09-12T00:09:36.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.203+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~M2ZEAWUGLYXO.0 size=1048576 2024-09-12T00:09:36.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.204+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~M2ZEAWUGLYXO.1 size=712570 2024-09-12T00:09:36.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.206+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=M2ZEAWUGLYXO tag=KEP3QL1ACZ97 type=write size=2809722 2024-09-12T00:09:36.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.208+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=8DB8M6CT2E1S type=del size=2951861 2024-09-12T00:09:36.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.209+0000 7f3dc2c18780 1 < completed write operation key=GP3MLWX9586T tag=7QGR59E34UR5 type=write size=858022 2024-09-12T00:09:36.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.212+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=O6US1BU018S0 type=write size=425202 2024-09-12T00:09:36.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.213+0000 7f3dc2c18780 1 < completed write operation key=U2H0A1GZROT7 tag=D3P105QR7QSL type=write size=96536 2024-09-12T00:09:36.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.214+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=VGGTWDBLYSPP type=del size=3739140 2024-09-12T00:09:36.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.216+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=86M2F81CL0YU type=del 2024-09-12T00:09:36.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.217+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=IHMHQSCHGN5C type=del size=1674013 2024-09-12T00:09:36.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.218+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~3D3O63IA6AJ0.0 size=1048576 2024-09-12T00:09:36.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.219+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~3D3O63IA6AJ0.1 size=1048576 2024-09-12T00:09:36.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.220+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~3D3O63IA6AJ0.2 size=400643 2024-09-12T00:09:36.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.222+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=3D3O63IA6AJ0 tag=DRBUDTHZIWT7 type=write size=3546371 2024-09-12T00:09:36.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.224+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~J2PW0C45IKGX.0 size=1048576 2024-09-12T00:09:36.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.225+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~J2PW0C45IKGX.1 size=1008764 2024-09-12T00:09:36.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.225+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=J2PW0C45IKGX tag=L8K1381J18K8 type=write size=3105916 2024-09-12T00:09:36.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.227+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~RKMZFX75RMUJ.0 size=128686 2024-09-12T00:09:36.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.229+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=RKMZFX75RMUJ tag=TQKP28LPGVO0 type=write size=1177262 2024-09-12T00:09:36.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.230+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=0G80SEZNHT18 type=del size=430824 2024-09-12T00:09:36.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.231+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=A9JDRZ1SQ5HJ type=del 2024-09-12T00:09:36.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.233+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=OR0LYRSN15SN type=del size=1696261 2024-09-12T00:09:36.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.234+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=EOFHPJ5I5APZ type=del 2024-09-12T00:09:36.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.235+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=8SOUA5TXMSOA type=del size=148477 2024-09-12T00:09:36.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.236+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=24F0CIMNTGF1 type=del 2024-09-12T00:09:36.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.238+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=4HC8RZJ1JQVW type=del size=1525709 2024-09-12T00:09:36.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.239+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=ARLJK5TKTUH6 type=del 2024-09-12T00:09:36.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.240+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=1YCCREIQ3VQ4 type=del size=4079928 2024-09-12T00:09:36.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.241+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=794R4ISN3UW3 type=del 2024-09-12T00:09:36.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.243+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=K9T8QEVEEGWW type=del size=3781608 2024-09-12T00:09:36.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.244+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~96WG81RYC5EN.0 size=599639 2024-09-12T00:09:36.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.246+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=96WG81RYC5EN tag=A8VOLN4XFPHW type=write size=1648215 2024-09-12T00:09:36.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.248+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~KTZMFNYOG34T.0 size=60384 2024-09-12T00:09:36.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.248+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=KTZMFNYOG34T tag=PG4L3DEW7NXD type=write size=1108960 2024-09-12T00:09:36.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.248+0000 7f3dc2c18780 1 < canceled part key=_multipart_Y40G8SLO6AVH.2~2DKQBA32XWVX.0 size=654060 2024-09-12T00:09:36.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.250+0000 7f3dc2c18780 1 < canceled multipart upload key=Y40G8SLO6AVH upload=2DKQBA32XWVX tag=6Y6ZYIDX67JQ type=write size=1702636 2024-09-12T00:09:36.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.251+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=MBRPEJREQE1Y type=write size=195366 2024-09-12T00:09:36.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.253+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=74ZI1ZMBK4OL type=del 2024-09-12T00:09:36.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.254+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=Z0G1HHOBF280 type=del size=4077201 2024-09-12T00:09:36.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.255+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=X4CDV7NE080B type=del 2024-09-12T00:09:36.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.258+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~GYMIYSEERY6W.0 size=692937 2024-09-12T00:09:36.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.258+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=GYMIYSEERY6W tag=8QBMS1NTR86E type=write size=1741513 2024-09-12T00:09:36.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.259+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=6Z1D4ULQDTNI type=del 2024-09-12T00:09:36.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.261+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~S3R6ATG76UEQ.0 size=28478 2024-09-12T00:09:36.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.261+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=S3R6ATG76UEQ tag=7YMOLOG0BRT5 type=write size=1077054 2024-09-12T00:09:36.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.262+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=8DB8M6CT2E1S type=del 2024-09-12T00:09:36.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.264+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=AKVGZIHVXJLG type=del size=2946113 2024-09-12T00:09:36.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.265+0000 7f3dc2c18780 1 < completed write operation key=65DTZR8A5OHF tag=O6US1BU018S0 type=write size=425202 2024-09-12T00:09:36.266 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.267+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~I02ITCUTW5GV.0 size=27070 2024-09-12T00:09:36.266 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.267+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=I02ITCUTW5GV tag=DDUHFT2L9UN3 type=write size=1075646 2024-09-12T00:09:36.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.268+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=VGGTWDBLYSPP type=del 2024-09-12T00:09:36.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.270+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=73KI0KJFMCTD type=write size=595362 2024-09-12T00:09:36.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.271+0000 7f3dc2c18780 1 < canceled operation key=TSL3IDD0EDT0 tag=IHMHQSCHGN5C type=del size=1674013 2024-09-12T00:09:36.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.272+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=ZCDB9I4K2G5D type=del size=3547842 2024-09-12T00:09:36.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.273+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~J2PW0C45IKGX.0 size=1048576 2024-09-12T00:09:36.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.274+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~J2PW0C45IKGX.1 size=1008764 2024-09-12T00:09:36.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.276+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=J2PW0C45IKGX tag=L8K1381J18K8 type=write size=3105916 2024-09-12T00:09:36.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.278+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=3U5879WMVMZ3 type=del size=1107284 2024-09-12T00:09:36.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.279+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=0G80SEZNHT18 type=del 2024-09-12T00:09:36.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.281+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~MXIYAFHWR0HH.0 size=1048576 2024-09-12T00:09:36.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.282+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~MXIYAFHWR0HH.1 size=43395 2024-09-12T00:09:36.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.282+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=MXIYAFHWR0HH tag=T33IAF89VEXO type=write size=2140547 2024-09-12T00:09:36.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.283+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=OR0LYRSN15SN type=del 2024-09-12T00:09:36.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.285+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=Y97G2NP6HSTT type=write size=114565 2024-09-12T00:09:36.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.287+0000 7f3dc2c18780 1 < suggested update operation key=KQWXE62PF5F7 tag=8SOUA5TXMSOA type=del size=148477 2024-09-12T00:09:36.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.288+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=4H2T8M0X57I2 type=del size=1491037 2024-09-12T00:09:36.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.290+0000 7f3dc2c18780 1 < canceled operation key=A4O7JFS2ULY0 tag=4HC8RZJ1JQVW type=del size=1525709 2024-09-12T00:09:36.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.292+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~ESL1G0Z0QDPE.0 size=640843 2024-09-12T00:09:36.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.292+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=ESL1G0Z0QDPE tag=A977XZVAZSK5 type=write size=1689419 2024-09-12T00:09:36.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.293+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=1YCCREIQ3VQ4 type=del 2024-09-12T00:09:36.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.294+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=D76LPRMOEL1W type=del size=1105371 2024-09-12T00:09:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.295+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=K9T8QEVEEGWW type=del 2024-09-12T00:09:36.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.297+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=RLGEPH9NJ5IC type=del size=1600641 2024-09-12T00:09:36.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.298+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~KTZMFNYOG34T.0 size=60384 2024-09-12T00:09:36.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.300+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=KTZMFNYOG34T tag=PG4L3DEW7NXD type=write size=1108960 2024-09-12T00:09:36.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.301+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=T2QP7PNQZDTI type=del size=2160549 2024-09-12T00:09:36.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.303+0000 7f3dc2c18780 1 < completed write operation key=L9C014T8YLNV tag=MBRPEJREQE1Y type=write size=195366 2024-09-12T00:09:36.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.304+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=U61TXDWBKNVT type=del size=1374103 2024-09-12T00:09:36.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.305+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=Z0G1HHOBF280 type=del 2024-09-12T00:09:36.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.307+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~N8IEYLXQT4ZP.0 size=1048576 2024-09-12T00:09:36.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.308+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~N8IEYLXQT4ZP.1 size=432726 2024-09-12T00:09:36.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.308+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=N8IEYLXQT4ZP tag=SC084B4LJM3R type=write size=2529878 2024-09-12T00:09:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.309+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~GYMIYSEERY6W.0 size=692937 2024-09-12T00:09:36.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.311+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=GYMIYSEERY6W tag=8QBMS1NTR86E type=write size=1741513 2024-09-12T00:09:36.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.313+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=7F72S6IAK2HM type=del size=1203436 2024-09-12T00:09:36.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.314+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~S3R6ATG76UEQ.0 size=28478 2024-09-12T00:09:36.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.316+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=S3R6ATG76UEQ tag=7YMOLOG0BRT5 type=write size=1077054 2024-09-12T00:09:36.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.317+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=L4TO0M4P3BWH type=del size=3154138 2024-09-12T00:09:36.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.320+0000 7f3dc2c18780 1 < suggested remove operation key=WRR6LAYIWOCE tag=AKVGZIHVXJLG type=del 2024-09-12T00:09:36.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.322+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~66WBN3GN5IW1.0 size=1048576 2024-09-12T00:09:36.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.323+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~66WBN3GN5IW1.1 size=924441 2024-09-12T00:09:36.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.323+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=66WBN3GN5IW1 tag=6LN3LDI76MPO type=write size=3021593 2024-09-12T00:09:36.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.324+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~I02ITCUTW5GV.0 size=27070 2024-09-12T00:09:36.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.327+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=I02ITCUTW5GV tag=DDUHFT2L9UN3 type=write size=1075646 2024-09-12T00:09:36.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.328+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=33X9A3B7A512 type=del size=2762875 2024-09-12T00:09:36.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.329+0000 7f3dc2c18780 1 < completed write operation key=C0JT46SGECP0 tag=73KI0KJFMCTD type=write size=595362 2024-09-12T00:09:36.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.331+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=C8LMY6PVYFHT type=del size=4099552 2024-09-12T00:09:36.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.333+0000 7f3dc2c18780 1 < suggested remove operation key=C7ZOCTAR2BEP tag=ZCDB9I4K2G5D type=del 2024-09-12T00:09:36.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.334+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=39X4GX1OQPU3 type=write size=1015745 2024-09-12T00:09:36.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.337+0000 7f3dc2c18780 1 < suggested remove operation key=QJ3KML910OEL tag=3U5879WMVMZ3 type=del 2024-09-12T00:09:36.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.339+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~R3XL4Q1I1EVB.0 size=992084 2024-09-12T00:09:36.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.339+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=R3XL4Q1I1EVB tag=1RD0VME3D0DR type=write size=2040660 2024-09-12T00:09:36.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.340+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~MXIYAFHWR0HH.0 size=1048576 2024-09-12T00:09:36.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.341+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~MXIYAFHWR0HH.1 size=43395 2024-09-12T00:09:36.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.344+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=MXIYAFHWR0HH tag=T33IAF89VEXO type=write size=2140547 2024-09-12T00:09:36.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.346+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~K0WGTIOON4R7.0 size=1048576 2024-09-12T00:09:36.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.348+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~K0WGTIOON4R7.1 size=979274 2024-09-12T00:09:36.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.348+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=K0WGTIOON4R7 tag=J9VBEZ7BXJ8T type=write size=3076426 2024-09-12T00:09:36.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.349+0000 7f3dc2c18780 1 < completed write operation key=A4O7JFS2ULY0 tag=Y97G2NP6HSTT type=write size=114565 2024-09-12T00:09:36.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.350+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=9LYTW4ALX2ZX type=del size=316943 2024-09-12T00:09:36.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.351+0000 7f3dc2c18780 -1 < failed to complete operation key=QJ3KML910OEL tag=4H2T8M0X57I2 type=del size=1491037: (22) Invalid argument 2024-09-12T00:09:36.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.352+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=6YAQC4F4VLTN type=del size=1026784 2024-09-12T00:09:36.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.354+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~ESL1G0Z0QDPE.0 size=640843 2024-09-12T00:09:36.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.356+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=ESL1G0Z0QDPE tag=A977XZVAZSK5 type=write size=1689419 2024-09-12T00:09:36.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.357+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=I1UDUKIAM09G type=del size=1006796 2024-09-12T00:09:36.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.358+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=D76LPRMOEL1W type=del 2024-09-12T00:09:36.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.359+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=BA9K0G5Q3TO9 type=write size=965800 2024-09-12T00:09:36.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.361+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=RLGEPH9NJ5IC type=del 2024-09-12T00:09:36.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.363+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~DT9HZN8P64I0.0 size=1048576 2024-09-12T00:09:36.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.364+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~DT9HZN8P64I0.1 size=1048576 2024-09-12T00:09:36.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.365+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~DT9HZN8P64I0.2 size=923801 2024-09-12T00:09:36.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.365+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=DT9HZN8P64I0 tag=0771FFHSNIS9 type=write size=4069529 2024-09-12T00:09:36.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.367+0000 7f3dc2c18780 1 < suggested update operation key=YYIQC6YL2PSW tag=T2QP7PNQZDTI type=del size=2160549 2024-09-12T00:09:36.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.368+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=WQ51FEX0QBRZ type=del size=2500502 2024-09-12T00:09:36.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.371+0000 7f3dc2c18780 1 < suggested update operation key=65DTZR8A5OHF tag=U61TXDWBKNVT type=del size=1374103 2024-09-12T00:09:36.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.372+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=MF4EGWUFY0CE type=write size=50706 2024-09-12T00:09:36.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.374+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~N8IEYLXQT4ZP.0 size=1048576 2024-09-12T00:09:36.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.375+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~N8IEYLXQT4ZP.1 size=432726 2024-09-12T00:09:36.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.377+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=N8IEYLXQT4ZP tag=SC084B4LJM3R type=write size=2529878 2024-09-12T00:09:36.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.380+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~K8DMDL21MG12.0 size=1048576 2024-09-12T00:09:36.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.381+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~K8DMDL21MG12.1 size=9444 2024-09-12T00:09:36.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.381+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=K8DMDL21MG12 tag=E4WTF6HLRTR6 type=write size=2106596 2024-09-12T00:09:36.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.382+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=7F72S6IAK2HM type=del 2024-09-12T00:09:36.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.383+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=6TUD8WVVDI7W type=del size=4053544 2024-09-12T00:09:36.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.385+0000 7f3dc2c18780 1 < suggested remove operation key=0ICU4WV9K1RG tag=L4TO0M4P3BWH type=del 2024-09-12T00:09:36.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.387+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=MLU1O5LFSSF5 type=del size=1300174 2024-09-12T00:09:36.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.388+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~66WBN3GN5IW1.0 size=1048576 2024-09-12T00:09:36.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.389+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~66WBN3GN5IW1.1 size=924441 2024-09-12T00:09:36.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.391+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=66WBN3GN5IW1 tag=6LN3LDI76MPO type=write size=3021593 2024-09-12T00:09:36.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.392+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=9L2UYWCPXPBT type=write size=382174 2024-09-12T00:09:36.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.393+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=33X9A3B7A512 type=del 2024-09-12T00:09:36.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.394+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=FSPWCUR6YOUB type=del size=389428 2024-09-12T00:09:36.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.395+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=C8LMY6PVYFHT type=del 2024-09-12T00:09:36.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.398+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~7WSXY810WZEE.0 size=737309 2024-09-12T00:09:36.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.398+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=7WSXY810WZEE tag=YLK2ERNZ9GI5 type=write size=1785885 2024-09-12T00:09:36.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.400+0000 7f3dc2c18780 1 < suggested remove operation key=U2H0A1GZROT7 tag=39X4GX1OQPU3 type=write 2024-09-12T00:09:36.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.402+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~K1T5DFPFH5EN.0 size=316026 2024-09-12T00:09:36.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.402+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=K1T5DFPFH5EN tag=PRMODLZPSMEF type=write size=1364602 2024-09-12T00:09:36.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.403+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~R3XL4Q1I1EVB.0 size=992084 2024-09-12T00:09:36.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.405+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=R3XL4Q1I1EVB tag=1RD0VME3D0DR type=write size=2040660 2024-09-12T00:09:36.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.407+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~GU5G0TE55FSN.0 size=687266 2024-09-12T00:09:36.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.407+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=GU5G0TE55FSN tag=K1I1KFFK9Z1N type=write size=1735842 2024-09-12T00:09:36.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.408+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~K0WGTIOON4R7.0 size=1048576 2024-09-12T00:09:36.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.409+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~K0WGTIOON4R7.1 size=979274 2024-09-12T00:09:36.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.411+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=K0WGTIOON4R7 tag=J9VBEZ7BXJ8T type=write size=3076426 2024-09-12T00:09:36.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.413+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=VPMOZ4OSMENA type=del size=967917 2024-09-12T00:09:36.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.414+0000 7f3dc2c18780 -1 < failed to complete operation key=65DTZR8A5OHF tag=9LYTW4ALX2ZX type=del size=316943: (22) Invalid argument 2024-09-12T00:09:36.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.416+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~1MGKNEBW1SGZ.0 size=1048576 2024-09-12T00:09:36.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.417+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~1MGKNEBW1SGZ.1 size=1048576 2024-09-12T00:09:36.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.419+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~1MGKNEBW1SGZ.2 size=321612 2024-09-12T00:09:36.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.419+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=1MGKNEBW1SGZ tag=T211LPXO3AO2 type=write size=3467340 2024-09-12T00:09:36.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.421+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=6YAQC4F4VLTN type=del 2024-09-12T00:09:36.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.422+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=MHTY5WSDFJH7 type=del size=3021663 2024-09-12T00:09:36.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.423+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=I1UDUKIAM09G type=del 2024-09-12T00:09:36.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.424+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=248D65UD0I3M type=del size=1743441 2024-09-12T00:09:36.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.426+0000 7f3dc2c18780 1 < completed write operation key=2SO8HBZSAMRX tag=BA9K0G5Q3TO9 type=write size=965800 2024-09-12T00:09:36.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.427+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=41VGTN5NTBQF type=del size=4095915 2024-09-12T00:09:36.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.428+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~DT9HZN8P64I0.0 size=1048576 2024-09-12T00:09:36.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.429+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~DT9HZN8P64I0.1 size=1048576 2024-09-12T00:09:36.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.430+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~DT9HZN8P64I0.2 size=923801 2024-09-12T00:09:36.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.432+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=DT9HZN8P64I0 tag=0771FFHSNIS9 type=write size=4069529 2024-09-12T00:09:36.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.434+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~C2R3TW1T6DN7.0 size=1048576 2024-09-12T00:09:36.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.435+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~C2R3TW1T6DN7.1 size=1048576 2024-09-12T00:09:36.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.436+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~C2R3TW1T6DN7.2 size=146602 2024-09-12T00:09:36.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.436+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=C2R3TW1T6DN7 tag=ZYRXCVJJ247R type=write size=3292330 2024-09-12T00:09:36.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.437+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=WQ51FEX0QBRZ type=del 2024-09-12T00:09:36.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.438+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=IL5GLXAZPMVB type=del size=2111327 2024-09-12T00:09:36.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.440+0000 7f3dc2c18780 1 < completed write operation key=OGRGDIUO2W8B tag=MF4EGWUFY0CE type=write size=50706 2024-09-12T00:09:36.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.441+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=1X3PD3T5UHMC type=del size=2355809 2024-09-12T00:09:36.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.443+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~K8DMDL21MG12.0 size=1048576 2024-09-12T00:09:36.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.445+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~K8DMDL21MG12.1 size=9444 2024-09-12T00:09:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.449+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=K8DMDL21MG12 tag=E4WTF6HLRTR6 type=write size=2106596 2024-09-12T00:09:36.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.450+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=CE8WFON9VYES type=del size=2379815 2024-09-12T00:09:36.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.452+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=6TUD8WVVDI7W type=del 2024-09-12T00:09:36.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.453+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=YSDNF416BBLU type=del size=2482677 2024-09-12T00:09:36.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.454+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=MLU1O5LFSSF5 type=del 2024-09-12T00:09:36.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.455+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=XJFN6HBJHD2R type=del size=3596513 2024-09-12T00:09:36.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.457+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=9L2UYWCPXPBT type=write size=382174 2024-09-12T00:09:36.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.459+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~Y0MMJX6W7W3E.0 size=1048576 2024-09-12T00:09:36.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.460+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~Y0MMJX6W7W3E.1 size=272449 2024-09-12T00:09:36.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.460+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=Y0MMJX6W7W3E tag=HQHUTZRVYMLJ type=write size=2369601 2024-09-12T00:09:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.461+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=FSPWCUR6YOUB type=del 2024-09-12T00:09:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.463+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~F4JLTYZKIIUX.0 size=1048576 2024-09-12T00:09:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.465+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~F4JLTYZKIIUX.1 size=1048576 2024-09-12T00:09:36.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.466+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~F4JLTYZKIIUX.2 size=463551 2024-09-12T00:09:36.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.466+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=F4JLTYZKIIUX tag=IY24MMRWUNES type=write size=3609279 2024-09-12T00:09:36.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.467+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~7WSXY810WZEE.0 size=737309 2024-09-12T00:09:36.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.469+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=7WSXY810WZEE tag=YLK2ERNZ9GI5 type=write size=1785885 2024-09-12T00:09:36.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.471+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~XON7CI1ETZIM.0 size=1048576 2024-09-12T00:09:36.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.472+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~XON7CI1ETZIM.1 size=938178 2024-09-12T00:09:36.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.472+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=XON7CI1ETZIM tag=OTUEOESBSY7R type=write size=3035330 2024-09-12T00:09:36.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.473+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~K1T5DFPFH5EN.0 size=316026 2024-09-12T00:09:36.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.475+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=K1T5DFPFH5EN tag=PRMODLZPSMEF type=write size=1364602 2024-09-12T00:09:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.477+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~3FFFG65954J3.0 size=1048576 2024-09-12T00:09:36.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.478+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~3FFFG65954J3.1 size=918523 2024-09-12T00:09:36.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.478+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=3FFFG65954J3 tag=7G5QL4VNW2R9 type=write size=3015675 2024-09-12T00:09:36.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.479+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~GU5G0TE55FSN.0 size=687266 2024-09-12T00:09:36.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.481+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=GU5G0TE55FSN tag=K1I1KFFK9Z1N type=write size=1735842 2024-09-12T00:09:36.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.483+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=1H63Y8B9X3WM type=del size=3460473 2024-09-12T00:09:36.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.484+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=VPMOZ4OSMENA type=del 2024-09-12T00:09:36.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.485+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=EI43O61C0544 type=write size=282511 2024-09-12T00:09:36.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.486+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~1MGKNEBW1SGZ.0 size=1048576 2024-09-12T00:09:36.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.487+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~1MGKNEBW1SGZ.1 size=1048576 2024-09-12T00:09:36.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.488+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~1MGKNEBW1SGZ.2 size=321612 2024-09-12T00:09:36.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.490+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=1MGKNEBW1SGZ tag=T211LPXO3AO2 type=write size=3467340 2024-09-12T00:09:36.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.492+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~NJQ9WHFQ6JID.0 size=516408 2024-09-12T00:09:36.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.492+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=NJQ9WHFQ6JID tag=TGW7L9XGLK16 type=write size=1564984 2024-09-12T00:09:36.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.494+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=MHTY5WSDFJH7 type=del 2024-09-12T00:09:36.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.496+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~8SER1ETA9AGQ.0 size=1048576 2024-09-12T00:09:36.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.497+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~8SER1ETA9AGQ.1 size=226721 2024-09-12T00:09:36.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.497+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=8SER1ETA9AGQ tag=MNZ4EFV3U5CO type=write size=2323873 2024-09-12T00:09:36.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.498+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=248D65UD0I3M type=del 2024-09-12T00:09:36.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.499+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=071DJZCMPE85 type=del size=2945855 2024-09-12T00:09:36.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.502+0000 7f3dc2c18780 1 < suggested remove operation key=L9C014T8YLNV tag=41VGTN5NTBQF type=del 2024-09-12T00:09:36.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.504+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~VEW044R77ZWM.0 size=1048576 2024-09-12T00:09:36.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.505+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~VEW044R77ZWM.1 size=952146 2024-09-12T00:09:36.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.505+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=VEW044R77ZWM tag=GWMTG4EIF207 type=write size=3049298 2024-09-12T00:09:36.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.506+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~C2R3TW1T6DN7.0 size=1048576 2024-09-12T00:09:36.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.506+0000 7f3dc2c18780 1 < canceled part key=_multipart_5F0BB9U7Y6ZZ.2~C2R3TW1T6DN7.1 size=1048576 2024-09-12T00:09:36.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.507+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~C2R3TW1T6DN7.2 size=146602 2024-09-12T00:09:36.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.509+0000 7f3dc2c18780 1 < canceled multipart upload key=5F0BB9U7Y6ZZ upload=C2R3TW1T6DN7 tag=ZYRXCVJJ247R type=write size=3292330 2024-09-12T00:09:36.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.512+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~5W2Z0HEB8W6Q.0 size=821621 2024-09-12T00:09:36.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.512+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=5W2Z0HEB8W6Q tag=9K689DKZVSZB type=write size=1870197 2024-09-12T00:09:36.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.513+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=IL5GLXAZPMVB type=del 2024-09-12T00:09:36.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.514+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=HFZ9A57S9ED0 type=write size=182416 2024-09-12T00:09:36.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.516+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=1X3PD3T5UHMC type=del 2024-09-12T00:09:36.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.517+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=HV0YNRIFC5XJ type=del size=408458 2024-09-12T00:09:36.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.518+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=CE8WFON9VYES type=del 2024-09-12T00:09:36.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.520+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~T3F3IB23VBO7.0 size=1048576 2024-09-12T00:09:36.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.521+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~T3F3IB23VBO7.1 size=462604 2024-09-12T00:09:36.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.521+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=T3F3IB23VBO7 tag=1BP56RST7CU0 type=write size=2559756 2024-09-12T00:09:36.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.523+0000 7f3dc2c18780 1 < suggested update operation key=YYIQC6YL2PSW tag=YSDNF416BBLU type=del size=2482677 2024-09-12T00:09:36.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.524+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=8W1637HESDN8 type=del size=3394044 2024-09-12T00:09:36.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.526+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=XJFN6HBJHD2R type=del 2024-09-12T00:09:36.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.527+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=K7VV5W3X2RB3 type=del size=1514963 2024-09-12T00:09:36.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.528+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~Y0MMJX6W7W3E.0 size=1048576 2024-09-12T00:09:36.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.529+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~Y0MMJX6W7W3E.1 size=272449 2024-09-12T00:09:36.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.531+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=Y0MMJX6W7W3E tag=HQHUTZRVYMLJ type=write size=2369601 2024-09-12T00:09:36.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.533+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~I5TYPOQB0GWR.0 size=1048576 2024-09-12T00:09:36.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.534+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~I5TYPOQB0GWR.1 size=286875 2024-09-12T00:09:36.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.534+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=I5TYPOQB0GWR tag=7XN9JTRGJKBS type=write size=2384027 2024-09-12T00:09:36.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.535+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~F4JLTYZKIIUX.0 size=1048576 2024-09-12T00:09:36.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.536+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~F4JLTYZKIIUX.1 size=1048576 2024-09-12T00:09:36.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.537+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~F4JLTYZKIIUX.2 size=463551 2024-09-12T00:09:36.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.539+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=F4JLTYZKIIUX tag=IY24MMRWUNES type=write size=3609279 2024-09-12T00:09:36.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.540+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=49XLS8EEMQ87 type=del size=515877 2024-09-12T00:09:36.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.541+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~XON7CI1ETZIM.0 size=1048576 2024-09-12T00:09:36.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.542+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~XON7CI1ETZIM.1 size=938178 2024-09-12T00:09:36.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.544+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=XON7CI1ETZIM tag=OTUEOESBSY7R type=write size=3035330 2024-09-12T00:09:36.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.546+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=9UK7ZWOVJTZO type=del size=2992931 2024-09-12T00:09:36.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.547+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~3FFFG65954J3.0 size=1048576 2024-09-12T00:09:36.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.548+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~3FFFG65954J3.1 size=918523 2024-09-12T00:09:36.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.550+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=3FFFG65954J3 tag=7G5QL4VNW2R9 type=write size=3015675 2024-09-12T00:09:36.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.551+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=L8N1MZFID88M type=del size=1691134 2024-09-12T00:09:36.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.552+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=1H63Y8B9X3WM type=del 2024-09-12T00:09:36.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.553+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=4KZQUD2Y07CK type=write size=968987 2024-09-12T00:09:36.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.556+0000 7f3dc2c18780 1 < suggested remove operation key=QJ3KML910OEL tag=EI43O61C0544 type=write 2024-09-12T00:09:36.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.559+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~YYIOBVCE0KGQ.0 size=1048576 2024-09-12T00:09:36.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.559+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~YYIOBVCE0KGQ.1 size=1048576 2024-09-12T00:09:36.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.561+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~YYIOBVCE0KGQ.2 size=371690 2024-09-12T00:09:36.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.561+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=YYIOBVCE0KGQ tag=YUJOEQWM1ALS type=write size=3517418 2024-09-12T00:09:36.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.562+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~NJQ9WHFQ6JID.0 size=516408 2024-09-12T00:09:36.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.564+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=NJQ9WHFQ6JID tag=TGW7L9XGLK16 type=write size=1564984 2024-09-12T00:09:36.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.565+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=LTQNXYMBRPEO type=del size=1992911 2024-09-12T00:09:36.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.566+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~8SER1ETA9AGQ.0 size=1048576 2024-09-12T00:09:36.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.567+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~8SER1ETA9AGQ.1 size=226721 2024-09-12T00:09:36.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.569+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=8SER1ETA9AGQ tag=MNZ4EFV3U5CO type=write size=2323873 2024-09-12T00:09:36.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.571+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~B8SO14KL6BZX.0 size=485184 2024-09-12T00:09:36.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.571+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=B8SO14KL6BZX tag=37Q0BUOSZF5I type=write size=1533760 2024-09-12T00:09:36.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.572+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=071DJZCMPE85 type=del 2024-09-12T00:09:36.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.573+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=VTV3SA5YMT6V type=del size=3527257 2024-09-12T00:09:36.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.574+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~VEW044R77ZWM.0 size=1048576 2024-09-12T00:09:36.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.575+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~VEW044R77ZWM.1 size=952146 2024-09-12T00:09:36.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.577+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=VEW044R77ZWM tag=GWMTG4EIF207 type=write size=3049298 2024-09-12T00:09:36.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.579+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=VF2NUA8DDHTQ type=del size=1933898 2024-09-12T00:09:36.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.580+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~5W2Z0HEB8W6Q.0 size=821621 2024-09-12T00:09:36.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.582+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=5W2Z0HEB8W6Q tag=9K689DKZVSZB type=write size=1870197 2024-09-12T00:09:36.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.583+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=C0LG4G29KUDH type=del size=725024 2024-09-12T00:09:36.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.584+0000 7f3dc2c18780 1 < completed write operation key=A4O7JFS2ULY0 tag=HFZ9A57S9ED0 type=write size=182416 2024-09-12T00:09:36.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.585+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=5RALGYQ2SOLW type=del size=3367918 2024-09-12T00:09:36.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.587+0000 7f3dc2c18780 1 < suggested remove operation key=KDHO7IEGICDA tag=HV0YNRIFC5XJ type=del 2024-09-12T00:09:36.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.589+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=Q4LHMM0SS02M type=del size=445381 2024-09-12T00:09:36.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.590+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~T3F3IB23VBO7.0 size=1048576 2024-09-12T00:09:36.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.591+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~T3F3IB23VBO7.1 size=462604 2024-09-12T00:09:36.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.593+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=T3F3IB23VBO7 tag=1BP56RST7CU0 type=write size=2559756 2024-09-12T00:09:36.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.594+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=5ZKJVO4OO9HQ type=del size=670877 2024-09-12T00:09:36.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.596+0000 7f3dc2c18780 1 < canceled operation key=U2H0A1GZROT7 tag=8W1637HESDN8 type=del size=3394044 2024-09-12T00:09:36.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.597+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=6FS2EJJXUHKE type=del size=2560193 2024-09-12T00:09:36.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.598+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=K7VV5W3X2RB3 type=del 2024-09-12T00:09:36.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.600+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~DN1FDC0J03ZZ.0 size=1048576 2024-09-12T00:09:36.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.601+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~DN1FDC0J03ZZ.1 size=1048576 2024-09-12T00:09:36.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.602+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~DN1FDC0J03ZZ.2 size=828894 2024-09-12T00:09:36.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.602+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=DN1FDC0J03ZZ tag=6DTQ0SII6PXL type=write size=3974622 2024-09-12T00:09:36.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.604+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~I5TYPOQB0GWR.0 size=1048576 2024-09-12T00:09:36.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.605+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~I5TYPOQB0GWR.1 size=286875 2024-09-12T00:09:36.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.607+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=I5TYPOQB0GWR tag=7XN9JTRGJKBS type=write size=2384027 2024-09-12T00:09:36.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.608+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=7P8JSDZBO3KK type=del size=2188779 2024-09-12T00:09:36.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.609+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=49XLS8EEMQ87 type=del 2024-09-12T00:09:36.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.610+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=V6Z6DRXCZJ3V type=del size=2560261 2024-09-12T00:09:36.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.613+0000 7f3dc2c18780 1 < suggested update operation key=A4O7JFS2ULY0 tag=9UK7ZWOVJTZO type=del size=2992931 2024-09-12T00:09:36.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.614+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=XB0Q2EFQFM6J type=write size=502713 2024-09-12T00:09:36.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.615+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=L8N1MZFID88M type=del 2024-09-12T00:09:36.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.616+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=9WDZVETDQFEF type=del size=1577291 2024-09-12T00:09:36.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.618+0000 7f3dc2c18780 1 < canceled operation key=C7ZOCTAR2BEP tag=4KZQUD2Y07CK type=write size=968987 2024-09-12T00:09:36.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.619+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=LEZ7EBB7JLT8 type=write size=660109 2024-09-12T00:09:36.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.620+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~YYIOBVCE0KGQ.0 size=1048576 2024-09-12T00:09:36.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.621+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~YYIOBVCE0KGQ.1 size=1048576 2024-09-12T00:09:36.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.622+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~YYIOBVCE0KGQ.2 size=371690 2024-09-12T00:09:36.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.624+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=YYIOBVCE0KGQ tag=YUJOEQWM1ALS type=write size=3517418 2024-09-12T00:09:36.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.625+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=IAB785YV6K3Y type=del size=3919212 2024-09-12T00:09:36.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.627+0000 7f3dc2c18780 1 < canceled operation key=5F0BB9U7Y6ZZ tag=LTQNXYMBRPEO type=del size=1992911 2024-09-12T00:09:36.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.629+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~NUU72CRKODW5.0 size=280090 2024-09-12T00:09:36.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.629+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=NUU72CRKODW5 tag=2DW2D9OL6I8P type=write size=1328666 2024-09-12T00:09:36.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.630+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~B8SO14KL6BZX.0 size=485184 2024-09-12T00:09:36.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.632+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=B8SO14KL6BZX tag=37Q0BUOSZF5I type=write size=1533760 2024-09-12T00:09:36.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.634+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=3TC86COVWEQ8 type=del size=2161751 2024-09-12T00:09:36.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.635+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=VTV3SA5YMT6V type=del 2024-09-12T00:09:36.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.636+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=LOW3T8L0A4IS type=del size=616766 2024-09-12T00:09:36.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.638+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=VF2NUA8DDHTQ type=del 2024-09-12T00:09:36.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.639+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=Y238JWJ0JFR9 type=del size=3353832 2024-09-12T00:09:36.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.640+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=C0LG4G29KUDH type=del 2024-09-12T00:09:36.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.641+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=RY0RQFL9Y300 type=write size=967292 2024-09-12T00:09:36.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.643+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=5RALGYQ2SOLW type=del 2024-09-12T00:09:36.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.644+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=VP6YJ5LZD08A type=write size=233774 2024-09-12T00:09:36.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.645+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=Q4LHMM0SS02M type=del 2024-09-12T00:09:36.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.647+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=S7HMFW6YGGL8 type=del size=4079447 2024-09-12T00:09:36.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.648+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=5ZKJVO4OO9HQ type=del 2024-09-12T00:09:36.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.650+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~NA0XSG6RO2A4.0 size=1048576 2024-09-12T00:09:36.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.651+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~NA0XSG6RO2A4.1 size=1048576 2024-09-12T00:09:36.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.652+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~NA0XSG6RO2A4.2 size=160748 2024-09-12T00:09:36.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.652+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=NA0XSG6RO2A4 tag=XQJSHTE8U962 type=write size=3306476 2024-09-12T00:09:36.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.654+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=6FS2EJJXUHKE type=del 2024-09-12T00:09:36.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.655+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=5N2C77KLS8FL type=del size=2830321 2024-09-12T00:09:36.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.656+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~DN1FDC0J03ZZ.0 size=1048576 2024-09-12T00:09:36.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.657+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~DN1FDC0J03ZZ.1 size=1048576 2024-09-12T00:09:36.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.658+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~DN1FDC0J03ZZ.2 size=828894 2024-09-12T00:09:36.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.660+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=DN1FDC0J03ZZ tag=6DTQ0SII6PXL type=write size=3974622 2024-09-12T00:09:36.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.662+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=QHHL0W30JUTD type=write size=863810 2024-09-12T00:09:36.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.663+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=7P8JSDZBO3KK type=del 2024-09-12T00:09:36.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.664+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=KVNRXH5W3HLL type=del size=1668304 2024-09-12T00:09:36.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.665+0000 7f3dc2c18780 1 < canceled operation key=415OYT4ML329 tag=V6Z6DRXCZJ3V type=del size=2560261 2024-09-12T00:09:36.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.666+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=ZEEDXSE7F4Z9 type=del size=3707981 2024-09-12T00:09:36.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.669+0000 7f3dc2c18780 1 < suggested remove operation key=UJDQEIAIRVDW tag=XB0Q2EFQFM6J type=write 2024-09-12T00:09:36.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.671+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~5769JDSP1TY7.0 size=103018 2024-09-12T00:09:36.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.671+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=5769JDSP1TY7 tag=RZY1W99GC4NL type=write size=1151594 2024-09-12T00:09:36.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.673+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=9WDZVETDQFEF type=del 2024-09-12T00:09:36.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.676+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~MBLVBCH4P54L.0 size=1048576 2024-09-12T00:09:36.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.677+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~MBLVBCH4P54L.1 size=370613 2024-09-12T00:09:36.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.677+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=MBLVBCH4P54L tag=837OCL17EAID type=write size=2467765 2024-09-12T00:09:36.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.679+0000 7f3dc2c18780 1 < suggested remove operation key=2SO8HBZSAMRX tag=LEZ7EBB7JLT8 type=write 2024-09-12T00:09:36.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.680+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=J5P8GJLCN4PP type=del size=258717 2024-09-12T00:09:36.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.681+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=IAB785YV6K3Y type=del 2024-09-12T00:09:36.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.683+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~VIG45T9VCA9U.0 size=894570 2024-09-12T00:09:36.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.683+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=VIG45T9VCA9U tag=3KY3DDAPVBUH type=write size=1943146 2024-09-12T00:09:36.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.685+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~NUU72CRKODW5.0 size=280090 2024-09-12T00:09:36.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.686+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=NUU72CRKODW5 tag=2DW2D9OL6I8P type=write size=1328666 2024-09-12T00:09:36.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.689+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~NJPKGY7A4XF4.0 size=1048576 2024-09-12T00:09:36.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.689+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~NJPKGY7A4XF4.1 size=1048576 2024-09-12T00:09:36.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.690+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~NJPKGY7A4XF4.2 size=308622 2024-09-12T00:09:36.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.690+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=NJPKGY7A4XF4 tag=1E6CZFGBWUEY type=write size=3454350 2024-09-12T00:09:36.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.691+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=3TC86COVWEQ8 type=del 2024-09-12T00:09:36.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.694+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~11JGTGIXG46X.0 size=662177 2024-09-12T00:09:36.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.694+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=11JGTGIXG46X tag=83ZI66E107S1 type=write size=1710753 2024-09-12T00:09:36.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.695+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=LOW3T8L0A4IS type=del 2024-09-12T00:09:36.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.696+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=8BF9NFPYFW7M type=del size=948130 2024-09-12T00:09:36.695 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.697+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=Y238JWJ0JFR9 type=del 2024-09-12T00:09:36.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.699+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~N9P4WGGCD8O7.0 size=1048576 2024-09-12T00:09:36.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.700+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~N9P4WGGCD8O7.1 size=1048576 2024-09-12T00:09:36.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.701+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~N9P4WGGCD8O7.2 size=1034565 2024-09-12T00:09:36.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.701+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=N9P4WGGCD8O7 tag=184131TGD2ND type=write size=4180293 2024-09-12T00:09:36.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.703+0000 7f3dc2c18780 1 < suggested update operation key=4POD73U0LAC0 tag=RY0RQFL9Y300 type=write size=967292 2024-09-12T00:09:36.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.704+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=9O2W2THUBEPR type=del size=517589 2024-09-12T00:09:36.704 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.705+0000 7f3dc2c18780 -1 < failed to complete operation key=UJDQEIAIRVDW tag=VP6YJ5LZD08A type=write size=233774: (22) Invalid argument 2024-09-12T00:09:36.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.707+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=M770P9S0XPMK type=del size=2596503 2024-09-12T00:09:36.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.709+0000 7f3dc2c18780 1 < suggested update operation key=5BM1TMLRBHTS tag=S7HMFW6YGGL8 type=del size=4079447 2024-09-12T00:09:36.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.710+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=MNJL8GM553PI type=del size=2864809 2024-09-12T00:09:36.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.711+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~NA0XSG6RO2A4.0 size=1048576 2024-09-12T00:09:36.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.712+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~NA0XSG6RO2A4.1 size=1048576 2024-09-12T00:09:36.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.713+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~NA0XSG6RO2A4.2 size=160748 2024-09-12T00:09:36.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.715+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=NA0XSG6RO2A4 tag=XQJSHTE8U962 type=write size=3306476 2024-09-12T00:09:36.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.716+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=37Y323GICNIF type=write size=323859 2024-09-12T00:09:36.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.719+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=5N2C77KLS8FL type=del size=2830321 2024-09-12T00:09:36.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.721+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~ZGE2FHZE26A1.0 size=941499 2024-09-12T00:09:36.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.721+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=ZGE2FHZE26A1 tag=6EEIIYEL83OR type=write size=1990075 2024-09-12T00:09:36.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.722+0000 7f3dc2c18780 1 < completed write operation key=Y40G8SLO6AVH tag=QHHL0W30JUTD type=write size=863810 2024-09-12T00:09:36.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.723+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=ZQ6AQ6S95E6J type=write size=647899 2024-09-12T00:09:36.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.726+0000 7f3dc2c18780 1 < suggested update operation key=C0JT46SGECP0 tag=KVNRXH5W3HLL type=del size=1668304 2024-09-12T00:09:36.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.727+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=N8EYAFLE6S08 type=del size=2627299 2024-09-12T00:09:36.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.729+0000 7f3dc2c18780 1 < suggested remove operation key=5F0BB9U7Y6ZZ tag=ZEEDXSE7F4Z9 type=del 2024-09-12T00:09:36.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.731+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~Q2L2PMA8KMCO.0 size=324708 2024-09-12T00:09:36.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.731+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=Q2L2PMA8KMCO tag=KHK6U335YNNJ type=write size=1373284 2024-09-12T00:09:36.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.732+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~5769JDSP1TY7.0 size=103018 2024-09-12T00:09:36.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.735+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=5769JDSP1TY7 tag=RZY1W99GC4NL type=write size=1151594 2024-09-12T00:09:36.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.736+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=MKN3QOBHMDTZ type=del size=2786137 2024-09-12T00:09:36.736 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.737+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~MBLVBCH4P54L.0 size=1048576 2024-09-12T00:09:36.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.738+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~MBLVBCH4P54L.1 size=370613 2024-09-12T00:09:36.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.740+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=MBLVBCH4P54L tag=837OCL17EAID type=write size=2467765 2024-09-12T00:09:36.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.741+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=0T479DSPXQQ6 type=del size=2758213 2024-09-12T00:09:36.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.742+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=J5P8GJLCN4PP type=del 2024-09-12T00:09:36.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.745+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~82MEJKHKV69P.0 size=1048576 2024-09-12T00:09:36.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.745+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~82MEJKHKV69P.1 size=240015 2024-09-12T00:09:36.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.745+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=82MEJKHKV69P tag=NGNA0T1OP7UF type=write size=2337167 2024-09-12T00:09:36.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.747+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~VIG45T9VCA9U.0 size=894570 2024-09-12T00:09:36.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.748+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=VIG45T9VCA9U tag=3KY3DDAPVBUH type=write size=1943146 2024-09-12T00:09:36.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.750+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=YE54CIUVUD08 type=del size=1528279 2024-09-12T00:09:36.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.750+0000 7f3dc2c18780 1 < canceled part key=_multipart_OGRGDIUO2W8B.2~NJPKGY7A4XF4.0 size=1048576 2024-09-12T00:09:36.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.750+0000 7f3dc2c18780 1 < canceled part key=_multipart_OGRGDIUO2W8B.2~NJPKGY7A4XF4.1 size=1048576 2024-09-12T00:09:36.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.751+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~NJPKGY7A4XF4.2 size=308622 2024-09-12T00:09:36.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.753+0000 7f3dc2c18780 1 < canceled multipart upload key=OGRGDIUO2W8B upload=NJPKGY7A4XF4 tag=1E6CZFGBWUEY type=write size=3454350 2024-09-12T00:09:36.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.754+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=1MABILGL1Z7V type=write size=587943 2024-09-12T00:09:36.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.755+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~11JGTGIXG46X.0 size=662177 2024-09-12T00:09:36.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.757+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=11JGTGIXG46X tag=83ZI66E107S1 type=write size=1710753 2024-09-12T00:09:36.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.758+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=230ST36HSQQH type=write size=218426 2024-09-12T00:09:36.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.961+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=8BF9NFPYFW7M type=del 2024-09-12T00:09:36.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.963+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=ZPS15OUBUG3J type=del size=1844725 2024-09-12T00:09:36.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.964+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~N9P4WGGCD8O7.0 size=1048576 2024-09-12T00:09:36.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.965+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~N9P4WGGCD8O7.1 size=1048576 2024-09-12T00:09:36.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.966+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~N9P4WGGCD8O7.2 size=1034565 2024-09-12T00:09:36.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.968+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=N9P4WGGCD8O7 tag=184131TGD2ND type=write size=4180293 2024-09-12T00:09:36.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.970+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=HST7NFN9LN7A type=del size=4152350 2024-09-12T00:09:36.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.971+0000 7f3dc2c18780 -1 < failed to complete operation key=2SO8HBZSAMRX tag=9O2W2THUBEPR type=del size=517589: (22) Invalid argument 2024-09-12T00:09:36.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.972+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=O7XDZMH17FXR type=del size=4027364 2024-09-12T00:09:36.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.973+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=M770P9S0XPMK type=del 2024-09-12T00:09:36.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.975+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=FGUV1GYEUYHR type=write size=1048396 2024-09-12T00:09:36.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.976+0000 7f3dc2c18780 -1 < failed to complete operation key=C0JT46SGECP0 tag=MNJL8GM553PI type=del size=2864809: (22) Invalid argument 2024-09-12T00:09:36.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.977+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=TOWC75YG6LUK type=del size=2442690 2024-09-12T00:09:36.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.979+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=37Y323GICNIF type=write size=323859 2024-09-12T00:09:36.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.980+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=2OSITET1G58N type=del size=2884874 2024-09-12T00:09:36.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.981+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~ZGE2FHZE26A1.0 size=941499 2024-09-12T00:09:36.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.983+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=ZGE2FHZE26A1 tag=6EEIIYEL83OR type=write size=1990075 2024-09-12T00:09:36.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.985+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=PJEW54DRIIRL type=del size=1461671 2024-09-12T00:09:36.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.986+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=ZQ6AQ6S95E6J type=write size=647899 2024-09-12T00:09:36.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.987+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=2RIRU34NEKKY type=del size=2377110 2024-09-12T00:09:36.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.990+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=N8EYAFLE6S08 type=del 2024-09-12T00:09:36.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.991+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=7DM15P618Z83 type=del size=2660958 2024-09-12T00:09:36.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.992+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~Q2L2PMA8KMCO.0 size=324708 2024-09-12T00:09:36.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.994+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=Q2L2PMA8KMCO tag=KHK6U335YNNJ type=write size=1373284 2024-09-12T00:09:36.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.996+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=JEXAY6VVO3PF type=del size=2881644 2024-09-12T00:09:36.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.997+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=MKN3QOBHMDTZ type=del 2024-09-12T00:09:36.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:36.998+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=7L58NN6PATXT type=del size=1845411 2024-09-12T00:09:36.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.000+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=0T479DSPXQQ6 type=del 2024-09-12T00:09:36.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.001+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=DYUZ38HVN17I type=del size=3723269 2024-09-12T00:09:37.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.002+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~82MEJKHKV69P.0 size=1048576 2024-09-12T00:09:37.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.003+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~82MEJKHKV69P.1 size=240015 2024-09-12T00:09:37.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.005+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=82MEJKHKV69P tag=NGNA0T1OP7UF type=write size=2337167 2024-09-12T00:09:37.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.007+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=3VHUB4WHQGIW type=del size=1952835 2024-09-12T00:09:37.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.008+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=YE54CIUVUD08 type=del 2024-09-12T00:09:37.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.009+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=JHJQ2V35E7H5 type=del size=3292204 2024-09-12T00:09:37.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.011+0000 7f3dc2c18780 1 < completed write operation key=5F0BB9U7Y6ZZ tag=1MABILGL1Z7V type=write size=587943 2024-09-12T00:09:37.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.012+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=NW3X82LTSO2D type=del size=3786837 2024-09-12T00:09:37.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.013+0000 7f3dc2c18780 1 < completed write operation key=OGRGDIUO2W8B tag=230ST36HSQQH type=write size=218426 2024-09-12T00:09:37.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.015+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=737SV3SLSAOK type=del size=934798 2024-09-12T00:09:37.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.016+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=ZPS15OUBUG3J type=del 2024-09-12T00:09:37.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.018+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~FQVQMROID1SD.0 size=87933 2024-09-12T00:09:37.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.018+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=FQVQMROID1SD tag=QJDR430I5YFD type=write size=1136509 2024-09-12T00:09:37.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.021+0000 7f3dc2c18780 1 < suggested remove operation key=KQWXE62PF5F7 tag=HST7NFN9LN7A type=del 2024-09-12T00:09:37.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.022+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=CDGY5URQ86BR type=del size=250265 2024-09-12T00:09:37.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.023+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=O7XDZMH17FXR type=del 2024-09-12T00:09:37.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.025+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~8TKX7KTAXVDB.0 size=628540 2024-09-12T00:09:37.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.025+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=8TKX7KTAXVDB tag=9I6F6NWK22CJ type=write size=1677116 2024-09-12T00:09:37.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.028+0000 7f3dc2c18780 1 < suggested remove operation key=Y40G8SLO6AVH tag=FGUV1GYEUYHR type=write 2024-09-12T00:09:37.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.029+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=7SSEWVF0HQ4T type=del size=527509 2024-09-12T00:09:37.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.030+0000 7f3dc2c18780 -1 < failed to complete operation key=Y40G8SLO6AVH tag=TOWC75YG6LUK type=del size=2442690: (22) Invalid argument 2024-09-12T00:09:37.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.031+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=DPPWCPF2OLMI type=del size=1710450 2024-09-12T00:09:37.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.033+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=2OSITET1G58N type=del 2024-09-12T00:09:37.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.034+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=E5GE8A3KLY1Y type=del size=1880872 2024-09-12T00:09:37.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.034+0000 7f3dc2c18780 -1 < no bi entry to suggest for operation key=KQWXE62PF5F7 tag=PJEW54DRIIRL type=del size=1461671: (2) No such file or directory 2024-09-12T00:09:37.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.036+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~7YLNOO28D4JT.0 size=1048576 2024-09-12T00:09:37.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.037+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~7YLNOO28D4JT.1 size=722083 2024-09-12T00:09:37.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.037+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=7YLNOO28D4JT tag=AMXMIWFU3NXH type=write size=2819235 2024-09-12T00:09:37.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.039+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=2RIRU34NEKKY type=del 2024-09-12T00:09:37.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.040+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=38YINA780LMI type=del size=502193 2024-09-12T00:09:37.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.042+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=7DM15P618Z83 type=del 2024-09-12T00:09:37.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.044+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~S0TSFX9RC3PJ.0 size=527676 2024-09-12T00:09:37.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.044+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=S0TSFX9RC3PJ tag=6BW9GVRWPX3D type=write size=1576252 2024-09-12T00:09:37.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.045+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=JEXAY6VVO3PF type=del 2024-09-12T00:09:37.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.047+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~VH78SQONPL2O.0 size=1048576 2024-09-12T00:09:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.048+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~VH78SQONPL2O.1 size=132955 2024-09-12T00:09:37.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.048+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=VH78SQONPL2O tag=B8WHIXNO77MJ type=write size=2230107 2024-09-12T00:09:37.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.050+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=7L58NN6PATXT type=del 2024-09-12T00:09:37.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.052+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~LVXU1K3T2124.0 size=1048576 2024-09-12T00:09:37.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.053+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~LVXU1K3T2124.1 size=1048576 2024-09-12T00:09:37.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.054+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~LVXU1K3T2124.2 size=613717 2024-09-12T00:09:37.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.054+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=LVXU1K3T2124 tag=4Q0PZLXDMISB type=write size=3759445 2024-09-12T00:09:37.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.055+0000 7f3dc2c18780 1 < canceled operation key=65DTZR8A5OHF tag=DYUZ38HVN17I type=del size=3723269 2024-09-12T00:09:37.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.056+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=W64DW58WWUVX type=write size=824466 2024-09-12T00:09:37.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.059+0000 7f3dc2c18780 1 < suggested remove operation key=L9C014T8YLNV tag=3VHUB4WHQGIW type=del 2024-09-12T00:09:37.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.061+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~QAFJVNMBMJS9.0 size=1048576 2024-09-12T00:09:37.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.062+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~QAFJVNMBMJS9.1 size=267256 2024-09-12T00:09:37.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.062+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=QAFJVNMBMJS9 tag=2E3K53VM1YFG type=write size=2364408 2024-09-12T00:09:37.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.063+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=JHJQ2V35E7H5 type=del 2024-09-12T00:09:37.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.064+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=XCZ1WHR03ECN type=del size=401167 2024-09-12T00:09:37.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.066+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=NW3X82LTSO2D type=del 2024-09-12T00:09:37.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.067+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=TR5A16PVRBNT type=del size=946229 2024-09-12T00:09:37.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.069+0000 7f3dc2c18780 1 < suggested remove operation key=UJDQEIAIRVDW tag=737SV3SLSAOK type=del 2024-09-12T00:09:37.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.070+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=TIGWSCGAI18J type=write size=694778 2024-09-12T00:09:37.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.072+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~FQVQMROID1SD.0 size=87933 2024-09-12T00:09:37.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.074+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=FQVQMROID1SD tag=QJDR430I5YFD type=write size=1136509 2024-09-12T00:09:37.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.075+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=1ZO9BPFO19UU type=del size=1782527 2024-09-12T00:09:37.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.076+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=CDGY5URQ86BR type=del 2024-09-12T00:09:37.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.077+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=VZPS1MQV75U4 type=del size=4043251 2024-09-12T00:09:37.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.078+0000 7f3dc2c18780 1 < canceled part key=_multipart_V0K5FRKYGJ0K.2~8TKX7KTAXVDB.0 size=628540 2024-09-12T00:09:37.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.080+0000 7f3dc2c18780 1 < canceled multipart upload key=V0K5FRKYGJ0K upload=8TKX7KTAXVDB tag=9I6F6NWK22CJ type=write size=1677116 2024-09-12T00:09:37.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.081+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=9AZEG8GYX4FK type=del size=1513863 2024-09-12T00:09:37.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.082+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=7SSEWVF0HQ4T type=del 2024-09-12T00:09:37.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.083+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=OGB7TC3TVAOT type=write size=343092 2024-09-12T00:09:37.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.086+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=DPPWCPF2OLMI type=del size=1710450 2024-09-12T00:09:37.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.087+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=5NRXC68YMGH0 type=del size=1482253 2024-09-12T00:09:37.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.089+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=E5GE8A3KLY1Y type=del 2024-09-12T00:09:37.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.090+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=ZDKACYXZEKN0 type=del size=1440974 2024-09-12T00:09:37.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.091+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~7YLNOO28D4JT.0 size=1048576 2024-09-12T00:09:37.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.092+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~7YLNOO28D4JT.1 size=722083 2024-09-12T00:09:37.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.094+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=7YLNOO28D4JT tag=AMXMIWFU3NXH type=write size=2819235 2024-09-12T00:09:37.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.096+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=Y535HV5MEROR type=del size=462066 2024-09-12T00:09:37.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.097+0000 7f3dc2c18780 -1 < failed to complete operation key=0ICU4WV9K1RG tag=38YINA780LMI type=del size=502193: (22) Invalid argument 2024-09-12T00:09:37.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.099+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~NS5ULR7QNHSE.0 size=1048576 2024-09-12T00:09:37.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.100+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~NS5ULR7QNHSE.1 size=1048576 2024-09-12T00:09:37.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.101+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~NS5ULR7QNHSE.2 size=544775 2024-09-12T00:09:37.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.101+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=NS5ULR7QNHSE tag=2P96QB37S76R type=write size=3690503 2024-09-12T00:09:37.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.102+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~S0TSFX9RC3PJ.0 size=527676 2024-09-12T00:09:37.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.104+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=S0TSFX9RC3PJ tag=6BW9GVRWPX3D type=write size=1576252 2024-09-12T00:09:37.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.107+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~P55CZ8T8TJDF.0 size=1048576 2024-09-12T00:09:37.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.107+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~P55CZ8T8TJDF.1 size=1048576 2024-09-12T00:09:37.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.109+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~P55CZ8T8TJDF.2 size=641294 2024-09-12T00:09:37.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.109+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=P55CZ8T8TJDF tag=FIZ01H6HLW9Y type=write size=3787022 2024-09-12T00:09:37.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.110+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~VH78SQONPL2O.0 size=1048576 2024-09-12T00:09:37.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.110+0000 7f3dc2c18780 1 < canceled part key=_multipart_L9C014T8YLNV.2~VH78SQONPL2O.1 size=132955 2024-09-12T00:09:37.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.112+0000 7f3dc2c18780 1 < canceled multipart upload key=L9C014T8YLNV upload=VH78SQONPL2O tag=B8WHIXNO77MJ type=write size=2230107 2024-09-12T00:09:37.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.113+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=CZV9M3HDY5QU type=del size=3956163 2024-09-12T00:09:37.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.115+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~LVXU1K3T2124.0 size=1048576 2024-09-12T00:09:37.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.116+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~LVXU1K3T2124.1 size=1048576 2024-09-12T00:09:37.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.116+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~LVXU1K3T2124.2 size=613717 2024-09-12T00:09:37.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.119+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=LVXU1K3T2124 tag=4Q0PZLXDMISB type=write size=3759445 2024-09-12T00:09:37.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.120+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=NUZLFAHBGDGW type=del size=3148486 2024-09-12T00:09:37.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.121+0000 7f3dc2c18780 1 < completed write operation key=5MAV2RJ4E31S tag=W64DW58WWUVX type=write size=824466 2024-09-12T00:09:37.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.122+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=RQZTCBCY1QTI type=del size=4023468 2024-09-12T00:09:37.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.124+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~QAFJVNMBMJS9.0 size=1048576 2024-09-12T00:09:37.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.125+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~QAFJVNMBMJS9.1 size=267256 2024-09-12T00:09:37.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.127+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=QAFJVNMBMJS9 tag=2E3K53VM1YFG type=write size=2364408 2024-09-12T00:09:37.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.129+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~UBPRQJOT3ZW3.0 size=1048576 2024-09-12T00:09:37.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.130+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~UBPRQJOT3ZW3.1 size=365171 2024-09-12T00:09:37.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.130+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=UBPRQJOT3ZW3 tag=PWD4RZVSFOWT type=write size=2462323 2024-09-12T00:09:37.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.131+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=XCZ1WHR03ECN type=del 2024-09-12T00:09:37.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.132+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=X79Z8A0BJ0L6 type=del size=3157905 2024-09-12T00:09:37.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.134+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=TR5A16PVRBNT type=del 2024-09-12T00:09:37.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.135+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=1U3KJLFPMT44 type=del size=1220589 2024-09-12T00:09:37.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.136+0000 7f3dc2c18780 1 < completed write operation key=OGRGDIUO2W8B tag=TIGWSCGAI18J type=write size=694778 2024-09-12T00:09:37.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.138+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~4S8GEZ5P9KZI.0 size=187677 2024-09-12T00:09:37.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.138+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=4S8GEZ5P9KZI tag=OW9XX64WRZHB type=write size=1236253 2024-09-12T00:09:37.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.141+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=1ZO9BPFO19UU type=del size=1782527 2024-09-12T00:09:37.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.142+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=R63LUHGQZKEI type=del size=2189142 2024-09-12T00:09:37.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.143+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=VZPS1MQV75U4 type=del 2024-09-12T00:09:37.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.146+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~P3WBH0RM9HFQ.0 size=1048576 2024-09-12T00:09:37.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.147+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~P3WBH0RM9HFQ.1 size=545640 2024-09-12T00:09:37.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.147+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=P3WBH0RM9HFQ tag=71HTDA39RZPQ type=write size=2642792 2024-09-12T00:09:37.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.149+0000 7f3dc2c18780 1 < suggested remove operation key=U2H0A1GZROT7 tag=9AZEG8GYX4FK type=del 2024-09-12T00:09:37.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.151+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~5W9R2PC8RVKA.0 size=845464 2024-09-12T00:09:37.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.151+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=5W9R2PC8RVKA tag=UG0GHTW8INEY type=write size=1894040 2024-09-12T00:09:37.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.153+0000 7f3dc2c18780 1 < completed write operation key=5F0BB9U7Y6ZZ tag=OGB7TC3TVAOT type=write size=343092 2024-09-12T00:09:37.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.154+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=E1XXBCSO1292 type=del size=922090 2024-09-12T00:09:37.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.155+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=5NRXC68YMGH0 type=del 2024-09-12T00:09:37.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.156+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=UYTU4JCQA1FP type=write size=245804 2024-09-12T00:09:37.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.157+0000 7f3dc2c18780 -1 < failed to complete operation key=U2H0A1GZROT7 tag=ZDKACYXZEKN0 type=del size=1440974: (22) Invalid argument 2024-09-12T00:09:37.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.160+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~CFY1UM8JY0WH.0 size=1048576 2024-09-12T00:09:37.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.161+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~CFY1UM8JY0WH.1 size=666633 2024-09-12T00:09:37.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.161+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=CFY1UM8JY0WH tag=DLYY4OHN56Y5 type=write size=2763785 2024-09-12T00:09:37.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.164+0000 7f3dc2c18780 1 < suggested update operation key=5F0BB9U7Y6ZZ tag=Y535HV5MEROR type=del size=462066 2024-09-12T00:09:37.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.165+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=8C6XJHMZY8C7 type=del size=889875 2024-09-12T00:09:37.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.166+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~NS5ULR7QNHSE.0 size=1048576 2024-09-12T00:09:37.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.169+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~NS5ULR7QNHSE.1 size=1048576 2024-09-12T00:09:37.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.169+0000 7f3dc2c18780 1 < canceled part key=_multipart_KQWXE62PF5F7.2~NS5ULR7QNHSE.2 size=544775 2024-09-12T00:09:37.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.171+0000 7f3dc2c18780 1 < canceled multipart upload key=KQWXE62PF5F7 upload=NS5ULR7QNHSE tag=2P96QB37S76R type=write size=3690503 2024-09-12T00:09:37.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.172+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=8PNZ6JUV3KWU type=del size=2814147 2024-09-12T00:09:37.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.173+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~P55CZ8T8TJDF.0 size=1048576 2024-09-12T00:09:37.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.174+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~P55CZ8T8TJDF.1 size=1048576 2024-09-12T00:09:37.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.175+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~P55CZ8T8TJDF.2 size=641294 2024-09-12T00:09:37.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.178+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=P55CZ8T8TJDF tag=FIZ01H6HLW9Y type=write size=3787022 2024-09-12T00:09:37.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.180+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~ZNGIADIYUZCS.0 size=1048576 2024-09-12T00:09:37.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.181+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~ZNGIADIYUZCS.1 size=1048576 2024-09-12T00:09:37.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.182+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~ZNGIADIYUZCS.2 size=430582 2024-09-12T00:09:37.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.182+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=ZNGIADIYUZCS tag=JBUKZYNBYMA5 type=write size=3576310 2024-09-12T00:09:37.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.183+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=CZV9M3HDY5QU type=del 2024-09-12T00:09:37.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.184+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=8JK2JSVNES5G type=del size=547827 2024-09-12T00:09:37.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.186+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=NUZLFAHBGDGW type=del 2024-09-12T00:09:37.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.187+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=QGC1OQ3484B1 type=del size=2952498 2024-09-12T00:09:37.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.188+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=RQZTCBCY1QTI type=del 2024-09-12T00:09:37.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.189+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=7V4LT7F9LWVU type=del size=241733 2024-09-12T00:09:37.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.191+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~UBPRQJOT3ZW3.0 size=1048576 2024-09-12T00:09:37.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.192+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~UBPRQJOT3ZW3.1 size=365171 2024-09-12T00:09:37.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.194+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=UBPRQJOT3ZW3 tag=PWD4RZVSFOWT type=write size=2462323 2024-09-12T00:09:37.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.196+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~D937UQFQ08E9.0 size=1048576 2024-09-12T00:09:37.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.197+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~D937UQFQ08E9.1 size=826311 2024-09-12T00:09:37.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.197+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=D937UQFQ08E9 tag=E7GE52FCCH61 type=write size=2923463 2024-09-12T00:09:37.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.199+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=X79Z8A0BJ0L6 type=del 2024-09-12T00:09:37.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.200+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=CUH2GWWVQF50 type=del size=1475194 2024-09-12T00:09:37.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.201+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=1U3KJLFPMT44 type=del 2024-09-12T00:09:37.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.202+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=7LC8424TCPEF type=del size=419482 2024-09-12T00:09:37.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.204+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~4S8GEZ5P9KZI.0 size=187677 2024-09-12T00:09:37.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.206+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=4S8GEZ5P9KZI tag=OW9XX64WRZHB type=write size=1236253 2024-09-12T00:09:37.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.207+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=LX2C5LZI72KK type=write size=373220 2024-09-12T00:09:37.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.209+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=R63LUHGQZKEI type=del 2024-09-12T00:09:37.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.211+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~H57IHT4DGFF1.0 size=789296 2024-09-12T00:09:37.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.211+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=H57IHT4DGFF1 tag=IRDCITFD0EMV type=write size=1837872 2024-09-12T00:09:37.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.212+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~P3WBH0RM9HFQ.0 size=1048576 2024-09-12T00:09:37.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.213+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~P3WBH0RM9HFQ.1 size=545640 2024-09-12T00:09:37.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.215+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=P3WBH0RM9HFQ tag=71HTDA39RZPQ type=write size=2642792 2024-09-12T00:09:37.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.218+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~0BZH13W7ERVL.0 size=1048576 2024-09-12T00:09:37.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.219+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~0BZH13W7ERVL.1 size=1048576 2024-09-12T00:09:37.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.220+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~0BZH13W7ERVL.2 size=186325 2024-09-12T00:09:37.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.220+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=0BZH13W7ERVL tag=YQ8FE5B40K9R type=write size=3332053 2024-09-12T00:09:37.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.221+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~5W9R2PC8RVKA.0 size=845464 2024-09-12T00:09:37.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.223+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=5W9R2PC8RVKA tag=UG0GHTW8INEY type=write size=1894040 2024-09-12T00:09:37.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.226+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~7MOFAUB87SOA.0 size=1048576 2024-09-12T00:09:37.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.228+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~7MOFAUB87SOA.1 size=1048576 2024-09-12T00:09:37.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.229+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~7MOFAUB87SOA.2 size=307439 2024-09-12T00:09:37.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.229+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=7MOFAUB87SOA tag=5AR0FAIOYS5G type=write size=3453167 2024-09-12T00:09:37.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.231+0000 7f3dc2c18780 1 < suggested update operation key=UJDQEIAIRVDW tag=E1XXBCSO1292 type=del size=922090 2024-09-12T00:09:37.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.232+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=H7BV2AB0KCYA type=del size=2885343 2024-09-12T00:09:37.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.235+0000 7f3dc2c18780 1 < suggested remove operation key=L9C014T8YLNV tag=UYTU4JCQA1FP type=write 2024-09-12T00:09:37.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.236+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=3X2KVGA6K1F1 type=del size=3104866 2024-09-12T00:09:37.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.237+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~CFY1UM8JY0WH.0 size=1048576 2024-09-12T00:09:37.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.238+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~CFY1UM8JY0WH.1 size=666633 2024-09-12T00:09:37.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.240+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=CFY1UM8JY0WH tag=DLYY4OHN56Y5 type=write size=2763785 2024-09-12T00:09:37.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.242+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=YZ4WZGKV32KT type=del size=1018767 2024-09-12T00:09:37.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.243+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=8C6XJHMZY8C7 type=del 2024-09-12T00:09:37.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.244+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=CW33C7ELPX55 type=del size=2673685 2024-09-12T00:09:37.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.245+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=8PNZ6JUV3KWU type=del 2024-09-12T00:09:37.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.246+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=WY3FXWMOQLJA type=del size=1447075 2024-09-12T00:09:37.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.248+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~ZNGIADIYUZCS.0 size=1048576 2024-09-12T00:09:37.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.249+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~ZNGIADIYUZCS.1 size=1048576 2024-09-12T00:09:37.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.250+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~ZNGIADIYUZCS.2 size=430582 2024-09-12T00:09:37.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.251+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=ZNGIADIYUZCS tag=JBUKZYNBYMA5 type=write size=3576310 2024-09-12T00:09:37.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.253+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=33E1XQJFC0OU type=del size=1916231 2024-09-12T00:09:37.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.254+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=8JK2JSVNES5G type=del 2024-09-12T00:09:37.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.256+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~364ODLM0VIUO.0 size=1048576 2024-09-12T00:09:37.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.257+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~364ODLM0VIUO.1 size=1027419 2024-09-12T00:09:37.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.257+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=364ODLM0VIUO tag=6G2F4KFKOIQQ type=write size=3124571 2024-09-12T00:09:37.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.259+0000 7f3dc2c18780 1 < canceled operation key=GLAOX3ZNNILD tag=QGC1OQ3484B1 type=del size=2952498 2024-09-12T00:09:37.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.261+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~9JIUO0487CDX.0 size=1048576 2024-09-12T00:09:37.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.262+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~9JIUO0487CDX.1 size=734302 2024-09-12T00:09:37.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.262+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=9JIUO0487CDX tag=RAL0191AJY6T type=write size=2831454 2024-09-12T00:09:37.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.263+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=7V4LT7F9LWVU type=del 2024-09-12T00:09:37.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.264+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=EVV0PDD676L9 type=del size=3231672 2024-09-12T00:09:37.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.265+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~D937UQFQ08E9.0 size=1048576 2024-09-12T00:09:37.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.266+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~D937UQFQ08E9.1 size=826311 2024-09-12T00:09:37.266 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.268+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=D937UQFQ08E9 tag=E7GE52FCCH61 type=write size=2923463 2024-09-12T00:09:37.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.270+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~4IY28GR9N70Y.0 size=1048576 2024-09-12T00:09:37.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.271+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~4IY28GR9N70Y.1 size=1048576 2024-09-12T00:09:37.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.272+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~4IY28GR9N70Y.2 size=982238 2024-09-12T00:09:37.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.272+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=4IY28GR9N70Y tag=NAOZMF1AUVLJ type=write size=4127966 2024-09-12T00:09:37.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.273+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=CUH2GWWVQF50 type=del 2024-09-12T00:09:37.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.275+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=33G9ND307PH8 type=del size=560966 2024-09-12T00:09:37.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.276+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=7LC8424TCPEF type=del 2024-09-12T00:09:37.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.278+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~I15N65NPLQPI.0 size=1048576 2024-09-12T00:09:37.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.279+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~I15N65NPLQPI.1 size=921238 2024-09-12T00:09:37.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.279+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=I15N65NPLQPI tag=49XDJXP1EY6G type=write size=3018390 2024-09-12T00:09:37.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.280+0000 7f3dc2c18780 1 < completed write operation key=65DTZR8A5OHF tag=LX2C5LZI72KK type=write size=373220 2024-09-12T00:09:37.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.282+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=M2A1N32G383T type=del size=2725668 2024-09-12T00:09:37.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.283+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~H57IHT4DGFF1.0 size=789296 2024-09-12T00:09:37.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.285+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=H57IHT4DGFF1 tag=IRDCITFD0EMV type=write size=1837872 2024-09-12T00:09:37.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.287+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~HL9RAYD04X7K.0 size=1048576 2024-09-12T00:09:37.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.288+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~HL9RAYD04X7K.1 size=90566 2024-09-12T00:09:37.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.288+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=HL9RAYD04X7K tag=I97PU62CP8YN type=write size=2187718 2024-09-12T00:09:37.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.289+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~0BZH13W7ERVL.0 size=1048576 2024-09-12T00:09:37.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.290+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~0BZH13W7ERVL.1 size=1048576 2024-09-12T00:09:37.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.290+0000 7f3dc2c18780 1 < canceled part key=_multipart_OGRGDIUO2W8B.2~0BZH13W7ERVL.2 size=186325 2024-09-12T00:09:37.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.292+0000 7f3dc2c18780 1 < canceled multipart upload key=OGRGDIUO2W8B upload=0BZH13W7ERVL tag=YQ8FE5B40K9R type=write size=3332053 2024-09-12T00:09:37.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.293+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=6N7MJT5O57IR type=write size=179209 2024-09-12T00:09:37.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.294+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~7MOFAUB87SOA.0 size=1048576 2024-09-12T00:09:37.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.295+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~7MOFAUB87SOA.1 size=1048576 2024-09-12T00:09:37.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.297+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~7MOFAUB87SOA.2 size=307439 2024-09-12T00:09:37.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.299+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=7MOFAUB87SOA tag=5AR0FAIOYS5G type=write size=3453167 2024-09-12T00:09:37.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.300+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=T0YCYIDULCWS type=del size=2602543 2024-09-12T00:09:37.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.303+0000 7f3dc2c18780 1 < suggested remove operation key=OGRGDIUO2W8B tag=H7BV2AB0KCYA type=del 2024-09-12T00:09:37.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.304+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=7NK19U7JCCK0 type=write size=849586 2024-09-12T00:09:37.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.305+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=3X2KVGA6K1F1 type=del 2024-09-12T00:09:37.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.308+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~DE353LXHU2JK.0 size=1048576 2024-09-12T00:09:37.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.309+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~DE353LXHU2JK.1 size=1048576 2024-09-12T00:09:37.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.310+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~DE353LXHU2JK.2 size=569638 2024-09-12T00:09:37.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.310+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=DE353LXHU2JK tag=CGEVO0KRIICB type=write size=3715366 2024-09-12T00:09:37.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.311+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=YZ4WZGKV32KT type=del 2024-09-12T00:09:37.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.313+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~RXQSNYQIGKSH.0 size=564250 2024-09-12T00:09:37.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.313+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=RXQSNYQIGKSH tag=YK88FDJ3RYW7 type=write size=1612826 2024-09-12T00:09:37.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.315+0000 7f3dc2c18780 1 < suggested update operation key=Y40G8SLO6AVH tag=CW33C7ELPX55 type=del size=2673685 2024-09-12T00:09:37.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.318+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~WFJR18C7XJTW.0 size=1048576 2024-09-12T00:09:37.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.319+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~WFJR18C7XJTW.1 size=1048576 2024-09-12T00:09:37.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.320+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~WFJR18C7XJTW.2 size=34775 2024-09-12T00:09:37.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.320+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=WFJR18C7XJTW tag=T3V0436GCTNH type=write size=3180503 2024-09-12T00:09:37.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.321+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=WY3FXWMOQLJA type=del 2024-09-12T00:09:37.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.323+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=5LTANEGMEW3Q type=write size=971259 2024-09-12T00:09:37.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.324+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=33E1XQJFC0OU type=del 2024-09-12T00:09:37.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.326+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~OPA2YRDJBJKB.0 size=1048576 2024-09-12T00:09:37.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.327+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~OPA2YRDJBJKB.1 size=51831 2024-09-12T00:09:37.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.327+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=OPA2YRDJBJKB tag=O4T0XPVBDITK type=write size=2148983 2024-09-12T00:09:37.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.328+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~364ODLM0VIUO.0 size=1048576 2024-09-12T00:09:37.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.329+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~364ODLM0VIUO.1 size=1027419 2024-09-12T00:09:37.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.331+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=364ODLM0VIUO tag=6G2F4KFKOIQQ type=write size=3124571 2024-09-12T00:09:37.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.333+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=2FPWSCOH3AJP type=del size=2170718 2024-09-12T00:09:37.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.334+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~9JIUO0487CDX.0 size=1048576 2024-09-12T00:09:37.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.335+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~9JIUO0487CDX.1 size=734302 2024-09-12T00:09:37.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.337+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=9JIUO0487CDX tag=RAL0191AJY6T type=write size=2831454 2024-09-12T00:09:37.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.338+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=NMU6TF0O0ILB type=del size=2688963 2024-09-12T00:09:37.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.340+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=EVV0PDD676L9 type=del 2024-09-12T00:09:37.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.342+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=KU303B2L3K21 type=del size=3976150 2024-09-12T00:09:37.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.343+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~4IY28GR9N70Y.0 size=1048576 2024-09-12T00:09:37.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.344+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~4IY28GR9N70Y.1 size=1048576 2024-09-12T00:09:37.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.344+0000 7f3dc2c18780 1 < canceled part key=_multipart_A4O7JFS2ULY0.2~4IY28GR9N70Y.2 size=982238 2024-09-12T00:09:37.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.346+0000 7f3dc2c18780 1 < canceled multipart upload key=A4O7JFS2ULY0 upload=4IY28GR9N70Y tag=NAOZMF1AUVLJ type=write size=4127966 2024-09-12T00:09:37.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.348+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~ALC0A4TS0PZ8.0 size=1048576 2024-09-12T00:09:37.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.349+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~ALC0A4TS0PZ8.1 size=273741 2024-09-12T00:09:37.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.349+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=ALC0A4TS0PZ8 tag=E58GG802OWOI type=write size=2370893 2024-09-12T00:09:37.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.350+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=33G9ND307PH8 type=del 2024-09-12T00:09:37.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.351+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=PBM8B5DYFFS1 type=del size=2115541 2024-09-12T00:09:37.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.353+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~I15N65NPLQPI.0 size=1048576 2024-09-12T00:09:37.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.354+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~I15N65NPLQPI.1 size=921238 2024-09-12T00:09:37.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.356+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=I15N65NPLQPI tag=49XDJXP1EY6G type=write size=3018390 2024-09-12T00:09:37.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.357+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=65TGCEP2XS24 type=del size=1524365 2024-09-12T00:09:37.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.358+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=M2A1N32G383T type=del 2024-09-12T00:09:37.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.360+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~4F9Q6NCU00IO.0 size=1048576 2024-09-12T00:09:37.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.361+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~4F9Q6NCU00IO.1 size=968273 2024-09-12T00:09:37.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.361+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=4F9Q6NCU00IO tag=B4AGL6RJSDUC type=write size=3065425 2024-09-12T00:09:37.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.363+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~HL9RAYD04X7K.0 size=1048576 2024-09-12T00:09:37.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.363+0000 7f3dc2c18780 1 < canceled part key=_multipart_5BM1TMLRBHTS.2~HL9RAYD04X7K.1 size=90566 2024-09-12T00:09:37.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.365+0000 7f3dc2c18780 1 < canceled multipart upload key=5BM1TMLRBHTS upload=HL9RAYD04X7K tag=I97PU62CP8YN type=write size=2187718 2024-09-12T00:09:37.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.367+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~AI7Y2T0UAJKW.0 size=414340 2024-09-12T00:09:37.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.367+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=AI7Y2T0UAJKW tag=D6NC3FF09KDL type=write size=1462916 2024-09-12T00:09:37.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.368+0000 7f3dc2c18780 1 < completed write operation key=TSL3IDD0EDT0 tag=6N7MJT5O57IR type=write size=179209 2024-09-12T00:09:37.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.370+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~0JXO8DFR7OP4.0 size=1048576 2024-09-12T00:09:37.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.371+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~0JXO8DFR7OP4.1 size=775408 2024-09-12T00:09:37.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.371+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=0JXO8DFR7OP4 tag=APA84HQAF0P2 type=write size=2872560 2024-09-12T00:09:37.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.373+0000 7f3dc2c18780 1 < suggested update operation key=YYIQC6YL2PSW tag=T0YCYIDULCWS type=del size=2602543 2024-09-12T00:09:37.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.375+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~DOIFVIPEWOOM.0 size=188252 2024-09-12T00:09:37.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.375+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=DOIFVIPEWOOM tag=T17Y1KI6ESQJ type=write size=1236828 2024-09-12T00:09:37.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.377+0000 7f3dc2c18780 1 < completed write operation key=7JVCFTM2QMGY tag=7NK19U7JCCK0 type=write size=849586 2024-09-12T00:09:37.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.379+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~10AL2P37V09C.0 size=1048576 2024-09-12T00:09:37.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.380+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~10AL2P37V09C.1 size=1048576 2024-09-12T00:09:37.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.381+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~10AL2P37V09C.2 size=291767 2024-09-12T00:09:37.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.381+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=10AL2P37V09C tag=5XC2KP34S05X type=write size=3437495 2024-09-12T00:09:37.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.382+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~DE353LXHU2JK.0 size=1048576 2024-09-12T00:09:37.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.383+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~DE353LXHU2JK.1 size=1048576 2024-09-12T00:09:37.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.383+0000 7f3dc2c18780 1 < canceled part key=_multipart_4POD73U0LAC0.2~DE353LXHU2JK.2 size=569638 2024-09-12T00:09:37.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.385+0000 7f3dc2c18780 1 < canceled multipart upload key=4POD73U0LAC0 upload=DE353LXHU2JK tag=CGEVO0KRIICB type=write size=3715366 2024-09-12T00:09:37.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.386+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=4KY677PPPNER type=del size=2726231 2024-09-12T00:09:37.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.388+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~RXQSNYQIGKSH.0 size=564250 2024-09-12T00:09:37.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.390+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=RXQSNYQIGKSH tag=YK88FDJ3RYW7 type=write size=1612826 2024-09-12T00:09:37.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.391+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=ZUJ6G12GS2ZY type=del size=3723222 2024-09-12T00:09:37.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.392+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~WFJR18C7XJTW.0 size=1048576 2024-09-12T00:09:37.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.393+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~WFJR18C7XJTW.1 size=1048576 2024-09-12T00:09:37.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.393+0000 7f3dc2c18780 1 < canceled part key=_multipart_5BM1TMLRBHTS.2~WFJR18C7XJTW.2 size=34775 2024-09-12T00:09:37.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.396+0000 7f3dc2c18780 1 < canceled multipart upload key=5BM1TMLRBHTS upload=WFJR18C7XJTW tag=T3V0436GCTNH type=write size=3180503 2024-09-12T00:09:37.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.397+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=K9IPN6BUON2H type=del size=2919717 2024-09-12T00:09:37.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.398+0000 7f3dc2c18780 1 < completed write operation key=WRR6LAYIWOCE tag=5LTANEGMEW3Q type=write size=971259 2024-09-12T00:09:37.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.400+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~2VYK2T5EMXQZ.0 size=1048576 2024-09-12T00:09:37.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.401+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~2VYK2T5EMXQZ.1 size=772881 2024-09-12T00:09:37.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.401+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=2VYK2T5EMXQZ tag=5FFLBAJH08HW type=write size=2870033 2024-09-12T00:09:37.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.401+0000 7f3dc2c18780 1 < canceled part key=_multipart_3WUIB2OMX77J.2~OPA2YRDJBJKB.0 size=1048576 2024-09-12T00:09:37.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.402+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~OPA2YRDJBJKB.1 size=51831 2024-09-12T00:09:37.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.404+0000 7f3dc2c18780 1 < canceled multipart upload key=3WUIB2OMX77J upload=OPA2YRDJBJKB tag=O4T0XPVBDITK type=write size=2148983 2024-09-12T00:09:37.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.407+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~QLLRIB37B61G.0 size=387304 2024-09-12T00:09:37.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.407+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=QLLRIB37B61G tag=2X9MSCZAIS8Z type=write size=1435880 2024-09-12T00:09:37.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.408+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=2FPWSCOH3AJP type=del 2024-09-12T00:09:37.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.410+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~TZJW3FRFDW3N.0 size=928088 2024-09-12T00:09:37.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.410+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=TZJW3FRFDW3N tag=67TOL3N86DMH type=write size=1976664 2024-09-12T00:09:37.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.413+0000 7f3dc2c18780 1 < suggested remove operation key=GP3MLWX9586T tag=NMU6TF0O0ILB type=del 2024-09-12T00:09:37.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.414+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=I6RXG8638Z9Y type=del size=3424361 2024-09-12T00:09:37.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.415+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=KU303B2L3K21 type=del 2024-09-12T00:09:37.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.417+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=VJAHZYO1FWLA type=del size=71333 2024-09-12T00:09:37.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.418+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~ALC0A4TS0PZ8.0 size=1048576 2024-09-12T00:09:37.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.420+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~ALC0A4TS0PZ8.1 size=273741 2024-09-12T00:09:37.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.422+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=ALC0A4TS0PZ8 tag=E58GG802OWOI type=write size=2370893 2024-09-12T00:09:37.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.423+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=2WX5IMMQ55DR type=del size=4148700 2024-09-12T00:09:37.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.424+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=PBM8B5DYFFS1 type=del 2024-09-12T00:09:37.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.427+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~9G36U804RRJA.0 size=1048576 2024-09-12T00:09:37.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.428+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~9G36U804RRJA.1 size=1040152 2024-09-12T00:09:37.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.428+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=9G36U804RRJA tag=UVTV2QSR71L9 type=write size=3137304 2024-09-12T00:09:37.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.429+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=65TGCEP2XS24 type=del 2024-09-12T00:09:37.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.432+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~YLCX8O6NDJN3.0 size=1048576 2024-09-12T00:09:37.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.433+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~YLCX8O6NDJN3.1 size=1048576 2024-09-12T00:09:37.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.434+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~YLCX8O6NDJN3.2 size=161892 2024-09-12T00:09:37.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.434+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=YLCX8O6NDJN3 tag=ZI5NAK0BXKEW type=write size=3307620 2024-09-12T00:09:37.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.434+0000 7f3dc2c18780 1 < canceled part key=_multipart_4POD73U0LAC0.2~4F9Q6NCU00IO.0 size=1048576 2024-09-12T00:09:37.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.435+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~4F9Q6NCU00IO.1 size=968273 2024-09-12T00:09:37.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.437+0000 7f3dc2c18780 1 < canceled multipart upload key=4POD73U0LAC0 upload=4F9Q6NCU00IO tag=B4AGL6RJSDUC type=write size=3065425 2024-09-12T00:09:37.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.438+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=PSSDIR7S8UQB type=del size=1137709 2024-09-12T00:09:37.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.439+0000 7f3dc2c18780 1 < canceled part key=_multipart_C7ZOCTAR2BEP.2~AI7Y2T0UAJKW.0 size=414340 2024-09-12T00:09:37.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.441+0000 7f3dc2c18780 1 < canceled multipart upload key=C7ZOCTAR2BEP upload=AI7Y2T0UAJKW tag=D6NC3FF09KDL type=write size=1462916 2024-09-12T00:09:37.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.443+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~B1EG1RLAWX7O.0 size=48380 2024-09-12T00:09:37.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.443+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=B1EG1RLAWX7O tag=O6BKOKVQYVY1 type=write size=1096956 2024-09-12T00:09:37.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.443+0000 7f3dc2c18780 1 < canceled part key=_multipart_4POD73U0LAC0.2~0JXO8DFR7OP4.0 size=1048576 2024-09-12T00:09:37.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.444+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~0JXO8DFR7OP4.1 size=775408 2024-09-12T00:09:37.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.446+0000 7f3dc2c18780 1 < canceled multipart upload key=4POD73U0LAC0 upload=0JXO8DFR7OP4 tag=APA84HQAF0P2 type=write size=2872560 2024-09-12T00:09:37.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.447+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=08627OBVIKBU type=del size=1756142 2024-09-12T00:09:37.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.448+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~DOIFVIPEWOOM.0 size=188252 2024-09-12T00:09:37.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.450+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=DOIFVIPEWOOM tag=T17Y1KI6ESQJ type=write size=1236828 2024-09-12T00:09:37.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.452+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=R4G4MKL82M3N type=del size=2566611 2024-09-12T00:09:37.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.453+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~10AL2P37V09C.0 size=1048576 2024-09-12T00:09:37.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.454+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~10AL2P37V09C.1 size=1048576 2024-09-12T00:09:37.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.456+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~10AL2P37V09C.2 size=291767 2024-09-12T00:09:37.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.458+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=10AL2P37V09C tag=5XC2KP34S05X type=write size=3437495 2024-09-12T00:09:37.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.459+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=UQVGO0YB9O74 type=del size=3122053 2024-09-12T00:09:37.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.460+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=4KY677PPPNER type=del 2024-09-12T00:09:37.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.463+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~77CD8BE246TM.0 size=655466 2024-09-12T00:09:37.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.463+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=77CD8BE246TM tag=OJSEQX6EPSBO type=write size=1704042 2024-09-12T00:09:37.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.464+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=ZUJ6G12GS2ZY type=del 2024-09-12T00:09:37.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.465+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=30RMIEH0FC8Z type=del size=2326069 2024-09-12T00:09:37.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.466+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=K9IPN6BUON2H type=del 2024-09-12T00:09:37.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.468+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~TN9PMVBTTWS1.0 size=84877 2024-09-12T00:09:37.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.468+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=TN9PMVBTTWS1 tag=XH7F1M74DNT2 type=write size=1133453 2024-09-12T00:09:37.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.469+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~2VYK2T5EMXQZ.0 size=1048576 2024-09-12T00:09:37.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.470+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~2VYK2T5EMXQZ.1 size=772881 2024-09-12T00:09:37.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.472+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=2VYK2T5EMXQZ tag=5FFLBAJH08HW type=write size=2870033 2024-09-12T00:09:37.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.475+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~2V1KRBTSF71N.0 size=1048576 2024-09-12T00:09:37.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.476+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~2V1KRBTSF71N.1 size=855568 2024-09-12T00:09:37.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.476+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=2V1KRBTSF71N tag=PDXVJV3W85BO type=write size=2952720 2024-09-12T00:09:37.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.477+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~QLLRIB37B61G.0 size=387304 2024-09-12T00:09:37.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.479+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=QLLRIB37B61G tag=2X9MSCZAIS8Z type=write size=1435880 2024-09-12T00:09:37.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.480+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=88Y1W31KL5MR type=write size=809255 2024-09-12T00:09:37.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.481+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~TZJW3FRFDW3N.0 size=928088 2024-09-12T00:09:37.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.483+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=TZJW3FRFDW3N tag=67TOL3N86DMH type=write size=1976664 2024-09-12T00:09:37.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.485+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~63OWR7KU7LPD.0 size=1048576 2024-09-12T00:09:37.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.486+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~63OWR7KU7LPD.1 size=1048576 2024-09-12T00:09:37.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.487+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~63OWR7KU7LPD.2 size=799817 2024-09-12T00:09:37.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.487+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=63OWR7KU7LPD tag=5X0H1FYHMX5V type=write size=3945545 2024-09-12T00:09:37.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.488+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=I6RXG8638Z9Y type=del 2024-09-12T00:09:37.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.490+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=2A0PU1VGW9HG type=write size=454863 2024-09-12T00:09:37.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.493+0000 7f3dc2c18780 1 < suggested update operation key=KQWXE62PF5F7 tag=VJAHZYO1FWLA type=del size=71333 2024-09-12T00:09:37.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.494+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=K46RR4C5592E type=write size=438049 2024-09-12T00:09:37.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.495+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=2WX5IMMQ55DR type=del 2024-09-12T00:09:37.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.497+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~DDX5G1NM5QSS.0 size=1048576 2024-09-12T00:09:37.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.498+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~DDX5G1NM5QSS.1 size=1048576 2024-09-12T00:09:37.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.500+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~DDX5G1NM5QSS.2 size=667813 2024-09-12T00:09:37.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.500+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=DDX5G1NM5QSS tag=YZON6EP3CCN8 type=write size=3813541 2024-09-12T00:09:37.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.501+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~9G36U804RRJA.0 size=1048576 2024-09-12T00:09:37.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.502+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~9G36U804RRJA.1 size=1040152 2024-09-12T00:09:37.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.504+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=9G36U804RRJA tag=UVTV2QSR71L9 type=write size=3137304 2024-09-12T00:09:37.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.506+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=2MVWY3SCX0GA type=del size=612232 2024-09-12T00:09:37.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.508+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~YLCX8O6NDJN3.0 size=1048576 2024-09-12T00:09:37.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.508+0000 7f3dc2c18780 1 < canceled part key=_multipart_KQWXE62PF5F7.2~YLCX8O6NDJN3.1 size=1048576 2024-09-12T00:09:37.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.509+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~YLCX8O6NDJN3.2 size=161892 2024-09-12T00:09:37.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.511+0000 7f3dc2c18780 1 < canceled multipart upload key=KQWXE62PF5F7 upload=YLCX8O6NDJN3 tag=ZI5NAK0BXKEW type=write size=3307620 2024-09-12T00:09:37.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.513+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~18TBP45HGF1E.0 size=941824 2024-09-12T00:09:37.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.513+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=18TBP45HGF1E tag=DCE3SDY3M3OO type=write size=1990400 2024-09-12T00:09:37.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.515+0000 7f3dc2c18780 1 < suggested update operation key=XNZNORKYEOPV tag=PSSDIR7S8UQB type=del size=1137709 2024-09-12T00:09:37.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.517+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=M2UUU018Z9ZQ type=write size=415537 2024-09-12T00:09:37.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.518+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~B1EG1RLAWX7O.0 size=48380 2024-09-12T00:09:37.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.520+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=B1EG1RLAWX7O tag=O6BKOKVQYVY1 type=write size=1096956 2024-09-12T00:09:37.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.521+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=RQ5LRNDZM4O3 type=write size=195136 2024-09-12T00:09:37.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.522+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=08627OBVIKBU type=del 2024-09-12T00:09:37.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.524+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~2TPUQR4X1EDB.0 size=1048576 2024-09-12T00:09:37.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.525+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~2TPUQR4X1EDB.1 size=1048576 2024-09-12T00:09:37.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.526+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~2TPUQR4X1EDB.2 size=394968 2024-09-12T00:09:37.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.526+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=2TPUQR4X1EDB tag=OZJ8CWYRDEFF type=write size=3540696 2024-09-12T00:09:37.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.529+0000 7f3dc2c18780 1 < suggested remove operation key=415OYT4ML329 tag=R4G4MKL82M3N type=del 2024-09-12T00:09:37.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.530+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=1JRU40HT8FE5 type=write size=140687 2024-09-12T00:09:37.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.531+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=UQVGO0YB9O74 type=del 2024-09-12T00:09:37.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.533+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~NHDRK87O5CMY.0 size=1048576 2024-09-12T00:09:37.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.534+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~NHDRK87O5CMY.1 size=280126 2024-09-12T00:09:37.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.534+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=NHDRK87O5CMY tag=BJ9PTVGO2FQA type=write size=2377278 2024-09-12T00:09:37.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.535+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~77CD8BE246TM.0 size=655466 2024-09-12T00:09:37.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.537+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=77CD8BE246TM tag=OJSEQX6EPSBO type=write size=1704042 2024-09-12T00:09:37.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.539+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~XNNPMUMCOBCL.0 size=1048576 2024-09-12T00:09:37.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.540+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~XNNPMUMCOBCL.1 size=952197 2024-09-12T00:09:37.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.540+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=XNNPMUMCOBCL tag=MHNOG4590ROW type=write size=3049349 2024-09-12T00:09:37.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.541+0000 7f3dc2c18780 -1 < no bi entry to suggest for operation key=415OYT4ML329 tag=30RMIEH0FC8Z type=del size=2326069: (2) No such file or directory 2024-09-12T00:09:37.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.542+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=R331YMVQ0RRJ type=write size=884213 2024-09-12T00:09:37.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.543+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~TN9PMVBTTWS1.0 size=84877 2024-09-12T00:09:37.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.545+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=TN9PMVBTTWS1 tag=XH7F1M74DNT2 type=write size=1133453 2024-09-12T00:09:37.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.546+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=3IOR73U1HMLN type=del size=772491 2024-09-12T00:09:37.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.547+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~2V1KRBTSF71N.0 size=1048576 2024-09-12T00:09:37.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.548+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~2V1KRBTSF71N.1 size=855568 2024-09-12T00:09:37.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.550+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=2V1KRBTSF71N tag=PDXVJV3W85BO type=write size=2952720 2024-09-12T00:09:37.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.551+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=WXAD79RT17SJ type=del size=53691 2024-09-12T00:09:37.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.552+0000 7f3dc2c18780 1 < completed write operation key=0ICU4WV9K1RG tag=88Y1W31KL5MR type=write size=809255 2024-09-12T00:09:37.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.554+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=GRKWS2OGBPMD type=write size=645101 2024-09-12T00:09:37.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.555+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~63OWR7KU7LPD.0 size=1048576 2024-09-12T00:09:37.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.555+0000 7f3dc2c18780 1 < canceled part key=_multipart_GLAOX3ZNNILD.2~63OWR7KU7LPD.1 size=1048576 2024-09-12T00:09:37.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.557+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~63OWR7KU7LPD.2 size=799817 2024-09-12T00:09:37.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.559+0000 7f3dc2c18780 1 < canceled multipart upload key=GLAOX3ZNNILD upload=63OWR7KU7LPD tag=5X0H1FYHMX5V type=write size=3945545 2024-09-12T00:09:37.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.560+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=OYQ5LPH3TOK1 type=del size=821308 2024-09-12T00:09:37.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.561+0000 7f3dc2c18780 1 < completed write operation key=QJ3KML910OEL tag=2A0PU1VGW9HG type=write size=454863 2024-09-12T00:09:37.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.563+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~Z8QEC8DO7P29.0 size=1048576 2024-09-12T00:09:37.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.564+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~Z8QEC8DO7P29.1 size=1048576 2024-09-12T00:09:37.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.565+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~Z8QEC8DO7P29.2 size=94573 2024-09-12T00:09:37.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.565+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=Z8QEC8DO7P29 tag=ZDWMIL8SAXWL type=write size=3240301 2024-09-12T00:09:37.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.566+0000 7f3dc2c18780 1 < completed write operation key=5BM1TMLRBHTS tag=K46RR4C5592E type=write size=438049 2024-09-12T00:09:37.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.568+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=10RH8BEFFMY9 type=del size=2602838 2024-09-12T00:09:37.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.570+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~DDX5G1NM5QSS.0 size=1048576 2024-09-12T00:09:37.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.571+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~DDX5G1NM5QSS.1 size=1048576 2024-09-12T00:09:37.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.574+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~DDX5G1NM5QSS.2 size=667813 2024-09-12T00:09:37.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.576+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=DDX5G1NM5QSS tag=YZON6EP3CCN8 type=write size=3813541 2024-09-12T00:09:37.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.577+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=EKR1RZ522FNW type=del size=544627 2024-09-12T00:09:37.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.580+0000 7f3dc2c18780 1 < suggested update operation key=UJDQEIAIRVDW tag=2MVWY3SCX0GA type=del size=612232 2024-09-12T00:09:37.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.582+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~EIC22MDM7X9Y.0 size=276439 2024-09-12T00:09:37.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.582+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=EIC22MDM7X9Y tag=0BNPCATJEZ8S type=write size=1325015 2024-09-12T00:09:37.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.582+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~18TBP45HGF1E.0 size=941824 2024-09-12T00:09:37.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.584+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=18TBP45HGF1E tag=DCE3SDY3M3OO type=write size=1990400 2024-09-12T00:09:37.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.587+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~80MMJ9JBNBCZ.0 size=852338 2024-09-12T00:09:37.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.587+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=80MMJ9JBNBCZ tag=61GDQIST4UHB type=write size=1900914 2024-09-12T00:09:37.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.589+0000 7f3dc2c18780 1 < suggested remove operation key=5F0BB9U7Y6ZZ tag=M2UUU018Z9ZQ type=write 2024-09-12T00:09:37.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.590+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=HPFFUGNVH26U type=write size=396623 2024-09-12T00:09:37.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.593+0000 7f3dc2c18780 1 < suggested remove operation key=A4O7JFS2ULY0 tag=RQ5LRNDZM4O3 type=write 2024-09-12T00:09:37.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.594+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=8GFE9DY1X2OZ type=del size=235656 2024-09-12T00:09:37.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.595+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~2TPUQR4X1EDB.0 size=1048576 2024-09-12T00:09:37.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.595+0000 7f3dc2c18780 1 < canceled part key=_multipart_0ICU4WV9K1RG.2~2TPUQR4X1EDB.1 size=1048576 2024-09-12T00:09:37.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.596+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~2TPUQR4X1EDB.2 size=394968 2024-09-12T00:09:37.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.598+0000 7f3dc2c18780 1 < canceled multipart upload key=0ICU4WV9K1RG upload=2TPUQR4X1EDB tag=OZJ8CWYRDEFF type=write size=3540696 2024-09-12T00:09:37.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.600+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~LYYPK3V0F71F.0 size=134626 2024-09-12T00:09:37.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.600+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=LYYPK3V0F71F tag=8S5AXRBP2OXW type=write size=1183202 2024-09-12T00:09:37.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.601+0000 7f3dc2c18780 1 < completed write operation key=4POD73U0LAC0 tag=1JRU40HT8FE5 type=write size=140687 2024-09-12T00:09:37.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.603+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=LGWG1N0IZFQE type=del size=2516754 2024-09-12T00:09:37.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.604+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~NHDRK87O5CMY.0 size=1048576 2024-09-12T00:09:37.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.605+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~NHDRK87O5CMY.1 size=280126 2024-09-12T00:09:37.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.607+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=NHDRK87O5CMY tag=BJ9PTVGO2FQA type=write size=2377278 2024-09-12T00:09:37.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.609+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~5ET7YIA6GWHY.0 size=973943 2024-09-12T00:09:37.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.609+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=5ET7YIA6GWHY tag=LKKZE0QI93W1 type=write size=2022519 2024-09-12T00:09:37.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.611+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~XNNPMUMCOBCL.0 size=1048576 2024-09-12T00:09:37.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.612+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~XNNPMUMCOBCL.1 size=952197 2024-09-12T00:09:37.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.614+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=XNNPMUMCOBCL tag=MHNOG4590ROW type=write size=3049349 2024-09-12T00:09:37.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.615+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=3D0DA67BC2JR type=del size=3042837 2024-09-12T00:09:37.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.617+0000 7f3dc2c18780 1 < suggested update operation key=3WUIB2OMX77J tag=R331YMVQ0RRJ type=write size=884213 2024-09-12T00:09:37.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.619+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=J9AGHH6W31DZ type=write size=32225 2024-09-12T00:09:37.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.620+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=3IOR73U1HMLN type=del 2024-09-12T00:09:37.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.622+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~54713DNMUKQR.0 size=1034572 2024-09-12T00:09:37.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.622+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=54713DNMUKQR tag=SZJR3DD1JRAX type=write size=2083148 2024-09-12T00:09:37.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.623+0000 7f3dc2c18780 1 < canceled operation key=C7ZOCTAR2BEP tag=WXAD79RT17SJ type=del size=53691 2024-09-12T00:09:37.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.625+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=HIHYA0EVTOGF type=del size=1584753 2024-09-12T00:09:37.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.626+0000 7f3dc2c18780 1 < completed write operation key=2SO8HBZSAMRX tag=GRKWS2OGBPMD type=write size=645101 2024-09-12T00:09:37.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.627+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=KZC5E1WOIFLV type=del size=2799662 2024-09-12T00:09:37.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.628+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=OYQ5LPH3TOK1 type=del 2024-09-12T00:09:37.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.630+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=2SNBOIDE1M3Y type=del size=209656 2024-09-12T00:09:37.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.631+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~Z8QEC8DO7P29.0 size=1048576 2024-09-12T00:09:37.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.632+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~Z8QEC8DO7P29.1 size=1048576 2024-09-12T00:09:37.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.633+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~Z8QEC8DO7P29.2 size=94573 2024-09-12T00:09:37.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.635+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=Z8QEC8DO7P29 tag=ZDWMIL8SAXWL type=write size=3240301 2024-09-12T00:09:37.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.636+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=HDAUNX26VOPY type=del size=3363690 2024-09-12T00:09:37.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.638+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=10RH8BEFFMY9 type=del 2024-09-12T00:09:37.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.639+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=84L464HH3VGY type=del size=152862 2024-09-12T00:09:37.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.640+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=EKR1RZ522FNW type=del 2024-09-12T00:09:37.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.641+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=774DOY9J6X33 type=del size=1834559 2024-09-12T00:09:37.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.643+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~EIC22MDM7X9Y.0 size=276439 2024-09-12T00:09:37.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.645+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=EIC22MDM7X9Y tag=0BNPCATJEZ8S type=write size=1325015 2024-09-12T00:09:37.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.649+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~NDW1OTE6A9TI.0 size=1048576 2024-09-12T00:09:37.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.650+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~NDW1OTE6A9TI.1 size=1048576 2024-09-12T00:09:37.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.651+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~NDW1OTE6A9TI.2 size=683245 2024-09-12T00:09:37.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.651+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=NDW1OTE6A9TI tag=01D1O9T8CVCA type=write size=3828973 2024-09-12T00:09:37.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.653+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~80MMJ9JBNBCZ.0 size=852338 2024-09-12T00:09:37.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.655+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=80MMJ9JBNBCZ tag=61GDQIST4UHB type=write size=1900914 2024-09-12T00:09:37.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.658+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~FM8QB4C0Y7R8.0 size=1048576 2024-09-12T00:09:37.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.659+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~FM8QB4C0Y7R8.1 size=694981 2024-09-12T00:09:37.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.659+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=FM8QB4C0Y7R8 tag=X1ITUQ5V6YQB type=write size=2792133 2024-09-12T00:09:37.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.661+0000 7f3dc2c18780 1 < completed write operation key=L9C014T8YLNV tag=HPFFUGNVH26U type=write size=396623 2024-09-12T00:09:37.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.662+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=PUE5PATIBUKS type=write size=691087 2024-09-12T00:09:37.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.663+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=8GFE9DY1X2OZ type=del 2024-09-12T00:09:37.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.665+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=O8CY6W9G1K3M type=write size=430116 2024-09-12T00:09:37.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.666+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~LYYPK3V0F71F.0 size=134626 2024-09-12T00:09:37.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.668+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=LYYPK3V0F71F tag=8S5AXRBP2OXW type=write size=1183202 2024-09-12T00:09:37.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.670+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~FH9M4JYFV6V7.0 size=1048576 2024-09-12T00:09:37.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.671+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~FH9M4JYFV6V7.1 size=125117 2024-09-12T00:09:37.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.671+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=FH9M4JYFV6V7 tag=0NM9P782PCVL type=write size=2222269 2024-09-12T00:09:37.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.673+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=LGWG1N0IZFQE type=del 2024-09-12T00:09:37.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.675+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~ABKXSJVN3ZEI.0 size=1048576 2024-09-12T00:09:37.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.676+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~ABKXSJVN3ZEI.1 size=820150 2024-09-12T00:09:37.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.676+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=ABKXSJVN3ZEI tag=KSZX6W0EU8UE type=write size=2917302 2024-09-12T00:09:37.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.676+0000 7f3dc2c18780 1 < canceled part key=_multipart_65DTZR8A5OHF.2~5ET7YIA6GWHY.0 size=973943 2024-09-12T00:09:37.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.678+0000 7f3dc2c18780 1 < canceled multipart upload key=65DTZR8A5OHF upload=5ET7YIA6GWHY tag=LKKZE0QI93W1 type=write size=2022519 2024-09-12T00:09:37.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.679+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=P58ZW2LTKDJ4 type=del size=3878942 2024-09-12T00:09:37.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.681+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=3D0DA67BC2JR type=del 2024-09-12T00:09:37.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.683+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~3K5VXGMH3NYG.0 size=1048576 2024-09-12T00:09:37.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.684+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~3K5VXGMH3NYG.1 size=239031 2024-09-12T00:09:37.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.684+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=3K5VXGMH3NYG tag=B0GV8XUF3UCZ type=write size=2336183 2024-09-12T00:09:37.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.685+0000 7f3dc2c18780 1 < canceled operation key=5MAV2RJ4E31S tag=J9AGHH6W31DZ type=write size=32225 2024-09-12T00:09:37.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.687+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=UC4YGK8VNECE type=del size=2122677 2024-09-12T00:09:37.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.688+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~54713DNMUKQR.0 size=1034572 2024-09-12T00:09:37.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.690+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=54713DNMUKQR tag=SZJR3DD1JRAX type=write size=2083148 2024-09-12T00:09:37.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.692+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=IOBXRPJWUP3V type=del size=1462766 2024-09-12T00:09:37.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.694+0000 7f3dc2c18780 1 < canceled operation key=WRBBH64CISJZ tag=HIHYA0EVTOGF type=del size=1584753 2024-09-12T00:09:37.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.696+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~JFYB6I7RABQO.0 size=975862 2024-09-12T00:09:37.695 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.696+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=JFYB6I7RABQO tag=CTTY0HUOHPLO type=write size=2024438 2024-09-12T00:09:37.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.698+0000 7f3dc2c18780 1 < suggested remove operation key=XNZNORKYEOPV tag=KZC5E1WOIFLV type=del 2024-09-12T00:09:37.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.700+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=A3PNJUW3HNTC type=del size=3710151 2024-09-12T00:09:37.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.701+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=2SNBOIDE1M3Y type=del 2024-09-12T00:09:37.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.702+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=UOLWML4BSE6S type=del size=1671389 2024-09-12T00:09:37.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.704+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=HDAUNX26VOPY type=del 2024-09-12T00:09:37.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.705+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=U4F8V25RTQLE type=del size=1592727 2024-09-12T00:09:37.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.706+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=84L464HH3VGY type=del 2024-09-12T00:09:37.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.708+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~L54JJC7BX2XJ.0 size=676789 2024-09-12T00:09:37.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.708+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=L54JJC7BX2XJ tag=LIY7BW0WLN9D type=write size=1725365 2024-09-12T00:09:37.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.711+0000 7f3dc2c18780 1 < suggested remove operation key=WRBBH64CISJZ tag=774DOY9J6X33 type=del 2024-09-12T00:09:37.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.713+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~TDBEYOVDN3HV.0 size=186803 2024-09-12T00:09:37.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.713+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=TDBEYOVDN3HV tag=45MP5QVVPWKZ type=write size=1235379 2024-09-12T00:09:37.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.716+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~NDW1OTE6A9TI.0 size=1048576 2024-09-12T00:09:37.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.717+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~NDW1OTE6A9TI.1 size=1048576 2024-09-12T00:09:37.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.718+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~NDW1OTE6A9TI.2 size=683245 2024-09-12T00:09:37.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.720+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=NDW1OTE6A9TI tag=01D1O9T8CVCA type=write size=3828973 2024-09-12T00:09:37.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.722+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~KMXR8XW16NT7.0 size=1048576 2024-09-12T00:09:37.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.723+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~KMXR8XW16NT7.1 size=1048576 2024-09-12T00:09:37.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.724+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~KMXR8XW16NT7.2 size=186900 2024-09-12T00:09:37.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.724+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=KMXR8XW16NT7 tag=3H32ALIM02C8 type=write size=3332628 2024-09-12T00:09:37.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.725+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRBBH64CISJZ.2~FM8QB4C0Y7R8.0 size=1048576 2024-09-12T00:09:37.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.726+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~FM8QB4C0Y7R8.1 size=694981 2024-09-12T00:09:37.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.728+0000 7f3dc2c18780 1 < canceled multipart upload key=WRBBH64CISJZ upload=FM8QB4C0Y7R8 tag=X1ITUQ5V6YQB type=write size=2792133 2024-09-12T00:09:37.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.730+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~L8J4IYX4ULRD.0 size=1048576 2024-09-12T00:09:37.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.731+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~L8J4IYX4ULRD.1 size=81811 2024-09-12T00:09:37.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.731+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=L8J4IYX4ULRD tag=TRVX11Z65XU9 type=write size=2178963 2024-09-12T00:09:37.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.734+0000 7f3dc2c18780 1 < suggested remove operation key=2SO8HBZSAMRX tag=PUE5PATIBUKS type=write 2024-09-12T00:09:37.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.735+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=OC10YT72I6Y6 type=del size=4100521 2024-09-12T00:09:37.736 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.738+0000 7f3dc2c18780 1 < suggested update operation key=GLAOX3ZNNILD tag=O8CY6W9G1K3M type=write size=430116 2024-09-12T00:09:37.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.739+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=S9BKAK94STJX type=del size=872703 2024-09-12T00:09:37.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.740+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~FH9M4JYFV6V7.0 size=1048576 2024-09-12T00:09:37.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.741+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~FH9M4JYFV6V7.1 size=125117 2024-09-12T00:09:37.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.743+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=FH9M4JYFV6V7 tag=0NM9P782PCVL type=write size=2222269 2024-09-12T00:09:37.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.744+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=LYYAIAII8BZ6 type=del size=3789342 2024-09-12T00:09:37.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.746+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~ABKXSJVN3ZEI.0 size=1048576 2024-09-12T00:09:37.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.747+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~ABKXSJVN3ZEI.1 size=820150 2024-09-12T00:09:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.748+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=ABKXSJVN3ZEI tag=KSZX6W0EU8UE type=write size=2917302 2024-09-12T00:09:37.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.750+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=0JSAAPH4VULY type=del size=1958650 2024-09-12T00:09:37.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.752+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=P58ZW2LTKDJ4 type=del size=3878942 2024-09-12T00:09:37.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.754+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~H2I4I6SUGYXI.0 size=1048576 2024-09-12T00:09:37.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.755+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~H2I4I6SUGYXI.1 size=1048576 2024-09-12T00:09:37.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.756+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~H2I4I6SUGYXI.2 size=64907 2024-09-12T00:09:37.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.756+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=H2I4I6SUGYXI tag=0LMYA83B2SJN type=write size=3210635 2024-09-12T00:09:37.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.757+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~3K5VXGMH3NYG.0 size=1048576 2024-09-12T00:09:37.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.759+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~3K5VXGMH3NYG.1 size=239031 2024-09-12T00:09:37.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.761+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=3K5VXGMH3NYG tag=B0GV8XUF3UCZ type=write size=2336183 2024-09-12T00:09:37.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.762+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=ZQU9TFYV2VV2 type=del size=298347 2024-09-12T00:09:37.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.764+0000 7f3dc2c18780 1 < suggested update operation key=UJDQEIAIRVDW tag=UC4YGK8VNECE type=del size=2122677 2024-09-12T00:09:37.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.766+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=YH6XJKLNEXVC type=del size=2801300 2024-09-12T00:09:37.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.768+0000 7f3dc2c18780 1 < suggested update operation key=OGRGDIUO2W8B tag=IOBXRPJWUP3V type=del size=1462766 2024-09-12T00:09:37.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.769+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=90R1AX2XFWC9 type=del size=4011742 2024-09-12T00:09:37.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.770+0000 7f3dc2c18780 1 < canceled part key=_multipart_OGRGDIUO2W8B.2~JFYB6I7RABQO.0 size=975862 2024-09-12T00:09:37.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.772+0000 7f3dc2c18780 1 < canceled multipart upload key=OGRGDIUO2W8B upload=JFYB6I7RABQO tag=CTTY0HUOHPLO type=write size=2024438 2024-09-12T00:09:37.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.773+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=KRQI025UMO4N type=del size=913264 2024-09-12T00:09:37.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.774+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=A3PNJUW3HNTC type=del 2024-09-12T00:09:37.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.776+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=0Z6V68E1Z6JQ type=del size=1019086 2024-09-12T00:09:37.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.777+0000 7f3dc2c18780 -1 < failed to complete operation key=UJDQEIAIRVDW tag=UOLWML4BSE6S type=del size=1671389: (22) Invalid argument 2024-09-12T00:09:37.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.778+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=F0LVZ49NESX2 type=del size=720338 2024-09-12T00:09:37.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.779+0000 7f3dc2c18780 -1 < failed to complete operation key=OGRGDIUO2W8B tag=U4F8V25RTQLE type=del size=1592727: (22) Invalid argument 2024-09-12T00:09:37.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.781+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=YSZAPZHCQS55 type=del size=855517 2024-09-12T00:09:37.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.782+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~L54JJC7BX2XJ.0 size=676789 2024-09-12T00:09:37.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.784+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=L54JJC7BX2XJ tag=LIY7BW0WLN9D type=write size=1725365 2024-09-12T00:09:37.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.785+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=42DEA1B3SK58 type=del size=994850 2024-09-12T00:09:37.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.787+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~TDBEYOVDN3HV.0 size=186803 2024-09-12T00:09:37.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.789+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=TDBEYOVDN3HV tag=45MP5QVVPWKZ type=write size=1235379 2024-09-12T00:09:37.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.790+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=L6HVBC51XMA2 type=write size=75765 2024-09-12T00:09:37.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.791+0000 7f3dc2c18780 1 < canceled part key=_multipart_415OYT4ML329.2~KMXR8XW16NT7.0 size=1048576 2024-09-12T00:09:37.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.791+0000 7f3dc2c18780 1 < canceled part key=_multipart_415OYT4ML329.2~KMXR8XW16NT7.1 size=1048576 2024-09-12T00:09:37.790 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.792+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~KMXR8XW16NT7.2 size=186900 2024-09-12T00:09:37.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.794+0000 7f3dc2c18780 1 < canceled multipart upload key=415OYT4ML329 upload=KMXR8XW16NT7 tag=3H32ALIM02C8 type=write size=3332628 2024-09-12T00:09:37.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.795+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=79YM59AQQMTI type=del size=193145 2024-09-12T00:09:37.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.797+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~L8J4IYX4ULRD.0 size=1048576 2024-09-12T00:09:37.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.798+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~L8J4IYX4ULRD.1 size=81811 2024-09-12T00:09:37.799 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.800+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=L8J4IYX4ULRD tag=TRVX11Z65XU9 type=write size=2178963 2024-09-12T00:09:37.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.802+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~IR8O2KN81922.0 size=1048576 2024-09-12T00:09:37.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.803+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~IR8O2KN81922.1 size=1048576 2024-09-12T00:09:37.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.804+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~IR8O2KN81922.2 size=701599 2024-09-12T00:09:37.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.804+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=IR8O2KN81922 tag=4UOZOGJJFNEG type=write size=3847327 2024-09-12T00:09:37.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.806+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=OC10YT72I6Y6 type=del 2024-09-12T00:09:37.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.807+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=DKCT2AAHXYKL type=del size=3520612 2024-09-12T00:09:37.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.808+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=S9BKAK94STJX type=del 2024-09-12T00:09:37.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.810+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=9WR9PJ441DJB type=del size=3545214 2024-09-12T00:09:37.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.813+0000 7f3dc2c18780 1 < suggested remove operation key=L9C014T8YLNV tag=LYYAIAII8BZ6 type=del 2024-09-12T00:09:37.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.816+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~62FR8VZ1L7G2.0 size=496935 2024-09-12T00:09:37.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.816+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=62FR8VZ1L7G2 tag=DZLXSGQFUJ49 type=write size=1545511 2024-09-12T00:09:37.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.817+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=0JSAAPH4VULY type=del 2024-09-12T00:09:37.816 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.818+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=IZ3HQ1P4UQ79 type=del size=2054869 2024-09-12T00:09:37.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.819+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~H2I4I6SUGYXI.0 size=1048576 2024-09-12T00:09:37.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.821+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~H2I4I6SUGYXI.1 size=1048576 2024-09-12T00:09:37.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.822+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~H2I4I6SUGYXI.2 size=64907 2024-09-12T00:09:37.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.824+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=H2I4I6SUGYXI tag=0LMYA83B2SJN type=write size=3210635 2024-09-12T00:09:37.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.825+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=ZX4WGXEM3YC2 type=del size=1750834 2024-09-12T00:09:37.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.827+0000 7f3dc2c18780 1 < canceled operation key=2SO8HBZSAMRX tag=ZQU9TFYV2VV2 type=del size=298347 2024-09-12T00:09:37.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.829+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~Q4HN5AQ2528D.0 size=1048576 2024-09-12T00:09:37.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.830+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~Q4HN5AQ2528D.1 size=144124 2024-09-12T00:09:37.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.830+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=Q4HN5AQ2528D tag=E69OE1YDONCP type=write size=2241276 2024-09-12T00:09:37.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.831+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=YH6XJKLNEXVC type=del 2024-09-12T00:09:37.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.833+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=6717HNRQ3D0L type=del size=1560795 2024-09-12T00:09:37.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.834+0000 7f3dc2c18780 1 < canceled operation key=2SO8HBZSAMRX tag=90R1AX2XFWC9 type=del size=4011742 2024-09-12T00:09:37.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.835+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=P9FRONBG5PFM type=del size=1221504 2024-09-12T00:09:37.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.838+0000 7f3dc2c18780 1 < suggested update operation key=OGRGDIUO2W8B tag=KRQI025UMO4N type=del size=913264 2024-09-12T00:09:37.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.840+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~8EYJHMPDJNAU.0 size=426893 2024-09-12T00:09:37.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.840+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=8EYJHMPDJNAU tag=WJH2YARG65QJ type=write size=1475469 2024-09-12T00:09:37.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.842+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=0Z6V68E1Z6JQ type=del 2024-09-12T00:09:37.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.843+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=FRA18ZZTMC0F type=del size=2492417 2024-09-12T00:09:37.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.844+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=F0LVZ49NESX2 type=del 2024-09-12T00:09:37.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.847+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~ORHVRDJ4GUW7.0 size=1048576 2024-09-12T00:09:37.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.848+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~ORHVRDJ4GUW7.1 size=1048576 2024-09-12T00:09:37.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.849+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~ORHVRDJ4GUW7.2 size=1021299 2024-09-12T00:09:37.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.849+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=ORHVRDJ4GUW7 tag=VN2REJOLY43Y type=write size=4167027 2024-09-12T00:09:37.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.850+0000 7f3dc2c18780 1 < canceled operation key=5CS98S02F59L tag=YSZAPZHCQS55 type=del size=855517 2024-09-12T00:09:37.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.851+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=0HOOE521W0E5 type=del size=1452277 2024-09-12T00:09:37.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.853+0000 7f3dc2c18780 1 < canceled operation key=5F0BB9U7Y6ZZ tag=42DEA1B3SK58 type=del size=994850 2024-09-12T00:09:37.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.854+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=ANH0G07PH1X7 type=del size=4046264 2024-09-12T00:09:37.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.857+0000 7f3dc2c18780 1 < suggested update operation key=415OYT4ML329 tag=L6HVBC51XMA2 type=write size=75765 2024-09-12T00:09:37.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.858+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=J0ARIYLCNWCP type=del size=685966 2024-09-12T00:09:37.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.860+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=79YM59AQQMTI type=del 2024-09-12T00:09:37.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.861+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=9BTXR43Z0DYE type=del size=4050133 2024-09-12T00:09:37.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.862+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~IR8O2KN81922.0 size=1048576 2024-09-12T00:09:37.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.863+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~IR8O2KN81922.1 size=1048576 2024-09-12T00:09:37.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.863+0000 7f3dc2c18780 1 < canceled part key=_multipart_415OYT4ML329.2~IR8O2KN81922.2 size=701599 2024-09-12T00:09:37.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.865+0000 7f3dc2c18780 1 < canceled multipart upload key=415OYT4ML329 upload=IR8O2KN81922 tag=4UOZOGJJFNEG type=write size=3847327 2024-09-12T00:09:37.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.866+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=ME87D1OCI54I type=del size=3221398 2024-09-12T00:09:37.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.869+0000 7f3dc2c18780 1 < suggested remove operation key=KQWXE62PF5F7 tag=DKCT2AAHXYKL type=del 2024-09-12T00:09:37.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.871+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=C0D8ZYTRLGQW type=del size=948337 2024-09-12T00:09:37.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.872+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=9WR9PJ441DJB type=del 2024-09-12T00:09:37.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.873+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=8L7PLWUZSSU1 type=del size=1569838 2024-09-12T00:09:37.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.876+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~62FR8VZ1L7G2.0 size=496935 2024-09-12T00:09:37.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.878+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=62FR8VZ1L7G2 tag=DZLXSGQFUJ49 type=write size=1545511 2024-09-12T00:09:37.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.879+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=X41J2P6T2G8U type=del size=3730762 2024-09-12T00:09:37.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.881+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=IZ3HQ1P4UQ79 type=del 2024-09-12T00:09:37.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.882+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=83QFAQPYHBQ3 type=del size=2065793 2024-09-12T00:09:37.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.883+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=ZX4WGXEM3YC2 type=del 2024-09-12T00:09:37.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.884+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=LR291TYRZXX5 type=del size=3338101 2024-09-12T00:09:37.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.886+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~Q4HN5AQ2528D.0 size=1048576 2024-09-12T00:09:37.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.887+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~Q4HN5AQ2528D.1 size=144124 2024-09-12T00:09:37.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.889+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=Q4HN5AQ2528D tag=E69OE1YDONCP type=write size=2241276 2024-09-12T00:09:37.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.891+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~LE9M11614TX3.0 size=1048576 2024-09-12T00:09:37.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.892+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~LE9M11614TX3.1 size=426089 2024-09-12T00:09:37.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.892+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=LE9M11614TX3 tag=MMOGWWY3IH07 type=write size=2523241 2024-09-12T00:09:37.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.895+0000 7f3dc2c18780 1 < suggested update operation key=3WUIB2OMX77J tag=6717HNRQ3D0L type=del size=1560795 2024-09-12T00:09:37.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.896+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=Q7MXFL34MKZX type=del size=1557496 2024-09-12T00:09:37.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.897+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=P9FRONBG5PFM type=del 2024-09-12T00:09:37.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.899+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~IQN1LO14H7OK.0 size=1048576 2024-09-12T00:09:37.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.900+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~IQN1LO14H7OK.1 size=1048576 2024-09-12T00:09:37.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.901+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~IQN1LO14H7OK.2 size=123893 2024-09-12T00:09:37.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.902+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=IQN1LO14H7OK tag=QU2GIYAUO77B type=write size=3269621 2024-09-12T00:09:37.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.903+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~8EYJHMPDJNAU.0 size=426893 2024-09-12T00:09:37.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.905+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=8EYJHMPDJNAU tag=WJH2YARG65QJ type=write size=1475469 2024-09-12T00:09:37.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.907+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~6LO5MH5F6RUL.0 size=608753 2024-09-12T00:09:37.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.907+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=6LO5MH5F6RUL tag=AI3OWAV3DRLT type=write size=1657329 2024-09-12T00:09:37.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.910+0000 7f3dc2c18780 1 < suggested update operation key=WRR6LAYIWOCE tag=FRA18ZZTMC0F type=del size=2492417 2024-09-12T00:09:37.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.911+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=5F6Y9QKRR42H type=del size=1110687 2024-09-12T00:09:37.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.912+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~ORHVRDJ4GUW7.0 size=1048576 2024-09-12T00:09:37.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.913+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~ORHVRDJ4GUW7.1 size=1048576 2024-09-12T00:09:37.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.914+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~ORHVRDJ4GUW7.2 size=1021299 2024-09-12T00:09:37.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.916+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=ORHVRDJ4GUW7 tag=VN2REJOLY43Y type=write size=4167027 2024-09-12T00:09:37.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.918+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=WDJ7QI01MMU2 type=del size=1053998 2024-09-12T00:09:37.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.920+0000 7f3dc2c18780 1 < suggested remove operation key=C7ZOCTAR2BEP tag=0HOOE521W0E5 type=del 2024-09-12T00:09:37.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.923+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~8ZBW476CM7BA.0 size=1048576 2024-09-12T00:09:37.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.924+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~8ZBW476CM7BA.1 size=865867 2024-09-12T00:09:37.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.924+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=8ZBW476CM7BA tag=01ND66ZHB91G type=write size=2963019 2024-09-12T00:09:37.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.925+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=ANH0G07PH1X7 type=del 2024-09-12T00:09:37.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.926+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=XM401B36773Y type=del size=1401722 2024-09-12T00:09:37.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.927+0000 7f3dc2c18780 -1 < failed to complete operation key=WRR6LAYIWOCE tag=J0ARIYLCNWCP type=del size=685966: (22) Invalid argument 2024-09-12T00:09:37.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.929+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=SWIEXBYL94UM type=del size=362940 2024-09-12T00:09:37.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.930+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=9BTXR43Z0DYE type=del 2024-09-12T00:09:37.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.933+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~9X4YWNAP4UOW.0 size=312242 2024-09-12T00:09:37.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.933+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=9X4YWNAP4UOW tag=6WT46KD0B5WB type=write size=1360818 2024-09-12T00:09:37.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.936+0000 7f3dc2c18780 1 < suggested remove operation key=KQWXE62PF5F7 tag=ME87D1OCI54I type=del 2024-09-12T00:09:37.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.940+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~LCOFUX214YDW.0 size=277238 2024-09-12T00:09:37.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.940+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=LCOFUX214YDW tag=AF4BG0IA2XG9 type=write size=1325814 2024-09-12T00:09:37.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.942+0000 7f3dc2c18780 1 < suggested remove operation key=415OYT4ML329 tag=C0D8ZYTRLGQW type=del 2024-09-12T00:09:37.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.944+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~A9JC709O6AUD.0 size=1048576 2024-09-12T00:09:37.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.945+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~A9JC709O6AUD.1 size=808524 2024-09-12T00:09:37.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.945+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=A9JC709O6AUD tag=P0WR4ZSSA7X6 type=write size=2905676 2024-09-12T00:09:37.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.946+0000 7f3dc2c18780 -1 < failed to complete operation key=WRR6LAYIWOCE tag=8L7PLWUZSSU1 type=del size=1569838: (22) Invalid argument 2024-09-12T00:09:37.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.948+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~NSLLEYJUY0YJ.0 size=1048576 2024-09-12T00:09:37.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.949+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~NSLLEYJUY0YJ.1 size=434277 2024-09-12T00:09:37.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.949+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=NSLLEYJUY0YJ tag=XKIIB9374VDP type=write size=2531429 2024-09-12T00:09:37.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.950+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=X41J2P6T2G8U type=del 2024-09-12T00:09:37.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.952+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=HSJC2NE6VJ56 type=write size=362552 2024-09-12T00:09:37.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.953+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=83QFAQPYHBQ3 type=del 2024-09-12T00:09:37.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.955+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~DVD86Z4X0T3S.0 size=1048576 2024-09-12T00:09:37.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.956+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~DVD86Z4X0T3S.1 size=692394 2024-09-12T00:09:37.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.956+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=DVD86Z4X0T3S tag=U22QDACXYF6T type=write size=2789546 2024-09-12T00:09:37.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.958+0000 7f3dc2c18780 1 < suggested update operation key=QJ3KML910OEL tag=LR291TYRZXX5 type=del size=3338101 2024-09-12T00:09:37.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.960+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~RSX8U0KPDS3D.0 size=175547 2024-09-12T00:09:37.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.960+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=RSX8U0KPDS3D tag=EN5S8RPICW68 type=write size=1224123 2024-09-12T00:09:37.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.962+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~LE9M11614TX3.0 size=1048576 2024-09-12T00:09:37.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.963+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~LE9M11614TX3.1 size=426089 2024-09-12T00:09:37.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.965+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=LE9M11614TX3 tag=MMOGWWY3IH07 type=write size=2523241 2024-09-12T00:09:37.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.967+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~AAZTO6DXOHJX.0 size=432739 2024-09-12T00:09:37.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.967+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=AAZTO6DXOHJX tag=NZIBLRD2OA9F type=write size=1481315 2024-09-12T00:09:37.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.969+0000 7f3dc2c18780 1 < suggested update operation key=OGRGDIUO2W8B tag=Q7MXFL34MKZX type=del size=1557496 2024-09-12T00:09:37.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.972+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~KO8GZNK55EXI.0 size=1048576 2024-09-12T00:09:37.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.973+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~KO8GZNK55EXI.1 size=1048576 2024-09-12T00:09:37.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.974+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~KO8GZNK55EXI.2 size=857173 2024-09-12T00:09:37.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.974+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=KO8GZNK55EXI tag=ORR0SI4Z3OS5 type=write size=4002901 2024-09-12T00:09:37.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.975+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~IQN1LO14H7OK.0 size=1048576 2024-09-12T00:09:37.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.976+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~IQN1LO14H7OK.1 size=1048576 2024-09-12T00:09:37.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.977+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~IQN1LO14H7OK.2 size=123893 2024-09-12T00:09:37.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.979+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=IQN1LO14H7OK tag=QU2GIYAUO77B type=write size=3269621 2024-09-12T00:09:37.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.981+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~TALW0LT613PF.0 size=327792 2024-09-12T00:09:37.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.981+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=TALW0LT613PF tag=0DH44ALNGPVJ type=write size=1376368 2024-09-12T00:09:37.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.982+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~6LO5MH5F6RUL.0 size=608753 2024-09-12T00:09:37.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.984+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=6LO5MH5F6RUL tag=AI3OWAV3DRLT type=write size=1657329 2024-09-12T00:09:37.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.986+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~PEXT3P9TBCBF.0 size=1048576 2024-09-12T00:09:37.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.987+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~PEXT3P9TBCBF.1 size=1048576 2024-09-12T00:09:37.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.988+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~PEXT3P9TBCBF.2 size=143801 2024-09-12T00:09:37.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.988+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=PEXT3P9TBCBF tag=C09LLDJVZL9A type=write size=3289529 2024-09-12T00:09:37.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.990+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=5F6Y9QKRR42H type=del 2024-09-12T00:09:37.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.991+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=0J84GV6SOLDY type=del size=1948002 2024-09-12T00:09:37.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.992+0000 7f3dc2c18780 -1 < failed to complete operation key=KQWXE62PF5F7 tag=WDJ7QI01MMU2 type=del size=1053998: (22) Invalid argument 2024-09-12T00:09:37.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.993+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=NX470HHLU9CN type=del size=1091792 2024-09-12T00:09:37.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.995+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~8ZBW476CM7BA.0 size=1048576 2024-09-12T00:09:37.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.996+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~8ZBW476CM7BA.1 size=865867 2024-09-12T00:09:37.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:37.998+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=8ZBW476CM7BA tag=01ND66ZHB91G type=write size=2963019 2024-09-12T00:09:37.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.000+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=6VMU44FB9O7T type=del size=912828 2024-09-12T00:09:38.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.001+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=XM401B36773Y type=del 2024-09-12T00:09:38.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.004+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~K0BMFE3INEGR.0 size=1048576 2024-09-12T00:09:38.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.005+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~K0BMFE3INEGR.1 size=1048576 2024-09-12T00:09:38.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.006+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~K0BMFE3INEGR.2 size=47095 2024-09-12T00:09:38.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.006+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=K0BMFE3INEGR tag=0I1RGNMYRSDF type=write size=3192823 2024-09-12T00:09:38.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.008+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=SWIEXBYL94UM type=del 2024-09-12T00:09:38.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.009+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=S11T0FKEI5FW type=del size=2026349 2024-09-12T00:09:38.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.010+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~9X4YWNAP4UOW.0 size=312242 2024-09-12T00:09:38.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.012+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=9X4YWNAP4UOW tag=6WT46KD0B5WB type=write size=1360818 2024-09-12T00:09:38.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.014+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=KQCKQEM0XCUQ type=write size=848834 2024-09-12T00:09:38.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.015+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~LCOFUX214YDW.0 size=277238 2024-09-12T00:09:38.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.017+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=LCOFUX214YDW tag=AF4BG0IA2XG9 type=write size=1325814 2024-09-12T00:09:38.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.018+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=HETQ2YJAOHQX type=write size=787287 2024-09-12T00:09:38.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.019+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~A9JC709O6AUD.0 size=1048576 2024-09-12T00:09:38.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.020+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~A9JC709O6AUD.1 size=808524 2024-09-12T00:09:38.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.022+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=A9JC709O6AUD tag=P0WR4ZSSA7X6 type=write size=2905676 2024-09-12T00:09:38.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.024+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=AVD2DRC6695J type=write size=617326 2024-09-12T00:09:38.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.025+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~NSLLEYJUY0YJ.0 size=1048576 2024-09-12T00:09:38.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.026+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~NSLLEYJUY0YJ.1 size=434277 2024-09-12T00:09:38.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.028+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=NSLLEYJUY0YJ tag=XKIIB9374VDP type=write size=2531429 2024-09-12T00:09:38.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.029+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=FHB383IHC33M type=del size=2886872 2024-09-12T00:09:38.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.030+0000 7f3dc2c18780 1 < completed write operation key=V0K5FRKYGJ0K tag=HSJC2NE6VJ56 type=write size=362552 2024-09-12T00:09:38.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.032+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~3A7XX02SEQ3C.0 size=1048576 2024-09-12T00:09:38.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.033+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~3A7XX02SEQ3C.1 size=1048576 2024-09-12T00:09:38.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.034+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~3A7XX02SEQ3C.2 size=349286 2024-09-12T00:09:38.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.034+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=3A7XX02SEQ3C tag=YHM4AZKLG824 type=write size=3495014 2024-09-12T00:09:38.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.035+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~DVD86Z4X0T3S.0 size=1048576 2024-09-12T00:09:38.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.036+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~DVD86Z4X0T3S.1 size=692394 2024-09-12T00:09:38.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.038+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=DVD86Z4X0T3S tag=U22QDACXYF6T type=write size=2789546 2024-09-12T00:09:38.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.040+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=3CFYCQOEXCD1 type=del size=2703835 2024-09-12T00:09:38.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.041+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~RSX8U0KPDS3D.0 size=175547 2024-09-12T00:09:38.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.043+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=RSX8U0KPDS3D tag=EN5S8RPICW68 type=write size=1224123 2024-09-12T00:09:38.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.045+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=X9JQ3LM4DA3S type=del size=1774063 2024-09-12T00:09:38.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.046+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~AAZTO6DXOHJX.0 size=432739 2024-09-12T00:09:38.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.048+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=AAZTO6DXOHJX tag=NZIBLRD2OA9F type=write size=1481315 2024-09-12T00:09:38.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.052+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~M2B4GZY2YFBU.0 size=1048576 2024-09-12T00:09:38.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.054+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~M2B4GZY2YFBU.1 size=173442 2024-09-12T00:09:38.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.054+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=M2B4GZY2YFBU tag=MKQ9KIEH0860 type=write size=2270594 2024-09-12T00:09:38.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.055+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~KO8GZNK55EXI.0 size=1048576 2024-09-12T00:09:38.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.055+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~KO8GZNK55EXI.1 size=1048576 2024-09-12T00:09:38.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.057+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~KO8GZNK55EXI.2 size=857173 2024-09-12T00:09:38.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.059+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=KO8GZNK55EXI tag=ORR0SI4Z3OS5 type=write size=4002901 2024-09-12T00:09:38.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.062+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~3DGU4615MRCR.0 size=1048576 2024-09-12T00:09:38.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.063+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~3DGU4615MRCR.1 size=589727 2024-09-12T00:09:38.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.063+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=3DGU4615MRCR tag=WRLOQD1OCCEW type=write size=2686879 2024-09-12T00:09:38.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.064+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~TALW0LT613PF.0 size=327792 2024-09-12T00:09:38.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.066+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=TALW0LT613PF tag=0DH44ALNGPVJ type=write size=1376368 2024-09-12T00:09:38.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.068+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~V1HCAGBFNR0K.0 size=1004822 2024-09-12T00:09:38.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.068+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=V1HCAGBFNR0K tag=964DHU1DSXNJ type=write size=2053398 2024-09-12T00:09:38.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.069+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~PEXT3P9TBCBF.0 size=1048576 2024-09-12T00:09:38.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.070+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~PEXT3P9TBCBF.1 size=1048576 2024-09-12T00:09:38.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.071+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~PEXT3P9TBCBF.2 size=143801 2024-09-12T00:09:38.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.073+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=PEXT3P9TBCBF tag=C09LLDJVZL9A type=write size=3289529 2024-09-12T00:09:38.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.075+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=YVT2XNPSOUUL type=del size=2852597 2024-09-12T00:09:38.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.076+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=0J84GV6SOLDY type=del 2024-09-12T00:09:38.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.078+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~7925MUY82890.0 size=1048576 2024-09-12T00:09:38.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.079+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~7925MUY82890.1 size=140197 2024-09-12T00:09:38.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.079+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=7925MUY82890 tag=0CSXRDWE33GF type=write size=2237349 2024-09-12T00:09:38.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.080+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=NX470HHLU9CN type=del 2024-09-12T00:09:38.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.082+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~QP9OC722Y6RB.0 size=1048576 2024-09-12T00:09:38.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.083+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~QP9OC722Y6RB.1 size=1048576 2024-09-12T00:09:38.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.084+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~QP9OC722Y6RB.2 size=50317 2024-09-12T00:09:38.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.084+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=QP9OC722Y6RB tag=BKB3FADKEOZO type=write size=3196045 2024-09-12T00:09:38.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.085+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=6VMU44FB9O7T type=del 2024-09-12T00:09:38.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.086+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=3748FXSN9YG2 type=del size=3535238 2024-09-12T00:09:38.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.088+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~K0BMFE3INEGR.0 size=1048576 2024-09-12T00:09:38.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.089+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~K0BMFE3INEGR.1 size=1048576 2024-09-12T00:09:38.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.090+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~K0BMFE3INEGR.2 size=47095 2024-09-12T00:09:38.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.092+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=K0BMFE3INEGR tag=0I1RGNMYRSDF type=write size=3192823 2024-09-12T00:09:38.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.094+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~1JBIBZQBQ3PL.0 size=298023 2024-09-12T00:09:38.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.094+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=1JBIBZQBQ3PL tag=JDONYB1K0I3N type=write size=1346599 2024-09-12T00:09:38.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.096+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=S11T0FKEI5FW type=del 2024-09-12T00:09:38.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.098+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~HA1UPZTXJSKH.0 size=16804 2024-09-12T00:09:38.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.098+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=HA1UPZTXJSKH tag=Y2RCFBF13FL4 type=write size=1065380 2024-09-12T00:09:38.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.100+0000 7f3dc2c18780 1 < completed write operation key=A4O7JFS2ULY0 tag=KQCKQEM0XCUQ type=write size=848834 2024-09-12T00:09:38.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.101+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=B1OQZ6XQ9DWQ type=del size=3825722 2024-09-12T00:09:38.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.104+0000 7f3dc2c18780 1 < suggested update operation key=7JVCFTM2QMGY tag=HETQ2YJAOHQX type=write size=787287 2024-09-12T00:09:38.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.105+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=NTE07XIAI1QQ type=del size=4163075 2024-09-12T00:09:38.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.107+0000 7f3dc2c18780 1 < suggested remove operation key=8JFV08DJLXTB tag=AVD2DRC6695J type=write 2024-09-12T00:09:38.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.108+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=WSLV5ZTXG4W2 type=del size=152444 2024-09-12T00:09:38.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.110+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=FHB383IHC33M type=del 2024-09-12T00:09:38.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.111+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=AE3I5FHW21Q7 type=del size=892072 2024-09-12T00:09:38.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.112+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~3A7XX02SEQ3C.0 size=1048576 2024-09-12T00:09:38.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.113+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~3A7XX02SEQ3C.1 size=1048576 2024-09-12T00:09:38.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.114+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~3A7XX02SEQ3C.2 size=349286 2024-09-12T00:09:38.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.116+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=3A7XX02SEQ3C tag=YHM4AZKLG824 type=write size=3495014 2024-09-12T00:09:38.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.117+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=CYNX3BDLAVWI type=del size=2603512 2024-09-12T00:09:38.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.120+0000 7f3dc2c18780 1 < suggested update operation key=U2H0A1GZROT7 tag=3CFYCQOEXCD1 type=del size=2703835 2024-09-12T00:09:38.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.121+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=INB7FGKH19XF type=del size=4150059 2024-09-12T00:09:38.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.123+0000 7f3dc2c18780 1 < suggested remove operation key=UJDQEIAIRVDW tag=X9JQ3LM4DA3S type=del 2024-09-12T00:09:38.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.124+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=8CKZ1PGQA8ZF type=write size=155185 2024-09-12T00:09:38.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.126+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~M2B4GZY2YFBU.0 size=1048576 2024-09-12T00:09:38.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.127+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~M2B4GZY2YFBU.1 size=173442 2024-09-12T00:09:38.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.129+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=M2B4GZY2YFBU tag=MKQ9KIEH0860 type=write size=2270594 2024-09-12T00:09:38.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.130+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=5G4QHS0LD0XK type=del size=3042130 2024-09-12T00:09:38.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.131+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~3DGU4615MRCR.0 size=1048576 2024-09-12T00:09:38.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.132+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~3DGU4615MRCR.1 size=589727 2024-09-12T00:09:38.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.134+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=3DGU4615MRCR tag=WRLOQD1OCCEW type=write size=2686879 2024-09-12T00:09:38.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.136+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~0NMES7VKLTPK.0 size=1048576 2024-09-12T00:09:38.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.137+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~0NMES7VKLTPK.1 size=1048576 2024-09-12T00:09:38.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.138+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~0NMES7VKLTPK.2 size=388014 2024-09-12T00:09:38.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.138+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=0NMES7VKLTPK tag=C6T63OJM8IV0 type=write size=3533742 2024-09-12T00:09:38.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.139+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~V1HCAGBFNR0K.0 size=1004822 2024-09-12T00:09:38.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.141+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=V1HCAGBFNR0K tag=964DHU1DSXNJ type=write size=2053398 2024-09-12T00:09:38.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.143+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~8VG14H23ST4V.0 size=1048576 2024-09-12T00:09:38.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.144+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~8VG14H23ST4V.1 size=1048576 2024-09-12T00:09:38.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.145+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~8VG14H23ST4V.2 size=933904 2024-09-12T00:09:38.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.145+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=8VG14H23ST4V tag=5DBODQ741ZAL type=write size=4079632 2024-09-12T00:09:38.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.146+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=YVT2XNPSOUUL type=del 2024-09-12T00:09:38.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.149+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~L1P153LSKK5N.0 size=1048576 2024-09-12T00:09:38.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.150+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~L1P153LSKK5N.1 size=1048576 2024-09-12T00:09:38.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.150+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~L1P153LSKK5N.2 size=860710 2024-09-12T00:09:38.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.150+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=L1P153LSKK5N tag=0GAQDADX0QM5 type=write size=4006438 2024-09-12T00:09:38.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.152+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~7925MUY82890.0 size=1048576 2024-09-12T00:09:38.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.153+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~7925MUY82890.1 size=140197 2024-09-12T00:09:38.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.155+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=7925MUY82890 tag=0CSXRDWE33GF type=write size=2237349 2024-09-12T00:09:38.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.156+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=77DRW7SH55G1 type=del size=3813495 2024-09-12T00:09:38.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.157+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~QP9OC722Y6RB.0 size=1048576 2024-09-12T00:09:38.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.158+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~QP9OC722Y6RB.1 size=1048576 2024-09-12T00:09:38.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.159+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~QP9OC722Y6RB.2 size=50317 2024-09-12T00:09:38.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.161+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=QP9OC722Y6RB tag=BKB3FADKEOZO type=write size=3196045 2024-09-12T00:09:38.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.162+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=ZN7FKL2UHECZ type=del size=869439 2024-09-12T00:09:38.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.164+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=3748FXSN9YG2 type=del size=3535238 2024-09-12T00:09:38.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.168+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~NH16EWOSDG2H.0 size=964905 2024-09-12T00:09:38.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.168+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=NH16EWOSDG2H tag=HNXB4G7SU3DV type=write size=2013481 2024-09-12T00:09:38.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.169+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~1JBIBZQBQ3PL.0 size=298023 2024-09-12T00:09:38.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.171+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=1JBIBZQBQ3PL tag=JDONYB1K0I3N type=write size=1346599 2024-09-12T00:09:38.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.172+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=KO533MIQTFEQ type=del size=2736442 2024-09-12T00:09:38.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.173+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~HA1UPZTXJSKH.0 size=16804 2024-09-12T00:09:38.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.175+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=HA1UPZTXJSKH tag=Y2RCFBF13FL4 type=write size=1065380 2024-09-12T00:09:38.175 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.177+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=PMO4K9NJ1N14 type=write size=641629 2024-09-12T00:09:38.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.178+0000 7f3dc2c18780 1 < canceled operation key=A4O7JFS2ULY0 tag=B1OQZ6XQ9DWQ type=del size=3825722 2024-09-12T00:09:38.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.179+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=OR2H4QTBKVLV type=del size=2122488 2024-09-12T00:09:38.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.180+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=NTE07XIAI1QQ type=del 2024-09-12T00:09:38.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.182+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~AACM2LJRD45X.0 size=1048576 2024-09-12T00:09:38.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.183+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~AACM2LJRD45X.1 size=1048576 2024-09-12T00:09:38.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.184+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~AACM2LJRD45X.2 size=364047 2024-09-12T00:09:38.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.184+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=AACM2LJRD45X tag=WVIEKG3H8X9Z type=write size=3509775 2024-09-12T00:09:38.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.186+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=WSLV5ZTXG4W2 type=del 2024-09-12T00:09:38.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.188+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~ZCN9TZIYCU02.0 size=1048576 2024-09-12T00:09:38.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.189+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~ZCN9TZIYCU02.1 size=1048576 2024-09-12T00:09:38.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.190+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~ZCN9TZIYCU02.2 size=199841 2024-09-12T00:09:38.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.190+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=ZCN9TZIYCU02 tag=130W3I02AG2R type=write size=3345569 2024-09-12T00:09:38.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.191+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=AE3I5FHW21Q7 type=del 2024-09-12T00:09:38.191 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.192+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=0GXTX54TQWVH type=del size=2547067 2024-09-12T00:09:38.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.194+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=CYNX3BDLAVWI type=del 2024-09-12T00:09:38.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.196+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~T6EALW4MR8RD.0 size=1048576 2024-09-12T00:09:38.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.197+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~T6EALW4MR8RD.1 size=265981 2024-09-12T00:09:38.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.197+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=T6EALW4MR8RD tag=KGL8BUIIYZNE type=write size=2363133 2024-09-12T00:09:38.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.198+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=INB7FGKH19XF type=del 2024-09-12T00:09:38.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.200+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~O8E4CTTQKSL9.0 size=56636 2024-09-12T00:09:38.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.200+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=O8E4CTTQKSL9 tag=9XQ1EVCPUBFO type=write size=1105212 2024-09-12T00:09:38.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.202+0000 7f3dc2c18780 1 < canceled operation key=Y40G8SLO6AVH tag=8CKZ1PGQA8ZF type=write size=155185 2024-09-12T00:09:38.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.203+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=S1A5CBSS0C54 type=del size=2359542 2024-09-12T00:09:38.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.204+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=5G4QHS0LD0XK type=del 2024-09-12T00:09:38.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.206+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~Y5S6DYQF160P.0 size=1048576 2024-09-12T00:09:38.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.207+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~Y5S6DYQF160P.1 size=1048576 2024-09-12T00:09:38.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.209+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~Y5S6DYQF160P.2 size=645947 2024-09-12T00:09:38.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.209+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=Y5S6DYQF160P tag=L9RNE19SL8F1 type=write size=3791675 2024-09-12T00:09:38.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.210+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~0NMES7VKLTPK.0 size=1048576 2024-09-12T00:09:38.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.211+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~0NMES7VKLTPK.1 size=1048576 2024-09-12T00:09:38.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.212+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~0NMES7VKLTPK.2 size=388014 2024-09-12T00:09:38.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.215+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=0NMES7VKLTPK tag=C6T63OJM8IV0 type=write size=3533742 2024-09-12T00:09:38.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.217+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~JZCA24VNE116.0 size=1048576 2024-09-12T00:09:38.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.218+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~JZCA24VNE116.1 size=1048576 2024-09-12T00:09:38.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.219+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~JZCA24VNE116.2 size=535501 2024-09-12T00:09:38.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.219+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=JZCA24VNE116 tag=L0RSXV1AIMDB type=write size=3681229 2024-09-12T00:09:38.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.220+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~8VG14H23ST4V.0 size=1048576 2024-09-12T00:09:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.221+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~8VG14H23ST4V.1 size=1048576 2024-09-12T00:09:38.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.222+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~8VG14H23ST4V.2 size=933904 2024-09-12T00:09:38.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.224+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=8VG14H23ST4V tag=5DBODQ741ZAL type=write size=4079632 2024-09-12T00:09:38.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.225+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=3CQR84YNMPH5 type=write size=658405 2024-09-12T00:09:38.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.227+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~L1P153LSKK5N.0 size=1048576 2024-09-12T00:09:38.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.228+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~L1P153LSKK5N.1 size=1048576 2024-09-12T00:09:38.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.229+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~L1P153LSKK5N.2 size=860710 2024-09-12T00:09:38.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.230+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=L1P153LSKK5N tag=0GAQDADX0QM5 type=write size=4006438 2024-09-12T00:09:38.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.232+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=7YSCTX0Y47T9 type=write size=766706 2024-09-12T00:09:38.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.234+0000 7f3dc2c18780 1 < suggested remove operation key=415OYT4ML329 tag=77DRW7SH55G1 type=del 2024-09-12T00:09:38.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.235+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=9UXU5XDBQE06 type=write size=134521 2024-09-12T00:09:38.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.237+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=ZN7FKL2UHECZ type=del 2024-09-12T00:09:38.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.239+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~WZ66S4S6P630.0 size=1048576 2024-09-12T00:09:38.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.240+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~WZ66S4S6P630.1 size=1048576 2024-09-12T00:09:38.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.241+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~WZ66S4S6P630.2 size=175827 2024-09-12T00:09:38.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.241+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=WZ66S4S6P630 tag=FC1POT5X6B74 type=write size=3321555 2024-09-12T00:09:38.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.242+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~NH16EWOSDG2H.0 size=964905 2024-09-12T00:09:38.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.245+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=NH16EWOSDG2H tag=HNXB4G7SU3DV type=write size=2013481 2024-09-12T00:09:38.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.246+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=4LOAUSQS1G8E type=del size=3482669 2024-09-12T00:09:38.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.248+0000 7f3dc2c18780 1 < suggested update operation key=C7ZOCTAR2BEP tag=KO533MIQTFEQ type=del size=2736442 2024-09-12T00:09:38.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.250+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~DQEUZ4EFA00Z.0 size=1048576 2024-09-12T00:09:38.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.251+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~DQEUZ4EFA00Z.1 size=1048576 2024-09-12T00:09:38.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.252+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~DQEUZ4EFA00Z.2 size=9750 2024-09-12T00:09:38.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.252+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=DQEUZ4EFA00Z tag=SXYKH1WB6FW1 type=write size=3155478 2024-09-12T00:09:38.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.254+0000 7f3dc2c18780 1 < completed write operation key=3WUIB2OMX77J tag=PMO4K9NJ1N14 type=write size=641629 2024-09-12T00:09:38.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.255+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=F22I9AP6M96Q type=write size=281432 2024-09-12T00:09:38.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.256+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=OR2H4QTBKVLV type=del 2024-09-12T00:09:38.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.258+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~9236DWZVPHWG.0 size=133348 2024-09-12T00:09:38.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.258+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=9236DWZVPHWG tag=QH3VB8IJWB1R type=write size=1181924 2024-09-12T00:09:38.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.260+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~AACM2LJRD45X.0 size=1048576 2024-09-12T00:09:38.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.261+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~AACM2LJRD45X.1 size=1048576 2024-09-12T00:09:38.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.262+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~AACM2LJRD45X.2 size=364047 2024-09-12T00:09:38.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.264+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=AACM2LJRD45X tag=WVIEKG3H8X9Z type=write size=3509775 2024-09-12T00:09:38.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.266+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~BR3U4NSEL1FW.0 size=1048576 2024-09-12T00:09:38.266 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.267+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~BR3U4NSEL1FW.1 size=1048576 2024-09-12T00:09:38.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.268+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~BR3U4NSEL1FW.2 size=339041 2024-09-12T00:09:38.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.268+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=BR3U4NSEL1FW tag=8DAOEAMRYBX1 type=write size=3484769 2024-09-12T00:09:38.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.269+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~ZCN9TZIYCU02.0 size=1048576 2024-09-12T00:09:38.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.270+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~ZCN9TZIYCU02.1 size=1048576 2024-09-12T00:09:38.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.272+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~ZCN9TZIYCU02.2 size=199841 2024-09-12T00:09:38.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.274+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=ZCN9TZIYCU02 tag=130W3I02AG2R type=write size=3345569 2024-09-12T00:09:38.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.275+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=NVTB6625GKZU type=write size=94535 2024-09-12T00:09:38.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.276+0000 7f3dc2c18780 1 < canceled operation key=TSL3IDD0EDT0 tag=0GXTX54TQWVH type=del size=2547067 2024-09-12T00:09:38.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.278+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~C8HKU9AYEU4S.0 size=1048576 2024-09-12T00:09:38.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.280+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~C8HKU9AYEU4S.1 size=1048576 2024-09-12T00:09:38.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.281+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~C8HKU9AYEU4S.2 size=292986 2024-09-12T00:09:38.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.281+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=C8HKU9AYEU4S tag=TASB0TBZE47E type=write size=3438714 2024-09-12T00:09:38.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.283+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~T6EALW4MR8RD.0 size=1048576 2024-09-12T00:09:38.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.284+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~T6EALW4MR8RD.1 size=265981 2024-09-12T00:09:38.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.286+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=T6EALW4MR8RD tag=KGL8BUIIYZNE type=write size=2363133 2024-09-12T00:09:38.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.287+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=XDKSO0CF110I type=del size=2600703 2024-09-12T00:09:38.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.289+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~O8E4CTTQKSL9.0 size=56636 2024-09-12T00:09:38.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.291+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=O8E4CTTQKSL9 tag=9XQ1EVCPUBFO type=write size=1105212 2024-09-12T00:09:38.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.293+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~FV0GKUC7HS1Q.0 size=1048576 2024-09-12T00:09:38.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.294+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~FV0GKUC7HS1Q.1 size=1048576 2024-09-12T00:09:38.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.295+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~FV0GKUC7HS1Q.2 size=400595 2024-09-12T00:09:38.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.295+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=FV0GKUC7HS1Q tag=9AUN8PQDRLM3 type=write size=3546323 2024-09-12T00:09:38.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.296+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=S1A5CBSS0C54 type=del 2024-09-12T00:09:38.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.298+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~R409X7JEHXZX.0 size=1048576 2024-09-12T00:09:38.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.299+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~R409X7JEHXZX.1 size=1048576 2024-09-12T00:09:38.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.300+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~R409X7JEHXZX.2 size=392362 2024-09-12T00:09:38.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.300+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=R409X7JEHXZX tag=ORFUA1OSTWQD type=write size=3538090 2024-09-12T00:09:38.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.301+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~Y5S6DYQF160P.0 size=1048576 2024-09-12T00:09:38.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.302+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~Y5S6DYQF160P.1 size=1048576 2024-09-12T00:09:38.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.302+0000 7f3dc2c18780 1 < canceled part key=_multipart_V0K5FRKYGJ0K.2~Y5S6DYQF160P.2 size=645947 2024-09-12T00:09:38.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.304+0000 7f3dc2c18780 1 < canceled multipart upload key=V0K5FRKYGJ0K upload=Y5S6DYQF160P tag=L9RNE19SL8F1 type=write size=3791675 2024-09-12T00:09:38.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.305+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=GLCX626WOONI type=write size=529126 2024-09-12T00:09:38.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.307+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~JZCA24VNE116.0 size=1048576 2024-09-12T00:09:38.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.308+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~JZCA24VNE116.1 size=1048576 2024-09-12T00:09:38.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.309+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~JZCA24VNE116.2 size=535501 2024-09-12T00:09:38.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.311+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=JZCA24VNE116 tag=L0RSXV1AIMDB type=write size=3681229 2024-09-12T00:09:38.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.313+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~UEQZXKPCS2UM.0 size=915150 2024-09-12T00:09:38.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.313+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=UEQZXKPCS2UM tag=SUDTA07XZT8J type=write size=1963726 2024-09-12T00:09:38.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.314+0000 7f3dc2c18780 1 < completed write operation key=5F0BB9U7Y6ZZ tag=3CQR84YNMPH5 type=write size=658405 2024-09-12T00:09:38.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.315+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=JJYZWVAQQ9BI type=write size=864549 2024-09-12T00:09:38.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.316+0000 7f3dc2c18780 1 < completed write operation key=WRR6LAYIWOCE tag=7YSCTX0Y47T9 type=write size=766706 2024-09-12T00:09:38.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.319+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~5SBIOHWEOAEC.0 size=195800 2024-09-12T00:09:38.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.319+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=5SBIOHWEOAEC tag=40NDXBGGB7EL type=write size=1244376 2024-09-12T00:09:38.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.320+0000 7f3dc2c18780 1 < completed write operation key=WRBBH64CISJZ tag=9UXU5XDBQE06 type=write size=134521 2024-09-12T00:09:38.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.321+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=R23SLNTZN0VZ type=del size=3640725 2024-09-12T00:09:38.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.323+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~WZ66S4S6P630.0 size=1048576 2024-09-12T00:09:38.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.323+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~WZ66S4S6P630.1 size=1048576 2024-09-12T00:09:38.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.324+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~WZ66S4S6P630.2 size=175827 2024-09-12T00:09:38.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.327+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=WZ66S4S6P630 tag=FC1POT5X6B74 type=write size=3321555 2024-09-12T00:09:38.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.328+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=6IHI6JVWSQ8J type=write size=536764 2024-09-12T00:09:38.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.329+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=4LOAUSQS1G8E type=del 2024-09-12T00:09:38.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.331+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~VUZAC6C6ZNB5.0 size=917533 2024-09-12T00:09:38.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.331+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=VUZAC6C6ZNB5 tag=KS6CJVX03A2W type=write size=1966109 2024-09-12T00:09:38.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.332+0000 7f3dc2c18780 1 < canceled part key=_multipart_4POD73U0LAC0.2~DQEUZ4EFA00Z.0 size=1048576 2024-09-12T00:09:38.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.333+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~DQEUZ4EFA00Z.1 size=1048576 2024-09-12T00:09:38.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.334+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~DQEUZ4EFA00Z.2 size=9750 2024-09-12T00:09:38.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.336+0000 7f3dc2c18780 1 < canceled multipart upload key=4POD73U0LAC0 upload=DQEUZ4EFA00Z tag=SXYKH1WB6FW1 type=write size=3155478 2024-09-12T00:09:38.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.337+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=ZJELOG5ZJB0K type=del size=2431485 2024-09-12T00:09:38.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.339+0000 7f3dc2c18780 1 < suggested update operation key=KQWXE62PF5F7 tag=F22I9AP6M96Q type=write size=281432 2024-09-12T00:09:38.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.341+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=ECIRLCDPHLUD type=del size=1023277 2024-09-12T00:09:38.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.342+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~9236DWZVPHWG.0 size=133348 2024-09-12T00:09:38.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.344+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=9236DWZVPHWG tag=QH3VB8IJWB1R type=write size=1181924 2024-09-12T00:09:38.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.345+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=169TL2X4NJXV type=del size=3728062 2024-09-12T00:09:38.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.346+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~BR3U4NSEL1FW.0 size=1048576 2024-09-12T00:09:38.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.347+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~BR3U4NSEL1FW.1 size=1048576 2024-09-12T00:09:38.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.348+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~BR3U4NSEL1FW.2 size=339041 2024-09-12T00:09:38.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.350+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=BR3U4NSEL1FW tag=8DAOEAMRYBX1 type=write size=3484769 2024-09-12T00:09:38.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.353+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~L2PZNXTDBGKB.0 size=1048576 2024-09-12T00:09:38.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.354+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~L2PZNXTDBGKB.1 size=1048576 2024-09-12T00:09:38.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.355+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~L2PZNXTDBGKB.2 size=76116 2024-09-12T00:09:38.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.355+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=L2PZNXTDBGKB tag=JQYTJAB8V0XF type=write size=3221844 2024-09-12T00:09:38.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.356+0000 7f3dc2c18780 1 < canceled operation key=2SO8HBZSAMRX tag=NVTB6625GKZU type=write size=94535 2024-09-12T00:09:38.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.357+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=9LJU80PF1U48 type=write size=746760 2024-09-12T00:09:38.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.358+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~C8HKU9AYEU4S.0 size=1048576 2024-09-12T00:09:38.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.358+0000 7f3dc2c18780 1 < canceled part key=_multipart_GLAOX3ZNNILD.2~C8HKU9AYEU4S.1 size=1048576 2024-09-12T00:09:38.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.359+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~C8HKU9AYEU4S.2 size=292986 2024-09-12T00:09:38.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.361+0000 7f3dc2c18780 1 < canceled multipart upload key=GLAOX3ZNNILD upload=C8HKU9AYEU4S tag=TASB0TBZE47E type=write size=3438714 2024-09-12T00:09:38.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.364+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~B2FCVEBMYKLU.0 size=1048576 2024-09-12T00:09:38.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.365+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~B2FCVEBMYKLU.1 size=321730 2024-09-12T00:09:38.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.365+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=B2FCVEBMYKLU tag=6S5S4RF466XX type=write size=2418882 2024-09-12T00:09:38.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.366+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=XDKSO0CF110I type=del 2024-09-12T00:09:38.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.368+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~DACK2NRCI8L3.0 size=507026 2024-09-12T00:09:38.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.368+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=DACK2NRCI8L3 tag=5LLI2XC82RXQ type=write size=1555602 2024-09-12T00:09:38.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.369+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~FV0GKUC7HS1Q.0 size=1048576 2024-09-12T00:09:38.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.370+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~FV0GKUC7HS1Q.1 size=1048576 2024-09-12T00:09:38.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.371+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~FV0GKUC7HS1Q.2 size=400595 2024-09-12T00:09:38.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.373+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=FV0GKUC7HS1Q tag=9AUN8PQDRLM3 type=write size=3546323 2024-09-12T00:09:38.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.375+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~VKH3DSLQ1LJ4.0 size=1048576 2024-09-12T00:09:38.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.376+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~VKH3DSLQ1LJ4.1 size=839064 2024-09-12T00:09:38.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.376+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=VKH3DSLQ1LJ4 tag=BKTLFF7O5IPD type=write size=2936216 2024-09-12T00:09:38.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.378+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~R409X7JEHXZX.0 size=1048576 2024-09-12T00:09:38.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.379+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~R409X7JEHXZX.1 size=1048576 2024-09-12T00:09:38.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.380+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~R409X7JEHXZX.2 size=392362 2024-09-12T00:09:38.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.382+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=R409X7JEHXZX tag=ORFUA1OSTWQD type=write size=3538090 2024-09-12T00:09:38.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.384+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~KTQPK8BHLPA7.0 size=1048576 2024-09-12T00:09:38.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.385+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~KTQPK8BHLPA7.1 size=217617 2024-09-12T00:09:38.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.385+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=KTQPK8BHLPA7 tag=V9H9F16ODLUM type=write size=2314769 2024-09-12T00:09:38.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.386+0000 7f3dc2c18780 1 < completed write operation key=0ICU4WV9K1RG tag=GLCX626WOONI type=write size=529126 2024-09-12T00:09:38.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.388+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~MM8NA76F9652.0 size=881783 2024-09-12T00:09:38.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.388+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=MM8NA76F9652 tag=UHO79P7M6IN3 type=write size=1930359 2024-09-12T00:09:38.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.389+0000 7f3dc2c18780 1 < canceled part key=_multipart_L9C014T8YLNV.2~UEQZXKPCS2UM.0 size=915150 2024-09-12T00:09:38.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.392+0000 7f3dc2c18780 1 < canceled multipart upload key=L9C014T8YLNV upload=UEQZXKPCS2UM tag=SUDTA07XZT8J type=write size=1963726 2024-09-12T00:09:38.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.393+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=K0LPTAAU3OCK type=write size=260546 2024-09-12T00:09:38.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.394+0000 7f3dc2c18780 1 < completed write operation key=0ICU4WV9K1RG tag=JJYZWVAQQ9BI type=write size=864549 2024-09-12T00:09:38.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.395+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=AG60UDPWV80C type=write size=959628 2024-09-12T00:09:38.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.397+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~5SBIOHWEOAEC.0 size=195800 2024-09-12T00:09:38.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.399+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=5SBIOHWEOAEC tag=40NDXBGGB7EL type=write size=1244376 2024-09-12T00:09:38.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.400+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=F30R03WBJZTR type=del size=2755524 2024-09-12T00:09:38.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.401+0000 7f3dc2c18780 1 < canceled operation key=TSL3IDD0EDT0 tag=R23SLNTZN0VZ type=del size=3640725 2024-09-12T00:09:38.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.402+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=M17XJGH5M13W type=del size=110552 2024-09-12T00:09:38.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.405+0000 7f3dc2c18780 1 < suggested update operation key=5MAV2RJ4E31S tag=6IHI6JVWSQ8J type=write size=536764 2024-09-12T00:09:38.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.406+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=VC5YCMK8808H type=write size=112889 2024-09-12T00:09:38.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.407+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~VUZAC6C6ZNB5.0 size=917533 2024-09-12T00:09:38.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.409+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=VUZAC6C6ZNB5 tag=KS6CJVX03A2W type=write size=1966109 2024-09-12T00:09:38.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.410+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=LOK8RJ49LEN3 type=del size=1041239 2024-09-12T00:09:38.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.413+0000 7f3dc2c18780 1 < suggested update operation key=Y40G8SLO6AVH tag=ZJELOG5ZJB0K type=del size=2431485 2024-09-12T00:09:38.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.414+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=1E9KX421QZ6N type=write size=516752 2024-09-12T00:09:38.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.416+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=ECIRLCDPHLUD type=del 2024-09-12T00:09:38.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.417+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=Q7QSD6TIPURM type=del size=791667 2024-09-12T00:09:38.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.418+0000 7f3dc2c18780 1 < canceled operation key=3WUIB2OMX77J tag=169TL2X4NJXV type=del size=3728062 2024-09-12T00:09:38.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.420+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=0NBYNZA2D3N3 type=del size=23432 2024-09-12T00:09:38.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.421+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~L2PZNXTDBGKB.0 size=1048576 2024-09-12T00:09:38.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.422+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~L2PZNXTDBGKB.1 size=1048576 2024-09-12T00:09:38.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.423+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~L2PZNXTDBGKB.2 size=76116 2024-09-12T00:09:38.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.427+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=L2PZNXTDBGKB tag=JQYTJAB8V0XF type=write size=3221844 2024-09-12T00:09:38.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.429+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~83H82V2ZXMON.0 size=1048576 2024-09-12T00:09:38.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.430+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~83H82V2ZXMON.1 size=97884 2024-09-12T00:09:38.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.430+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=83H82V2ZXMON tag=B1DY0MX96KTK type=write size=2195036 2024-09-12T00:09:38.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.431+0000 7f3dc2c18780 1 < completed write operation key=5BM1TMLRBHTS tag=9LJU80PF1U48 type=write size=746760 2024-09-12T00:09:38.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.432+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=K2XOIL7KE3H8 type=del size=2083950 2024-09-12T00:09:38.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.434+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~B2FCVEBMYKLU.0 size=1048576 2024-09-12T00:09:38.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.435+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~B2FCVEBMYKLU.1 size=321730 2024-09-12T00:09:38.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.437+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=B2FCVEBMYKLU tag=6S5S4RF466XX type=write size=2418882 2024-09-12T00:09:38.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.438+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=URY05CL2G8LK type=del size=1426722 2024-09-12T00:09:38.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.439+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~DACK2NRCI8L3.0 size=507026 2024-09-12T00:09:38.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.441+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=DACK2NRCI8L3 tag=5LLI2XC82RXQ type=write size=1555602 2024-09-12T00:09:38.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.442+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=SB3BVO1SV1M0 type=del size=2002637 2024-09-12T00:09:38.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.442+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRBBH64CISJZ.2~VKH3DSLQ1LJ4.0 size=1048576 2024-09-12T00:09:38.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.444+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~VKH3DSLQ1LJ4.1 size=839064 2024-09-12T00:09:38.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.445+0000 7f3dc2c18780 1 < canceled multipart upload key=WRBBH64CISJZ upload=VKH3DSLQ1LJ4 tag=BKTLFF7O5IPD type=write size=2936216 2024-09-12T00:09:38.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.447+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=513UNO7604J1 type=del size=1661425 2024-09-12T00:09:38.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.448+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~KTQPK8BHLPA7.0 size=1048576 2024-09-12T00:09:38.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.449+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~KTQPK8BHLPA7.1 size=217617 2024-09-12T00:09:38.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.451+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=KTQPK8BHLPA7 tag=V9H9F16ODLUM type=write size=2314769 2024-09-12T00:09:38.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.453+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~UMBDDUQCGEC6.0 size=814794 2024-09-12T00:09:38.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.453+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=UMBDDUQCGEC6 tag=6I3P1A9AS1HP type=write size=1863370 2024-09-12T00:09:38.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.455+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~MM8NA76F9652.0 size=881783 2024-09-12T00:09:38.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.457+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=MM8NA76F9652 tag=UHO79P7M6IN3 type=write size=1930359 2024-09-12T00:09:38.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.458+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=P68CR0P3KJH5 type=del size=965701 2024-09-12T00:09:38.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.460+0000 7f3dc2c18780 1 < suggested update operation key=65DTZR8A5OHF tag=K0LPTAAU3OCK type=write size=260546 2024-09-12T00:09:38.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.461+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=MWQRPU8MMK6F type=del size=1019828 2024-09-12T00:09:38.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.463+0000 7f3dc2c18780 1 < completed write operation key=C7ZOCTAR2BEP tag=AG60UDPWV80C type=write size=959628 2024-09-12T00:09:38.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.464+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=YY0NDDPFQ7H4 type=del size=3094467 2024-09-12T00:09:38.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.465+0000 7f3dc2c18780 -1 < failed to complete operation key=5MAV2RJ4E31S tag=F30R03WBJZTR type=del size=2755524: (22) Invalid argument 2024-09-12T00:09:38.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.467+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~JBNHTFCRJG3H.0 size=1048576 2024-09-12T00:09:38.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.468+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~JBNHTFCRJG3H.1 size=1048576 2024-09-12T00:09:38.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.469+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~JBNHTFCRJG3H.2 size=749159 2024-09-12T00:09:38.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.469+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=JBNHTFCRJG3H tag=4Q9OOL7UYCPK type=write size=3894887 2024-09-12T00:09:38.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.471+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=M17XJGH5M13W type=del 2024-09-12T00:09:38.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.472+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=V5UVTN6U5GC4 type=del size=3705348 2024-09-12T00:09:38.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.473+0000 7f3dc2c18780 1 < completed write operation key=5MAV2RJ4E31S tag=VC5YCMK8808H type=write size=112889 2024-09-12T00:09:38.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.475+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~34FWGV4BGO5A.0 size=1048576 2024-09-12T00:09:38.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.476+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~34FWGV4BGO5A.1 size=1048576 2024-09-12T00:09:38.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.477+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~34FWGV4BGO5A.2 size=310317 2024-09-12T00:09:38.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.477+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=34FWGV4BGO5A tag=3KYHHDZ73WRX type=write size=3456045 2024-09-12T00:09:38.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.479+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=LOK8RJ49LEN3 type=del 2024-09-12T00:09:38.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.481+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=3K3GFYFNFDBN type=del size=3352522 2024-09-12T00:09:38.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.482+0000 7f3dc2c18780 1 < completed write operation key=5CS98S02F59L tag=1E9KX421QZ6N type=write size=516752 2024-09-12T00:09:38.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.483+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=1W06Q80SANEQ type=del size=1664278 2024-09-12T00:09:38.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.485+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=Q7QSD6TIPURM type=del 2024-09-12T00:09:38.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.486+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=1KRSNMNXMB48 type=write size=897448 2024-09-12T00:09:38.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.493+0000 7f3dc2c18780 1 < suggested update operation key=25CF1N8J81Y9 tag=0NBYNZA2D3N3 type=del size=23432 2024-09-12T00:09:38.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.494+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=BLCAWEEXN4XM type=del size=2226560 2024-09-12T00:09:38.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.496+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~83H82V2ZXMON.0 size=1048576 2024-09-12T00:09:38.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.497+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~83H82V2ZXMON.1 size=97884 2024-09-12T00:09:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.499+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=83H82V2ZXMON tag=B1DY0MX96KTK type=write size=2195036 2024-09-12T00:09:38.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.501+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~FTYCIL2DLIS5.0 size=1048576 2024-09-12T00:09:38.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.502+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~FTYCIL2DLIS5.1 size=1048576 2024-09-12T00:09:38.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.503+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~FTYCIL2DLIS5.2 size=35598 2024-09-12T00:09:38.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.503+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=FTYCIL2DLIS5 tag=9HZ660EKODMS type=write size=3181326 2024-09-12T00:09:38.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.505+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=K2XOIL7KE3H8 type=del 2024-09-12T00:09:38.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.507+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~7POI83MCSWMM.0 size=1048576 2024-09-12T00:09:38.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.508+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~7POI83MCSWMM.1 size=1048576 2024-09-12T00:09:38.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.509+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~7POI83MCSWMM.2 size=51735 2024-09-12T00:09:38.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.509+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=7POI83MCSWMM tag=JM2ZNON9ZSW8 type=write size=3197463 2024-09-12T00:09:38.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.510+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=URY05CL2G8LK type=del 2024-09-12T00:09:38.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.512+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=051B8L9NTNL8 type=del size=1033061 2024-09-12T00:09:38.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.513+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=SB3BVO1SV1M0 type=del 2024-09-12T00:09:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.514+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=Z8HL8QS8UC5C type=write size=557901 2024-09-12T00:09:38.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.517+0000 7f3dc2c18780 1 < suggested update operation key=C7ZOCTAR2BEP tag=513UNO7604J1 type=del size=1661425 2024-09-12T00:09:38.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.519+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~2MNAHYGTKLFX.0 size=920658 2024-09-12T00:09:38.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.519+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=2MNAHYGTKLFX tag=YGEGJR4R7FTL type=write size=1969234 2024-09-12T00:09:38.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.520+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~UMBDDUQCGEC6.0 size=814794 2024-09-12T00:09:38.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.522+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=UMBDDUQCGEC6 tag=6I3P1A9AS1HP type=write size=1863370 2024-09-12T00:09:38.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.524+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~B1FF489H5VMU.0 size=1048576 2024-09-12T00:09:38.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.525+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~B1FF489H5VMU.1 size=1048576 2024-09-12T00:09:38.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.526+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~B1FF489H5VMU.2 size=244337 2024-09-12T00:09:38.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.526+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=B1FF489H5VMU tag=1IR2ID5ZLEWJ type=write size=3390065 2024-09-12T00:09:38.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.527+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=P68CR0P3KJH5 type=del 2024-09-12T00:09:38.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.530+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~1E4YS6KXC3WZ.0 size=1048576 2024-09-12T00:09:38.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.530+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~1E4YS6KXC3WZ.1 size=1048576 2024-09-12T00:09:38.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.531+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~1E4YS6KXC3WZ.2 size=532236 2024-09-12T00:09:38.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.531+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=1E4YS6KXC3WZ tag=WFO8V8AY2UBC type=write size=3677964 2024-09-12T00:09:38.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.534+0000 7f3dc2c18780 1 < suggested update operation key=OGRGDIUO2W8B tag=MWQRPU8MMK6F type=del size=1019828 2024-09-12T00:09:38.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.536+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~OJENC8UFMRY8.0 size=1048576 2024-09-12T00:09:38.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.537+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~OJENC8UFMRY8.1 size=178834 2024-09-12T00:09:38.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.537+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=OJENC8UFMRY8 tag=2BQA4R9I14KN type=write size=2275986 2024-09-12T00:09:38.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.539+0000 7f3dc2c18780 1 < suggested remove operation key=3WUIB2OMX77J tag=YY0NDDPFQ7H4 type=del 2024-09-12T00:09:38.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.540+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=S9VIT6L24YSP type=del size=1681469 2024-09-12T00:09:38.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.541+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~JBNHTFCRJG3H.0 size=1048576 2024-09-12T00:09:38.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.542+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~JBNHTFCRJG3H.1 size=1048576 2024-09-12T00:09:38.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.543+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~JBNHTFCRJG3H.2 size=749159 2024-09-12T00:09:38.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.545+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=JBNHTFCRJG3H tag=4Q9OOL7UYCPK type=write size=3894887 2024-09-12T00:09:38.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.546+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=K2AONPC4S1JX type=del size=1783803 2024-09-12T00:09:38.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.548+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=V5UVTN6U5GC4 type=del 2024-09-12T00:09:38.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.550+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~6MFDXVYA7G9R.0 size=715975 2024-09-12T00:09:38.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.550+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=6MFDXVYA7G9R tag=MZ9WS2J42YVC type=write size=1764551 2024-09-12T00:09:38.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.551+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~34FWGV4BGO5A.0 size=1048576 2024-09-12T00:09:38.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.552+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~34FWGV4BGO5A.1 size=1048576 2024-09-12T00:09:38.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.553+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~34FWGV4BGO5A.2 size=310317 2024-09-12T00:09:38.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.555+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=34FWGV4BGO5A tag=3KYHHDZ73WRX type=write size=3456045 2024-09-12T00:09:38.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.557+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~M8X1IXWB2F6F.0 size=1048576 2024-09-12T00:09:38.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.558+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~M8X1IXWB2F6F.1 size=1048576 2024-09-12T00:09:38.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.559+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~M8X1IXWB2F6F.2 size=536959 2024-09-12T00:09:38.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.559+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=M8X1IXWB2F6F tag=WIWE4ADQEILL type=write size=3682687 2024-09-12T00:09:38.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.560+0000 7f3dc2c18780 1 < canceled operation key=WRBBH64CISJZ tag=3K3GFYFNFDBN type=del size=3352522 2024-09-12T00:09:38.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.562+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~EW5HSXHURZBE.0 size=1048576 2024-09-12T00:09:38.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.563+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~EW5HSXHURZBE.1 size=315718 2024-09-12T00:09:38.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.563+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=EW5HSXHURZBE tag=9G5I3SDCVCL4 type=write size=2412870 2024-09-12T00:09:38.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.564+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=1W06Q80SANEQ type=del 2024-09-12T00:09:38.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.566+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=KD6SB3821OIP type=write size=219566 2024-09-12T00:09:38.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.568+0000 7f3dc2c18780 1 < suggested update operation key=5F0BB9U7Y6ZZ tag=1KRSNMNXMB48 type=write size=897448 2024-09-12T00:09:38.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.570+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~FTMGU6GQMHQ8.0 size=1048576 2024-09-12T00:09:38.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.571+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~FTMGU6GQMHQ8.1 size=927402 2024-09-12T00:09:38.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.571+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=FTMGU6GQMHQ8 tag=1ADQQYAMUP5T type=write size=3024554 2024-09-12T00:09:38.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.572+0000 7f3dc2c18780 1 < canceled operation key=Y40G8SLO6AVH tag=BLCAWEEXN4XM type=del size=2226560 2024-09-12T00:09:38.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.574+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~DLSHWJIFI100.0 size=1048576 2024-09-12T00:09:38.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.575+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~DLSHWJIFI100.1 size=205816 2024-09-12T00:09:38.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.575+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=DLSHWJIFI100 tag=Z9UNY01BGI0K type=write size=2302968 2024-09-12T00:09:38.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.577+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~FTYCIL2DLIS5.0 size=1048576 2024-09-12T00:09:38.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.578+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~FTYCIL2DLIS5.1 size=1048576 2024-09-12T00:09:38.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.579+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~FTYCIL2DLIS5.2 size=35598 2024-09-12T00:09:38.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.581+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=FTYCIL2DLIS5 tag=9HZ660EKODMS type=write size=3181326 2024-09-12T00:09:38.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.582+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=MJIMW0JIKTDH type=del size=3062352 2024-09-12T00:09:38.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.583+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~7POI83MCSWMM.0 size=1048576 2024-09-12T00:09:38.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.584+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~7POI83MCSWMM.1 size=1048576 2024-09-12T00:09:38.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.585+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~7POI83MCSWMM.2 size=51735 2024-09-12T00:09:38.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.587+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=7POI83MCSWMM tag=JM2ZNON9ZSW8 type=write size=3197463 2024-09-12T00:09:38.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.590+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~BW01T9IA7NG6.0 size=788834 2024-09-12T00:09:38.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.590+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=BW01T9IA7NG6 tag=LD13Q9588ZV9 type=write size=1837410 2024-09-12T00:09:38.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.591+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=051B8L9NTNL8 type=del 2024-09-12T00:09:38.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.592+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=RF6WJUJS18S4 type=del size=2853521 2024-09-12T00:09:38.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.593+0000 7f3dc2c18780 1 < canceled operation key=5BM1TMLRBHTS tag=Z8HL8QS8UC5C type=write size=557901 2024-09-12T00:09:38.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.595+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=1QEE110E1J7M type=del size=14687 2024-09-12T00:09:38.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.596+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~2MNAHYGTKLFX.0 size=920658 2024-09-12T00:09:38.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.598+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=2MNAHYGTKLFX tag=YGEGJR4R7FTL type=write size=1969234 2024-09-12T00:09:38.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.599+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=EUJG7XKNE6XF type=del size=1196747 2024-09-12T00:09:38.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.601+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~B1FF489H5VMU.0 size=1048576 2024-09-12T00:09:38.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.602+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~B1FF489H5VMU.1 size=1048576 2024-09-12T00:09:38.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.603+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~B1FF489H5VMU.2 size=244337 2024-09-12T00:09:38.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.605+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=B1FF489H5VMU tag=1IR2ID5ZLEWJ type=write size=3390065 2024-09-12T00:09:38.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.607+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=HWNDH00ZOQTI type=del size=636692 2024-09-12T00:09:38.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.608+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~1E4YS6KXC3WZ.0 size=1048576 2024-09-12T00:09:38.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.609+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~1E4YS6KXC3WZ.1 size=1048576 2024-09-12T00:09:38.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.610+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~1E4YS6KXC3WZ.2 size=532236 2024-09-12T00:09:38.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.612+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=1E4YS6KXC3WZ tag=WFO8V8AY2UBC type=write size=3677964 2024-09-12T00:09:38.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.615+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~5UN72KMY4NY2.0 size=327986 2024-09-12T00:09:38.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.615+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=5UN72KMY4NY2 tag=Z2XHX0W9291A type=write size=1376562 2024-09-12T00:09:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.616+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~OJENC8UFMRY8.0 size=1048576 2024-09-12T00:09:38.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.617+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~OJENC8UFMRY8.1 size=178834 2024-09-12T00:09:38.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.619+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=OJENC8UFMRY8 tag=2BQA4R9I14KN type=write size=2275986 2024-09-12T00:09:38.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.620+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=S4WJ34IIX51Q type=del size=1281838 2024-09-12T00:09:38.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.621+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=S9VIT6L24YSP type=del 2024-09-12T00:09:38.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.624+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~IWJL5LRU9IPJ.0 size=131936 2024-09-12T00:09:38.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.624+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=IWJL5LRU9IPJ tag=NCCLGRDW28GI type=write size=1180512 2024-09-12T00:09:38.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.627+0000 7f3dc2c18780 1 < suggested update operation key=UJDQEIAIRVDW tag=K2AONPC4S1JX type=del size=1783803 2024-09-12T00:09:38.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.629+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~QATPDDHG342S.0 size=721712 2024-09-12T00:09:38.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.629+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=QATPDDHG342S tag=N0K0M7AJEH33 type=write size=1770288 2024-09-12T00:09:38.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.630+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~6MFDXVYA7G9R.0 size=715975 2024-09-12T00:09:38.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.632+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=6MFDXVYA7G9R tag=MZ9WS2J42YVC type=write size=1764551 2024-09-12T00:09:38.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.634+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~3JWY8N6VFQTQ.0 size=1048576 2024-09-12T00:09:38.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.635+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~3JWY8N6VFQTQ.1 size=836977 2024-09-12T00:09:38.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.635+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=3JWY8N6VFQTQ tag=FAJVWZ890E62 type=write size=2934129 2024-09-12T00:09:38.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.637+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~M8X1IXWB2F6F.0 size=1048576 2024-09-12T00:09:38.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.637+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~M8X1IXWB2F6F.1 size=1048576 2024-09-12T00:09:38.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.638+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~M8X1IXWB2F6F.2 size=536959 2024-09-12T00:09:38.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.640+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=M8X1IXWB2F6F tag=WIWE4ADQEILL type=write size=3682687 2024-09-12T00:09:38.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.642+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~2GSB7NC34ACY.0 size=1048576 2024-09-12T00:09:38.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.643+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~2GSB7NC34ACY.1 size=726399 2024-09-12T00:09:38.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.643+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=2GSB7NC34ACY tag=31QQ24FEVEDG type=write size=2823551 2024-09-12T00:09:38.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.644+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~EW5HSXHURZBE.0 size=1048576 2024-09-12T00:09:38.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.645+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~EW5HSXHURZBE.1 size=315718 2024-09-12T00:09:38.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.647+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=EW5HSXHURZBE tag=9G5I3SDCVCL4 type=write size=2412870 2024-09-12T00:09:38.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.649+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~FHSNET21N3CT.0 size=1048576 2024-09-12T00:09:38.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.650+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~FHSNET21N3CT.1 size=559435 2024-09-12T00:09:38.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.650+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=FHSNET21N3CT tag=P81H4YZGKRU1 type=write size=2656587 2024-09-12T00:09:38.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.651+0000 7f3dc2c18780 1 < completed write operation key=YYIQC6YL2PSW tag=KD6SB3821OIP type=write size=219566 2024-09-12T00:09:38.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.652+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=79Z8FAOQT9XZ type=write size=276058 2024-09-12T00:09:38.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.652+0000 7f3dc2c18780 1 < canceled part key=_multipart_5BM1TMLRBHTS.2~FTMGU6GQMHQ8.0 size=1048576 2024-09-12T00:09:38.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.653+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~FTMGU6GQMHQ8.1 size=927402 2024-09-12T00:09:38.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.655+0000 7f3dc2c18780 1 < canceled multipart upload key=5BM1TMLRBHTS upload=FTMGU6GQMHQ8 tag=1ADQQYAMUP5T type=write size=3024554 2024-09-12T00:09:38.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.657+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=W6W3VYR5MO6S type=del size=488664 2024-09-12T00:09:38.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.658+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~DLSHWJIFI100.0 size=1048576 2024-09-12T00:09:38.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.659+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~DLSHWJIFI100.1 size=205816 2024-09-12T00:09:38.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.662+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=DLSHWJIFI100 tag=Z9UNY01BGI0K type=write size=2302968 2024-09-12T00:09:38.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.663+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=0IUON52G39WT type=del size=3851669 2024-09-12T00:09:38.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.664+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=MJIMW0JIKTDH type=del 2024-09-12T00:09:38.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.667+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~AVVNK5I72XTM.0 size=1048576 2024-09-12T00:09:38.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.667+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~AVVNK5I72XTM.1 size=1048576 2024-09-12T00:09:38.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.668+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~AVVNK5I72XTM.2 size=103912 2024-09-12T00:09:38.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.668+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=AVVNK5I72XTM tag=5M25SDG7OUL4 type=write size=3249640 2024-09-12T00:09:38.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.670+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~BW01T9IA7NG6.0 size=788834 2024-09-12T00:09:38.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.672+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=BW01T9IA7NG6 tag=LD13Q9588ZV9 type=write size=1837410 2024-09-12T00:09:38.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.673+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=KA53FZEK2NL8 type=del size=3175591 2024-09-12T00:09:38.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.674+0000 7f3dc2c18780 1 < canceled operation key=3WUIB2OMX77J tag=RF6WJUJS18S4 type=del size=2853521 2024-09-12T00:09:38.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.676+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~36LPI7TZS0QX.0 size=1048576 2024-09-12T00:09:38.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.677+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~36LPI7TZS0QX.1 size=1048576 2024-09-12T00:09:38.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.678+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~36LPI7TZS0QX.2 size=267056 2024-09-12T00:09:38.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.678+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=36LPI7TZS0QX tag=MOYX2TNFWJQG type=write size=3412784 2024-09-12T00:09:38.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.680+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=1QEE110E1J7M type=del 2024-09-12T00:09:38.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.682+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~IYZORWBZ7FS7.0 size=701132 2024-09-12T00:09:38.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.682+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=IYZORWBZ7FS7 tag=5HY4TLA4C7VM type=write size=1749708 2024-09-12T00:09:38.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.684+0000 7f3dc2c18780 -1 < failed to complete operation key=UJDQEIAIRVDW tag=EUJG7XKNE6XF type=del size=1196747: (22) Invalid argument 2024-09-12T00:09:38.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.685+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=80KNS4M28OD3 type=del size=788052 2024-09-12T00:09:38.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.687+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=HWNDH00ZOQTI type=del 2024-09-12T00:09:38.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.688+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=JF3DENKRGFOR type=del size=3569188 2024-09-12T00:09:38.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.689+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~5UN72KMY4NY2.0 size=327986 2024-09-12T00:09:38.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.693+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=5UN72KMY4NY2 tag=Z2XHX0W9291A type=write size=1376562 2024-09-12T00:09:38.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.694+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=17UTCKKRKVG2 type=del size=2298707 2024-09-12T00:09:38.695 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.697+0000 7f3dc2c18780 1 < suggested update operation key=5CS98S02F59L tag=S4WJ34IIX51Q type=del size=1281838 2024-09-12T00:09:38.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.698+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=A3M32UUHPY1R type=write size=242323 2024-09-12T00:09:38.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.699+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~IWJL5LRU9IPJ.0 size=131936 2024-09-12T00:09:38.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.701+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=IWJL5LRU9IPJ tag=NCCLGRDW28GI type=write size=1180512 2024-09-12T00:09:38.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.702+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=786CX2N1THPR type=del size=2168224 2024-09-12T00:09:38.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.704+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~QATPDDHG342S.0 size=721712 2024-09-12T00:09:38.704 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.706+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=QATPDDHG342S tag=N0K0M7AJEH33 type=write size=1770288 2024-09-12T00:09:38.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.707+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=TTUU1TD1REQO type=del size=2877840 2024-09-12T00:09:38.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.708+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~3JWY8N6VFQTQ.0 size=1048576 2024-09-12T00:09:38.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.709+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~3JWY8N6VFQTQ.1 size=836977 2024-09-12T00:09:38.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.711+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=3JWY8N6VFQTQ tag=FAJVWZ890E62 type=write size=2934129 2024-09-12T00:09:38.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.712+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=ED6FY5H5G6V8 type=del size=3396282 2024-09-12T00:09:38.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.714+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~2GSB7NC34ACY.0 size=1048576 2024-09-12T00:09:38.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.715+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~2GSB7NC34ACY.1 size=726399 2024-09-12T00:09:38.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.717+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=2GSB7NC34ACY tag=31QQ24FEVEDG type=write size=2823551 2024-09-12T00:09:38.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.719+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~B10EDUS4X24T.0 size=607439 2024-09-12T00:09:38.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.719+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=B10EDUS4X24T tag=2S4TSZ2AJXX2 type=write size=1656015 2024-09-12T00:09:38.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.720+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~FHSNET21N3CT.0 size=1048576 2024-09-12T00:09:38.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.721+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~FHSNET21N3CT.1 size=559435 2024-09-12T00:09:38.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.723+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=FHSNET21N3CT tag=P81H4YZGKRU1 type=write size=2656587 2024-09-12T00:09:38.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.725+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=8TJP8O8IFOK8 type=write size=512125 2024-09-12T00:09:38.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.727+0000 7f3dc2c18780 1 < suggested update operation key=5CS98S02F59L tag=79Z8FAOQT9XZ type=write size=276058 2024-09-12T00:09:38.727 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.728+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=W7FWWSZOU4EH type=del size=3215374 2024-09-12T00:09:38.729 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.731+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=W6W3VYR5MO6S type=del size=488664 2024-09-12T00:09:38.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.732+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=OUIJVK6PW0ZY type=del size=1579174 2024-09-12T00:09:38.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.733+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=0IUON52G39WT type=del 2024-09-12T00:09:38.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.736+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~5VHU0G7GOLSP.0 size=143252 2024-09-12T00:09:38.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.736+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=5VHU0G7GOLSP tag=MEJU33CF4793 type=write size=1191828 2024-09-12T00:09:38.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.737+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~AVVNK5I72XTM.0 size=1048576 2024-09-12T00:09:38.736 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.738+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~AVVNK5I72XTM.1 size=1048576 2024-09-12T00:09:38.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.739+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~AVVNK5I72XTM.2 size=103912 2024-09-12T00:09:38.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.742+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=AVVNK5I72XTM tag=5M25SDG7OUL4 type=write size=3249640 2024-09-12T00:09:38.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.744+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~D0Q0I98J7O0J.0 size=1048576 2024-09-12T00:09:38.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.745+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~D0Q0I98J7O0J.1 size=872109 2024-09-12T00:09:38.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.745+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=D0Q0I98J7O0J tag=A39763KV3Z40 type=write size=2969261 2024-09-12T00:09:38.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.746+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=KA53FZEK2NL8 type=del 2024-09-12T00:09:38.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.749+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DWVOCW53ACP3.0 size=136478 2024-09-12T00:09:38.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.749+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=DWVOCW53ACP3 tag=REMHK1Y71OXY type=write size=1185054 2024-09-12T00:09:38.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.750+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~36LPI7TZS0QX.0 size=1048576 2024-09-12T00:09:38.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.751+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~36LPI7TZS0QX.1 size=1048576 2024-09-12T00:09:38.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.752+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~36LPI7TZS0QX.2 size=267056 2024-09-12T00:09:38.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.754+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=36LPI7TZS0QX tag=MOYX2TNFWJQG type=write size=3412784 2024-09-12T00:09:38.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.755+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=YAL7A3DQUCDG type=write size=525516 2024-09-12T00:09:38.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.756+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~IYZORWBZ7FS7.0 size=701132 2024-09-12T00:09:38.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.758+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=IYZORWBZ7FS7 tag=5HY4TLA4C7VM type=write size=1749708 2024-09-12T00:09:38.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.760+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~GF7IJ3408UGL.0 size=1048576 2024-09-12T00:09:38.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.761+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~GF7IJ3408UGL.1 size=1048576 2024-09-12T00:09:38.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.762+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~GF7IJ3408UGL.2 size=175916 2024-09-12T00:09:38.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.762+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=GF7IJ3408UGL tag=2AIXJG2IUWER type=write size=3321644 2024-09-12T00:09:38.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.765+0000 7f3dc2c18780 1 < suggested update operation key=A4O7JFS2ULY0 tag=80KNS4M28OD3 type=del size=788052 2024-09-12T00:09:38.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.766+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=LD1AS41BD869 type=del size=3872976 2024-09-12T00:09:38.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.767+0000 7f3dc2c18780 1 < canceled operation key=8JFV08DJLXTB tag=JF3DENKRGFOR type=del size=3569188 2024-09-12T00:09:38.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.768+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=ZQGNWBN5O4DD type=del size=3461231 2024-09-12T00:09:38.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.769+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=17UTCKKRKVG2 type=del 2024-09-12T00:09:38.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.772+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~KZ8LM2SRXE10.0 size=183867 2024-09-12T00:09:38.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.772+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=KZ8LM2SRXE10 tag=CLN77BWRAMPG type=write size=1232443 2024-09-12T00:09:38.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.773+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=A3M32UUHPY1R type=write size=242323 2024-09-12T00:09:38.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.774+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=PS3HOI0O5X55 type=del size=669761 2024-09-12T00:09:38.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.775+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=786CX2N1THPR type=del 2024-09-12T00:09:38.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.776+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=N23PDRGYG58Y type=del size=1153611 2024-09-12T00:09:38.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.778+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=TTUU1TD1REQO type=del 2024-09-12T00:09:38.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.779+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=VCSLL1QL18SJ type=del size=2904846 2024-09-12T00:09:38.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.781+0000 7f3dc2c18780 1 < suggested remove operation key=0ICU4WV9K1RG tag=ED6FY5H5G6V8 type=del 2024-09-12T00:09:38.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.782+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=W9JPROMQ8L9H type=del size=3561983 2024-09-12T00:09:38.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.784+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~B10EDUS4X24T.0 size=607439 2024-09-12T00:09:38.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.785+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=B10EDUS4X24T tag=2S4TSZ2AJXX2 type=write size=1656015 2024-09-12T00:09:38.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.787+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=FB7767PIHD8B type=del size=2691820 2024-09-12T00:09:38.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.788+0000 7f3dc2c18780 1 < completed write operation key=WRR6LAYIWOCE tag=8TJP8O8IFOK8 type=write size=512125 2024-09-12T00:09:38.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.789+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=0YFV93UMWM7O type=del size=269447 2024-09-12T00:09:38.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.790+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=W7FWWSZOU4EH type=del 2024-09-12T00:09:38.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.792+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=OEKX50O9CKF0 type=del size=600325 2024-09-12T00:09:38.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.793+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=OUIJVK6PW0ZY type=del 2024-09-12T00:09:38.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.795+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=RCBLDA2YTF0D type=del size=287063 2024-09-12T00:09:38.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.795+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRBBH64CISJZ.2~5VHU0G7GOLSP.0 size=143252 2024-09-12T00:09:38.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.797+0000 7f3dc2c18780 1 < canceled multipart upload key=WRBBH64CISJZ upload=5VHU0G7GOLSP tag=MEJU33CF4793 type=write size=1191828 2024-09-12T00:09:38.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.800+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~OI29194EUM6Z.0 size=1048576 2024-09-12T00:09:38.800 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.801+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~OI29194EUM6Z.1 size=1048576 2024-09-12T00:09:38.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.802+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~OI29194EUM6Z.2 size=42897 2024-09-12T00:09:38.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.802+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=OI29194EUM6Z tag=OMXH0NRAF6CU type=write size=3188625 2024-09-12T00:09:38.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.803+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~D0Q0I98J7O0J.0 size=1048576 2024-09-12T00:09:38.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.804+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~D0Q0I98J7O0J.1 size=872109 2024-09-12T00:09:38.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.807+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=D0Q0I98J7O0J tag=A39763KV3Z40 type=write size=2969261 2024-09-12T00:09:38.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.808+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=PWC3FCS7HQ5H type=del size=3148186 2024-09-12T00:09:38.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.809+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DWVOCW53ACP3.0 size=136478 2024-09-12T00:09:38.810 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.811+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=DWVOCW53ACP3 tag=REMHK1Y71OXY type=write size=1185054 2024-09-12T00:09:38.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.812+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=SO3F75W5C470 type=del size=965062 2024-09-12T00:09:38.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.814+0000 7f3dc2c18780 1 < completed write operation key=GP3MLWX9586T tag=YAL7A3DQUCDG type=write size=525516 2024-09-12T00:09:38.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.816+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~XW3ZOPR127Q3.0 size=1048576 2024-09-12T00:09:38.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.817+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~XW3ZOPR127Q3.1 size=1048576 2024-09-12T00:09:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.818+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~XW3ZOPR127Q3.2 size=249044 2024-09-12T00:09:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.818+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=XW3ZOPR127Q3 tag=WQNJNX3TE16T type=write size=3394772 2024-09-12T00:09:38.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.819+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~GF7IJ3408UGL.0 size=1048576 2024-09-12T00:09:38.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.820+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~GF7IJ3408UGL.1 size=1048576 2024-09-12T00:09:38.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.820+0000 7f3dc2c18780 1 < canceled part key=_multipart_7JVCFTM2QMGY.2~GF7IJ3408UGL.2 size=175916 2024-09-12T00:09:38.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.822+0000 7f3dc2c18780 1 < canceled multipart upload key=7JVCFTM2QMGY upload=GF7IJ3408UGL tag=2AIXJG2IUWER type=write size=3321644 2024-09-12T00:09:38.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.825+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DECGJBE8XVFV.0 size=1048576 2024-09-12T00:09:38.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.826+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DECGJBE8XVFV.1 size=1048576 2024-09-12T00:09:38.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.827+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DECGJBE8XVFV.2 size=131480 2024-09-12T00:09:38.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.827+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=DECGJBE8XVFV tag=6YQZNFYX2UKR type=write size=3277208 2024-09-12T00:09:38.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.828+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=LD1AS41BD869 type=del 2024-09-12T00:09:38.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.830+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~9G3UODQJ97ZO.0 size=691332 2024-09-12T00:09:38.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.830+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=9G3UODQJ97ZO tag=7YWI904X0JZB type=write size=1739908 2024-09-12T00:09:38.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.832+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=ZQGNWBN5O4DD type=del 2024-09-12T00:09:38.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.833+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=W1ZF76Y37WSA type=write size=678483 2024-09-12T00:09:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.835+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~KZ8LM2SRXE10.0 size=183867 2024-09-12T00:09:38.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.837+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=KZ8LM2SRXE10 tag=CLN77BWRAMPG type=write size=1232443 2024-09-12T00:09:38.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.838+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=QFILMIPXBMQD type=del size=263418 2024-09-12T00:09:38.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.839+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=PS3HOI0O5X55 type=del 2024-09-12T00:09:38.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.840+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=7M3PIIU7TXMN type=del size=1821088 2024-09-12T00:09:38.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.842+0000 7f3dc2c18780 1 < canceled operation key=KQWXE62PF5F7 tag=N23PDRGYG58Y type=del size=1153611 2024-09-12T00:09:38.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.843+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=VH2ZWGYD9EJU type=del size=2556134 2024-09-12T00:09:38.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.844+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=VCSLL1QL18SJ type=del 2024-09-12T00:09:38.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.845+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=TV04OTS4HLE3 type=del size=3604962 2024-09-12T00:09:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.848+0000 7f3dc2c18780 1 < suggested remove operation key=7JVCFTM2QMGY tag=W9JPROMQ8L9H type=del 2024-09-12T00:09:38.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.850+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~PB3V0P9CYMHD.0 size=804478 2024-09-12T00:09:38.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.850+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=PB3V0P9CYMHD tag=P8ACQX7ZO6GN type=write size=1853054 2024-09-12T00:09:38.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.851+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=FB7767PIHD8B type=del 2024-09-12T00:09:38.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.852+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=MNPIBEFCA9TP type=del size=912589 2024-09-12T00:09:38.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.854+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=0YFV93UMWM7O type=del 2024-09-12T00:09:38.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.855+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=RXJ82MRWT2V0 type=del size=3696057 2024-09-12T00:09:38.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.856+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=OEKX50O9CKF0 type=del 2024-09-12T00:09:38.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.857+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=JI506YEUXY21 type=del size=3308733 2024-09-12T00:09:38.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.860+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=RCBLDA2YTF0D type=del 2024-09-12T00:09:38.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.861+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=HPJ8BT4WTMRU type=del size=2210639 2024-09-12T00:09:38.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.862+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~OI29194EUM6Z.0 size=1048576 2024-09-12T00:09:38.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.863+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~OI29194EUM6Z.1 size=1048576 2024-09-12T00:09:38.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.865+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~OI29194EUM6Z.2 size=42897 2024-09-12T00:09:38.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.867+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=OI29194EUM6Z tag=OMXH0NRAF6CU type=write size=3188625 2024-09-12T00:09:38.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.868+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=Y319QL6467ZA type=del size=324368 2024-09-12T00:09:38.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.870+0000 7f3dc2c18780 1 < suggested remove operation key=8JFV08DJLXTB tag=PWC3FCS7HQ5H type=del 2024-09-12T00:09:38.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.873+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~PQHNOBKRI0D5.0 size=1048576 2024-09-12T00:09:38.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.873+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~PQHNOBKRI0D5.1 size=1048576 2024-09-12T00:09:38.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.874+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~PQHNOBKRI0D5.2 size=314775 2024-09-12T00:09:38.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.874+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=PQHNOBKRI0D5 tag=GXVJC4SAN6I8 type=write size=3460503 2024-09-12T00:09:38.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.876+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=SO3F75W5C470 type=del 2024-09-12T00:09:38.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.878+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~K8Z9EBMR066I.0 size=1048576 2024-09-12T00:09:38.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.879+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~K8Z9EBMR066I.1 size=1048576 2024-09-12T00:09:38.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.880+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~K8Z9EBMR066I.2 size=906044 2024-09-12T00:09:38.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.880+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=K8Z9EBMR066I tag=5DQ86MRQ0QT2 type=write size=4051772 2024-09-12T00:09:38.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.881+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~XW3ZOPR127Q3.0 size=1048576 2024-09-12T00:09:38.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.881+0000 7f3dc2c18780 1 < canceled part key=_multipart_V0K5FRKYGJ0K.2~XW3ZOPR127Q3.1 size=1048576 2024-09-12T00:09:38.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.882+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~XW3ZOPR127Q3.2 size=249044 2024-09-12T00:09:38.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.884+0000 7f3dc2c18780 1 < canceled multipart upload key=V0K5FRKYGJ0K upload=XW3ZOPR127Q3 tag=WQNJNX3TE16T type=write size=3394772 2024-09-12T00:09:38.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.885+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=0SHRJESU9X0B type=del size=1260533 2024-09-12T00:09:38.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.886+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DECGJBE8XVFV.0 size=1048576 2024-09-12T00:09:38.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.887+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DECGJBE8XVFV.1 size=1048576 2024-09-12T00:09:38.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.888+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DECGJBE8XVFV.2 size=131480 2024-09-12T00:09:38.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.890+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=DECGJBE8XVFV tag=6YQZNFYX2UKR type=write size=3277208 2024-09-12T00:09:38.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.892+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~B119HI3K9LO4.0 size=1048576 2024-09-12T00:09:38.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.893+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~B119HI3K9LO4.1 size=1048576 2024-09-12T00:09:38.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.894+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~B119HI3K9LO4.2 size=643084 2024-09-12T00:09:38.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.894+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=B119HI3K9LO4 tag=EGISH0XHPLPL type=write size=3788812 2024-09-12T00:09:38.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.895+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~9G3UODQJ97ZO.0 size=691332 2024-09-12T00:09:38.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.897+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=9G3UODQJ97ZO tag=7YWI904X0JZB type=write size=1739908 2024-09-12T00:09:38.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.899+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~MRV62JMH2Y8L.0 size=320588 2024-09-12T00:09:38.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.899+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=MRV62JMH2Y8L tag=J9TURX060V5M type=write size=1369164 2024-09-12T00:09:38.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.901+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=W1ZF76Y37WSA type=write size=678483 2024-09-12T00:09:38.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.902+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=EKPXFTM8M9AC type=del size=2465971 2024-09-12T00:09:38.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.903+0000 7f3dc2c18780 1 < canceled operation key=C0JT46SGECP0 tag=QFILMIPXBMQD type=del size=263418 2024-09-12T00:09:38.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.904+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=01506ZR5T3IT type=del size=1629407 2024-09-12T00:09:38.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.906+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=7M3PIIU7TXMN type=del 2024-09-12T00:09:38.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.908+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~21JAECUKLISD.0 size=1048576 2024-09-12T00:09:38.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.909+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~21JAECUKLISD.1 size=1048576 2024-09-12T00:09:38.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.910+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~21JAECUKLISD.2 size=840973 2024-09-12T00:09:38.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.910+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=21JAECUKLISD tag=D8INNZA5262N type=write size=3986701 2024-09-12T00:09:38.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.911+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=VH2ZWGYD9EJU type=del 2024-09-12T00:09:38.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.913+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~C23IXDS4SX0U.0 size=1048576 2024-09-12T00:09:38.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.914+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~C23IXDS4SX0U.1 size=1048576 2024-09-12T00:09:38.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.915+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~C23IXDS4SX0U.2 size=806923 2024-09-12T00:09:38.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.915+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=C23IXDS4SX0U tag=MKORNCT5KG29 type=write size=3952651 2024-09-12T00:09:38.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.916+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=TV04OTS4HLE3 type=del 2024-09-12T00:09:38.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.919+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~GOBZSYY15VTW.0 size=1048576 2024-09-12T00:09:38.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.919+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~GOBZSYY15VTW.1 size=1048576 2024-09-12T00:09:38.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.920+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~GOBZSYY15VTW.2 size=525752 2024-09-12T00:09:38.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.920+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=GOBZSYY15VTW tag=7FTATZDKYW6L type=write size=3671480 2024-09-12T00:09:38.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.922+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~PB3V0P9CYMHD.0 size=804478 2024-09-12T00:09:38.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.924+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=PB3V0P9CYMHD tag=P8ACQX7ZO6GN type=write size=1853054 2024-09-12T00:09:38.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.926+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~2KWPY74ASN8J.0 size=1048576 2024-09-12T00:09:38.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.927+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~2KWPY74ASN8J.1 size=1048576 2024-09-12T00:09:38.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.928+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~2KWPY74ASN8J.2 size=517745 2024-09-12T00:09:38.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.928+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=2KWPY74ASN8J tag=5L3LBP5PO6B5 type=write size=3663473 2024-09-12T00:09:38.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.930+0000 7f3dc2c18780 1 < suggested remove operation key=GLAOX3ZNNILD tag=MNPIBEFCA9TP type=del 2024-09-12T00:09:38.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.931+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=BC43QSXAQ7WG type=write size=251803 2024-09-12T00:09:38.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.933+0000 7f3dc2c18780 1 < canceled operation key=GP3MLWX9586T tag=RXJ82MRWT2V0 type=del size=3696057 2024-09-12T00:09:38.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.935+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~I1UC1IHRHEGM.0 size=1048576 2024-09-12T00:09:38.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.936+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~I1UC1IHRHEGM.1 size=130811 2024-09-12T00:09:38.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.936+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=I1UC1IHRHEGM tag=I6ALAPNL4F3T type=write size=2227963 2024-09-12T00:09:38.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.938+0000 7f3dc2c18780 1 < suggested remove operation key=5F0BB9U7Y6ZZ tag=JI506YEUXY21 type=del 2024-09-12T00:09:38.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.940+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=RON3L2HRPDYO type=del size=2579316 2024-09-12T00:09:38.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.941+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=HPJ8BT4WTMRU type=del 2024-09-12T00:09:38.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.943+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=3I1YKANYLUQW type=del size=1125524 2024-09-12T00:09:38.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.945+0000 7f3dc2c18780 1 < suggested remove operation key=QJ3KML910OEL tag=Y319QL6467ZA type=del 2024-09-12T00:09:38.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.947+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=Y4MSLSLIKVGU type=write size=490419 2024-09-12T00:09:38.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.948+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~PQHNOBKRI0D5.0 size=1048576 2024-09-12T00:09:38.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.948+0000 7f3dc2c18780 1 < canceled part key=_multipart_0ICU4WV9K1RG.2~PQHNOBKRI0D5.1 size=1048576 2024-09-12T00:09:38.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.949+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~PQHNOBKRI0D5.2 size=314775 2024-09-12T00:09:38.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.951+0000 7f3dc2c18780 1 < canceled multipart upload key=0ICU4WV9K1RG upload=PQHNOBKRI0D5 tag=GXVJC4SAN6I8 type=write size=3460503 2024-09-12T00:09:38.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.954+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~E1BUJICXH9NL.0 size=1048576 2024-09-12T00:09:38.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.955+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~E1BUJICXH9NL.1 size=1048576 2024-09-12T00:09:38.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.956+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~E1BUJICXH9NL.2 size=977334 2024-09-12T00:09:38.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.956+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=E1BUJICXH9NL tag=9TRFMO6YYRID type=write size=4123062 2024-09-12T00:09:38.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.957+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~K8Z9EBMR066I.0 size=1048576 2024-09-12T00:09:38.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.958+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~K8Z9EBMR066I.1 size=1048576 2024-09-12T00:09:38.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.959+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~K8Z9EBMR066I.2 size=906044 2024-09-12T00:09:38.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.962+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=K8Z9EBMR066I tag=5DQ86MRQ0QT2 type=write size=4051772 2024-09-12T00:09:38.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.964+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~EPDYZGGHGQQM.0 size=1048576 2024-09-12T00:09:38.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.965+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~EPDYZGGHGQQM.1 size=396994 2024-09-12T00:09:38.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.965+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=EPDYZGGHGQQM tag=JZOCB8YPLGM0 type=write size=2494146 2024-09-12T00:09:38.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.966+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=0SHRJESU9X0B type=del 2024-09-12T00:09:38.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.967+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=AJX5UXWULO7G type=del size=2846346 2024-09-12T00:09:38.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.969+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~B119HI3K9LO4.0 size=1048576 2024-09-12T00:09:38.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.970+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~B119HI3K9LO4.1 size=1048576 2024-09-12T00:09:38.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.971+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~B119HI3K9LO4.2 size=643084 2024-09-12T00:09:38.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.974+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=B119HI3K9LO4 tag=EGISH0XHPLPL type=write size=3788812 2024-09-12T00:09:38.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.975+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=407WDN8LFTM6 type=del size=1333475 2024-09-12T00:09:38.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.976+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~MRV62JMH2Y8L.0 size=320588 2024-09-12T00:09:38.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.978+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=MRV62JMH2Y8L tag=J9TURX060V5M type=write size=1369164 2024-09-12T00:09:38.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.981+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~SQ54RE8C4DX0.0 size=1048576 2024-09-12T00:09:38.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.982+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~SQ54RE8C4DX0.1 size=1048576 2024-09-12T00:09:38.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.983+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~SQ54RE8C4DX0.2 size=180812 2024-09-12T00:09:38.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.983+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=SQ54RE8C4DX0 tag=AFFY3PS5QCME type=write size=3326540 2024-09-12T00:09:38.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.984+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=EKPXFTM8M9AC type=del 2024-09-12T00:09:38.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.986+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=402BLSA09TZT type=del size=446914 2024-09-12T00:09:38.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.987+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=01506ZR5T3IT type=del 2024-09-12T00:09:38.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.988+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=CMKXTS0HK28H type=del size=402713 2024-09-12T00:09:38.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.990+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~21JAECUKLISD.0 size=1048576 2024-09-12T00:09:38.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.991+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~21JAECUKLISD.1 size=1048576 2024-09-12T00:09:38.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.992+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~21JAECUKLISD.2 size=840973 2024-09-12T00:09:38.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.995+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=21JAECUKLISD tag=D8INNZA5262N type=write size=3986701 2024-09-12T00:09:38.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.997+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=K2AHA5YQCMVK type=write size=747871 2024-09-12T00:09:38.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.998+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~C23IXDS4SX0U.0 size=1048576 2024-09-12T00:09:38.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:38.999+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~C23IXDS4SX0U.1 size=1048576 2024-09-12T00:09:38.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.000+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~C23IXDS4SX0U.2 size=806923 2024-09-12T00:09:39.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.002+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=C23IXDS4SX0U tag=MKORNCT5KG29 type=write size=3952651 2024-09-12T00:09:39.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.004+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=68DQYAAJ67NI type=del size=564361 2024-09-12T00:09:39.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.004+0000 7f3dc2c18780 1 < canceled part key=_multipart_8JFV08DJLXTB.2~GOBZSYY15VTW.0 size=1048576 2024-09-12T00:09:39.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.005+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~GOBZSYY15VTW.1 size=1048576 2024-09-12T00:09:39.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.006+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~GOBZSYY15VTW.2 size=525752 2024-09-12T00:09:39.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.010+0000 7f3dc2c18780 1 < canceled multipart upload key=8JFV08DJLXTB upload=GOBZSYY15VTW tag=7FTATZDKYW6L type=write size=3671480 2024-09-12T00:09:39.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.013+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=7T19V3AMT7O8 type=write size=692259 2024-09-12T00:09:39.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.014+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~2KWPY74ASN8J.0 size=1048576 2024-09-12T00:09:39.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.015+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~2KWPY74ASN8J.1 size=1048576 2024-09-12T00:09:39.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.016+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~2KWPY74ASN8J.2 size=517745 2024-09-12T00:09:39.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.018+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=2KWPY74ASN8J tag=5L3LBP5PO6B5 type=write size=3663473 2024-09-12T00:09:39.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.020+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~Z19EOYU32KDZ.0 size=925639 2024-09-12T00:09:39.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.020+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=Z19EOYU32KDZ tag=BZ32OAO1Y61Z type=write size=1974215 2024-09-12T00:09:39.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.021+0000 7f3dc2c18780 1 < completed write operation key=L9C014T8YLNV tag=BC43QSXAQ7WG type=write size=251803 2024-09-12T00:09:39.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.024+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~2GE0WNP8KNNE.0 size=1048576 2024-09-12T00:09:39.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.025+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~2GE0WNP8KNNE.1 size=1048576 2024-09-12T00:09:39.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.026+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~2GE0WNP8KNNE.2 size=654576 2024-09-12T00:09:39.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.026+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=2GE0WNP8KNNE tag=ER73XLJJD7NP type=write size=3800304 2024-09-12T00:09:39.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.027+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~I1UC1IHRHEGM.0 size=1048576 2024-09-12T00:09:39.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.028+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~I1UC1IHRHEGM.1 size=130811 2024-09-12T00:09:39.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.030+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=I1UC1IHRHEGM tag=I6ALAPNL4F3T type=write size=2227963 2024-09-12T00:09:39.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.032+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~KDDZYSKX5EG0.0 size=382956 2024-09-12T00:09:39.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.032+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=KDDZYSKX5EG0 tag=5VFAO50N5B8I type=write size=1431532 2024-09-12T00:09:39.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.033+0000 7f3dc2c18780 1 < canceled operation key=XNZNORKYEOPV tag=RON3L2HRPDYO type=del size=2579316 2024-09-12T00:09:39.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.034+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=1EX09BUUFCLM type=del size=2232432 2024-09-12T00:09:39.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.037+0000 7f3dc2c18780 1 < suggested update operation key=25CF1N8J81Y9 tag=3I1YKANYLUQW type=del size=1125524 2024-09-12T00:09:39.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.038+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=3YN0KAZ9IKLL type=del size=1089991 2024-09-12T00:09:39.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.040+0000 7f3dc2c18780 1 < suggested update operation key=A4O7JFS2ULY0 tag=Y4MSLSLIKVGU type=write size=490419 2024-09-12T00:09:39.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.042+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=AA62TEP7UOGO type=del size=258808 2024-09-12T00:09:39.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.042+0000 7f3dc2c18780 1 < canceled part key=_multipart_V0K5FRKYGJ0K.2~E1BUJICXH9NL.0 size=1048576 2024-09-12T00:09:39.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.042+0000 7f3dc2c18780 1 < canceled part key=_multipart_V0K5FRKYGJ0K.2~E1BUJICXH9NL.1 size=1048576 2024-09-12T00:09:39.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.043+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~E1BUJICXH9NL.2 size=977334 2024-09-12T00:09:39.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.045+0000 7f3dc2c18780 1 < canceled multipart upload key=V0K5FRKYGJ0K upload=E1BUJICXH9NL tag=9TRFMO6YYRID type=write size=4123062 2024-09-12T00:09:39.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.046+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=1YRLKOFG55M1 type=write size=464480 2024-09-12T00:09:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.047+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~EPDYZGGHGQQM.0 size=1048576 2024-09-12T00:09:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.047+0000 7f3dc2c18780 1 < canceled part key=_multipart_C7ZOCTAR2BEP.2~EPDYZGGHGQQM.1 size=396994 2024-09-12T00:09:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.049+0000 7f3dc2c18780 1 < canceled multipart upload key=C7ZOCTAR2BEP upload=EPDYZGGHGQQM tag=JZOCB8YPLGM0 type=write size=2494146 2024-09-12T00:09:39.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.052+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~TNLRFU7E2E0F.0 size=1048576 2024-09-12T00:09:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.053+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~TNLRFU7E2E0F.1 size=839455 2024-09-12T00:09:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.053+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=TNLRFU7E2E0F tag=3821TC0MKEZZ type=write size=2936607 2024-09-12T00:09:39.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.055+0000 7f3dc2c18780 1 < suggested remove operation key=XNZNORKYEOPV tag=AJX5UXWULO7G type=del 2024-09-12T00:09:39.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.056+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=RKGU48WD78Q7 type=write size=635566 2024-09-12T00:09:39.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.057+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=407WDN8LFTM6 type=del 2024-09-12T00:09:39.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.059+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=YROH2E67FF56 type=del size=2989997 2024-09-12T00:09:39.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.060+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~SQ54RE8C4DX0.0 size=1048576 2024-09-12T00:09:39.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.061+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~SQ54RE8C4DX0.1 size=1048576 2024-09-12T00:09:39.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.062+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~SQ54RE8C4DX0.2 size=180812 2024-09-12T00:09:39.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.064+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=SQ54RE8C4DX0 tag=AFFY3PS5QCME type=write size=3326540 2024-09-12T00:09:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.065+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=5MJJRB9INGBR type=del size=1812932 2024-09-12T00:09:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.066+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=402BLSA09TZT type=del 2024-09-12T00:09:39.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.069+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~1N2B84ATNTW3.0 size=191831 2024-09-12T00:09:39.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.069+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=1N2B84ATNTW3 tag=OI6R1UWYS6W6 type=write size=1240407 2024-09-12T00:09:39.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.070+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=CMKXTS0HK28H type=del 2024-09-12T00:09:39.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.071+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=FP8BWM4SCPYM type=del size=405643 2024-09-12T00:09:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.074+0000 7f3dc2c18780 1 < suggested remove operation key=QJ3KML910OEL tag=K2AHA5YQCMVK type=write 2024-09-12T00:09:39.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.076+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~W2FGB0W0EGSY.0 size=163230 2024-09-12T00:09:39.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.076+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=W2FGB0W0EGSY tag=LRX433C3XHK3 type=write size=1211806 2024-09-12T00:09:39.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.077+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=68DQYAAJ67NI type=del 2024-09-12T00:09:39.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.078+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=ZXYH6THL2P7Y type=write size=432312 2024-09-12T00:09:39.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.080+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=7T19V3AMT7O8 type=write size=692259 2024-09-12T00:09:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.081+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=YTS3FD2ZFRKF type=del size=1965710 2024-09-12T00:09:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.082+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~Z19EOYU32KDZ.0 size=925639 2024-09-12T00:09:39.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.085+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=Z19EOYU32KDZ tag=BZ32OAO1Y61Z type=write size=1974215 2024-09-12T00:09:39.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.086+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=9A55DR174BZM type=del size=3834430 2024-09-12T00:09:39.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.087+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~2GE0WNP8KNNE.0 size=1048576 2024-09-12T00:09:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.088+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~2GE0WNP8KNNE.1 size=1048576 2024-09-12T00:09:39.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.089+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~2GE0WNP8KNNE.2 size=654576 2024-09-12T00:09:39.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.091+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=2GE0WNP8KNNE tag=ER73XLJJD7NP type=write size=3800304 2024-09-12T00:09:39.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.094+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=KI7QCW8TCHQU type=del size=4179173 2024-09-12T00:09:39.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.095+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~KDDZYSKX5EG0.0 size=382956 2024-09-12T00:09:39.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.097+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=KDDZYSKX5EG0 tag=5VFAO50N5B8I type=write size=1431532 2024-09-12T00:09:39.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.098+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=5VE5OY0Q55NS type=del size=1007052 2024-09-12T00:09:39.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.099+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=1EX09BUUFCLM type=del 2024-09-12T00:09:39.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.102+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~ERD0D2T7MYXA.0 size=708226 2024-09-12T00:09:39.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.102+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=ERD0D2T7MYXA tag=6IZ5HH46MRZW type=write size=1756802 2024-09-12T00:09:39.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.103+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=3YN0KAZ9IKLL type=del 2024-09-12T00:09:39.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.105+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~TLLPO673DFAV.0 size=1048576 2024-09-12T00:09:39.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.106+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~TLLPO673DFAV.1 size=1048576 2024-09-12T00:09:39.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.107+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~TLLPO673DFAV.2 size=924389 2024-09-12T00:09:39.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.107+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=TLLPO673DFAV tag=27GH1XOCH6G8 type=write size=4070117 2024-09-12T00:09:39.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.108+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=AA62TEP7UOGO type=del 2024-09-12T00:09:39.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.110+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=OSJ34JA0YLIP type=write size=875011 2024-09-12T00:09:39.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.111+0000 7f3dc2c18780 1 < completed write operation key=Y40G8SLO6AVH tag=1YRLKOFG55M1 type=write size=464480 2024-09-12T00:09:39.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.112+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=96IGZTD3ITTW type=write size=316464 2024-09-12T00:09:39.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.113+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~TNLRFU7E2E0F.0 size=1048576 2024-09-12T00:09:39.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.115+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~TNLRFU7E2E0F.1 size=839455 2024-09-12T00:09:39.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.117+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=TNLRFU7E2E0F tag=3821TC0MKEZZ type=write size=2936607 2024-09-12T00:09:39.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.118+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=AM0X8OE4CSDL type=del size=505884 2024-09-12T00:09:39.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.120+0000 7f3dc2c18780 1 < suggested update operation key=U2H0A1GZROT7 tag=RKGU48WD78Q7 type=write size=635566 2024-09-12T00:09:39.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.121+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=PO618LQEHFBV type=del size=2481330 2024-09-12T00:09:39.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.123+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=YROH2E67FF56 type=del 2024-09-12T00:09:39.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.124+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=6EAJYBMEFLAD type=del size=3636953 2024-09-12T00:09:39.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.126+0000 7f3dc2c18780 1 < suggested update operation key=WRBBH64CISJZ tag=5MJJRB9INGBR type=del size=1812932 2024-09-12T00:09:39.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.128+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=F36RPJX9QQD4 type=del size=154306 2024-09-12T00:09:39.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.129+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~1N2B84ATNTW3.0 size=191831 2024-09-12T00:09:39.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.131+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=1N2B84ATNTW3 tag=OI6R1UWYS6W6 type=write size=1240407 2024-09-12T00:09:39.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.133+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~PP9JF6CJ86I0.0 size=529690 2024-09-12T00:09:39.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.133+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=PP9JF6CJ86I0 tag=R7PMFVNSO7FU type=write size=1578266 2024-09-12T00:09:39.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.134+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=FP8BWM4SCPYM type=del 2024-09-12T00:09:39.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.137+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~3IAT4Z029XO3.0 size=1048576 2024-09-12T00:09:39.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.138+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~3IAT4Z029XO3.1 size=1048576 2024-09-12T00:09:39.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.139+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~3IAT4Z029XO3.2 size=638343 2024-09-12T00:09:39.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.139+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=3IAT4Z029XO3 tag=EVQAPD1BCMW2 type=write size=3784071 2024-09-12T00:09:39.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.140+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~W2FGB0W0EGSY.0 size=163230 2024-09-12T00:09:39.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.142+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=W2FGB0W0EGSY tag=LRX433C3XHK3 type=write size=1211806 2024-09-12T00:09:39.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.144+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=UTT00CEYI9Z7 type=del size=1288419 2024-09-12T00:09:39.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.145+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=ZXYH6THL2P7Y type=write size=432312 2024-09-12T00:09:39.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.147+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~2RGS65WPQUUO.0 size=1048576 2024-09-12T00:09:39.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.148+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~2RGS65WPQUUO.1 size=1048576 2024-09-12T00:09:39.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.149+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~2RGS65WPQUUO.2 size=4733 2024-09-12T00:09:39.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.149+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=2RGS65WPQUUO tag=JS4RW5BEVTEN type=write size=3150461 2024-09-12T00:09:39.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.150+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=YTS3FD2ZFRKF type=del 2024-09-12T00:09:39.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.152+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=AZFOW04A5SEK type=del size=3419125 2024-09-12T00:09:39.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.153+0000 7f3dc2c18780 1 < canceled operation key=KDHO7IEGICDA tag=9A55DR174BZM type=del size=3834430 2024-09-12T00:09:39.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.154+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=VJV4JSX39KR5 type=del size=1902155 2024-09-12T00:09:39.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.156+0000 7f3dc2c18780 1 < suggested remove operation key=0ICU4WV9K1RG tag=KI7QCW8TCHQU type=del 2024-09-12T00:09:39.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.158+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=YJ4U16NDJ6FE type=del size=1042525 2024-09-12T00:09:39.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.159+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=5VE5OY0Q55NS type=del 2024-09-12T00:09:39.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.161+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~4A21O6C6Z1AM.0 size=651609 2024-09-12T00:09:39.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.161+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=4A21O6C6Z1AM tag=6BRL8PDHRZJS type=write size=1700185 2024-09-12T00:09:39.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.162+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~ERD0D2T7MYXA.0 size=708226 2024-09-12T00:09:39.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.164+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=ERD0D2T7MYXA tag=6IZ5HH46MRZW type=write size=1756802 2024-09-12T00:09:39.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.165+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=SHKP8MS48FPL type=del size=666855 2024-09-12T00:09:39.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.167+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~TLLPO673DFAV.0 size=1048576 2024-09-12T00:09:39.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.168+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~TLLPO673DFAV.1 size=1048576 2024-09-12T00:09:39.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.169+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~TLLPO673DFAV.2 size=924389 2024-09-12T00:09:39.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.171+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=TLLPO673DFAV tag=27GH1XOCH6G8 type=write size=4070117 2024-09-12T00:09:39.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.173+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~M3Z8UYZM8AKL.0 size=1048576 2024-09-12T00:09:39.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.174+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~M3Z8UYZM8AKL.1 size=145980 2024-09-12T00:09:39.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.174+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=M3Z8UYZM8AKL tag=E4ZM1ATEEMLV type=write size=2243132 2024-09-12T00:09:39.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.176+0000 7f3dc2c18780 1 < completed write operation key=4POD73U0LAC0 tag=OSJ34JA0YLIP type=write size=875011 2024-09-12T00:09:39.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.177+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=9LIBUEVSS2KN type=del size=3214450 2024-09-12T00:09:39.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.179+0000 7f3dc2c18780 1 < completed write operation key=25CF1N8J81Y9 tag=96IGZTD3ITTW type=write size=316464 2024-09-12T00:09:39.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.180+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=LSIGHEB68H3I type=del size=2845229 2024-09-12T00:09:39.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.182+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=AM0X8OE4CSDL type=del 2024-09-12T00:09:39.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.184+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~FL46CNGHQW00.0 size=68237 2024-09-12T00:09:39.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.184+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=FL46CNGHQW00 tag=E1ORIEE02ROP type=write size=1116813 2024-09-12T00:09:39.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.186+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=PO618LQEHFBV type=del 2024-09-12T00:09:39.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.187+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=3GIV9N4TDO1Y type=del size=3326714 2024-09-12T00:09:39.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.188+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=6EAJYBMEFLAD type=del 2024-09-12T00:09:39.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.191+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~Y4OQAUPBYZ1Y.0 size=1048576 2024-09-12T00:09:39.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.192+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~Y4OQAUPBYZ1Y.1 size=1048576 2024-09-12T00:09:39.191 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.193+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~Y4OQAUPBYZ1Y.2 size=513177 2024-09-12T00:09:39.191 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.193+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=Y4OQAUPBYZ1Y tag=MO8I4Q835051 type=write size=3658905 2024-09-12T00:09:39.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.194+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=F36RPJX9QQD4 type=del 2024-09-12T00:09:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.195+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=D6WWVV62BEUV type=del size=491099 2024-09-12T00:09:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.195+0000 7f3dc2c18780 1 < canceled part key=_multipart_KDHO7IEGICDA.2~PP9JF6CJ86I0.0 size=529690 2024-09-12T00:09:39.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.197+0000 7f3dc2c18780 1 < canceled multipart upload key=KDHO7IEGICDA upload=PP9JF6CJ86I0 tag=R7PMFVNSO7FU type=write size=1578266 2024-09-12T00:09:39.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.200+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~7QXY64GCSCRT.0 size=571810 2024-09-12T00:09:39.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.200+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=7QXY64GCSCRT tag=20Y5QOZYV8PW type=write size=1620386 2024-09-12T00:09:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.202+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~3IAT4Z029XO3.0 size=1048576 2024-09-12T00:09:39.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.202+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~3IAT4Z029XO3.1 size=1048576 2024-09-12T00:09:39.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.203+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~3IAT4Z029XO3.2 size=638343 2024-09-12T00:09:39.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.205+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=3IAT4Z029XO3 tag=EVQAPD1BCMW2 type=write size=3784071 2024-09-12T00:09:39.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.208+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~DLPJXXLOWOVN.0 size=144720 2024-09-12T00:09:39.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.208+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=DLPJXXLOWOVN tag=D8G0T01QRNKI type=write size=1193296 2024-09-12T00:09:39.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.209+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=UTT00CEYI9Z7 type=del 2024-09-12T00:09:39.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.210+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=WZ8M7K438D3N type=del size=3422518 2024-09-12T00:09:39.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.213+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~2RGS65WPQUUO.0 size=1048576 2024-09-12T00:09:39.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.214+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~2RGS65WPQUUO.1 size=1048576 2024-09-12T00:09:39.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.215+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~2RGS65WPQUUO.2 size=4733 2024-09-12T00:09:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.217+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=2RGS65WPQUUO tag=JS4RW5BEVTEN type=write size=3150461 2024-09-12T00:09:39.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.220+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~7WFC19GO0LRZ.0 size=1048576 2024-09-12T00:09:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.221+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~7WFC19GO0LRZ.1 size=504848 2024-09-12T00:09:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.221+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=7WFC19GO0LRZ tag=LZQZ6ZRU1XWS type=write size=2602000 2024-09-12T00:09:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.223+0000 7f3dc2c18780 1 < suggested update operation key=65DTZR8A5OHF tag=AZFOW04A5SEK type=del size=3419125 2024-09-12T00:09:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.224+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=R2KT13BINPA1 type=del size=1708454 2024-09-12T00:09:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.226+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=VJV4JSX39KR5 type=del 2024-09-12T00:09:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.227+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=RQ3AYDJEOA3D type=del size=1289316 2024-09-12T00:09:39.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.228+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=YJ4U16NDJ6FE type=del 2024-09-12T00:09:39.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.230+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=VTGMG0V01NBA type=write size=983002 2024-09-12T00:09:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.231+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~4A21O6C6Z1AM.0 size=651609 2024-09-12T00:09:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.233+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=4A21O6C6Z1AM tag=6BRL8PDHRZJS type=write size=1700185 2024-09-12T00:09:39.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.234+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=6FUZT781Z5D8 type=write size=845245 2024-09-12T00:09:39.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.236+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=SHKP8MS48FPL type=del 2024-09-12T00:09:39.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.238+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~5F2CHH9ZIVHR.0 size=1048576 2024-09-12T00:09:39.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.239+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~5F2CHH9ZIVHR.1 size=1048576 2024-09-12T00:09:39.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.240+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~5F2CHH9ZIVHR.2 size=281187 2024-09-12T00:09:39.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.240+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=5F2CHH9ZIVHR tag=2TAUUQIZKWA4 type=write size=3426915 2024-09-12T00:09:39.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.241+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~M3Z8UYZM8AKL.0 size=1048576 2024-09-12T00:09:39.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.242+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~M3Z8UYZM8AKL.1 size=145980 2024-09-12T00:09:39.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.244+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=M3Z8UYZM8AKL tag=E4ZM1ATEEMLV type=write size=2243132 2024-09-12T00:09:39.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.246+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=V6GJSSMEL3C6 type=del size=2826430 2024-09-12T00:09:39.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.247+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=9LIBUEVSS2KN type=del 2024-09-12T00:09:39.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.248+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=FB72GH2T9MIY type=del size=567782 2024-09-12T00:09:39.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.249+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=LSIGHEB68H3I type=del 2024-09-12T00:09:39.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.252+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~0RPPAO80YS8A.0 size=1048576 2024-09-12T00:09:39.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.253+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~0RPPAO80YS8A.1 size=1048576 2024-09-12T00:09:39.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.254+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~0RPPAO80YS8A.2 size=712633 2024-09-12T00:09:39.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.254+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=0RPPAO80YS8A tag=IA7GZ6EYGXL9 type=write size=3858361 2024-09-12T00:09:39.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.255+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~FL46CNGHQW00.0 size=68237 2024-09-12T00:09:39.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.257+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=FL46CNGHQW00 tag=E1ORIEE02ROP type=write size=1116813 2024-09-12T00:09:39.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.259+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~IFMITHWP9T5U.0 size=142393 2024-09-12T00:09:39.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.259+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=IFMITHWP9T5U tag=LZLS9BB7JNNR type=write size=1190969 2024-09-12T00:09:39.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.261+0000 7f3dc2c18780 1 < canceled operation key=Y40G8SLO6AVH tag=3GIV9N4TDO1Y type=del size=3326714 2024-09-12T00:09:39.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.263+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~JY5W62J8DQ16.0 size=100084 2024-09-12T00:09:39.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.263+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=JY5W62J8DQ16 tag=G9MHVWJBFEF2 type=write size=1148660 2024-09-12T00:09:39.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.264+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~Y4OQAUPBYZ1Y.0 size=1048576 2024-09-12T00:09:39.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.265+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~Y4OQAUPBYZ1Y.1 size=1048576 2024-09-12T00:09:39.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.266+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~Y4OQAUPBYZ1Y.2 size=513177 2024-09-12T00:09:39.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.268+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=Y4OQAUPBYZ1Y tag=MO8I4Q835051 type=write size=3658905 2024-09-12T00:09:39.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.270+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=OT9N3X0DEMQM type=del size=3442055 2024-09-12T00:09:39.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.271+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=D6WWVV62BEUV type=del 2024-09-12T00:09:39.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.273+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~9S1V8RHNGQPJ.0 size=772484 2024-09-12T00:09:39.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.273+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=9S1V8RHNGQPJ tag=AGURV3YRGAKK type=write size=1821060 2024-09-12T00:09:39.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.275+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~7QXY64GCSCRT.0 size=571810 2024-09-12T00:09:39.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.277+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=7QXY64GCSCRT tag=20Y5QOZYV8PW type=write size=1620386 2024-09-12T00:09:39.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.278+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=JNS2F7ETJ2ZS type=del size=1395181 2024-09-12T00:09:39.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.279+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~DLPJXXLOWOVN.0 size=144720 2024-09-12T00:09:39.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.281+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=DLPJXXLOWOVN tag=D8G0T01QRNKI type=write size=1193296 2024-09-12T00:09:39.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.283+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~5PWR1Z3826OJ.0 size=243523 2024-09-12T00:09:39.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.283+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=5PWR1Z3826OJ tag=76B25Y2P1QMF type=write size=1292099 2024-09-12T00:09:39.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.285+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=WZ8M7K438D3N type=del 2024-09-12T00:09:39.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.286+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=GU7PCG57OUFR type=del size=4102789 2024-09-12T00:09:39.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.287+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~7WFC19GO0LRZ.0 size=1048576 2024-09-12T00:09:39.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.288+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~7WFC19GO0LRZ.1 size=504848 2024-09-12T00:09:39.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.290+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=7WFC19GO0LRZ tag=LZQZ6ZRU1XWS type=write size=2602000 2024-09-12T00:09:39.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.293+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~E5G53YKIDZ7O.0 size=590714 2024-09-12T00:09:39.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.293+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=E5G53YKIDZ7O tag=2OM0L4QC4CVV type=write size=1639290 2024-09-12T00:09:39.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.294+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=R2KT13BINPA1 type=del 2024-09-12T00:09:39.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.296+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~TIKFILQHGG33.0 size=1048576 2024-09-12T00:09:39.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.297+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~TIKFILQHGG33.1 size=1048576 2024-09-12T00:09:39.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.298+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~TIKFILQHGG33.2 size=279074 2024-09-12T00:09:39.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.298+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=TIKFILQHGG33 tag=V4BY3XBRINEU type=write size=3424802 2024-09-12T00:09:39.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.299+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=RQ3AYDJEOA3D type=del 2024-09-12T00:09:39.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.301+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=MD8RGYBYPEA5 type=del size=2738642 2024-09-12T00:09:39.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.302+0000 7f3dc2c18780 1 < completed write operation key=WRR6LAYIWOCE tag=VTGMG0V01NBA type=write size=983002 2024-09-12T00:09:39.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.303+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=JHF5EDK4333V type=del size=2749547 2024-09-12T00:09:39.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.306+0000 7f3dc2c18780 1 < suggested update operation key=KDHO7IEGICDA tag=6FUZT781Z5D8 type=write size=845245 2024-09-12T00:09:39.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.308+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~AZ1LP064PPRL.0 size=577891 2024-09-12T00:09:39.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.308+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=AZ1LP064PPRL tag=31OZPKWNSYLJ type=write size=1626467 2024-09-12T00:09:39.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.309+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~5F2CHH9ZIVHR.0 size=1048576 2024-09-12T00:09:39.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.310+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~5F2CHH9ZIVHR.1 size=1048576 2024-09-12T00:09:39.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.311+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~5F2CHH9ZIVHR.2 size=281187 2024-09-12T00:09:39.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.313+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=5F2CHH9ZIVHR tag=2TAUUQIZKWA4 type=write size=3426915 2024-09-12T00:09:39.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.315+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~TZ46JVTV9FSO.0 size=1048576 2024-09-12T00:09:39.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.316+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~TZ46JVTV9FSO.1 size=987123 2024-09-12T00:09:39.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.316+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=TZ46JVTV9FSO tag=X4UT2ZT003NZ type=write size=3084275 2024-09-12T00:09:39.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.317+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=V6GJSSMEL3C6 type=del 2024-09-12T00:09:39.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.319+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=ZIG97ZP3L4MN type=del size=448694 2024-09-12T00:09:39.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.320+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=FB72GH2T9MIY type=del 2024-09-12T00:09:39.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.321+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=DS8F27VCXI0Q type=del size=857333 2024-09-12T00:09:39.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.322+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~0RPPAO80YS8A.0 size=1048576 2024-09-12T00:09:39.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.322+0000 7f3dc2c18780 1 < canceled part key=_multipart_C7ZOCTAR2BEP.2~0RPPAO80YS8A.1 size=1048576 2024-09-12T00:09:39.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.322+0000 7f3dc2c18780 1 < canceled part key=_multipart_C7ZOCTAR2BEP.2~0RPPAO80YS8A.2 size=712633 2024-09-12T00:09:39.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.324+0000 7f3dc2c18780 1 < canceled multipart upload key=C7ZOCTAR2BEP upload=0RPPAO80YS8A tag=IA7GZ6EYGXL9 type=write size=3858361 2024-09-12T00:09:39.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.326+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~PE0J9O428GHC.0 size=1048576 2024-09-12T00:09:39.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.328+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~PE0J9O428GHC.1 size=1048576 2024-09-12T00:09:39.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.329+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~PE0J9O428GHC.2 size=6849 2024-09-12T00:09:39.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.329+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=PE0J9O428GHC tag=UJPDWQMFL6EY type=write size=3152577 2024-09-12T00:09:39.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.330+0000 7f3dc2c18780 1 < canceled part key=_multipart_V0K5FRKYGJ0K.2~IFMITHWP9T5U.0 size=142393 2024-09-12T00:09:39.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.332+0000 7f3dc2c18780 1 < canceled multipart upload key=V0K5FRKYGJ0K upload=IFMITHWP9T5U tag=LZLS9BB7JNNR type=write size=1190969 2024-09-12T00:09:39.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.334+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=0SL33Y9PFUMC type=del size=1065449 2024-09-12T00:09:39.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.334+0000 7f3dc2c18780 1 < canceled part key=_multipart_A4O7JFS2ULY0.2~JY5W62J8DQ16.0 size=100084 2024-09-12T00:09:39.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.336+0000 7f3dc2c18780 1 < canceled multipart upload key=A4O7JFS2ULY0 upload=JY5W62J8DQ16 tag=G9MHVWJBFEF2 type=write size=1148660 2024-09-12T00:09:39.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.337+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=SC5V5U0K3QPP type=del size=1438229 2024-09-12T00:09:39.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.339+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=OT9N3X0DEMQM type=del 2024-09-12T00:09:39.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.341+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~08JA685TW0I5.0 size=79313 2024-09-12T00:09:39.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.341+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=08JA685TW0I5 tag=8D8Z02Y9PMCN type=write size=1127889 2024-09-12T00:09:39.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.342+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~9S1V8RHNGQPJ.0 size=772484 2024-09-12T00:09:39.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.344+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=9S1V8RHNGQPJ tag=AGURV3YRGAKK type=write size=1821060 2024-09-12T00:09:39.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.346+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=D94N33JD9EU9 type=del size=1315379 2024-09-12T00:09:39.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.347+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=JNS2F7ETJ2ZS type=del 2024-09-12T00:09:39.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.348+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=3U53PP6Z0GZ2 type=del size=502493 2024-09-12T00:09:39.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.349+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~5PWR1Z3826OJ.0 size=243523 2024-09-12T00:09:39.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.352+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=5PWR1Z3826OJ tag=76B25Y2P1QMF type=write size=1292099 2024-09-12T00:09:39.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.354+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~CHZUGHBCAHCW.0 size=200579 2024-09-12T00:09:39.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.354+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=CHZUGHBCAHCW tag=MLJGXM4KMCN3 type=write size=1249155 2024-09-12T00:09:39.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.355+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=GU7PCG57OUFR type=del 2024-09-12T00:09:39.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.357+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=OIP3ZXZ6G64I type=del size=3347165 2024-09-12T00:09:39.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.358+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~E5G53YKIDZ7O.0 size=590714 2024-09-12T00:09:39.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.360+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=E5G53YKIDZ7O tag=2OM0L4QC4CVV type=write size=1639290 2024-09-12T00:09:39.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.363+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~DE33GKAZCTAI.0 size=1048576 2024-09-12T00:09:39.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.364+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~DE33GKAZCTAI.1 size=1048576 2024-09-12T00:09:39.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.365+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~DE33GKAZCTAI.2 size=290564 2024-09-12T00:09:39.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.365+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=DE33GKAZCTAI tag=POJ1OH85KO7L type=write size=3436292 2024-09-12T00:09:39.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.366+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~TIKFILQHGG33.0 size=1048576 2024-09-12T00:09:39.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.367+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~TIKFILQHGG33.1 size=1048576 2024-09-12T00:09:39.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.367+0000 7f3dc2c18780 1 < canceled part key=_multipart_QJ3KML910OEL.2~TIKFILQHGG33.2 size=279074 2024-09-12T00:09:39.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.369+0000 7f3dc2c18780 1 < canceled multipart upload key=QJ3KML910OEL upload=TIKFILQHGG33 tag=V4BY3XBRINEU type=write size=3424802 2024-09-12T00:09:39.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.372+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~U0GEUK5HTSLR.0 size=1048576 2024-09-12T00:09:39.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.373+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~U0GEUK5HTSLR.1 size=1048576 2024-09-12T00:09:39.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.374+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~U0GEUK5HTSLR.2 size=199390 2024-09-12T00:09:39.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.374+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=U0GEUK5HTSLR tag=6CY1WYMM5QRD type=write size=3345118 2024-09-12T00:09:39.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.375+0000 7f3dc2c18780 1 < canceled operation key=A4O7JFS2ULY0 tag=MD8RGYBYPEA5 type=del size=2738642 2024-09-12T00:09:39.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.377+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=CY04AGE9XAIC type=del size=530175 2024-09-12T00:09:39.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.378+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=JHF5EDK4333V type=del 2024-09-12T00:09:39.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.380+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=8HPM9DRSGNC2 type=del size=4171678 2024-09-12T00:09:39.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.381+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~AZ1LP064PPRL.0 size=577891 2024-09-12T00:09:39.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.384+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=AZ1LP064PPRL tag=31OZPKWNSYLJ type=write size=1626467 2024-09-12T00:09:39.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.385+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=EX86NTZV0LRI type=write size=6183 2024-09-12T00:09:39.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.387+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~TZ46JVTV9FSO.0 size=1048576 2024-09-12T00:09:39.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.388+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~TZ46JVTV9FSO.1 size=987123 2024-09-12T00:09:39.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.390+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=TZ46JVTV9FSO tag=X4UT2ZT003NZ type=write size=3084275 2024-09-12T00:09:39.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.393+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~3G31N2LKG58D.0 size=544219 2024-09-12T00:09:39.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.393+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=3G31N2LKG58D tag=AD1R732VFJBU type=write size=1592795 2024-09-12T00:09:39.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.394+0000 7f3dc2c18780 1 < canceled operation key=65DTZR8A5OHF tag=ZIG97ZP3L4MN type=del size=448694 2024-09-12T00:09:39.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.396+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=ND69N7Y2C6BH type=write size=470475 2024-09-12T00:09:39.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.397+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=DS8F27VCXI0Q type=del 2024-09-12T00:09:39.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.400+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~ZGKHJGRMPNFD.0 size=1048576 2024-09-12T00:09:39.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.401+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~ZGKHJGRMPNFD.1 size=45204 2024-09-12T00:09:39.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.401+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=ZGKHJGRMPNFD tag=RAR4E3WZVCI0 type=write size=2142356 2024-09-12T00:09:39.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.402+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~PE0J9O428GHC.0 size=1048576 2024-09-12T00:09:39.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.402+0000 7f3dc2c18780 1 < canceled part key=_multipart_5F0BB9U7Y6ZZ.2~PE0J9O428GHC.1 size=1048576 2024-09-12T00:09:39.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.404+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~PE0J9O428GHC.2 size=6849 2024-09-12T00:09:39.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.406+0000 7f3dc2c18780 1 < canceled multipart upload key=5F0BB9U7Y6ZZ upload=PE0J9O428GHC tag=UJPDWQMFL6EY type=write size=3152577 2024-09-12T00:09:39.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.407+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=KF17UZOY9JE7 type=write size=36824 2024-09-12T00:09:39.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.409+0000 7f3dc2c18780 1 < suggested remove operation key=A4O7JFS2ULY0 tag=0SL33Y9PFUMC type=del 2024-09-12T00:09:39.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.411+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=E4IWXHZ1X1Y4 type=write size=843317 2024-09-12T00:09:39.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.412+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=SC5V5U0K3QPP type=del 2024-09-12T00:09:39.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.413+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=HXVJDQWM230W type=write size=967478 2024-09-12T00:09:39.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.414+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~08JA685TW0I5.0 size=79313 2024-09-12T00:09:39.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.416+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=08JA685TW0I5 tag=8D8Z02Y9PMCN type=write size=1127889 2024-09-12T00:09:39.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.418+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=CP8ZTYJ6LMHM type=del size=3630041 2024-09-12T00:09:39.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.419+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=D94N33JD9EU9 type=del 2024-09-12T00:09:39.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.420+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=P43UG7G4T4IY type=del size=3678618 2024-09-12T00:09:39.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.421+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=3U53PP6Z0GZ2 type=del 2024-09-12T00:09:39.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.422+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=GLBHHZ6SVIJ1 type=write size=580323 2024-09-12T00:09:39.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.424+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~CHZUGHBCAHCW.0 size=200579 2024-09-12T00:09:39.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.426+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=CHZUGHBCAHCW tag=MLJGXM4KMCN3 type=write size=1249155 2024-09-12T00:09:39.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.427+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=NOKT2XVOKNFF type=del size=1969625 2024-09-12T00:09:39.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.428+0000 7f3dc2c18780 1 < canceled operation key=GP3MLWX9586T tag=OIP3ZXZ6G64I type=del size=3347165 2024-09-12T00:09:39.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.429+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=TLJOHZP4LMT7 type=del size=1691450 2024-09-12T00:09:39.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.430+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~DE33GKAZCTAI.0 size=1048576 2024-09-12T00:09:39.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.431+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~DE33GKAZCTAI.1 size=1048576 2024-09-12T00:09:39.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.432+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~DE33GKAZCTAI.2 size=290564 2024-09-12T00:09:39.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.434+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=DE33GKAZCTAI tag=POJ1OH85KO7L type=write size=3436292 2024-09-12T00:09:39.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.437+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~QC0UHF07YP8K.0 size=1048576 2024-09-12T00:09:39.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.438+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~QC0UHF07YP8K.1 size=40214 2024-09-12T00:09:39.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.438+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=QC0UHF07YP8K tag=F0L22FLV50EV type=write size=2137366 2024-09-12T00:09:39.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.439+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~U0GEUK5HTSLR.0 size=1048576 2024-09-12T00:09:39.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.440+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~U0GEUK5HTSLR.1 size=1048576 2024-09-12T00:09:39.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.441+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~U0GEUK5HTSLR.2 size=199390 2024-09-12T00:09:39.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.443+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=U0GEUK5HTSLR tag=6CY1WYMM5QRD type=write size=3345118 2024-09-12T00:09:39.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.444+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=GKZ1CK0RHEG1 type=del size=2141882 2024-09-12T00:09:39.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.445+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=CY04AGE9XAIC type=del 2024-09-12T00:09:39.446 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.447+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~SYDL08ZS3ZM6.0 size=552947 2024-09-12T00:09:39.446 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.447+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=SYDL08ZS3ZM6 tag=7R7HHXE6W092 type=write size=1601523 2024-09-12T00:09:39.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.450+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=8HPM9DRSGNC2 type=del 2024-09-12T00:09:39.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.451+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=C9AVVK918AP5 type=del size=3294619 2024-09-12T00:09:39.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.454+0000 7f3dc2c18780 1 < canceled operation key=C7ZOCTAR2BEP tag=EX86NTZV0LRI type=write size=6183 2024-09-12T00:09:39.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.456+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~7I710DNYFWOI.0 size=494998 2024-09-12T00:09:39.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.456+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=7I710DNYFWOI tag=TZ3O8FJ25VA7 type=write size=1543574 2024-09-12T00:09:39.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.457+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~3G31N2LKG58D.0 size=544219 2024-09-12T00:09:39.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.459+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=3G31N2LKG58D tag=AD1R732VFJBU type=write size=1592795 2024-09-12T00:09:39.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.460+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=8U3A7KZCOLOU type=write size=131793 2024-09-12T00:09:39.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.462+0000 7f3dc2c18780 1 < canceled operation key=TSL3IDD0EDT0 tag=ND69N7Y2C6BH type=write size=470475 2024-09-12T00:09:39.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.464+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~RHJCL7KV1J86.0 size=320882 2024-09-12T00:09:39.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.464+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=RHJCL7KV1J86 tag=UD0QK1Y1Y07D type=write size=1369458 2024-09-12T00:09:39.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.465+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~ZGKHJGRMPNFD.0 size=1048576 2024-09-12T00:09:39.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.466+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~ZGKHJGRMPNFD.1 size=45204 2024-09-12T00:09:39.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.468+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=ZGKHJGRMPNFD tag=RAR4E3WZVCI0 type=write size=2142356 2024-09-12T00:09:39.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.469+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=4HADGBXLOOD0 type=del size=286511 2024-09-12T00:09:39.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.471+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=KF17UZOY9JE7 type=write size=36824 2024-09-12T00:09:39.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.473+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~HOTSOKYU3CY4.0 size=499285 2024-09-12T00:09:39.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.473+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=HOTSOKYU3CY4 tag=S4MH9YJGY2GW type=write size=1547861 2024-09-12T00:09:39.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.474+0000 7f3dc2c18780 1 < completed write operation key=2SO8HBZSAMRX tag=E4IWXHZ1X1Y4 type=write size=843317 2024-09-12T00:09:39.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.475+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=Z9252N0HS2O2 type=del size=3147331 2024-09-12T00:09:39.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.477+0000 7f3dc2c18780 1 < canceled operation key=25CF1N8J81Y9 tag=HXVJDQWM230W type=write size=967478 2024-09-12T00:09:39.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.478+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=8Y294ORG139K type=write size=77114 2024-09-12T00:09:39.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.479+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=CP8ZTYJ6LMHM type=del 2024-09-12T00:09:39.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.488+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~6MQW9I9X9XCY.0 size=1048576 2024-09-12T00:09:39.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.489+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~6MQW9I9X9XCY.1 size=264759 2024-09-12T00:09:39.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.489+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=6MQW9I9X9XCY tag=5IOGL9QN1M5W type=write size=2361911 2024-09-12T00:09:39.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.490+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=P43UG7G4T4IY type=del 2024-09-12T00:09:39.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.491+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=HKVBGZBMHXEE type=del size=1136725 2024-09-12T00:09:39.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.492+0000 7f3dc2c18780 1 < canceled operation key=0ICU4WV9K1RG tag=GLBHHZ6SVIJ1 type=write size=580323 2024-09-12T00:09:39.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.494+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=BLSTM2LHMKBP type=write size=205311 2024-09-12T00:09:39.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.495+0000 7f3dc2c18780 1 < canceled operation key=WRR6LAYIWOCE tag=NOKT2XVOKNFF type=del size=1969625 2024-09-12T00:09:39.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.496+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=EKP2WDFM6PU1 type=del size=1514233 2024-09-12T00:09:39.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.497+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=TLJOHZP4LMT7 type=del 2024-09-12T00:09:39.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.499+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=QFA2GTISQ0KJ type=del size=2280312 2024-09-12T00:09:39.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.500+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~QC0UHF07YP8K.0 size=1048576 2024-09-12T00:09:39.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.501+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~QC0UHF07YP8K.1 size=40214 2024-09-12T00:09:39.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.503+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=QC0UHF07YP8K tag=F0L22FLV50EV type=write size=2137366 2024-09-12T00:09:39.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.505+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~6PD4REGOQGEP.0 size=634003 2024-09-12T00:09:39.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.505+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=6PD4REGOQGEP tag=5P5CUCHSDAZC type=write size=1682579 2024-09-12T00:09:39.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.507+0000 7f3dc2c18780 1 < canceled operation key=WRR6LAYIWOCE tag=GKZ1CK0RHEG1 type=del size=2141882 2024-09-12T00:09:39.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.508+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=U3NNE9689F84 type=write size=372204 2024-09-12T00:09:39.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.509+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~SYDL08ZS3ZM6.0 size=552947 2024-09-12T00:09:39.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.511+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=SYDL08ZS3ZM6 tag=7R7HHXE6W092 type=write size=1601523 2024-09-12T00:09:39.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.512+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=NPPOY0CCE9LH type=del size=3329088 2024-09-12T00:09:39.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.514+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=C9AVVK918AP5 type=del 2024-09-12T00:09:39.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.516+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~LAT3ZOU24WSA.0 size=533937 2024-09-12T00:09:39.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.516+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=LAT3ZOU24WSA tag=TDOKELXFN5Q7 type=write size=1582513 2024-09-12T00:09:39.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.517+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~7I710DNYFWOI.0 size=494998 2024-09-12T00:09:39.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.519+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=7I710DNYFWOI tag=TZ3O8FJ25VA7 type=write size=1543574 2024-09-12T00:09:39.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.522+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~HHS63R3F2QT8.0 size=484969 2024-09-12T00:09:39.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.522+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=HHS63R3F2QT8 tag=K2FXVH72P5HQ type=write size=1533545 2024-09-12T00:09:39.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.523+0000 7f3dc2c18780 1 < canceled operation key=3WUIB2OMX77J tag=8U3A7KZCOLOU type=write size=131793 2024-09-12T00:09:39.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.526+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=32NBH25FYE17 type=del size=1398933 2024-09-12T00:09:39.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.527+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~RHJCL7KV1J86.0 size=320882 2024-09-12T00:09:39.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.529+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=RHJCL7KV1J86 tag=UD0QK1Y1Y07D type=write size=1369458 2024-09-12T00:09:39.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.530+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=S2QJLSWLHCGX type=write size=611488 2024-09-12T00:09:39.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.531+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=4HADGBXLOOD0 type=del 2024-09-12T00:09:39.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.533+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=JNBDLUUKCK29 type=del size=2243769 2024-09-12T00:09:39.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.534+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~HOTSOKYU3CY4.0 size=499285 2024-09-12T00:09:39.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.536+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=HOTSOKYU3CY4 tag=S4MH9YJGY2GW type=write size=1547861 2024-09-12T00:09:39.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.538+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~63UXVBQ4JNNY.0 size=1048576 2024-09-12T00:09:39.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.539+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~63UXVBQ4JNNY.1 size=1048576 2024-09-12T00:09:39.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.540+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~63UXVBQ4JNNY.2 size=708156 2024-09-12T00:09:39.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.540+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=63UXVBQ4JNNY tag=AYS7DBRIY824 type=write size=3853884 2024-09-12T00:09:39.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.541+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=Z9252N0HS2O2 type=del 2024-09-12T00:09:39.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.543+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~NJR54V4BBDC0.0 size=883573 2024-09-12T00:09:39.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.543+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=NJR54V4BBDC0 tag=W7BK31DJSLKB type=write size=1932149 2024-09-12T00:09:39.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.546+0000 7f3dc2c18780 1 < suggested update operation key=UJDQEIAIRVDW tag=8Y294ORG139K type=write size=77114 2024-09-12T00:09:39.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.548+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~R3V47S25NEGM.0 size=598074 2024-09-12T00:09:39.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.548+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=R3V47S25NEGM tag=4CKV4Z03LUE0 type=write size=1646650 2024-09-12T00:09:39.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.549+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~6MQW9I9X9XCY.0 size=1048576 2024-09-12T00:09:39.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.550+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~6MQW9I9X9XCY.1 size=264759 2024-09-12T00:09:39.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.552+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=6MQW9I9X9XCY tag=5IOGL9QN1M5W type=write size=2361911 2024-09-12T00:09:39.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.554+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=KXDN6OPDEIN5 type=write size=209221 2024-09-12T00:09:39.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.555+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=HKVBGZBMHXEE type=del 2024-09-12T00:09:39.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.557+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~2KDY7B13TBP8.0 size=1048576 2024-09-12T00:09:39.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.558+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~2KDY7B13TBP8.1 size=1003736 2024-09-12T00:09:39.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.558+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=2KDY7B13TBP8 tag=V1AB0R38WE5F type=write size=3100888 2024-09-12T00:09:39.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.559+0000 7f3dc2c18780 1 < completed write operation key=C7ZOCTAR2BEP tag=BLSTM2LHMKBP type=write size=205311 2024-09-12T00:09:39.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.560+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=MSLDCFK3US1Y type=del size=3140411 2024-09-12T00:09:39.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.562+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=EKP2WDFM6PU1 type=del 2024-09-12T00:09:39.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.563+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=NA3V62E79UQG type=del size=350657 2024-09-12T00:09:39.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.564+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=QFA2GTISQ0KJ type=del 2024-09-12T00:09:39.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.566+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~RTY38QDL0L22.0 size=163422 2024-09-12T00:09:39.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.566+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=RTY38QDL0L22 tag=G73QMKNIC9CZ type=write size=1211998 2024-09-12T00:09:39.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.567+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~6PD4REGOQGEP.0 size=634003 2024-09-12T00:09:39.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.569+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=6PD4REGOQGEP tag=5P5CUCHSDAZC type=write size=1682579 2024-09-12T00:09:39.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.570+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=N2Q1K55E6EOO type=del size=3298629 2024-09-12T00:09:39.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.573+0000 7f3dc2c18780 1 < suggested update operation key=V0K5FRKYGJ0K tag=U3NNE9689F84 type=write size=372204 2024-09-12T00:09:39.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.575+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=SHDU47Y9XBWR type=del size=3151798 2024-09-12T00:09:39.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.576+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=NPPOY0CCE9LH type=del 2024-09-12T00:09:39.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.578+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~RJK9JDMG382T.0 size=1048576 2024-09-12T00:09:39.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.579+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~RJK9JDMG382T.1 size=1048576 2024-09-12T00:09:39.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.580+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~RJK9JDMG382T.2 size=92422 2024-09-12T00:09:39.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.580+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=RJK9JDMG382T tag=1P25QR3FEC0P type=write size=3238150 2024-09-12T00:09:39.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.582+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~LAT3ZOU24WSA.0 size=533937 2024-09-12T00:09:39.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.584+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=LAT3ZOU24WSA tag=TDOKELXFN5Q7 type=write size=1582513 2024-09-12T00:09:39.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.585+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=5PF1Z186MEGH type=write size=516768 2024-09-12T00:09:39.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.586+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~HHS63R3F2QT8.0 size=484969 2024-09-12T00:09:39.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.588+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=HHS63R3F2QT8 tag=K2FXVH72P5HQ type=write size=1533545 2024-09-12T00:09:39.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.589+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=I6RU115449Q4 type=del size=2465402 2024-09-12T00:09:39.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.590+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=32NBH25FYE17 type=del 2024-09-12T00:09:39.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.592+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=NV4GJUUES3FY type=write size=1033341 2024-09-12T00:09:39.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.593+0000 7f3dc2c18780 1 < completed write operation key=OGRGDIUO2W8B tag=S2QJLSWLHCGX type=write size=611488 2024-09-12T00:09:39.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.595+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~QCC009N7HS9Y.0 size=1048576 2024-09-12T00:09:39.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.596+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~QCC009N7HS9Y.1 size=636886 2024-09-12T00:09:39.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.596+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=QCC009N7HS9Y tag=LD8W0K09R4AS type=write size=2734038 2024-09-12T00:09:39.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.598+0000 7f3dc2c18780 1 < suggested update operation key=GLAOX3ZNNILD tag=JNBDLUUKCK29 type=del size=2243769 2024-09-12T00:09:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.601+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~GY629MZZLEWZ.0 size=1048576 2024-09-12T00:09:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.602+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~GY629MZZLEWZ.1 size=1000039 2024-09-12T00:09:39.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.602+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=GY629MZZLEWZ tag=60R6HCGM5DNT type=write size=3097191 2024-09-12T00:09:39.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.603+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~63UXVBQ4JNNY.0 size=1048576 2024-09-12T00:09:39.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.604+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~63UXVBQ4JNNY.1 size=1048576 2024-09-12T00:09:39.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.605+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~63UXVBQ4JNNY.2 size=708156 2024-09-12T00:09:39.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.607+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=63UXVBQ4JNNY tag=AYS7DBRIY824 type=write size=3853884 2024-09-12T00:09:39.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.608+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=T89I29NQF59B type=del size=356900 2024-09-12T00:09:39.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.610+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~NJR54V4BBDC0.0 size=883573 2024-09-12T00:09:39.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.612+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=NJR54V4BBDC0 tag=W7BK31DJSLKB type=write size=1932149 2024-09-12T00:09:39.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.613+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=81W30OP98EUW type=del size=3034388 2024-09-12T00:09:39.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.614+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~R3V47S25NEGM.0 size=598074 2024-09-12T00:09:39.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.616+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=R3V47S25NEGM tag=4CKV4Z03LUE0 type=write size=1646650 2024-09-12T00:09:39.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.619+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~9OZ4DQDNZ4EJ.0 size=1048576 2024-09-12T00:09:39.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.620+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~9OZ4DQDNZ4EJ.1 size=163295 2024-09-12T00:09:39.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.620+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=9OZ4DQDNZ4EJ tag=NWBCUZ6JGZE3 type=write size=2260447 2024-09-12T00:09:39.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.623+0000 7f3dc2c18780 1 < suggested update operation key=65DTZR8A5OHF tag=KXDN6OPDEIN5 type=write size=209221 2024-09-12T00:09:39.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.624+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=06R5LH4G539P type=del size=3878910 2024-09-12T00:09:39.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.625+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~2KDY7B13TBP8.0 size=1048576 2024-09-12T00:09:39.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.626+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~2KDY7B13TBP8.1 size=1003736 2024-09-12T00:09:39.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.628+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=2KDY7B13TBP8 tag=V1AB0R38WE5F type=write size=3100888 2024-09-12T00:09:39.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.629+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=4I31YAFW3R5R type=del size=3080480 2024-09-12T00:09:39.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.631+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=MSLDCFK3US1Y type=del 2024-09-12T00:09:39.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.632+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=FW8IIUHMKOB7 type=del size=2357016 2024-09-12T00:09:39.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.633+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=NA3V62E79UQG type=del 2024-09-12T00:09:39.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.635+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=IUVUP7QNS62Z type=del size=1185143 2024-09-12T00:09:39.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.636+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~RTY38QDL0L22.0 size=163422 2024-09-12T00:09:39.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.638+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=RTY38QDL0L22 tag=G73QMKNIC9CZ type=write size=1211998 2024-09-12T00:09:39.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.640+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~VTC24WL8QAXY.0 size=1048576 2024-09-12T00:09:39.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.642+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~VTC24WL8QAXY.1 size=93192 2024-09-12T00:09:39.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.642+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=VTC24WL8QAXY tag=QO1HL8HOBW6C type=write size=2190344 2024-09-12T00:09:39.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.643+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=N2Q1K55E6EOO type=del 2024-09-12T00:09:39.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.644+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=A4A3D6LHJN56 type=del size=1609672 2024-09-12T00:09:39.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.645+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=SHDU47Y9XBWR type=del 2024-09-12T00:09:39.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.646+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=OFGEQKT7MKM0 type=del size=3135156 2024-09-12T00:09:39.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.648+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~RJK9JDMG382T.0 size=1048576 2024-09-12T00:09:39.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.649+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~RJK9JDMG382T.1 size=1048576 2024-09-12T00:09:39.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.650+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~RJK9JDMG382T.2 size=92422 2024-09-12T00:09:39.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.652+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=RJK9JDMG382T tag=1P25QR3FEC0P type=write size=3238150 2024-09-12T00:09:39.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.654+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=AUDO41JIDXZ9 type=del size=1579789 2024-09-12T00:09:39.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.655+0000 7f3dc2c18780 1 < canceled operation key=U2H0A1GZROT7 tag=5PF1Z186MEGH type=write size=516768 2024-09-12T00:09:39.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.657+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~8CJ3IDRRYOPJ.0 size=1048576 2024-09-12T00:09:39.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.658+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~8CJ3IDRRYOPJ.1 size=1048576 2024-09-12T00:09:39.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.659+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~8CJ3IDRRYOPJ.2 size=477956 2024-09-12T00:09:39.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.659+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=8CJ3IDRRYOPJ tag=BE1IOH4L9UDX type=write size=3623684 2024-09-12T00:09:39.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.662+0000 7f3dc2c18780 1 < suggested update operation key=WRBBH64CISJZ tag=I6RU115449Q4 type=del size=2465402 2024-09-12T00:09:39.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.663+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=7G3PK6RHTYY8 type=del size=3845788 2024-09-12T00:09:39.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.665+0000 7f3dc2c18780 -1 < failed to complete operation key=GLAOX3ZNNILD tag=NV4GJUUES3FY type=write size=1033341: (22) Invalid argument 2024-09-12T00:09:39.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.667+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~FBY9QR19IDQ4.0 size=592943 2024-09-12T00:09:39.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.667+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=FBY9QR19IDQ4 tag=5CVUG2KDNY4K type=write size=1641519 2024-09-12T00:09:39.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.668+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~QCC009N7HS9Y.0 size=1048576 2024-09-12T00:09:39.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.669+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~QCC009N7HS9Y.1 size=636886 2024-09-12T00:09:39.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.671+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=QCC009N7HS9Y tag=LD8W0K09R4AS type=write size=2734038 2024-09-12T00:09:39.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.673+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=BO1GVSZ9CT5Q type=write size=985111 2024-09-12T00:09:39.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.674+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~GY629MZZLEWZ.0 size=1048576 2024-09-12T00:09:39.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.675+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~GY629MZZLEWZ.1 size=1000039 2024-09-12T00:09:39.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.677+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=GY629MZZLEWZ tag=60R6HCGM5DNT type=write size=3097191 2024-09-12T00:09:39.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.679+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~8H69W7I7AS8Z.0 size=1048576 2024-09-12T00:09:39.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.681+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~8H69W7I7AS8Z.1 size=1048576 2024-09-12T00:09:39.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.682+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~8H69W7I7AS8Z.2 size=273205 2024-09-12T00:09:39.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.682+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=8H69W7I7AS8Z tag=6WJGL00OPDXN type=write size=3418933 2024-09-12T00:09:39.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.684+0000 7f3dc2c18780 1 < suggested remove operation key=5F0BB9U7Y6ZZ tag=T89I29NQF59B type=del 2024-09-12T00:09:39.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.687+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~1DMHTTN6H3GP.0 size=1048576 2024-09-12T00:09:39.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.688+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~1DMHTTN6H3GP.1 size=220474 2024-09-12T00:09:39.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.688+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=1DMHTTN6H3GP tag=SVN7EUP7V342 type=write size=2317626 2024-09-12T00:09:39.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.689+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=81W30OP98EUW type=del 2024-09-12T00:09:39.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.693+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~67A527Z26XNH.0 size=392962 2024-09-12T00:09:39.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.693+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=67A527Z26XNH tag=PXAUU3408B2G type=write size=1441538 2024-09-12T00:09:39.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.695+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~9OZ4DQDNZ4EJ.0 size=1048576 2024-09-12T00:09:39.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.695+0000 7f3dc2c18780 1 < canceled part key=_multipart_25CF1N8J81Y9.2~9OZ4DQDNZ4EJ.1 size=163295 2024-09-12T00:09:39.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.698+0000 7f3dc2c18780 1 < canceled multipart upload key=25CF1N8J81Y9 upload=9OZ4DQDNZ4EJ tag=NWBCUZ6JGZE3 type=write size=2260447 2024-09-12T00:09:39.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.700+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~XBFBIPOS3NE4.0 size=610601 2024-09-12T00:09:39.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.700+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=XBFBIPOS3NE4 tag=PBQNAIQD6HDA type=write size=1659177 2024-09-12T00:09:39.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.701+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=06R5LH4G539P type=del 2024-09-12T00:09:39.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.703+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=RUUHM2AMF3HW type=del size=2767336 2024-09-12T00:09:39.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.704+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=4I31YAFW3R5R type=del 2024-09-12T00:09:39.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.707+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~G5PZSYGWCX1H.0 size=480229 2024-09-12T00:09:39.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.707+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=G5PZSYGWCX1H tag=9PEK9OATW7W6 type=write size=1528805 2024-09-12T00:09:39.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.709+0000 7f3dc2c18780 1 < suggested update operation key=5BM1TMLRBHTS tag=FW8IIUHMKOB7 type=del size=2357016 2024-09-12T00:09:39.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.712+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~83IRTZYKWDIO.0 size=1048576 2024-09-12T00:09:39.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.713+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~83IRTZYKWDIO.1 size=1048576 2024-09-12T00:09:39.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.714+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~83IRTZYKWDIO.2 size=1044761 2024-09-12T00:09:39.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.714+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=83IRTZYKWDIO tag=7GO3QWRFA5H3 type=write size=4190489 2024-09-12T00:09:39.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.715+0000 7f3dc2c18780 -1 < failed to complete operation key=5F0BB9U7Y6ZZ tag=IUVUP7QNS62Z type=del size=1185143: (22) Invalid argument 2024-09-12T00:09:39.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.717+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~372OC2JR0WT3.0 size=1048576 2024-09-12T00:09:39.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.718+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~372OC2JR0WT3.1 size=1041247 2024-09-12T00:09:39.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.718+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=372OC2JR0WT3 tag=GWSJ7MANT6E7 type=write size=3138399 2024-09-12T00:09:39.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.720+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~VTC24WL8QAXY.0 size=1048576 2024-09-12T00:09:39.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.721+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~VTC24WL8QAXY.1 size=93192 2024-09-12T00:09:39.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.723+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=VTC24WL8QAXY tag=QO1HL8HOBW6C type=write size=2190344 2024-09-12T00:09:39.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.725+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=GWNV0NDVIPDK type=del size=2167734 2024-09-12T00:09:39.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.726+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=A4A3D6LHJN56 type=del 2024-09-12T00:09:39.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.727+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=RC5FUU4SJEKH type=write size=538195 2024-09-12T00:09:39.727 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.729+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=OFGEQKT7MKM0 type=del 2024-09-12T00:09:39.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.730+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=AHXJFHXHWX6D type=del size=542875 2024-09-12T00:09:39.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.733+0000 7f3dc2c18780 1 < suggested update operation key=OGRGDIUO2W8B tag=AUDO41JIDXZ9 type=del size=1579789 2024-09-12T00:09:39.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.734+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=SPSF1JE22BYD type=del size=4024701 2024-09-12T00:09:39.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.735+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~8CJ3IDRRYOPJ.0 size=1048576 2024-09-12T00:09:39.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.736+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~8CJ3IDRRYOPJ.1 size=1048576 2024-09-12T00:09:39.736 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.737+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~8CJ3IDRRYOPJ.2 size=477956 2024-09-12T00:09:39.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.739+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=8CJ3IDRRYOPJ tag=BE1IOH4L9UDX type=write size=3623684 2024-09-12T00:09:39.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.740+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=SYDQ39VB2VKQ type=del size=3802594 2024-09-12T00:09:39.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.742+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=7G3PK6RHTYY8 type=del 2024-09-12T00:09:39.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.744+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~HQFN8CFZH6M4.0 size=26502 2024-09-12T00:09:39.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.744+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=HQFN8CFZH6M4 tag=43BQ8FY1F7OL type=write size=1075078 2024-09-12T00:09:39.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.745+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~FBY9QR19IDQ4.0 size=592943 2024-09-12T00:09:39.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.747+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=FBY9QR19IDQ4 tag=5CVUG2KDNY4K type=write size=1641519 2024-09-12T00:09:39.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.749+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~BEN10W6X2ZX3.0 size=598490 2024-09-12T00:09:39.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.749+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=BEN10W6X2ZX3 tag=0O4ASYAGGKTP type=write size=1647066 2024-09-12T00:09:39.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.751+0000 7f3dc2c18780 -1 < failed to complete operation key=5BM1TMLRBHTS tag=BO1GVSZ9CT5Q type=write size=985111: (22) Invalid argument 2024-09-12T00:09:39.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.753+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~I6XBZ1151WMR.0 size=1048576 2024-09-12T00:09:39.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.754+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~I6XBZ1151WMR.1 size=1039014 2024-09-12T00:09:39.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.754+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=I6XBZ1151WMR tag=UDHV0Z1K5Q9C type=write size=3136166 2024-09-12T00:09:39.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.755+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~8H69W7I7AS8Z.0 size=1048576 2024-09-12T00:09:39.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.756+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~8H69W7I7AS8Z.1 size=1048576 2024-09-12T00:09:39.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.757+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~8H69W7I7AS8Z.2 size=273205 2024-09-12T00:09:39.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.759+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=8H69W7I7AS8Z tag=6WJGL00OPDXN type=write size=3418933 2024-09-12T00:09:39.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.762+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~GP9SL21FQXMS.0 size=1048576 2024-09-12T00:09:39.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.763+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~GP9SL21FQXMS.1 size=1048576 2024-09-12T00:09:39.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.764+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~GP9SL21FQXMS.2 size=982079 2024-09-12T00:09:39.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.764+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=GP9SL21FQXMS tag=BO2MR6ND7QQK type=write size=4127807 2024-09-12T00:09:39.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.765+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~1DMHTTN6H3GP.0 size=1048576 2024-09-12T00:09:39.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.766+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~1DMHTTN6H3GP.1 size=220474 2024-09-12T00:09:39.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.768+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=1DMHTTN6H3GP tag=SVN7EUP7V342 type=write size=2317626 2024-09-12T00:09:39.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.769+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=E82ARQPQIDNH type=write size=258217 2024-09-12T00:09:39.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.770+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~67A527Z26XNH.0 size=392962 2024-09-12T00:09:39.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.772+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=67A527Z26XNH tag=PXAUU3408B2G type=write size=1441538 2024-09-12T00:09:39.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.774+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=WAT73E0TA7QR type=del size=475618 2024-09-12T00:09:39.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.775+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~XBFBIPOS3NE4.0 size=610601 2024-09-12T00:09:39.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.777+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=XBFBIPOS3NE4 tag=PBQNAIQD6HDA type=write size=1659177 2024-09-12T00:09:39.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.778+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=V56XPY29PY9D type=del size=1062203 2024-09-12T00:09:39.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.779+0000 7f3dc2c18780 1 < canceled operation key=XNZNORKYEOPV tag=RUUHM2AMF3HW type=del size=2767336 2024-09-12T00:09:39.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.781+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=MZZUULOWVMKW type=del size=447595 2024-09-12T00:09:39.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.781+0000 7f3dc2c18780 1 < canceled part key=_multipart_0ICU4WV9K1RG.2~G5PZSYGWCX1H.0 size=480229 2024-09-12T00:09:39.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.783+0000 7f3dc2c18780 1 < canceled multipart upload key=0ICU4WV9K1RG upload=G5PZSYGWCX1H tag=9PEK9OATW7W6 type=write size=1528805 2024-09-12T00:09:39.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.785+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~37NW3NQK5VOG.0 size=1048576 2024-09-12T00:09:39.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.786+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~37NW3NQK5VOG.1 size=916970 2024-09-12T00:09:39.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.786+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=37NW3NQK5VOG tag=YBX1VWAQQRR5 type=write size=3014122 2024-09-12T00:09:39.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.787+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~83IRTZYKWDIO.0 size=1048576 2024-09-12T00:09:39.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.788+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~83IRTZYKWDIO.1 size=1048576 2024-09-12T00:09:39.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.789+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~83IRTZYKWDIO.2 size=1044761 2024-09-12T00:09:39.790 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.791+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=83IRTZYKWDIO tag=7GO3QWRFA5H3 type=write size=4190489 2024-09-12T00:09:39.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.792+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=IGYGAM85B8JA type=del size=3343809 2024-09-12T00:09:39.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.794+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~372OC2JR0WT3.0 size=1048576 2024-09-12T00:09:39.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.795+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~372OC2JR0WT3.1 size=1041247 2024-09-12T00:09:39.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.797+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=372OC2JR0WT3 tag=GWSJ7MANT6E7 type=write size=3138399 2024-09-12T00:09:39.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.799+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~9K3ZGZ2OB2ML.0 size=1048576 2024-09-12T00:09:39.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.800+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~9K3ZGZ2OB2ML.1 size=701341 2024-09-12T00:09:39.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.800+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=9K3ZGZ2OB2ML tag=D91UF6TGW2DA type=write size=2798493 2024-09-12T00:09:39.799 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.801+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=GWNV0NDVIPDK type=del 2024-09-12T00:09:39.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.802+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=CK9TDANMHRED type=write size=960912 2024-09-12T00:09:39.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.804+0000 7f3dc2c18780 1 < completed write operation key=5MAV2RJ4E31S tag=RC5FUU4SJEKH type=write size=538195 2024-09-12T00:09:39.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.805+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=WI9KEGOE4MWP type=del size=3507858 2024-09-12T00:09:39.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.806+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=AHXJFHXHWX6D type=del 2024-09-12T00:09:39.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.807+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=BP02932RR1XJ type=del size=3692985 2024-09-12T00:09:39.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.811+0000 7f3dc2c18780 1 < suggested remove operation key=25CF1N8J81Y9 tag=SPSF1JE22BYD type=del 2024-09-12T00:09:39.813 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.815+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~JCLMPRDVH0QD.0 size=1048576 2024-09-12T00:09:39.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.815+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~JCLMPRDVH0QD.1 size=1048576 2024-09-12T00:09:39.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.816+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~JCLMPRDVH0QD.2 size=227318 2024-09-12T00:09:39.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.816+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=JCLMPRDVH0QD tag=13K5XGOKPLMO type=write size=3373046 2024-09-12T00:09:39.816 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.818+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=SYDQ39VB2VKQ type=del 2024-09-12T00:09:39.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.820+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~8RWB7AFQRXTH.0 size=635517 2024-09-12T00:09:39.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.820+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=8RWB7AFQRXTH tag=OU7ZKRK49J32 type=write size=1684093 2024-09-12T00:09:39.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.821+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~HQFN8CFZH6M4.0 size=26502 2024-09-12T00:09:39.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.823+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=HQFN8CFZH6M4 tag=43BQ8FY1F7OL type=write size=1075078 2024-09-12T00:09:39.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.824+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=X7TM43EZY5L1 type=del size=3648500 2024-09-12T00:09:39.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.825+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~BEN10W6X2ZX3.0 size=598490 2024-09-12T00:09:39.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.828+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=BEN10W6X2ZX3 tag=0O4ASYAGGKTP type=write size=1647066 2024-09-12T00:09:39.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.829+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=HVS9CXJ0XDJ9 type=del size=2991744 2024-09-12T00:09:39.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.831+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~I6XBZ1151WMR.0 size=1048576 2024-09-12T00:09:39.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.831+0000 7f3dc2c18780 1 < canceled part key=_multipart_0ICU4WV9K1RG.2~I6XBZ1151WMR.1 size=1039014 2024-09-12T00:09:39.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.833+0000 7f3dc2c18780 1 < canceled multipart upload key=0ICU4WV9K1RG upload=I6XBZ1151WMR tag=UDHV0Z1K5Q9C type=write size=3136166 2024-09-12T00:09:39.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.835+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~2FMROXI4ZPKC.0 size=1048576 2024-09-12T00:09:39.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.836+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~2FMROXI4ZPKC.1 size=1048576 2024-09-12T00:09:39.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.837+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~2FMROXI4ZPKC.2 size=608373 2024-09-12T00:09:39.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.837+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=2FMROXI4ZPKC tag=8LDAUUI3OTFM type=write size=3754101 2024-09-12T00:09:39.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.838+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~GP9SL21FQXMS.0 size=1048576 2024-09-12T00:09:39.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.839+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~GP9SL21FQXMS.1 size=1048576 2024-09-12T00:09:39.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.840+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~GP9SL21FQXMS.2 size=982079 2024-09-12T00:09:39.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.843+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=GP9SL21FQXMS tag=BO2MR6ND7QQK type=write size=4127807 2024-09-12T00:09:39.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.844+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=YKVND21615R6 type=write size=219945 2024-09-12T00:09:39.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.846+0000 7f3dc2c18780 1 < completed write operation key=WRR6LAYIWOCE tag=E82ARQPQIDNH type=write size=258217 2024-09-12T00:09:39.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.847+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=7UQCZYC841XX type=del size=3800120 2024-09-12T00:09:39.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.849+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=WAT73E0TA7QR type=del 2024-09-12T00:09:39.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.850+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=31RJVXE6K2U2 type=del size=2055309 2024-09-12T00:09:39.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.851+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=V56XPY29PY9D type=del 2024-09-12T00:09:39.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.853+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=ADLS7U1NX0ZU type=del size=1638151 2024-09-12T00:09:39.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.854+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=MZZUULOWVMKW type=del 2024-09-12T00:09:39.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.856+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=V482OT2VYB28 type=del size=1899392 2024-09-12T00:09:39.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.857+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~37NW3NQK5VOG.0 size=1048576 2024-09-12T00:09:39.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.859+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~37NW3NQK5VOG.1 size=916970 2024-09-12T00:09:39.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.861+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=37NW3NQK5VOG tag=YBX1VWAQQRR5 type=write size=3014122 2024-09-12T00:09:39.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.864+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~96CJTOLROJH0.0 size=1048576 2024-09-12T00:09:39.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.865+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~96CJTOLROJH0.1 size=584453 2024-09-12T00:09:39.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.865+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=96CJTOLROJH0 tag=SB37GO6EJAX4 type=write size=2681605 2024-09-12T00:09:39.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.866+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=IGYGAM85B8JA type=del 2024-09-12T00:09:39.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.869+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~0N4X0ACX7KF1.0 size=1048576 2024-09-12T00:09:39.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.870+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~0N4X0ACX7KF1.1 size=812964 2024-09-12T00:09:39.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.870+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=0N4X0ACX7KF1 tag=UCL9YHS17LD3 type=write size=2910116 2024-09-12T00:09:39.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.871+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~9K3ZGZ2OB2ML.0 size=1048576 2024-09-12T00:09:39.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.873+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~9K3ZGZ2OB2ML.1 size=701341 2024-09-12T00:09:39.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.875+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=9K3ZGZ2OB2ML tag=D91UF6TGW2DA type=write size=2798493 2024-09-12T00:09:39.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.877+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~UUF04W3N7T4T.0 size=1048576 2024-09-12T00:09:39.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.878+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~UUF04W3N7T4T.1 size=520696 2024-09-12T00:09:39.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.878+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=UUF04W3N7T4T tag=1LWH3APR7GQ4 type=write size=2617848 2024-09-12T00:09:39.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.879+0000 7f3dc2c18780 1 < completed write operation key=Y40G8SLO6AVH tag=CK9TDANMHRED type=write size=960912 2024-09-12T00:09:39.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.881+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=2B02OTT7Z55A type=del size=4026411 2024-09-12T00:09:39.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.882+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=WI9KEGOE4MWP type=del 2024-09-12T00:09:39.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.884+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~X696MWMGD62M.0 size=1048576 2024-09-12T00:09:39.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.885+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~X696MWMGD62M.1 size=450462 2024-09-12T00:09:39.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.885+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=X696MWMGD62M tag=YAAOZQ3SULWJ type=write size=2547614 2024-09-12T00:09:39.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.886+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=BP02932RR1XJ type=del 2024-09-12T00:09:39.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.887+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=II41BTG3HT0E type=write size=672988 2024-09-12T00:09:39.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.889+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~JCLMPRDVH0QD.0 size=1048576 2024-09-12T00:09:39.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.890+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~JCLMPRDVH0QD.1 size=1048576 2024-09-12T00:09:39.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.891+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~JCLMPRDVH0QD.2 size=227318 2024-09-12T00:09:39.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.893+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=JCLMPRDVH0QD tag=13K5XGOKPLMO type=write size=3373046 2024-09-12T00:09:39.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.894+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=1G16JN76YJIK type=write size=925998 2024-09-12T00:09:39.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.896+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~8RWB7AFQRXTH.0 size=635517 2024-09-12T00:09:39.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.898+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=8RWB7AFQRXTH tag=OU7ZKRK49J32 type=write size=1684093 2024-09-12T00:09:39.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.900+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~73KDBAC06F0S.0 size=1048576 2024-09-12T00:09:39.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.901+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~73KDBAC06F0S.1 size=1048576 2024-09-12T00:09:39.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.903+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~73KDBAC06F0S.2 size=692388 2024-09-12T00:09:39.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.903+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=73KDBAC06F0S tag=VS7QKHSWSEE7 type=write size=3838116 2024-09-12T00:09:39.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.904+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=X7TM43EZY5L1 type=del 2024-09-12T00:09:39.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.905+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=WU4WTPRZCH5A type=del size=3439219 2024-09-12T00:09:39.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.906+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=HVS9CXJ0XDJ9 type=del 2024-09-12T00:09:39.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.908+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=CNUKCQM8DCTN type=write size=787347 2024-09-12T00:09:39.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.909+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~2FMROXI4ZPKC.0 size=1048576 2024-09-12T00:09:39.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.910+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~2FMROXI4ZPKC.1 size=1048576 2024-09-12T00:09:39.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.911+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~2FMROXI4ZPKC.2 size=608373 2024-09-12T00:09:39.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.913+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=2FMROXI4ZPKC tag=8LDAUUI3OTFM type=write size=3754101 2024-09-12T00:09:39.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.915+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~QZMXOHE4TIXB.0 size=1048576 2024-09-12T00:09:39.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.916+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~QZMXOHE4TIXB.1 size=1048576 2024-09-12T00:09:39.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.917+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~QZMXOHE4TIXB.2 size=803793 2024-09-12T00:09:39.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.917+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=QZMXOHE4TIXB tag=HB66KZXYMBOJ type=write size=3949521 2024-09-12T00:09:39.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.920+0000 7f3dc2c18780 1 < suggested remove operation key=25CF1N8J81Y9 tag=YKVND21615R6 type=write 2024-09-12T00:09:39.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.921+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=5CDG40WTONGT type=del size=1146478 2024-09-12T00:09:39.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.922+0000 7f3dc2c18780 1 < canceled operation key=OGRGDIUO2W8B tag=7UQCZYC841XX type=del size=3800120 2024-09-12T00:09:39.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.925+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~T7VI6ZJ0IJET.0 size=1048576 2024-09-12T00:09:39.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.926+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~T7VI6ZJ0IJET.1 size=296878 2024-09-12T00:09:39.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.926+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=T7VI6ZJ0IJET tag=8WPNCU1QKLW7 type=write size=2394030 2024-09-12T00:09:39.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.927+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=31RJVXE6K2U2 type=del 2024-09-12T00:09:39.928 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.929+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~6EHZ8SUR4OZR.0 size=1048576 2024-09-12T00:09:39.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.932+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~6EHZ8SUR4OZR.1 size=514734 2024-09-12T00:09:39.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.932+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=6EHZ8SUR4OZR tag=7LGQ36BDEHAQ type=write size=2611886 2024-09-12T00:09:39.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.934+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=ADLS7U1NX0ZU type=del 2024-09-12T00:09:39.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.938+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~05ZM1S0IQOE0.0 size=1048576 2024-09-12T00:09:39.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.939+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~05ZM1S0IQOE0.1 size=241467 2024-09-12T00:09:39.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.939+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=05ZM1S0IQOE0 tag=60EQVKWH274Q type=write size=2338619 2024-09-12T00:09:39.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.940+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=V482OT2VYB28 type=del 2024-09-12T00:09:39.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.943+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~KIWKYSY1FAP7.0 size=190429 2024-09-12T00:09:39.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.943+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=KIWKYSY1FAP7 tag=1V9SUWEMQ2QW type=write size=1239005 2024-09-12T00:09:39.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.944+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~96CJTOLROJH0.0 size=1048576 2024-09-12T00:09:39.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.945+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~96CJTOLROJH0.1 size=584453 2024-09-12T00:09:39.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.947+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=96CJTOLROJH0 tag=SB37GO6EJAX4 type=write size=2681605 2024-09-12T00:09:39.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.948+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=3IVPJY42R672 type=del size=3024446 2024-09-12T00:09:39.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.949+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~0N4X0ACX7KF1.0 size=1048576 2024-09-12T00:09:39.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.950+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~0N4X0ACX7KF1.1 size=812964 2024-09-12T00:09:39.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.952+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=0N4X0ACX7KF1 tag=UCL9YHS17LD3 type=write size=2910116 2024-09-12T00:09:39.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.953+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=AZBSNSWAT8ER type=write size=401731 2024-09-12T00:09:39.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.955+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~UUF04W3N7T4T.0 size=1048576 2024-09-12T00:09:39.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.956+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~UUF04W3N7T4T.1 size=520696 2024-09-12T00:09:39.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.958+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=UUF04W3N7T4T tag=1LWH3APR7GQ4 type=write size=2617848 2024-09-12T00:09:39.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.960+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~2LXCO8128D41.0 size=611799 2024-09-12T00:09:39.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.960+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=2LXCO8128D41 tag=3HZEHTHUXLSV type=write size=1660375 2024-09-12T00:09:39.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.962+0000 7f3dc2c18780 1 < suggested remove operation key=KDHO7IEGICDA tag=2B02OTT7Z55A type=del 2024-09-12T00:09:39.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.964+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=OF0AVBHXG2FM type=write size=692091 2024-09-12T00:09:39.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.965+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~X696MWMGD62M.0 size=1048576 2024-09-12T00:09:39.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.966+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~X696MWMGD62M.1 size=450462 2024-09-12T00:09:39.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.968+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=X696MWMGD62M tag=YAAOZQ3SULWJ type=write size=2547614 2024-09-12T00:09:39.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.970+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~DQ0R3X46IG1B.0 size=1048576 2024-09-12T00:09:39.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.971+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~DQ0R3X46IG1B.1 size=42568 2024-09-12T00:09:39.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.971+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=DQ0R3X46IG1B tag=0242N2DCIJRX type=write size=2139720 2024-09-12T00:09:39.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.973+0000 7f3dc2c18780 1 < completed write operation key=GP3MLWX9586T tag=II41BTG3HT0E type=write size=672988 2024-09-12T00:09:39.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.974+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=6DLPW8JCCCU1 type=del size=3225954 2024-09-12T00:09:39.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.975+0000 7f3dc2c18780 1 < completed write operation key=5F0BB9U7Y6ZZ tag=1G16JN76YJIK type=write size=925998 2024-09-12T00:09:39.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.978+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~1PI2QC2CFBR7.0 size=1048576 2024-09-12T00:09:39.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.979+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~1PI2QC2CFBR7.1 size=71453 2024-09-12T00:09:39.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.979+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=1PI2QC2CFBR7 tag=CI3LKGJ58ZL4 type=write size=2168605 2024-09-12T00:09:39.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.980+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~73KDBAC06F0S.0 size=1048576 2024-09-12T00:09:39.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.981+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~73KDBAC06F0S.1 size=1048576 2024-09-12T00:09:39.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.982+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~73KDBAC06F0S.2 size=692388 2024-09-12T00:09:39.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.985+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=73KDBAC06F0S tag=VS7QKHSWSEE7 type=write size=3838116 2024-09-12T00:09:39.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.987+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~LCIYBKRHULXK.0 size=767947 2024-09-12T00:09:39.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.987+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=LCIYBKRHULXK tag=GYLMZ7GNRT0F type=write size=1816523 2024-09-12T00:09:39.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.988+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=WU4WTPRZCH5A type=del 2024-09-12T00:09:39.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.989+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=NUYD0QJZ0118 type=write size=160551 2024-09-12T00:09:39.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.991+0000 7f3dc2c18780 1 < canceled operation key=GP3MLWX9586T tag=CNUKCQM8DCTN type=write size=787347 2024-09-12T00:09:39.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.993+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~F8GB83X6C78R.0 size=410329 2024-09-12T00:09:39.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.993+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=F8GB83X6C78R tag=3BDRVHJ80ICD type=write size=1458905 2024-09-12T00:09:39.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.995+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~QZMXOHE4TIXB.0 size=1048576 2024-09-12T00:09:39.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.996+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~QZMXOHE4TIXB.1 size=1048576 2024-09-12T00:09:39.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.996+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~QZMXOHE4TIXB.2 size=803793 2024-09-12T00:09:39.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:39.999+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=QZMXOHE4TIXB tag=HB66KZXYMBOJ type=write size=3949521 2024-09-12T00:09:39.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.000+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=RIHQ9LOX0EDO type=del size=3026927 2024-09-12T00:09:39.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.001+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=5CDG40WTONGT type=del 2024-09-12T00:09:40.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.002+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=1YG7FHZ96400 type=del size=2525699 2024-09-12T00:09:40.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.004+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~T7VI6ZJ0IJET.0 size=1048576 2024-09-12T00:09:40.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.005+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~T7VI6ZJ0IJET.1 size=296878 2024-09-12T00:09:40.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.007+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=T7VI6ZJ0IJET tag=8WPNCU1QKLW7 type=write size=2394030 2024-09-12T00:09:40.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.008+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=1MDBUH2HYXFV type=del size=3908201 2024-09-12T00:09:40.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.009+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~6EHZ8SUR4OZR.0 size=1048576 2024-09-12T00:09:40.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.010+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~6EHZ8SUR4OZR.1 size=514734 2024-09-12T00:09:40.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.015+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=6EHZ8SUR4OZR tag=7LGQ36BDEHAQ type=write size=2611886 2024-09-12T00:09:40.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.017+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=E4ZS5Y16HU4T type=del size=345666 2024-09-12T00:09:40.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.020+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~05ZM1S0IQOE0.0 size=1048576 2024-09-12T00:09:40.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.021+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~05ZM1S0IQOE0.1 size=241467 2024-09-12T00:09:40.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.023+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=05ZM1S0IQOE0 tag=60EQVKWH274Q type=write size=2338619 2024-09-12T00:09:40.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.024+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=B2NMDJ6XTNXV type=del size=3374933 2024-09-12T00:09:40.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.025+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~KIWKYSY1FAP7.0 size=190429 2024-09-12T00:09:40.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.027+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=KIWKYSY1FAP7 tag=1V9SUWEMQ2QW type=write size=1239005 2024-09-12T00:09:40.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.029+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~PGLCBCW2G76F.0 size=279914 2024-09-12T00:09:40.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.029+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=PGLCBCW2G76F tag=NUZLYTT4GEUO type=write size=1328490 2024-09-12T00:09:40.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.031+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=3IVPJY42R672 type=del 2024-09-12T00:09:40.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.032+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=LHNF6LXRXWJF type=del size=2597292 2024-09-12T00:09:40.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.034+0000 7f3dc2c18780 1 < suggested remove operation key=65DTZR8A5OHF tag=AZBSNSWAT8ER type=write 2024-09-12T00:09:40.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.035+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=18RYY77QSL8T type=del size=1743543 2024-09-12T00:09:40.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.036+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~2LXCO8128D41.0 size=611799 2024-09-12T00:09:40.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.038+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=2LXCO8128D41 tag=3HZEHTHUXLSV type=write size=1660375 2024-09-12T00:09:40.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.039+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=4IEEVLQ27TIZ type=write size=569738 2024-09-12T00:09:40.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.041+0000 7f3dc2c18780 1 < completed write operation key=U2H0A1GZROT7 tag=OF0AVBHXG2FM type=write size=692091 2024-09-12T00:09:40.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.042+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=CJ328YKN2GKE type=write size=44602 2024-09-12T00:09:40.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.043+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~DQ0R3X46IG1B.0 size=1048576 2024-09-12T00:09:40.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.044+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~DQ0R3X46IG1B.1 size=42568 2024-09-12T00:09:40.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.046+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=DQ0R3X46IG1B tag=0242N2DCIJRX type=write size=2139720 2024-09-12T00:09:40.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.047+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=RF1VZIDZYQ0G type=del size=3620923 2024-09-12T00:09:40.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.049+0000 7f3dc2c18780 1 < canceled operation key=V0K5FRKYGJ0K tag=6DLPW8JCCCU1 type=del size=3225954 2024-09-12T00:09:40.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.051+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~OOV0JR38OE7M.0 size=1048576 2024-09-12T00:09:40.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.052+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~OOV0JR38OE7M.1 size=1048576 2024-09-12T00:09:40.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.053+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~OOV0JR38OE7M.2 size=549788 2024-09-12T00:09:40.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.053+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=OOV0JR38OE7M tag=FI9H51VTKF54 type=write size=3695516 2024-09-12T00:09:40.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.056+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~1PI2QC2CFBR7.0 size=1048576 2024-09-12T00:09:40.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.057+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~1PI2QC2CFBR7.1 size=71453 2024-09-12T00:09:40.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.059+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=1PI2QC2CFBR7 tag=CI3LKGJ58ZL4 type=write size=2168605 2024-09-12T00:09:40.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.060+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=I38KXIOE5RFY type=del size=41603 2024-09-12T00:09:40.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.062+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~LCIYBKRHULXK.0 size=767947 2024-09-12T00:09:40.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.064+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=LCIYBKRHULXK tag=GYLMZ7GNRT0F type=write size=1816523 2024-09-12T00:09:40.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.065+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=TD9V890VGH41 type=del size=2986513 2024-09-12T00:09:40.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.066+0000 7f3dc2c18780 1 < completed write operation key=KQWXE62PF5F7 tag=NUYD0QJZ0118 type=write size=160551 2024-09-12T00:09:40.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.069+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~9AI0UA10XWBA.0 size=1048576 2024-09-12T00:09:40.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.070+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~9AI0UA10XWBA.1 size=565299 2024-09-12T00:09:40.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.070+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=9AI0UA10XWBA tag=74QFFTFRJ84G type=write size=2662451 2024-09-12T00:09:40.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.071+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~F8GB83X6C78R.0 size=410329 2024-09-12T00:09:40.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.073+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=F8GB83X6C78R tag=3BDRVHJ80ICD type=write size=1458905 2024-09-12T00:09:40.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.075+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=ABOXPNNIV8AG type=del size=4135208 2024-09-12T00:09:40.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.076+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=RIHQ9LOX0EDO type=del 2024-09-12T00:09:40.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.079+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~3L26HZEIOUTE.0 size=1048576 2024-09-12T00:09:40.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.080+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~3L26HZEIOUTE.1 size=1048576 2024-09-12T00:09:40.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.081+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~3L26HZEIOUTE.2 size=451184 2024-09-12T00:09:40.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.081+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=3L26HZEIOUTE tag=3ECL2CCXDK3B type=write size=3596912 2024-09-12T00:09:40.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.082+0000 7f3dc2c18780 1 < canceled operation key=TSL3IDD0EDT0 tag=1YG7FHZ96400 type=del size=2525699 2024-09-12T00:09:40.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.084+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~XBFCV557SNAH.0 size=544070 2024-09-12T00:09:40.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.084+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=XBFCV557SNAH tag=M745EBWZQZTW type=write size=1592646 2024-09-12T00:09:40.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.086+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=1MDBUH2HYXFV type=del 2024-09-12T00:09:40.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.087+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=BJEPV09RK6S9 type=del size=1781362 2024-09-12T00:09:40.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.090+0000 7f3dc2c18780 1 < suggested update operation key=A4O7JFS2ULY0 tag=E4ZS5Y16HU4T type=del size=345666 2024-09-12T00:09:40.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.091+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=7RD49APAD9FU type=del size=4128887 2024-09-12T00:09:40.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.092+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=B2NMDJ6XTNXV type=del 2024-09-12T00:09:40.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.094+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~OJ7HZ94A4SLL.0 size=1048576 2024-09-12T00:09:40.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.096+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~OJ7HZ94A4SLL.1 size=326193 2024-09-12T00:09:40.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.096+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=OJ7HZ94A4SLL tag=GACMB998AMZK type=write size=2423345 2024-09-12T00:09:40.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.097+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~PGLCBCW2G76F.0 size=279914 2024-09-12T00:09:40.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.099+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=PGLCBCW2G76F tag=NUZLYTT4GEUO type=write size=1328490 2024-09-12T00:09:40.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.100+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=ES1E354AAUWA type=write size=778119 2024-09-12T00:09:40.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.102+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=LHNF6LXRXWJF type=del 2024-09-12T00:09:40.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.103+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=1BIZI9MMJN34 type=del size=1604647 2024-09-12T00:09:40.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.104+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=18RYY77QSL8T type=del 2024-09-12T00:09:40.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.107+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~SPAKHOZ4OZSL.0 size=1048576 2024-09-12T00:09:40.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.108+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~SPAKHOZ4OZSL.1 size=1048576 2024-09-12T00:09:40.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.109+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~SPAKHOZ4OZSL.2 size=667301 2024-09-12T00:09:40.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.109+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=SPAKHOZ4OZSL tag=208GFS12WIG6 type=write size=3813029 2024-09-12T00:09:40.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.110+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=4IEEVLQ27TIZ type=write size=569738 2024-09-12T00:09:40.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.113+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~2KSU06QSY743.0 size=1048576 2024-09-12T00:09:40.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.114+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~2KSU06QSY743.1 size=1048576 2024-09-12T00:09:40.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.115+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~2KSU06QSY743.2 size=54785 2024-09-12T00:09:40.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.115+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=2KSU06QSY743 tag=A2WBOWZAVU0V type=write size=3200513 2024-09-12T00:09:40.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.116+0000 7f3dc2c18780 -1 < failed to complete operation key=A4O7JFS2ULY0 tag=CJ328YKN2GKE type=write size=44602: (22) Invalid argument 2024-09-12T00:09:40.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.117+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=Q9S0OSW1B1MN type=del size=2131946 2024-09-12T00:09:40.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.119+0000 7f3dc2c18780 1 < suggested remove operation key=415OYT4ML329 tag=RF1VZIDZYQ0G type=del 2024-09-12T00:09:40.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.121+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~NXILR9QHIFFD.0 size=18919 2024-09-12T00:09:40.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.121+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=NXILR9QHIFFD tag=CYIHYIY2L0PN type=write size=1067495 2024-09-12T00:09:40.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.123+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~OOV0JR38OE7M.0 size=1048576 2024-09-12T00:09:40.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.124+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~OOV0JR38OE7M.1 size=1048576 2024-09-12T00:09:40.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.124+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~OOV0JR38OE7M.2 size=549788 2024-09-12T00:09:40.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.126+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=OOV0JR38OE7M tag=FI9H51VTKF54 type=write size=3695516 2024-09-12T00:09:40.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.129+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~PT32T8FZQ0S0.0 size=1048576 2024-09-12T00:09:40.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.130+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~PT32T8FZQ0S0.1 size=1048576 2024-09-12T00:09:40.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.131+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~PT32T8FZQ0S0.2 size=344019 2024-09-12T00:09:40.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.131+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=PT32T8FZQ0S0 tag=SKN8ELDG7KVW type=write size=3489747 2024-09-12T00:09:40.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.132+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=I38KXIOE5RFY type=del 2024-09-12T00:09:40.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.133+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=WJUQHTOGHC7W type=del size=3631207 2024-09-12T00:09:40.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.136+0000 7f3dc2c18780 1 < suggested update operation key=25CF1N8J81Y9 tag=TD9V890VGH41 type=del size=2986513 2024-09-12T00:09:40.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.137+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=U04J4GME71VR type=del size=1040206 2024-09-12T00:09:40.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.137+0000 7f3dc2c18780 1 < canceled part key=_multipart_25CF1N8J81Y9.2~9AI0UA10XWBA.0 size=1048576 2024-09-12T00:09:40.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.138+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~9AI0UA10XWBA.1 size=565299 2024-09-12T00:09:40.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.140+0000 7f3dc2c18780 1 < canceled multipart upload key=25CF1N8J81Y9 upload=9AI0UA10XWBA tag=74QFFTFRJ84G type=write size=2662451 2024-09-12T00:09:40.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.142+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~W3UU0R23OLLO.0 size=146104 2024-09-12T00:09:40.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.142+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=W3UU0R23OLLO tag=XPTEQBMQLK8D type=write size=1194680 2024-09-12T00:09:40.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.144+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=ABOXPNNIV8AG type=del 2024-09-12T00:09:40.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.145+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=YVARMKROEKB5 type=write size=880716 2024-09-12T00:09:40.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.146+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~3L26HZEIOUTE.0 size=1048576 2024-09-12T00:09:40.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.147+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~3L26HZEIOUTE.1 size=1048576 2024-09-12T00:09:40.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.148+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~3L26HZEIOUTE.2 size=451184 2024-09-12T00:09:40.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.150+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=3L26HZEIOUTE tag=3ECL2CCXDK3B type=write size=3596912 2024-09-12T00:09:40.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.152+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=JTZRKKKXRSEZ type=write size=440175 2024-09-12T00:09:40.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.153+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~XBFCV557SNAH.0 size=544070 2024-09-12T00:09:40.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.155+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=XBFCV557SNAH tag=M745EBWZQZTW type=write size=1592646 2024-09-12T00:09:40.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.156+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=JVDOB75G54IA type=write size=403892 2024-09-12T00:09:40.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.159+0000 7f3dc2c18780 1 < suggested remove operation key=L9C014T8YLNV tag=BJEPV09RK6S9 type=del 2024-09-12T00:09:40.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.161+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~BEQ4UVMWQG3S.0 size=1048576 2024-09-12T00:09:40.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.163+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~BEQ4UVMWQG3S.1 size=1048576 2024-09-12T00:09:40.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.164+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~BEQ4UVMWQG3S.2 size=933386 2024-09-12T00:09:40.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.164+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=BEQ4UVMWQG3S tag=HZ496TNFHOQQ type=write size=4079114 2024-09-12T00:09:40.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.165+0000 7f3dc2c18780 -1 < failed to complete operation key=415OYT4ML329 tag=7RD49APAD9FU type=del size=4128887: (22) Invalid argument 2024-09-12T00:09:40.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.168+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~XMLBZ0WWGFUA.0 size=1048576 2024-09-12T00:09:40.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.169+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~XMLBZ0WWGFUA.1 size=685682 2024-09-12T00:09:40.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.169+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=XMLBZ0WWGFUA tag=ROYXQFEM02GL type=write size=2782834 2024-09-12T00:09:40.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.170+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~OJ7HZ94A4SLL.0 size=1048576 2024-09-12T00:09:40.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.171+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~OJ7HZ94A4SLL.1 size=326193 2024-09-12T00:09:40.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.175+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=OJ7HZ94A4SLL tag=GACMB998AMZK type=write size=2423345 2024-09-12T00:09:40.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.178+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=S0W8TLLXHNR0 type=write size=403600 2024-09-12T00:09:40.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.178+0000 7f3dc2c18780 -1 < no bi entry to suggest for operation key=L9C014T8YLNV tag=ES1E354AAUWA type=write size=778119: (2) No such file or directory 2024-09-12T00:09:40.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.180+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=UOCD9VZN085T type=del size=1938438 2024-09-12T00:09:40.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.182+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=1BIZI9MMJN34 type=del 2024-09-12T00:09:40.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.184+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~BMK2E7NAGPAK.0 size=1048576 2024-09-12T00:09:40.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.185+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~BMK2E7NAGPAK.1 size=1048576 2024-09-12T00:09:40.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.186+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~BMK2E7NAGPAK.2 size=978829 2024-09-12T00:09:40.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.186+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=BMK2E7NAGPAK tag=QZHDYF7ZT56V type=write size=4124557 2024-09-12T00:09:40.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.187+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~SPAKHOZ4OZSL.0 size=1048576 2024-09-12T00:09:40.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.188+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~SPAKHOZ4OZSL.1 size=1048576 2024-09-12T00:09:40.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.189+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~SPAKHOZ4OZSL.2 size=667301 2024-09-12T00:09:40.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.191+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=SPAKHOZ4OZSL tag=208GFS12WIG6 type=write size=3813029 2024-09-12T00:09:40.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.194+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~QA0XF6A6YCG6.0 size=1048576 2024-09-12T00:09:40.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.195+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~QA0XF6A6YCG6.1 size=874143 2024-09-12T00:09:40.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.195+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=QA0XF6A6YCG6 tag=RKD0BDGNG8OB type=write size=2971295 2024-09-12T00:09:40.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.195+0000 7f3dc2c18780 1 < canceled part key=_multipart_7JVCFTM2QMGY.2~2KSU06QSY743.0 size=1048576 2024-09-12T00:09:40.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.196+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~2KSU06QSY743.1 size=1048576 2024-09-12T00:09:40.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.197+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~2KSU06QSY743.2 size=54785 2024-09-12T00:09:40.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.199+0000 7f3dc2c18780 1 < canceled multipart upload key=7JVCFTM2QMGY upload=2KSU06QSY743 tag=A2WBOWZAVU0V type=write size=3200513 2024-09-12T00:09:40.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.200+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=MVE60XPRMP25 type=del size=3441439 2024-09-12T00:09:40.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.203+0000 7f3dc2c18780 1 < suggested remove operation key=KDHO7IEGICDA tag=Q9S0OSW1B1MN type=del 2024-09-12T00:09:40.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.204+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=4YFWABSX72Y0 type=del size=2858776 2024-09-12T00:09:40.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.204+0000 7f3dc2c18780 1 < canceled part key=_multipart_XNZNORKYEOPV.2~NXILR9QHIFFD.0 size=18919 2024-09-12T00:09:40.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.206+0000 7f3dc2c18780 1 < canceled multipart upload key=XNZNORKYEOPV upload=NXILR9QHIFFD tag=CYIHYIY2L0PN type=write size=1067495 2024-09-12T00:09:40.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.207+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=3W9VH6TY4IU9 type=del size=2937334 2024-09-12T00:09:40.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.208+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~PT32T8FZQ0S0.0 size=1048576 2024-09-12T00:09:40.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.209+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~PT32T8FZQ0S0.1 size=1048576 2024-09-12T00:09:40.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.210+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~PT32T8FZQ0S0.2 size=344019 2024-09-12T00:09:40.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.212+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=PT32T8FZQ0S0 tag=SKN8ELDG7KVW type=write size=3489747 2024-09-12T00:09:40.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.214+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=QQGI7X3NE8DX type=del size=2511114 2024-09-12T00:09:40.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.215+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=WJUQHTOGHC7W type=del 2024-09-12T00:09:40.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.216+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=HBX2CVEKUIOF type=del size=945720 2024-09-12T00:09:40.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.218+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=U04J4GME71VR type=del size=1040206 2024-09-12T00:09:40.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.220+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=TPQVDEY3SVO9 type=del size=1339617 2024-09-12T00:09:40.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.221+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~W3UU0R23OLLO.0 size=146104 2024-09-12T00:09:40.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.223+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=W3UU0R23OLLO tag=XPTEQBMQLK8D type=write size=1194680 2024-09-12T00:09:40.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.225+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~YLGZTSKGA873.0 size=933182 2024-09-12T00:09:40.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.225+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=YLGZTSKGA873 tag=0HHCFRVLQUS3 type=write size=1981758 2024-09-12T00:09:40.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.226+0000 7f3dc2c18780 1 < completed write operation key=7JVCFTM2QMGY tag=YVARMKROEKB5 type=write size=880716 2024-09-12T00:09:40.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.229+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~08TSHQKNSI1T.0 size=1048576 2024-09-12T00:09:40.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.230+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~08TSHQKNSI1T.1 size=1048576 2024-09-12T00:09:40.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.231+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~08TSHQKNSI1T.2 size=818508 2024-09-12T00:09:40.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.231+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=08TSHQKNSI1T tag=WDMGJL29QQ9A type=write size=3964236 2024-09-12T00:09:40.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.232+0000 7f3dc2c18780 1 < canceled operation key=U2H0A1GZROT7 tag=JTZRKKKXRSEZ type=write size=440175 2024-09-12T00:09:40.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.234+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~7JMFJGZ0WATG.0 size=1048576 2024-09-12T00:09:40.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.235+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~7JMFJGZ0WATG.1 size=1048576 2024-09-12T00:09:40.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.236+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~7JMFJGZ0WATG.2 size=550165 2024-09-12T00:09:40.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.236+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=7JMFJGZ0WATG tag=ODIFPM3TALZI type=write size=3695893 2024-09-12T00:09:40.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.237+0000 7f3dc2c18780 1 < completed write operation key=WRBBH64CISJZ tag=JVDOB75G54IA type=write size=403892 2024-09-12T00:09:40.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.240+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~8TFBWQ3BFXYI.0 size=1048576 2024-09-12T00:09:40.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.241+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~8TFBWQ3BFXYI.1 size=1048576 2024-09-12T00:09:40.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.242+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~8TFBWQ3BFXYI.2 size=27754 2024-09-12T00:09:40.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.242+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=8TFBWQ3BFXYI tag=9EZD9DCZZ3EL type=write size=3173482 2024-09-12T00:09:40.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.243+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~BEQ4UVMWQG3S.0 size=1048576 2024-09-12T00:09:40.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.244+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~BEQ4UVMWQG3S.1 size=1048576 2024-09-12T00:09:40.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.245+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~BEQ4UVMWQG3S.2 size=933386 2024-09-12T00:09:40.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.248+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=BEQ4UVMWQG3S tag=HZ496TNFHOQQ type=write size=4079114 2024-09-12T00:09:40.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.249+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=T4LF0DGXKH3X type=del size=1558989 2024-09-12T00:09:40.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.250+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~XMLBZ0WWGFUA.0 size=1048576 2024-09-12T00:09:40.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.251+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~XMLBZ0WWGFUA.1 size=685682 2024-09-12T00:09:40.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.253+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=XMLBZ0WWGFUA tag=ROYXQFEM02GL type=write size=2782834 2024-09-12T00:09:40.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.255+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=80VUHUHXEK3E type=del size=2976429 2024-09-12T00:09:40.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.256+0000 7f3dc2c18780 1 < completed write operation key=C0JT46SGECP0 tag=S0W8TLLXHNR0 type=write size=403600 2024-09-12T00:09:40.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.257+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=YGUJGKSGXPC9 type=write size=922416 2024-09-12T00:09:40.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.259+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=UOCD9VZN085T type=del 2024-09-12T00:09:40.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.261+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~EA26L15P5GT0.0 size=1048576 2024-09-12T00:09:40.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.262+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~EA26L15P5GT0.1 size=1048576 2024-09-12T00:09:40.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.263+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~EA26L15P5GT0.2 size=482780 2024-09-12T00:09:40.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.263+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=EA26L15P5GT0 tag=6GTXZ8RTP3WS type=write size=3628508 2024-09-12T00:09:40.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.265+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~BMK2E7NAGPAK.0 size=1048576 2024-09-12T00:09:40.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.265+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~BMK2E7NAGPAK.1 size=1048576 2024-09-12T00:09:40.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.266+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~BMK2E7NAGPAK.2 size=978829 2024-09-12T00:09:40.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.269+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=BMK2E7NAGPAK tag=QZHDYF7ZT56V type=write size=4124557 2024-09-12T00:09:40.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.270+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=EOZS3AWA3QY2 type=del size=1866811 2024-09-12T00:09:40.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.272+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~QA0XF6A6YCG6.0 size=1048576 2024-09-12T00:09:40.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.273+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~QA0XF6A6YCG6.1 size=874143 2024-09-12T00:09:40.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.275+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=QA0XF6A6YCG6 tag=RKD0BDGNG8OB type=write size=2971295 2024-09-12T00:09:40.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.276+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=WUBKRR2XZQVX type=write size=915745 2024-09-12T00:09:40.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.277+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=MVE60XPRMP25 type=del 2024-09-12T00:09:40.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.278+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=6RW11Q0IPHBB type=del size=1072607 2024-09-12T00:09:40.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.280+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=4YFWABSX72Y0 type=del 2024-09-12T00:09:40.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.281+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=TR1RHPX3G834 type=del size=2551089 2024-09-12T00:09:40.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.282+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=3W9VH6TY4IU9 type=del 2024-09-12T00:09:40.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.283+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=CRT73EOU4UI7 type=del size=3176898 2024-09-12T00:09:40.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.286+0000 7f3dc2c18780 1 < suggested remove operation key=415OYT4ML329 tag=QQGI7X3NE8DX type=del 2024-09-12T00:09:40.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.287+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=PNSLS7XUXWM2 type=del size=1180119 2024-09-12T00:09:40.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.288+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=HBX2CVEKUIOF type=del 2024-09-12T00:09:40.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.289+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=BIT54P2T3MV2 type=del size=3854812 2024-09-12T00:09:40.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.291+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=TPQVDEY3SVO9 type=del 2024-09-12T00:09:40.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.292+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=M3ISY9G6H9U0 type=write size=749648 2024-09-12T00:09:40.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.292+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~YLGZTSKGA873.0 size=933182 2024-09-12T00:09:40.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.295+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=YLGZTSKGA873 tag=0HHCFRVLQUS3 type=write size=1981758 2024-09-12T00:09:40.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.296+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=AL4NGX9XY5BE type=del size=3720295 2024-09-12T00:09:40.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.298+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~08TSHQKNSI1T.0 size=1048576 2024-09-12T00:09:40.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.299+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~08TSHQKNSI1T.1 size=1048576 2024-09-12T00:09:40.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.300+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~08TSHQKNSI1T.2 size=818508 2024-09-12T00:09:40.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.302+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=08TSHQKNSI1T tag=WDMGJL29QQ9A type=write size=3964236 2024-09-12T00:09:40.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.304+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~VDG00YHGYEEO.0 size=1048576 2024-09-12T00:09:40.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.305+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~VDG00YHGYEEO.1 size=1048576 2024-09-12T00:09:40.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.306+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~VDG00YHGYEEO.2 size=795927 2024-09-12T00:09:40.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.306+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=VDG00YHGYEEO tag=AINFHB1R2XPZ type=write size=3941655 2024-09-12T00:09:40.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.307+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~7JMFJGZ0WATG.0 size=1048576 2024-09-12T00:09:40.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.308+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~7JMFJGZ0WATG.1 size=1048576 2024-09-12T00:09:40.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.309+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~7JMFJGZ0WATG.2 size=550165 2024-09-12T00:09:40.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.311+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=7JMFJGZ0WATG tag=ODIFPM3TALZI type=write size=3695893 2024-09-12T00:09:40.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.313+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=1KBS0VMJY6SG type=write size=652168 2024-09-12T00:09:40.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.314+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~8TFBWQ3BFXYI.0 size=1048576 2024-09-12T00:09:40.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.315+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~8TFBWQ3BFXYI.1 size=1048576 2024-09-12T00:09:40.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.316+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~8TFBWQ3BFXYI.2 size=27754 2024-09-12T00:09:40.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.318+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=8TFBWQ3BFXYI tag=9EZD9DCZZ3EL type=write size=3173482 2024-09-12T00:09:40.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.321+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~BK06ORINWITZ.0 size=192618 2024-09-12T00:09:40.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.321+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=BK06ORINWITZ tag=PWYCREQ0E89J type=write size=1241194 2024-09-12T00:09:40.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.322+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=T4LF0DGXKH3X type=del 2024-09-12T00:09:40.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.323+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=942XATKIVG3C type=write size=624927 2024-09-12T00:09:40.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.326+0000 7f3dc2c18780 1 < suggested remove operation key=GP3MLWX9586T tag=80VUHUHXEK3E type=del 2024-09-12T00:09:40.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.327+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=HDHT76H4IRM8 type=del size=913866 2024-09-12T00:09:40.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.328+0000 7f3dc2c18780 1 < completed write operation key=A4O7JFS2ULY0 tag=YGUJGKSGXPC9 type=write size=922416 2024-09-12T00:09:40.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.330+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~CD2KX8TRRZVC.0 size=722222 2024-09-12T00:09:40.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.330+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=CD2KX8TRRZVC tag=7L4SHB3C6IXZ type=write size=1770798 2024-09-12T00:09:40.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.332+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~EA26L15P5GT0.0 size=1048576 2024-09-12T00:09:40.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.333+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~EA26L15P5GT0.1 size=1048576 2024-09-12T00:09:40.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.334+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~EA26L15P5GT0.2 size=482780 2024-09-12T00:09:40.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.336+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=EA26L15P5GT0 tag=6GTXZ8RTP3WS type=write size=3628508 2024-09-12T00:09:40.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.337+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=7PI9CW3PEBBK type=write size=10227 2024-09-12T00:09:40.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.338+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=EOZS3AWA3QY2 type=del 2024-09-12T00:09:40.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.340+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~5EG019FYGSDC.0 size=1048576 2024-09-12T00:09:40.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.341+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~5EG019FYGSDC.1 size=783535 2024-09-12T00:09:40.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.341+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=5EG019FYGSDC tag=9MFY9UB53P4C type=write size=2880687 2024-09-12T00:09:40.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.342+0000 7f3dc2c18780 1 < completed write operation key=YYIQC6YL2PSW tag=WUBKRR2XZQVX type=write size=915745 2024-09-12T00:09:40.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.343+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=H9Z3GP0QYV96 type=write size=345033 2024-09-12T00:09:40.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.345+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=6RW11Q0IPHBB type=del 2024-09-12T00:09:40.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.347+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~14T65M8P8W23.0 size=1048576 2024-09-12T00:09:40.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.348+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~14T65M8P8W23.1 size=105260 2024-09-12T00:09:40.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.348+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=14T65M8P8W23 tag=PVH2KXC4HGEZ type=write size=2202412 2024-09-12T00:09:40.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.349+0000 7f3dc2c18780 1 < canceled operation key=A4O7JFS2ULY0 tag=TR1RHPX3G834 type=del size=2551089 2024-09-12T00:09:40.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.350+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=JLOZVY2THUJ5 type=del size=3261468 2024-09-12T00:09:40.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.351+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=CRT73EOU4UI7 type=del 2024-09-12T00:09:40.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.352+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=UKREPMAHT74H type=del size=201488 2024-09-12T00:09:40.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.354+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=PNSLS7XUXWM2 type=del 2024-09-12T00:09:40.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.355+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=POWDJI81NA9E type=del size=3905442 2024-09-12T00:09:40.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.356+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=BIT54P2T3MV2 type=del 2024-09-12T00:09:40.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.357+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=UM3ELC892DQ2 type=del size=2909644 2024-09-12T00:09:40.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.358+0000 7f3dc2c18780 1 < completed write operation key=TSL3IDD0EDT0 tag=M3ISY9G6H9U0 type=write size=749648 2024-09-12T00:09:40.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.361+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~HU7QYJ4A0UM5.0 size=1048576 2024-09-12T00:09:40.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.361+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~HU7QYJ4A0UM5.1 size=118198 2024-09-12T00:09:40.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.361+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=HU7QYJ4A0UM5 tag=OIG9ZFPTT35O type=write size=2215350 2024-09-12T00:09:40.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.363+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=AL4NGX9XY5BE type=del 2024-09-12T00:09:40.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.365+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~3BPZJ743BTK4.0 size=1048576 2024-09-12T00:09:40.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.366+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~3BPZJ743BTK4.1 size=188686 2024-09-12T00:09:40.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.366+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=3BPZJ743BTK4 tag=CGFB7LSJK9Y0 type=write size=2285838 2024-09-12T00:09:40.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.367+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~VDG00YHGYEEO.0 size=1048576 2024-09-12T00:09:40.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.368+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~VDG00YHGYEEO.1 size=1048576 2024-09-12T00:09:40.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.369+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~VDG00YHGYEEO.2 size=795927 2024-09-12T00:09:40.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.371+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=VDG00YHGYEEO tag=AINFHB1R2XPZ type=write size=3941655 2024-09-12T00:09:40.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.373+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~PVNK1LW72GBL.0 size=112645 2024-09-12T00:09:40.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.373+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=PVNK1LW72GBL tag=EEGFGIOEFV9N type=write size=1161221 2024-09-12T00:09:40.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.374+0000 7f3dc2c18780 1 < canceled operation key=415OYT4ML329 tag=1KBS0VMJY6SG type=write size=652168 2024-09-12T00:09:40.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.375+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=VNOQTY8E69YZ type=write size=415841 2024-09-12T00:09:40.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.376+0000 7f3dc2c18780 1 < canceled part key=_multipart_25CF1N8J81Y9.2~BK06ORINWITZ.0 size=192618 2024-09-12T00:09:40.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.378+0000 7f3dc2c18780 1 < canceled multipart upload key=25CF1N8J81Y9 upload=BK06ORINWITZ tag=PWYCREQ0E89J type=write size=1241194 2024-09-12T00:09:40.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.379+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=29OPIFP5O7N0 type=del size=3824242 2024-09-12T00:09:40.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.381+0000 7f3dc2c18780 1 < suggested update operation key=5CS98S02F59L tag=942XATKIVG3C type=write size=624927 2024-09-12T00:09:40.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.383+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=IVYSXC3HOXSS type=del size=2280709 2024-09-12T00:09:40.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.385+0000 7f3dc2c18780 1 < suggested update operation key=7JVCFTM2QMGY tag=HDHT76H4IRM8 type=del size=913866 2024-09-12T00:09:40.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.388+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~UO2ZB7T1TFD7.0 size=1021466 2024-09-12T00:09:40.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.388+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=UO2ZB7T1TFD7 tag=YRTNDJ9QJFLD type=write size=2070042 2024-09-12T00:09:40.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.389+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~CD2KX8TRRZVC.0 size=722222 2024-09-12T00:09:40.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.391+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=CD2KX8TRRZVC tag=7L4SHB3C6IXZ type=write size=1770798 2024-09-12T00:09:40.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.393+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~PTA1NPRHB5FA.0 size=841738 2024-09-12T00:09:40.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.393+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=PTA1NPRHB5FA tag=DCJWIEF5DSGM type=write size=1890314 2024-09-12T00:09:40.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.394+0000 7f3dc2c18780 1 < completed write operation key=415OYT4ML329 tag=7PI9CW3PEBBK type=write size=10227 2024-09-12T00:09:40.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.396+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=MS9P7U1TMDW5 type=write size=349026 2024-09-12T00:09:40.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.398+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~5EG019FYGSDC.0 size=1048576 2024-09-12T00:09:40.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.398+0000 7f3dc2c18780 1 < canceled part key=_multipart_KDHO7IEGICDA.2~5EG019FYGSDC.1 size=783535 2024-09-12T00:09:40.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.400+0000 7f3dc2c18780 1 < canceled multipart upload key=KDHO7IEGICDA upload=5EG019FYGSDC tag=9MFY9UB53P4C type=write size=2880687 2024-09-12T00:09:40.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.402+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=8FR1HDYP84M5 type=del size=3924005 2024-09-12T00:09:40.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.404+0000 7f3dc2c18780 1 < suggested update operation key=5F0BB9U7Y6ZZ tag=H9Z3GP0QYV96 type=write size=345033 2024-09-12T00:09:40.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.405+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=0YB5AFO5C3SV type=del size=1774362 2024-09-12T00:09:40.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.407+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~14T65M8P8W23.0 size=1048576 2024-09-12T00:09:40.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.408+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~14T65M8P8W23.1 size=105260 2024-09-12T00:09:40.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.411+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=14T65M8P8W23 tag=PVH2KXC4HGEZ type=write size=2202412 2024-09-12T00:09:40.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.413+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~JUBCKLTQGMKP.0 size=1048576 2024-09-12T00:09:40.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.414+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~JUBCKLTQGMKP.1 size=600561 2024-09-12T00:09:40.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.414+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=JUBCKLTQGMKP tag=QKRORITTD9QX type=write size=2697713 2024-09-12T00:09:40.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.415+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=JLOZVY2THUJ5 type=del 2024-09-12T00:09:40.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.417+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=J60CT80MJJYB type=del size=3424007 2024-09-12T00:09:40.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.418+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=UKREPMAHT74H type=del 2024-09-12T00:09:40.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.419+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=ZH0I94SG788K type=del size=2326707 2024-09-12T00:09:40.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.421+0000 7f3dc2c18780 1 < suggested update operation key=C0JT46SGECP0 tag=POWDJI81NA9E type=del size=3905442 2024-09-12T00:09:40.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.423+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=OUIW1MU6G5FR type=write size=71037 2024-09-12T00:09:40.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.424+0000 7f3dc2c18780 1 < canceled operation key=GLAOX3ZNNILD tag=UM3ELC892DQ2 type=del size=2909644 2024-09-12T00:09:40.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.426+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~0HHHZTU3QA62.0 size=994254 2024-09-12T00:09:40.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.426+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=0HHHZTU3QA62 tag=QAAXH74IA0Z5 type=write size=2042830 2024-09-12T00:09:40.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.427+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~HU7QYJ4A0UM5.0 size=1048576 2024-09-12T00:09:40.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.428+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~HU7QYJ4A0UM5.1 size=118198 2024-09-12T00:09:40.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.430+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=HU7QYJ4A0UM5 tag=OIG9ZFPTT35O type=write size=2215350 2024-09-12T00:09:40.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.433+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~1HQB2ELCW5ZH.0 size=828205 2024-09-12T00:09:40.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.433+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=1HQB2ELCW5ZH tag=KRW2OEHPNVGT type=write size=1876781 2024-09-12T00:09:40.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.434+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~3BPZJ743BTK4.0 size=1048576 2024-09-12T00:09:40.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.435+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~3BPZJ743BTK4.1 size=188686 2024-09-12T00:09:40.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.437+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=3BPZJ743BTK4 tag=CGFB7LSJK9Y0 type=write size=2285838 2024-09-12T00:09:40.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.438+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=62RFNTF0S1GE type=del size=912756 2024-09-12T00:09:40.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.439+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~PVNK1LW72GBL.0 size=112645 2024-09-12T00:09:40.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.441+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=PVNK1LW72GBL tag=EEGFGIOEFV9N type=write size=1161221 2024-09-12T00:09:40.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.444+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~YY8NE0SU14VA.0 size=1048576 2024-09-12T00:09:40.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.445+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~YY8NE0SU14VA.1 size=1048576 2024-09-12T00:09:40.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.446+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~YY8NE0SU14VA.2 size=387670 2024-09-12T00:09:40.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.446+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=YY8NE0SU14VA tag=1KV35S3HJUFC type=write size=3533398 2024-09-12T00:09:40.446 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.447+0000 7f3dc2c18780 1 < canceled operation key=OGRGDIUO2W8B tag=VNOQTY8E69YZ type=write size=415841 2024-09-12T00:09:40.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.449+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=P60BAD3BKRSC type=del size=753067 2024-09-12T00:09:40.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.450+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=29OPIFP5O7N0 type=del 2024-09-12T00:09:40.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.451+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=GJ2RW20H69YV type=write size=81251 2024-09-12T00:09:40.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.452+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=IVYSXC3HOXSS type=del 2024-09-12T00:09:40.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.454+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=Z1I02ZT9UEA7 type=write size=884275 2024-09-12T00:09:40.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.455+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~UO2ZB7T1TFD7.0 size=1021466 2024-09-12T00:09:40.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.457+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=UO2ZB7T1TFD7 tag=YRTNDJ9QJFLD type=write size=2070042 2024-09-12T00:09:40.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.458+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=OU0GWBV1LIAE type=write size=924535 2024-09-12T00:09:40.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.459+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~PTA1NPRHB5FA.0 size=841738 2024-09-12T00:09:40.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.462+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=PTA1NPRHB5FA tag=DCJWIEF5DSGM type=write size=1890314 2024-09-12T00:09:40.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.464+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~SJ02UJSNFWAO.0 size=185929 2024-09-12T00:09:40.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.464+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=SJ02UJSNFWAO tag=OVE153XZZRCW type=write size=1234505 2024-09-12T00:09:40.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.467+0000 7f3dc2c18780 1 < suggested update operation key=U2H0A1GZROT7 tag=MS9P7U1TMDW5 type=write size=349026 2024-09-12T00:09:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.468+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=HKVRSM7QXDK2 type=del size=751671 2024-09-12T00:09:40.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.470+0000 7f3dc2c18780 1 < suggested update operation key=KQWXE62PF5F7 tag=8FR1HDYP84M5 type=del size=3924005 2024-09-12T00:09:40.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.471+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=0NCLQ3JQOBBY type=del size=3253821 2024-09-12T00:09:40.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.473+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=0YB5AFO5C3SV type=del 2024-09-12T00:09:40.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.474+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=8RLOFBHU2T7K type=del size=833510 2024-09-12T00:09:40.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.475+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~JUBCKLTQGMKP.0 size=1048576 2024-09-12T00:09:40.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.475+0000 7f3dc2c18780 1 < canceled part key=_multipart_KDHO7IEGICDA.2~JUBCKLTQGMKP.1 size=600561 2024-09-12T00:09:40.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.477+0000 7f3dc2c18780 1 < canceled multipart upload key=KDHO7IEGICDA upload=JUBCKLTQGMKP tag=QKRORITTD9QX type=write size=2697713 2024-09-12T00:09:40.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.479+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=SXLXIX3ZY4J3 type=write size=845395 2024-09-12T00:09:40.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.480+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=J60CT80MJJYB type=del 2024-09-12T00:09:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.481+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=PK2UNXDP8YS5 type=del size=100547 2024-09-12T00:09:40.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.484+0000 7f3dc2c18780 1 < suggested update operation key=WRR6LAYIWOCE tag=ZH0I94SG788K type=del size=2326707 2024-09-12T00:09:40.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.486+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~DBLTRI474UQS.0 size=1048576 2024-09-12T00:09:40.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.487+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~DBLTRI474UQS.1 size=594283 2024-09-12T00:09:40.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.487+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=DBLTRI474UQS tag=9U1FVSZK76KW type=write size=2691435 2024-09-12T00:09:40.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.488+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=OUIW1MU6G5FR type=write size=71037 2024-09-12T00:09:40.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.489+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=M94F7XUAT8NT type=del size=1282279 2024-09-12T00:09:40.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.490+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~0HHHZTU3QA62.0 size=994254 2024-09-12T00:09:40.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.492+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=0HHHZTU3QA62 tag=QAAXH74IA0Z5 type=write size=2042830 2024-09-12T00:09:40.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.494+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~SNKL63EGBUPA.0 size=1048576 2024-09-12T00:09:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.495+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~SNKL63EGBUPA.1 size=610207 2024-09-12T00:09:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.495+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=SNKL63EGBUPA tag=IY2RG11SRGJ3 type=write size=2707359 2024-09-12T00:09:40.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.496+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~1HQB2ELCW5ZH.0 size=828205 2024-09-12T00:09:40.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.498+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=1HQB2ELCW5ZH tag=KRW2OEHPNVGT type=write size=1876781 2024-09-12T00:09:40.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.500+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=M8JMLZMUPCRR type=write size=852378 2024-09-12T00:09:40.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.501+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=62RFNTF0S1GE type=del 2024-09-12T00:09:40.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.502+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=4TVFPMGH7Q96 type=del size=2134128 2024-09-12T00:09:40.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.505+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~YY8NE0SU14VA.0 size=1048576 2024-09-12T00:09:40.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.506+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~YY8NE0SU14VA.1 size=1048576 2024-09-12T00:09:40.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.507+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~YY8NE0SU14VA.2 size=387670 2024-09-12T00:09:40.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.510+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=YY8NE0SU14VA tag=1KV35S3HJUFC type=write size=3533398 2024-09-12T00:09:40.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.512+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~J8E89CS3FD7L.0 size=1048576 2024-09-12T00:09:40.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.513+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~J8E89CS3FD7L.1 size=1048576 2024-09-12T00:09:40.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.514+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~J8E89CS3FD7L.2 size=199853 2024-09-12T00:09:40.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.514+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=J8E89CS3FD7L tag=O1L7I0ZXJT2Q type=write size=3345581 2024-09-12T00:09:40.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.515+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=P60BAD3BKRSC type=del 2024-09-12T00:09:40.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.516+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=19MDHUSYBJ5L type=del size=1309205 2024-09-12T00:09:40.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.517+0000 7f3dc2c18780 1 < completed write operation key=0ICU4WV9K1RG tag=GJ2RW20H69YV type=write size=81251 2024-09-12T00:09:40.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.518+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=FH75HCUE8D45 type=del size=2454557 2024-09-12T00:09:40.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.520+0000 7f3dc2c18780 1 < completed write operation key=5MAV2RJ4E31S tag=Z1I02ZT9UEA7 type=write size=884275 2024-09-12T00:09:40.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.522+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~V9IHUX21907M.0 size=1048576 2024-09-12T00:09:40.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.523+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~V9IHUX21907M.1 size=1048576 2024-09-12T00:09:40.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.524+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~V9IHUX21907M.2 size=189658 2024-09-12T00:09:40.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.524+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=V9IHUX21907M tag=I5G1MS4COQR5 type=write size=3335386 2024-09-12T00:09:40.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.528+0000 7f3dc2c18780 1 < suggested update operation key=TSL3IDD0EDT0 tag=OU0GWBV1LIAE type=write size=924535 2024-09-12T00:09:40.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.529+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=G363A8CCN1SU type=del size=3721669 2024-09-12T00:09:40.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.530+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~SJ02UJSNFWAO.0 size=185929 2024-09-12T00:09:40.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.532+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=SJ02UJSNFWAO tag=OVE153XZZRCW type=write size=1234505 2024-09-12T00:09:40.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.533+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=U91NNGNWCJD9 type=del size=3913194 2024-09-12T00:09:40.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.534+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=HKVRSM7QXDK2 type=del 2024-09-12T00:09:40.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.536+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=R6HV7L77C6ZZ type=del size=1711229 2024-09-12T00:09:40.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.537+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=0NCLQ3JQOBBY type=del 2024-09-12T00:09:40.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.540+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~EMOFGDCA6TMY.0 size=1048576 2024-09-12T00:09:40.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.540+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~EMOFGDCA6TMY.1 size=297500 2024-09-12T00:09:40.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.540+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=EMOFGDCA6TMY tag=47UZR998J95C type=write size=2394652 2024-09-12T00:09:40.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.542+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=8RLOFBHU2T7K type=del 2024-09-12T00:09:40.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.543+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=PBTZVYMGH9LH type=del size=1844994 2024-09-12T00:09:40.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.544+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=SXLXIX3ZY4J3 type=write size=845395 2024-09-12T00:09:40.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.545+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=0XNUHIMSYHFK type=write size=735314 2024-09-12T00:09:40.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.546+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=PK2UNXDP8YS5 type=del 2024-09-12T00:09:40.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.548+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~9WY92MEHWFVW.0 size=122640 2024-09-12T00:09:40.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.548+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=9WY92MEHWFVW tag=EM9N8E91OAPQ type=write size=1171216 2024-09-12T00:09:40.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.549+0000 7f3dc2c18780 1 < canceled part key=_multipart_C7ZOCTAR2BEP.2~DBLTRI474UQS.0 size=1048576 2024-09-12T00:09:40.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.549+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~DBLTRI474UQS.1 size=594283 2024-09-12T00:09:40.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.551+0000 7f3dc2c18780 1 < canceled multipart upload key=C7ZOCTAR2BEP upload=DBLTRI474UQS tag=9U1FVSZK76KW type=write size=2691435 2024-09-12T00:09:40.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.553+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=YMFYKQ571HUB type=write size=154637 2024-09-12T00:09:40.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.554+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=M94F7XUAT8NT type=del 2024-09-12T00:09:40.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.556+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~P2L2E54WW6IP.0 size=314497 2024-09-12T00:09:40.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.556+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=P2L2E54WW6IP tag=OOEKM30PML2D type=write size=1363073 2024-09-12T00:09:40.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.557+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~SNKL63EGBUPA.0 size=1048576 2024-09-12T00:09:40.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.558+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~SNKL63EGBUPA.1 size=610207 2024-09-12T00:09:40.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.560+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=SNKL63EGBUPA tag=IY2RG11SRGJ3 type=write size=2707359 2024-09-12T00:09:40.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.561+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=1BLNK6L55VYZ type=write size=39775 2024-09-12T00:09:40.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.563+0000 7f3dc2c18780 1 < canceled operation key=7JVCFTM2QMGY tag=M8JMLZMUPCRR type=write size=852378 2024-09-12T00:09:40.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.565+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~SCD5YA1FADQZ.0 size=1048576 2024-09-12T00:09:40.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.566+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~SCD5YA1FADQZ.1 size=1048576 2024-09-12T00:09:40.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.567+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~SCD5YA1FADQZ.2 size=356806 2024-09-12T00:09:40.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.567+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=SCD5YA1FADQZ tag=7EWFC8HIPQ1G type=write size=3502534 2024-09-12T00:09:40.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.568+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=4TVFPMGH7Q96 type=del 2024-09-12T00:09:40.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.569+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=IWFQOWFTDVH8 type=del size=599159 2024-09-12T00:09:40.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.571+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~J8E89CS3FD7L.0 size=1048576 2024-09-12T00:09:40.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.572+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~J8E89CS3FD7L.1 size=1048576 2024-09-12T00:09:40.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.572+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRBBH64CISJZ.2~J8E89CS3FD7L.2 size=199853 2024-09-12T00:09:40.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.574+0000 7f3dc2c18780 1 < canceled multipart upload key=WRBBH64CISJZ upload=J8E89CS3FD7L tag=O1L7I0ZXJT2Q type=write size=3345581 2024-09-12T00:09:40.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.576+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~A8HD78RSGH3X.0 size=1048576 2024-09-12T00:09:40.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.577+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~A8HD78RSGH3X.1 size=240091 2024-09-12T00:09:40.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.577+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=A8HD78RSGH3X tag=53VFN43NQCWF type=write size=2337243 2024-09-12T00:09:40.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.579+0000 7f3dc2c18780 1 < suggested remove operation key=4POD73U0LAC0 tag=19MDHUSYBJ5L type=del 2024-09-12T00:09:40.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.582+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~SDQ65H0QXMVL.0 size=130754 2024-09-12T00:09:40.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.582+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=SDQ65H0QXMVL tag=0JWW2QRLGZT7 type=write size=1179330 2024-09-12T00:09:40.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.583+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=FH75HCUE8D45 type=del 2024-09-12T00:09:40.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.585+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~KUBVQYERFML3.0 size=1048576 2024-09-12T00:09:40.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.586+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~KUBVQYERFML3.1 size=1048576 2024-09-12T00:09:40.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.587+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~KUBVQYERFML3.2 size=162416 2024-09-12T00:09:40.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.587+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=KUBVQYERFML3 tag=H2R6IOGQKIPU type=write size=3308144 2024-09-12T00:09:40.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.588+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~V9IHUX21907M.0 size=1048576 2024-09-12T00:09:40.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.589+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~V9IHUX21907M.1 size=1048576 2024-09-12T00:09:40.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.590+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~V9IHUX21907M.2 size=189658 2024-09-12T00:09:40.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.592+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=V9IHUX21907M tag=I5G1MS4COQR5 type=write size=3335386 2024-09-12T00:09:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.595+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~SEY54CGWJFJI.0 size=1048576 2024-09-12T00:09:40.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.596+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~SEY54CGWJFJI.1 size=1048576 2024-09-12T00:09:40.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.597+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~SEY54CGWJFJI.2 size=335852 2024-09-12T00:09:40.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.597+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=SEY54CGWJFJI tag=NYCOZ3G1P8Y1 type=write size=3481580 2024-09-12T00:09:40.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.598+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=G363A8CCN1SU type=del 2024-09-12T00:09:40.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.599+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=43TLDOOI1Z65 type=write size=401329 2024-09-12T00:09:40.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.601+0000 7f3dc2c18780 1 < canceled operation key=WRR6LAYIWOCE tag=U91NNGNWCJD9 type=del size=3913194 2024-09-12T00:09:40.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.603+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~DUHVYC1T0YM6.0 size=1048576 2024-09-12T00:09:40.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.604+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~DUHVYC1T0YM6.1 size=202963 2024-09-12T00:09:40.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.604+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=DUHVYC1T0YM6 tag=H3IER0U67X1B type=write size=2300115 2024-09-12T00:09:40.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.605+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=R6HV7L77C6ZZ type=del 2024-09-12T00:09:40.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.609+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~LM7YH4RLZGIN.0 size=1048576 2024-09-12T00:09:40.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.610+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~LM7YH4RLZGIN.1 size=747611 2024-09-12T00:09:40.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.610+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=LM7YH4RLZGIN tag=S6ITX0CBH4U0 type=write size=2844763 2024-09-12T00:09:40.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.612+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~EMOFGDCA6TMY.0 size=1048576 2024-09-12T00:09:40.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.613+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~EMOFGDCA6TMY.1 size=297500 2024-09-12T00:09:40.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.615+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=EMOFGDCA6TMY tag=47UZR998J95C type=write size=2394652 2024-09-12T00:09:40.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.616+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=7LRVR2GFO07S type=del size=260605 2024-09-12T00:09:40.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.619+0000 7f3dc2c18780 1 < suggested remove operation key=C7ZOCTAR2BEP tag=PBTZVYMGH9LH type=del 2024-09-12T00:09:40.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.620+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=ONKMK9YG57J9 type=del size=2226590 2024-09-12T00:09:40.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.622+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=0XNUHIMSYHFK type=write size=735314 2024-09-12T00:09:40.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.625+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~FJ75ISABJ27R.0 size=745471 2024-09-12T00:09:40.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.625+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=FJ75ISABJ27R tag=HSDTCPTQYJUA type=write size=1794047 2024-09-12T00:09:40.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.626+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~9WY92MEHWFVW.0 size=122640 2024-09-12T00:09:40.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.628+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=9WY92MEHWFVW tag=EM9N8E91OAPQ type=write size=1171216 2024-09-12T00:09:40.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.630+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~7KR0SO0W64PH.0 size=758185 2024-09-12T00:09:40.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.630+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=7KR0SO0W64PH tag=Z5AVMWWDVV14 type=write size=1806761 2024-09-12T00:09:40.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.631+0000 7f3dc2c18780 1 < completed write operation key=2SO8HBZSAMRX tag=YMFYKQ571HUB type=write size=154637 2024-09-12T00:09:40.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.634+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~G32RJE6YSQ4G.0 size=1000953 2024-09-12T00:09:40.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.634+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=G32RJE6YSQ4G tag=0CJWPK5FODH8 type=write size=2049529 2024-09-12T00:09:40.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.635+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~P2L2E54WW6IP.0 size=314497 2024-09-12T00:09:40.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.637+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=P2L2E54WW6IP tag=OOEKM30PML2D type=write size=1363073 2024-09-12T00:09:40.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.638+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=TL3WR0KLJ7FF type=del size=2274513 2024-09-12T00:09:40.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.639+0000 7f3dc2c18780 1 < completed write operation key=U2H0A1GZROT7 tag=1BLNK6L55VYZ type=write size=39775 2024-09-12T00:09:40.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.641+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=OCQ225JZ82KE type=del size=3291738 2024-09-12T00:09:40.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.642+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~SCD5YA1FADQZ.0 size=1048576 2024-09-12T00:09:40.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.643+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~SCD5YA1FADQZ.1 size=1048576 2024-09-12T00:09:40.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.645+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~SCD5YA1FADQZ.2 size=356806 2024-09-12T00:09:40.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.647+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=SCD5YA1FADQZ tag=7EWFC8HIPQ1G type=write size=3502534 2024-09-12T00:09:40.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.649+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~BW9L2MAB0H7Y.0 size=667993 2024-09-12T00:09:40.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.649+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=BW9L2MAB0H7Y tag=HDU3CAJI68CV type=write size=1716569 2024-09-12T00:09:40.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.650+0000 7f3dc2c18780 1 < canceled operation key=V0K5FRKYGJ0K tag=IWFQOWFTDVH8 type=del size=599159 2024-09-12T00:09:40.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.652+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=EV9T3G0QI7K1 type=del size=1467762 2024-09-12T00:09:40.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.653+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~A8HD78RSGH3X.0 size=1048576 2024-09-12T00:09:40.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.654+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~A8HD78RSGH3X.1 size=240091 2024-09-12T00:09:40.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.656+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=A8HD78RSGH3X tag=53VFN43NQCWF type=write size=2337243 2024-09-12T00:09:40.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.658+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~UHN91FQURNR6.0 size=328928 2024-09-12T00:09:40.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.658+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=UHN91FQURNR6 tag=AWT6ZUIINVJ8 type=write size=1377504 2024-09-12T00:09:40.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.658+0000 7f3dc2c18780 1 < canceled part key=_multipart_3WUIB2OMX77J.2~SDQ65H0QXMVL.0 size=130754 2024-09-12T00:09:40.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.660+0000 7f3dc2c18780 1 < canceled multipart upload key=3WUIB2OMX77J upload=SDQ65H0QXMVL tag=0JWW2QRLGZT7 type=write size=1179330 2024-09-12T00:09:40.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.662+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~6513EZP7OXPH.0 size=1048576 2024-09-12T00:09:40.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.663+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~6513EZP7OXPH.1 size=1833 2024-09-12T00:09:40.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.663+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=6513EZP7OXPH tag=IKUR45YBD0KB type=write size=2098985 2024-09-12T00:09:40.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.665+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~KUBVQYERFML3.0 size=1048576 2024-09-12T00:09:40.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.666+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~KUBVQYERFML3.1 size=1048576 2024-09-12T00:09:40.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.667+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~KUBVQYERFML3.2 size=162416 2024-09-12T00:09:40.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.669+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=KUBVQYERFML3 tag=H2R6IOGQKIPU type=write size=3308144 2024-09-12T00:09:40.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.670+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=FLUD335RV981 type=del size=1628389 2024-09-12T00:09:40.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.672+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~SEY54CGWJFJI.0 size=1048576 2024-09-12T00:09:40.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.673+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~SEY54CGWJFJI.1 size=1048576 2024-09-12T00:09:40.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.674+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~SEY54CGWJFJI.2 size=335852 2024-09-12T00:09:40.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.676+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=SEY54CGWJFJI tag=NYCOZ3G1P8Y1 type=write size=3481580 2024-09-12T00:09:40.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.679+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~GWCSRAYPOMXL.0 size=856917 2024-09-12T00:09:40.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.679+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=GWCSRAYPOMXL tag=KBWXXFPJN2U7 type=write size=1905493 2024-09-12T00:09:40.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.680+0000 7f3dc2c18780 1 < completed write operation key=415OYT4ML329 tag=43TLDOOI1Z65 type=write size=401329 2024-09-12T00:09:40.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.683+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~7WG5CPF8HOOI.0 size=545579 2024-09-12T00:09:40.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.683+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=7WG5CPF8HOOI tag=1RAEWXSE20H0 type=write size=1594155 2024-09-12T00:09:40.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.684+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~DUHVYC1T0YM6.0 size=1048576 2024-09-12T00:09:40.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.685+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~DUHVYC1T0YM6.1 size=202963 2024-09-12T00:09:40.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.687+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=DUHVYC1T0YM6 tag=H3IER0U67X1B type=write size=2300115 2024-09-12T00:09:40.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.689+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~S3YG9VLWYWNI.0 size=786130 2024-09-12T00:09:40.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.689+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=S3YG9VLWYWNI tag=6FM30AA24I4L type=write size=1834706 2024-09-12T00:09:40.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.690+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~LM7YH4RLZGIN.0 size=1048576 2024-09-12T00:09:40.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.691+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~LM7YH4RLZGIN.1 size=747611 2024-09-12T00:09:40.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.693+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=LM7YH4RLZGIN tag=S6ITX0CBH4U0 type=write size=2844763 2024-09-12T00:09:40.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.696+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~QZEV7RVHA152.0 size=358456 2024-09-12T00:09:40.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.696+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=QZEV7RVHA152 tag=JXW5TC4D47AB type=write size=1407032 2024-09-12T00:09:40.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.698+0000 7f3dc2c18780 1 < suggested update operation key=V0K5FRKYGJ0K tag=7LRVR2GFO07S type=del size=260605 2024-09-12T00:09:40.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.699+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=N0JM4Z7V9TE4 type=del size=3162878 2024-09-12T00:09:40.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.702+0000 7f3dc2c18780 1 < suggested remove operation key=415OYT4ML329 tag=ONKMK9YG57J9 type=del 2024-09-12T00:09:40.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.704+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~5978KHQLX8K9.0 size=936722 2024-09-12T00:09:40.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.704+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=5978KHQLX8K9 tag=2B80AH003LMK type=write size=1985298 2024-09-12T00:09:40.704 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.705+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~FJ75ISABJ27R.0 size=745471 2024-09-12T00:09:40.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.707+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=FJ75ISABJ27R tag=HSDTCPTQYJUA type=write size=1794047 2024-09-12T00:09:40.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.710+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~0NSHTRVT4UUW.0 size=1048576 2024-09-12T00:09:40.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.711+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~0NSHTRVT4UUW.1 size=312152 2024-09-12T00:09:40.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.711+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=0NSHTRVT4UUW tag=2PP6FRHH4VKL type=write size=2409304 2024-09-12T00:09:40.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.712+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~7KR0SO0W64PH.0 size=758185 2024-09-12T00:09:40.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.714+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=7KR0SO0W64PH tag=Z5AVMWWDVV14 type=write size=1806761 2024-09-12T00:09:40.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.717+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~11667MAQ3AU7.0 size=940887 2024-09-12T00:09:40.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.717+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=11667MAQ3AU7 tag=U5FCQQHQMP2P type=write size=1989463 2024-09-12T00:09:40.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.718+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~G32RJE6YSQ4G.0 size=1000953 2024-09-12T00:09:40.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.720+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=G32RJE6YSQ4G tag=0CJWPK5FODH8 type=write size=2049529 2024-09-12T00:09:40.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.723+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~33VHJ9QDE69H.0 size=854296 2024-09-12T00:09:40.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.723+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=33VHJ9QDE69H tag=SIC8EYK0Z3T7 type=write size=1902872 2024-09-12T00:09:40.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.725+0000 7f3dc2c18780 1 < suggested update operation key=C0JT46SGECP0 tag=TL3WR0KLJ7FF type=del size=2274513 2024-09-12T00:09:40.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.728+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~L7HCGLLS2UQC.0 size=1048576 2024-09-12T00:09:40.727 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.728+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~L7HCGLLS2UQC.1 size=28260 2024-09-12T00:09:40.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.728+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=L7HCGLLS2UQC tag=45ZNISTKQY59 type=write size=2125412 2024-09-12T00:09:40.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.731+0000 7f3dc2c18780 1 < suggested update operation key=4POD73U0LAC0 tag=OCQ225JZ82KE type=del size=3291738 2024-09-12T00:09:40.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.733+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~18JAM0W44RYM.0 size=837438 2024-09-12T00:09:40.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.733+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=18JAM0W44RYM tag=TPESA1G8EPVV type=write size=1886014 2024-09-12T00:09:40.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.735+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~BW9L2MAB0H7Y.0 size=667993 2024-09-12T00:09:40.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.737+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=BW9L2MAB0H7Y tag=HDU3CAJI68CV type=write size=1716569 2024-09-12T00:09:40.736 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.738+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=U35DJUL49PA0 type=del size=1028270 2024-09-12T00:09:40.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.739+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=EV9T3G0QI7K1 type=del 2024-09-12T00:09:40.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.740+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=HPDMO123UON1 type=del size=3124104 2024-09-12T00:09:40.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.742+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~UHN91FQURNR6.0 size=328928 2024-09-12T00:09:40.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.744+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=UHN91FQURNR6 tag=AWT6ZUIINVJ8 type=write size=1377504 2024-09-12T00:09:40.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.746+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~GXXESAWA0KHD.0 size=1048576 2024-09-12T00:09:40.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.747+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~GXXESAWA0KHD.1 size=1048576 2024-09-12T00:09:40.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.748+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~GXXESAWA0KHD.2 size=586933 2024-09-12T00:09:40.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.748+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=GXXESAWA0KHD tag=PL4ZWZV6UW07 type=write size=3732661 2024-09-12T00:09:40.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.749+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~6513EZP7OXPH.0 size=1048576 2024-09-12T00:09:40.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.750+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~6513EZP7OXPH.1 size=1833 2024-09-12T00:09:40.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.753+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=6513EZP7OXPH tag=IKUR45YBD0KB type=write size=2098985 2024-09-12T00:09:40.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.755+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~2H07NQ18HPYZ.0 size=1048576 2024-09-12T00:09:40.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.756+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~2H07NQ18HPYZ.1 size=1048576 2024-09-12T00:09:40.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.757+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~2H07NQ18HPYZ.2 size=976445 2024-09-12T00:09:40.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.757+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=2H07NQ18HPYZ tag=Q6A2T9OMQVL6 type=write size=4122173 2024-09-12T00:09:40.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.759+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=FLUD335RV981 type=del 2024-09-12T00:09:40.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.762+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~5HY0MIASOV3U.0 size=1048576 2024-09-12T00:09:40.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.763+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~5HY0MIASOV3U.1 size=386225 2024-09-12T00:09:40.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.763+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=5HY0MIASOV3U tag=5H6Q0BP5LT38 type=write size=2483377 2024-09-12T00:09:40.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.764+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~GWCSRAYPOMXL.0 size=856917 2024-09-12T00:09:40.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.766+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=GWCSRAYPOMXL tag=KBWXXFPJN2U7 type=write size=1905493 2024-09-12T00:09:40.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.769+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DF5XNSCM4MCF.0 size=217390 2024-09-12T00:09:40.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.769+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=DF5XNSCM4MCF tag=YPN0EF6VY48O type=write size=1265966 2024-09-12T00:09:40.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.770+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~7WG5CPF8HOOI.0 size=545579 2024-09-12T00:09:40.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.772+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=7WG5CPF8HOOI tag=1RAEWXSE20H0 type=write size=1594155 2024-09-12T00:09:40.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.774+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=G1UQXLRQGBQI type=del size=3645262 2024-09-12T00:09:40.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.775+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~S3YG9VLWYWNI.0 size=786130 2024-09-12T00:09:40.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.777+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=S3YG9VLWYWNI tag=6FM30AA24I4L type=write size=1834706 2024-09-12T00:09:40.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.779+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~AE8IC3IL3GA4.0 size=1048576 2024-09-12T00:09:40.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.780+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~AE8IC3IL3GA4.1 size=811865 2024-09-12T00:09:40.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.780+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=AE8IC3IL3GA4 tag=8588LXLU5PC2 type=write size=2909017 2024-09-12T00:09:40.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.781+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~QZEV7RVHA152.0 size=358456 2024-09-12T00:09:40.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.783+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=QZEV7RVHA152 tag=JXW5TC4D47AB type=write size=1407032 2024-09-12T00:09:40.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.785+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=ONSJASBE0SEM type=del size=546001 2024-09-12T00:09:40.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.786+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=N0JM4Z7V9TE4 type=del 2024-09-12T00:09:40.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.788+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~979ZXHILX3MK.0 size=1048576 2024-09-12T00:09:40.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.789+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~979ZXHILX3MK.1 size=88827 2024-09-12T00:09:40.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.789+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=979ZXHILX3MK tag=RSQBHOJDUKW6 type=write size=2185979 2024-09-12T00:09:40.790 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.792+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~5978KHQLX8K9.0 size=936722 2024-09-12T00:09:40.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.794+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=5978KHQLX8K9 tag=2B80AH003LMK type=write size=1985298 2024-09-12T00:09:40.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.795+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=LDA06LKXBW48 type=del size=2562592 2024-09-12T00:09:40.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.796+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~0NSHTRVT4UUW.0 size=1048576 2024-09-12T00:09:40.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.797+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~0NSHTRVT4UUW.1 size=312152 2024-09-12T00:09:40.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.799+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=0NSHTRVT4UUW tag=2PP6FRHH4VKL type=write size=2409304 2024-09-12T00:09:40.800 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.801+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~TVGDZSJHYF9H.0 size=1048576 2024-09-12T00:09:40.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.803+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~TVGDZSJHYF9H.1 size=1048576 2024-09-12T00:09:40.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.803+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~TVGDZSJHYF9H.2 size=588478 2024-09-12T00:09:40.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.803+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=TVGDZSJHYF9H tag=69MGOTW6O1RP type=write size=3734206 2024-09-12T00:09:40.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.805+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~11667MAQ3AU7.0 size=940887 2024-09-12T00:09:40.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.807+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=11667MAQ3AU7 tag=U5FCQQHQMP2P type=write size=1989463 2024-09-12T00:09:40.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.809+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~SDN4L35FYQXV.0 size=1048576 2024-09-12T00:09:40.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.810+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~SDN4L35FYQXV.1 size=1048576 2024-09-12T00:09:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.811+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~SDN4L35FYQXV.2 size=810656 2024-09-12T00:09:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.811+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=SDN4L35FYQXV tag=FR11I03N28O0 type=write size=3956384 2024-09-12T00:09:40.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.812+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~33VHJ9QDE69H.0 size=854296 2024-09-12T00:09:40.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.814+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=33VHJ9QDE69H tag=SIC8EYK0Z3T7 type=write size=1902872 2024-09-12T00:09:40.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.815+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=QAGGBUT4JQ22 type=del size=1898686 2024-09-12T00:09:40.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.816+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~L7HCGLLS2UQC.0 size=1048576 2024-09-12T00:09:40.816 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.817+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~L7HCGLLS2UQC.1 size=28260 2024-09-12T00:09:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.819+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=L7HCGLLS2UQC tag=45ZNISTKQY59 type=write size=2125412 2024-09-12T00:09:40.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.821+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=D151X8ME527F type=del size=3576779 2024-09-12T00:09:40.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.822+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~18JAM0W44RYM.0 size=837438 2024-09-12T00:09:40.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.824+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=18JAM0W44RYM tag=TPESA1G8EPVV type=write size=1886014 2024-09-12T00:09:40.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.825+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=BF9UT4GEH1P0 type=del size=3485351 2024-09-12T00:09:40.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.826+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=U35DJUL49PA0 type=del 2024-09-12T00:09:40.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.828+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=9YOT33KHLYKH type=del size=2141147 2024-09-12T00:09:40.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.829+0000 7f3dc2c18780 1 < canceled operation key=GLAOX3ZNNILD tag=HPDMO123UON1 type=del size=3124104 2024-09-12T00:09:40.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.830+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=Q383FKNULGNK type=del size=3415123 2024-09-12T00:09:40.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.831+0000 7f3dc2c18780 1 < canceled part key=_multipart_25CF1N8J81Y9.2~GXXESAWA0KHD.0 size=1048576 2024-09-12T00:09:40.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.832+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~GXXESAWA0KHD.1 size=1048576 2024-09-12T00:09:40.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.833+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~GXXESAWA0KHD.2 size=586933 2024-09-12T00:09:40.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.835+0000 7f3dc2c18780 1 < canceled multipart upload key=25CF1N8J81Y9 upload=GXXESAWA0KHD tag=PL4ZWZV6UW07 type=write size=3732661 2024-09-12T00:09:40.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.837+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=X9ETYPOFDG64 type=del size=1092566 2024-09-12T00:09:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.838+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~2H07NQ18HPYZ.0 size=1048576 2024-09-12T00:09:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.839+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~2H07NQ18HPYZ.1 size=1048576 2024-09-12T00:09:40.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.840+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~2H07NQ18HPYZ.2 size=976445 2024-09-12T00:09:40.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.842+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=2H07NQ18HPYZ tag=Q6A2T9OMQVL6 type=write size=4122173 2024-09-12T00:09:40.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.844+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=8XY09434WHOM type=del size=229233 2024-09-12T00:09:40.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.845+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~5HY0MIASOV3U.0 size=1048576 2024-09-12T00:09:40.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.846+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~5HY0MIASOV3U.1 size=386225 2024-09-12T00:09:40.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.848+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=5HY0MIASOV3U tag=5H6Q0BP5LT38 type=write size=2483377 2024-09-12T00:09:40.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.850+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~QY2I4ROZOLQG.0 size=1048576 2024-09-12T00:09:40.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.851+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~QY2I4ROZOLQG.1 size=1048576 2024-09-12T00:09:40.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.853+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~QY2I4ROZOLQG.2 size=849979 2024-09-12T00:09:40.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.853+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=QY2I4ROZOLQG tag=XFX06JZM4A75 type=write size=3995707 2024-09-12T00:09:40.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.854+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DF5XNSCM4MCF.0 size=217390 2024-09-12T00:09:40.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.857+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=DF5XNSCM4MCF tag=YPN0EF6VY48O type=write size=1265966 2024-09-12T00:09:40.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.858+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=T6UHY84CGKMP type=del size=2649422 2024-09-12T00:09:40.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.859+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=G1UQXLRQGBQI type=del 2024-09-12T00:09:40.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.861+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=RMWB16FER9FY type=del size=3504374 2024-09-12T00:09:40.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.862+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~AE8IC3IL3GA4.0 size=1048576 2024-09-12T00:09:40.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.863+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~AE8IC3IL3GA4.1 size=811865 2024-09-12T00:09:40.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.865+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=AE8IC3IL3GA4 tag=8588LXLU5PC2 type=write size=2909017 2024-09-12T00:09:40.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.867+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=EWG27M22R0KZ type=write size=143022 2024-09-12T00:09:40.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.868+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=ONSJASBE0SEM type=del 2024-09-12T00:09:40.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.869+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=48JT2Z4JN1PX type=del size=887070 2024-09-12T00:09:40.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.870+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~979ZXHILX3MK.0 size=1048576 2024-09-12T00:09:40.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.871+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~979ZXHILX3MK.1 size=88827 2024-09-12T00:09:40.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.873+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=979ZXHILX3MK tag=RSQBHOJDUKW6 type=write size=2185979 2024-09-12T00:09:40.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.875+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=PEVVVRPP9YR1 type=del size=1309957 2024-09-12T00:09:40.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.876+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=LDA06LKXBW48 type=del 2024-09-12T00:09:40.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.879+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~PF85LISZV0BV.0 size=1048576 2024-09-12T00:09:40.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.880+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~PF85LISZV0BV.1 size=351244 2024-09-12T00:09:40.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.880+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=PF85LISZV0BV tag=4KWFV81XDLRI type=write size=2448396 2024-09-12T00:09:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.881+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~TVGDZSJHYF9H.0 size=1048576 2024-09-12T00:09:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.881+0000 7f3dc2c18780 1 < canceled part key=_multipart_415OYT4ML329.2~TVGDZSJHYF9H.1 size=1048576 2024-09-12T00:09:40.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.881+0000 7f3dc2c18780 1 < canceled part key=_multipart_415OYT4ML329.2~TVGDZSJHYF9H.2 size=588478 2024-09-12T00:09:40.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.883+0000 7f3dc2c18780 1 < canceled multipart upload key=415OYT4ML329 upload=TVGDZSJHYF9H tag=69MGOTW6O1RP type=write size=3734206 2024-09-12T00:09:40.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.885+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=HD9M88QVEREX type=del size=2571384 2024-09-12T00:09:40.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.886+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~SDN4L35FYQXV.0 size=1048576 2024-09-12T00:09:40.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.887+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~SDN4L35FYQXV.1 size=1048576 2024-09-12T00:09:40.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.888+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~SDN4L35FYQXV.2 size=810656 2024-09-12T00:09:40.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.890+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=SDN4L35FYQXV tag=FR11I03N28O0 type=write size=3956384 2024-09-12T00:09:40.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.893+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~6VKTF84C0G6O.0 size=1048576 2024-09-12T00:09:40.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.894+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~6VKTF84C0G6O.1 size=1048576 2024-09-12T00:09:40.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.894+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~6VKTF84C0G6O.2 size=190676 2024-09-12T00:09:40.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.894+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=6VKTF84C0G6O tag=H4T3FV9Z57QR type=write size=3336404 2024-09-12T00:09:40.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.897+0000 7f3dc2c18780 1 < suggested update operation key=GP3MLWX9586T tag=QAGGBUT4JQ22 type=del size=1898686 2024-09-12T00:09:40.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.898+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=JVS0BRQYY66J type=del size=252819 2024-09-12T00:09:40.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.899+0000 7f3dc2c18780 1 < canceled operation key=4POD73U0LAC0 tag=D151X8ME527F type=del size=3576779 2024-09-12T00:09:40.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.902+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~3NISJOKTBIP4.0 size=604965 2024-09-12T00:09:40.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.902+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=3NISJOKTBIP4 tag=OL4G8L28ZQRM type=write size=1653541 2024-09-12T00:09:40.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.903+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=BF9UT4GEH1P0 type=del 2024-09-12T00:09:40.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.904+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=E602X2PG55TW type=del size=1522111 2024-09-12T00:09:40.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.905+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=9YOT33KHLYKH type=del 2024-09-12T00:09:40.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.907+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=U2SSBJ5MQYNM type=write size=838351 2024-09-12T00:09:40.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.908+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=Q383FKNULGNK type=del 2024-09-12T00:09:40.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.909+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=A94AP1L1G3GK type=del size=4082764 2024-09-12T00:09:40.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.910+0000 7f3dc2c18780 1 < canceled operation key=GLAOX3ZNNILD tag=X9ETYPOFDG64 type=del size=1092566 2024-09-12T00:09:40.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.911+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=0A3KG2LIC4Q0 type=del size=129593 2024-09-12T00:09:40.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.914+0000 7f3dc2c18780 1 < suggested remove operation key=5F0BB9U7Y6ZZ tag=8XY09434WHOM type=del 2024-09-12T00:09:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.916+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~WS63JDOABFLL.0 size=1048576 2024-09-12T00:09:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.917+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~WS63JDOABFLL.1 size=1048576 2024-09-12T00:09:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.918+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~WS63JDOABFLL.2 size=571978 2024-09-12T00:09:40.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.918+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=WS63JDOABFLL tag=CZ0J5COTLPOE type=write size=3717706 2024-09-12T00:09:40.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.919+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~QY2I4ROZOLQG.0 size=1048576 2024-09-12T00:09:40.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.920+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~QY2I4ROZOLQG.1 size=1048576 2024-09-12T00:09:40.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.921+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~QY2I4ROZOLQG.2 size=849979 2024-09-12T00:09:40.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.923+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=QY2I4ROZOLQG tag=XFX06JZM4A75 type=write size=3995707 2024-09-12T00:09:40.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.924+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=KFX4SAHFU8RD type=del size=2591095 2024-09-12T00:09:40.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.926+0000 7f3dc2c18780 -1 < failed to complete operation key=5F0BB9U7Y6ZZ tag=T6UHY84CGKMP type=del size=2649422: (22) Invalid argument 2024-09-12T00:09:40.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.927+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=D6YOL8S7VFEL type=del size=1289445 2024-09-12T00:09:40.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.929+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=RMWB16FER9FY type=del 2024-09-12T00:09:40.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.930+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=S7ZZPSGXLNOO type=del size=2588765 2024-09-12T00:09:40.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.933+0000 7f3dc2c18780 1 < suggested update operation key=Y40G8SLO6AVH tag=EWG27M22R0KZ type=write size=143022 2024-09-12T00:09:40.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.934+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=0JG8N064R5QT type=write size=1041406 2024-09-12T00:09:40.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.936+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=48JT2Z4JN1PX type=del 2024-09-12T00:09:40.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.938+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~28LENPMS784A.0 size=1048576 2024-09-12T00:09:40.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.939+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~28LENPMS784A.1 size=697626 2024-09-12T00:09:40.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.939+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=28LENPMS784A tag=AILXTMTNUE81 type=write size=2794778 2024-09-12T00:09:40.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.941+0000 7f3dc2c18780 1 < canceled operation key=YYIQC6YL2PSW tag=PEVVVRPP9YR1 type=del size=1309957 2024-09-12T00:09:40.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.942+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=F1MIEOUZ8TGA type=write size=975716 2024-09-12T00:09:40.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.944+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~PF85LISZV0BV.0 size=1048576 2024-09-12T00:09:40.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.945+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~PF85LISZV0BV.1 size=351244 2024-09-12T00:09:40.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.947+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=PF85LISZV0BV tag=4KWFV81XDLRI type=write size=2448396 2024-09-12T00:09:40.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.949+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=75BLZ3Q0CYJK type=del size=590864 2024-09-12T00:09:40.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.950+0000 7f3dc2c18780 1 < canceled operation key=QJ3KML910OEL tag=HD9M88QVEREX type=del size=2571384 2024-09-12T00:09:40.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.952+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=DPLNT325BQDC type=del size=3592572 2024-09-12T00:09:40.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.953+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~6VKTF84C0G6O.0 size=1048576 2024-09-12T00:09:40.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.954+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~6VKTF84C0G6O.1 size=1048576 2024-09-12T00:09:40.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.955+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~6VKTF84C0G6O.2 size=190676 2024-09-12T00:09:40.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.958+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=6VKTF84C0G6O tag=H4T3FV9Z57QR type=write size=3336404 2024-09-12T00:09:40.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.959+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=PX08XXYWB1RT type=del size=4120077 2024-09-12T00:09:40.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.960+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=JVS0BRQYY66J type=del 2024-09-12T00:09:40.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.962+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~XV5RMUOVU4KF.0 size=1048576 2024-09-12T00:09:40.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.963+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~XV5RMUOVU4KF.1 size=1048576 2024-09-12T00:09:40.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.964+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~XV5RMUOVU4KF.2 size=168791 2024-09-12T00:09:40.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.964+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=XV5RMUOVU4KF tag=ZUA6DCS51ZKA type=write size=3314519 2024-09-12T00:09:40.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.966+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~3NISJOKTBIP4.0 size=604965 2024-09-12T00:09:40.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.968+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=3NISJOKTBIP4 tag=OL4G8L28ZQRM type=write size=1653541 2024-09-12T00:09:40.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.969+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=ZH452M384NW6 type=write size=165377 2024-09-12T00:09:40.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.971+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=E602X2PG55TW type=del 2024-09-12T00:09:40.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.974+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~E323RFJ8WCQ1.0 size=280696 2024-09-12T00:09:40.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.974+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=E323RFJ8WCQ1 tag=KDUF1JEU1OA7 type=write size=1329272 2024-09-12T00:09:40.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.976+0000 7f3dc2c18780 1 < suggested update operation key=QJ3KML910OEL tag=U2SSBJ5MQYNM type=write size=838351 2024-09-12T00:09:40.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.977+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=C4NLNAG5RTD0 type=del size=697894 2024-09-12T00:09:40.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.979+0000 7f3dc2c18780 1 < canceled operation key=KQWXE62PF5F7 tag=A94AP1L1G3GK type=del size=4082764 2024-09-12T00:09:40.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.980+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=BY3BEY9YQ5GI type=del size=2425846 2024-09-12T00:09:40.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.981+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=0A3KG2LIC4Q0 type=del 2024-09-12T00:09:40.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.983+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~WN3CZ0MMRQJP.0 size=156060 2024-09-12T00:09:40.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.983+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=WN3CZ0MMRQJP tag=ZBI0C1SES91T type=write size=1204636 2024-09-12T00:09:40.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.984+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~WS63JDOABFLL.0 size=1048576 2024-09-12T00:09:40.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.985+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~WS63JDOABFLL.1 size=1048576 2024-09-12T00:09:40.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.985+0000 7f3dc2c18780 1 < canceled part key=_multipart_Y40G8SLO6AVH.2~WS63JDOABFLL.2 size=571978 2024-09-12T00:09:40.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.987+0000 7f3dc2c18780 1 < canceled multipart upload key=Y40G8SLO6AVH upload=WS63JDOABFLL tag=CZ0J5COTLPOE type=write size=3717706 2024-09-12T00:09:40.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.988+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=QBAHW9ZB9EFF type=del size=348378 2024-09-12T00:09:40.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.991+0000 7f3dc2c18780 1 < suggested remove operation key=GLAOX3ZNNILD tag=KFX4SAHFU8RD type=del 2024-09-12T00:09:40.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.992+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=RKXRQNVWPGTT type=write size=945480 2024-09-12T00:09:40.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.994+0000 7f3dc2c18780 1 < suggested remove operation key=Y40G8SLO6AVH tag=D6YOL8S7VFEL type=del 2024-09-12T00:09:40.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.996+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~VWIHMUF9UKVD.0 size=664501 2024-09-12T00:09:40.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.996+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=VWIHMUF9UKVD tag=1ZW2T1J7XW4L type=write size=1713077 2024-09-12T00:09:40.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:40.999+0000 7f3dc2c18780 1 < canceled operation key=V0K5FRKYGJ0K tag=S7ZZPSGXLNOO type=del size=2588765 2024-09-12T00:09:40.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.000+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=ZI86W4LOY2FV type=del size=1330903 2024-09-12T00:09:41.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.001+0000 7f3dc2c18780 1 < completed write operation key=OGRGDIUO2W8B tag=0JG8N064R5QT type=write size=1041406 2024-09-12T00:09:41.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.002+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=URM0YTSPC6WA type=del size=1348996 2024-09-12T00:09:41.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.002+0000 7f3dc2c18780 1 < canceled part key=_multipart_GLAOX3ZNNILD.2~28LENPMS784A.0 size=1048576 2024-09-12T00:09:41.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.003+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~28LENPMS784A.1 size=697626 2024-09-12T00:09:41.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.006+0000 7f3dc2c18780 1 < canceled multipart upload key=GLAOX3ZNNILD upload=28LENPMS784A tag=AILXTMTNUE81 type=write size=2794778 2024-09-12T00:09:41.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.007+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=ZZPPFEMCUM6Z type=del size=1336442 2024-09-12T00:09:41.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.009+0000 7f3dc2c18780 1 < completed write operation key=2SO8HBZSAMRX tag=F1MIEOUZ8TGA type=write size=975716 2024-09-12T00:09:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.010+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=KE14IX4WVXCN type=del size=381176 2024-09-12T00:09:41.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.011+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=75BLZ3Q0CYJK type=del 2024-09-12T00:09:41.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.013+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~D26A7RS9KNS2.0 size=338421 2024-09-12T00:09:41.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.013+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=D26A7RS9KNS2 tag=9PFQAFHJVAIW type=write size=1386997 2024-09-12T00:09:41.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.015+0000 7f3dc2c18780 -1 < failed to complete operation key=GLAOX3ZNNILD tag=DPLNT325BQDC type=del size=3592572: (22) Invalid argument 2024-09-12T00:09:41.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.016+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=U8L5QX8R5J5P type=del size=1062425 2024-09-12T00:09:41.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.017+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=PX08XXYWB1RT type=del 2024-09-12T00:09:41.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.019+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=7V2O93G6UK7T type=del size=1138997 2024-09-12T00:09:41.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.020+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~XV5RMUOVU4KF.0 size=1048576 2024-09-12T00:09:41.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.021+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~XV5RMUOVU4KF.1 size=1048576 2024-09-12T00:09:41.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.022+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~XV5RMUOVU4KF.2 size=168791 2024-09-12T00:09:41.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.024+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=XV5RMUOVU4KF tag=ZUA6DCS51ZKA type=write size=3314519 2024-09-12T00:09:41.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.026+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~9NBEZO4GT3V4.0 size=1048576 2024-09-12T00:09:41.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.027+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~9NBEZO4GT3V4.1 size=1048576 2024-09-12T00:09:41.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.028+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~9NBEZO4GT3V4.2 size=1019647 2024-09-12T00:09:41.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.028+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=9NBEZO4GT3V4 tag=2HC72M2VHPKT type=write size=4165375 2024-09-12T00:09:41.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.030+0000 7f3dc2c18780 1 < completed write operation key=YYIQC6YL2PSW tag=ZH452M384NW6 type=write size=165377 2024-09-12T00:09:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.031+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=K6HS1L6XT93F type=del size=166664 2024-09-12T00:09:41.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.032+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~E323RFJ8WCQ1.0 size=280696 2024-09-12T00:09:41.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.034+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=E323RFJ8WCQ1 tag=KDUF1JEU1OA7 type=write size=1329272 2024-09-12T00:09:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.036+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~370YQSMTP7TM.0 size=1048576 2024-09-12T00:09:41.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.037+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~370YQSMTP7TM.1 size=1048576 2024-09-12T00:09:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.038+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~370YQSMTP7TM.2 size=95988 2024-09-12T00:09:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.038+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=370YQSMTP7TM tag=MOVD900PJHUF type=write size=3241716 2024-09-12T00:09:41.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.039+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=C4NLNAG5RTD0 type=del 2024-09-12T00:09:41.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.041+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=Z9SQQ0VIWCHW type=write size=11213 2024-09-12T00:09:41.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.042+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=BY3BEY9YQ5GI type=del 2024-09-12T00:09:41.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.044+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~8KM5VHSRKU6K.0 size=1048576 2024-09-12T00:09:41.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.045+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~8KM5VHSRKU6K.1 size=174868 2024-09-12T00:09:41.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.045+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=8KM5VHSRKU6K tag=0KVQ0SWHYYLU type=write size=2272020 2024-09-12T00:09:41.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.047+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~WN3CZ0MMRQJP.0 size=156060 2024-09-12T00:09:41.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.049+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=WN3CZ0MMRQJP tag=ZBI0C1SES91T type=write size=1204636 2024-09-12T00:09:41.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.051+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~U4OX7UJ342LK.0 size=427394 2024-09-12T00:09:41.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.051+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=U4OX7UJ342LK tag=6ZUZN07QJWYJ type=write size=1475970 2024-09-12T00:09:41.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.052+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=QBAHW9ZB9EFF type=del 2024-09-12T00:09:41.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.053+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=33CY61NXXAZ9 type=del size=3270746 2024-09-12T00:09:41.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.055+0000 7f3dc2c18780 1 < completed write operation key=GP3MLWX9586T tag=RKXRQNVWPGTT type=write size=945480 2024-09-12T00:09:41.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.056+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=ZZ9J2V8ZVX5U type=del size=602033 2024-09-12T00:09:41.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.057+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~VWIHMUF9UKVD.0 size=664501 2024-09-12T00:09:41.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.059+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=VWIHMUF9UKVD tag=1ZW2T1J7XW4L type=write size=1713077 2024-09-12T00:09:41.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.061+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~A28N7LNYJDB8.0 size=1048576 2024-09-12T00:09:41.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.062+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~A28N7LNYJDB8.1 size=1048576 2024-09-12T00:09:41.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.063+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~A28N7LNYJDB8.2 size=934675 2024-09-12T00:09:41.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.063+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=A28N7LNYJDB8 tag=O0F264ELVGWO type=write size=4080403 2024-09-12T00:09:41.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.065+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=ZI86W4LOY2FV type=del 2024-09-12T00:09:41.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.067+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~0BYZTWXL1L34.0 size=1048576 2024-09-12T00:09:41.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.069+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~0BYZTWXL1L34.1 size=1048576 2024-09-12T00:09:41.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.070+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~0BYZTWXL1L34.2 size=806270 2024-09-12T00:09:41.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.070+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=0BYZTWXL1L34 tag=J6PZPNA8YJN8 type=write size=3951998 2024-09-12T00:09:41.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.073+0000 7f3dc2c18780 1 < suggested update operation key=4POD73U0LAC0 tag=URM0YTSPC6WA type=del size=1348996 2024-09-12T00:09:41.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.074+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=T2RI5YHO42C7 type=del size=1206408 2024-09-12T00:09:41.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.075+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=ZZPPFEMCUM6Z type=del 2024-09-12T00:09:41.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.076+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=G2COVAIVLP29 type=del size=2273376 2024-09-12T00:09:41.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.078+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=KE14IX4WVXCN type=del 2024-09-12T00:09:41.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.080+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~ZYZO5GSMDHUM.0 size=1048576 2024-09-12T00:09:41.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.081+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~ZYZO5GSMDHUM.1 size=293955 2024-09-12T00:09:41.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.081+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=ZYZO5GSMDHUM tag=OVY4B564M1QG type=write size=2391107 2024-09-12T00:09:41.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.082+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~D26A7RS9KNS2.0 size=338421 2024-09-12T00:09:41.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.084+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=D26A7RS9KNS2 tag=9PFQAFHJVAIW type=write size=1386997 2024-09-12T00:09:41.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.085+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=185Z8Q50OWA3 type=del size=1940454 2024-09-12T00:09:41.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.087+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=U8L5QX8R5J5P type=del 2024-09-12T00:09:41.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.088+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=D2FAK94HVL30 type=write size=958362 2024-09-12T00:09:41.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.089+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=7V2O93G6UK7T type=del 2024-09-12T00:09:41.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.090+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=LQFMZJW84H09 type=del size=2963635 2024-09-12T00:09:41.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.093+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~9NBEZO4GT3V4.0 size=1048576 2024-09-12T00:09:41.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.094+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~9NBEZO4GT3V4.1 size=1048576 2024-09-12T00:09:41.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.095+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~9NBEZO4GT3V4.2 size=1019647 2024-09-12T00:09:41.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.097+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=9NBEZO4GT3V4 tag=2HC72M2VHPKT type=write size=4165375 2024-09-12T00:09:41.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.098+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=QQG826FB468J type=del size=3557381 2024-09-12T00:09:41.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.100+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=K6HS1L6XT93F type=del 2024-09-12T00:09:41.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.101+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=44I6KKOJUK3E type=del size=2899351 2024-09-12T00:09:41.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.102+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~370YQSMTP7TM.0 size=1048576 2024-09-12T00:09:41.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.104+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~370YQSMTP7TM.1 size=1048576 2024-09-12T00:09:41.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.104+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~370YQSMTP7TM.2 size=95988 2024-09-12T00:09:41.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.107+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=370YQSMTP7TM tag=MOVD900PJHUF type=write size=3241716 2024-09-12T00:09:41.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.108+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=3WACG476PWT8 type=del size=3481659 2024-09-12T00:09:41.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.111+0000 7f3dc2c18780 1 < suggested update operation key=3WUIB2OMX77J tag=Z9SQQ0VIWCHW type=write size=11213 2024-09-12T00:09:41.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.113+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~6GVL3T682UHY.0 size=1048576 2024-09-12T00:09:41.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.114+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~6GVL3T682UHY.1 size=545338 2024-09-12T00:09:41.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.114+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=6GVL3T682UHY tag=59MS4N2QOVWQ type=write size=2642490 2024-09-12T00:09:41.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.114+0000 7f3dc2c18780 1 < canceled part key=_multipart_UJDQEIAIRVDW.2~8KM5VHSRKU6K.0 size=1048576 2024-09-12T00:09:41.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.116+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~8KM5VHSRKU6K.1 size=174868 2024-09-12T00:09:41.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.119+0000 7f3dc2c18780 1 < canceled multipart upload key=UJDQEIAIRVDW upload=8KM5VHSRKU6K tag=0KVQ0SWHYYLU type=write size=2272020 2024-09-12T00:09:41.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.122+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~A5983H3LXX90.0 size=1048576 2024-09-12T00:09:41.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.123+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~A5983H3LXX90.1 size=1043544 2024-09-12T00:09:41.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.123+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=A5983H3LXX90 tag=91C4V0NN1EQL type=write size=3140696 2024-09-12T00:09:41.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.124+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~U4OX7UJ342LK.0 size=427394 2024-09-12T00:09:41.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.127+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=U4OX7UJ342LK tag=6ZUZN07QJWYJ type=write size=1475970 2024-09-12T00:09:41.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.129+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~H5NX9UQOPPDT.0 size=1048576 2024-09-12T00:09:41.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.130+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~H5NX9UQOPPDT.1 size=1048576 2024-09-12T00:09:41.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.131+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~H5NX9UQOPPDT.2 size=872489 2024-09-12T00:09:41.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.131+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=H5NX9UQOPPDT tag=7K14W1L87SQ2 type=write size=4018217 2024-09-12T00:09:41.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.133+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=33CY61NXXAZ9 type=del 2024-09-12T00:09:41.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.134+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=6G3I5GKZ9YUM type=del size=851123 2024-09-12T00:09:41.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.135+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=ZZ9J2V8ZVX5U type=del 2024-09-12T00:09:41.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.137+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=XAYU6R3AL68Y type=del size=2582560 2024-09-12T00:09:41.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.138+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~A28N7LNYJDB8.0 size=1048576 2024-09-12T00:09:41.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.139+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~A28N7LNYJDB8.1 size=1048576 2024-09-12T00:09:41.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.139+0000 7f3dc2c18780 1 < canceled part key=_multipart_C0JT46SGECP0.2~A28N7LNYJDB8.2 size=934675 2024-09-12T00:09:41.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.142+0000 7f3dc2c18780 1 < canceled multipart upload key=C0JT46SGECP0 upload=A28N7LNYJDB8 tag=O0F264ELVGWO type=write size=4080403 2024-09-12T00:09:41.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.143+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=RYJKXYJYRKAS type=del size=810595 2024-09-12T00:09:41.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.144+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~0BYZTWXL1L34.0 size=1048576 2024-09-12T00:09:41.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.145+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~0BYZTWXL1L34.1 size=1048576 2024-09-12T00:09:41.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.145+0000 7f3dc2c18780 1 < canceled part key=_multipart_7JVCFTM2QMGY.2~0BYZTWXL1L34.2 size=806270 2024-09-12T00:09:41.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.147+0000 7f3dc2c18780 1 < canceled multipart upload key=7JVCFTM2QMGY upload=0BYZTWXL1L34 tag=J6PZPNA8YJN8 type=write size=3951998 2024-09-12T00:09:41.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.150+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~A7GE9LXLQ2YQ.0 size=515742 2024-09-12T00:09:41.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.150+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=A7GE9LXLQ2YQ tag=3O4N8V85P1RK type=write size=1564318 2024-09-12T00:09:41.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.152+0000 7f3dc2c18780 1 < suggested update operation key=C7ZOCTAR2BEP tag=T2RI5YHO42C7 type=del size=1206408 2024-09-12T00:09:41.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.153+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=GO1K1NU06P13 type=del size=2724786 2024-09-12T00:09:41.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.156+0000 7f3dc2c18780 1 < suggested update operation key=A4O7JFS2ULY0 tag=G2COVAIVLP29 type=del size=2273376 2024-09-12T00:09:41.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.157+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=OYVLV1UB9TOO type=del size=2767288 2024-09-12T00:09:41.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.158+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~ZYZO5GSMDHUM.0 size=1048576 2024-09-12T00:09:41.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.159+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~ZYZO5GSMDHUM.1 size=293955 2024-09-12T00:09:41.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.161+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=ZYZO5GSMDHUM tag=OVY4B564M1QG type=write size=2391107 2024-09-12T00:09:41.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.162+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=URZFH0DYT6PW type=write size=64231 2024-09-12T00:09:41.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.163+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=185Z8Q50OWA3 type=del 2024-09-12T00:09:41.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.166+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~7H2G1FI1H7KY.0 size=1048576 2024-09-12T00:09:41.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.167+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~7H2G1FI1H7KY.1 size=1048576 2024-09-12T00:09:41.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.168+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~7H2G1FI1H7KY.2 size=670304 2024-09-12T00:09:41.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.168+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=7H2G1FI1H7KY tag=SD05WWR5M0AX type=write size=3816032 2024-09-12T00:09:41.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.169+0000 7f3dc2c18780 1 < completed write operation key=U2H0A1GZROT7 tag=D2FAK94HVL30 type=write size=958362 2024-09-12T00:09:41.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.171+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~N2RZYH26191Q.0 size=1048576 2024-09-12T00:09:41.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.172+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~N2RZYH26191Q.1 size=196870 2024-09-12T00:09:41.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.172+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=N2RZYH26191Q tag=4XQA98TDG94L type=write size=2294022 2024-09-12T00:09:41.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.174+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=LQFMZJW84H09 type=del 2024-09-12T00:09:41.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.175+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=5J6HIT53S3ZU type=del size=3484347 2024-09-12T00:09:41.175 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.176+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=QQG826FB468J type=del 2024-09-12T00:09:41.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.179+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~QDR2PHCS75H5.0 size=1048576 2024-09-12T00:09:41.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.180+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~QDR2PHCS75H5.1 size=1048576 2024-09-12T00:09:41.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.181+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~QDR2PHCS75H5.2 size=924567 2024-09-12T00:09:41.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.181+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=QDR2PHCS75H5 tag=80B6IA7R2MG3 type=write size=4070295 2024-09-12T00:09:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.183+0000 7f3dc2c18780 1 < suggested remove operation key=0ICU4WV9K1RG tag=44I6KKOJUK3E type=del 2024-09-12T00:09:41.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.184+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=T63UAH6U82BG type=write size=191711 2024-09-12T00:09:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.186+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=3WACG476PWT8 type=del 2024-09-12T00:09:41.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.188+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~267BJ5XU6GHS.0 size=1048576 2024-09-12T00:09:41.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.189+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~267BJ5XU6GHS.1 size=513396 2024-09-12T00:09:41.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.189+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=267BJ5XU6GHS tag=O1UQYHW1E86P type=write size=2610548 2024-09-12T00:09:41.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.190+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~6GVL3T682UHY.0 size=1048576 2024-09-12T00:09:41.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.191+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~6GVL3T682UHY.1 size=545338 2024-09-12T00:09:41.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.193+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=6GVL3T682UHY tag=59MS4N2QOVWQ type=write size=2642490 2024-09-12T00:09:41.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.195+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=72X5UBF6FX2F type=write size=10887 2024-09-12T00:09:41.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.196+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~A5983H3LXX90.0 size=1048576 2024-09-12T00:09:41.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.197+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~A5983H3LXX90.1 size=1043544 2024-09-12T00:09:41.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.199+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=A5983H3LXX90 tag=91C4V0NN1EQL type=write size=3140696 2024-09-12T00:09:41.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.200+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=NDBWPRCVTL5G type=del size=957915 2024-09-12T00:09:41.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.201+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~H5NX9UQOPPDT.0 size=1048576 2024-09-12T00:09:41.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.202+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~H5NX9UQOPPDT.1 size=1048576 2024-09-12T00:09:41.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.203+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~H5NX9UQOPPDT.2 size=872489 2024-09-12T00:09:41.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.205+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=H5NX9UQOPPDT tag=7K14W1L87SQ2 type=write size=4018217 2024-09-12T00:09:41.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.206+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=33X1V8OH1MCK type=write size=592528 2024-09-12T00:09:41.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.208+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=6G3I5GKZ9YUM type=del 2024-09-12T00:09:41.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.209+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=05LAULRE34Q3 type=del size=3452538 2024-09-12T00:09:41.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.210+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=XAYU6R3AL68Y type=del 2024-09-12T00:09:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.212+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=MACPBTLXAJC8 type=del size=1393954 2024-09-12T00:09:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.213+0000 7f3dc2c18780 -1 < failed to complete operation key=0ICU4WV9K1RG tag=RYJKXYJYRKAS type=del size=810595: (22) Invalid argument 2024-09-12T00:09:41.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.214+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=UFB28OX9YE9D type=del size=1884902 2024-09-12T00:09:41.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.215+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~A7GE9LXLQ2YQ.0 size=515742 2024-09-12T00:09:41.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.217+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=A7GE9LXLQ2YQ tag=3O4N8V85P1RK type=write size=1564318 2024-09-12T00:09:41.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.218+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=B6QIGKYGIELP type=del size=723788 2024-09-12T00:09:41.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.220+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=GO1K1NU06P13 type=del 2024-09-12T00:09:41.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.222+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~UXQ10QFOAWHM.0 size=1048576 2024-09-12T00:09:41.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.223+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~UXQ10QFOAWHM.1 size=1048576 2024-09-12T00:09:41.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.224+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~UXQ10QFOAWHM.2 size=25072 2024-09-12T00:09:41.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.224+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=UXQ10QFOAWHM tag=G4QLSKZB3HXG type=write size=3170800 2024-09-12T00:09:41.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.225+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=OYVLV1UB9TOO type=del 2024-09-12T00:09:41.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.227+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=3HPKAG06Z0UV type=del size=2002107 2024-09-12T00:09:41.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.228+0000 7f3dc2c18780 1 < completed write operation key=415OYT4ML329 tag=URZFH0DYT6PW type=write size=64231 2024-09-12T00:09:41.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.229+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=O29O49T3XQC2 type=del size=732248 2024-09-12T00:09:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.230+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~7H2G1FI1H7KY.0 size=1048576 2024-09-12T00:09:41.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.231+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~7H2G1FI1H7KY.1 size=1048576 2024-09-12T00:09:41.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.232+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~7H2G1FI1H7KY.2 size=670304 2024-09-12T00:09:41.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.235+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=7H2G1FI1H7KY tag=SD05WWR5M0AX type=write size=3816032 2024-09-12T00:09:41.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.237+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=O7XIMH5LJ8P0 type=del size=3305644 2024-09-12T00:09:41.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.240+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~N2RZYH26191Q.0 size=1048576 2024-09-12T00:09:41.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.242+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~N2RZYH26191Q.1 size=196870 2024-09-12T00:09:41.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.245+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=N2RZYH26191Q tag=4XQA98TDG94L type=write size=2294022 2024-09-12T00:09:41.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.247+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~CXT7NNXTRKMJ.0 size=499334 2024-09-12T00:09:41.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.247+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=CXT7NNXTRKMJ tag=2LGRER1BFQLN type=write size=1547910 2024-09-12T00:09:41.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.248+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=5J6HIT53S3ZU type=del 2024-09-12T00:09:41.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.249+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=44RSXF70Y6WD type=del size=37330 2024-09-12T00:09:41.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.251+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~QDR2PHCS75H5.0 size=1048576 2024-09-12T00:09:41.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.251+0000 7f3dc2c18780 1 < canceled part key=_multipart_65DTZR8A5OHF.2~QDR2PHCS75H5.1 size=1048576 2024-09-12T00:09:41.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.252+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~QDR2PHCS75H5.2 size=924567 2024-09-12T00:09:41.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.254+0000 7f3dc2c18780 1 < canceled multipart upload key=65DTZR8A5OHF upload=QDR2PHCS75H5 tag=80B6IA7R2MG3 type=write size=4070295 2024-09-12T00:09:41.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.256+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~0E9OEOIJY66M.0 size=1048576 2024-09-12T00:09:41.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.257+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~0E9OEOIJY66M.1 size=119998 2024-09-12T00:09:41.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.257+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=0E9OEOIJY66M tag=OXEZ92EQZZMI type=write size=2217150 2024-09-12T00:09:41.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.259+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=T63UAH6U82BG type=write size=191711 2024-09-12T00:09:41.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.260+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=IRQ552K0ITVF type=del size=1585634 2024-09-12T00:09:41.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.261+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~267BJ5XU6GHS.0 size=1048576 2024-09-12T00:09:41.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.262+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~267BJ5XU6GHS.1 size=513396 2024-09-12T00:09:41.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.264+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=267BJ5XU6GHS tag=O1UQYHW1E86P type=write size=2610548 2024-09-12T00:09:41.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.265+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=HR5MF2I601PH type=write size=97250 2024-09-12T00:09:41.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.266+0000 7f3dc2c18780 1 < completed write operation key=GLAOX3ZNNILD tag=72X5UBF6FX2F type=write size=10887 2024-09-12T00:09:41.266 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.268+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=4QXK761W5Y6A type=del size=3145348 2024-09-12T00:09:41.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.270+0000 7f3dc2c18780 1 < suggested update operation key=5F0BB9U7Y6ZZ tag=NDBWPRCVTL5G type=del size=957915 2024-09-12T00:09:41.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.272+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~MMBQZM746HQG.0 size=1048576 2024-09-12T00:09:41.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.273+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~MMBQZM746HQG.1 size=508888 2024-09-12T00:09:41.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.273+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=MMBQZM746HQG tag=DFRLZ8I4U0WN type=write size=2606040 2024-09-12T00:09:41.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.276+0000 7f3dc2c18780 1 < suggested remove operation key=OGRGDIUO2W8B tag=33X1V8OH1MCK type=write 2024-09-12T00:09:41.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.277+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=1XJOOVHCM5US type=del size=136971 2024-09-12T00:09:41.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.278+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=05LAULRE34Q3 type=del 2024-09-12T00:09:41.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.280+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~QKJEUGOS9X0L.0 size=261055 2024-09-12T00:09:41.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.280+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=QKJEUGOS9X0L tag=28D9ES5296DM type=write size=1309631 2024-09-12T00:09:41.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.282+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=MACPBTLXAJC8 type=del 2024-09-12T00:09:41.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.283+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=01RSGAGAMINJ type=del size=302012 2024-09-12T00:09:41.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.284+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=UFB28OX9YE9D type=del 2024-09-12T00:09:41.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.285+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=TL2SPSTEYJDI type=del size=1592233 2024-09-12T00:09:41.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.286+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=B6QIGKYGIELP type=del 2024-09-12T00:09:41.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.288+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=5UKW61CCE543 type=write size=650576 2024-09-12T00:09:41.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.289+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~UXQ10QFOAWHM.0 size=1048576 2024-09-12T00:09:41.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.290+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~UXQ10QFOAWHM.1 size=1048576 2024-09-12T00:09:41.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.291+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~UXQ10QFOAWHM.2 size=25072 2024-09-12T00:09:41.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.293+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=UXQ10QFOAWHM tag=G4QLSKZB3HXG type=write size=3170800 2024-09-12T00:09:41.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.294+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=RUYT7ZLPG6YI type=write size=640082 2024-09-12T00:09:41.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.295+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=3HPKAG06Z0UV type=del 2024-09-12T00:09:41.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.296+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=RYEMDEJ10ZZ8 type=del size=1440932 2024-09-12T00:09:41.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.298+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=O29O49T3XQC2 type=del 2024-09-12T00:09:41.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.300+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~2RX1XTHCO9WV.0 size=1048576 2024-09-12T00:09:41.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.301+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~2RX1XTHCO9WV.1 size=1048576 2024-09-12T00:09:41.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.302+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~2RX1XTHCO9WV.2 size=784341 2024-09-12T00:09:41.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.302+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=2RX1XTHCO9WV tag=RGLORCALXXVP type=write size=3930069 2024-09-12T00:09:41.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.303+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=O7XIMH5LJ8P0 type=del 2024-09-12T00:09:41.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.304+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=1QUSWCKZJ6Z0 type=del size=850808 2024-09-12T00:09:41.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.305+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~CXT7NNXTRKMJ.0 size=499334 2024-09-12T00:09:41.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.307+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=CXT7NNXTRKMJ tag=2LGRER1BFQLN type=write size=1547910 2024-09-12T00:09:41.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.308+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=FI60IVAGYE3F type=write size=870177 2024-09-12T00:09:41.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.310+0000 7f3dc2c18780 1 < canceled operation key=5BM1TMLRBHTS tag=44RSXF70Y6WD type=del size=37330 2024-09-12T00:09:41.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.312+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~ZNWJ373OCM1C.0 size=561141 2024-09-12T00:09:41.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.312+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=ZNWJ373OCM1C tag=2T4K2DUH0IMQ type=write size=1609717 2024-09-12T00:09:41.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.313+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~0E9OEOIJY66M.0 size=1048576 2024-09-12T00:09:41.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.314+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~0E9OEOIJY66M.1 size=119998 2024-09-12T00:09:41.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.316+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=0E9OEOIJY66M tag=OXEZ92EQZZMI type=write size=2217150 2024-09-12T00:09:41.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.318+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=LEJLU5MII7BL type=write size=122098 2024-09-12T00:09:41.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.319+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=IRQ552K0ITVF type=del 2024-09-12T00:09:41.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.321+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~A8RIJ6X1GJZG.0 size=1048576 2024-09-12T00:09:41.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.322+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~A8RIJ6X1GJZG.1 size=146294 2024-09-12T00:09:41.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.322+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=A8RIJ6X1GJZG tag=MVA8FV43MJS0 type=write size=2243446 2024-09-12T00:09:41.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.325+0000 7f3dc2c18780 1 < suggested update operation key=V0K5FRKYGJ0K tag=HR5MF2I601PH type=write size=97250 2024-09-12T00:09:41.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.326+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=ZDFC34CM4XZK type=del size=4131953 2024-09-12T00:09:41.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.327+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=4QXK761W5Y6A type=del 2024-09-12T00:09:41.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.329+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~GNR1VZ4ARX5D.0 size=440397 2024-09-12T00:09:41.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.329+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=GNR1VZ4ARX5D tag=L4RTRDDRJOZA type=write size=1488973 2024-09-12T00:09:41.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.331+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~MMBQZM746HQG.0 size=1048576 2024-09-12T00:09:41.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.332+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~MMBQZM746HQG.1 size=508888 2024-09-12T00:09:41.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.334+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=MMBQZM746HQG tag=DFRLZ8I4U0WN type=write size=2606040 2024-09-12T00:09:41.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.335+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=PMS1JXTL73GY type=del size=3779756 2024-09-12T00:09:41.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.337+0000 7f3dc2c18780 1 < suggested remove operation key=XNZNORKYEOPV tag=1XJOOVHCM5US type=del 2024-09-12T00:09:41.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.339+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=K9LFH909U1S5 type=del size=3685326 2024-09-12T00:09:41.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.340+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~QKJEUGOS9X0L.0 size=261055 2024-09-12T00:09:41.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.342+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=QKJEUGOS9X0L tag=28D9ES5296DM type=write size=1309631 2024-09-12T00:09:41.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.344+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~I0PAQAOBQMYZ.0 size=1048576 2024-09-12T00:09:41.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.345+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~I0PAQAOBQMYZ.1 size=870749 2024-09-12T00:09:41.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.345+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=I0PAQAOBQMYZ tag=MA85CR1LLYLO type=write size=2967901 2024-09-12T00:09:41.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.346+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=01RSGAGAMINJ type=del 2024-09-12T00:09:41.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.348+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=JHT776Z0P4QJ type=del size=877526 2024-09-12T00:09:41.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.349+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=TL2SPSTEYJDI type=del 2024-09-12T00:09:41.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.351+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~1MNN56RNKU0L.0 size=1048576 2024-09-12T00:09:41.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.352+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~1MNN56RNKU0L.1 size=78214 2024-09-12T00:09:41.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.352+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=1MNN56RNKU0L tag=LMB47HUZZMDA type=write size=2175366 2024-09-12T00:09:41.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.353+0000 7f3dc2c18780 1 < completed write operation key=5CS98S02F59L tag=5UKW61CCE543 type=write size=650576 2024-09-12T00:09:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.356+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~SJT0KY7UIH2N.0 size=1048576 2024-09-12T00:09:41.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.357+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~SJT0KY7UIH2N.1 size=1048576 2024-09-12T00:09:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.359+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~SJT0KY7UIH2N.2 size=373638 2024-09-12T00:09:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.359+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=SJT0KY7UIH2N tag=KLITAQKUGUNA type=write size=3519366 2024-09-12T00:09:41.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.360+0000 7f3dc2c18780 1 < completed write operation key=L9C014T8YLNV tag=RUYT7ZLPG6YI type=write size=640082 2024-09-12T00:09:41.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.361+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=QQFCOJUAPHJA type=del size=1691530 2024-09-12T00:09:41.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.362+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=RYEMDEJ10ZZ8 type=del 2024-09-12T00:09:41.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.364+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=RVQTLZVHNVLR type=del size=1808365 2024-09-12T00:09:41.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.365+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~2RX1XTHCO9WV.0 size=1048576 2024-09-12T00:09:41.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.366+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~2RX1XTHCO9WV.1 size=1048576 2024-09-12T00:09:41.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.367+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~2RX1XTHCO9WV.2 size=784341 2024-09-12T00:09:41.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.369+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=2RX1XTHCO9WV tag=RGLORCALXXVP type=write size=3930069 2024-09-12T00:09:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.370+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=9T5CAH2BKOYA type=del size=2065860 2024-09-12T00:09:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.372+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=1QUSWCKZJ6Z0 type=del 2024-09-12T00:09:41.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.373+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=M31MKU1D8H6C type=del size=1410245 2024-09-12T00:09:41.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.374+0000 7f3dc2c18780 1 < completed write operation key=5BM1TMLRBHTS tag=FI60IVAGYE3F type=write size=870177 2024-09-12T00:09:41.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.376+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~K36Y7QSLBUXK.0 size=1048576 2024-09-12T00:09:41.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.377+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~K36Y7QSLBUXK.1 size=1048576 2024-09-12T00:09:41.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.378+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~K36Y7QSLBUXK.2 size=800023 2024-09-12T00:09:41.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.378+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=K36Y7QSLBUXK tag=EYD5K5NH6UMR type=write size=3945751 2024-09-12T00:09:41.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.379+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~ZNWJ373OCM1C.0 size=561141 2024-09-12T00:09:41.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.382+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=ZNWJ373OCM1C tag=2T4K2DUH0IMQ type=write size=1609717 2024-09-12T00:09:41.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.383+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=MIGI8ILJPA11 type=write size=241352 2024-09-12T00:09:41.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.385+0000 7f3dc2c18780 1 < suggested remove operation key=3WUIB2OMX77J tag=LEJLU5MII7BL type=write 2024-09-12T00:09:41.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.386+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=GLUDHPARBSH7 type=del size=2075810 2024-09-12T00:09:41.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.388+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~A8RIJ6X1GJZG.0 size=1048576 2024-09-12T00:09:41.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.389+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~A8RIJ6X1GJZG.1 size=146294 2024-09-12T00:09:41.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.391+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=A8RIJ6X1GJZG tag=MVA8FV43MJS0 type=write size=2243446 2024-09-12T00:09:41.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.392+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=TID1F0IWMSDP type=del size=1375326 2024-09-12T00:09:41.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.393+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=ZDFC34CM4XZK type=del 2024-09-12T00:09:41.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.394+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=02GA506N2GCP type=del size=3955035 2024-09-12T00:09:41.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.396+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~GNR1VZ4ARX5D.0 size=440397 2024-09-12T00:09:41.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.398+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=GNR1VZ4ARX5D tag=L4RTRDDRJOZA type=write size=1488973 2024-09-12T00:09:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.400+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~W461EVJ88MQ6.0 size=838950 2024-09-12T00:09:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.400+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=W461EVJ88MQ6 tag=FKHTI8QWMM7Z type=write size=1887526 2024-09-12T00:09:41.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.401+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=PMS1JXTL73GY type=del 2024-09-12T00:09:41.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.402+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=CRVAM1CB3YYF type=del size=1194845 2024-09-12T00:09:41.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.404+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=K9LFH909U1S5 type=del 2024-09-12T00:09:41.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.405+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=J2D2BAC20ZH1 type=del size=640398 2024-09-12T00:09:41.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.406+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~I0PAQAOBQMYZ.0 size=1048576 2024-09-12T00:09:41.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.407+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~I0PAQAOBQMYZ.1 size=870749 2024-09-12T00:09:41.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.409+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=I0PAQAOBQMYZ tag=MA85CR1LLYLO type=write size=2967901 2024-09-12T00:09:41.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.410+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=347GXUQ4K068 type=del size=829766 2024-09-12T00:09:41.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.412+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=JHT776Z0P4QJ type=del 2024-09-12T00:09:41.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.413+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=96JQX99BVS88 type=del size=3226104 2024-09-12T00:09:41.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.413+0000 7f3dc2c18780 1 < canceled part key=_multipart_UJDQEIAIRVDW.2~1MNN56RNKU0L.0 size=1048576 2024-09-12T00:09:41.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.414+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~1MNN56RNKU0L.1 size=78214 2024-09-12T00:09:41.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.416+0000 7f3dc2c18780 1 < canceled multipart upload key=UJDQEIAIRVDW upload=1MNN56RNKU0L tag=LMB47HUZZMDA type=write size=2175366 2024-09-12T00:09:41.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.419+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~AX2G13DJUAL3.0 size=1048576 2024-09-12T00:09:41.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.420+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~AX2G13DJUAL3.1 size=442892 2024-09-12T00:09:41.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.420+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=AX2G13DJUAL3 tag=4OBV9R4G84FW type=write size=2540044 2024-09-12T00:09:41.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.421+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~SJT0KY7UIH2N.0 size=1048576 2024-09-12T00:09:41.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.422+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~SJT0KY7UIH2N.1 size=1048576 2024-09-12T00:09:41.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.423+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~SJT0KY7UIH2N.2 size=373638 2024-09-12T00:09:41.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.426+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=SJT0KY7UIH2N tag=KLITAQKUGUNA type=write size=3519366 2024-09-12T00:09:41.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.428+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~TXPW7CWIQER5.0 size=832200 2024-09-12T00:09:41.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.428+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=TXPW7CWIQER5 tag=E1ZE9X98KTTA type=write size=1880776 2024-09-12T00:09:41.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.429+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=QQFCOJUAPHJA type=del 2024-09-12T00:09:41.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.430+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=K3L8X4RT1XM4 type=del size=38906 2024-09-12T00:09:41.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.432+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=RVQTLZVHNVLR type=del 2024-09-12T00:09:41.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.434+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~XHR1HCG4V61G.0 size=1048576 2024-09-12T00:09:41.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.435+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~XHR1HCG4V61G.1 size=533247 2024-09-12T00:09:41.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.435+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=XHR1HCG4V61G tag=F479QO38R4IR type=write size=2630399 2024-09-12T00:09:41.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.436+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=9T5CAH2BKOYA type=del 2024-09-12T00:09:41.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.437+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=79TY20LQ43O0 type=del size=2497947 2024-09-12T00:09:41.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.439+0000 7f3dc2c18780 -1 < failed to complete operation key=3WUIB2OMX77J tag=M31MKU1D8H6C type=del size=1410245: (22) Invalid argument 2024-09-12T00:09:41.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.440+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=8VD1Q4M7UCAH type=write size=224219 2024-09-12T00:09:41.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.441+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~K36Y7QSLBUXK.0 size=1048576 2024-09-12T00:09:41.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.442+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~K36Y7QSLBUXK.1 size=1048576 2024-09-12T00:09:41.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.442+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~K36Y7QSLBUXK.2 size=800023 2024-09-12T00:09:41.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.444+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=K36Y7QSLBUXK tag=EYD5K5NH6UMR type=write size=3945751 2024-09-12T00:09:41.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.445+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=6DGXX3O3BPOU type=del size=457608 2024-09-12T00:09:41.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.447+0000 7f3dc2c18780 1 < canceled operation key=WRR6LAYIWOCE tag=MIGI8ILJPA11 type=write size=241352 2024-09-12T00:09:41.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.448+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=EC9TTEJSU9GZ type=del size=3812191 2024-09-12T00:09:41.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.449+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=GLUDHPARBSH7 type=del 2024-09-12T00:09:41.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.450+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=KON41F8HP5G9 type=del size=2811922 2024-09-12T00:09:41.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.451+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=TID1F0IWMSDP type=del 2024-09-12T00:09:41.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.453+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=032DEK4AKQHQ type=del size=3471285 2024-09-12T00:09:41.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.454+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=02GA506N2GCP type=del 2024-09-12T00:09:41.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.455+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=U4GMUNRCLI3T type=del size=3034090 2024-09-12T00:09:41.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.456+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~W461EVJ88MQ6.0 size=838950 2024-09-12T00:09:41.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.458+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=W461EVJ88MQ6 tag=FKHTI8QWMM7Z type=write size=1887526 2024-09-12T00:09:41.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.460+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=JSVWNEWSMT5C type=del size=2852988 2024-09-12T00:09:41.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.461+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=CRVAM1CB3YYF type=del 2024-09-12T00:09:41.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.463+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~PQO9ZUAKL7RJ.0 size=818404 2024-09-12T00:09:41.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.463+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=PQO9ZUAKL7RJ tag=WB2S7GQOR4YC type=write size=1866980 2024-09-12T00:09:41.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.464+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=J2D2BAC20ZH1 type=del 2024-09-12T00:09:41.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.465+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=KDREG7FZ33JL type=del size=99080 2024-09-12T00:09:41.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.468+0000 7f3dc2c18780 1 < suggested remove operation key=2SO8HBZSAMRX tag=347GXUQ4K068 type=del 2024-09-12T00:09:41.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.469+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=DB7MO8FWFEGA type=write size=182231 2024-09-12T00:09:41.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.470+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=96JQX99BVS88 type=del 2024-09-12T00:09:41.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.474+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~RJLENI32TO5Y.0 size=1048576 2024-09-12T00:09:41.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.475+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~RJLENI32TO5Y.1 size=1048576 2024-09-12T00:09:41.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.476+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~RJLENI32TO5Y.2 size=735292 2024-09-12T00:09:41.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.476+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=RJLENI32TO5Y tag=WD7AOO1314UF type=write size=3881020 2024-09-12T00:09:41.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.477+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~AX2G13DJUAL3.0 size=1048576 2024-09-12T00:09:41.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.478+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~AX2G13DJUAL3.1 size=442892 2024-09-12T00:09:41.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.480+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=AX2G13DJUAL3 tag=4OBV9R4G84FW type=write size=2540044 2024-09-12T00:09:41.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.482+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=JLC15ZDW5Y1E type=del size=2241711 2024-09-12T00:09:41.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.483+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~TXPW7CWIQER5.0 size=832200 2024-09-12T00:09:41.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.485+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=TXPW7CWIQER5 tag=E1ZE9X98KTTA type=write size=1880776 2024-09-12T00:09:41.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.486+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=RCWRC90PXG4U type=del size=3803413 2024-09-12T00:09:41.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.488+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=K3L8X4RT1XM4 type=del 2024-09-12T00:09:41.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.490+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~NNF1G1TR11D7.0 size=1048576 2024-09-12T00:09:41.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.491+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~NNF1G1TR11D7.1 size=357649 2024-09-12T00:09:41.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.491+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=NNF1G1TR11D7 tag=U913YFAPC62K type=write size=2454801 2024-09-12T00:09:41.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.493+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~XHR1HCG4V61G.0 size=1048576 2024-09-12T00:09:41.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.494+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~XHR1HCG4V61G.1 size=533247 2024-09-12T00:09:41.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.496+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=XHR1HCG4V61G tag=F479QO38R4IR type=write size=2630399 2024-09-12T00:09:41.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.499+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~W894ML36EB3Y.0 size=1048576 2024-09-12T00:09:41.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.500+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~W894ML36EB3Y.1 size=168047 2024-09-12T00:09:41.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.500+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=W894ML36EB3Y tag=5G7ARZ3FQFH4 type=write size=2265199 2024-09-12T00:09:41.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.503+0000 7f3dc2c18780 1 < suggested update operation key=5MAV2RJ4E31S tag=79TY20LQ43O0 type=del size=2497947 2024-09-12T00:09:41.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.506+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~BE8MN0GO1DSK.0 size=628612 2024-09-12T00:09:41.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.506+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=BE8MN0GO1DSK tag=VYIA2J8DR07U type=write size=1677188 2024-09-12T00:09:41.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.507+0000 7f3dc2c18780 1 < completed write operation key=GP3MLWX9586T tag=8VD1Q4M7UCAH type=write size=224219 2024-09-12T00:09:41.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.509+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=099MJI0GWVPN type=del size=1890750 2024-09-12T00:09:41.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.510+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=6DGXX3O3BPOU type=del 2024-09-12T00:09:41.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.512+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=XNC5HO83YI29 type=del size=1427089 2024-09-12T00:09:41.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.513+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=EC9TTEJSU9GZ type=del 2024-09-12T00:09:41.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.514+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=K4IV6T0JWFT5 type=del size=3730459 2024-09-12T00:09:41.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.517+0000 7f3dc2c18780 1 < suggested update operation key=Y40G8SLO6AVH tag=KON41F8HP5G9 type=del size=2811922 2024-09-12T00:09:41.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.518+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=Y2ZL30STWXQP type=write size=789375 2024-09-12T00:09:41.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.519+0000 7f3dc2c18780 -1 < failed to complete operation key=Y40G8SLO6AVH tag=032DEK4AKQHQ type=del size=3471285: (22) Invalid argument 2024-09-12T00:09:41.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.521+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=X2MVZ0XWG03B type=write size=100110 2024-09-12T00:09:41.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.522+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=U4GMUNRCLI3T type=del 2024-09-12T00:09:41.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.525+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~ND7WRA3XAH0D.0 size=1048576 2024-09-12T00:09:41.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.526+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~ND7WRA3XAH0D.1 size=802690 2024-09-12T00:09:41.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.526+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=ND7WRA3XAH0D tag=FFWPRXPPKA6U type=write size=2899842 2024-09-12T00:09:41.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.528+0000 7f3dc2c18780 1 < suggested remove operation key=L9C014T8YLNV tag=JSVWNEWSMT5C type=del 2024-09-12T00:09:41.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.530+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~32N01KZLXX1M.0 size=1048576 2024-09-12T00:09:41.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.531+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~32N01KZLXX1M.1 size=1048576 2024-09-12T00:09:41.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.532+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~32N01KZLXX1M.2 size=120679 2024-09-12T00:09:41.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.532+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=32N01KZLXX1M tag=VFHUV54X9KRG type=write size=3266407 2024-09-12T00:09:41.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.533+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~PQO9ZUAKL7RJ.0 size=818404 2024-09-12T00:09:41.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.536+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=PQO9ZUAKL7RJ tag=WB2S7GQOR4YC type=write size=1866980 2024-09-12T00:09:41.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.537+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=CZIVXGV2YMKB type=del size=1723417 2024-09-12T00:09:41.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.538+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=KDREG7FZ33JL type=del 2024-09-12T00:09:41.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.541+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~O92TB9UDRUS4.0 size=1048576 2024-09-12T00:09:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.542+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~O92TB9UDRUS4.1 size=258581 2024-09-12T00:09:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.542+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=O92TB9UDRUS4 tag=A822CN67PTGA type=write size=2355733 2024-09-12T00:09:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.545+0000 7f3dc2c18780 1 < suggested remove operation key=V0K5FRKYGJ0K tag=DB7MO8FWFEGA type=write 2024-09-12T00:09:41.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.546+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=L40EBT6OJNI5 type=del size=1830855 2024-09-12T00:09:41.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.547+0000 7f3dc2c18780 1 < canceled part key=_multipart_A4O7JFS2ULY0.2~RJLENI32TO5Y.0 size=1048576 2024-09-12T00:09:41.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.548+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~RJLENI32TO5Y.1 size=1048576 2024-09-12T00:09:41.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.549+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~RJLENI32TO5Y.2 size=735292 2024-09-12T00:09:41.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.551+0000 7f3dc2c18780 1 < canceled multipart upload key=A4O7JFS2ULY0 upload=RJLENI32TO5Y tag=WD7AOO1314UF type=write size=3881020 2024-09-12T00:09:41.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.552+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=ZCZHQXVQNQZY type=del size=80980 2024-09-12T00:09:41.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.553+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=JLC15ZDW5Y1E type=del 2024-09-12T00:09:41.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.554+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=U3CLG5BC9UNC type=del size=1463389 2024-09-12T00:09:41.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.555+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=RCWRC90PXG4U type=del 2024-09-12T00:09:41.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.558+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~BCHOKWX3YQH1.0 size=1048576 2024-09-12T00:09:41.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.559+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~BCHOKWX3YQH1.1 size=490606 2024-09-12T00:09:41.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.559+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=BCHOKWX3YQH1 tag=IIGXGGWO6NWL type=write size=2587758 2024-09-12T00:09:41.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.560+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~NNF1G1TR11D7.0 size=1048576 2024-09-12T00:09:41.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.561+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~NNF1G1TR11D7.1 size=357649 2024-09-12T00:09:41.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.563+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=NNF1G1TR11D7 tag=U913YFAPC62K type=write size=2454801 2024-09-12T00:09:41.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.565+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~OU7P0VAJVRUN.0 size=1048576 2024-09-12T00:09:41.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.566+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~OU7P0VAJVRUN.1 size=18151 2024-09-12T00:09:41.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.566+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=OU7P0VAJVRUN tag=E7G1RYBX1P2U type=write size=2115303 2024-09-12T00:09:41.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.568+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~W894ML36EB3Y.0 size=1048576 2024-09-12T00:09:41.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.568+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~W894ML36EB3Y.1 size=168047 2024-09-12T00:09:41.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.570+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=W894ML36EB3Y tag=5G7ARZ3FQFH4 type=write size=2265199 2024-09-12T00:09:41.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.572+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=GFHLEHDOKHH9 type=del size=1433400 2024-09-12T00:09:41.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.573+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~BE8MN0GO1DSK.0 size=628612 2024-09-12T00:09:41.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.575+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=BE8MN0GO1DSK tag=VYIA2J8DR07U type=write size=1677188 2024-09-12T00:09:41.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.577+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~2Y386VT7WV6Z.0 size=1048576 2024-09-12T00:09:41.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.578+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~2Y386VT7WV6Z.1 size=1048576 2024-09-12T00:09:41.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.579+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~2Y386VT7WV6Z.2 size=992470 2024-09-12T00:09:41.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.579+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=2Y386VT7WV6Z tag=BBMK1X1EZ4OH type=write size=4138198 2024-09-12T00:09:41.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.580+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=099MJI0GWVPN type=del 2024-09-12T00:09:41.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.582+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~SB3DISRU9I4R.0 size=1048576 2024-09-12T00:09:41.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.583+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~SB3DISRU9I4R.1 size=814549 2024-09-12T00:09:41.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.583+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=SB3DISRU9I4R tag=4TBEM4D1MD71 type=write size=2911701 2024-09-12T00:09:41.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.584+0000 7f3dc2c18780 -1 < failed to complete operation key=V0K5FRKYGJ0K tag=XNC5HO83YI29 type=del size=1427089: (22) Invalid argument 2024-09-12T00:09:41.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.586+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=NWFMY0M7ZK92 type=del size=747826 2024-09-12T00:09:41.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.587+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=K4IV6T0JWFT5 type=del 2024-09-12T00:09:41.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.588+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=L273ORI5IVWB type=del size=2855440 2024-09-12T00:09:41.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.589+0000 7f3dc2c18780 1 < completed write operation key=4POD73U0LAC0 tag=Y2ZL30STWXQP type=write size=789375 2024-09-12T00:09:41.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.593+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~05ATCWGXZLR1.0 size=1048576 2024-09-12T00:09:41.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.594+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~05ATCWGXZLR1.1 size=1048576 2024-09-12T00:09:41.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.595+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~05ATCWGXZLR1.2 size=296371 2024-09-12T00:09:41.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.595+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=05ATCWGXZLR1 tag=0D7T4K8QERYZ type=write size=3442099 2024-09-12T00:09:41.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.596+0000 7f3dc2c18780 1 < completed write operation key=UJDQEIAIRVDW tag=X2MVZ0XWG03B type=write size=100110 2024-09-12T00:09:41.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.598+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~XLAN2UB0UTIO.0 size=1048576 2024-09-12T00:09:41.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.599+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~XLAN2UB0UTIO.1 size=1048576 2024-09-12T00:09:41.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.600+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~XLAN2UB0UTIO.2 size=551449 2024-09-12T00:09:41.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.600+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=XLAN2UB0UTIO tag=02RULNVSXN3B type=write size=3697177 2024-09-12T00:09:41.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.600+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRR6LAYIWOCE.2~ND7WRA3XAH0D.0 size=1048576 2024-09-12T00:09:41.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.601+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~ND7WRA3XAH0D.1 size=802690 2024-09-12T00:09:41.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.603+0000 7f3dc2c18780 1 < canceled multipart upload key=WRR6LAYIWOCE upload=ND7WRA3XAH0D tag=FFWPRXPPKA6U type=write size=2899842 2024-09-12T00:09:41.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.605+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~F2H3WG8AREE7.0 size=205689 2024-09-12T00:09:41.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.605+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=F2H3WG8AREE7 tag=VU7WZH300Y0V type=write size=1254265 2024-09-12T00:09:41.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.607+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~32N01KZLXX1M.0 size=1048576 2024-09-12T00:09:41.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.608+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~32N01KZLXX1M.1 size=1048576 2024-09-12T00:09:41.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.609+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~32N01KZLXX1M.2 size=120679 2024-09-12T00:09:41.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.611+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=32N01KZLXX1M tag=VFHUV54X9KRG type=write size=3266407 2024-09-12T00:09:41.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.613+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~AT1MHDSF2SGE.0 size=1048576 2024-09-12T00:09:41.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.614+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~AT1MHDSF2SGE.1 size=1048576 2024-09-12T00:09:41.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.615+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~AT1MHDSF2SGE.2 size=362665 2024-09-12T00:09:41.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.615+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=AT1MHDSF2SGE tag=NGVTE3PGY321 type=write size=3508393 2024-09-12T00:09:41.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.616+0000 7f3dc2c18780 1 < canceled operation key=4POD73U0LAC0 tag=CZIVXGV2YMKB type=del size=1723417 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.617+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=ZA0M6O3H40GR type=write size=464260 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.618+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~O92TB9UDRUS4.0 size=1048576 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.619+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~O92TB9UDRUS4.1 size=258581 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.621+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=O92TB9UDRUS4 tag=A822CN67PTGA type=write size=2355733 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.623+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=XY9QO1S30NY4 type=del size=1962921 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.625+0000 7f3dc2c18780 1 < suggested remove operation key=V0K5FRKYGJ0K tag=L40EBT6OJNI5 type=del 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.626+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=VLPX6JYR4ANJ type=del size=1198887 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.627+0000 7f3dc2c18780 -1 < failed to complete operation key=V0K5FRKYGJ0K tag=ZCZHQXVQNQZY type=del size=80980: (22) Invalid argument 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.628+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=8PUAIB5KVHVM type=del size=3542764 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.630+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=U3CLG5BC9UNC type=del 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.632+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~7OT3UC9LAL15.0 size=1048576 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.633+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~7OT3UC9LAL15.1 size=167918 2024-09-12T00:09:41.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.633+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=7OT3UC9LAL15 tag=JUSO51VXCW2V type=write size=2265070 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.634+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~BCHOKWX3YQH1.0 size=1048576 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.635+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~BCHOKWX3YQH1.1 size=490606 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.638+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=BCHOKWX3YQH1 tag=IIGXGGWO6NWL type=write size=2587758 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.639+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=5OW53Q3YT02E type=del size=4176741 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.640+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~OU7P0VAJVRUN.0 size=1048576 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.641+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~OU7P0VAJVRUN.1 size=18151 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.643+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=OU7P0VAJVRUN tag=E7G1RYBX1P2U type=write size=2115303 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.644+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=XD488BS72Y6F type=del size=1980630 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.646+0000 7f3dc2c18780 1 < canceled operation key=OGRGDIUO2W8B tag=GFHLEHDOKHH9 type=del size=1433400 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.647+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=YPDSNSCEQM0S type=del size=2966719 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.648+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~2Y386VT7WV6Z.0 size=1048576 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.649+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~2Y386VT7WV6Z.1 size=1048576 2024-09-12T00:09:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.650+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~2Y386VT7WV6Z.2 size=992470 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.652+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=2Y386VT7WV6Z tag=BBMK1X1EZ4OH type=write size=4138198 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.654+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~Y62586ROMWVE.0 size=1048576 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.655+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~Y62586ROMWVE.1 size=1048576 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.656+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~Y62586ROMWVE.2 size=544334 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.656+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=Y62586ROMWVE tag=G5DZD1TF9JVZ type=write size=3690062 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.657+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~SB3DISRU9I4R.0 size=1048576 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.657+0000 7f3dc2c18780 1 < canceled part key=_multipart_C0JT46SGECP0.2~SB3DISRU9I4R.1 size=814549 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.659+0000 7f3dc2c18780 1 < canceled multipart upload key=C0JT46SGECP0 upload=SB3DISRU9I4R tag=4TBEM4D1MD71 type=write size=2911701 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.660+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=2QOF5QH9HO9Q type=del size=2124982 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.661+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=NWFMY0M7ZK92 type=del 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.663+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=WWWI4BZ50GOS type=del size=3911263 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.665+0000 7f3dc2c18780 1 < suggested remove operation key=U2H0A1GZROT7 tag=L273ORI5IVWB type=del 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.666+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=T0WRLDCHLL8E type=write size=660178 2024-09-12T00:09:41.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.667+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~05ATCWGXZLR1.0 size=1048576 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.668+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~05ATCWGXZLR1.1 size=1048576 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.669+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~05ATCWGXZLR1.2 size=296371 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.671+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=05ATCWGXZLR1 tag=0D7T4K8QERYZ type=write size=3442099 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.673+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~315UBPLOQ011.0 size=245057 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.673+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=315UBPLOQ011 tag=QCOPP2CAIAFX type=write size=1293633 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.674+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~XLAN2UB0UTIO.0 size=1048576 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.675+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~XLAN2UB0UTIO.1 size=1048576 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.676+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~XLAN2UB0UTIO.2 size=551449 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.678+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=XLAN2UB0UTIO tag=02RULNVSXN3B type=write size=3697177 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.680+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~C3CBOEEM3RBW.0 size=1048576 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.681+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~C3CBOEEM3RBW.1 size=269420 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.681+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=C3CBOEEM3RBW tag=J47JDL41P3EU type=write size=2366572 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.683+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~F2H3WG8AREE7.0 size=205689 2024-09-12T00:09:41.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.685+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=F2H3WG8AREE7 tag=VU7WZH300Y0V type=write size=1254265 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.686+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=BBH22TY4VGRW type=write size=841852 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.687+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~AT1MHDSF2SGE.0 size=1048576 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.688+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~AT1MHDSF2SGE.1 size=1048576 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.688+0000 7f3dc2c18780 1 < canceled part key=_multipart_415OYT4ML329.2~AT1MHDSF2SGE.2 size=362665 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.690+0000 7f3dc2c18780 1 < canceled multipart upload key=415OYT4ML329 upload=AT1MHDSF2SGE tag=NGVTE3PGY321 type=write size=3508393 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.693+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~JGWI4UMD0EVG.0 size=368449 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.693+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=JGWI4UMD0EVG tag=NV5SDWOKD2WC type=write size=1417025 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.694+0000 7f3dc2c18780 1 < canceled operation key=GP3MLWX9586T tag=ZA0M6O3H40GR type=write size=464260 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.695+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=BHCXJQV0JC6E type=del size=1572471 2024-09-12T00:09:41.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.696+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=XY9QO1S30NY4 type=del 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.699+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~TB4RMGPRXE4X.0 size=1048576 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.700+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~TB4RMGPRXE4X.1 size=1048576 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.701+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~TB4RMGPRXE4X.2 size=713410 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.701+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=TB4RMGPRXE4X tag=TGMM3J0269VG type=write size=3859138 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.703+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=VLPX6JYR4ANJ type=del 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.707+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~DY9HD4M37J6Y.0 size=1048576 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.708+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~DY9HD4M37J6Y.1 size=1048576 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.709+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~DY9HD4M37J6Y.2 size=119308 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.709+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=DY9HD4M37J6Y tag=UWTR3WNN6QAO type=write size=3265036 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.710+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=8PUAIB5KVHVM type=del 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.712+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=YW1SAQX8ZU35 type=write size=790174 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.713+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~7OT3UC9LAL15.0 size=1048576 2024-09-12T00:09:41.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.714+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~7OT3UC9LAL15.1 size=167918 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.716+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=7OT3UC9LAL15 tag=JUSO51VXCW2V type=write size=2265070 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.717+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=V7EVRL008MJL type=del size=997109 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.719+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=5OW53Q3YT02E type=del 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.720+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=AUOJYERRPVU2 type=del size=3350860 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.721+0000 7f3dc2c18780 1 < canceled operation key=5BM1TMLRBHTS tag=XD488BS72Y6F type=del size=1980630 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.722+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=TU3NAAQ0W35R type=del size=3967251 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.723+0000 7f3dc2c18780 -1 < no bi entry to suggest for operation key=U2H0A1GZROT7 tag=YPDSNSCEQM0S type=del size=2966719: (2) No such file or directory 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.726+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~KQUBF4RGZ6GO.0 size=1048576 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.727+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~KQUBF4RGZ6GO.1 size=596813 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.727+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=KQUBF4RGZ6GO tag=N97T24N55LT4 type=write size=2693965 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.728+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~Y62586ROMWVE.0 size=1048576 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.729+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~Y62586ROMWVE.1 size=1048576 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.730+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~Y62586ROMWVE.2 size=544334 2024-09-12T00:09:41.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.732+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=Y62586ROMWVE tag=G5DZD1TF9JVZ type=write size=3690062 2024-09-12T00:09:41.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.734+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~40OA2I6RLJN8.0 size=1048576 2024-09-12T00:09:41.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.735+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~40OA2I6RLJN8.1 size=1048576 2024-09-12T00:09:41.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.736+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~40OA2I6RLJN8.2 size=952691 2024-09-12T00:09:41.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.736+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=40OA2I6RLJN8 tag=P2HSPRQB83M9 type=write size=4098419 2024-09-12T00:09:41.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.737+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=2QOF5QH9HO9Q type=del 2024-09-12T00:09:41.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.739+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~NRLLCBBDLXXR.0 size=793933 2024-09-12T00:09:41.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.739+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=NRLLCBBDLXXR tag=U7G9PNMUZBT2 type=write size=1842509 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.740+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=WWWI4BZ50GOS type=del 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.742+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=UM0LO9HG9CM9 type=del size=840105 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.743+0000 7f3dc2c18780 1 < completed write operation key=C0JT46SGECP0 tag=T0WRLDCHLL8E type=write size=660178 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.745+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~AK5HVGHMTC46.0 size=1048576 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.746+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~AK5HVGHMTC46.1 size=787688 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.746+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=AK5HVGHMTC46 tag=IRX11FA45Q34 type=write size=2884840 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.747+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~315UBPLOQ011.0 size=245057 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.749+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=315UBPLOQ011 tag=QCOPP2CAIAFX type=write size=1293633 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.750+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=AAQECZ6D35HF type=del size=3575159 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.750+0000 7f3dc2c18780 1 < canceled part key=_multipart_5F0BB9U7Y6ZZ.2~C3CBOEEM3RBW.0 size=1048576 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.751+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~C3CBOEEM3RBW.1 size=269420 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.753+0000 7f3dc2c18780 1 < canceled multipart upload key=5F0BB9U7Y6ZZ upload=C3CBOEEM3RBW tag=J47JDL41P3EU type=write size=2366572 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.755+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=GNRPC4AXBH5E type=del size=2359240 2024-09-12T00:09:41.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.757+0000 7f3dc2c18780 1 < suggested remove operation key=3WUIB2OMX77J tag=BBH22TY4VGRW type=write 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.758+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=3BQDB601ZFGN type=del size=4164993 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.760+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~JGWI4UMD0EVG.0 size=368449 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.762+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=JGWI4UMD0EVG tag=NV5SDWOKD2WC type=write size=1417025 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.765+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~KKW7DODROZ19.0 size=1048576 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.766+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~KKW7DODROZ19.1 size=837761 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.766+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=KKW7DODROZ19 tag=KT88FU29KKTN type=write size=2934913 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.767+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=BHCXJQV0JC6E type=del 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.768+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=SFIKMETY4QCF type=del size=357926 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.769+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~TB4RMGPRXE4X.0 size=1048576 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.770+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~TB4RMGPRXE4X.1 size=1048576 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.771+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~TB4RMGPRXE4X.2 size=713410 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.773+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=TB4RMGPRXE4X tag=TGMM3J0269VG type=write size=3859138 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.774+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=QTWJPZI4W7RQ type=write size=955424 2024-09-12T00:09:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.775+0000 7f3dc2c18780 1 < canceled part key=_multipart_2SO8HBZSAMRX.2~DY9HD4M37J6Y.0 size=1048576 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.775+0000 7f3dc2c18780 1 < canceled part key=_multipart_2SO8HBZSAMRX.2~DY9HD4M37J6Y.1 size=1048576 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.776+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~DY9HD4M37J6Y.2 size=119308 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.778+0000 7f3dc2c18780 1 < canceled multipart upload key=2SO8HBZSAMRX upload=DY9HD4M37J6Y tag=UWTR3WNN6QAO type=write size=3265036 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.779+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=5NLB0MEUOF0B type=del size=2937739 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.780+0000 7f3dc2c18780 1 < completed write operation key=TSL3IDD0EDT0 tag=YW1SAQX8ZU35 type=write size=790174 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.783+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~DD3ZHYGYRBIW.0 size=450288 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.783+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=DD3ZHYGYRBIW tag=3KN1LQDPUHXG type=write size=1498864 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.784+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=V7EVRL008MJL type=del 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.785+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=TQEKCTSORP9O type=del size=2537035 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.788+0000 7f3dc2c18780 1 < suggested remove operation key=GLAOX3ZNNILD tag=AUOJYERRPVU2 type=del 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.789+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=9C1K2ETO2EOJ type=del size=504833 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.790+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=TU3NAAQ0W35R type=del 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.792+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~SCI0F5KBFF71.0 size=1048576 2024-09-12T00:09:41.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.793+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~SCI0F5KBFF71.1 size=1048576 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.794+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~SCI0F5KBFF71.2 size=1040848 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.794+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=SCI0F5KBFF71 tag=P26H6JV8TI6M type=write size=4186576 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.796+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~KQUBF4RGZ6GO.0 size=1048576 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.797+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~KQUBF4RGZ6GO.1 size=596813 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.799+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=KQUBF4RGZ6GO tag=N97T24N55LT4 type=write size=2693965 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.800+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=52IWFIL2P0W6 type=del size=268840 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.802+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~40OA2I6RLJN8.0 size=1048576 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.803+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~40OA2I6RLJN8.1 size=1048576 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.803+0000 7f3dc2c18780 1 < canceled part key=_multipart_5MAV2RJ4E31S.2~40OA2I6RLJN8.2 size=952691 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.805+0000 7f3dc2c18780 1 < canceled multipart upload key=5MAV2RJ4E31S upload=40OA2I6RLJN8 tag=P2HSPRQB83M9 type=write size=4098419 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.808+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~PBWH13DEBAKC.0 size=1048576 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.809+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~PBWH13DEBAKC.1 size=1048576 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.810+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~PBWH13DEBAKC.2 size=119581 2024-09-12T00:09:41.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.810+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=PBWH13DEBAKC tag=YJ1GY4LJ4J32 type=write size=3265309 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.812+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~NRLLCBBDLXXR.0 size=793933 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.814+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=NRLLCBBDLXXR tag=U7G9PNMUZBT2 type=write size=1842509 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.815+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=GHXN4QIMSRI7 type=write size=164839 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.818+0000 7f3dc2c18780 1 < suggested remove operation key=XNZNORKYEOPV tag=UM0LO9HG9CM9 type=del 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.820+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~SOQIQC7QFQ53.0 size=1048576 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.822+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~SOQIQC7QFQ53.1 size=477832 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.822+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=SOQIQC7QFQ53 tag=JMHBCYC6ASOG type=write size=2574984 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.822+0000 7f3dc2c18780 1 < canceled part key=_multipart_5F0BB9U7Y6ZZ.2~AK5HVGHMTC46.0 size=1048576 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.824+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~AK5HVGHMTC46.1 size=787688 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.827+0000 7f3dc2c18780 1 < canceled multipart upload key=5F0BB9U7Y6ZZ upload=AK5HVGHMTC46 tag=IRX11FA45Q34 type=write size=2884840 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.829+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=L69YIDZDVHIZ type=write size=824112 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.830+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=AAQECZ6D35HF type=del 2024-09-12T00:09:41.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.832+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~G71Q0DLN83SL.0 size=1014500 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.832+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=G71Q0DLN83SL tag=6O7IUF0L0HFJ type=write size=2063076 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.833+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=GNRPC4AXBH5E type=del 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.834+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=AG04G1U71OVR type=del size=1029054 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.836+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=3BQDB601ZFGN type=del 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.837+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=MC492SDJY2T4 type=write size=295607 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.838+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~KKW7DODROZ19.0 size=1048576 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.839+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~KKW7DODROZ19.1 size=837761 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.841+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=KKW7DODROZ19 tag=KT88FU29KKTN type=write size=2934913 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.842+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=R1OSCYXFBNYP type=del size=3182504 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.843+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=SFIKMETY4QCF type=del 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.845+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=03XH7UXYGAB8 type=del size=2486955 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.846+0000 7f3dc2c18780 1 < canceled operation key=5CS98S02F59L tag=QTWJPZI4W7RQ type=write size=955424 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.847+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=YMFLIH1AS9Z9 type=del size=2019280 2024-09-12T00:09:41.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.848+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=5NLB0MEUOF0B type=del 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.849+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=0Y05EWHML20F type=del size=3885391 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.851+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~DD3ZHYGYRBIW.0 size=450288 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.853+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=DD3ZHYGYRBIW tag=3KN1LQDPUHXG type=write size=1498864 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.854+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=AHKAZ2RAE6C2 type=del size=1059008 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.856+0000 7f3dc2c18780 1 < suggested remove operation key=415OYT4ML329 tag=TQEKCTSORP9O type=del 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.858+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=IB2TES376IYV type=del size=782962 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.860+0000 7f3dc2c18780 1 < suggested remove operation key=GLAOX3ZNNILD tag=9C1K2ETO2EOJ type=del 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.861+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=W7HUD31F0O8E type=del size=4173190 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.863+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~SCI0F5KBFF71.0 size=1048576 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.864+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~SCI0F5KBFF71.1 size=1048576 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.864+0000 7f3dc2c18780 1 < canceled part key=_multipart_L9C014T8YLNV.2~SCI0F5KBFF71.2 size=1040848 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.866+0000 7f3dc2c18780 1 < canceled multipart upload key=L9C014T8YLNV upload=SCI0F5KBFF71 tag=P26H6JV8TI6M type=write size=4186576 2024-09-12T00:09:41.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.867+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=YDGL6O2AK1P2 type=del size=475141 2024-09-12T00:09:41.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.870+0000 7f3dc2c18780 1 < suggested remove operation key=KDHO7IEGICDA tag=52IWFIL2P0W6 type=del 2024-09-12T00:09:41.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.872+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~MQ2O2756TWH4.0 size=1048576 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.873+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~MQ2O2756TWH4.1 size=1048576 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.874+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~MQ2O2756TWH4.2 size=412917 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.874+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=MQ2O2756TWH4 tag=FVG4YVF82I9Z type=write size=3558645 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.875+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~PBWH13DEBAKC.0 size=1048576 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.876+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~PBWH13DEBAKC.1 size=1048576 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.877+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~PBWH13DEBAKC.2 size=119581 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.880+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=PBWH13DEBAKC tag=YJ1GY4LJ4J32 type=write size=3265309 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.882+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~NTQZBWLEWNEU.0 size=1048576 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.883+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~NTQZBWLEWNEU.1 size=1048576 2024-09-12T00:09:41.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.884+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~NTQZBWLEWNEU.2 size=640110 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.884+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=NTQZBWLEWNEU tag=HQSPISA29WXL type=write size=3785838 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.886+0000 7f3dc2c18780 1 < completed write operation key=3WUIB2OMX77J tag=GHXN4QIMSRI7 type=write size=164839 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.887+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=7ZYR48FR485X type=del size=1640866 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.888+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~SOQIQC7QFQ53.0 size=1048576 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.889+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~SOQIQC7QFQ53.1 size=477832 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.893+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=SOQIQC7QFQ53 tag=JMHBCYC6ASOG type=write size=2574984 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.894+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=9E0S82O2G5KG type=del size=1984503 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.896+0000 7f3dc2c18780 1 < completed write operation key=25CF1N8J81Y9 tag=L69YIDZDVHIZ type=write size=824112 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.897+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=8M29MH5XUZP2 type=del size=389411 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.898+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~G71Q0DLN83SL.0 size=1014500 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.900+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=G71Q0DLN83SL tag=6O7IUF0L0HFJ type=write size=2063076 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.902+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=G40Z7P35YE5M type=del size=355980 2024-09-12T00:09:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.903+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=AG04G1U71OVR type=del 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.905+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~79NQXMTPT6E4.0 size=1048576 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.906+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~79NQXMTPT6E4.1 size=812590 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.906+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=79NQXMTPT6E4 tag=JDS1GA40FBX4 type=write size=2909742 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.907+0000 7f3dc2c18780 1 < completed write operation key=WRR6LAYIWOCE tag=MC492SDJY2T4 type=write size=295607 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.909+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~9Y22UWC7HLB1.0 size=137844 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.909+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=9Y22UWC7HLB1 tag=EDGCBU4VMW6O type=write size=1186420 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.911+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=R1OSCYXFBNYP type=del 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.913+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~E3OWWQEHKGIF.0 size=1048576 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.914+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~E3OWWQEHKGIF.1 size=1048576 2024-09-12T00:09:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.915+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~E3OWWQEHKGIF.2 size=1038227 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.915+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=E3OWWQEHKGIF tag=P5D172OU95LS type=write size=4183955 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.916+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=03XH7UXYGAB8 type=del 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.918+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=HOUR943K2L5M type=del size=517333 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.919+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=YMFLIH1AS9Z9 type=del 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.920+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=1Z01AS61NTA2 type=del size=3127852 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.923+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=0Y05EWHML20F type=del size=3885391 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.924+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=LHBKOMER9WHK type=del size=366084 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.925+0000 7f3dc2c18780 1 < canceled operation key=3WUIB2OMX77J tag=AHKAZ2RAE6C2 type=del size=1059008 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.927+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=KPN8R1K0MD6H type=del size=69123 2024-09-12T00:09:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.928+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=IB2TES376IYV type=del 2024-09-12T00:09:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.930+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~7AF1JEEA0BGE.0 size=1048576 2024-09-12T00:09:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.931+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~7AF1JEEA0BGE.1 size=855933 2024-09-12T00:09:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.931+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=7AF1JEEA0BGE tag=Z71SSZ473PR2 type=write size=2953085 2024-09-12T00:09:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.934+0000 7f3dc2c18780 1 < suggested update operation key=YYIQC6YL2PSW tag=W7HUD31F0O8E type=del size=4173190 2024-09-12T00:09:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.936+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~ZNN61QWKSOKS.0 size=811607 2024-09-12T00:09:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.936+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=ZNN61QWKSOKS tag=R1TTJV5S1B6X type=write size=1860183 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.937+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=YDGL6O2AK1P2 type=del 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.939+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~NHZMWLKNE0K0.0 size=1042414 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.939+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=NHZMWLKNE0K0 tag=CY3DMGOCSZL9 type=write size=2090990 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.941+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~MQ2O2756TWH4.0 size=1048576 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.942+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~MQ2O2756TWH4.1 size=1048576 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.945+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~MQ2O2756TWH4.2 size=412917 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.948+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=MQ2O2756TWH4 tag=FVG4YVF82I9Z type=write size=3558645 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.949+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=BK1OU7X9MVAV type=del size=517777 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.950+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~NTQZBWLEWNEU.0 size=1048576 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.951+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~NTQZBWLEWNEU.1 size=1048576 2024-09-12T00:09:41.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.952+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~NTQZBWLEWNEU.2 size=640110 2024-09-12T00:09:41.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.955+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=NTQZBWLEWNEU tag=HQSPISA29WXL type=write size=3785838 2024-09-12T00:09:41.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.957+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~VUW0T8BUTUAX.0 size=1048576 2024-09-12T00:09:41.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.958+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~VUW0T8BUTUAX.1 size=1048576 2024-09-12T00:09:41.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.959+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~VUW0T8BUTUAX.2 size=530453 2024-09-12T00:09:41.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.959+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=VUW0T8BUTUAX tag=OC64JKLTJNNW type=write size=3676181 2024-09-12T00:09:41.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.960+0000 7f3dc2c18780 1 < canceled operation key=Y40G8SLO6AVH tag=7ZYR48FR485X type=del size=1640866 2024-09-12T00:09:41.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.961+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=I5CA1QWP475B type=del size=3791141 2024-09-12T00:09:41.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.962+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=9E0S82O2G5KG type=del 2024-09-12T00:09:41.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.964+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=TBOJNIEANJ66 type=del size=1349795 2024-09-12T00:09:41.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.966+0000 7f3dc2c18780 1 < suggested update operation key=WRBBH64CISJZ tag=8M29MH5XUZP2 type=del size=389411 2024-09-12T00:09:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.968+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~FYW3Q2ZZXBBE.0 size=891697 2024-09-12T00:09:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.968+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=FYW3Q2ZZXBBE tag=Q79BE2VOW8F2 type=write size=1940273 2024-09-12T00:09:41.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.969+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=G40Z7P35YE5M type=del 2024-09-12T00:09:41.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.971+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=F1347742USCZ type=write size=761264 2024-09-12T00:09:41.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.972+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~79NQXMTPT6E4.0 size=1048576 2024-09-12T00:09:41.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.973+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~79NQXMTPT6E4.1 size=812590 2024-09-12T00:09:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.975+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=79NQXMTPT6E4 tag=JDS1GA40FBX4 type=write size=2909742 2024-09-12T00:09:41.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.976+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=MES3X1EME9CD type=del size=1740678 2024-09-12T00:09:41.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.977+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~9Y22UWC7HLB1.0 size=137844 2024-09-12T00:09:41.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.979+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=9Y22UWC7HLB1 tag=EDGCBU4VMW6O type=write size=1186420 2024-09-12T00:09:41.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.982+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~AZGOEFBL5QH1.0 size=1048576 2024-09-12T00:09:41.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.983+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~AZGOEFBL5QH1.1 size=953823 2024-09-12T00:09:41.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.983+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=AZGOEFBL5QH1 tag=LADH6R1Y9PKX type=write size=3050975 2024-09-12T00:09:41.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.984+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~E3OWWQEHKGIF.0 size=1048576 2024-09-12T00:09:41.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.985+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~E3OWWQEHKGIF.1 size=1048576 2024-09-12T00:09:41.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.986+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~E3OWWQEHKGIF.2 size=1038227 2024-09-12T00:09:41.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.988+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=E3OWWQEHKGIF tag=P5D172OU95LS type=write size=4183955 2024-09-12T00:09:41.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.989+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=H5WT6R0SZFVW type=del size=3301324 2024-09-12T00:09:41.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.990+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=HOUR943K2L5M type=del 2024-09-12T00:09:41.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.992+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~GZBMFA9S2U0H.0 size=743730 2024-09-12T00:09:41.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.992+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=GZBMFA9S2U0H tag=RNI4JBN5NNWF type=write size=1792306 2024-09-12T00:09:41.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.993+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=1Z01AS61NTA2 type=del 2024-09-12T00:09:41.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.996+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~32QV82TE2IC7.0 size=825892 2024-09-12T00:09:41.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.996+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=32QV82TE2IC7 tag=5QP3BHFHPG8P type=write size=1874468 2024-09-12T00:09:41.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.997+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=LHBKOMER9WHK type=del 2024-09-12T00:09:41.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.999+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~1I3NUK0CVA91.0 size=220024 2024-09-12T00:09:41.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:41.999+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=1I3NUK0CVA91 tag=8XDDGHUU5VTR type=write size=1268600 2024-09-12T00:09:41.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.000+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=KPN8R1K0MD6H type=del 2024-09-12T00:09:42.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.001+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=LHPSG3X7TJA9 type=write size=871350 2024-09-12T00:09:42.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.003+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~7AF1JEEA0BGE.0 size=1048576 2024-09-12T00:09:42.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.004+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~7AF1JEEA0BGE.1 size=855933 2024-09-12T00:09:42.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.006+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=7AF1JEEA0BGE tag=Z71SSZ473PR2 type=write size=2953085 2024-09-12T00:09:42.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.007+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=QSXKZZ274SBS type=del size=3172961 2024-09-12T00:09:42.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.008+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~ZNN61QWKSOKS.0 size=811607 2024-09-12T00:09:42.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.010+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=ZNN61QWKSOKS tag=R1TTJV5S1B6X type=write size=1860183 2024-09-12T00:09:42.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.013+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~9JB2GENIG7FB.0 size=1048576 2024-09-12T00:09:42.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.013+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~9JB2GENIG7FB.1 size=1048576 2024-09-12T00:09:42.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.015+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~9JB2GENIG7FB.2 size=322021 2024-09-12T00:09:42.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.015+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=9JB2GENIG7FB tag=OB7L207WC6HX type=write size=3467749 2024-09-12T00:09:42.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.017+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~NHZMWLKNE0K0.0 size=1042414 2024-09-12T00:09:42.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.020+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=NHZMWLKNE0K0 tag=CY3DMGOCSZL9 type=write size=2090990 2024-09-12T00:09:42.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.021+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=KSO8HETVG2CE type=write size=264081 2024-09-12T00:09:42.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.023+0000 7f3dc2c18780 1 < suggested update operation key=KQWXE62PF5F7 tag=BK1OU7X9MVAV type=del size=517777 2024-09-12T00:09:42.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.025+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=2W7MTRJSKVIU type=write size=471943 2024-09-12T00:09:42.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.026+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~VUW0T8BUTUAX.0 size=1048576 2024-09-12T00:09:42.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.027+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~VUW0T8BUTUAX.1 size=1048576 2024-09-12T00:09:42.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.028+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~VUW0T8BUTUAX.2 size=530453 2024-09-12T00:09:42.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.031+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=VUW0T8BUTUAX tag=OC64JKLTJNNW type=write size=3676181 2024-09-12T00:09:42.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.033+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~BKA9NLVTFV61.0 size=1048576 2024-09-12T00:09:42.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.034+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~BKA9NLVTFV61.1 size=741480 2024-09-12T00:09:42.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.034+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=BKA9NLVTFV61 tag=MKLW6C1O0R8N type=write size=2838632 2024-09-12T00:09:42.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.036+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=I5CA1QWP475B type=del 2024-09-12T00:09:42.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.038+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~ERUF7RMFKKI7.0 size=1048576 2024-09-12T00:09:42.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.039+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~ERUF7RMFKKI7.1 size=1048576 2024-09-12T00:09:42.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.040+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~ERUF7RMFKKI7.2 size=623052 2024-09-12T00:09:42.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.040+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=ERUF7RMFKKI7 tag=2BIXQDS733RU type=write size=3768780 2024-09-12T00:09:42.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.041+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=TBOJNIEANJ66 type=del 2024-09-12T00:09:42.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.043+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=7YVHD1DC7HYD type=del size=708534 2024-09-12T00:09:42.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.044+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~FYW3Q2ZZXBBE.0 size=891697 2024-09-12T00:09:42.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.046+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=FYW3Q2ZZXBBE tag=Q79BE2VOW8F2 type=write size=1940273 2024-09-12T00:09:42.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.047+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=BM4MTB9S7MMR type=del size=3565018 2024-09-12T00:09:42.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.048+0000 7f3dc2c18780 1 < completed write operation key=Y40G8SLO6AVH tag=F1347742USCZ type=write size=761264 2024-09-12T00:09:42.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.051+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~Q3G04IL4668A.0 size=1048576 2024-09-12T00:09:42.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.052+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~Q3G04IL4668A.1 size=1048576 2024-09-12T00:09:42.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.053+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~Q3G04IL4668A.2 size=630802 2024-09-12T00:09:42.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.053+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=Q3G04IL4668A tag=2RYQQ9H6DIG3 type=write size=3776530 2024-09-12T00:09:42.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.054+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=MES3X1EME9CD type=del 2024-09-12T00:09:42.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.056+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~IB134TKPB0YW.0 size=1048576 2024-09-12T00:09:42.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.057+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~IB134TKPB0YW.1 size=1048576 2024-09-12T00:09:42.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.058+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~IB134TKPB0YW.2 size=549219 2024-09-12T00:09:42.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.058+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=IB134TKPB0YW tag=7KYCCPH40CFR type=write size=3694947 2024-09-12T00:09:42.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.059+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~AZGOEFBL5QH1.0 size=1048576 2024-09-12T00:09:42.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.059+0000 7f3dc2c18780 1 < canceled part key=_multipart_U2H0A1GZROT7.2~AZGOEFBL5QH1.1 size=953823 2024-09-12T00:09:42.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.063+0000 7f3dc2c18780 1 < canceled multipart upload key=U2H0A1GZROT7 upload=AZGOEFBL5QH1 tag=LADH6R1Y9PKX type=write size=3050975 2024-09-12T00:09:42.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.065+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~0ZDYZLKEJ47R.0 size=822853 2024-09-12T00:09:42.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.065+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=0ZDYZLKEJ47R tag=2KXWXG0D1TGH type=write size=1871429 2024-09-12T00:09:42.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.066+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=H5WT6R0SZFVW type=del 2024-09-12T00:09:42.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.068+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~LSEN8AJLYP86.0 size=1048576 2024-09-12T00:09:42.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.069+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~LSEN8AJLYP86.1 size=651818 2024-09-12T00:09:42.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.069+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=LSEN8AJLYP86 tag=7F92QF6GIME2 type=write size=2748970 2024-09-12T00:09:42.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.071+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~GZBMFA9S2U0H.0 size=743730 2024-09-12T00:09:42.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.072+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=GZBMFA9S2U0H tag=RNI4JBN5NNWF type=write size=1792306 2024-09-12T00:09:42.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.074+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=D8FAM66I4ZT5 type=del size=1285084 2024-09-12T00:09:42.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.075+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~32QV82TE2IC7.0 size=825892 2024-09-12T00:09:42.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.077+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=32QV82TE2IC7 tag=5QP3BHFHPG8P type=write size=1874468 2024-09-12T00:09:42.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.079+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~U3FI8NUHT2N9.0 size=183647 2024-09-12T00:09:42.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.079+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=U3FI8NUHT2N9 tag=5W3DD65QWX2S type=write size=1232223 2024-09-12T00:09:42.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.080+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~1I3NUK0CVA91.0 size=220024 2024-09-12T00:09:42.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.082+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=1I3NUK0CVA91 tag=8XDDGHUU5VTR type=write size=1268600 2024-09-12T00:09:42.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.083+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=QUXA5Y6SSR45 type=del size=335730 2024-09-12T00:09:42.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.085+0000 7f3dc2c18780 1 < completed write operation key=2SO8HBZSAMRX tag=LHPSG3X7TJA9 type=write size=871350 2024-09-12T00:09:42.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.087+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=YNNPULSTTTYB type=write size=196996 2024-09-12T00:09:42.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.089+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=QSXKZZ274SBS type=del 2024-09-12T00:09:42.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.091+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~WTAE96BYP3D7.0 size=1048576 2024-09-12T00:09:42.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.092+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~WTAE96BYP3D7.1 size=1048576 2024-09-12T00:09:42.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.093+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~WTAE96BYP3D7.2 size=1035455 2024-09-12T00:09:42.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.093+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=WTAE96BYP3D7 tag=29JLHIG6R2FX type=write size=4181183 2024-09-12T00:09:42.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.094+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~9JB2GENIG7FB.0 size=1048576 2024-09-12T00:09:42.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.095+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~9JB2GENIG7FB.1 size=1048576 2024-09-12T00:09:42.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.096+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~9JB2GENIG7FB.2 size=322021 2024-09-12T00:09:42.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.098+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=9JB2GENIG7FB tag=OB7L207WC6HX type=write size=3467749 2024-09-12T00:09:42.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.100+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=HE7LIOBT4LQ9 type=del size=3339906 2024-09-12T00:09:42.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.102+0000 7f3dc2c18780 1 < suggested remove operation key=25CF1N8J81Y9 tag=KSO8HETVG2CE type=write 2024-09-12T00:09:42.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.103+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=FITC2ICZB7E9 type=del size=2421814 2024-09-12T00:09:42.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.105+0000 7f3dc2c18780 1 < completed write operation key=3WUIB2OMX77J tag=2W7MTRJSKVIU type=write size=471943 2024-09-12T00:09:42.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.106+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=SBHWYK5OX2T9 type=del size=150549 2024-09-12T00:09:42.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.106+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~BKA9NLVTFV61.0 size=1048576 2024-09-12T00:09:42.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.107+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~BKA9NLVTFV61.1 size=741480 2024-09-12T00:09:42.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.109+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=BKA9NLVTFV61 tag=MKLW6C1O0R8N type=write size=2838632 2024-09-12T00:09:42.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.111+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~O8KLHZ5F1NZ1.0 size=951477 2024-09-12T00:09:42.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.111+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=O8KLHZ5F1NZ1 tag=UD0QN7FCRAXK type=write size=2000053 2024-09-12T00:09:42.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.112+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~ERUF7RMFKKI7.0 size=1048576 2024-09-12T00:09:42.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.113+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~ERUF7RMFKKI7.1 size=1048576 2024-09-12T00:09:42.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.114+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~ERUF7RMFKKI7.2 size=623052 2024-09-12T00:09:42.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.116+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=ERUF7RMFKKI7 tag=2BIXQDS733RU type=write size=3768780 2024-09-12T00:09:42.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.117+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=FE1VEHB4EIM1 type=del size=2831000 2024-09-12T00:09:42.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.118+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=7YVHD1DC7HYD type=del 2024-09-12T00:09:42.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.119+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=Q3GMY06D3P1I type=del size=1890223 2024-09-12T00:09:42.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.120+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=BM4MTB9S7MMR type=del 2024-09-12T00:09:42.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.122+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=4T0VNT7XT3XQ type=del size=3486300 2024-09-12T00:09:42.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.123+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~Q3G04IL4668A.0 size=1048576 2024-09-12T00:09:42.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.124+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~Q3G04IL4668A.1 size=1048576 2024-09-12T00:09:42.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.125+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~Q3G04IL4668A.2 size=630802 2024-09-12T00:09:42.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.127+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=Q3G04IL4668A tag=2RYQQ9H6DIG3 type=write size=3776530 2024-09-12T00:09:42.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.129+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~WX5RGMH6WD66.0 size=1048576 2024-09-12T00:09:42.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.130+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~WX5RGMH6WD66.1 size=1048576 2024-09-12T00:09:42.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.131+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~WX5RGMH6WD66.2 size=926854 2024-09-12T00:09:42.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.131+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=WX5RGMH6WD66 tag=Z33TYRZJSE7F type=write size=4072582 2024-09-12T00:09:42.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.132+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~IB134TKPB0YW.0 size=1048576 2024-09-12T00:09:42.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.133+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~IB134TKPB0YW.1 size=1048576 2024-09-12T00:09:42.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.134+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~IB134TKPB0YW.2 size=549219 2024-09-12T00:09:42.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.136+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=IB134TKPB0YW tag=7KYCCPH40CFR type=write size=3694947 2024-09-12T00:09:42.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.138+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~MBZL0ZDXPCKC.0 size=1048576 2024-09-12T00:09:42.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.140+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~MBZL0ZDXPCKC.1 size=1048576 2024-09-12T00:09:42.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.141+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~MBZL0ZDXPCKC.2 size=261623 2024-09-12T00:09:42.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.141+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=MBZL0ZDXPCKC tag=JQBHIJFNUKZD type=write size=3407351 2024-09-12T00:09:42.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.142+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~0ZDYZLKEJ47R.0 size=822853 2024-09-12T00:09:42.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.144+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=0ZDYZLKEJ47R tag=2KXWXG0D1TGH type=write size=1871429 2024-09-12T00:09:42.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.146+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~RBODB8XUGNDF.0 size=794825 2024-09-12T00:09:42.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.146+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=RBODB8XUGNDF tag=K3P6W4INA1TJ type=write size=1843401 2024-09-12T00:09:42.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.148+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~LSEN8AJLYP86.0 size=1048576 2024-09-12T00:09:42.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.149+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~LSEN8AJLYP86.1 size=651818 2024-09-12T00:09:42.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.151+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=LSEN8AJLYP86 tag=7F92QF6GIME2 type=write size=2748970 2024-09-12T00:09:42.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.153+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~4AWL1RR1F6CH.0 size=474578 2024-09-12T00:09:42.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.153+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=4AWL1RR1F6CH tag=W5C1M03WSJMU type=write size=1523154 2024-09-12T00:09:42.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.154+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=D8FAM66I4ZT5 type=del 2024-09-12T00:09:42.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.156+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~K2RX3RPJ5LEM.0 size=1048576 2024-09-12T00:09:42.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.157+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~K2RX3RPJ5LEM.1 size=37092 2024-09-12T00:09:42.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.157+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=K2RX3RPJ5LEM tag=GDF89ROGVZMU type=write size=2134244 2024-09-12T00:09:42.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.159+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~U3FI8NUHT2N9.0 size=183647 2024-09-12T00:09:42.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.161+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=U3FI8NUHT2N9 tag=5W3DD65QWX2S type=write size=1232223 2024-09-12T00:09:42.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.162+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=YQIX40P7BH74 type=write size=1036009 2024-09-12T00:09:42.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.164+0000 7f3dc2c18780 1 < suggested remove operation key=5F0BB9U7Y6ZZ tag=QUXA5Y6SSR45 type=del 2024-09-12T00:09:42.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.166+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=4L3Q2DKN6IKY type=del size=311415 2024-09-12T00:09:42.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.167+0000 7f3dc2c18780 1 < completed write operation key=KQWXE62PF5F7 tag=YNNPULSTTTYB type=write size=196996 2024-09-12T00:09:42.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.168+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=F2QO2MSQ8TK4 type=del size=123588 2024-09-12T00:09:42.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.169+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~WTAE96BYP3D7.0 size=1048576 2024-09-12T00:09:42.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.170+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~WTAE96BYP3D7.1 size=1048576 2024-09-12T00:09:42.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.171+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~WTAE96BYP3D7.2 size=1035455 2024-09-12T00:09:42.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.175+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=WTAE96BYP3D7 tag=29JLHIG6R2FX type=write size=4181183 2024-09-12T00:09:42.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.177+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~3QAX362QPWDO.0 size=1048576 2024-09-12T00:09:42.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.178+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~3QAX362QPWDO.1 size=603070 2024-09-12T00:09:42.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.178+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=3QAX362QPWDO tag=4T0VB3Q8IL9C type=write size=2700222 2024-09-12T00:09:42.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.179+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=HE7LIOBT4LQ9 type=del 2024-09-12T00:09:42.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.182+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~JV7WEOEZMF4X.0 size=683687 2024-09-12T00:09:42.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.182+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=JV7WEOEZMF4X tag=7BUGKM4S2O4G type=write size=1732263 2024-09-12T00:09:42.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.183+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=FITC2ICZB7E9 type=del 2024-09-12T00:09:42.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.185+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~76UI39A9ETTZ.0 size=1048576 2024-09-12T00:09:42.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.186+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~76UI39A9ETTZ.1 size=85892 2024-09-12T00:09:42.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.186+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=76UI39A9ETTZ tag=S5OEZ4VJMG46 type=write size=2183044 2024-09-12T00:09:42.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.188+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=SBHWYK5OX2T9 type=del 2024-09-12T00:09:42.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.190+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~TNX8DPJY5IZZ.0 size=1048576 2024-09-12T00:09:42.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.191+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~TNX8DPJY5IZZ.1 size=268943 2024-09-12T00:09:42.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.191+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=TNX8DPJY5IZZ tag=Y9TT6AMKFPLG type=write size=2366095 2024-09-12T00:09:42.191 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.192+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~O8KLHZ5F1NZ1.0 size=951477 2024-09-12T00:09:42.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.194+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=O8KLHZ5F1NZ1 tag=UD0QN7FCRAXK type=write size=2000053 2024-09-12T00:09:42.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.195+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=I15UYET45LRQ type=del size=1476681 2024-09-12T00:09:42.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.197+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=FE1VEHB4EIM1 type=del 2024-09-12T00:09:42.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.199+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~HADGY1CMGKZY.0 size=1048576 2024-09-12T00:09:42.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.200+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~HADGY1CMGKZY.1 size=505508 2024-09-12T00:09:42.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.200+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=HADGY1CMGKZY tag=N5KVCK31B7YQ type=write size=2602660 2024-09-12T00:09:42.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.201+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=Q3GMY06D3P1I type=del 2024-09-12T00:09:42.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.202+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=8ND8MZ4VS84O type=del size=2612725 2024-09-12T00:09:42.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.204+0000 7f3dc2c18780 1 < canceled operation key=2SO8HBZSAMRX tag=4T0VNT7XT3XQ type=del size=3486300 2024-09-12T00:09:42.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.206+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~4RGKFXDWRMXH.0 size=1048576 2024-09-12T00:09:42.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.207+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~4RGKFXDWRMXH.1 size=1048576 2024-09-12T00:09:42.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.208+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~4RGKFXDWRMXH.2 size=310493 2024-09-12T00:09:42.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.208+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=4RGKFXDWRMXH tag=XABNEZNANLM5 type=write size=3456221 2024-09-12T00:09:42.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.209+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~WX5RGMH6WD66.0 size=1048576 2024-09-12T00:09:42.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.210+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~WX5RGMH6WD66.1 size=1048576 2024-09-12T00:09:42.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.211+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~WX5RGMH6WD66.2 size=926854 2024-09-12T00:09:42.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.213+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=WX5RGMH6WD66 tag=Z33TYRZJSE7F type=write size=4072582 2024-09-12T00:09:42.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.214+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=U2P5H4DDA3RB type=del size=1789130 2024-09-12T00:09:42.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.215+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~MBZL0ZDXPCKC.0 size=1048576 2024-09-12T00:09:42.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.216+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~MBZL0ZDXPCKC.1 size=1048576 2024-09-12T00:09:42.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.217+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~MBZL0ZDXPCKC.2 size=261623 2024-09-12T00:09:42.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.219+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=MBZL0ZDXPCKC tag=JQBHIJFNUKZD type=write size=3407351 2024-09-12T00:09:42.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.220+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=ERP9DJL7KBVZ type=del size=2256212 2024-09-12T00:09:42.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.221+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~RBODB8XUGNDF.0 size=794825 2024-09-12T00:09:42.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.223+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=RBODB8XUGNDF tag=K3P6W4INA1TJ type=write size=1843401 2024-09-12T00:09:42.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.224+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=SHVOPO3X833V type=del size=1699749 2024-09-12T00:09:42.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.226+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~4AWL1RR1F6CH.0 size=474578 2024-09-12T00:09:42.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.227+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=4AWL1RR1F6CH tag=W5C1M03WSJMU type=write size=1523154 2024-09-12T00:09:42.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.229+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=RV7O9PC34518 type=del size=1833835 2024-09-12T00:09:42.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.229+0000 7f3dc2c18780 1 < canceled part key=_multipart_V0K5FRKYGJ0K.2~K2RX3RPJ5LEM.0 size=1048576 2024-09-12T00:09:42.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.230+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~K2RX3RPJ5LEM.1 size=37092 2024-09-12T00:09:42.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.232+0000 7f3dc2c18780 1 < canceled multipart upload key=V0K5FRKYGJ0K upload=K2RX3RPJ5LEM tag=GDF89ROGVZMU type=write size=2134244 2024-09-12T00:09:42.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.233+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=YG1TL48LW9G3 type=del size=2296363 2024-09-12T00:09:42.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.234+0000 7f3dc2c18780 1 < completed write operation key=GLAOX3ZNNILD tag=YQIX40P7BH74 type=write size=1036009 2024-09-12T00:09:42.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.235+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=3QBYDASAQHSM type=write size=555251 2024-09-12T00:09:42.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.236+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=4L3Q2DKN6IKY type=del 2024-09-12T00:09:42.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.238+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=V26BH7OUU3SX type=del size=2220451 2024-09-12T00:09:42.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.240+0000 7f3dc2c18780 1 < suggested update operation key=5CS98S02F59L tag=F2QO2MSQ8TK4 type=del size=123588 2024-09-12T00:09:42.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.241+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=B1ZLVQ9IB7RN type=del size=3537976 2024-09-12T00:09:42.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.242+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~3QAX362QPWDO.0 size=1048576 2024-09-12T00:09:42.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.243+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~3QAX362QPWDO.1 size=603070 2024-09-12T00:09:42.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.245+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=3QAX362QPWDO tag=4T0VB3Q8IL9C type=write size=2700222 2024-09-12T00:09:42.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.247+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~UCCXPCXEKVEA.0 size=647137 2024-09-12T00:09:42.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.247+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=UCCXPCXEKVEA tag=MHVXDEV25M36 type=write size=1695713 2024-09-12T00:09:42.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.249+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~JV7WEOEZMF4X.0 size=683687 2024-09-12T00:09:42.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.251+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=JV7WEOEZMF4X tag=7BUGKM4S2O4G type=write size=1732263 2024-09-12T00:09:42.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.252+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=GHJUBU5RZLLU type=del size=3213089 2024-09-12T00:09:42.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.252+0000 7f3dc2c18780 1 < canceled part key=_multipart_GLAOX3ZNNILD.2~76UI39A9ETTZ.0 size=1048576 2024-09-12T00:09:42.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.253+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~76UI39A9ETTZ.1 size=85892 2024-09-12T00:09:42.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.255+0000 7f3dc2c18780 1 < canceled multipart upload key=GLAOX3ZNNILD upload=76UI39A9ETTZ tag=S5OEZ4VJMG46 type=write size=2183044 2024-09-12T00:09:42.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.257+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~IS5ZF6NGE3B1.0 size=1048576 2024-09-12T00:09:42.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.258+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~IS5ZF6NGE3B1.1 size=946596 2024-09-12T00:09:42.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.258+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=IS5ZF6NGE3B1 tag=J8K4JXQFH80P type=write size=3043748 2024-09-12T00:09:42.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.259+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~TNX8DPJY5IZZ.0 size=1048576 2024-09-12T00:09:42.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.260+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~TNX8DPJY5IZZ.1 size=268943 2024-09-12T00:09:42.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.262+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=TNX8DPJY5IZZ tag=Y9TT6AMKFPLG type=write size=2366095 2024-09-12T00:09:42.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.264+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~YZ29XRQQ3BLO.0 size=1048576 2024-09-12T00:09:42.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.265+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~YZ29XRQQ3BLO.1 size=1048576 2024-09-12T00:09:42.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.266+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~YZ29XRQQ3BLO.2 size=746734 2024-09-12T00:09:42.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.266+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=YZ29XRQQ3BLO tag=WSX4QHRNTFC4 type=write size=3892462 2024-09-12T00:09:42.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.268+0000 7f3dc2c18780 1 < canceled operation key=A4O7JFS2ULY0 tag=I15UYET45LRQ type=del size=1476681 2024-09-12T00:09:42.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.269+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=QHP4597ZCVRK type=del size=345153 2024-09-12T00:09:42.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.271+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~HADGY1CMGKZY.0 size=1048576 2024-09-12T00:09:42.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.272+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~HADGY1CMGKZY.1 size=505508 2024-09-12T00:09:42.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.274+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=HADGY1CMGKZY tag=N5KVCK31B7YQ type=write size=2602660 2024-09-12T00:09:42.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.276+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~U968TXAKAYKS.0 size=1048576 2024-09-12T00:09:42.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.277+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~U968TXAKAYKS.1 size=1048576 2024-09-12T00:09:42.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.278+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~U968TXAKAYKS.2 size=997418 2024-09-12T00:09:42.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.278+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=U968TXAKAYKS tag=IOW2MHRMNJ3X type=write size=4143146 2024-09-12T00:09:42.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.279+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=8ND8MZ4VS84O type=del 2024-09-12T00:09:42.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.280+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=PZWG3MLR3E4D type=del size=3611663 2024-09-12T00:09:42.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.280+0000 7f3dc2c18780 1 < canceled part key=_multipart_C7ZOCTAR2BEP.2~4RGKFXDWRMXH.0 size=1048576 2024-09-12T00:09:42.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.281+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~4RGKFXDWRMXH.1 size=1048576 2024-09-12T00:09:42.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.282+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~4RGKFXDWRMXH.2 size=310493 2024-09-12T00:09:42.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.286+0000 7f3dc2c18780 1 < canceled multipart upload key=C7ZOCTAR2BEP upload=4RGKFXDWRMXH tag=XABNEZNANLM5 type=write size=3456221 2024-09-12T00:09:42.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.291+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~BH549HTPMEJS.0 size=250925 2024-09-12T00:09:42.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.291+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=BH549HTPMEJS tag=9YK0O2LCVI9A type=write size=1299501 2024-09-12T00:09:42.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.292+0000 7f3dc2c18780 1 < canceled operation key=5BM1TMLRBHTS tag=U2P5H4DDA3RB type=del size=1789130 2024-09-12T00:09:42.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.294+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~L5SMF3UFOXA8.0 size=1048576 2024-09-12T00:09:42.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.295+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~L5SMF3UFOXA8.1 size=65901 2024-09-12T00:09:42.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.295+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=L5SMF3UFOXA8 tag=JPAG9OKECBT7 type=write size=2163053 2024-09-12T00:09:42.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.297+0000 7f3dc2c18780 -1 < failed to complete operation key=5CS98S02F59L tag=ERP9DJL7KBVZ type=del size=2256212: (22) Invalid argument 2024-09-12T00:09:42.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.298+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=UF3VW1TXFHWO type=write size=214276 2024-09-12T00:09:42.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.299+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=SHVOPO3X833V type=del 2024-09-12T00:09:42.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.300+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=S5KV4MDCS2C6 type=del size=2013857 2024-09-12T00:09:42.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.301+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=RV7O9PC34518 type=del 2024-09-12T00:09:42.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.303+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=02F97X6B5HGG type=del size=1714814 2024-09-12T00:09:42.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.304+0000 7f3dc2c18780 1 < canceled operation key=A4O7JFS2ULY0 tag=YG1TL48LW9G3 type=del size=2296363 2024-09-12T00:09:42.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.305+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=6JILBZ8YHDPH type=del size=2284222 2024-09-12T00:09:42.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.307+0000 7f3dc2c18780 1 < suggested remove operation key=4POD73U0LAC0 tag=3QBYDASAQHSM type=write 2024-09-12T00:09:42.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.309+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~9KNS2642LBTC.0 size=21186 2024-09-12T00:09:42.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.309+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=9KNS2642LBTC tag=3G20AA7MFD25 type=write size=1069762 2024-09-12T00:09:42.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.312+0000 7f3dc2c18780 1 < suggested remove operation key=5BM1TMLRBHTS tag=V26BH7OUU3SX type=del 2024-09-12T00:09:42.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.314+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~YC7IHGYKCQ0U.0 size=1048576 2024-09-12T00:09:42.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.315+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~YC7IHGYKCQ0U.1 size=1048576 2024-09-12T00:09:42.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.316+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~YC7IHGYKCQ0U.2 size=455992 2024-09-12T00:09:42.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.316+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=YC7IHGYKCQ0U tag=69HLR882S4AJ type=write size=3601720 2024-09-12T00:09:42.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.318+0000 7f3dc2c18780 1 < suggested remove operation key=UJDQEIAIRVDW tag=B1ZLVQ9IB7RN type=del 2024-09-12T00:09:42.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.319+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=L7XJEDN9OI9P type=write size=284797 2024-09-12T00:09:42.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.321+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~UCCXPCXEKVEA.0 size=647137 2024-09-12T00:09:42.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.322+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=UCCXPCXEKVEA tag=MHVXDEV25M36 type=write size=1695713 2024-09-12T00:09:42.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.325+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~Q0WX3UY47NZL.0 size=795432 2024-09-12T00:09:42.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.325+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=Q0WX3UY47NZL tag=B5LQPZM53FDM type=write size=1844008 2024-09-12T00:09:42.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.326+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=GHJUBU5RZLLU type=del 2024-09-12T00:09:42.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.328+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=ZS4KID1UY6A6 type=del size=3179536 2024-09-12T00:09:42.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.329+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~IS5ZF6NGE3B1.0 size=1048576 2024-09-12T00:09:42.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.329+0000 7f3dc2c18780 1 < canceled part key=_multipart_3WUIB2OMX77J.2~IS5ZF6NGE3B1.1 size=946596 2024-09-12T00:09:42.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.331+0000 7f3dc2c18780 1 < canceled multipart upload key=3WUIB2OMX77J upload=IS5ZF6NGE3B1 tag=J8K4JXQFH80P type=write size=3043748 2024-09-12T00:09:42.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.333+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DQ4XLQYFX2XM.0 size=1048576 2024-09-12T00:09:42.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.334+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~DQ4XLQYFX2XM.1 size=205511 2024-09-12T00:09:42.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.334+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=DQ4XLQYFX2XM tag=UF1AG39A7K7H type=write size=2302663 2024-09-12T00:09:42.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.336+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~YZ29XRQQ3BLO.0 size=1048576 2024-09-12T00:09:42.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.337+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~YZ29XRQQ3BLO.1 size=1048576 2024-09-12T00:09:42.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.337+0000 7f3dc2c18780 1 < canceled part key=_multipart_A4O7JFS2ULY0.2~YZ29XRQQ3BLO.2 size=746734 2024-09-12T00:09:42.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.339+0000 7f3dc2c18780 1 < canceled multipart upload key=A4O7JFS2ULY0 upload=YZ29XRQQ3BLO tag=WSX4QHRNTFC4 type=write size=3892462 2024-09-12T00:09:42.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.340+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=PZWLMC449Z1N type=del size=2146952 2024-09-12T00:09:42.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.342+0000 7f3dc2c18780 1 < suggested remove operation key=KDHO7IEGICDA tag=QHP4597ZCVRK type=del 2024-09-12T00:09:42.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.345+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~YA09ZPHQ627S.0 size=780315 2024-09-12T00:09:42.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.345+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=YA09ZPHQ627S tag=I2E3662ZQESW type=write size=1828891 2024-09-12T00:09:42.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.346+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~U968TXAKAYKS.0 size=1048576 2024-09-12T00:09:42.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.348+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~U968TXAKAYKS.1 size=1048576 2024-09-12T00:09:42.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.349+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~U968TXAKAYKS.2 size=997418 2024-09-12T00:09:42.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.351+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=U968TXAKAYKS tag=IOW2MHRMNJ3X type=write size=4143146 2024-09-12T00:09:42.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.352+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=4MVEE0UMJCNP type=del size=949565 2024-09-12T00:09:42.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.354+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=PZWG3MLR3E4D type=del 2024-09-12T00:09:42.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.356+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~S3VEDQVCI0RF.0 size=1005016 2024-09-12T00:09:42.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.356+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=S3VEDQVCI0RF tag=ASFGTUCDOLQ0 type=write size=2053592 2024-09-12T00:09:42.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.357+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~BH549HTPMEJS.0 size=250925 2024-09-12T00:09:42.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.359+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=BH549HTPMEJS tag=9YK0O2LCVI9A type=write size=1299501 2024-09-12T00:09:42.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.361+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=JX3WHRXO3GLR type=del size=842021 2024-09-12T00:09:42.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.362+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~L5SMF3UFOXA8.0 size=1048576 2024-09-12T00:09:42.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.363+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~L5SMF3UFOXA8.1 size=65901 2024-09-12T00:09:42.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.365+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=L5SMF3UFOXA8 tag=JPAG9OKECBT7 type=write size=2163053 2024-09-12T00:09:42.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.366+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=NH03AVEL4FCV type=del size=2689381 2024-09-12T00:09:42.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.367+0000 7f3dc2c18780 1 < completed write operation key=V0K5FRKYGJ0K tag=UF3VW1TXFHWO type=write size=214276 2024-09-12T00:09:42.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.369+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=LAZ0Z0QT3DE7 type=write size=686137 2024-09-12T00:09:42.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.370+0000 7f3dc2c18780 1 < canceled operation key=QJ3KML910OEL tag=S5KV4MDCS2C6 type=del size=2013857 2024-09-12T00:09:42.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.371+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=YMKFRK16KRBW type=del size=3505496 2024-09-12T00:09:42.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.372+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=02F97X6B5HGG type=del 2024-09-12T00:09:42.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.374+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=ZGAP2ONH0SA3 type=del size=3620613 2024-09-12T00:09:42.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.375+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=6JILBZ8YHDPH type=del 2024-09-12T00:09:42.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.377+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~SPQEA6829CX5.0 size=626308 2024-09-12T00:09:42.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.377+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=SPQEA6829CX5 tag=DKN9EGGADNQQ type=write size=1674884 2024-09-12T00:09:42.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.378+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~9KNS2642LBTC.0 size=21186 2024-09-12T00:09:42.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.380+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=9KNS2642LBTC tag=3G20AA7MFD25 type=write size=1069762 2024-09-12T00:09:42.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.382+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=OXAAAV4V6O8P type=del size=1651413 2024-09-12T00:09:42.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.383+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~YC7IHGYKCQ0U.0 size=1048576 2024-09-12T00:09:42.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.384+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~YC7IHGYKCQ0U.1 size=1048576 2024-09-12T00:09:42.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.385+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~YC7IHGYKCQ0U.2 size=455992 2024-09-12T00:09:42.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.387+0000 7f3dc2c18780 1 < completed multipart upload key=5CS98S02F59L upload=YC7IHGYKCQ0U tag=69HLR882S4AJ type=write size=3601720 2024-09-12T00:09:42.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.389+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=KW5GIOA9SG4J type=del size=3586616 2024-09-12T00:09:42.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.390+0000 7f3dc2c18780 1 < completed write operation key=3WUIB2OMX77J tag=L7XJEDN9OI9P type=write size=284797 2024-09-12T00:09:42.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.391+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=C9LGQFBGYT67 type=del size=1277413 2024-09-12T00:09:42.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.393+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~Q0WX3UY47NZL.0 size=795432 2024-09-12T00:09:42.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.395+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=Q0WX3UY47NZL tag=B5LQPZM53FDM type=write size=1844008 2024-09-12T00:09:42.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.398+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~PYUS5O3D24OV.0 size=1048576 2024-09-12T00:09:42.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.398+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~PYUS5O3D24OV.1 size=1048576 2024-09-12T00:09:42.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.399+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~PYUS5O3D24OV.2 size=205683 2024-09-12T00:09:42.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.399+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=PYUS5O3D24OV tag=P59LGAU9RK08 type=write size=3351411 2024-09-12T00:09:42.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.402+0000 7f3dc2c18780 1 < suggested remove operation key=UJDQEIAIRVDW tag=ZS4KID1UY6A6 type=del 2024-09-12T00:09:42.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.403+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=3DRP96MH2Y1R type=del size=1685215 2024-09-12T00:09:42.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.404+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DQ4XLQYFX2XM.0 size=1048576 2024-09-12T00:09:42.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.406+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~DQ4XLQYFX2XM.1 size=205511 2024-09-12T00:09:42.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.409+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=DQ4XLQYFX2XM tag=UF1AG39A7K7H type=write size=2302663 2024-09-12T00:09:42.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.411+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~4KN5L93YAMZ5.0 size=1048576 2024-09-12T00:09:42.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.412+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~4KN5L93YAMZ5.1 size=1048576 2024-09-12T00:09:42.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.413+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~4KN5L93YAMZ5.2 size=872319 2024-09-12T00:09:42.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.413+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=4KN5L93YAMZ5 tag=QT9WURY3QNRO type=write size=4018047 2024-09-12T00:09:42.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.415+0000 7f3dc2c18780 1 < suggested remove operation key=25CF1N8J81Y9 tag=PZWLMC449Z1N type=del 2024-09-12T00:09:42.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.417+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~RBW2PZEJGKUM.0 size=1048576 2024-09-12T00:09:42.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.418+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~RBW2PZEJGKUM.1 size=624891 2024-09-12T00:09:42.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.418+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=RBW2PZEJGKUM tag=2DJFMO4RO36P type=write size=2722043 2024-09-12T00:09:42.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.419+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~YA09ZPHQ627S.0 size=780315 2024-09-12T00:09:42.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.422+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=YA09ZPHQ627S tag=I2E3662ZQESW type=write size=1828891 2024-09-12T00:09:42.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.423+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=TISU4WPK9PHI type=write size=415623 2024-09-12T00:09:42.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.425+0000 7f3dc2c18780 1 < suggested update operation key=5F0BB9U7Y6ZZ tag=4MVEE0UMJCNP type=del size=949565 2024-09-12T00:09:42.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.426+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=R3X0PZYXY7KK type=del size=3689785 2024-09-12T00:09:42.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.428+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~S3VEDQVCI0RF.0 size=1005016 2024-09-12T00:09:42.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.430+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=S3VEDQVCI0RF tag=ASFGTUCDOLQ0 type=write size=2053592 2024-09-12T00:09:42.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.431+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=TRDC04L6O0G7 type=del size=956578 2024-09-12T00:09:42.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.432+0000 7f3dc2c18780 -1 < failed to complete operation key=UJDQEIAIRVDW tag=JX3WHRXO3GLR type=del size=842021: (22) Invalid argument 2024-09-12T00:09:42.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.434+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~IKY45TJKJVDH.0 size=1048576 2024-09-12T00:09:42.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.435+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~IKY45TJKJVDH.1 size=1048576 2024-09-12T00:09:42.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.436+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~IKY45TJKJVDH.2 size=727930 2024-09-12T00:09:42.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.436+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=IKY45TJKJVDH tag=MEAXJM8XS1WH type=write size=3873658 2024-09-12T00:09:42.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.437+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=NH03AVEL4FCV type=del 2024-09-12T00:09:42.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.439+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~240HX0I3QCGT.0 size=1048576 2024-09-12T00:09:42.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.440+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~240HX0I3QCGT.1 size=36454 2024-09-12T00:09:42.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.440+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=240HX0I3QCGT tag=RTXZIUF08RPG type=write size=2133606 2024-09-12T00:09:42.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.442+0000 7f3dc2c18780 1 < completed write operation key=V0K5FRKYGJ0K tag=LAZ0Z0QT3DE7 type=write size=686137 2024-09-12T00:09:42.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.443+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=XDYJ2WZBAW5I type=del size=1934733 2024-09-12T00:09:42.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.444+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=YMKFRK16KRBW type=del 2024-09-12T00:09:42.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.446+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~RSZE955XJSVD.0 size=1048576 2024-09-12T00:09:42.446 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.447+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~RSZE955XJSVD.1 size=383071 2024-09-12T00:09:42.446 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.447+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=RSZE955XJSVD tag=ZELKCBVRJ2X9 type=write size=2480223 2024-09-12T00:09:42.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.449+0000 7f3dc2c18780 1 < canceled operation key=OGRGDIUO2W8B tag=ZGAP2ONH0SA3 type=del size=3620613 2024-09-12T00:09:42.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.451+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~MHA8257LPA86.0 size=1048576 2024-09-12T00:09:42.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.452+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~MHA8257LPA86.1 size=355857 2024-09-12T00:09:42.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.452+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=MHA8257LPA86 tag=TKPDHY1B7FRA type=write size=2453009 2024-09-12T00:09:42.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.453+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~SPQEA6829CX5.0 size=626308 2024-09-12T00:09:42.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.455+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=SPQEA6829CX5 tag=DKN9EGGADNQQ type=write size=1674884 2024-09-12T00:09:42.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.456+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=KRE92UJPA13I type=del size=2076722 2024-09-12T00:09:42.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.458+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=OXAAAV4V6O8P type=del 2024-09-12T00:09:42.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.459+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=OSBVDC9W8N5A type=del size=1794587 2024-09-12T00:09:42.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.460+0000 7f3dc2c18780 1 < canceled operation key=U2H0A1GZROT7 tag=KW5GIOA9SG4J type=del size=3586616 2024-09-12T00:09:42.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.463+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~MK9SJUGZIJIP.0 size=1048576 2024-09-12T00:09:42.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.464+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~MK9SJUGZIJIP.1 size=1048576 2024-09-12T00:09:42.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.465+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~MK9SJUGZIJIP.2 size=498985 2024-09-12T00:09:42.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.465+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=MK9SJUGZIJIP tag=7FMO8029JZOL type=write size=3644713 2024-09-12T00:09:42.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.467+0000 7f3dc2c18780 1 < suggested remove operation key=5MAV2RJ4E31S tag=C9LGQFBGYT67 type=del 2024-09-12T00:09:42.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.468+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=KVN0POPXJF2I type=del size=3057587 2024-09-12T00:09:42.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.469+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~PYUS5O3D24OV.0 size=1048576 2024-09-12T00:09:42.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.470+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~PYUS5O3D24OV.1 size=1048576 2024-09-12T00:09:42.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.471+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~PYUS5O3D24OV.2 size=205683 2024-09-12T00:09:42.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.473+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=PYUS5O3D24OV tag=P59LGAU9RK08 type=write size=3351411 2024-09-12T00:09:42.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.475+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=JFCMH403H03U type=del size=4056873 2024-09-12T00:09:42.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.476+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=3DRP96MH2Y1R type=del 2024-09-12T00:09:42.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.478+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~V7ZMBZA1W9SR.0 size=700541 2024-09-12T00:09:42.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.478+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=V7ZMBZA1W9SR tag=SX218P50HG9T type=write size=1749117 2024-09-12T00:09:42.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.479+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~4KN5L93YAMZ5.0 size=1048576 2024-09-12T00:09:42.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.479+0000 7f3dc2c18780 1 < canceled part key=_multipart_5CS98S02F59L.2~4KN5L93YAMZ5.1 size=1048576 2024-09-12T00:09:42.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.481+0000 7f3dc2c18780 1 < completed part key=_multipart_5CS98S02F59L.2~4KN5L93YAMZ5.2 size=872319 2024-09-12T00:09:42.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.483+0000 7f3dc2c18780 1 < canceled multipart upload key=5CS98S02F59L upload=4KN5L93YAMZ5 tag=QT9WURY3QNRO type=write size=4018047 2024-09-12T00:09:42.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.484+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=GCA4W9PSY6G1 type=write size=1030139 2024-09-12T00:09:42.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.485+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~RBW2PZEJGKUM.0 size=1048576 2024-09-12T00:09:42.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.486+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~RBW2PZEJGKUM.1 size=624891 2024-09-12T00:09:42.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.488+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=RBW2PZEJGKUM tag=2DJFMO4RO36P type=write size=2722043 2024-09-12T00:09:42.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.491+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~RY28ABCMVXSL.0 size=1048576 2024-09-12T00:09:42.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.492+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~RY28ABCMVXSL.1 size=1048576 2024-09-12T00:09:42.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.493+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~RY28ABCMVXSL.2 size=933117 2024-09-12T00:09:42.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.493+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=RY28ABCMVXSL tag=36JAUVF22989 type=write size=4078845 2024-09-12T00:09:42.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.494+0000 7f3dc2c18780 1 < completed write operation key=WRR6LAYIWOCE tag=TISU4WPK9PHI type=write size=415623 2024-09-12T00:09:42.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.496+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~TU5VPEA1VWWO.0 size=1048576 2024-09-12T00:09:42.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.497+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~TU5VPEA1VWWO.1 size=1048576 2024-09-12T00:09:42.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.498+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~TU5VPEA1VWWO.2 size=419724 2024-09-12T00:09:42.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.498+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=TU5VPEA1VWWO tag=3WDX2FA8H4ZZ type=write size=3565452 2024-09-12T00:09:42.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.500+0000 7f3dc2c18780 1 < suggested remove operation key=8JFV08DJLXTB tag=R3X0PZYXY7KK type=del 2024-09-12T00:09:42.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.502+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~BAM53CN1XM6C.0 size=1048576 2024-09-12T00:09:42.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.503+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~BAM53CN1XM6C.1 size=1048576 2024-09-12T00:09:42.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.504+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~BAM53CN1XM6C.2 size=614623 2024-09-12T00:09:42.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.504+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=BAM53CN1XM6C tag=Z33TQPMFDK72 type=write size=3760351 2024-09-12T00:09:42.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.506+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=TRDC04L6O0G7 type=del 2024-09-12T00:09:42.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.508+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~W3DF16L567M4.0 size=1048576 2024-09-12T00:09:42.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.509+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~W3DF16L567M4.1 size=1048576 2024-09-12T00:09:42.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.510+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~W3DF16L567M4.2 size=351809 2024-09-12T00:09:42.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.510+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=W3DF16L567M4 tag=FLIQTPOQJIXW type=write size=3497537 2024-09-12T00:09:42.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.511+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~IKY45TJKJVDH.0 size=1048576 2024-09-12T00:09:42.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.512+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~IKY45TJKJVDH.1 size=1048576 2024-09-12T00:09:42.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.513+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~IKY45TJKJVDH.2 size=727930 2024-09-12T00:09:42.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.515+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=IKY45TJKJVDH tag=MEAXJM8XS1WH type=write size=3873658 2024-09-12T00:09:42.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.517+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=0KS9GWJXLUX5 type=del size=2733518 2024-09-12T00:09:42.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.517+0000 7f3dc2c18780 1 < canceled part key=_multipart_0ICU4WV9K1RG.2~240HX0I3QCGT.0 size=1048576 2024-09-12T00:09:42.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.519+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~240HX0I3QCGT.1 size=36454 2024-09-12T00:09:42.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.521+0000 7f3dc2c18780 1 < canceled multipart upload key=0ICU4WV9K1RG upload=240HX0I3QCGT tag=RTXZIUF08RPG type=write size=2133606 2024-09-12T00:09:42.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.522+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=GVDA1QBHPB1I type=del size=2130068 2024-09-12T00:09:42.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.523+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=XDYJ2WZBAW5I type=del 2024-09-12T00:09:42.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.524+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=KDSLLKN09D72 type=del size=3003970 2024-09-12T00:09:42.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.526+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~RSZE955XJSVD.0 size=1048576 2024-09-12T00:09:42.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.527+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~RSZE955XJSVD.1 size=383071 2024-09-12T00:09:42.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.529+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=RSZE955XJSVD tag=ZELKCBVRJ2X9 type=write size=2480223 2024-09-12T00:09:42.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.530+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=KNVGLXCR5Z4S type=write size=949829 2024-09-12T00:09:42.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.532+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~MHA8257LPA86.0 size=1048576 2024-09-12T00:09:42.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.533+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~MHA8257LPA86.1 size=355857 2024-09-12T00:09:42.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.535+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=MHA8257LPA86 tag=TKPDHY1B7FRA type=write size=2453009 2024-09-12T00:09:42.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.536+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=32EYZ279FKNA type=write size=755832 2024-09-12T00:09:42.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.537+0000 7f3dc2c18780 1 < completed delete operation key=415OYT4ML329 tag=KRE92UJPA13I type=del 2024-09-12T00:09:42.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.539+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=57FPZSUA1K08 type=del size=476803 2024-09-12T00:09:42.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.540+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=OSBVDC9W8N5A type=del 2024-09-12T00:09:42.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.541+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=NPCVXE3H84R0 type=del size=656436 2024-09-12T00:09:42.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.543+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~MK9SJUGZIJIP.0 size=1048576 2024-09-12T00:09:42.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.544+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~MK9SJUGZIJIP.1 size=1048576 2024-09-12T00:09:42.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.545+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~MK9SJUGZIJIP.2 size=498985 2024-09-12T00:09:42.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.547+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=MK9SJUGZIJIP tag=7FMO8029JZOL type=write size=3644713 2024-09-12T00:09:42.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.549+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~4YUADAYV6C9W.0 size=1048576 2024-09-12T00:09:42.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.550+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~4YUADAYV6C9W.1 size=2786 2024-09-12T00:09:42.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.550+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=4YUADAYV6C9W tag=0ND9IA7MWWNZ type=write size=2099938 2024-09-12T00:09:42.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.552+0000 7f3dc2c18780 1 < suggested remove operation key=5BM1TMLRBHTS tag=KVN0POPXJF2I type=del 2024-09-12T00:09:42.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.555+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~16NICB0XKN9E.0 size=167812 2024-09-12T00:09:42.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.555+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=16NICB0XKN9E tag=7ZQUDTIYQ6TM type=write size=1216388 2024-09-12T00:09:42.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.556+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=JFCMH403H03U type=del 2024-09-12T00:09:42.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.557+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=6ISMDQU03XB4 type=write size=105439 2024-09-12T00:09:42.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.559+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~V7ZMBZA1W9SR.0 size=700541 2024-09-12T00:09:42.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.561+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=V7ZMBZA1W9SR tag=SX218P50HG9T type=write size=1749117 2024-09-12T00:09:42.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.562+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=P0TI4EYMGTAP type=del size=727838 2024-09-12T00:09:42.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.563+0000 7f3dc2c18780 1 < completed write operation key=KQWXE62PF5F7 tag=GCA4W9PSY6G1 type=write size=1030139 2024-09-12T00:09:42.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.566+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~QP7VRLVJFKRE.0 size=1048576 2024-09-12T00:09:42.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.567+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~QP7VRLVJFKRE.1 size=241935 2024-09-12T00:09:42.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.567+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=QP7VRLVJFKRE tag=AAM8CJWBYYYS type=write size=2339087 2024-09-12T00:09:42.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.568+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~RY28ABCMVXSL.0 size=1048576 2024-09-12T00:09:42.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.569+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~RY28ABCMVXSL.1 size=1048576 2024-09-12T00:09:42.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.570+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~RY28ABCMVXSL.2 size=933117 2024-09-12T00:09:42.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.572+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=RY28ABCMVXSL tag=36JAUVF22989 type=write size=4078845 2024-09-12T00:09:42.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.573+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=YRRUG71XHM2U type=del size=2505373 2024-09-12T00:09:42.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.575+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~TU5VPEA1VWWO.0 size=1048576 2024-09-12T00:09:42.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.576+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~TU5VPEA1VWWO.1 size=1048576 2024-09-12T00:09:42.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.577+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~TU5VPEA1VWWO.2 size=419724 2024-09-12T00:09:42.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.579+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=TU5VPEA1VWWO tag=3WDX2FA8H4ZZ type=write size=3565452 2024-09-12T00:09:42.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.581+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~9TJG13JQ0GZ8.0 size=1048576 2024-09-12T00:09:42.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.582+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~9TJG13JQ0GZ8.1 size=1048576 2024-09-12T00:09:42.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.583+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~9TJG13JQ0GZ8.2 size=910958 2024-09-12T00:09:42.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.583+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=9TJG13JQ0GZ8 tag=H1GU7EQHHIFN type=write size=4056686 2024-09-12T00:09:42.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.584+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~BAM53CN1XM6C.0 size=1048576 2024-09-12T00:09:42.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.585+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~BAM53CN1XM6C.1 size=1048576 2024-09-12T00:09:42.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.586+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~BAM53CN1XM6C.2 size=614623 2024-09-12T00:09:42.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.589+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=BAM53CN1XM6C tag=Z33TQPMFDK72 type=write size=3760351 2024-09-12T00:09:42.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.591+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~79U3QPKU3XIP.0 size=1048576 2024-09-12T00:09:42.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.592+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~79U3QPKU3XIP.1 size=1048576 2024-09-12T00:09:42.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.593+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~79U3QPKU3XIP.2 size=141758 2024-09-12T00:09:42.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.593+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=79U3QPKU3XIP tag=R1OS9Y5R2HZG type=write size=3287486 2024-09-12T00:09:42.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.594+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~W3DF16L567M4.0 size=1048576 2024-09-12T00:09:42.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.595+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~W3DF16L567M4.1 size=1048576 2024-09-12T00:09:42.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.596+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~W3DF16L567M4.2 size=351809 2024-09-12T00:09:42.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.598+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=W3DF16L567M4 tag=FLIQTPOQJIXW type=write size=3497537 2024-09-12T00:09:42.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.601+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~ZWGISWDEDDQ3.0 size=660396 2024-09-12T00:09:42.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.601+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=ZWGISWDEDDQ3 tag=24KBHC1PB0PE type=write size=1708972 2024-09-12T00:09:42.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.602+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=0KS9GWJXLUX5 type=del 2024-09-12T00:09:42.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.603+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=1HC90TZAEXKQ type=del size=1749993 2024-09-12T00:09:42.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.604+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=GVDA1QBHPB1I type=del 2024-09-12T00:09:42.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.606+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=M306AKZ6DQE5 type=del size=1519407 2024-09-12T00:09:42.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.607+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=KDSLLKN09D72 type=del 2024-09-12T00:09:42.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.608+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=19L2BVSQ3SWK type=del size=3107807 2024-09-12T00:09:42.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.609+0000 7f3dc2c18780 1 < completed write operation key=GP3MLWX9586T tag=KNVGLXCR5Z4S type=write size=949829 2024-09-12T00:09:42.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.611+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=W4C8AZ7X320B type=del size=2193904 2024-09-12T00:09:42.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.612+0000 7f3dc2c18780 1 < canceled operation key=25CF1N8J81Y9 tag=32EYZ279FKNA type=write size=755832 2024-09-12T00:09:42.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.613+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=K375IJFQ8OHN type=del size=3867321 2024-09-12T00:09:42.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.615+0000 7f3dc2c18780 -1 < failed to complete operation key=5BM1TMLRBHTS tag=57FPZSUA1K08 type=del size=476803: (22) Invalid argument 2024-09-12T00:09:42.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.617+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~E632FL7S80AM.0 size=1048576 2024-09-12T00:09:42.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.618+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~E632FL7S80AM.1 size=1048576 2024-09-12T00:09:42.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.619+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~E632FL7S80AM.2 size=660647 2024-09-12T00:09:42.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.619+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=E632FL7S80AM tag=0RF30235YNZA type=write size=3806375 2024-09-12T00:09:42.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.620+0000 7f3dc2c18780 1 < completed delete operation key=0ICU4WV9K1RG tag=NPCVXE3H84R0 type=del 2024-09-12T00:09:42.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.622+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~HCGIZ2Q51NEE.0 size=1048576 2024-09-12T00:09:42.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.623+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~HCGIZ2Q51NEE.1 size=696552 2024-09-12T00:09:42.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.623+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=HCGIZ2Q51NEE tag=R5JA1LK8EU63 type=write size=2793704 2024-09-12T00:09:42.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.625+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~4YUADAYV6C9W.0 size=1048576 2024-09-12T00:09:42.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.626+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~4YUADAYV6C9W.1 size=2786 2024-09-12T00:09:42.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.628+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=4YUADAYV6C9W tag=0ND9IA7MWWNZ type=write size=2099938 2024-09-12T00:09:42.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.629+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=ZRCLT2YGDQXX type=del size=2296315 2024-09-12T00:09:42.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.630+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~16NICB0XKN9E.0 size=167812 2024-09-12T00:09:42.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.632+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=16NICB0XKN9E tag=7ZQUDTIYQ6TM type=write size=1216388 2024-09-12T00:09:42.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.635+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=QDOKT94HHVNZ type=del size=573215 2024-09-12T00:09:42.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.636+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=6ISMDQU03XB4 type=write size=105439 2024-09-12T00:09:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.638+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~0ZJ6RSTDUCV5.0 size=153491 2024-09-12T00:09:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.638+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=0ZJ6RSTDUCV5 tag=O6XNGUXNU0WF type=write size=1202067 2024-09-12T00:09:42.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.639+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=P0TI4EYMGTAP type=del 2024-09-12T00:09:42.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.640+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=10M1VMB3BID4 type=del size=468894 2024-09-12T00:09:42.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.642+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~QP7VRLVJFKRE.0 size=1048576 2024-09-12T00:09:42.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.642+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~QP7VRLVJFKRE.1 size=241935 2024-09-12T00:09:42.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.644+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=QP7VRLVJFKRE tag=AAM8CJWBYYYS type=write size=2339087 2024-09-12T00:09:42.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.647+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~ZCCZ4DMZN438.0 size=1048576 2024-09-12T00:09:42.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.647+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~ZCCZ4DMZN438.1 size=1048576 2024-09-12T00:09:42.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.648+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~ZCCZ4DMZN438.2 size=220733 2024-09-12T00:09:42.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.648+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=ZCCZ4DMZN438 tag=FHYOQU7FRBMW type=write size=3366461 2024-09-12T00:09:42.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.650+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=YRRUG71XHM2U type=del 2024-09-12T00:09:42.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.651+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=SNJZR6T58H92 type=del size=977035 2024-09-12T00:09:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.652+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~9TJG13JQ0GZ8.0 size=1048576 2024-09-12T00:09:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.653+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~9TJG13JQ0GZ8.1 size=1048576 2024-09-12T00:09:42.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.654+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~9TJG13JQ0GZ8.2 size=910958 2024-09-12T00:09:42.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.656+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=9TJG13JQ0GZ8 tag=H1GU7EQHHIFN type=write size=4056686 2024-09-12T00:09:42.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.657+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=Z1TG0GR3LQH5 type=write size=1006080 2024-09-12T00:09:42.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.658+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~79U3QPKU3XIP.0 size=1048576 2024-09-12T00:09:42.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.658+0000 7f3dc2c18780 1 < canceled part key=_multipart_3WUIB2OMX77J.2~79U3QPKU3XIP.1 size=1048576 2024-09-12T00:09:42.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.659+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~79U3QPKU3XIP.2 size=141758 2024-09-12T00:09:42.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.661+0000 7f3dc2c18780 1 < canceled multipart upload key=3WUIB2OMX77J upload=79U3QPKU3XIP tag=R1OS9Y5R2HZG type=write size=3287486 2024-09-12T00:09:42.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.663+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~Z96CWNNBJP80.0 size=1048576 2024-09-12T00:09:42.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.664+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~Z96CWNNBJP80.1 size=313302 2024-09-12T00:09:42.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.664+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=Z96CWNNBJP80 tag=0XQI4UJWRZ3F type=write size=2410454 2024-09-12T00:09:42.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.665+0000 7f3dc2c18780 1 < canceled part key=_multipart_XNZNORKYEOPV.2~ZWGISWDEDDQ3.0 size=660396 2024-09-12T00:09:42.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.667+0000 7f3dc2c18780 1 < canceled multipart upload key=XNZNORKYEOPV upload=ZWGISWDEDDQ3 tag=24KBHC1PB0PE type=write size=1708972 2024-09-12T00:09:42.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.669+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~ZM5XG5Y8INWS.0 size=18173 2024-09-12T00:09:42.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.669+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=ZM5XG5Y8INWS tag=X16CXFW4UHDI type=write size=1066749 2024-09-12T00:09:42.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.671+0000 7f3dc2c18780 1 < suggested remove operation key=UJDQEIAIRVDW tag=1HC90TZAEXKQ type=del 2024-09-12T00:09:42.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.673+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~N6YY0AI12JE4.0 size=946249 2024-09-12T00:09:42.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.673+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=N6YY0AI12JE4 tag=113HIS3Q5NRC type=write size=1994825 2024-09-12T00:09:42.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.675+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=M306AKZ6DQE5 type=del 2024-09-12T00:09:42.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.677+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~9VGJZVG4OE2H.0 size=635646 2024-09-12T00:09:42.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.677+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=9VGJZVG4OE2H tag=6BDX71OWBXBN type=write size=1684222 2024-09-12T00:09:42.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.678+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=19L2BVSQ3SWK type=del 2024-09-12T00:09:42.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.680+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~L6XUZ9K7V2UE.0 size=1048576 2024-09-12T00:09:42.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.681+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~L6XUZ9K7V2UE.1 size=502582 2024-09-12T00:09:42.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.681+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=L6XUZ9K7V2UE tag=29Q540MM865K type=write size=2599734 2024-09-12T00:09:42.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.683+0000 7f3dc2c18780 1 < canceled operation key=V0K5FRKYGJ0K tag=W4C8AZ7X320B type=del size=2193904 2024-09-12T00:09:42.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.684+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=M3Q6SP84OY5C type=del size=2111394 2024-09-12T00:09:42.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.685+0000 7f3dc2c18780 1 < canceled operation key=25CF1N8J81Y9 tag=K375IJFQ8OHN type=del size=3867321 2024-09-12T00:09:42.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.686+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=61UFF5I5LXBA type=write size=300144 2024-09-12T00:09:42.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.688+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~E632FL7S80AM.0 size=1048576 2024-09-12T00:09:42.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.690+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~E632FL7S80AM.1 size=1048576 2024-09-12T00:09:42.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.691+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~E632FL7S80AM.2 size=660647 2024-09-12T00:09:42.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.693+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=E632FL7S80AM tag=0RF30235YNZA type=write size=3806375 2024-09-12T00:09:42.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.694+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=23KMYA2ALD4B type=del size=2627534 2024-09-12T00:09:42.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.696+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~HCGIZ2Q51NEE.0 size=1048576 2024-09-12T00:09:42.695 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.697+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~HCGIZ2Q51NEE.1 size=696552 2024-09-12T00:09:42.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.699+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=HCGIZ2Q51NEE tag=R5JA1LK8EU63 type=write size=2793704 2024-09-12T00:09:42.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.700+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=VCINXI6VJGNL type=del size=2185856 2024-09-12T00:09:42.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.701+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=ZRCLT2YGDQXX type=del 2024-09-12T00:09:42.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.702+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=L1DSFKMKG7VB type=del size=2166576 2024-09-12T00:09:42.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.704+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=QDOKT94HHVNZ type=del 2024-09-12T00:09:42.704 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.705+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=Y4EUECXL226Y type=del size=4122361 2024-09-12T00:09:42.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.706+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~0ZJ6RSTDUCV5.0 size=153491 2024-09-12T00:09:42.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.708+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=0ZJ6RSTDUCV5 tag=O6XNGUXNU0WF type=write size=1202067 2024-09-12T00:09:42.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.710+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~ZTJIT6AA04S5.0 size=1048576 2024-09-12T00:09:42.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.711+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~ZTJIT6AA04S5.1 size=288827 2024-09-12T00:09:42.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.711+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=ZTJIT6AA04S5 tag=ND8GLYE23DX5 type=write size=2385979 2024-09-12T00:09:42.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.714+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=10M1VMB3BID4 type=del size=468894 2024-09-12T00:09:42.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.716+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~3A5GVS2Y7F9U.0 size=1048576 2024-09-12T00:09:42.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.717+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~3A5GVS2Y7F9U.1 size=60647 2024-09-12T00:09:42.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.717+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=3A5GVS2Y7F9U tag=9RQUOQ8W51CZ type=write size=2157799 2024-09-12T00:09:42.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.718+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~ZCCZ4DMZN438.0 size=1048576 2024-09-12T00:09:42.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.719+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~ZCCZ4DMZN438.1 size=1048576 2024-09-12T00:09:42.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.719+0000 7f3dc2c18780 1 < canceled part key=_multipart_5F0BB9U7Y6ZZ.2~ZCCZ4DMZN438.2 size=220733 2024-09-12T00:09:42.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.721+0000 7f3dc2c18780 1 < canceled multipart upload key=5F0BB9U7Y6ZZ upload=ZCCZ4DMZN438 tag=FHYOQU7FRBMW type=write size=3366461 2024-09-12T00:09:42.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.723+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=IO2GA2ARVM1Y type=write size=697432 2024-09-12T00:09:42.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.725+0000 7f3dc2c18780 1 < suggested remove operation key=V0K5FRKYGJ0K tag=SNJZR6T58H92 type=del 2024-09-12T00:09:42.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.726+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=FK0Q3A2T0LKC type=del size=3556101 2024-09-12T00:09:42.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.728+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=Z1TG0GR3LQH5 type=write size=1006080 2024-09-12T00:09:42.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.729+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=SJ3DY25PX62C type=del size=438757 2024-09-12T00:09:42.729 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.730+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~Z96CWNNBJP80.0 size=1048576 2024-09-12T00:09:42.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.731+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~Z96CWNNBJP80.1 size=313302 2024-09-12T00:09:42.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.733+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=Z96CWNNBJP80 tag=0XQI4UJWRZ3F type=write size=2410454 2024-09-12T00:09:42.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.735+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=BJ8U0GEMFA8N type=del size=2796322 2024-09-12T00:09:42.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.736+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~ZM5XG5Y8INWS.0 size=18173 2024-09-12T00:09:42.736 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.738+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=ZM5XG5Y8INWS tag=X16CXFW4UHDI type=write size=1066749 2024-09-12T00:09:42.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.740+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~2N8M72FZWJ89.0 size=117638 2024-09-12T00:09:42.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.740+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=2N8M72FZWJ89 tag=Y5DTDNF4RMC5 type=write size=1166214 2024-09-12T00:09:42.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.740+0000 7f3dc2c18780 1 < canceled part key=_multipart_8JFV08DJLXTB.2~N6YY0AI12JE4.0 size=946249 2024-09-12T00:09:42.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.742+0000 7f3dc2c18780 1 < canceled multipart upload key=8JFV08DJLXTB upload=N6YY0AI12JE4 tag=113HIS3Q5NRC type=write size=1994825 2024-09-12T00:09:42.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.743+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=X84SLB5YQBTY type=del size=3415160 2024-09-12T00:09:42.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.745+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~9VGJZVG4OE2H.0 size=635646 2024-09-12T00:09:42.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.747+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=9VGJZVG4OE2H tag=6BDX71OWBXBN type=write size=1684222 2024-09-12T00:09:42.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.749+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=TK7QWBT0WI9X type=del size=30687 2024-09-12T00:09:42.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.750+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~L6XUZ9K7V2UE.0 size=1048576 2024-09-12T00:09:42.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.751+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~L6XUZ9K7V2UE.1 size=502582 2024-09-12T00:09:42.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.754+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=L6XUZ9K7V2UE tag=29Q540MM865K type=write size=2599734 2024-09-12T00:09:42.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.755+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=RVCHKXJF9I4P type=del size=148242 2024-09-12T00:09:42.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.756+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=M3Q6SP84OY5C type=del 2024-09-12T00:09:42.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.758+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~GHRQCBMD06LV.0 size=820091 2024-09-12T00:09:42.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.758+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=GHRQCBMD06LV tag=9IJ8N2ENDQPX type=write size=1868667 2024-09-12T00:09:42.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.760+0000 7f3dc2c18780 1 < completed write operation key=2SO8HBZSAMRX tag=61UFF5I5LXBA type=write size=300144 2024-09-12T00:09:42.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.761+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=QKJFVE6V0RP3 type=write size=603381 2024-09-12T00:09:42.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.762+0000 7f3dc2c18780 1 < canceled operation key=QJ3KML910OEL tag=23KMYA2ALD4B type=del size=2627534 2024-09-12T00:09:42.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.763+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=6S80HY85M211 type=del size=3134956 2024-09-12T00:09:42.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.764+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=VCINXI6VJGNL type=del 2024-09-12T00:09:42.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.766+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=HOMM3JDA8LPT type=del size=658800 2024-09-12T00:09:42.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.767+0000 7f3dc2c18780 -1 < failed to complete operation key=V0K5FRKYGJ0K tag=L1DSFKMKG7VB type=del size=2166576: (22) Invalid argument 2024-09-12T00:09:42.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.768+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=2JARILHAZ1UV type=write size=683795 2024-09-12T00:09:42.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.770+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=Y4EUECXL226Y type=del 2024-09-12T00:09:42.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.772+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~49THGDAXT7OR.0 size=1048576 2024-09-12T00:09:42.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.773+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~49THGDAXT7OR.1 size=604389 2024-09-12T00:09:42.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.773+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=49THGDAXT7OR tag=UB20RIR3LRHF type=write size=2701541 2024-09-12T00:09:42.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.774+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~ZTJIT6AA04S5.0 size=1048576 2024-09-12T00:09:42.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.775+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~ZTJIT6AA04S5.1 size=288827 2024-09-12T00:09:42.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.777+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=ZTJIT6AA04S5 tag=ND8GLYE23DX5 type=write size=2385979 2024-09-12T00:09:42.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.780+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~T6HRP1BLSTGU.0 size=1048576 2024-09-12T00:09:42.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.781+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~T6HRP1BLSTGU.1 size=729939 2024-09-12T00:09:42.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.781+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=T6HRP1BLSTGU tag=4EHE75WQR8XR type=write size=2827091 2024-09-12T00:09:42.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.782+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~3A5GVS2Y7F9U.0 size=1048576 2024-09-12T00:09:42.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.783+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~3A5GVS2Y7F9U.1 size=60647 2024-09-12T00:09:42.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.785+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=3A5GVS2Y7F9U tag=9RQUOQ8W51CZ type=write size=2157799 2024-09-12T00:09:42.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.786+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=OIWOF71W07S0 type=write size=282073 2024-09-12T00:09:42.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.788+0000 7f3dc2c18780 1 < canceled operation key=GLAOX3ZNNILD tag=IO2GA2ARVM1Y type=write size=697432 2024-09-12T00:09:42.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.789+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=GLECGHEKTVB8 type=del size=1091833 2024-09-12T00:09:42.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.790+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=FK0Q3A2T0LKC type=del 2024-09-12T00:09:42.790 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.791+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=YYW1E4V8DWQR type=del size=3799712 2024-09-12T00:09:42.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.793+0000 7f3dc2c18780 1 < canceled operation key=C7ZOCTAR2BEP tag=SJ3DY25PX62C type=del size=438757 2024-09-12T00:09:42.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.794+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=7ZVZTHS84NH9 type=write size=396536 2024-09-12T00:09:42.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.795+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=BJ8U0GEMFA8N type=del 2024-09-12T00:09:42.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.797+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=YNOA5SCUVI0U type=del size=370340 2024-09-12T00:09:42.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.797+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~2N8M72FZWJ89.0 size=117638 2024-09-12T00:09:42.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.799+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=2N8M72FZWJ89 tag=Y5DTDNF4RMC5 type=write size=1166214 2024-09-12T00:09:42.799 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.800+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=WIH19J0R8A5L type=del size=2499366 2024-09-12T00:09:42.800 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.802+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=X84SLB5YQBTY type=del 2024-09-12T00:09:42.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.804+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~XTVXGLRWVLRB.0 size=1048576 2024-09-12T00:09:42.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.805+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~XTVXGLRWVLRB.1 size=1048576 2024-09-12T00:09:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.806+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~XTVXGLRWVLRB.2 size=144919 2024-09-12T00:09:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.806+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=XTVXGLRWVLRB tag=UHQ9UPHFT7YU type=write size=3290647 2024-09-12T00:09:42.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.808+0000 7f3dc2c18780 1 < suggested update operation key=Y40G8SLO6AVH tag=TK7QWBT0WI9X type=del size=30687 2024-09-12T00:09:42.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.810+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=5EA97A33A10L type=del size=2237701 2024-09-12T00:09:42.811 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.812+0000 7f3dc2c18780 1 < suggested update operation key=KDHO7IEGICDA tag=RVCHKXJF9I4P type=del size=148242 2024-09-12T00:09:42.813 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.814+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~G39F7K0JS6D9.0 size=1048576 2024-09-12T00:09:42.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.815+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~G39F7K0JS6D9.1 size=1048576 2024-09-12T00:09:42.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.816+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~G39F7K0JS6D9.2 size=587620 2024-09-12T00:09:42.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.816+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=G39F7K0JS6D9 tag=5OGU3ZURHG4D type=write size=3733348 2024-09-12T00:09:42.816 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.818+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~GHRQCBMD06LV.0 size=820091 2024-09-12T00:09:42.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.820+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=GHRQCBMD06LV tag=9IJ8N2ENDQPX type=write size=1868667 2024-09-12T00:09:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.821+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=D3AEJZYDG5J9 type=write size=604173 2024-09-12T00:09:42.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.824+0000 7f3dc2c18780 1 < suggested remove operation key=0ICU4WV9K1RG tag=QKJFVE6V0RP3 type=write 2024-09-12T00:09:42.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.825+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=5UQ62QIX60HP type=write size=361476 2024-09-12T00:09:42.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.827+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=6S80HY85M211 type=del 2024-09-12T00:09:42.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.828+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=HLGM5IV8DU29 type=del size=4050545 2024-09-12T00:09:42.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.830+0000 7f3dc2c18780 1 < suggested remove operation key=KDHO7IEGICDA tag=HOMM3JDA8LPT type=del 2024-09-12T00:09:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.833+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~B1QIFO8ZJW04.0 size=1048576 2024-09-12T00:09:42.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.834+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~B1QIFO8ZJW04.1 size=1048576 2024-09-12T00:09:42.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.835+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~B1QIFO8ZJW04.2 size=536643 2024-09-12T00:09:42.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.835+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=B1QIFO8ZJW04 tag=IZSIG3G156QS type=write size=3682371 2024-09-12T00:09:42.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.836+0000 7f3dc2c18780 -1 < failed to complete operation key=KDHO7IEGICDA tag=2JARILHAZ1UV type=write size=683795: (22) Invalid argument 2024-09-12T00:09:42.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.838+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~AA5TN3W9C8EI.0 size=778619 2024-09-12T00:09:42.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.839+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=AA5TN3W9C8EI tag=0XVXENIEVAK7 type=write size=1827195 2024-09-12T00:09:42.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.840+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~49THGDAXT7OR.0 size=1048576 2024-09-12T00:09:42.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.841+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~49THGDAXT7OR.1 size=604389 2024-09-12T00:09:42.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.844+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=49THGDAXT7OR tag=UB20RIR3LRHF type=write size=2701541 2024-09-12T00:09:42.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.845+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=HFWTG5PA03Q8 type=del size=57924 2024-09-12T00:09:42.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.846+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~T6HRP1BLSTGU.0 size=1048576 2024-09-12T00:09:42.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.847+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~T6HRP1BLSTGU.1 size=729939 2024-09-12T00:09:42.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.849+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=T6HRP1BLSTGU tag=4EHE75WQR8XR type=write size=2827091 2024-09-12T00:09:42.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.850+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=BIM0CT58706Z type=del size=877961 2024-09-12T00:09:42.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.853+0000 7f3dc2c18780 1 < suggested remove operation key=8JFV08DJLXTB tag=OIWOF71W07S0 type=write 2024-09-12T00:09:42.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.856+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~IDCXI5ZBSCN9.0 size=1048576 2024-09-12T00:09:42.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.857+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~IDCXI5ZBSCN9.1 size=1048576 2024-09-12T00:09:42.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.858+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~IDCXI5ZBSCN9.2 size=293520 2024-09-12T00:09:42.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.858+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=IDCXI5ZBSCN9 tag=HYDCXYH7TI3T type=write size=3439248 2024-09-12T00:09:42.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.860+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=GLECGHEKTVB8 type=del 2024-09-12T00:09:42.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.861+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=DF599GCDXUOU type=del size=3318324 2024-09-12T00:09:42.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.862+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=YYW1E4V8DWQR type=del 2024-09-12T00:09:42.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.864+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~4G17E6U3UH5E.0 size=223279 2024-09-12T00:09:42.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.864+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=4G17E6U3UH5E tag=MRAK1E8RQ1G9 type=write size=1271855 2024-09-12T00:09:42.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.866+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=7ZVZTHS84NH9 type=write size=396536 2024-09-12T00:09:42.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.867+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=4QJTQ2BOO7DX type=del size=3456610 2024-09-12T00:09:42.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.868+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=YNOA5SCUVI0U type=del 2024-09-12T00:09:42.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.870+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=0YC3KCCB3W44 type=del size=411696 2024-09-12T00:09:42.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.872+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=WIH19J0R8A5L type=del 2024-09-12T00:09:42.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.873+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=IZ385EPPDQKQ type=del size=2704424 2024-09-12T00:09:42.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.874+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~XTVXGLRWVLRB.0 size=1048576 2024-09-12T00:09:42.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.875+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~XTVXGLRWVLRB.1 size=1048576 2024-09-12T00:09:42.875 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.876+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~XTVXGLRWVLRB.2 size=144919 2024-09-12T00:09:42.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.878+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=XTVXGLRWVLRB tag=UHQ9UPHFT7YU type=write size=3290647 2024-09-12T00:09:42.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.880+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~491GBOZX8SIU.0 size=1048576 2024-09-12T00:09:42.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.881+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~491GBOZX8SIU.1 size=1048576 2024-09-12T00:09:42.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.882+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~491GBOZX8SIU.2 size=930578 2024-09-12T00:09:42.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.882+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=491GBOZX8SIU tag=CVKD7KUAVJWX type=write size=4076306 2024-09-12T00:09:42.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.883+0000 7f3dc2c18780 -1 < no bi entry to suggest for operation key=8JFV08DJLXTB tag=5EA97A33A10L type=del size=2237701: (2) No such file or directory 2024-09-12T00:09:42.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.886+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~8O741I2NQILP.0 size=1048576 2024-09-12T00:09:42.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.887+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~8O741I2NQILP.1 size=1048576 2024-09-12T00:09:42.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.888+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~8O741I2NQILP.2 size=527274 2024-09-12T00:09:42.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.888+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=8O741I2NQILP tag=VCY7HH2DJFIQ type=write size=3673002 2024-09-12T00:09:42.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.889+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~G39F7K0JS6D9.0 size=1048576 2024-09-12T00:09:42.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.890+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~G39F7K0JS6D9.1 size=1048576 2024-09-12T00:09:42.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.891+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~G39F7K0JS6D9.2 size=587620 2024-09-12T00:09:42.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.893+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=G39F7K0JS6D9 tag=5OGU3ZURHG4D type=write size=3733348 2024-09-12T00:09:42.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.895+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~P5F9OAOOQY10.0 size=1048576 2024-09-12T00:09:42.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.896+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~P5F9OAOOQY10.1 size=1048576 2024-09-12T00:09:42.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.897+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~P5F9OAOOQY10.2 size=316878 2024-09-12T00:09:42.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.897+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=P5F9OAOOQY10 tag=WAAGQX963BFU type=write size=3462606 2024-09-12T00:09:42.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.898+0000 7f3dc2c18780 1 < completed write operation key=TSL3IDD0EDT0 tag=D3AEJZYDG5J9 type=write size=604173 2024-09-12T00:09:42.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.900+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~P6WWRHLGP1X4.0 size=1048576 2024-09-12T00:09:42.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.901+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~P6WWRHLGP1X4.1 size=1048576 2024-09-12T00:09:42.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.902+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~P6WWRHLGP1X4.2 size=62083 2024-09-12T00:09:42.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.902+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=P6WWRHLGP1X4 tag=OE12RWKNIHFE type=write size=3207811 2024-09-12T00:09:42.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.903+0000 7f3dc2c18780 1 < completed write operation key=3WUIB2OMX77J tag=5UQ62QIX60HP type=write size=361476 2024-09-12T00:09:42.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.906+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~TGJMACJ6DOEA.0 size=1048576 2024-09-12T00:09:42.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.907+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~TGJMACJ6DOEA.1 size=1048576 2024-09-12T00:09:42.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.908+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~TGJMACJ6DOEA.2 size=994449 2024-09-12T00:09:42.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.908+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=TGJMACJ6DOEA tag=MJQ87IB5SPZD type=write size=4140177 2024-09-12T00:09:42.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.909+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=HLGM5IV8DU29 type=del 2024-09-12T00:09:42.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.911+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~3MHU1PL51K1A.0 size=946603 2024-09-12T00:09:42.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.911+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=3MHU1PL51K1A tag=LZEJQW6YG92S type=write size=1995179 2024-09-12T00:09:42.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.912+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~B1QIFO8ZJW04.0 size=1048576 2024-09-12T00:09:42.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.913+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~B1QIFO8ZJW04.1 size=1048576 2024-09-12T00:09:42.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.914+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~B1QIFO8ZJW04.2 size=536643 2024-09-12T00:09:42.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.916+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=B1QIFO8ZJW04 tag=IZSIG3G156QS type=write size=3682371 2024-09-12T00:09:42.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.919+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~VF92D85MC8AZ.0 size=1048576 2024-09-12T00:09:42.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.919+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~VF92D85MC8AZ.1 size=1048576 2024-09-12T00:09:42.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.921+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~VF92D85MC8AZ.2 size=928703 2024-09-12T00:09:42.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.921+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=VF92D85MC8AZ tag=DQPJIYEEGKEW type=write size=4074431 2024-09-12T00:09:42.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.922+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~AA5TN3W9C8EI.0 size=778619 2024-09-12T00:09:42.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.924+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=AA5TN3W9C8EI tag=0XVXENIEVAK7 type=write size=1827195 2024-09-12T00:09:42.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.926+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~1ITCGMKM6NWA.0 size=1048576 2024-09-12T00:09:42.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.927+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~1ITCGMKM6NWA.1 size=753565 2024-09-12T00:09:42.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.927+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=1ITCGMKM6NWA tag=R75EJQ6549OL type=write size=2850717 2024-09-12T00:09:42.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.928+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=HFWTG5PA03Q8 type=del 2024-09-12T00:09:42.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.930+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~Z86JVWN7OBQ8.0 size=1048576 2024-09-12T00:09:42.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.932+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~Z86JVWN7OBQ8.1 size=828564 2024-09-12T00:09:42.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.932+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=Z86JVWN7OBQ8 tag=1KYZFFAKZ4VH type=write size=2925716 2024-09-12T00:09:42.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.933+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=BIM0CT58706Z type=del 2024-09-12T00:09:42.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.934+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=S3QRMDCQN0TI type=del size=1229630 2024-09-12T00:09:42.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.935+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~IDCXI5ZBSCN9.0 size=1048576 2024-09-12T00:09:42.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.937+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~IDCXI5ZBSCN9.1 size=1048576 2024-09-12T00:09:42.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.938+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~IDCXI5ZBSCN9.2 size=293520 2024-09-12T00:09:42.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.940+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=IDCXI5ZBSCN9 tag=HYDCXYH7TI3T type=write size=3439248 2024-09-12T00:09:42.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.941+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=E083NJWBVIRJ type=del size=994824 2024-09-12T00:09:42.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.942+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=DF599GCDXUOU type=del 2024-09-12T00:09:42.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.943+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=MZOZU5QUMJ9B type=del size=4021815 2024-09-12T00:09:42.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.945+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~4G17E6U3UH5E.0 size=223279 2024-09-12T00:09:42.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.946+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=4G17E6U3UH5E tag=MRAK1E8RQ1G9 type=write size=1271855 2024-09-12T00:09:42.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.948+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=OCT9BA8CJXYF type=del size=3525417 2024-09-12T00:09:42.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.950+0000 7f3dc2c18780 1 < suggested update operation key=A4O7JFS2ULY0 tag=4QJTQ2BOO7DX type=del size=3456610 2024-09-12T00:09:42.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.952+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~E4MDQX661PB7.0 size=755724 2024-09-12T00:09:42.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.952+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=E4MDQX661PB7 tag=8C2LGO2JAPUQ type=write size=1804300 2024-09-12T00:09:42.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.953+0000 7f3dc2c18780 -1 < failed to complete operation key=A4O7JFS2ULY0 tag=0YC3KCCB3W44 type=del size=411696: (22) Invalid argument 2024-09-12T00:09:42.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.955+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=9O4IGCLEVFIK type=del size=4100844 2024-09-12T00:09:42.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.956+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=IZ385EPPDQKQ type=del 2024-09-12T00:09:42.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.957+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=D9HJNXVAXH5G type=del size=1948939 2024-09-12T00:09:42.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.958+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~491GBOZX8SIU.0 size=1048576 2024-09-12T00:09:42.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.959+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~491GBOZX8SIU.1 size=1048576 2024-09-12T00:09:42.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.960+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~491GBOZX8SIU.2 size=930578 2024-09-12T00:09:42.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.962+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=491GBOZX8SIU tag=CVKD7KUAVJWX type=write size=4076306 2024-09-12T00:09:42.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.963+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=AJ2ELGJ7P69C type=del size=3213904 2024-09-12T00:09:42.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.965+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~8O741I2NQILP.0 size=1048576 2024-09-12T00:09:42.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.966+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~8O741I2NQILP.1 size=1048576 2024-09-12T00:09:42.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.967+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~8O741I2NQILP.2 size=527274 2024-09-12T00:09:42.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.969+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=8O741I2NQILP tag=VCY7HH2DJFIQ type=write size=3673002 2024-09-12T00:09:42.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.970+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=HMHPLMHFU08E type=del size=3822582 2024-09-12T00:09:42.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.971+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~P5F9OAOOQY10.0 size=1048576 2024-09-12T00:09:42.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.972+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~P5F9OAOOQY10.1 size=1048576 2024-09-12T00:09:42.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.973+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~P5F9OAOOQY10.2 size=316878 2024-09-12T00:09:42.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.975+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=P5F9OAOOQY10 tag=WAAGQX963BFU type=write size=3462606 2024-09-12T00:09:42.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.977+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~DGUOXIWMY9M0.0 size=1048576 2024-09-12T00:09:42.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.978+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~DGUOXIWMY9M0.1 size=849786 2024-09-12T00:09:42.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.978+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=DGUOXIWMY9M0 tag=ZC10YU0OD1MY type=write size=2946938 2024-09-12T00:09:42.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.980+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~P6WWRHLGP1X4.0 size=1048576 2024-09-12T00:09:42.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.982+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~P6WWRHLGP1X4.1 size=1048576 2024-09-12T00:09:42.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.983+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~P6WWRHLGP1X4.2 size=62083 2024-09-12T00:09:42.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.985+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=P6WWRHLGP1X4 tag=OE12RWKNIHFE type=write size=3207811 2024-09-12T00:09:42.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.987+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~2UEPIA6LM8A0.0 size=777557 2024-09-12T00:09:42.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.987+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=2UEPIA6LM8A0 tag=4XK2TUU1VL7X type=write size=1826133 2024-09-12T00:09:42.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.989+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~TGJMACJ6DOEA.0 size=1048576 2024-09-12T00:09:42.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.990+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~TGJMACJ6DOEA.1 size=1048576 2024-09-12T00:09:42.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.991+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~TGJMACJ6DOEA.2 size=994449 2024-09-12T00:09:42.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.993+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=TGJMACJ6DOEA tag=MJQ87IB5SPZD type=write size=4140177 2024-09-12T00:09:42.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.994+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=7PDHK8IC35S8 type=del size=4182383 2024-09-12T00:09:42.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.995+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~3MHU1PL51K1A.0 size=946603 2024-09-12T00:09:42.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.998+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=3MHU1PL51K1A tag=LZEJQW6YG92S type=write size=1995179 2024-09-12T00:09:42.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.999+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=VYRTITP4PVK8 type=del size=1984119 2024-09-12T00:09:42.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:42.999+0000 7f3dc2c18780 1 < canceled part key=_multipart_GLAOX3ZNNILD.2~VF92D85MC8AZ.0 size=1048576 2024-09-12T00:09:42.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.000+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~VF92D85MC8AZ.1 size=1048576 2024-09-12T00:09:43.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.001+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~VF92D85MC8AZ.2 size=928703 2024-09-12T00:09:43.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.003+0000 7f3dc2c18780 1 < canceled multipart upload key=GLAOX3ZNNILD upload=VF92D85MC8AZ tag=DQPJIYEEGKEW type=write size=4074431 2024-09-12T00:09:43.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.004+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=XL915W21N1I2 type=write size=767470 2024-09-12T00:09:43.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.006+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~1ITCGMKM6NWA.0 size=1048576 2024-09-12T00:09:43.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.007+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~1ITCGMKM6NWA.1 size=753565 2024-09-12T00:09:43.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.009+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=1ITCGMKM6NWA tag=R75EJQ6549OL type=write size=2850717 2024-09-12T00:09:43.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.010+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=JTH06GLSCQMI type=del size=392785 2024-09-12T00:09:43.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.011+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~Z86JVWN7OBQ8.0 size=1048576 2024-09-12T00:09:43.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.012+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~Z86JVWN7OBQ8.1 size=828564 2024-09-12T00:09:43.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.014+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=Z86JVWN7OBQ8 tag=1KYZFFAKZ4VH type=write size=2925716 2024-09-12T00:09:43.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.016+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~0TM5XZ0D8H4R.0 size=352107 2024-09-12T00:09:43.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.016+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=0TM5XZ0D8H4R tag=OH2GFLM2VJ5Q type=write size=1400683 2024-09-12T00:09:43.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.018+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=S3QRMDCQN0TI type=del 2024-09-12T00:09:43.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.022+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~R3I4GSQSQ66B.0 size=1048576 2024-09-12T00:09:43.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.023+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~R3I4GSQSQ66B.1 size=1048576 2024-09-12T00:09:43.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.024+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~R3I4GSQSQ66B.2 size=243266 2024-09-12T00:09:43.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.024+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=R3I4GSQSQ66B tag=ONVKP2ZNK34R type=write size=3388994 2024-09-12T00:09:43.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.025+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=E083NJWBVIRJ type=del 2024-09-12T00:09:43.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.028+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~KMPN6GGKXC7L.0 size=612015 2024-09-12T00:09:43.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.028+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=KMPN6GGKXC7L tag=PJ19E3J83BAX type=write size=1660591 2024-09-12T00:09:43.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.030+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=MZOZU5QUMJ9B type=del size=4021815 2024-09-12T00:09:43.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.031+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=XNR2W1VW6OGX type=del size=2768299 2024-09-12T00:09:43.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.034+0000 7f3dc2c18780 1 < suggested update operation key=WRBBH64CISJZ tag=OCT9BA8CJXYF type=del size=3525417 2024-09-12T00:09:43.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.035+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=JWSIDR3OID6E type=write size=363801 2024-09-12T00:09:43.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.036+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~E4MDQX661PB7.0 size=755724 2024-09-12T00:09:43.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.038+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=E4MDQX661PB7 tag=8C2LGO2JAPUQ type=write size=1804300 2024-09-12T00:09:43.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.040+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~5T10IZCAICB9.0 size=298598 2024-09-12T00:09:43.039 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.040+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=5T10IZCAICB9 tag=G5H6U7AADR30 type=write size=1347174 2024-09-12T00:09:43.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.042+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=9O4IGCLEVFIK type=del 2024-09-12T00:09:43.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.043+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=NSQ01VVW65WA type=write size=671857 2024-09-12T00:09:43.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.045+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=D9HJNXVAXH5G type=del 2024-09-12T00:09:43.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.046+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=YBFM3QS2KXLW type=del size=356386 2024-09-12T00:09:43.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.048+0000 7f3dc2c18780 1 < suggested remove operation key=5F0BB9U7Y6ZZ tag=AJ2ELGJ7P69C type=del 2024-09-12T00:09:43.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.050+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~69E7EHEBNLQY.0 size=1048576 2024-09-12T00:09:43.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.052+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~69E7EHEBNLQY.1 size=150627 2024-09-12T00:09:43.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.052+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=69E7EHEBNLQY tag=44L3RI82NQY4 type=write size=2247779 2024-09-12T00:09:43.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.053+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=HMHPLMHFU08E type=del 2024-09-12T00:09:43.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.054+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=CZBI5Z7VZNWV type=del size=3979994 2024-09-12T00:09:43.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.054+0000 7f3dc2c18780 1 < canceled part key=_multipart_C7ZOCTAR2BEP.2~DGUOXIWMY9M0.0 size=1048576 2024-09-12T00:09:43.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.055+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~DGUOXIWMY9M0.1 size=849786 2024-09-12T00:09:43.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.058+0000 7f3dc2c18780 1 < canceled multipart upload key=C7ZOCTAR2BEP upload=DGUOXIWMY9M0 tag=ZC10YU0OD1MY type=write size=2946938 2024-09-12T00:09:43.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.060+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~OCK8Q4I93DP0.0 size=1048576 2024-09-12T00:09:43.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.061+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~OCK8Q4I93DP0.1 size=361846 2024-09-12T00:09:43.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.061+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=OCK8Q4I93DP0 tag=7FQFLWVKN082 type=write size=2458998 2024-09-12T00:09:43.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.062+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~2UEPIA6LM8A0.0 size=777557 2024-09-12T00:09:43.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.064+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=2UEPIA6LM8A0 tag=4XK2TUU1VL7X type=write size=1826133 2024-09-12T00:09:43.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.066+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=2QCODSZ41155 type=write size=493394 2024-09-12T00:09:43.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.068+0000 7f3dc2c18780 1 < suggested remove operation key=Y40G8SLO6AVH tag=7PDHK8IC35S8 type=del 2024-09-12T00:09:43.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.070+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~PKUZIREW5PCE.0 size=516745 2024-09-12T00:09:43.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.070+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=PKUZIREW5PCE tag=BQVBBP6QT89L type=write size=1565321 2024-09-12T00:09:43.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.073+0000 7f3dc2c18780 1 < suggested update operation key=WRBBH64CISJZ tag=VYRTITP4PVK8 type=del size=1984119 2024-09-12T00:09:43.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.074+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=19421G6WDCGX type=del size=1323110 2024-09-12T00:09:43.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.075+0000 7f3dc2c18780 1 < completed write operation key=GLAOX3ZNNILD tag=XL915W21N1I2 type=write size=767470 2024-09-12T00:09:43.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.076+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=STR39NC4CR14 type=del size=379279 2024-09-12T00:09:43.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.077+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=JTH06GLSCQMI type=del 2024-09-12T00:09:43.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.079+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~FO0PPWYT0BL0.0 size=1048576 2024-09-12T00:09:43.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.080+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~FO0PPWYT0BL0.1 size=481684 2024-09-12T00:09:43.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.080+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=FO0PPWYT0BL0 tag=Q9NZWIMR6OLL type=write size=2578836 2024-09-12T00:09:43.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.082+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~0TM5XZ0D8H4R.0 size=352107 2024-09-12T00:09:43.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.084+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=0TM5XZ0D8H4R tag=OH2GFLM2VJ5Q type=write size=1400683 2024-09-12T00:09:43.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.086+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~QPL0IPTLPIHF.0 size=1048576 2024-09-12T00:09:43.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.087+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~QPL0IPTLPIHF.1 size=838094 2024-09-12T00:09:43.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.087+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=QPL0IPTLPIHF tag=SIYJGQMP9MIF type=write size=2935246 2024-09-12T00:09:43.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.088+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~R3I4GSQSQ66B.0 size=1048576 2024-09-12T00:09:43.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.088+0000 7f3dc2c18780 1 < canceled part key=_multipart_KDHO7IEGICDA.2~R3I4GSQSQ66B.1 size=1048576 2024-09-12T00:09:43.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.089+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~R3I4GSQSQ66B.2 size=243266 2024-09-12T00:09:43.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.091+0000 7f3dc2c18780 1 < canceled multipart upload key=KDHO7IEGICDA upload=R3I4GSQSQ66B tag=ONVKP2ZNK34R type=write size=3388994 2024-09-12T00:09:43.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.092+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=35X5UKEM1PI8 type=del size=376426 2024-09-12T00:09:43.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.093+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~KMPN6GGKXC7L.0 size=612015 2024-09-12T00:09:43.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.095+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=KMPN6GGKXC7L tag=PJ19E3J83BAX type=write size=1660591 2024-09-12T00:09:43.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.097+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=LCZS1EURZ8ZA type=del size=2843476 2024-09-12T00:09:43.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.099+0000 7f3dc2c18780 1 < completed delete operation key=A4O7JFS2ULY0 tag=XNR2W1VW6OGX type=del 2024-09-12T00:09:43.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.101+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~ZB61D9Z3C9N9.0 size=1048576 2024-09-12T00:09:43.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.102+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~ZB61D9Z3C9N9.1 size=1048576 2024-09-12T00:09:43.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.103+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~ZB61D9Z3C9N9.2 size=59746 2024-09-12T00:09:43.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.103+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=ZB61D9Z3C9N9 tag=EFJYLBCLJY4X type=write size=3205474 2024-09-12T00:09:43.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.104+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=JWSIDR3OID6E type=write size=363801 2024-09-12T00:09:43.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.106+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~0GF8C0DK9LRJ.0 size=1048576 2024-09-12T00:09:43.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.107+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~0GF8C0DK9LRJ.1 size=385666 2024-09-12T00:09:43.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.107+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=0GF8C0DK9LRJ tag=H1VI2A012YCL type=write size=2482818 2024-09-12T00:09:43.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.108+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~5T10IZCAICB9.0 size=298598 2024-09-12T00:09:43.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.111+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=5T10IZCAICB9 tag=G5H6U7AADR30 type=write size=1347174 2024-09-12T00:09:43.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.112+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=RZRXTFDCOB40 type=del size=3081534 2024-09-12T00:09:43.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.113+0000 7f3dc2c18780 1 < completed write operation key=7JVCFTM2QMGY tag=NSQ01VVW65WA type=write size=671857 2024-09-12T00:09:43.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.114+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=Z2VVFRBDXSWK type=del size=711231 2024-09-12T00:09:43.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.115+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=YBFM3QS2KXLW type=del 2024-09-12T00:09:43.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.118+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~5LGCWZ83TOXD.0 size=1048576 2024-09-12T00:09:43.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.118+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~5LGCWZ83TOXD.1 size=1048576 2024-09-12T00:09:43.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.119+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~5LGCWZ83TOXD.2 size=843239 2024-09-12T00:09:43.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.119+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=5LGCWZ83TOXD tag=K06WUXTY1YQ9 type=write size=3988967 2024-09-12T00:09:43.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.121+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~69E7EHEBNLQY.0 size=1048576 2024-09-12T00:09:43.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.122+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~69E7EHEBNLQY.1 size=150627 2024-09-12T00:09:43.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.124+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=69E7EHEBNLQY tag=44L3RI82NQY4 type=write size=2247779 2024-09-12T00:09:43.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.126+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~LN914B8TRSG8.0 size=1048576 2024-09-12T00:09:43.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.127+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~LN914B8TRSG8.1 size=324135 2024-09-12T00:09:43.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.127+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=LN914B8TRSG8 tag=M5IK9NLF3BTL type=write size=2421287 2024-09-12T00:09:43.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.128+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=CZBI5Z7VZNWV type=del 2024-09-12T00:09:43.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.129+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=8EBTYNBZYWQC type=del size=631790 2024-09-12T00:09:43.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.131+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~OCK8Q4I93DP0.0 size=1048576 2024-09-12T00:09:43.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.132+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~OCK8Q4I93DP0.1 size=361846 2024-09-12T00:09:43.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.134+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=OCK8Q4I93DP0 tag=7FQFLWVKN082 type=write size=2458998 2024-09-12T00:09:43.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.135+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=REANK8Y8KKGV type=del size=3121409 2024-09-12T00:09:43.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.136+0000 7f3dc2c18780 1 < completed write operation key=0ICU4WV9K1RG tag=2QCODSZ41155 type=write size=493394 2024-09-12T00:09:43.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.139+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~6AXEN2R8RP2J.0 size=1048576 2024-09-12T00:09:43.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.140+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~6AXEN2R8RP2J.1 size=656067 2024-09-12T00:09:43.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.140+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=6AXEN2R8RP2J tag=O24514R8I4Z1 type=write size=2753219 2024-09-12T00:09:43.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.141+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~PKUZIREW5PCE.0 size=516745 2024-09-12T00:09:43.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.143+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=PKUZIREW5PCE tag=BQVBBP6QT89L type=write size=1565321 2024-09-12T00:09:43.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.144+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=OHNB45MEQV8U type=del size=3181025 2024-09-12T00:09:43.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.145+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=19421G6WDCGX type=del 2024-09-12T00:09:43.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.147+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=E1903W6M7JWX type=del size=3740367 2024-09-12T00:09:43.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.148+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=STR39NC4CR14 type=del 2024-09-12T00:09:43.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.150+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~UCOWFQ1CGAMB.0 size=1048576 2024-09-12T00:09:43.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.151+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~UCOWFQ1CGAMB.1 size=1048576 2024-09-12T00:09:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.152+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~UCOWFQ1CGAMB.2 size=524141 2024-09-12T00:09:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.152+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=UCOWFQ1CGAMB tag=VZDTV2LDLTGL type=write size=3669869 2024-09-12T00:09:43.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.153+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~FO0PPWYT0BL0.0 size=1048576 2024-09-12T00:09:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.154+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~FO0PPWYT0BL0.1 size=481684 2024-09-12T00:09:43.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.156+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=FO0PPWYT0BL0 tag=Q9NZWIMR6OLL type=write size=2578836 2024-09-12T00:09:43.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.158+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=9OJEXKFE2S3K type=write size=435669 2024-09-12T00:09:43.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.159+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~QPL0IPTLPIHF.0 size=1048576 2024-09-12T00:09:43.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.160+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~QPL0IPTLPIHF.1 size=838094 2024-09-12T00:09:43.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.162+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=QPL0IPTLPIHF tag=SIYJGQMP9MIF type=write size=2935246 2024-09-12T00:09:43.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.164+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~Z4X037W4NHWI.0 size=1048576 2024-09-12T00:09:43.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.166+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~Z4X037W4NHWI.1 size=1048576 2024-09-12T00:09:43.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.167+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~Z4X037W4NHWI.2 size=148351 2024-09-12T00:09:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.167+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=Z4X037W4NHWI tag=OYJ86YXMWUX8 type=write size=3294079 2024-09-12T00:09:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.168+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=35X5UKEM1PI8 type=del 2024-09-12T00:09:43.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.170+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~BJ0Q9QNG0Z3X.0 size=556506 2024-09-12T00:09:43.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.170+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=BJ0Q9QNG0Z3X tag=URCAK1WYDXWZ type=write size=1605082 2024-09-12T00:09:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.173+0000 7f3dc2c18780 1 < suggested update operation key=GP3MLWX9586T tag=LCZS1EURZ8ZA type=del size=2843476 2024-09-12T00:09:43.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.175+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~UQDHTIODZZVK.0 size=1048576 2024-09-12T00:09:43.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.176+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~UQDHTIODZZVK.1 size=1048576 2024-09-12T00:09:43.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.177+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~UQDHTIODZZVK.2 size=29759 2024-09-12T00:09:43.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.177+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=UQDHTIODZZVK tag=R337A98N4VU6 type=write size=3175487 2024-09-12T00:09:43.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.178+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~ZB61D9Z3C9N9.0 size=1048576 2024-09-12T00:09:43.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.178+0000 7f3dc2c18780 1 < canceled part key=_multipart_GP3MLWX9586T.2~ZB61D9Z3C9N9.1 size=1048576 2024-09-12T00:09:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.179+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~ZB61D9Z3C9N9.2 size=59746 2024-09-12T00:09:43.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.181+0000 7f3dc2c18780 1 < canceled multipart upload key=GP3MLWX9586T upload=ZB61D9Z3C9N9 tag=EFJYLBCLJY4X type=write size=3205474 2024-09-12T00:09:43.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.183+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~FYPG10C0WTSO.0 size=825023 2024-09-12T00:09:43.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.183+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=FYPG10C0WTSO tag=J7U3213JC6BS type=write size=1873599 2024-09-12T00:09:43.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.184+0000 7f3dc2c18780 1 < canceled part key=_multipart_4POD73U0LAC0.2~0GF8C0DK9LRJ.0 size=1048576 2024-09-12T00:09:43.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.185+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~0GF8C0DK9LRJ.1 size=385666 2024-09-12T00:09:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.187+0000 7f3dc2c18780 1 < canceled multipart upload key=4POD73U0LAC0 upload=0GF8C0DK9LRJ tag=H1VI2A012YCL type=write size=2482818 2024-09-12T00:09:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.188+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=SAX6BZWUUCR2 type=del size=4156124 2024-09-12T00:09:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.189+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=RZRXTFDCOB40 type=del 2024-09-12T00:09:43.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.190+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=FARQHK9XRDXE type=write size=505797 2024-09-12T00:09:43.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.192+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=Z2VVFRBDXSWK type=del 2024-09-12T00:09:43.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.194+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=RTJIDL7H0CR4 type=del size=2552110 2024-09-12T00:09:43.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.195+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~5LGCWZ83TOXD.0 size=1048576 2024-09-12T00:09:43.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.197+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~5LGCWZ83TOXD.1 size=1048576 2024-09-12T00:09:43.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.197+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~5LGCWZ83TOXD.2 size=843239 2024-09-12T00:09:43.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.200+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=5LGCWZ83TOXD tag=K06WUXTY1YQ9 type=write size=3988967 2024-09-12T00:09:43.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.202+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~DAD2ZXGYNQEK.0 size=1048576 2024-09-12T00:09:43.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.203+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~DAD2ZXGYNQEK.1 size=1387 2024-09-12T00:09:43.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.203+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=DAD2ZXGYNQEK tag=VRE3GYYOVGFK type=write size=2098539 2024-09-12T00:09:43.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.204+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~LN914B8TRSG8.0 size=1048576 2024-09-12T00:09:43.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.205+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~LN914B8TRSG8.1 size=324135 2024-09-12T00:09:43.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.207+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=LN914B8TRSG8 tag=M5IK9NLF3BTL type=write size=2421287 2024-09-12T00:09:43.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.209+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~VK9Y3L4G3BEG.0 size=551372 2024-09-12T00:09:43.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.210+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=VK9Y3L4G3BEG tag=57H6UJAZXWMW type=write size=1599948 2024-09-12T00:09:43.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.211+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=8EBTYNBZYWQC type=del 2024-09-12T00:09:43.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.213+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=WMFP7Z0LZ44W type=del size=2584712 2024-09-12T00:09:43.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.215+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=REANK8Y8KKGV type=del 2024-09-12T00:09:43.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.217+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~Y6ZK5EKWAH6N.0 size=1048576 2024-09-12T00:09:43.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.218+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~Y6ZK5EKWAH6N.1 size=1048576 2024-09-12T00:09:43.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.219+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~Y6ZK5EKWAH6N.2 size=447440 2024-09-12T00:09:43.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.219+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=Y6ZK5EKWAH6N tag=YTYOCFJAPOSS type=write size=3593168 2024-09-12T00:09:43.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.220+0000 7f3dc2c18780 1 < canceled part key=_multipart_25CF1N8J81Y9.2~6AXEN2R8RP2J.0 size=1048576 2024-09-12T00:09:43.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.221+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~6AXEN2R8RP2J.1 size=656067 2024-09-12T00:09:43.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.223+0000 7f3dc2c18780 1 < canceled multipart upload key=25CF1N8J81Y9 upload=6AXEN2R8RP2J tag=O24514R8I4Z1 type=write size=2753219 2024-09-12T00:09:43.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.225+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~XMP1LHNP9T7J.0 size=800098 2024-09-12T00:09:43.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.225+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=XMP1LHNP9T7J tag=EEZUUTRRXTFN type=write size=1848674 2024-09-12T00:09:43.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.227+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=OHNB45MEQV8U type=del 2024-09-12T00:09:43.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.228+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=3OGOOWD6SHZ3 type=del size=2925926 2024-09-12T00:09:43.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.229+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=E1903W6M7JWX type=del 2024-09-12T00:09:43.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.230+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=93WFQ6FFND4Z type=write size=825855 2024-09-12T00:09:43.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.232+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~UCOWFQ1CGAMB.0 size=1048576 2024-09-12T00:09:43.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.233+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~UCOWFQ1CGAMB.1 size=1048576 2024-09-12T00:09:43.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.234+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~UCOWFQ1CGAMB.2 size=524141 2024-09-12T00:09:43.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.237+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=UCOWFQ1CGAMB tag=VZDTV2LDLTGL type=write size=3669869 2024-09-12T00:09:43.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.239+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~SJDW5Y5KQD6X.0 size=103496 2024-09-12T00:09:43.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.239+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=SJDW5Y5KQD6X tag=JIJY1OBMODM8 type=write size=1152072 2024-09-12T00:09:43.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.240+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=9OJEXKFE2S3K type=write size=435669 2024-09-12T00:09:43.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.242+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=X9Z4IYI9OJ70 type=del size=2186378 2024-09-12T00:09:43.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.243+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~Z4X037W4NHWI.0 size=1048576 2024-09-12T00:09:43.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.244+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~Z4X037W4NHWI.1 size=1048576 2024-09-12T00:09:43.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.244+0000 7f3dc2c18780 1 < canceled part key=_multipart_0ICU4WV9K1RG.2~Z4X037W4NHWI.2 size=148351 2024-09-12T00:09:43.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.247+0000 7f3dc2c18780 1 < canceled multipart upload key=0ICU4WV9K1RG upload=Z4X037W4NHWI tag=OYJ86YXMWUX8 type=write size=3294079 2024-09-12T00:09:43.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.248+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=C2PEF44DDLBU type=del size=1060872 2024-09-12T00:09:43.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.249+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~BJ0Q9QNG0Z3X.0 size=556506 2024-09-12T00:09:43.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.251+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=BJ0Q9QNG0Z3X tag=URCAK1WYDXWZ type=write size=1605082 2024-09-12T00:09:43.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.252+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=4FKH6B6ID1C0 type=del size=226428 2024-09-12T00:09:43.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.254+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~UQDHTIODZZVK.0 size=1048576 2024-09-12T00:09:43.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.254+0000 7f3dc2c18780 1 < canceled part key=_multipart_65DTZR8A5OHF.2~UQDHTIODZZVK.1 size=1048576 2024-09-12T00:09:43.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.255+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~UQDHTIODZZVK.2 size=29759 2024-09-12T00:09:43.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.257+0000 7f3dc2c18780 1 < canceled multipart upload key=65DTZR8A5OHF upload=UQDHTIODZZVK tag=R337A98N4VU6 type=write size=3175487 2024-09-12T00:09:43.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.258+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=CF6GHFCM2GX8 type=del size=3578263 2024-09-12T00:09:43.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.259+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~FYPG10C0WTSO.0 size=825023 2024-09-12T00:09:43.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.261+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=FYPG10C0WTSO tag=J7U3213JC6BS type=write size=1873599 2024-09-12T00:09:43.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.264+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~T23RSCVIZ5HK.0 size=1048576 2024-09-12T00:09:43.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.265+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~T23RSCVIZ5HK.1 size=899165 2024-09-12T00:09:43.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.265+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=T23RSCVIZ5HK tag=61SYVTH2JRZB type=write size=2996317 2024-09-12T00:09:43.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.266+0000 7f3dc2c18780 1 < canceled operation key=V0K5FRKYGJ0K tag=SAX6BZWUUCR2 type=del size=4156124 2024-09-12T00:09:43.266 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.267+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=D7PMV6KJEFJ1 type=write size=778153 2024-09-12T00:09:43.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.268+0000 7f3dc2c18780 1 < canceled operation key=WRBBH64CISJZ tag=FARQHK9XRDXE type=write size=505797 2024-09-12T00:09:43.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.270+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~NHKWV53EJJRT.0 size=1048576 2024-09-12T00:09:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.271+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~NHKWV53EJJRT.1 size=208297 2024-09-12T00:09:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.271+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=NHKWV53EJJRT tag=40PQ457S1QM3 type=write size=2305449 2024-09-12T00:09:43.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.274+0000 7f3dc2c18780 1 < suggested update operation key=TSL3IDD0EDT0 tag=RTJIDL7H0CR4 type=del size=2552110 2024-09-12T00:09:43.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.276+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~26QMVN1MV4RO.0 size=160964 2024-09-12T00:09:43.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.276+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=26QMVN1MV4RO tag=SU5QTN10D3Y2 type=write size=1209540 2024-09-12T00:09:43.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.278+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~DAD2ZXGYNQEK.0 size=1048576 2024-09-12T00:09:43.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.279+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~DAD2ZXGYNQEK.1 size=1387 2024-09-12T00:09:43.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.281+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=DAD2ZXGYNQEK tag=VRE3GYYOVGFK type=write size=2098539 2024-09-12T00:09:43.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.282+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=FWUGI4V2HFVJ type=del size=3392193 2024-09-12T00:09:43.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.283+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~VK9Y3L4G3BEG.0 size=551372 2024-09-12T00:09:43.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.285+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=VK9Y3L4G3BEG tag=57H6UJAZXWMW type=write size=1599948 2024-09-12T00:09:43.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.287+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=XRJ4R6L5L78N type=del size=2744883 2024-09-12T00:09:43.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.288+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=WMFP7Z0LZ44W type=del 2024-09-12T00:09:43.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.289+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=20E3GH1U36JL type=del size=1206597 2024-09-12T00:09:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.290+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~Y6ZK5EKWAH6N.0 size=1048576 2024-09-12T00:09:43.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.291+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~Y6ZK5EKWAH6N.1 size=1048576 2024-09-12T00:09:43.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.292+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~Y6ZK5EKWAH6N.2 size=447440 2024-09-12T00:09:43.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.294+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=Y6ZK5EKWAH6N tag=YTYOCFJAPOSS type=write size=3593168 2024-09-12T00:09:43.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.295+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=5Z1LYBPWJJ04 type=write size=822866 2024-09-12T00:09:43.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.297+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~XMP1LHNP9T7J.0 size=800098 2024-09-12T00:09:43.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.299+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=XMP1LHNP9T7J tag=EEZUUTRRXTFN type=write size=1848674 2024-09-12T00:09:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.300+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=WG6XQCN6CKPI type=del size=1819315 2024-09-12T00:09:43.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.301+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=3OGOOWD6SHZ3 type=del 2024-09-12T00:09:43.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.302+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=VRLG4LKVKIJZ type=del size=1461438 2024-09-12T00:09:43.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.304+0000 7f3dc2c18780 1 < completed write operation key=8JFV08DJLXTB tag=93WFQ6FFND4Z type=write size=825855 2024-09-12T00:09:43.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.306+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~SFUY5MJQYJU3.0 size=1048576 2024-09-12T00:09:43.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.307+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~SFUY5MJQYJU3.1 size=9410 2024-09-12T00:09:43.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.307+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=SFUY5MJQYJU3 tag=HER8TU4ICQKK type=write size=2106562 2024-09-12T00:09:43.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.308+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~SJDW5Y5KQD6X.0 size=103496 2024-09-12T00:09:43.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.310+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=SJDW5Y5KQD6X tag=JIJY1OBMODM8 type=write size=1152072 2024-09-12T00:09:43.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.311+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=8089PUYVDR6K type=del size=2975209 2024-09-12T00:09:43.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.313+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=X9Z4IYI9OJ70 type=del 2024-09-12T00:09:43.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.315+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~5J21ONJINW4N.0 size=140196 2024-09-12T00:09:43.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.315+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=5J21ONJINW4N tag=OO6C29BW59ZN type=write size=1188772 2024-09-12T00:09:43.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.317+0000 7f3dc2c18780 1 < suggested remove operation key=C7ZOCTAR2BEP tag=C2PEF44DDLBU type=del 2024-09-12T00:09:43.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.318+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=65MYPUYOUZVQ type=del size=3898020 2024-09-12T00:09:43.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.321+0000 7f3dc2c18780 1 < suggested remove operation key=U2H0A1GZROT7 tag=4FKH6B6ID1C0 type=del 2024-09-12T00:09:43.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.323+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~T52CUBBBHM3T.0 size=1002840 2024-09-12T00:09:43.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.323+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=T52CUBBBHM3T tag=RW9RS8L9XGX5 type=write size=2051416 2024-09-12T00:09:43.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.326+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=CF6GHFCM2GX8 type=del size=3578263 2024-09-12T00:09:43.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.328+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~2K5N9BLE1BJ0.0 size=1048576 2024-09-12T00:09:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.329+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~2K5N9BLE1BJ0.1 size=392971 2024-09-12T00:09:43.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.329+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=2K5N9BLE1BJ0 tag=Q2CCN1BQYHT5 type=write size=2490123 2024-09-12T00:09:43.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.332+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~T23RSCVIZ5HK.0 size=1048576 2024-09-12T00:09:43.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.334+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~T23RSCVIZ5HK.1 size=899165 2024-09-12T00:09:43.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.337+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=T23RSCVIZ5HK tag=61SYVTH2JRZB type=write size=2996317 2024-09-12T00:09:43.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.340+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~ROU72X9OOSYN.0 size=9701 2024-09-12T00:09:43.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.340+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=ROU72X9OOSYN tag=1WYGNIQLHWSO type=write size=1058277 2024-09-12T00:09:43.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.341+0000 7f3dc2c18780 1 < completed write operation key=UJDQEIAIRVDW tag=D7PMV6KJEFJ1 type=write size=778153 2024-09-12T00:09:43.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.342+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=7M1X2ZZJ4741 type=del size=2152644 2024-09-12T00:09:43.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.343+0000 7f3dc2c18780 1 < canceled part key=_multipart_OGRGDIUO2W8B.2~NHKWV53EJJRT.0 size=1048576 2024-09-12T00:09:43.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.344+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~NHKWV53EJJRT.1 size=208297 2024-09-12T00:09:43.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.346+0000 7f3dc2c18780 1 < canceled multipart upload key=OGRGDIUO2W8B upload=NHKWV53EJJRT tag=40PQ457S1QM3 type=write size=2305449 2024-09-12T00:09:43.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.347+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=3ZHU2T4W0Z4E type=del size=849502 2024-09-12T00:09:43.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.348+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~26QMVN1MV4RO.0 size=160964 2024-09-12T00:09:43.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.350+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=26QMVN1MV4RO tag=SU5QTN10D3Y2 type=write size=1209540 2024-09-12T00:09:43.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.352+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=4CBER953WZXQ type=del size=3773843 2024-09-12T00:09:43.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.353+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=FWUGI4V2HFVJ type=del 2024-09-12T00:09:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.354+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=BIU7BLBFD2VI type=del size=125817 2024-09-12T00:09:43.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.357+0000 7f3dc2c18780 1 < suggested update operation key=Y40G8SLO6AVH tag=XRJ4R6L5L78N type=del size=2744883 2024-09-12T00:09:43.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.359+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~0S6NWVQ47VOH.0 size=1048576 2024-09-12T00:09:43.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.360+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~0S6NWVQ47VOH.1 size=1048576 2024-09-12T00:09:43.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.361+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~0S6NWVQ47VOH.2 size=1009882 2024-09-12T00:09:43.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.361+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=0S6NWVQ47VOH tag=WAQ3S0CSM7OP type=write size=4155610 2024-09-12T00:09:43.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.362+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=20E3GH1U36JL type=del 2024-09-12T00:09:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.365+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~WXCC3PZXV2BZ.0 size=92750 2024-09-12T00:09:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.365+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=WXCC3PZXV2BZ tag=8SGRB8AH1ZQ2 type=write size=1141326 2024-09-12T00:09:43.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.366+0000 7f3dc2c18780 1 < completed write operation key=5F0BB9U7Y6ZZ tag=5Z1LYBPWJJ04 type=write size=822866 2024-09-12T00:09:43.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.367+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=225UZWJLR0Z2 type=del size=3691019 2024-09-12T00:09:43.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.368+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=WG6XQCN6CKPI type=del 2024-09-12T00:09:43.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.371+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~B3ZEPMG20QUV.0 size=1048576 2024-09-12T00:09:43.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.372+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~B3ZEPMG20QUV.1 size=556857 2024-09-12T00:09:43.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.372+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=B3ZEPMG20QUV tag=VFZ8V26P4SC3 type=write size=2654009 2024-09-12T00:09:43.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.374+0000 7f3dc2c18780 1 < suggested update operation key=Y40G8SLO6AVH tag=VRLG4LKVKIJZ type=del size=1461438 2024-09-12T00:09:43.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.377+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~TZZRD27MDHZN.0 size=1048576 2024-09-12T00:09:43.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.378+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~TZZRD27MDHZN.1 size=804052 2024-09-12T00:09:43.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.378+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=TZZRD27MDHZN tag=0NQYLSWVM2AX type=write size=2901204 2024-09-12T00:09:43.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.379+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~SFUY5MJQYJU3.0 size=1048576 2024-09-12T00:09:43.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.380+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~SFUY5MJQYJU3.1 size=9410 2024-09-12T00:09:43.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.382+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=SFUY5MJQYJU3 tag=HER8TU4ICQKK type=write size=2106562 2024-09-12T00:09:43.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.383+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=86T307SJRCFH type=write size=142630 2024-09-12T00:09:43.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.384+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=8089PUYVDR6K type=del 2024-09-12T00:09:43.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.386+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=GXF91QLZEDUS type=del size=3776298 2024-09-12T00:09:43.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.387+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~5J21ONJINW4N.0 size=140196 2024-09-12T00:09:43.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.390+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=5J21ONJINW4N tag=OO6C29BW59ZN type=write size=1188772 2024-09-12T00:09:43.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.391+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=CDMFT90W3CS2 type=del size=1944251 2024-09-12T00:09:43.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.392+0000 7f3dc2c18780 -1 < failed to complete operation key=2SO8HBZSAMRX tag=65MYPUYOUZVQ type=del size=3898020: (22) Invalid argument 2024-09-12T00:09:43.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.394+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=JG9SWYHZCB0M type=del size=3296294 2024-09-12T00:09:43.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.395+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~T52CUBBBHM3T.0 size=1002840 2024-09-12T00:09:43.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.397+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=T52CUBBBHM3T tag=RW9RS8L9XGX5 type=write size=2051416 2024-09-12T00:09:43.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.398+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=W0J8B2T2N6TT type=del size=2748441 2024-09-12T00:09:43.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.399+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~2K5N9BLE1BJ0.0 size=1048576 2024-09-12T00:09:43.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.400+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~2K5N9BLE1BJ0.1 size=392971 2024-09-12T00:09:43.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.403+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=2K5N9BLE1BJ0 tag=Q2CCN1BQYHT5 type=write size=2490123 2024-09-12T00:09:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.404+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=VQSRUKVHFNLU type=del size=379606 2024-09-12T00:09:43.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.405+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~ROU72X9OOSYN.0 size=9701 2024-09-12T00:09:43.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.407+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=ROU72X9OOSYN tag=1WYGNIQLHWSO type=write size=1058277 2024-09-12T00:09:43.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.409+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~W4LI7N0KQ6LU.0 size=1048576 2024-09-12T00:09:43.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.410+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~W4LI7N0KQ6LU.1 size=1048576 2024-09-12T00:09:43.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.411+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~W4LI7N0KQ6LU.2 size=858341 2024-09-12T00:09:43.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.411+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=W4LI7N0KQ6LU tag=Q1K9JB43ODE4 type=write size=4004069 2024-09-12T00:09:43.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.412+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=7M1X2ZZJ4741 type=del 2024-09-12T00:09:43.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.414+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~MNEAUPQSPM7V.0 size=1048576 2024-09-12T00:09:43.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.415+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~MNEAUPQSPM7V.1 size=1048576 2024-09-12T00:09:43.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.416+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~MNEAUPQSPM7V.2 size=68614 2024-09-12T00:09:43.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.416+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=MNEAUPQSPM7V tag=IJU1MP777ARF type=write size=3214342 2024-09-12T00:09:43.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.418+0000 7f3dc2c18780 1 < canceled operation key=YYIQC6YL2PSW tag=3ZHU2T4W0Z4E type=del size=849502 2024-09-12T00:09:43.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.419+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=V20KN6YQYL39 type=del size=3677580 2024-09-12T00:09:43.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.420+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=4CBER953WZXQ type=del 2024-09-12T00:09:43.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.422+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~A5EZK3QNEUMT.0 size=1048576 2024-09-12T00:09:43.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.423+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~A5EZK3QNEUMT.1 size=121004 2024-09-12T00:09:43.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.423+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=A5EZK3QNEUMT tag=E76P9R6F5CA4 type=write size=2218156 2024-09-12T00:09:43.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.424+0000 7f3dc2c18780 1 < canceled operation key=25CF1N8J81Y9 tag=BIU7BLBFD2VI type=del size=125817 2024-09-12T00:09:43.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.426+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=KBAF3EJWN5QU type=del size=1092380 2024-09-12T00:09:43.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.427+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~0S6NWVQ47VOH.0 size=1048576 2024-09-12T00:09:43.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.428+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~0S6NWVQ47VOH.1 size=1048576 2024-09-12T00:09:43.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.429+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~0S6NWVQ47VOH.2 size=1009882 2024-09-12T00:09:43.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.431+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=0S6NWVQ47VOH tag=WAQ3S0CSM7OP type=write size=4155610 2024-09-12T00:09:43.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.432+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=5WY3GTXPRZA7 type=del size=633758 2024-09-12T00:09:43.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.434+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~WXCC3PZXV2BZ.0 size=92750 2024-09-12T00:09:43.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.436+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=WXCC3PZXV2BZ tag=8SGRB8AH1ZQ2 type=write size=1141326 2024-09-12T00:09:43.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.438+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~MCYYGAXJEWPU.0 size=745159 2024-09-12T00:09:43.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.438+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=MCYYGAXJEWPU tag=X103XVN1UJRR type=write size=1793735 2024-09-12T00:09:43.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.439+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=225UZWJLR0Z2 type=del 2024-09-12T00:09:43.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.441+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~4P9N4XND759T.0 size=237865 2024-09-12T00:09:43.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.441+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=4P9N4XND759T tag=HX0U24F01D4X type=write size=1286441 2024-09-12T00:09:43.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.443+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~B3ZEPMG20QUV.0 size=1048576 2024-09-12T00:09:43.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.444+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~B3ZEPMG20QUV.1 size=556857 2024-09-12T00:09:43.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.446+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=B3ZEPMG20QUV tag=VFZ8V26P4SC3 type=write size=2654009 2024-09-12T00:09:43.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.449+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~GT9D3TX4QY3G.0 size=1048576 2024-09-12T00:09:43.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.451+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~GT9D3TX4QY3G.1 size=972656 2024-09-12T00:09:43.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.451+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=GT9D3TX4QY3G tag=WPAY7JBMXH24 type=write size=3069808 2024-09-12T00:09:43.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.451+0000 7f3dc2c18780 1 < canceled part key=_multipart_Y40G8SLO6AVH.2~TZZRD27MDHZN.0 size=1048576 2024-09-12T00:09:43.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.452+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~TZZRD27MDHZN.1 size=804052 2024-09-12T00:09:43.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.454+0000 7f3dc2c18780 1 < canceled multipart upload key=Y40G8SLO6AVH upload=TZZRD27MDHZN tag=0NQYLSWVM2AX type=write size=2901204 2024-09-12T00:09:43.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.455+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=7SR9HZ6IBUZO type=del size=2090623 2024-09-12T00:09:43.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.457+0000 7f3dc2c18780 1 < completed write operation key=GLAOX3ZNNILD tag=86T307SJRCFH type=write size=142630 2024-09-12T00:09:43.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.459+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~FJCRLETIE51F.0 size=1048576 2024-09-12T00:09:43.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.460+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~FJCRLETIE51F.1 size=271306 2024-09-12T00:09:43.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.460+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=FJCRLETIE51F tag=S5TUTH23WCGA type=write size=2368458 2024-09-12T00:09:43.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.463+0000 7f3dc2c18780 1 < suggested update operation key=25CF1N8J81Y9 tag=GXF91QLZEDUS type=del size=3776298 2024-09-12T00:09:43.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.464+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=KXNFUER52E3W type=del size=3130953 2024-09-12T00:09:43.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.465+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=CDMFT90W3CS2 type=del 2024-09-12T00:09:43.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.466+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=6Q18XGWFE74L type=del size=1466654 2024-09-12T00:09:43.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.468+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=JG9SWYHZCB0M type=del 2024-09-12T00:09:43.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.470+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~53AW05BGG350.0 size=86557 2024-09-12T00:09:43.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.470+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=53AW05BGG350 tag=IXB77AE3MMS4 type=write size=1135133 2024-09-12T00:09:43.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.471+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=W0J8B2T2N6TT type=del 2024-09-12T00:09:43.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.472+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=EDQDO3JVKEV8 type=del size=2601289 2024-09-12T00:09:43.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.475+0000 7f3dc2c18780 1 < suggested remove operation key=Y40G8SLO6AVH tag=VQSRUKVHFNLU type=del 2024-09-12T00:09:43.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.476+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=HKY7L9MG634O type=del size=698782 2024-09-12T00:09:43.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.477+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~W4LI7N0KQ6LU.0 size=1048576 2024-09-12T00:09:43.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.478+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~W4LI7N0KQ6LU.1 size=1048576 2024-09-12T00:09:43.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.478+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRR6LAYIWOCE.2~W4LI7N0KQ6LU.2 size=858341 2024-09-12T00:09:43.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.481+0000 7f3dc2c18780 1 < canceled multipart upload key=WRR6LAYIWOCE upload=W4LI7N0KQ6LU tag=Q1K9JB43ODE4 type=write size=4004069 2024-09-12T00:09:43.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.482+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=4IJHFQROAY1I type=del size=904257 2024-09-12T00:09:43.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.483+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~MNEAUPQSPM7V.0 size=1048576 2024-09-12T00:09:43.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.484+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~MNEAUPQSPM7V.1 size=1048576 2024-09-12T00:09:43.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.485+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~MNEAUPQSPM7V.2 size=68614 2024-09-12T00:09:43.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.487+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=MNEAUPQSPM7V tag=IJU1MP777ARF type=write size=3214342 2024-09-12T00:09:43.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.489+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=FK17KZN8YIPG type=del size=510399 2024-09-12T00:09:43.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.491+0000 7f3dc2c18780 1 < suggested remove operation key=TSL3IDD0EDT0 tag=V20KN6YQYL39 type=del 2024-09-12T00:09:43.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.492+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=ZZDKI2KH6OBD type=del size=2220700 2024-09-12T00:09:43.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.494+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~A5EZK3QNEUMT.0 size=1048576 2024-09-12T00:09:43.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.495+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~A5EZK3QNEUMT.1 size=121004 2024-09-12T00:09:43.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.497+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=A5EZK3QNEUMT tag=E76P9R6F5CA4 type=write size=2218156 2024-09-12T00:09:43.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.498+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=ZMTQKPUJOU76 type=del size=1325992 2024-09-12T00:09:43.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.499+0000 7f3dc2c18780 1 < canceled operation key=GLAOX3ZNNILD tag=KBAF3EJWN5QU type=del size=1092380 2024-09-12T00:09:43.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.501+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=11DXGXOO2A3M type=del size=2256293 2024-09-12T00:09:43.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.502+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=5WY3GTXPRZA7 type=del 2024-09-12T00:09:43.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.503+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=9127X513UNI2 type=del size=3067856 2024-09-12T00:09:43.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.504+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~MCYYGAXJEWPU.0 size=745159 2024-09-12T00:09:43.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.506+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=MCYYGAXJEWPU tag=X103XVN1UJRR type=write size=1793735 2024-09-12T00:09:43.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.508+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=EMMLQFOZG5IL type=del size=3776757 2024-09-12T00:09:43.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.509+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~4P9N4XND759T.0 size=237865 2024-09-12T00:09:43.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.511+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=4P9N4XND759T tag=HX0U24F01D4X type=write size=1286441 2024-09-12T00:09:43.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.512+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=LVN6E48NV30P type=del size=606563 2024-09-12T00:09:43.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.513+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~GT9D3TX4QY3G.0 size=1048576 2024-09-12T00:09:43.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.514+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~GT9D3TX4QY3G.1 size=972656 2024-09-12T00:09:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.516+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=GT9D3TX4QY3G tag=WPAY7JBMXH24 type=write size=3069808 2024-09-12T00:09:43.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.517+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=VD68NBLV1LJ6 type=del size=637950 2024-09-12T00:09:43.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.519+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=7SR9HZ6IBUZO type=del 2024-09-12T00:09:43.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.521+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~IQC0F81SWKNU.0 size=1048576 2024-09-12T00:09:43.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.522+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~IQC0F81SWKNU.1 size=1048576 2024-09-12T00:09:43.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.523+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~IQC0F81SWKNU.2 size=403178 2024-09-12T00:09:43.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.523+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=IQC0F81SWKNU tag=EI3YT2A9ZV73 type=write size=3548906 2024-09-12T00:09:43.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.523+0000 7f3dc2c18780 1 < canceled part key=_multipart_KQWXE62PF5F7.2~FJCRLETIE51F.0 size=1048576 2024-09-12T00:09:43.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.524+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~FJCRLETIE51F.1 size=271306 2024-09-12T00:09:43.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.526+0000 7f3dc2c18780 1 < canceled multipart upload key=KQWXE62PF5F7 upload=FJCRLETIE51F tag=S5TUTH23WCGA type=write size=2368458 2024-09-12T00:09:43.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.527+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=1Z48S8AI2UPJ type=del size=3334608 2024-09-12T00:09:43.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.529+0000 7f3dc2c18780 1 < canceled operation key=C7ZOCTAR2BEP tag=KXNFUER52E3W type=del size=3130953 2024-09-12T00:09:43.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.531+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~EVP6NQWWN6B9.0 size=397487 2024-09-12T00:09:43.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.531+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=EVP6NQWWN6B9 tag=8UIDSOZNGWDQ type=write size=1446063 2024-09-12T00:09:43.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.533+0000 7f3dc2c18780 1 < suggested remove operation key=0ICU4WV9K1RG tag=6Q18XGWFE74L type=del 2024-09-12T00:09:43.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.535+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~I0GLB42ERPQK.0 size=1048576 2024-09-12T00:09:43.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.536+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~I0GLB42ERPQK.1 size=1048576 2024-09-12T00:09:43.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.537+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~I0GLB42ERPQK.2 size=278910 2024-09-12T00:09:43.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.537+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=I0GLB42ERPQK tag=6EL0YUEOTEMX type=write size=3424638 2024-09-12T00:09:43.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.538+0000 7f3dc2c18780 1 < canceled part key=_multipart_415OYT4ML329.2~53AW05BGG350.0 size=86557 2024-09-12T00:09:43.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.540+0000 7f3dc2c18780 1 < canceled multipart upload key=415OYT4ML329 upload=53AW05BGG350 tag=IXB77AE3MMS4 type=write size=1135133 2024-09-12T00:09:43.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.541+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=B6U74A0I35U5 type=del size=1720513 2024-09-12T00:09:43.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.542+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=EDQDO3JVKEV8 type=del 2024-09-12T00:09:43.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.544+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=TFTTE15YYTS3 type=write size=213883 2024-09-12T00:09:43.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.545+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=HKY7L9MG634O type=del 2024-09-12T00:09:43.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.546+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=85F43UGNTCEU type=del size=2464364 2024-09-12T00:09:43.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.547+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=4IJHFQROAY1I type=del 2024-09-12T00:09:43.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.550+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~88GYF62UN59S.0 size=1048576 2024-09-12T00:09:43.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.551+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~88GYF62UN59S.1 size=891581 2024-09-12T00:09:43.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.551+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=88GYF62UN59S tag=31QG4SWQIEGL type=write size=2988733 2024-09-12T00:09:43.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.553+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=FK17KZN8YIPG type=del 2024-09-12T00:09:43.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.554+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=JVPPCHZK33MJ type=del size=337689 2024-09-12T00:09:43.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.555+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=ZZDKI2KH6OBD type=del 2024-09-12T00:09:43.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.557+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~QNRD0EWNHA46.0 size=1048576 2024-09-12T00:09:43.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.558+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~QNRD0EWNHA46.1 size=1048576 2024-09-12T00:09:43.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.559+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~QNRD0EWNHA46.2 size=617577 2024-09-12T00:09:43.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.559+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=QNRD0EWNHA46 tag=QFDL9OKPIY07 type=write size=3763305 2024-09-12T00:09:43.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.560+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=ZMTQKPUJOU76 type=del 2024-09-12T00:09:43.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.562+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=CW35YEB37PGN type=del size=232229 2024-09-12T00:09:43.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.563+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=11DXGXOO2A3M type=del 2024-09-12T00:09:43.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.565+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~XQQU5UXG18PS.0 size=972882 2024-09-12T00:09:43.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.565+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=XQQU5UXG18PS tag=0XN3YJN2QJ8F type=write size=2021458 2024-09-12T00:09:43.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.566+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=9127X513UNI2 type=del 2024-09-12T00:09:43.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.570+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~HLWCQV7XDFTL.0 size=383493 2024-09-12T00:09:43.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.570+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=HLWCQV7XDFTL tag=I9DIQZHAHFH1 type=write size=1432069 2024-09-12T00:09:43.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.572+0000 7f3dc2c18780 1 < suggested remove operation key=8JFV08DJLXTB tag=EMMLQFOZG5IL type=del 2024-09-12T00:09:43.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.574+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~8YELCJIXH7MK.0 size=1048576 2024-09-12T00:09:43.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.575+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~8YELCJIXH7MK.1 size=1048576 2024-09-12T00:09:43.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.576+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~8YELCJIXH7MK.2 size=265959 2024-09-12T00:09:43.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.576+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=8YELCJIXH7MK tag=XN6FX7SD2ZB0 type=write size=3411687 2024-09-12T00:09:43.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.579+0000 7f3dc2c18780 1 < suggested remove operation key=YYIQC6YL2PSW tag=LVN6E48NV30P type=del 2024-09-12T00:09:43.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.580+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=7WAXLZDOUDAX type=del size=3169112 2024-09-12T00:09:43.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.583+0000 7f3dc2c18780 1 < suggested update operation key=C0JT46SGECP0 tag=VD68NBLV1LJ6 type=del size=637950 2024-09-12T00:09:43.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.584+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=4KWSZ1CCY6O6 type=write size=5868 2024-09-12T00:09:43.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.585+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~IQC0F81SWKNU.0 size=1048576 2024-09-12T00:09:43.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.586+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~IQC0F81SWKNU.1 size=1048576 2024-09-12T00:09:43.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.587+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~IQC0F81SWKNU.2 size=403178 2024-09-12T00:09:43.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.589+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=IQC0F81SWKNU tag=EI3YT2A9ZV73 type=write size=3548906 2024-09-12T00:09:43.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.591+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~JVEMCMMCBW5G.0 size=1048576 2024-09-12T00:09:43.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.592+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~JVEMCMMCBW5G.1 size=1048576 2024-09-12T00:09:43.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.593+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~JVEMCMMCBW5G.2 size=737053 2024-09-12T00:09:43.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.593+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=JVEMCMMCBW5G tag=0IL0JMGQ9KLE type=write size=3882781 2024-09-12T00:09:43.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.595+0000 7f3dc2c18780 -1 < failed to complete operation key=C0JT46SGECP0 tag=1Z48S8AI2UPJ type=del size=3334608: (22) Invalid argument 2024-09-12T00:09:43.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.596+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=QFFU1R156LXY type=del size=1644767 2024-09-12T00:09:43.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.598+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~EVP6NQWWN6B9.0 size=397487 2024-09-12T00:09:43.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.600+0000 7f3dc2c18780 1 < completed multipart upload key=A4O7JFS2ULY0 upload=EVP6NQWWN6B9 tag=8UIDSOZNGWDQ type=write size=1446063 2024-09-12T00:09:43.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.601+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=7VR0XQ9113HC type=del size=89884 2024-09-12T00:09:43.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.602+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~I0GLB42ERPQK.0 size=1048576 2024-09-12T00:09:43.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.604+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~I0GLB42ERPQK.1 size=1048576 2024-09-12T00:09:43.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.605+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~I0GLB42ERPQK.2 size=278910 2024-09-12T00:09:43.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.607+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=I0GLB42ERPQK tag=6EL0YUEOTEMX type=write size=3424638 2024-09-12T00:09:43.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.609+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=7FFOCTE1BGW6 type=del size=2697280 2024-09-12T00:09:43.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.613+0000 7f3dc2c18780 1 < suggested update operation key=5BM1TMLRBHTS tag=B6U74A0I35U5 type=del size=1720513 2024-09-12T00:09:43.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.614+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=43BZONR0Y0D0 type=del size=3156543 2024-09-12T00:09:43.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.615+0000 7f3dc2c18780 1 < completed write operation key=Y40G8SLO6AVH tag=TFTTE15YYTS3 type=write size=213883 2024-09-12T00:09:43.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.616+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=C1RP79VUS3DD type=del size=2285565 2024-09-12T00:09:43.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.618+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=85F43UGNTCEU type=del 2024-09-12T00:09:43.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.619+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=LEU2ZWIQWHM7 type=del size=3402687 2024-09-12T00:09:43.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.620+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~88GYF62UN59S.0 size=1048576 2024-09-12T00:09:43.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.621+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~88GYF62UN59S.1 size=891581 2024-09-12T00:09:43.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.624+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=88GYF62UN59S tag=31QG4SWQIEGL type=write size=2988733 2024-09-12T00:09:43.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.625+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=UBK6Y0N5LPQ1 type=del size=735402 2024-09-12T00:09:43.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.626+0000 7f3dc2c18780 1 < canceled operation key=WRR6LAYIWOCE tag=JVPPCHZK33MJ type=del size=337689 2024-09-12T00:09:43.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.627+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=OFAEUB1KAH4K type=del size=3037743 2024-09-12T00:09:43.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.628+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~QNRD0EWNHA46.0 size=1048576 2024-09-12T00:09:43.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.629+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~QNRD0EWNHA46.1 size=1048576 2024-09-12T00:09:43.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.630+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~QNRD0EWNHA46.2 size=617577 2024-09-12T00:09:43.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.632+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=QNRD0EWNHA46 tag=QFDL9OKPIY07 type=write size=3763305 2024-09-12T00:09:43.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.634+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=OJRRY9IZFROB type=del size=729425 2024-09-12T00:09:43.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.634+0000 7f3dc2c18780 -1 < no bi entry to suggest for operation key=YYIQC6YL2PSW tag=CW35YEB37PGN type=del size=232229: (2) No such file or directory 2024-09-12T00:09:43.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.636+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~BVAHNFDWHIX3.0 size=626886 2024-09-12T00:09:43.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.636+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=BVAHNFDWHIX3 tag=E1783MDYKW6E type=write size=1675462 2024-09-12T00:09:43.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.638+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~XQQU5UXG18PS.0 size=972882 2024-09-12T00:09:43.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.640+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=XQQU5UXG18PS tag=0XN3YJN2QJ8F type=write size=2021458 2024-09-12T00:09:43.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.641+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=7LKW9IS9LG8H type=del size=3997937 2024-09-12T00:09:43.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.642+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~HLWCQV7XDFTL.0 size=383493 2024-09-12T00:09:43.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.644+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=HLWCQV7XDFTL tag=I9DIQZHAHFH1 type=write size=1432069 2024-09-12T00:09:43.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.645+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=XOA4CH0170P0 type=del size=1286132 2024-09-12T00:09:43.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.647+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~8YELCJIXH7MK.0 size=1048576 2024-09-12T00:09:43.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.648+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~8YELCJIXH7MK.1 size=1048576 2024-09-12T00:09:43.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.649+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~8YELCJIXH7MK.2 size=265959 2024-09-12T00:09:43.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.651+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=8YELCJIXH7MK tag=XN6FX7SD2ZB0 type=write size=3411687 2024-09-12T00:09:43.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.652+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=L30D3TAU7GG9 type=del size=3924798 2024-09-12T00:09:43.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.654+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=7WAXLZDOUDAX type=del 2024-09-12T00:09:43.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.655+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=M4NDQW11DFL3 type=del size=1249853 2024-09-12T00:09:43.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.656+0000 7f3dc2c18780 1 < completed write operation key=C0JT46SGECP0 tag=4KWSZ1CCY6O6 type=write size=5868 2024-09-12T00:09:43.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.657+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=T5CTBBNI5DXX type=write size=591413 2024-09-12T00:09:43.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.659+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~JVEMCMMCBW5G.0 size=1048576 2024-09-12T00:09:43.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.660+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~JVEMCMMCBW5G.1 size=1048576 2024-09-12T00:09:43.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.661+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~JVEMCMMCBW5G.2 size=737053 2024-09-12T00:09:43.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.663+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=JVEMCMMCBW5G tag=0IL0JMGQ9KLE type=write size=3882781 2024-09-12T00:09:43.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.664+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=KC2ONVGPY7BS type=del size=2233902 2024-09-12T00:09:43.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.665+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=QFFU1R156LXY type=del 2024-09-12T00:09:43.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.667+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=ZE46I9TDQ3ZO type=del size=2672061 2024-09-12T00:09:43.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.668+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=7VR0XQ9113HC type=del 2024-09-12T00:09:43.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.670+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~TZID68OM979L.0 size=147994 2024-09-12T00:09:43.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.670+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=TZID68OM979L tag=9ZIGYFCBZD14 type=write size=1196570 2024-09-12T00:09:43.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.672+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=7FFOCTE1BGW6 type=del 2024-09-12T00:09:43.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.673+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=TXHPQLB8RPH8 type=write size=205074 2024-09-12T00:09:43.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.676+0000 7f3dc2c18780 1 < suggested update operation key=QJ3KML910OEL tag=43BZONR0Y0D0 type=del size=3156543 2024-09-12T00:09:43.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.677+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=HMDOWSGSJZ3D type=del size=1052486 2024-09-12T00:09:43.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.679+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=C1RP79VUS3DD type=del size=2285565 2024-09-12T00:09:43.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.682+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~PL5ZQZ4FDDFO.0 size=1048576 2024-09-12T00:09:43.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.683+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~PL5ZQZ4FDDFO.1 size=128079 2024-09-12T00:09:43.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.683+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=PL5ZQZ4FDDFO tag=EH4OOYQ9HY1X type=write size=2225231 2024-09-12T00:09:43.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.684+0000 7f3dc2c18780 1 < completed delete operation key=KDHO7IEGICDA tag=LEU2ZWIQWHM7 type=del 2024-09-12T00:09:43.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.685+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=KD97Z4Y5OAUP type=del size=979211 2024-09-12T00:09:43.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.688+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=UBK6Y0N5LPQ1 type=del size=735402 2024-09-12T00:09:43.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.690+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=W97S6CJ9883H type=del size=3661988 2024-09-12T00:09:43.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.693+0000 7f3dc2c18780 1 < suggested remove operation key=GP3MLWX9586T tag=OFAEUB1KAH4K type=del 2024-09-12T00:09:43.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.694+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=9OT82X8V39RA type=del size=477358 2024-09-12T00:09:43.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.695+0000 7f3dc2c18780 1 < canceled operation key=3WUIB2OMX77J tag=OJRRY9IZFROB type=del size=729425 2024-09-12T00:09:43.695 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.697+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=JRSY2E9R673R type=del size=1497875 2024-09-12T00:09:43.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.698+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~BVAHNFDWHIX3.0 size=626886 2024-09-12T00:09:43.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.700+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=BVAHNFDWHIX3 tag=E1783MDYKW6E type=write size=1675462 2024-09-12T00:09:43.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.702+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~5XLVS3IKNMRT.0 size=1048576 2024-09-12T00:09:43.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.703+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~5XLVS3IKNMRT.1 size=1048576 2024-09-12T00:09:43.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.704+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~5XLVS3IKNMRT.2 size=301814 2024-09-12T00:09:43.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.704+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=5XLVS3IKNMRT tag=QL1AFRS2GXCQ type=write size=3447542 2024-09-12T00:09:43.704 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.705+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=7LKW9IS9LG8H type=del 2024-09-12T00:09:43.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.707+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=4153NEH4E6VF type=write size=745873 2024-09-12T00:09:43.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.708+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=XOA4CH0170P0 type=del 2024-09-12T00:09:43.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.710+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~LB5SHBC68HM8.0 size=1048576 2024-09-12T00:09:43.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.711+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~LB5SHBC68HM8.1 size=678720 2024-09-12T00:09:43.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.711+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=LB5SHBC68HM8 tag=A4XI55SRBEBS type=write size=2775872 2024-09-12T00:09:43.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.712+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=L30D3TAU7GG9 type=del 2024-09-12T00:09:43.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.714+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=PL6Z770D7CX2 type=del size=1037334 2024-09-12T00:09:43.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.715+0000 7f3dc2c18780 -1 < failed to complete operation key=QJ3KML910OEL tag=M4NDQW11DFL3 type=del size=1249853: (22) Invalid argument 2024-09-12T00:09:43.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.716+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=FPS0QWFOVPZI type=write size=776926 2024-09-12T00:09:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.718+0000 7f3dc2c18780 1 < suggested update operation key=YYIQC6YL2PSW tag=T5CTBBNI5DXX type=write size=591413 2024-09-12T00:09:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.719+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=7MORMBT31948 type=del size=1797602 2024-09-12T00:09:43.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.722+0000 7f3dc2c18780 1 < suggested update operation key=4POD73U0LAC0 tag=KC2ONVGPY7BS type=del size=2233902 2024-09-12T00:09:43.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.724+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~AT466LMF6Q6S.0 size=1048576 2024-09-12T00:09:43.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.725+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~AT466LMF6Q6S.1 size=1048576 2024-09-12T00:09:43.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.726+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~AT466LMF6Q6S.2 size=377971 2024-09-12T00:09:43.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.726+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=AT466LMF6Q6S tag=FGC9VI6J70PW type=write size=3523699 2024-09-12T00:09:43.727 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.728+0000 7f3dc2c18780 1 < suggested remove operation key=C0JT46SGECP0 tag=ZE46I9TDQ3ZO type=del 2024-09-12T00:09:43.729 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.730+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=HSERNVIC5UD7 type=del size=2640221 2024-09-12T00:09:43.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.731+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~TZID68OM979L.0 size=147994 2024-09-12T00:09:43.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.733+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=TZID68OM979L tag=9ZIGYFCBZD14 type=write size=1196570 2024-09-12T00:09:43.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.734+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=TKOV94LJB5I6 type=write size=213893 2024-09-12T00:09:43.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.735+0000 7f3dc2c18780 1 < completed write operation key=5MAV2RJ4E31S tag=TXHPQLB8RPH8 type=write size=205074 2024-09-12T00:09:43.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.736+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=OX3C9EWGRIBP type=del size=3104347 2024-09-12T00:09:43.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.738+0000 7f3dc2c18780 1 < suggested update operation key=5MAV2RJ4E31S tag=HMDOWSGSJZ3D type=del size=1052486 2024-09-12T00:09:43.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.740+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=P3B3PTPG54D3 type=del size=2176807 2024-09-12T00:09:43.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.741+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~PL5ZQZ4FDDFO.0 size=1048576 2024-09-12T00:09:43.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.742+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~PL5ZQZ4FDDFO.1 size=128079 2024-09-12T00:09:43.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.744+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=PL5ZQZ4FDDFO tag=EH4OOYQ9HY1X type=write size=2225231 2024-09-12T00:09:43.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.746+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~39KLTXZH15IW.0 size=1048576 2024-09-12T00:09:43.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.746+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~39KLTXZH15IW.1 size=390997 2024-09-12T00:09:43.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.746+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=39KLTXZH15IW tag=VDLGTQYX3PWG type=write size=2488149 2024-09-12T00:09:43.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.748+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=KD97Z4Y5OAUP type=del 2024-09-12T00:09:43.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.749+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=PU6QKJUS0LQQ type=del size=419906 2024-09-12T00:09:43.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.750+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=W97S6CJ9883H type=del 2024-09-12T00:09:43.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.752+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~QOKX399G3IVM.0 size=815702 2024-09-12T00:09:43.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.752+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=QOKX399G3IVM tag=G74DVCUMUK5F type=write size=1864278 2024-09-12T00:09:43.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.753+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=9OT82X8V39RA type=del 2024-09-12T00:09:43.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.756+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~GSVK6449KVPE.0 size=1048576 2024-09-12T00:09:43.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.757+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~GSVK6449KVPE.1 size=986127 2024-09-12T00:09:43.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.757+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=GSVK6449KVPE tag=HHWGI52BHOF0 type=write size=3083279 2024-09-12T00:09:43.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.758+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=JRSY2E9R673R type=del 2024-09-12T00:09:43.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.760+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=OPFEG06PU9YT type=del size=3229703 2024-09-12T00:09:43.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.761+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~5XLVS3IKNMRT.0 size=1048576 2024-09-12T00:09:43.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.761+0000 7f3dc2c18780 1 < canceled part key=_multipart_YYIQC6YL2PSW.2~5XLVS3IKNMRT.1 size=1048576 2024-09-12T00:09:43.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.762+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~5XLVS3IKNMRT.2 size=301814 2024-09-12T00:09:43.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.764+0000 7f3dc2c18780 1 < canceled multipart upload key=YYIQC6YL2PSW upload=5XLVS3IKNMRT tag=QL1AFRS2GXCQ type=write size=3447542 2024-09-12T00:09:43.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.765+0000 7f3dc2c18780 1 > prepared operation key=KDHO7IEGICDA tag=4WOTNV12R7DF type=write size=1006226 2024-09-12T00:09:43.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.768+0000 7f3dc2c18780 1 < suggested update operation key=GLAOX3ZNNILD tag=4153NEH4E6VF type=write size=745873 2024-09-12T00:09:43.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.769+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=9CPOHN40N822 type=write size=260122 2024-09-12T00:09:43.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.770+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~LB5SHBC68HM8.0 size=1048576 2024-09-12T00:09:43.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.771+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~LB5SHBC68HM8.1 size=678720 2024-09-12T00:09:43.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.773+0000 7f3dc2c18780 1 < completed multipart upload key=C0JT46SGECP0 upload=LB5SHBC68HM8 tag=A4XI55SRBEBS type=write size=2775872 2024-09-12T00:09:43.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.774+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=IKOIF9F87D09 type=del size=360355 2024-09-12T00:09:43.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.777+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=PL6Z770D7CX2 type=del size=1037334 2024-09-12T00:09:43.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.779+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~0P7XJ1LGS8YG.0 size=1048576 2024-09-12T00:09:43.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.780+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~0P7XJ1LGS8YG.1 size=64110 2024-09-12T00:09:43.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.780+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=0P7XJ1LGS8YG tag=ML8AZNDXGPEL type=write size=2161262 2024-09-12T00:09:43.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.781+0000 7f3dc2c18780 1 < completed write operation key=KQWXE62PF5F7 tag=FPS0QWFOVPZI type=write size=776926 2024-09-12T00:09:43.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.783+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~4OJ2EC77YMRO.0 size=300419 2024-09-12T00:09:43.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.783+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=4OJ2EC77YMRO tag=0C3KCKVW0PGG type=write size=1348995 2024-09-12T00:09:43.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.785+0000 7f3dc2c18780 -1 < failed to complete operation key=5MAV2RJ4E31S tag=7MORMBT31948 type=del size=1797602: (22) Invalid argument 2024-09-12T00:09:43.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.787+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~81T13Z24E3O7.0 size=1048576 2024-09-12T00:09:43.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.788+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~81T13Z24E3O7.1 size=60925 2024-09-12T00:09:43.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.788+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=81T13Z24E3O7 tag=SI1X0J6JUVLD type=write size=2158077 2024-09-12T00:09:43.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.789+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~AT466LMF6Q6S.0 size=1048576 2024-09-12T00:09:43.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.790+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~AT466LMF6Q6S.1 size=1048576 2024-09-12T00:09:43.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.790+0000 7f3dc2c18780 1 < canceled part key=_multipart_XNZNORKYEOPV.2~AT466LMF6Q6S.2 size=377971 2024-09-12T00:09:43.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.792+0000 7f3dc2c18780 1 < canceled multipart upload key=XNZNORKYEOPV upload=AT466LMF6Q6S tag=FGC9VI6J70PW type=write size=3523699 2024-09-12T00:09:43.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.795+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~FZW8G56C5N9F.0 size=793951 2024-09-12T00:09:43.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.795+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=FZW8G56C5N9F tag=N1N5ECCPOHR4 type=write size=1842527 2024-09-12T00:09:43.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.797+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=HSERNVIC5UD7 type=del 2024-09-12T00:09:43.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.799+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~QMB9KOWY90BI.0 size=86867 2024-09-12T00:09:43.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.799+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=QMB9KOWY90BI tag=9L1DG9NYT3DZ type=write size=1135443 2024-09-12T00:09:43.799 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.800+0000 7f3dc2c18780 1 < completed write operation key=OGRGDIUO2W8B tag=TKOV94LJB5I6 type=write size=213893 2024-09-12T00:09:43.800 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.801+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=DP4GRGK4JSKH type=del size=385492 2024-09-12T00:09:43.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.803+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=OX3C9EWGRIBP type=del 2024-09-12T00:09:43.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.806+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~AJFNKNVUW9FH.0 size=1048576 2024-09-12T00:09:43.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.807+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~AJFNKNVUW9FH.1 size=1048576 2024-09-12T00:09:43.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.808+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~AJFNKNVUW9FH.2 size=488313 2024-09-12T00:09:43.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.808+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=AJFNKNVUW9FH tag=7OB3B1O3PKYN type=write size=3634041 2024-09-12T00:09:43.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.809+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=P3B3PTPG54D3 type=del 2024-09-12T00:09:43.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.810+0000 7f3dc2c18780 1 > prepared operation key=WRBBH64CISJZ tag=7DTBSUI5Y161 type=del size=2217962 2024-09-12T00:09:43.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.811+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~39KLTXZH15IW.0 size=1048576 2024-09-12T00:09:43.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.812+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~39KLTXZH15IW.1 size=390997 2024-09-12T00:09:43.814 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.814+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=39KLTXZH15IW tag=VDLGTQYX3PWG type=write size=2488149 2024-09-12T00:09:43.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.817+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~LME23D5QLMG0.0 size=456666 2024-09-12T00:09:43.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.817+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=LME23D5QLMG0 tag=8LUEBO0X5UXD type=write size=1505242 2024-09-12T00:09:43.816 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.818+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=PU6QKJUS0LQQ type=del 2024-09-12T00:09:43.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.819+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=ZGQVTTWO7B52 type=del size=2151485 2024-09-12T00:09:43.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.821+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~QOKX399G3IVM.0 size=815702 2024-09-12T00:09:43.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.823+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=QOKX399G3IVM tag=G74DVCUMUK5F type=write size=1864278 2024-09-12T00:09:43.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.825+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~WN2IVGKX4AUI.0 size=1048576 2024-09-12T00:09:43.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.826+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~WN2IVGKX4AUI.1 size=555432 2024-09-12T00:09:43.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.826+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=WN2IVGKX4AUI tag=9JR4NT7P2OPC type=write size=2652584 2024-09-12T00:09:43.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.827+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~GSVK6449KVPE.0 size=1048576 2024-09-12T00:09:43.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.828+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~GSVK6449KVPE.1 size=986127 2024-09-12T00:09:43.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.830+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=GSVK6449KVPE tag=HHWGI52BHOF0 type=write size=3083279 2024-09-12T00:09:43.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.831+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=ZYPX6D4NWML3 type=del size=1362643 2024-09-12T00:09:43.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.833+0000 7f3dc2c18780 1 < completed delete operation key=Y40G8SLO6AVH tag=OPFEG06PU9YT type=del 2024-09-12T00:09:43.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.834+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=38LYRQXTT65N type=del size=882072 2024-09-12T00:09:43.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.835+0000 7f3dc2c18780 1 < completed write operation key=KDHO7IEGICDA tag=4WOTNV12R7DF type=write size=1006226 2024-09-12T00:09:43.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.838+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~VMFB83I8GOY9.0 size=1048576 2024-09-12T00:09:43.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.838+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~VMFB83I8GOY9.1 size=393055 2024-09-12T00:09:43.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.838+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=VMFB83I8GOY9 tag=Q0EY3LUWCDVA type=write size=2490207 2024-09-12T00:09:43.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.840+0000 7f3dc2c18780 1 < canceled operation key=U2H0A1GZROT7 tag=9CPOHN40N822 type=write size=260122 2024-09-12T00:09:43.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.841+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=SSHDO78JIOGW type=del size=532317 2024-09-12T00:09:43.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.842+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=IKOIF9F87D09 type=del 2024-09-12T00:09:43.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.844+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=RCPX3OXWWOPB type=del size=2587667 2024-09-12T00:09:43.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.845+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~0P7XJ1LGS8YG.0 size=1048576 2024-09-12T00:09:43.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.846+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~0P7XJ1LGS8YG.1 size=64110 2024-09-12T00:09:43.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.848+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=0P7XJ1LGS8YG tag=ML8AZNDXGPEL type=write size=2161262 2024-09-12T00:09:43.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.849+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=4MVTV37NG48C type=del size=460683 2024-09-12T00:09:43.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.850+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~4OJ2EC77YMRO.0 size=300419 2024-09-12T00:09:43.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.852+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=4OJ2EC77YMRO tag=0C3KCKVW0PGG type=write size=1348995 2024-09-12T00:09:43.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.858+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=TN7AFU3L3I52 type=del size=297955 2024-09-12T00:09:43.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.860+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~81T13Z24E3O7.0 size=1048576 2024-09-12T00:09:43.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.860+0000 7f3dc2c18780 1 < canceled part key=_multipart_KQWXE62PF5F7.2~81T13Z24E3O7.1 size=60925 2024-09-12T00:09:43.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.862+0000 7f3dc2c18780 1 < canceled multipart upload key=KQWXE62PF5F7 upload=81T13Z24E3O7 tag=SI1X0J6JUVLD type=write size=2158077 2024-09-12T00:09:43.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.864+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~O2AKGQZATOJ2.0 size=1048576 2024-09-12T00:09:43.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.865+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~O2AKGQZATOJ2.1 size=163730 2024-09-12T00:09:43.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.865+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=O2AKGQZATOJ2 tag=5ESSVAJ56HCQ type=write size=2260882 2024-09-12T00:09:43.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.866+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~FZW8G56C5N9F.0 size=793951 2024-09-12T00:09:43.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.868+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=FZW8G56C5N9F tag=N1N5ECCPOHR4 type=write size=1842527 2024-09-12T00:09:43.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.870+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=JCZCMNHGTC3O type=del size=1347803 2024-09-12T00:09:43.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.871+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~QMB9KOWY90BI.0 size=86867 2024-09-12T00:09:43.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.873+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=QMB9KOWY90BI tag=9L1DG9NYT3DZ type=write size=1135443 2024-09-12T00:09:43.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.875+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~B8CRD9ACZ6FG.0 size=669302 2024-09-12T00:09:43.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.875+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=B8CRD9ACZ6FG tag=8RLU9PT2GLRK type=write size=1717878 2024-09-12T00:09:43.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.877+0000 7f3dc2c18780 1 < suggested remove operation key=WRR6LAYIWOCE tag=DP4GRGK4JSKH type=del 2024-09-12T00:09:43.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.880+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~9ZS53CQV7IR9.0 size=1048576 2024-09-12T00:09:43.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.880+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~9ZS53CQV7IR9.1 size=279619 2024-09-12T00:09:43.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.880+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=9ZS53CQV7IR9 tag=LR5DD2FF6H17 type=write size=2376771 2024-09-12T00:09:43.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.882+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~AJFNKNVUW9FH.0 size=1048576 2024-09-12T00:09:43.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.883+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~AJFNKNVUW9FH.1 size=1048576 2024-09-12T00:09:43.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.884+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~AJFNKNVUW9FH.2 size=488313 2024-09-12T00:09:43.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.886+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=AJFNKNVUW9FH tag=7OB3B1O3PKYN type=write size=3634041 2024-09-12T00:09:43.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.888+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~ZZG6FEDW2A8Y.0 size=502808 2024-09-12T00:09:43.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.888+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=ZZG6FEDW2A8Y tag=2JB9TSPNY2Y2 type=write size=1551384 2024-09-12T00:09:43.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.889+0000 7f3dc2c18780 1 < completed delete operation key=WRBBH64CISJZ tag=7DTBSUI5Y161 type=del 2024-09-12T00:09:43.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.891+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=7ULTRGKEKU6N type=del size=2818987 2024-09-12T00:09:43.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.892+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~LME23D5QLMG0.0 size=456666 2024-09-12T00:09:43.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.894+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=LME23D5QLMG0 tag=8LUEBO0X5UXD type=write size=1505242 2024-09-12T00:09:43.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.896+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~GZ1AV6KNT276.0 size=1048576 2024-09-12T00:09:43.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.897+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~GZ1AV6KNT276.1 size=109741 2024-09-12T00:09:43.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.897+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=GZ1AV6KNT276 tag=XHUVX3QWQ851 type=write size=2206893 2024-09-12T00:09:43.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.899+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=ZGQVTTWO7B52 type=del 2024-09-12T00:09:43.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.900+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=H9VL3GAZEDFF type=write size=500363 2024-09-12T00:09:43.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.900+0000 7f3dc2c18780 1 < canceled part key=_multipart_Y40G8SLO6AVH.2~WN2IVGKX4AUI.0 size=1048576 2024-09-12T00:09:43.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.901+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~WN2IVGKX4AUI.1 size=555432 2024-09-12T00:09:43.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.903+0000 7f3dc2c18780 1 < canceled multipart upload key=Y40G8SLO6AVH upload=WN2IVGKX4AUI tag=9JR4NT7P2OPC type=write size=2652584 2024-09-12T00:09:43.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.905+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~HA00S55IPPLK.0 size=1048576 2024-09-12T00:09:43.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.906+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~HA00S55IPPLK.1 size=205743 2024-09-12T00:09:43.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.907+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=HA00S55IPPLK tag=AR3D18UBG4KT type=write size=2302895 2024-09-12T00:09:43.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.908+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=ZYPX6D4NWML3 type=del 2024-09-12T00:09:43.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.909+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=E43WKFH78KDN type=del size=949474 2024-09-12T00:09:43.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.911+0000 7f3dc2c18780 1 < suggested remove operation key=2SO8HBZSAMRX tag=38LYRQXTT65N type=del 2024-09-12T00:09:43.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.914+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~OEM0FS3XYQRS.0 size=1048576 2024-09-12T00:09:43.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.915+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~OEM0FS3XYQRS.1 size=503091 2024-09-12T00:09:43.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.915+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=OEM0FS3XYQRS tag=70YMMZD47V7X type=write size=2600243 2024-09-12T00:09:43.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.915+0000 7f3dc2c18780 1 < canceled part key=_multipart_KDHO7IEGICDA.2~VMFB83I8GOY9.0 size=1048576 2024-09-12T00:09:43.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.916+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~VMFB83I8GOY9.1 size=393055 2024-09-12T00:09:43.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.918+0000 7f3dc2c18780 1 < canceled multipart upload key=KDHO7IEGICDA upload=VMFB83I8GOY9 tag=Q0EY3LUWCDVA type=write size=2490207 2024-09-12T00:09:43.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.919+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=V8MA3P63UL4X type=del size=4053931 2024-09-12T00:09:43.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.921+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=SSHDO78JIOGW type=del 2024-09-12T00:09:43.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.923+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~2BQ6RRMJG0XK.0 size=1048576 2024-09-12T00:09:43.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.925+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~2BQ6RRMJG0XK.1 size=1048576 2024-09-12T00:09:43.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.926+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~2BQ6RRMJG0XK.2 size=536943 2024-09-12T00:09:43.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.926+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=2BQ6RRMJG0XK tag=Y0DEEMA9QLLH type=write size=3682671 2024-09-12T00:09:43.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.928+0000 7f3dc2c18780 1 < canceled operation key=5CS98S02F59L tag=RCPX3OXWWOPB type=del size=2587667 2024-09-12T00:09:43.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.929+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=96F8O2NDBTOH type=del size=3269783 2024-09-12T00:09:43.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.930+0000 7f3dc2c18780 1 < completed delete operation key=GLAOX3ZNNILD tag=4MVTV37NG48C type=del 2024-09-12T00:09:43.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.931+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=SIEOLMR520UO type=del size=1996598 2024-09-12T00:09:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.933+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=TN7AFU3L3I52 type=del 2024-09-12T00:09:43.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.935+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~T7UZTB15NKR6.0 size=1048576 2024-09-12T00:09:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.936+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~T7UZTB15NKR6.1 size=272280 2024-09-12T00:09:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.936+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=T7UZTB15NKR6 tag=PS2ALS8KJHS7 type=write size=2369432 2024-09-12T00:09:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.936+0000 7f3dc2c18780 1 < canceled part key=_multipart_2SO8HBZSAMRX.2~O2AKGQZATOJ2.0 size=1048576 2024-09-12T00:09:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.937+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~O2AKGQZATOJ2.1 size=163730 2024-09-12T00:09:43.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.939+0000 7f3dc2c18780 1 < canceled multipart upload key=2SO8HBZSAMRX upload=O2AKGQZATOJ2 tag=5ESSVAJ56HCQ type=write size=2260882 2024-09-12T00:09:43.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.941+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~BY7FL81T65X8.0 size=1048576 2024-09-12T00:09:43.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.942+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~BY7FL81T65X8.1 size=678007 2024-09-12T00:09:43.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.942+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=BY7FL81T65X8 tag=TYGDLFRVX8CZ type=write size=2775159 2024-09-12T00:09:43.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.944+0000 7f3dc2c18780 1 < completed delete operation key=L9C014T8YLNV tag=JCZCMNHGTC3O type=del 2024-09-12T00:09:43.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.946+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~BOF0LRFTNOV6.0 size=1048576 2024-09-12T00:09:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.947+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~BOF0LRFTNOV6.1 size=127881 2024-09-12T00:09:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.947+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=BOF0LRFTNOV6 tag=SX35ODLRJV3P type=write size=2225033 2024-09-12T00:09:43.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.948+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~B8CRD9ACZ6FG.0 size=669302 2024-09-12T00:09:43.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.951+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=B8CRD9ACZ6FG tag=8RLU9PT2GLRK type=write size=1717878 2024-09-12T00:09:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.952+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=X648HEJWUXX2 type=write size=904121 2024-09-12T00:09:43.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.953+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~9ZS53CQV7IR9.0 size=1048576 2024-09-12T00:09:43.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.954+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~9ZS53CQV7IR9.1 size=279619 2024-09-12T00:09:43.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.956+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=9ZS53CQV7IR9 tag=LR5DD2FF6H17 type=write size=2376771 2024-09-12T00:09:43.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.957+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=7NP7CT59O3C9 type=del size=796138 2024-09-12T00:09:43.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.959+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~ZZG6FEDW2A8Y.0 size=502808 2024-09-12T00:09:43.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.961+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=ZZG6FEDW2A8Y tag=2JB9TSPNY2Y2 type=write size=1551384 2024-09-12T00:09:43.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.962+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=92ME5TOVL9EF type=del size=1542076 2024-09-12T00:09:43.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.964+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=7ULTRGKEKU6N type=del size=2818987 2024-09-12T00:09:43.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.966+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=TUMKTIJPSAED type=del size=3552682 2024-09-12T00:09:43.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.967+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~GZ1AV6KNT276.0 size=1048576 2024-09-12T00:09:43.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.968+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~GZ1AV6KNT276.1 size=109741 2024-09-12T00:09:43.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.970+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=GZ1AV6KNT276 tag=XHUVX3QWQ851 type=write size=2206893 2024-09-12T00:09:43.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.971+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=HB71FO2D3AOY type=del size=100525 2024-09-12T00:09:43.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.972+0000 7f3dc2c18780 1 < canceled operation key=WRR6LAYIWOCE tag=H9VL3GAZEDFF type=write size=500363 2024-09-12T00:09:43.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.973+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=28MQCMZCKTPZ type=del size=3093670 2024-09-12T00:09:43.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.974+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~HA00S55IPPLK.0 size=1048576 2024-09-12T00:09:43.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.974+0000 7f3dc2c18780 1 < canceled part key=_multipart_GLAOX3ZNNILD.2~HA00S55IPPLK.1 size=205743 2024-09-12T00:09:43.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.976+0000 7f3dc2c18780 1 < canceled multipart upload key=GLAOX3ZNNILD upload=HA00S55IPPLK tag=AR3D18UBG4KT type=write size=2302895 2024-09-12T00:09:43.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.977+0000 7f3dc2c18780 1 > prepared operation key=A4O7JFS2ULY0 tag=HYPRQELWY538 type=write size=646798 2024-09-12T00:09:43.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.979+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=E43WKFH78KDN type=del 2024-09-12T00:09:43.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.980+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=WNELCYM1F51E type=del size=3479934 2024-09-12T00:09:43.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.981+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~OEM0FS3XYQRS.0 size=1048576 2024-09-12T00:09:43.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.982+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~OEM0FS3XYQRS.1 size=503091 2024-09-12T00:09:43.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.984+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=OEM0FS3XYQRS tag=70YMMZD47V7X type=write size=2600243 2024-09-12T00:09:43.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.985+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=HPIUMP2UUHOI type=del size=2774666 2024-09-12T00:09:43.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.987+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=V8MA3P63UL4X type=del 2024-09-12T00:09:43.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.989+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~VLGMVSYUKLRR.0 size=177362 2024-09-12T00:09:43.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.989+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=VLGMVSYUKLRR tag=UPF54L0GYALY type=write size=1225938 2024-09-12T00:09:43.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.990+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~2BQ6RRMJG0XK.0 size=1048576 2024-09-12T00:09:43.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.991+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~2BQ6RRMJG0XK.1 size=1048576 2024-09-12T00:09:43.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.992+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~2BQ6RRMJG0XK.2 size=536943 2024-09-12T00:09:43.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.994+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=2BQ6RRMJG0XK tag=Y0DEEMA9QLLH type=write size=3682671 2024-09-12T00:09:43.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.996+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~6X60Z2Q3FAFZ.0 size=1048576 2024-09-12T00:09:43.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.997+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~6X60Z2Q3FAFZ.1 size=1048576 2024-09-12T00:09:43.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.998+0000 7f3dc2c18780 1 > prepared part key=_multipart_A4O7JFS2ULY0.2~6X60Z2Q3FAFZ.2 size=522798 2024-09-12T00:09:43.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.998+0000 7f3dc2c18780 1 > prepared multipart upload key=A4O7JFS2ULY0 upload=6X60Z2Q3FAFZ tag=QD31LIVFLSU8 type=write size=3668526 2024-09-12T00:09:43.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:43.999+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=96F8O2NDBTOH type=del 2024-09-12T00:09:43.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.001+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=PMYLQDNKHXR8 type=del size=3229649 2024-09-12T00:09:44.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.003+0000 7f3dc2c18780 1 < suggested remove operation key=5BM1TMLRBHTS tag=SIEOLMR520UO type=del 2024-09-12T00:09:44.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.005+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~HW5B2W91Q3CC.0 size=1048576 2024-09-12T00:09:44.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.006+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~HW5B2W91Q3CC.1 size=318770 2024-09-12T00:09:44.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.006+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=HW5B2W91Q3CC tag=WRO9D7ZD4SUP type=write size=2415922 2024-09-12T00:09:44.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.007+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~T7UZTB15NKR6.0 size=1048576 2024-09-12T00:09:44.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.008+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~T7UZTB15NKR6.1 size=272280 2024-09-12T00:09:44.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.010+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=T7UZTB15NKR6 tag=PS2ALS8KJHS7 type=write size=2369432 2024-09-12T00:09:44.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.011+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=9NS5GZD29MEB type=del size=3726321 2024-09-12T00:09:44.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.013+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~BY7FL81T65X8.0 size=1048576 2024-09-12T00:09:44.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.014+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~BY7FL81T65X8.1 size=678007 2024-09-12T00:09:44.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.016+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=BY7FL81T65X8 tag=TYGDLFRVX8CZ type=write size=2775159 2024-09-12T00:09:44.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.017+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=C5KZSFSNT6DO type=del size=2588257 2024-09-12T00:09:44.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.018+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~BOF0LRFTNOV6.0 size=1048576 2024-09-12T00:09:44.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.020+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~BOF0LRFTNOV6.1 size=127881 2024-09-12T00:09:44.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.022+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=BOF0LRFTNOV6 tag=SX35ODLRJV3P type=write size=2225033 2024-09-12T00:09:44.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.024+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~4H3459SXT11B.0 size=1048576 2024-09-12T00:09:44.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.025+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~4H3459SXT11B.1 size=1032825 2024-09-12T00:09:44.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.025+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=4H3459SXT11B tag=UXDIZ4KBQ71E type=write size=3129977 2024-09-12T00:09:44.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.027+0000 7f3dc2c18780 1 < completed write operation key=5CS98S02F59L tag=X648HEJWUXX2 type=write size=904121 2024-09-12T00:09:44.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.028+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=0SYKSCI2T1YU type=del size=987396 2024-09-12T00:09:44.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.029+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=7NP7CT59O3C9 type=del 2024-09-12T00:09:44.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.031+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=PRGK863T6EIU type=write size=174331 2024-09-12T00:09:44.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.033+0000 7f3dc2c18780 1 < suggested update operation key=C0JT46SGECP0 tag=92ME5TOVL9EF type=del size=1542076 2024-09-12T00:09:44.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.035+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=205QRTX2OLLW type=write size=324232 2024-09-12T00:09:44.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.036+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=TUMKTIJPSAED type=del 2024-09-12T00:09:44.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.037+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=U0C87BOP8PNC type=write size=131791 2024-09-12T00:09:44.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.039+0000 7f3dc2c18780 1 < canceled operation key=GLAOX3ZNNILD tag=HB71FO2D3AOY type=del size=100525 2024-09-12T00:09:44.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.041+0000 7f3dc2c18780 1 > prepared operation key=C0JT46SGECP0 tag=APX15G089WOX type=del size=279147 2024-09-12T00:09:44.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.043+0000 7f3dc2c18780 1 < completed delete operation key=UJDQEIAIRVDW tag=28MQCMZCKTPZ type=del 2024-09-12T00:09:44.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.044+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=MR8KB2V92ZLR type=del size=49277 2024-09-12T00:09:44.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.045+0000 7f3dc2c18780 1 < canceled operation key=A4O7JFS2ULY0 tag=HYPRQELWY538 type=write size=646798 2024-09-12T00:09:44.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.046+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=NUVQGXTS14VN type=del size=1955671 2024-09-12T00:09:44.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.049+0000 7f3dc2c18780 1 < suggested remove operation key=TSL3IDD0EDT0 tag=WNELCYM1F51E type=del 2024-09-12T00:09:44.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.052+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~XNR2YLHOR0O6.0 size=1048576 2024-09-12T00:09:44.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.053+0000 7f3dc2c18780 1 > prepared part key=_multipart_7JVCFTM2QMGY.2~XNR2YLHOR0O6.1 size=235413 2024-09-12T00:09:44.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.053+0000 7f3dc2c18780 1 > prepared multipart upload key=7JVCFTM2QMGY upload=XNR2YLHOR0O6 tag=Q448QSKBT3UR type=write size=2332565 2024-09-12T00:09:44.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.055+0000 7f3dc2c18780 -1 < failed to complete operation key=C0JT46SGECP0 tag=HPIUMP2UUHOI type=del size=2774666: (22) Invalid argument 2024-09-12T00:09:44.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.057+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~JNIICXPKPPLF.0 size=1048576 2024-09-12T00:09:44.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.059+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~JNIICXPKPPLF.1 size=1048576 2024-09-12T00:09:44.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.059+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~JNIICXPKPPLF.2 size=795312 2024-09-12T00:09:44.058 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.059+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=JNIICXPKPPLF tag=28J9WNVO1P2M type=write size=3941040 2024-09-12T00:09:44.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.061+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~VLGMVSYUKLRR.0 size=177362 2024-09-12T00:09:44.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.063+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=VLGMVSYUKLRR tag=UPF54L0GYALY type=write size=1225938 2024-09-12T00:09:44.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.065+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~2JEJFLG26L43.0 size=1048576 2024-09-12T00:09:44.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.066+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~2JEJFLG26L43.1 size=51240 2024-09-12T00:09:44.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.066+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=2JEJFLG26L43 tag=6NZ830JIZ1SW type=write size=2148392 2024-09-12T00:09:44.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.066+0000 7f3dc2c18780 1 < canceled part key=_multipart_A4O7JFS2ULY0.2~6X60Z2Q3FAFZ.0 size=1048576 2024-09-12T00:09:44.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.067+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~6X60Z2Q3FAFZ.1 size=1048576 2024-09-12T00:09:44.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.068+0000 7f3dc2c18780 1 < completed part key=_multipart_A4O7JFS2ULY0.2~6X60Z2Q3FAFZ.2 size=522798 2024-09-12T00:09:44.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.070+0000 7f3dc2c18780 1 < canceled multipart upload key=A4O7JFS2ULY0 upload=6X60Z2Q3FAFZ tag=QD31LIVFLSU8 type=write size=3668526 2024-09-12T00:09:44.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.072+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~BZLJM7J4NUFX.0 size=565410 2024-09-12T00:09:44.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.072+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=BZLJM7J4NUFX tag=6IM5Y8QZ313U type=write size=1613986 2024-09-12T00:09:44.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.074+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=PMYLQDNKHXR8 type=del 2024-09-12T00:09:44.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.076+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~FO458B6YXG0S.0 size=1048576 2024-09-12T00:09:44.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.077+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~FO458B6YXG0S.1 size=996265 2024-09-12T00:09:44.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.077+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=FO458B6YXG0S tag=P8UN5RA7KQCD type=write size=3093417 2024-09-12T00:09:44.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.079+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~HW5B2W91Q3CC.0 size=1048576 2024-09-12T00:09:44.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.080+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~HW5B2W91Q3CC.1 size=318770 2024-09-12T00:09:44.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.082+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=HW5B2W91Q3CC tag=WRO9D7ZD4SUP type=write size=2415922 2024-09-12T00:09:44.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.084+0000 7f3dc2c18780 1 > prepared part key=_multipart_4POD73U0LAC0.2~U9Q32ZN6BD4V.0 size=937899 2024-09-12T00:09:44.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.084+0000 7f3dc2c18780 1 > prepared multipart upload key=4POD73U0LAC0 upload=U9Q32ZN6BD4V tag=QROVKSPJY81G type=write size=1986475 2024-09-12T00:09:44.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.085+0000 7f3dc2c18780 1 < completed delete operation key=QJ3KML910OEL tag=9NS5GZD29MEB type=del 2024-09-12T00:09:44.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.088+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~4E0WKZOZJZRT.0 size=1048576 2024-09-12T00:09:44.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.089+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~4E0WKZOZJZRT.1 size=884184 2024-09-12T00:09:44.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.089+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=4E0WKZOZJZRT tag=9WFBBWDEQVAH type=write size=2981336 2024-09-12T00:09:44.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.091+0000 7f3dc2c18780 1 < suggested update operation key=QJ3KML910OEL tag=C5KZSFSNT6DO type=del size=2588257 2024-09-12T00:09:44.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.092+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=EE4ZBPEO912S type=del size=2794043 2024-09-12T00:09:44.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.093+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~4H3459SXT11B.0 size=1048576 2024-09-12T00:09:44.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.093+0000 7f3dc2c18780 1 < canceled part key=_multipart_Y40G8SLO6AVH.2~4H3459SXT11B.1 size=1032825 2024-09-12T00:09:44.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.095+0000 7f3dc2c18780 1 < canceled multipart upload key=Y40G8SLO6AVH upload=4H3459SXT11B tag=UXDIZ4KBQ71E type=write size=3129977 2024-09-12T00:09:44.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.096+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=I42VGCPQ602G type=write size=262673 2024-09-12T00:09:44.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.098+0000 7f3dc2c18780 -1 < failed to complete operation key=TSL3IDD0EDT0 tag=0SYKSCI2T1YU type=del size=987396: (22) Invalid argument 2024-09-12T00:09:44.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.100+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~4EQJHX204S1U.0 size=1048576 2024-09-12T00:09:44.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.101+0000 7f3dc2c18780 1 > prepared part key=_multipart_65DTZR8A5OHF.2~4EQJHX204S1U.1 size=390244 2024-09-12T00:09:44.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.101+0000 7f3dc2c18780 1 > prepared multipart upload key=65DTZR8A5OHF upload=4EQJHX204S1U tag=B68NIFPCG1HX type=write size=2487396 2024-09-12T00:09:44.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.102+0000 7f3dc2c18780 1 < completed write operation key=25CF1N8J81Y9 tag=PRGK863T6EIU type=write size=174331 2024-09-12T00:09:44.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.104+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~WWGD5ERGY0ZE.0 size=1048576 2024-09-12T00:09:44.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.105+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~WWGD5ERGY0ZE.1 size=474169 2024-09-12T00:09:44.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.105+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=WWGD5ERGY0ZE tag=BH4Y6984S0A6 type=write size=2571321 2024-09-12T00:09:44.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.108+0000 7f3dc2c18780 1 < completed write operation key=8JFV08DJLXTB tag=205QRTX2OLLW type=write size=324232 2024-09-12T00:09:44.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.110+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~YK11EVBBY256.0 size=1048576 2024-09-12T00:09:44.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.111+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~YK11EVBBY256.1 size=1048576 2024-09-12T00:09:44.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.112+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~YK11EVBBY256.2 size=816527 2024-09-12T00:09:44.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.112+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=YK11EVBBY256 tag=YSM87L6MJEZM type=write size=3962255 2024-09-12T00:09:44.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.114+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=U0C87BOP8PNC type=write size=131791 2024-09-12T00:09:44.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.115+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=FZ8NWMS7DIUX type=del size=1155147 2024-09-12T00:09:44.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.117+0000 7f3dc2c18780 1 < completed delete operation key=C0JT46SGECP0 tag=APX15G089WOX type=del 2024-09-12T00:09:44.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.118+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=C9AUTHS5Y37G type=del size=314018 2024-09-12T00:09:44.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.119+0000 7f3dc2c18780 -1 < failed to complete operation key=TSL3IDD0EDT0 tag=MR8KB2V92ZLR type=del size=49277: (22) Invalid argument 2024-09-12T00:09:44.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.121+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~95IFQ0NNWVVU.0 size=1048576 2024-09-12T00:09:44.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.122+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~95IFQ0NNWVVU.1 size=139976 2024-09-12T00:09:44.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.122+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=95IFQ0NNWVVU tag=HEAW1STAWQLU type=write size=2237128 2024-09-12T00:09:44.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.124+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=NUVQGXTS14VN type=del 2024-09-12T00:09:44.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.125+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=4ARA1H4WDCO3 type=del size=1152304 2024-09-12T00:09:44.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.126+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~XNR2YLHOR0O6.0 size=1048576 2024-09-12T00:09:44.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.127+0000 7f3dc2c18780 1 < completed part key=_multipart_7JVCFTM2QMGY.2~XNR2YLHOR0O6.1 size=235413 2024-09-12T00:09:44.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.129+0000 7f3dc2c18780 1 < completed multipart upload key=7JVCFTM2QMGY upload=XNR2YLHOR0O6 tag=Q448QSKBT3UR type=write size=2332565 2024-09-12T00:09:44.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.130+0000 7f3dc2c18780 1 > prepared operation key=L9C014T8YLNV tag=2L4V4XMV3KTE type=write size=99075 2024-09-12T00:09:44.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.132+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~JNIICXPKPPLF.0 size=1048576 2024-09-12T00:09:44.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.133+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~JNIICXPKPPLF.1 size=1048576 2024-09-12T00:09:44.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.134+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~JNIICXPKPPLF.2 size=795312 2024-09-12T00:09:44.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.136+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=JNIICXPKPPLF tag=28J9WNVO1P2M type=write size=3941040 2024-09-12T00:09:44.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.137+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=6JLMZBT1HPHK type=del size=3080132 2024-09-12T00:09:44.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.138+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~2JEJFLG26L43.0 size=1048576 2024-09-12T00:09:44.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.139+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~2JEJFLG26L43.1 size=51240 2024-09-12T00:09:44.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.141+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=2JEJFLG26L43 tag=6NZ830JIZ1SW type=write size=2148392 2024-09-12T00:09:44.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.143+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~SKGJVFZQ7UXN.0 size=1048576 2024-09-12T00:09:44.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.144+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~SKGJVFZQ7UXN.1 size=1048576 2024-09-12T00:09:44.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.145+0000 7f3dc2c18780 1 > prepared part key=_multipart_XNZNORKYEOPV.2~SKGJVFZQ7UXN.2 size=843068 2024-09-12T00:09:44.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.145+0000 7f3dc2c18780 1 > prepared multipart upload key=XNZNORKYEOPV upload=SKGJVFZQ7UXN tag=DJ9TMN6LW49U type=write size=3988796 2024-09-12T00:09:44.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.147+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~BZLJM7J4NUFX.0 size=565410 2024-09-12T00:09:44.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.149+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=BZLJM7J4NUFX tag=6IM5Y8QZ313U type=write size=1613986 2024-09-12T00:09:44.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.151+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~B0MJ7PHAOZR7.0 size=1048576 2024-09-12T00:09:44.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.152+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~B0MJ7PHAOZR7.1 size=1048576 2024-09-12T00:09:44.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.153+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~B0MJ7PHAOZR7.2 size=670874 2024-09-12T00:09:44.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.153+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=B0MJ7PHAOZR7 tag=HCFTHP9H0IXD type=write size=3816602 2024-09-12T00:09:44.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.154+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~FO458B6YXG0S.0 size=1048576 2024-09-12T00:09:44.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.155+0000 7f3dc2c18780 1 < completed part key=_multipart_C7ZOCTAR2BEP.2~FO458B6YXG0S.1 size=996265 2024-09-12T00:09:44.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.159+0000 7f3dc2c18780 1 < completed multipart upload key=C7ZOCTAR2BEP upload=FO458B6YXG0S tag=P8UN5RA7KQCD type=write size=3093417 2024-09-12T00:09:44.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.160+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=RX3O3UMG8CDD type=write size=411022 2024-09-12T00:09:44.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.161+0000 7f3dc2c18780 1 < completed part key=_multipart_4POD73U0LAC0.2~U9Q32ZN6BD4V.0 size=937899 2024-09-12T00:09:44.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.163+0000 7f3dc2c18780 1 < completed multipart upload key=4POD73U0LAC0 upload=U9Q32ZN6BD4V tag=QROVKSPJY81G type=write size=1986475 2024-09-12T00:09:44.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.165+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=LEEJJWYX2Q8K type=write size=809208 2024-09-12T00:09:44.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.166+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~4E0WKZOZJZRT.0 size=1048576 2024-09-12T00:09:44.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.166+0000 7f3dc2c18780 1 < canceled part key=_multipart_TSL3IDD0EDT0.2~4E0WKZOZJZRT.1 size=884184 2024-09-12T00:09:44.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.168+0000 7f3dc2c18780 1 < canceled multipart upload key=TSL3IDD0EDT0 upload=4E0WKZOZJZRT tag=9WFBBWDEQVAH type=write size=2981336 2024-09-12T00:09:44.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.170+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~FOEFC5QFKC32.0 size=1048576 2024-09-12T00:09:44.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.171+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~FOEFC5QFKC32.1 size=1048576 2024-09-12T00:09:44.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.172+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~FOEFC5QFKC32.2 size=11511 2024-09-12T00:09:44.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.172+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=FOEFC5QFKC32 tag=EMA6XMKRR6GJ type=write size=3157239 2024-09-12T00:09:44.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.174+0000 7f3dc2c18780 1 < completed delete operation key=65DTZR8A5OHF tag=EE4ZBPEO912S type=del 2024-09-12T00:09:44.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.175+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=KLP1EZUEFIAL type=del size=456947 2024-09-12T00:09:44.175 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.176+0000 7f3dc2c18780 1 < completed write operation key=XNZNORKYEOPV tag=I42VGCPQ602G type=write size=262673 2024-09-12T00:09:44.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.177+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=M3IKAEJCY7QS type=del size=87736 2024-09-12T00:09:44.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.179+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~4EQJHX204S1U.0 size=1048576 2024-09-12T00:09:44.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.180+0000 7f3dc2c18780 1 < completed part key=_multipart_65DTZR8A5OHF.2~4EQJHX204S1U.1 size=390244 2024-09-12T00:09:44.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.182+0000 7f3dc2c18780 1 < completed multipart upload key=65DTZR8A5OHF upload=4EQJHX204S1U tag=B68NIFPCG1HX type=write size=2487396 2024-09-12T00:09:44.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.183+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=48FG7AIM7A59 type=del size=3285405 2024-09-12T00:09:44.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.184+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~WWGD5ERGY0ZE.0 size=1048576 2024-09-12T00:09:44.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.185+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~WWGD5ERGY0ZE.1 size=474169 2024-09-12T00:09:44.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.187+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=WWGD5ERGY0ZE tag=BH4Y6984S0A6 type=write size=2571321 2024-09-12T00:09:44.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.188+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=0QS1FLNEH2P9 type=del size=359843 2024-09-12T00:09:44.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.189+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~YK11EVBBY256.0 size=1048576 2024-09-12T00:09:44.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.190+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~YK11EVBBY256.1 size=1048576 2024-09-12T00:09:44.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.191+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~YK11EVBBY256.2 size=816527 2024-09-12T00:09:44.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.193+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=YK11EVBBY256 tag=YSM87L6MJEZM type=write size=3962255 2024-09-12T00:09:44.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.195+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~0J3UXROW5IDX.0 size=1048576 2024-09-12T00:09:44.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.196+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~0J3UXROW5IDX.1 size=1048576 2024-09-12T00:09:44.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.197+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~0J3UXROW5IDX.2 size=479530 2024-09-12T00:09:44.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.197+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=0J3UXROW5IDX tag=4L2M6O4A4IZH type=write size=3625258 2024-09-12T00:09:44.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.198+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=FZ8NWMS7DIUX type=del 2024-09-12T00:09:44.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.199+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=ZEC0YV59TUS5 type=write size=497227 2024-09-12T00:09:44.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.201+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=C9AUTHS5Y37G type=del 2024-09-12T00:09:44.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.202+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=PC7MJWLX92ZN type=write size=229476 2024-09-12T00:09:44.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.203+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~95IFQ0NNWVVU.0 size=1048576 2024-09-12T00:09:44.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.204+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~95IFQ0NNWVVU.1 size=139976 2024-09-12T00:09:44.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.206+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=95IFQ0NNWVVU tag=HEAW1STAWQLU type=write size=2237128 2024-09-12T00:09:44.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.207+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=5QEBOA4G2OT9 type=del size=1840205 2024-09-12T00:09:44.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.208+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=4ARA1H4WDCO3 type=del 2024-09-12T00:09:44.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.211+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~2VXOASP3L3R7.0 size=1048576 2024-09-12T00:09:44.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.211+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~2VXOASP3L3R7.1 size=1048576 2024-09-12T00:09:44.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.212+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~2VXOASP3L3R7.2 size=177403 2024-09-12T00:09:44.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.212+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=2VXOASP3L3R7 tag=M9KS3SV62VRS type=write size=3323131 2024-09-12T00:09:44.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.215+0000 7f3dc2c18780 1 < suggested update operation key=L9C014T8YLNV tag=2L4V4XMV3KTE type=write size=99075 2024-09-12T00:09:44.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.217+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~HFI78OAH6VZA.0 size=1048576 2024-09-12T00:09:44.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.218+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~HFI78OAH6VZA.1 size=1048576 2024-09-12T00:09:44.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.219+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~HFI78OAH6VZA.2 size=541504 2024-09-12T00:09:44.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.219+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=HFI78OAH6VZA tag=WKNSQ0QQHHCU type=write size=3687232 2024-09-12T00:09:44.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.222+0000 7f3dc2c18780 1 < suggested remove operation key=XNZNORKYEOPV tag=6JLMZBT1HPHK type=del 2024-09-12T00:09:44.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.224+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~6U93RHV0ECBI.0 size=826244 2024-09-12T00:09:44.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.224+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=6U93RHV0ECBI tag=SR0JDCBVRX55 type=write size=1874820 2024-09-12T00:09:44.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.225+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~SKGJVFZQ7UXN.0 size=1048576 2024-09-12T00:09:44.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.226+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~SKGJVFZQ7UXN.1 size=1048576 2024-09-12T00:09:44.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.227+0000 7f3dc2c18780 1 < completed part key=_multipart_XNZNORKYEOPV.2~SKGJVFZQ7UXN.2 size=843068 2024-09-12T00:09:44.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.230+0000 7f3dc2c18780 1 < completed multipart upload key=XNZNORKYEOPV upload=SKGJVFZQ7UXN tag=DJ9TMN6LW49U type=write size=3988796 2024-09-12T00:09:44.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.231+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=01I2U4W63PRU type=del size=2370261 2024-09-12T00:09:44.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.232+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~B0MJ7PHAOZR7.0 size=1048576 2024-09-12T00:09:44.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.233+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~B0MJ7PHAOZR7.1 size=1048576 2024-09-12T00:09:44.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.233+0000 7f3dc2c18780 1 < canceled part key=_multipart_8JFV08DJLXTB.2~B0MJ7PHAOZR7.2 size=670874 2024-09-12T00:09:44.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.236+0000 7f3dc2c18780 1 < canceled multipart upload key=8JFV08DJLXTB upload=B0MJ7PHAOZR7 tag=HCFTHP9H0IXD type=write size=3816602 2024-09-12T00:09:44.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.238+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~OEEM924XUS02.0 size=1048576 2024-09-12T00:09:44.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.239+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~OEEM924XUS02.1 size=1048576 2024-09-12T00:09:44.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.240+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~OEEM924XUS02.2 size=615348 2024-09-12T00:09:44.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.240+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=OEEM924XUS02 tag=RK9I5294RNSV type=write size=3761076 2024-09-12T00:09:44.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.242+0000 7f3dc2c18780 1 < completed write operation key=65DTZR8A5OHF tag=RX3O3UMG8CDD type=write size=411022 2024-09-12T00:09:44.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.244+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=07BDQJJ4NDI0 type=write size=622678 2024-09-12T00:09:44.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.246+0000 7f3dc2c18780 1 < suggested remove operation key=3WUIB2OMX77J tag=LEEJJWYX2Q8K type=write 2024-09-12T00:09:44.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.248+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=JD1MCC6CP79G type=write size=302095 2024-09-12T00:09:44.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.249+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~FOEFC5QFKC32.0 size=1048576 2024-09-12T00:09:44.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.251+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~FOEFC5QFKC32.1 size=1048576 2024-09-12T00:09:44.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.252+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~FOEFC5QFKC32.2 size=11511 2024-09-12T00:09:44.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.254+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=FOEFC5QFKC32 tag=EMA6XMKRR6GJ type=write size=3157239 2024-09-12T00:09:44.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.256+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=9E17E16J2QM5 type=del size=1569335 2024-09-12T00:09:44.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.258+0000 7f3dc2c18780 1 < suggested update operation key=5BM1TMLRBHTS tag=KLP1EZUEFIAL type=del size=456947 2024-09-12T00:09:44.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.261+0000 7f3dc2c18780 1 > prepared part key=_multipart_V0K5FRKYGJ0K.2~BKPXJR99PMRC.0 size=971343 2024-09-12T00:09:44.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.261+0000 7f3dc2c18780 1 > prepared multipart upload key=V0K5FRKYGJ0K upload=BKPXJR99PMRC tag=SAZC1E5EGVR7 type=write size=2019919 2024-09-12T00:09:44.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.263+0000 7f3dc2c18780 1 < suggested remove operation key=QJ3KML910OEL tag=M3IKAEJCY7QS type=del 2024-09-12T00:09:44.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.264+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=GYSIXCPCP445 type=del size=4131058 2024-09-12T00:09:44.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.267+0000 7f3dc2c18780 1 < suggested remove operation key=415OYT4ML329 tag=48FG7AIM7A59 type=del 2024-09-12T00:09:44.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.269+0000 7f3dc2c18780 1 > prepared part key=_multipart_GP3MLWX9586T.2~89WWZVMNJ2YX.0 size=666105 2024-09-12T00:09:44.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.269+0000 7f3dc2c18780 1 > prepared multipart upload key=GP3MLWX9586T upload=89WWZVMNJ2YX tag=8U0P2BNF1VOD type=write size=1714681 2024-09-12T00:09:44.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.270+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=0QS1FLNEH2P9 type=del 2024-09-12T00:09:44.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.271+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=U7HXXSNZBX5B type=write size=675044 2024-09-12T00:09:44.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.272+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~0J3UXROW5IDX.0 size=1048576 2024-09-12T00:09:44.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.275+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~0J3UXROW5IDX.1 size=1048576 2024-09-12T00:09:44.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.276+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~0J3UXROW5IDX.2 size=479530 2024-09-12T00:09:44.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.279+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=0J3UXROW5IDX tag=4L2M6O4A4IZH type=write size=3625258 2024-09-12T00:09:44.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.280+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=MEJT44XN1JSR type=del size=1018082 2024-09-12T00:09:44.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.281+0000 7f3dc2c18780 1 < completed write operation key=2SO8HBZSAMRX tag=ZEC0YV59TUS5 type=write size=497227 2024-09-12T00:09:44.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.283+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=A1ZNXIHXHZLL type=del size=1167371 2024-09-12T00:09:44.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.284+0000 7f3dc2c18780 1 < completed write operation key=5CS98S02F59L tag=PC7MJWLX92ZN type=write size=229476 2024-09-12T00:09:44.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.285+0000 7f3dc2c18780 1 > prepared operation key=WRR6LAYIWOCE tag=MVGWLCKUH42P type=del size=2383771 2024-09-12T00:09:44.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.286+0000 7f3dc2c18780 1 < completed delete operation key=7JVCFTM2QMGY tag=5QEBOA4G2OT9 type=del 2024-09-12T00:09:44.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.288+0000 7f3dc2c18780 1 > prepared operation key=UJDQEIAIRVDW tag=6Q0013YHWM0S type=write size=334551 2024-09-12T00:09:44.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.289+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~2VXOASP3L3R7.0 size=1048576 2024-09-12T00:09:44.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.290+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~2VXOASP3L3R7.1 size=1048576 2024-09-12T00:09:44.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.291+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~2VXOASP3L3R7.2 size=177403 2024-09-12T00:09:44.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.293+0000 7f3dc2c18780 1 < completed multipart upload key=8JFV08DJLXTB upload=2VXOASP3L3R7 tag=M9KS3SV62VRS type=write size=3323131 2024-09-12T00:09:44.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.295+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~VGEB92F9UCPU.0 size=1048576 2024-09-12T00:09:44.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.296+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~VGEB92F9UCPU.1 size=1048576 2024-09-12T00:09:44.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.297+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~VGEB92F9UCPU.2 size=543845 2024-09-12T00:09:44.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.297+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=VGEB92F9UCPU tag=W0BXY7USSRG7 type=write size=3689573 2024-09-12T00:09:44.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.298+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~HFI78OAH6VZA.0 size=1048576 2024-09-12T00:09:44.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.299+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~HFI78OAH6VZA.1 size=1048576 2024-09-12T00:09:44.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.300+0000 7f3dc2c18780 1 < completed part key=_multipart_5BM1TMLRBHTS.2~HFI78OAH6VZA.2 size=541504 2024-09-12T00:09:44.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.302+0000 7f3dc2c18780 1 < completed multipart upload key=5BM1TMLRBHTS upload=HFI78OAH6VZA tag=WKNSQ0QQHHCU type=write size=3687232 2024-09-12T00:09:44.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.303+0000 7f3dc2c18780 1 > prepared operation key=415OYT4ML329 tag=KTWSBJKJMQVB type=del size=3030906 2024-09-12T00:09:44.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.304+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~6U93RHV0ECBI.0 size=826244 2024-09-12T00:09:44.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.306+0000 7f3dc2c18780 1 < completed multipart upload key=WRBBH64CISJZ upload=6U93RHV0ECBI tag=SR0JDCBVRX55 type=write size=1874820 2024-09-12T00:09:44.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.307+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=DOG2VDO2MGSU type=del size=522459 2024-09-12T00:09:44.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.308+0000 7f3dc2c18780 1 < completed delete operation key=XNZNORKYEOPV tag=01I2U4W63PRU type=del 2024-09-12T00:09:44.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.309+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=IIX0M1RHKWDT type=del size=54441 2024-09-12T00:09:44.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.311+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~OEEM924XUS02.0 size=1048576 2024-09-12T00:09:44.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.312+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~OEEM924XUS02.1 size=1048576 2024-09-12T00:09:44.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.313+0000 7f3dc2c18780 1 < completed part key=_multipart_OGRGDIUO2W8B.2~OEEM924XUS02.2 size=615348 2024-09-12T00:09:44.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.315+0000 7f3dc2c18780 1 < completed multipart upload key=OGRGDIUO2W8B upload=OEEM924XUS02 tag=RK9I5294RNSV type=write size=3761076 2024-09-12T00:09:44.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.316+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=A5ZZXL4ZEO9F type=del size=834206 2024-09-12T00:09:44.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.318+0000 7f3dc2c18780 1 < suggested remove operation key=QJ3KML910OEL tag=07BDQJJ4NDI0 type=write 2024-09-12T00:09:44.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.321+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~0B6V0QTE09U2.0 size=370316 2024-09-12T00:09:44.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.321+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=0B6V0QTE09U2 tag=BSVK0BYK7MWJ type=write size=1418892 2024-09-12T00:09:44.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.322+0000 7f3dc2c18780 1 < completed write operation key=25CF1N8J81Y9 tag=JD1MCC6CP79G type=write size=302095 2024-09-12T00:09:44.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.323+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=YYWDMVIJWCDL type=del size=1790653 2024-09-12T00:09:44.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.324+0000 7f3dc2c18780 -1 < failed to complete operation key=415OYT4ML329 tag=9E17E16J2QM5 type=del size=1569335: (22) Invalid argument 2024-09-12T00:09:44.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.327+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~6MYW6ZIP2BB9.0 size=1048576 2024-09-12T00:09:44.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.328+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~6MYW6ZIP2BB9.1 size=856695 2024-09-12T00:09:44.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.328+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=6MYW6ZIP2BB9 tag=47V84R2S6T6K type=write size=2953847 2024-09-12T00:09:44.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.329+0000 7f3dc2c18780 1 < completed part key=_multipart_V0K5FRKYGJ0K.2~BKPXJR99PMRC.0 size=971343 2024-09-12T00:09:44.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.331+0000 7f3dc2c18780 1 < completed multipart upload key=V0K5FRKYGJ0K upload=BKPXJR99PMRC tag=SAZC1E5EGVR7 type=write size=2019919 2024-09-12T00:09:44.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.332+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=U2FV4546UCUF type=del size=1860853 2024-09-12T00:09:44.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.333+0000 7f3dc2c18780 1 < canceled operation key=WRR6LAYIWOCE tag=GYSIXCPCP445 type=del size=4131058 2024-09-12T00:09:44.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.336+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~38CE28FG4JL9.0 size=1048576 2024-09-12T00:09:44.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.337+0000 7f3dc2c18780 1 > prepared part key=_multipart_QJ3KML910OEL.2~38CE28FG4JL9.1 size=753037 2024-09-12T00:09:44.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.337+0000 7f3dc2c18780 1 > prepared multipart upload key=QJ3KML910OEL upload=38CE28FG4JL9 tag=UO4JXG1GEV25 type=write size=2850189 2024-09-12T00:09:44.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.338+0000 7f3dc2c18780 1 < completed part key=_multipart_GP3MLWX9586T.2~89WWZVMNJ2YX.0 size=666105 2024-09-12T00:09:44.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.341+0000 7f3dc2c18780 1 < completed multipart upload key=GP3MLWX9586T upload=89WWZVMNJ2YX tag=8U0P2BNF1VOD type=write size=1714681 2024-09-12T00:09:44.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.342+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=QZWLNLX1JUV8 type=del size=1557647 2024-09-12T00:09:44.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.343+0000 7f3dc2c18780 1 < completed write operation key=Y40G8SLO6AVH tag=U7HXXSNZBX5B type=write size=675044 2024-09-12T00:09:44.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.344+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=PSAYSNJD6VXG type=del size=1185467 2024-09-12T00:09:44.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.346+0000 7f3dc2c18780 1 < canceled operation key=5F0BB9U7Y6ZZ tag=MEJT44XN1JSR type=del size=1018082 2024-09-12T00:09:44.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.347+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=D3P679FXZHP1 type=del size=1512613 2024-09-12T00:09:44.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.348+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=A1ZNXIHXHZLL type=del 2024-09-12T00:09:44.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.351+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~5SVTJQSMDXMC.0 size=1048576 2024-09-12T00:09:44.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.352+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~5SVTJQSMDXMC.1 size=1048576 2024-09-12T00:09:44.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.353+0000 7f3dc2c18780 1 > prepared part key=_multipart_C0JT46SGECP0.2~5SVTJQSMDXMC.2 size=1034714 2024-09-12T00:09:44.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.353+0000 7f3dc2c18780 1 > prepared multipart upload key=C0JT46SGECP0 upload=5SVTJQSMDXMC tag=X5XA5D0LNGHR type=write size=4180442 2024-09-12T00:09:44.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.354+0000 7f3dc2c18780 1 < completed delete operation key=WRR6LAYIWOCE tag=MVGWLCKUH42P type=del 2024-09-12T00:09:44.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.355+0000 7f3dc2c18780 1 > prepared operation key=5MAV2RJ4E31S tag=0ZLNPA71HN2Z type=del size=3447061 2024-09-12T00:09:44.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.357+0000 7f3dc2c18780 1 < completed write operation key=UJDQEIAIRVDW tag=6Q0013YHWM0S type=write size=334551 2024-09-12T00:09:44.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.359+0000 7f3dc2c18780 1 > prepared part key=_multipart_5CS98S02F59L.2~NP66YVO8OQ38.0 size=232853 2024-09-12T00:09:44.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.359+0000 7f3dc2c18780 1 > prepared multipart upload key=5CS98S02F59L upload=NP66YVO8OQ38 tag=8OW3YYBF59IS type=write size=1281429 2024-09-12T00:09:44.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.361+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~VGEB92F9UCPU.0 size=1048576 2024-09-12T00:09:44.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.362+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~VGEB92F9UCPU.1 size=1048576 2024-09-12T00:09:44.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.363+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~VGEB92F9UCPU.2 size=543845 2024-09-12T00:09:44.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.366+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=VGEB92F9UCPU tag=W0BXY7USSRG7 type=write size=3689573 2024-09-12T00:09:44.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.367+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=GSG5V1S2CI56 type=write size=694645 2024-09-12T00:09:44.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.368+0000 7f3dc2c18780 1 < canceled operation key=415OYT4ML329 tag=KTWSBJKJMQVB type=del size=3030906 2024-09-12T00:09:44.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.370+0000 7f3dc2c18780 1 > prepared operation key=V0K5FRKYGJ0K tag=OMJU9V70KH98 type=del size=271171 2024-09-12T00:09:44.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.371+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=DOG2VDO2MGSU type=del 2024-09-12T00:09:44.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.372+0000 7f3dc2c18780 1 > prepared operation key=C7ZOCTAR2BEP tag=SBAR6SYYX3LX type=del size=728355 2024-09-12T00:09:44.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.373+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=IIX0M1RHKWDT type=del 2024-09-12T00:09:44.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.375+0000 7f3dc2c18780 1 > prepared operation key=5F0BB9U7Y6ZZ tag=TJC1C00JARZ3 type=del size=4094093 2024-09-12T00:09:44.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.376+0000 7f3dc2c18780 -1 < failed to complete operation key=QJ3KML910OEL tag=A5ZZXL4ZEO9F type=del size=834206: (22) Invalid argument 2024-09-12T00:09:44.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.377+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=MMRJPT0DMNVW type=del size=2365078 2024-09-12T00:09:44.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.378+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~0B6V0QTE09U2.0 size=370316 2024-09-12T00:09:44.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.380+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=0B6V0QTE09U2 tag=BSVK0BYK7MWJ type=write size=1418892 2024-09-12T00:09:44.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.383+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~4NB0GRIOURJE.0 size=1048576 2024-09-12T00:09:44.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.384+0000 7f3dc2c18780 1 > prepared part key=_multipart_8JFV08DJLXTB.2~4NB0GRIOURJE.1 size=703124 2024-09-12T00:09:44.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.384+0000 7f3dc2c18780 1 > prepared multipart upload key=8JFV08DJLXTB upload=4NB0GRIOURJE tag=H4JYMQ39C2BC type=write size=2800276 2024-09-12T00:09:44.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.385+0000 7f3dc2c18780 1 < canceled operation key=8JFV08DJLXTB tag=YYWDMVIJWCDL type=del size=1790653 2024-09-12T00:09:44.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.386+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=T6BSSSB8XFJB type=del size=1243466 2024-09-12T00:09:44.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.387+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~6MYW6ZIP2BB9.0 size=1048576 2024-09-12T00:09:44.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.388+0000 7f3dc2c18780 1 < completed part key=_multipart_5F0BB9U7Y6ZZ.2~6MYW6ZIP2BB9.1 size=856695 2024-09-12T00:09:44.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.390+0000 7f3dc2c18780 1 < completed multipart upload key=5F0BB9U7Y6ZZ upload=6MYW6ZIP2BB9 tag=47V84R2S6T6K type=write size=2953847 2024-09-12T00:09:44.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.393+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~OR8H1QJ13Z2O.0 size=875066 2024-09-12T00:09:44.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.393+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=OR8H1QJ13Z2O tag=M915I947QVKY type=write size=1923642 2024-09-12T00:09:44.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.396+0000 7f3dc2c18780 1 < suggested update operation key=65DTZR8A5OHF tag=U2FV4546UCUF type=del size=1860853 2024-09-12T00:09:44.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.398+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~UFIWQU7ZW6XV.0 size=1048576 2024-09-12T00:09:44.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.399+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~UFIWQU7ZW6XV.1 size=1048576 2024-09-12T00:09:44.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.400+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~UFIWQU7ZW6XV.2 size=283120 2024-09-12T00:09:44.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.400+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=UFIWQU7ZW6XV tag=6OBTW52ZULEB type=write size=3428848 2024-09-12T00:09:44.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.402+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~38CE28FG4JL9.0 size=1048576 2024-09-12T00:09:44.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.403+0000 7f3dc2c18780 1 < completed part key=_multipart_QJ3KML910OEL.2~38CE28FG4JL9.1 size=753037 2024-09-12T00:09:44.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.405+0000 7f3dc2c18780 1 < completed multipart upload key=QJ3KML910OEL upload=38CE28FG4JL9 tag=UO4JXG1GEV25 type=write size=2850189 2024-09-12T00:09:44.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.406+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=SLK4CSN5CS0G type=write size=664688 2024-09-12T00:09:44.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.409+0000 7f3dc2c18780 1 < suggested remove operation key=5BM1TMLRBHTS tag=QZWLNLX1JUV8 type=del 2024-09-12T00:09:44.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.410+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=43BR5GKBKNRM type=del size=3930798 2024-09-12T00:09:44.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.412+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=PSAYSNJD6VXG type=del 2024-09-12T00:09:44.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.413+0000 7f3dc2c18780 1 > prepared operation key=65DTZR8A5OHF tag=BOFWD62K20RK type=del size=94631 2024-09-12T00:09:44.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.414+0000 7f3dc2c18780 1 < completed delete operation key=KQWXE62PF5F7 tag=D3P679FXZHP1 type=del 2024-09-12T00:09:44.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.416+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~K8R8HDMWQNMN.0 size=1048576 2024-09-12T00:09:44.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.417+0000 7f3dc2c18780 1 > prepared part key=_multipart_L9C014T8YLNV.2~K8R8HDMWQNMN.1 size=330830 2024-09-12T00:09:44.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.417+0000 7f3dc2c18780 1 > prepared multipart upload key=L9C014T8YLNV upload=K8R8HDMWQNMN tag=N041KM1IDB08 type=write size=2427982 2024-09-12T00:09:44.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.419+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~5SVTJQSMDXMC.0 size=1048576 2024-09-12T00:09:44.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.420+0000 7f3dc2c18780 1 < completed part key=_multipart_C0JT46SGECP0.2~5SVTJQSMDXMC.1 size=1048576 2024-09-12T00:09:44.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.420+0000 7f3dc2c18780 1 < canceled part key=_multipart_C0JT46SGECP0.2~5SVTJQSMDXMC.2 size=1034714 2024-09-12T00:09:44.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.422+0000 7f3dc2c18780 1 < canceled multipart upload key=C0JT46SGECP0 upload=5SVTJQSMDXMC tag=X5XA5D0LNGHR type=write size=4180442 2024-09-12T00:09:44.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.423+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=VK587ECRCS0Y type=del size=2136387 2024-09-12T00:09:44.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.424+0000 7f3dc2c18780 1 < completed delete operation key=5MAV2RJ4E31S tag=0ZLNPA71HN2Z type=del 2024-09-12T00:09:44.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.425+0000 7f3dc2c18780 1 > prepared operation key=8JFV08DJLXTB tag=K3RBXOVFOWI8 type=del size=1507290 2024-09-12T00:09:44.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.426+0000 7f3dc2c18780 1 < canceled part key=_multipart_5CS98S02F59L.2~NP66YVO8OQ38.0 size=232853 2024-09-12T00:09:44.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.428+0000 7f3dc2c18780 1 < canceled multipart upload key=5CS98S02F59L upload=NP66YVO8OQ38 tag=8OW3YYBF59IS type=write size=1281429 2024-09-12T00:09:44.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.429+0000 7f3dc2c18780 1 > prepared operation key=XNZNORKYEOPV tag=T0MJJ14TP7WZ type=del size=2920207 2024-09-12T00:09:44.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.431+0000 7f3dc2c18780 1 < completed write operation key=GLAOX3ZNNILD tag=GSG5V1S2CI56 type=write size=694645 2024-09-12T00:09:44.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.433+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~6DABMK40732V.0 size=1048576 2024-09-12T00:09:44.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.434+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~6DABMK40732V.1 size=1048576 2024-09-12T00:09:44.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.435+0000 7f3dc2c18780 1 > prepared part key=_multipart_UJDQEIAIRVDW.2~6DABMK40732V.2 size=957406 2024-09-12T00:09:44.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.435+0000 7f3dc2c18780 1 > prepared multipart upload key=UJDQEIAIRVDW upload=6DABMK40732V tag=01XE9XZ3NO2O type=write size=4103134 2024-09-12T00:09:44.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.436+0000 7f3dc2c18780 1 < completed delete operation key=V0K5FRKYGJ0K tag=OMJU9V70KH98 type=del 2024-09-12T00:09:44.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.437+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=VR2FOLUFI5BC type=write size=720010 2024-09-12T00:09:44.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.438+0000 7f3dc2c18780 1 < completed delete operation key=C7ZOCTAR2BEP tag=SBAR6SYYX3LX type=del 2024-09-12T00:09:44.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.440+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=R23CWOXOE98I type=del size=337255 2024-09-12T00:09:44.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.441+0000 7f3dc2c18780 1 < completed delete operation key=5F0BB9U7Y6ZZ tag=TJC1C00JARZ3 type=del 2024-09-12T00:09:44.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.443+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~D8N8Y0ETZDRJ.0 size=1048576 2024-09-12T00:09:44.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.444+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~D8N8Y0ETZDRJ.1 size=1048576 2024-09-12T00:09:44.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.445+0000 7f3dc2c18780 1 > prepared part key=_multipart_5MAV2RJ4E31S.2~D8N8Y0ETZDRJ.2 size=90565 2024-09-12T00:09:44.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.445+0000 7f3dc2c18780 1 > prepared multipart upload key=5MAV2RJ4E31S upload=D8N8Y0ETZDRJ tag=10DF45MNLD88 type=write size=3236293 2024-09-12T00:09:44.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.446+0000 7f3dc2c18780 1 < completed delete operation key=2SO8HBZSAMRX tag=MMRJPT0DMNVW type=del 2024-09-12T00:09:44.446 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.447+0000 7f3dc2c18780 1 > prepared operation key=0ICU4WV9K1RG tag=T958TNHXFR6M type=del size=527118 2024-09-12T00:09:44.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.448+0000 7f3dc2c18780 1 < canceled part key=_multipart_8JFV08DJLXTB.2~4NB0GRIOURJE.0 size=1048576 2024-09-12T00:09:44.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.449+0000 7f3dc2c18780 1 < completed part key=_multipart_8JFV08DJLXTB.2~4NB0GRIOURJE.1 size=703124 2024-09-12T00:09:44.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.451+0000 7f3dc2c18780 1 < canceled multipart upload key=8JFV08DJLXTB upload=4NB0GRIOURJE tag=H4JYMQ39C2BC type=write size=2800276 2024-09-12T00:09:44.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.453+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~UE702LB1Z3VR.0 size=1048576 2024-09-12T00:09:44.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.454+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~UE702LB1Z3VR.1 size=1048576 2024-09-12T00:09:44.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.455+0000 7f3dc2c18780 1 > prepared part key=_multipart_U2H0A1GZROT7.2~UE702LB1Z3VR.2 size=916547 2024-09-12T00:09:44.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.455+0000 7f3dc2c18780 1 > prepared multipart upload key=U2H0A1GZROT7 upload=UE702LB1Z3VR tag=KV7SQYYE2RCJ type=write size=4062275 2024-09-12T00:09:44.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.457+0000 7f3dc2c18780 1 < suggested update operation key=7JVCFTM2QMGY tag=T6BSSSB8XFJB type=del size=1243466 2024-09-12T00:09:44.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.459+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=IMW4ARQZWHNZ type=del size=792381 2024-09-12T00:09:44.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.460+0000 7f3dc2c18780 1 < completed part key=_multipart_TSL3IDD0EDT0.2~OR8H1QJ13Z2O.0 size=875066 2024-09-12T00:09:44.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.463+0000 7f3dc2c18780 1 < completed multipart upload key=TSL3IDD0EDT0 upload=OR8H1QJ13Z2O tag=M915I947QVKY type=write size=1923642 2024-09-12T00:09:44.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.466+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~AJBPOAOUWRUH.0 size=383675 2024-09-12T00:09:44.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.466+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=AJBPOAOUWRUH tag=GW45MGIL299F type=write size=1432251 2024-09-12T00:09:44.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.467+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~UFIWQU7ZW6XV.0 size=1048576 2024-09-12T00:09:44.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.468+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~UFIWQU7ZW6XV.1 size=1048576 2024-09-12T00:09:44.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.469+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~UFIWQU7ZW6XV.2 size=283120 2024-09-12T00:09:44.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.472+0000 7f3dc2c18780 1 < completed multipart upload key=0ICU4WV9K1RG upload=UFIWQU7ZW6XV tag=6OBTW52ZULEB type=write size=3428848 2024-09-12T00:09:44.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.475+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~BMCW9L34JR0W.0 size=1048576 2024-09-12T00:09:44.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.476+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~BMCW9L34JR0W.1 size=1048576 2024-09-12T00:09:44.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.477+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~BMCW9L34JR0W.2 size=906212 2024-09-12T00:09:44.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.477+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=BMCW9L34JR0W tag=AS7JN8HBNHEN type=write size=4051940 2024-09-12T00:09:44.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.479+0000 7f3dc2c18780 1 < completed write operation key=5CS98S02F59L tag=SLK4CSN5CS0G type=write size=664688 2024-09-12T00:09:44.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.480+0000 7f3dc2c18780 1 > prepared operation key=YYIQC6YL2PSW tag=KZCTD6ZRQI0L type=del size=1129200 2024-09-12T00:09:44.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.482+0000 7f3dc2c18780 1 < completed delete operation key=5BM1TMLRBHTS tag=43BR5GKBKNRM type=del 2024-09-12T00:09:44.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.483+0000 7f3dc2c18780 1 > prepared operation key=GP3MLWX9586T tag=E8IKVJKV9GJ7 type=del size=1730833 2024-09-12T00:09:44.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.484+0000 7f3dc2c18780 1 < canceled operation key=65DTZR8A5OHF tag=BOFWD62K20RK type=del size=94631 2024-09-12T00:09:44.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.486+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=48UI1VDL83KL type=del size=1433000 2024-09-12T00:09:44.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.487+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~K8R8HDMWQNMN.0 size=1048576 2024-09-12T00:09:44.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.488+0000 7f3dc2c18780 1 < completed part key=_multipart_L9C014T8YLNV.2~K8R8HDMWQNMN.1 size=330830 2024-09-12T00:09:44.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.491+0000 7f3dc2c18780 1 < completed multipart upload key=L9C014T8YLNV upload=K8R8HDMWQNMN tag=N041KM1IDB08 type=write size=2427982 2024-09-12T00:09:44.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.492+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=H6EULJUDA47X type=del size=1565620 2024-09-12T00:09:44.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.493+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=VK587ECRCS0Y type=del 2024-09-12T00:09:44.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.495+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~YI46TI5JLFKQ.0 size=1048576 2024-09-12T00:09:44.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.496+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~YI46TI5JLFKQ.1 size=1048576 2024-09-12T00:09:44.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.497+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~YI46TI5JLFKQ.2 size=852361 2024-09-12T00:09:44.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.497+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=YI46TI5JLFKQ tag=TA407FRL0CK5 type=write size=3998089 2024-09-12T00:09:44.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.499+0000 7f3dc2c18780 1 < completed delete operation key=8JFV08DJLXTB tag=K3RBXOVFOWI8 type=del 2024-09-12T00:09:44.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.500+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=6B0Q0SVW12QJ type=del size=1069485 2024-09-12T00:09:44.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.502+0000 7f3dc2c18780 1 < suggested update operation key=XNZNORKYEOPV tag=T0MJJ14TP7WZ type=del size=2920207 2024-09-12T00:09:44.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.504+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRR6LAYIWOCE.2~DXFP2ZFPT2V9.0 size=656204 2024-09-12T00:09:44.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.504+0000 7f3dc2c18780 1 > prepared multipart upload key=WRR6LAYIWOCE upload=DXFP2ZFPT2V9 tag=W8DRFYYFGBZN type=write size=1704780 2024-09-12T00:09:44.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.506+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~6DABMK40732V.0 size=1048576 2024-09-12T00:09:44.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.507+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~6DABMK40732V.1 size=1048576 2024-09-12T00:09:44.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.508+0000 7f3dc2c18780 1 < completed part key=_multipart_UJDQEIAIRVDW.2~6DABMK40732V.2 size=957406 2024-09-12T00:09:44.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.510+0000 7f3dc2c18780 1 < completed multipart upload key=UJDQEIAIRVDW upload=6DABMK40732V tag=01XE9XZ3NO2O type=write size=4103134 2024-09-12T00:09:44.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.511+0000 7f3dc2c18780 1 > prepared operation key=2SO8HBZSAMRX tag=OC77730M09U0 type=del size=3758771 2024-09-12T00:09:44.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.514+0000 7f3dc2c18780 1 < completed write operation key=YYIQC6YL2PSW tag=VR2FOLUFI5BC type=write size=720010 2024-09-12T00:09:44.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.516+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=UN3T9FN32LT0 type=write size=1046482 2024-09-12T00:09:44.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.518+0000 7f3dc2c18780 1 < suggested update operation key=KQWXE62PF5F7 tag=R23CWOXOE98I type=del size=337255 2024-09-12T00:09:44.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.520+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~L0LW6RZMXSMJ.0 size=1048576 2024-09-12T00:09:44.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.521+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~L0LW6RZMXSMJ.1 size=1048576 2024-09-12T00:09:44.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.523+0000 7f3dc2c18780 1 > prepared part key=_multipart_KDHO7IEGICDA.2~L0LW6RZMXSMJ.2 size=363049 2024-09-12T00:09:44.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.523+0000 7f3dc2c18780 1 > prepared multipart upload key=KDHO7IEGICDA upload=L0LW6RZMXSMJ tag=CL4SCWQBAKMA type=write size=3508777 2024-09-12T00:09:44.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.524+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~D8N8Y0ETZDRJ.0 size=1048576 2024-09-12T00:09:44.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.525+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~D8N8Y0ETZDRJ.1 size=1048576 2024-09-12T00:09:44.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.526+0000 7f3dc2c18780 1 < completed part key=_multipart_5MAV2RJ4E31S.2~D8N8Y0ETZDRJ.2 size=90565 2024-09-12T00:09:44.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.528+0000 7f3dc2c18780 1 < completed multipart upload key=5MAV2RJ4E31S upload=D8N8Y0ETZDRJ tag=10DF45MNLD88 type=write size=3236293 2024-09-12T00:09:44.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.530+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~RY0ADE5ECWMI.0 size=1048576 2024-09-12T00:09:44.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.531+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~RY0ADE5ECWMI.1 size=1048576 2024-09-12T00:09:44.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.532+0000 7f3dc2c18780 1 > prepared part key=_multipart_WRBBH64CISJZ.2~RY0ADE5ECWMI.2 size=389447 2024-09-12T00:09:44.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.532+0000 7f3dc2c18780 1 > prepared multipart upload key=WRBBH64CISJZ upload=RY0ADE5ECWMI tag=ERM5RX3PE5RY type=write size=3535175 2024-09-12T00:09:44.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.534+0000 7f3dc2c18780 1 < suggested update operation key=0ICU4WV9K1RG tag=T958TNHXFR6M type=del size=527118 2024-09-12T00:09:44.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.536+0000 7f3dc2c18780 1 > prepared operation key=U2H0A1GZROT7 tag=WNDJ1Y6IKBMO type=del size=17588 2024-09-12T00:09:44.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.537+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~UE702LB1Z3VR.0 size=1048576 2024-09-12T00:09:44.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.538+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~UE702LB1Z3VR.1 size=1048576 2024-09-12T00:09:44.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.539+0000 7f3dc2c18780 1 < completed part key=_multipart_U2H0A1GZROT7.2~UE702LB1Z3VR.2 size=916547 2024-09-12T00:09:44.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.541+0000 7f3dc2c18780 1 < completed multipart upload key=U2H0A1GZROT7 upload=UE702LB1Z3VR tag=KV7SQYYE2RCJ type=write size=4062275 2024-09-12T00:09:44.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.543+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~XN7XGPJXFPXQ.0 size=1048576 2024-09-12T00:09:44.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.544+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~XN7XGPJXFPXQ.1 size=1048576 2024-09-12T00:09:44.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.545+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~XN7XGPJXFPXQ.2 size=179321 2024-09-12T00:09:44.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.545+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=XN7XGPJXFPXQ tag=6V4U0DR9Z2AV type=write size=3325049 2024-09-12T00:09:44.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.546+0000 7f3dc2c18780 1 < completed delete operation key=TSL3IDD0EDT0 tag=IMW4ARQZWHNZ type=del 2024-09-12T00:09:44.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.547+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=BZ93UAXIA6L8 type=del size=3920854 2024-09-12T00:09:44.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.549+0000 7f3dc2c18780 1 < completed part key=_multipart_2SO8HBZSAMRX.2~AJBPOAOUWRUH.0 size=383675 2024-09-12T00:09:44.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.551+0000 7f3dc2c18780 1 < completed multipart upload key=2SO8HBZSAMRX upload=AJBPOAOUWRUH tag=GW45MGIL299F type=write size=1432251 2024-09-12T00:09:44.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.552+0000 7f3dc2c18780 1 > prepared operation key=GLAOX3ZNNILD tag=ZPMBMZ2O42PL type=del size=1622819 2024-09-12T00:09:44.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.552+0000 7f3dc2c18780 1 < canceled part key=_multipart_0ICU4WV9K1RG.2~BMCW9L34JR0W.0 size=1048576 2024-09-12T00:09:44.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.553+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~BMCW9L34JR0W.1 size=1048576 2024-09-12T00:09:44.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.554+0000 7f3dc2c18780 1 < completed part key=_multipart_0ICU4WV9K1RG.2~BMCW9L34JR0W.2 size=906212 2024-09-12T00:09:44.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.556+0000 7f3dc2c18780 1 < canceled multipart upload key=0ICU4WV9K1RG upload=BMCW9L34JR0W tag=AS7JN8HBNHEN type=write size=4051940 2024-09-12T00:09:44.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.558+0000 7f3dc2c18780 1 > prepared operation key=5CS98S02F59L tag=YOLOSN3ORYK0 type=del size=3889317 2024-09-12T00:09:44.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.559+0000 7f3dc2c18780 1 < completed delete operation key=YYIQC6YL2PSW tag=KZCTD6ZRQI0L type=del 2024-09-12T00:09:44.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.560+0000 7f3dc2c18780 1 > prepared operation key=3WUIB2OMX77J tag=44FAC63KZQDM type=del size=4003804 2024-09-12T00:09:44.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.561+0000 7f3dc2c18780 1 < completed delete operation key=GP3MLWX9586T tag=E8IKVJKV9GJ7 type=del 2024-09-12T00:09:44.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.564+0000 7f3dc2c18780 1 > prepared part key=_multipart_GLAOX3ZNNILD.2~1RVL83GA4NJB.0 size=135544 2024-09-12T00:09:44.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.564+0000 7f3dc2c18780 1 > prepared multipart upload key=GLAOX3ZNNILD upload=1RVL83GA4NJB tag=AQO8EAWNT2D4 type=write size=1184120 2024-09-12T00:09:44.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.565+0000 7f3dc2c18780 1 < completed delete operation key=25CF1N8J81Y9 tag=48UI1VDL83KL type=del 2024-09-12T00:09:44.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.567+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~9PREC8H4JCVP.0 size=1048576 2024-09-12T00:09:44.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.568+0000 7f3dc2c18780 1 > prepared part key=_multipart_KQWXE62PF5F7.2~9PREC8H4JCVP.1 size=684362 2024-09-12T00:09:44.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.568+0000 7f3dc2c18780 1 > prepared multipart upload key=KQWXE62PF5F7 upload=9PREC8H4JCVP tag=QMAVFT9L4B1F type=write size=2781514 2024-09-12T00:09:44.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.569+0000 7f3dc2c18780 1 < canceled operation key=25CF1N8J81Y9 tag=H6EULJUDA47X type=del size=1565620 2024-09-12T00:09:44.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.572+0000 7f3dc2c18780 1 > prepared part key=_multipart_415OYT4ML329.2~X1KCUMQMOG3A.0 size=144607 2024-09-12T00:09:44.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.572+0000 7f3dc2c18780 1 > prepared multipart upload key=415OYT4ML329 upload=X1KCUMQMOG3A tag=5B9IT55WCEGS type=write size=1193183 2024-09-12T00:09:44.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.573+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~YI46TI5JLFKQ.0 size=1048576 2024-09-12T00:09:44.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.574+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~YI46TI5JLFKQ.1 size=1048576 2024-09-12T00:09:44.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.575+0000 7f3dc2c18780 1 < completed part key=_multipart_25CF1N8J81Y9.2~YI46TI5JLFKQ.2 size=852361 2024-09-12T00:09:44.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.577+0000 7f3dc2c18780 1 < completed multipart upload key=25CF1N8J81Y9 upload=YI46TI5JLFKQ tag=TA407FRL0CK5 type=write size=3998089 2024-09-12T00:09:44.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.580+0000 7f3dc2c18780 1 > prepared part key=_multipart_Y40G8SLO6AVH.2~UPXWUSDHUXTH.0 size=810283 2024-09-12T00:09:44.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.580+0000 7f3dc2c18780 1 > prepared multipart upload key=Y40G8SLO6AVH upload=UPXWUSDHUXTH tag=L936RX5VSGUQ type=write size=1858859 2024-09-12T00:09:44.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.581+0000 7f3dc2c18780 1 < canceled operation key=OGRGDIUO2W8B tag=6B0Q0SVW12QJ type=del size=1069485 2024-09-12T00:09:44.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.582+0000 7f3dc2c18780 1 > prepared operation key=TSL3IDD0EDT0 tag=AFZHSVW8CKA3 type=write size=438796 2024-09-12T00:09:44.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.583+0000 7f3dc2c18780 1 < completed part key=_multipart_WRR6LAYIWOCE.2~DXFP2ZFPT2V9.0 size=656204 2024-09-12T00:09:44.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.585+0000 7f3dc2c18780 1 < completed multipart upload key=WRR6LAYIWOCE upload=DXFP2ZFPT2V9 tag=W8DRFYYFGBZN type=write size=1704780 2024-09-12T00:09:44.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.586+0000 7f3dc2c18780 1 > prepared operation key=4POD73U0LAC0 tag=TNZL0BDLDRNZ type=del size=3644203 2024-09-12T00:09:44.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.589+0000 7f3dc2c18780 1 < suggested update operation key=2SO8HBZSAMRX tag=OC77730M09U0 type=del size=3758771 2024-09-12T00:09:44.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.590+0000 7f3dc2c18780 1 > prepared operation key=OGRGDIUO2W8B tag=8MDB88NWXEYC type=del size=3095331 2024-09-12T00:09:44.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.591+0000 7f3dc2c18780 1 < canceled operation key=5CS98S02F59L tag=UN3T9FN32LT0 type=write size=1046482 2024-09-12T00:09:44.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.592+0000 7f3dc2c18780 1 > prepared operation key=5BM1TMLRBHTS tag=3X3YOGGMKQ76 type=write size=461307 2024-09-12T00:09:44.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.594+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~L0LW6RZMXSMJ.0 size=1048576 2024-09-12T00:09:44.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.595+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~L0LW6RZMXSMJ.1 size=1048576 2024-09-12T00:09:44.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.596+0000 7f3dc2c18780 1 < completed part key=_multipart_KDHO7IEGICDA.2~L0LW6RZMXSMJ.2 size=363049 2024-09-12T00:09:44.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.598+0000 7f3dc2c18780 1 < completed multipart upload key=KDHO7IEGICDA upload=L0LW6RZMXSMJ tag=CL4SCWQBAKMA type=write size=3508777 2024-09-12T00:09:44.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.600+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~1OM3YEPETL4Z.0 size=1048576 2024-09-12T00:09:44.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.601+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~1OM3YEPETL4Z.1 size=657177 2024-09-12T00:09:44.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.601+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=1OM3YEPETL4Z tag=FLUVRIY0RBYU type=write size=2754329 2024-09-12T00:09:44.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.603+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~RY0ADE5ECWMI.0 size=1048576 2024-09-12T00:09:44.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.603+0000 7f3dc2c18780 1 < canceled part key=_multipart_WRBBH64CISJZ.2~RY0ADE5ECWMI.1 size=1048576 2024-09-12T00:09:44.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.604+0000 7f3dc2c18780 1 < completed part key=_multipart_WRBBH64CISJZ.2~RY0ADE5ECWMI.2 size=389447 2024-09-12T00:09:44.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.606+0000 7f3dc2c18780 1 < canceled multipart upload key=WRBBH64CISJZ upload=RY0ADE5ECWMI tag=ERM5RX3PE5RY type=write size=3535175 2024-09-12T00:09:44.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.608+0000 7f3dc2c18780 1 > prepared part key=_multipart_5BM1TMLRBHTS.2~H5N7UZS7L94Q.0 size=794495 2024-09-12T00:09:44.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.608+0000 7f3dc2c18780 1 > prepared multipart upload key=5BM1TMLRBHTS upload=H5N7UZS7L94Q tag=E6FPGERJAE6K type=write size=1843071 2024-09-12T00:09:44.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.609+0000 7f3dc2c18780 1 < completed delete operation key=U2H0A1GZROT7 tag=WNDJ1Y6IKBMO type=del 2024-09-12T00:09:44.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.611+0000 7f3dc2c18780 1 > prepared operation key=QJ3KML910OEL tag=LTAW5NBDJWG5 type=del size=3690101 2024-09-12T00:09:44.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.612+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~XN7XGPJXFPXQ.0 size=1048576 2024-09-12T00:09:44.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.613+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~XN7XGPJXFPXQ.1 size=1048576 2024-09-12T00:09:44.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.614+0000 7f3dc2c18780 1 < completed part key=_multipart_YYIQC6YL2PSW.2~XN7XGPJXFPXQ.2 size=179321 2024-09-12T00:09:44.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.616+0000 7f3dc2c18780 1 < completed multipart upload key=YYIQC6YL2PSW upload=XN7XGPJXFPXQ tag=6V4U0DR9Z2AV type=write size=3325049 2024-09-12T00:09:44.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.618+0000 7f3dc2c18780 1 > prepared part key=_multipart_0ICU4WV9K1RG.2~I9062LWJS9VY.0 size=394987 2024-09-12T00:09:44.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.618+0000 7f3dc2c18780 1 > prepared multipart upload key=0ICU4WV9K1RG upload=I9062LWJS9VY tag=SLZJ1OIVTPN8 type=write size=1443563 2024-09-12T00:09:44.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.621+0000 7f3dc2c18780 1 < suggested remove operation key=Y40G8SLO6AVH tag=BZ93UAXIA6L8 type=del 2024-09-12T00:09:44.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.622+0000 7f3dc2c18780 1 > prepared operation key=Y40G8SLO6AVH tag=8BO7KOXPXP0U type=write size=730951 2024-09-12T00:09:44.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.624+0000 7f3dc2c18780 1 < suggested remove operation key=GLAOX3ZNNILD tag=ZPMBMZ2O42PL type=del 2024-09-12T00:09:44.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.627+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~EQ4UFUF4CL5X.0 size=1048576 2024-09-12T00:09:44.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.629+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~EQ4UFUF4CL5X.1 size=1048576 2024-09-12T00:09:44.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.630+0000 7f3dc2c18780 1 > prepared part key=_multipart_25CF1N8J81Y9.2~EQ4UFUF4CL5X.2 size=194564 2024-09-12T00:09:44.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.630+0000 7f3dc2c18780 1 > prepared multipart upload key=25CF1N8J81Y9 upload=EQ4UFUF4CL5X tag=BGQ1WOI0TWOL type=write size=3340292 2024-09-12T00:09:44.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.631+0000 7f3dc2c18780 1 < completed delete operation key=5CS98S02F59L tag=YOLOSN3ORYK0 type=del 2024-09-12T00:09:44.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.632+0000 7f3dc2c18780 1 > prepared operation key=7JVCFTM2QMGY tag=D4U8QH7ICG36 type=del size=3466239 2024-09-12T00:09:44.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.634+0000 7f3dc2c18780 1 < completed delete operation key=3WUIB2OMX77J tag=44FAC63KZQDM type=del 2024-09-12T00:09:44.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.636+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~7OTY2AXT2YZE.0 size=1048576 2024-09-12T00:09:44.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.637+0000 7f3dc2c18780 1 > prepared part key=_multipart_3WUIB2OMX77J.2~7OTY2AXT2YZE.1 size=732541 2024-09-12T00:09:44.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.637+0000 7f3dc2c18780 1 > prepared multipart upload key=3WUIB2OMX77J upload=7OTY2AXT2YZE tag=YUBD0QAN97A5 type=write size=2829693 2024-09-12T00:09:44.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.638+0000 7f3dc2c18780 1 < completed part key=_multipart_GLAOX3ZNNILD.2~1RVL83GA4NJB.0 size=135544 2024-09-12T00:09:44.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.640+0000 7f3dc2c18780 1 < completed multipart upload key=GLAOX3ZNNILD upload=1RVL83GA4NJB tag=AQO8EAWNT2D4 type=write size=1184120 2024-09-12T00:09:44.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.642+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~ILGGAUH0NKBP.0 size=1048576 2024-09-12T00:09:44.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.643+0000 7f3dc2c18780 1 > prepared part key=_multipart_C7ZOCTAR2BEP.2~ILGGAUH0NKBP.1 size=289969 2024-09-12T00:09:44.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.643+0000 7f3dc2c18780 1 > prepared multipart upload key=C7ZOCTAR2BEP upload=ILGGAUH0NKBP tag=2D8M51BSAHZE type=write size=2387121 2024-09-12T00:09:44.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.644+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~9PREC8H4JCVP.0 size=1048576 2024-09-12T00:09:44.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.645+0000 7f3dc2c18780 1 < completed part key=_multipart_KQWXE62PF5F7.2~9PREC8H4JCVP.1 size=684362 2024-09-12T00:09:44.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.647+0000 7f3dc2c18780 1 < completed multipart upload key=KQWXE62PF5F7 upload=9PREC8H4JCVP tag=QMAVFT9L4B1F type=write size=2781514 2024-09-12T00:09:44.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.649+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~9HYOE8YXGMFB.0 size=1048576 2024-09-12T00:09:44.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.650+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~9HYOE8YXGMFB.1 size=1048576 2024-09-12T00:09:44.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.651+0000 7f3dc2c18780 1 > prepared part key=_multipart_OGRGDIUO2W8B.2~9HYOE8YXGMFB.2 size=729087 2024-09-12T00:09:44.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.651+0000 7f3dc2c18780 1 > prepared multipart upload key=OGRGDIUO2W8B upload=9HYOE8YXGMFB tag=K77T9YQQVL0R type=write size=3874815 2024-09-12T00:09:44.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.653+0000 7f3dc2c18780 1 < completed part key=_multipart_415OYT4ML329.2~X1KCUMQMOG3A.0 size=144607 2024-09-12T00:09:44.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.655+0000 7f3dc2c18780 1 < completed multipart upload key=415OYT4ML329 upload=X1KCUMQMOG3A tag=5B9IT55WCEGS type=write size=1193183 2024-09-12T00:09:44.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.657+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~6Z4K4UNWGQKJ.0 size=1048576 2024-09-12T00:09:44.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.658+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~6Z4K4UNWGQKJ.1 size=13787 2024-09-12T00:09:44.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.658+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=6Z4K4UNWGQKJ tag=IO5341NH9XAU type=write size=2110939 2024-09-12T00:09:44.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.661+0000 7f3dc2c18780 1 < completed part key=_multipart_Y40G8SLO6AVH.2~UPXWUSDHUXTH.0 size=810283 2024-09-12T00:09:44.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.663+0000 7f3dc2c18780 1 < completed multipart upload key=Y40G8SLO6AVH upload=UPXWUSDHUXTH tag=L936RX5VSGUQ type=write size=1858859 2024-09-12T00:09:44.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.665+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~QGTTWYEXVKFW.0 size=1048576 2024-09-12T00:09:44.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.666+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~QGTTWYEXVKFW.1 size=1048576 2024-09-12T00:09:44.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.667+0000 7f3dc2c18780 1 > prepared part key=_multipart_5F0BB9U7Y6ZZ.2~QGTTWYEXVKFW.2 size=542951 2024-09-12T00:09:44.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.667+0000 7f3dc2c18780 1 > prepared multipart upload key=5F0BB9U7Y6ZZ upload=QGTTWYEXVKFW tag=3KY5Y4AHRFRK type=write size=3688679 2024-09-12T00:09:44.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.669+0000 7f3dc2c18780 1 < canceled operation key=TSL3IDD0EDT0 tag=AFZHSVW8CKA3 type=write size=438796 2024-09-12T00:09:44.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.670+0000 7f3dc2c18780 1 > prepared operation key=25CF1N8J81Y9 tag=PZPZHNVPGL2W type=del size=2656723 2024-09-12T00:09:44.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.672+0000 7f3dc2c18780 1 < completed delete operation key=4POD73U0LAC0 tag=TNZL0BDLDRNZ type=del 2024-09-12T00:09:44.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.673+0000 7f3dc2c18780 1 > prepared operation key=KQWXE62PF5F7 tag=92JN5VJAS02E type=del size=2318301 2024-09-12T00:09:44.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.674+0000 7f3dc2c18780 1 < completed delete operation key=OGRGDIUO2W8B tag=8MDB88NWXEYC type=del 2024-09-12T00:09:44.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.677+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~K047UT0HK8DN.0 size=1048576 2024-09-12T00:09:44.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.678+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~K047UT0HK8DN.1 size=1048576 2024-09-12T00:09:44.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.679+0000 7f3dc2c18780 1 > prepared part key=_multipart_2SO8HBZSAMRX.2~K047UT0HK8DN.2 size=955918 2024-09-12T00:09:44.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.679+0000 7f3dc2c18780 1 > prepared multipart upload key=2SO8HBZSAMRX upload=K047UT0HK8DN tag=RR0QYF8CIQ0R type=write size=4101646 2024-09-12T00:09:44.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.680+0000 7f3dc2c18780 1 < completed write operation key=5BM1TMLRBHTS tag=3X3YOGGMKQ76 type=write size=461307 2024-09-12T00:09:44.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.682+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~O468DHP3GCRH.0 size=1048576 2024-09-12T00:09:44.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.683+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~O468DHP3GCRH.1 size=1048576 2024-09-12T00:09:44.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.684+0000 7f3dc2c18780 1 > prepared part key=_multipart_YYIQC6YL2PSW.2~O468DHP3GCRH.2 size=598409 2024-09-12T00:09:44.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.684+0000 7f3dc2c18780 1 > prepared multipart upload key=YYIQC6YL2PSW upload=O468DHP3GCRH tag=B7G5BBK7ZJTA type=write size=3744137 2024-09-12T00:09:44.684 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.685+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~1OM3YEPETL4Z.0 size=1048576 2024-09-12T00:09:44.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.686+0000 7f3dc2c18780 1 < completed part key=_multipart_3WUIB2OMX77J.2~1OM3YEPETL4Z.1 size=657177 2024-09-12T00:09:44.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.688+0000 7f3dc2c18780 1 < completed multipart upload key=3WUIB2OMX77J upload=1OM3YEPETL4Z tag=FLUVRIY0RBYU type=write size=2754329 2024-09-12T00:09:44.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.690+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~8EN2CV08XWJX.0 size=1048576 2024-09-12T00:09:44.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.691+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~8EN2CV08XWJX.1 size=1048576 2024-09-12T00:09:44.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.692+0000 7f3dc2c18780 1 > prepared part key=_multipart_TSL3IDD0EDT0.2~8EN2CV08XWJX.2 size=895272 2024-09-12T00:09:44.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:09:44.692+0000 7f3dc2c18780 1 > prepared multipart upload key=TSL3IDD0EDT0 upload=8EN2CV08XWJX tag=1UMCM8H9XUQM type=write size=4041000 2024-09-12T00:09:44.691 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] cls_rgw_stats.simulate (9679 ms) 2024-09-12T00:09:44.691 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from cls_rgw_stats (9679 ms total) 2024-09-12T00:09:44.691 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:09:44.691 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:45.031 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 1 test from 1 test suite ran. (11886 ms total) 2024-09-12T00:09:45.031 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 1 test. 2024-09-12T00:09:45.035 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:09:45.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:09:45.126 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:09:45.127 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:09:45.127 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:09:45.217 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2024-09-12T00:09:45.221 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:09:45.221 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:47.067 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:09:47.067 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:09:47.073 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (7 ms) 2024-09-12T00:09:47.210 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:09:47.211 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (8 ms) 2024-09-12T00:09:47.211 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:09:47.211 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_str (8 ms) 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (5 ms) 2024-09-12T00:09:47.212 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:09:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-12T00:09:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:09:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:09:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:09:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-12T00:09:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:09:47.331 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (210 ms) 2024-09-12T00:09:47.331 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:09:47.340 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (9 ms) 2024-09-12T00:09:47.340 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:09:47.348 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-12T00:09:47.348 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:09:47.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (9 ms) 2024-09-12T00:09:47.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:09:47.365 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2024-09-12T00:09:47.365 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:09:47.376 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (11 ms) 2024-09-12T00:09:47.376 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:09:47.380 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (4 ms) 2024-09-12T00:09:47.380 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:09:47.383 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T00:09:47.383 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:09:47.384 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T00:09:47.384 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:09:47.384 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T00:09:47.384 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:09:47.392 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-12T00:09:47.392 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:09:47.399 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-12T00:09:47.399 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:09:47.407 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2024-09-12T00:09:47.407 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:09:47.416 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2024-09-12T00:09:47.416 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:09:47.418 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (3 ms) 2024-09-12T00:09:47.419 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:09:47.421 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T00:09:47.421 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:09:47.422 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T00:09:47.422 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:09:47.423 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-12T00:09:47.423 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:09:47.431 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-12T00:09:47.431 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 31 tests from CmpOmap (364 ms total) 2024-09-12T00:09:47.432 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:09:47.432 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:48.067 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 31 tests from 1 test suite ran. (2850 ms total) 2024-09-12T00:09:48.067 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 31 tests. 2024-09-12T00:09:48.070 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:09:48.070 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:09:48.115 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:09:48.117 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:09:48.117 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:09:48.165 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2024-09-12T00:09:48.165 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:09:48.165 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:48.165 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:09:48.165 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:09:51.085 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2920 ms) 2024-09-12T00:09:51.086 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:09:54.112 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3027 ms) 2024-09-12T00:09:54.112 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:09:57.127 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Reserve (3015 ms) 2024-09-12T00:09:57.127 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:10:00.167 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3040 ms) 2024-09-12T00:10:00.167 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:10:04.192 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Commit (4025 ms) 2024-09-12T00:10:04.192 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:10:07.207 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Stats (3015 ms) 2024-09-12T00:10:07.207 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:10:11.226 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4019 ms) 2024-09-12T00:10:11.226 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:10:14.258 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Abort (3030 ms) 2024-09-12T00:10:14.258 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:10:17.276 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ReserveError (3020 ms) 2024-09-12T00:10:17.276 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:10:20.293 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.CommitError (3016 ms) 2024-09-12T00:10:20.294 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:10:23.326 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.AbortError (3034 ms) 2024-09-12T00:10:23.327 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:10:26.355 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3029 ms) 2024-09-12T00:10:26.355 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:10:29.358 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3003 ms) 2024-09-12T00:10:29.359 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:10:32.396 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3038 ms) 2024-09-12T00:10:32.396 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:10:35.417 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3021 ms) 2024-09-12T00:10:35.418 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:10:38.449 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3032 ms) 2024-09-12T00:10:38.449 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:10:41.453 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3004 ms) 2024-09-12T00:10:41.454 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:10:44.501 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Cleanup (3043 ms) 2024-09-12T00:10:44.502 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:10:54.951 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10455 ms) 2024-09-12T00:10:54.952 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:10:57.991 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3038 ms) 2024-09-12T00:10:57.991 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:11:11.106 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13116 ms) 2024-09-12T00:11:11.106 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:11:15.127 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4019 ms) 2024-09-12T00:11:15.127 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:11:21.167 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6043 ms) 2024-09-12T00:11:21.167 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:11:26.202 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5035 ms) 2024-09-12T00:11:26.203 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 24 tests from TestCls2PCQueue (98037 ms total) 2024-09-12T00:11:26.203 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:11:26.203 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:11:26.203 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 24 tests from 1 test suite ran. (98037 ms total) 2024-09-12T00:11:26.203 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 24 tests. 2024-09-12T00:11:26.206 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:11:26.206 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:11:26.253 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:11:26.254 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:11:26.254 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:11:26.311 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:26.311 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:26.311 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:11:26.311 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:11:28.198 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:11:28.198 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:11:28.223 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsAccount.add (25 ms) 2024-09-12T00:11:28.223 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:11:28.228 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-12T00:11:28.228 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:11:28.398 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsAccount.rm (170 ms) 2024-09-12T00:11:28.398 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:11:28.418 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ClsAccount.list (20 ms) 2024-09-12T00:11:28.418 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 4 tests from ClsAccount (220 ms total) 2024-09-12T00:11:28.418 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:11:28.418 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:11:29.200 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 4 tests from 1 test suite ran. (2889 ms total) 2024-09-12T00:11:29.200 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 4 tests. 2024-09-12T00:11:29.204 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:11:29.204 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:11:29.249 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:11:29.250 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:11:29.251 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:11:29.306 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:29.307 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:29.307 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:11:29.307 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:11:31.212 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:11:31.213 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:11:31.230 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] rgw_gc_log.init_existing_queue (18 ms) 2024-09-12T00:11:31.230 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:11:31.233 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T00:11:31.233 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:11:31.237 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (4 ms) 2024-09-12T00:11:31.237 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:11:31.238 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-12T00:11:31.238 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:11:31.241 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T00:11:31.241 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:11:31.243 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T00:11:31.243 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 6 tests from rgw_gc_log (31 ms total) 2024-09-12T00:11:31.243 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:11:31.243 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:11:32.216 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 6 tests from 1 test suite ran. (2909 ms total) 2024-09-12T00:11:32.216 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 6 tests. 2024-09-12T00:11:32.219 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:11:32.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:11:32.266 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:11:32.267 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:11:32.267 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:11:32.329 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns= i= 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns= i= 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.330 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns= i= 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "obj1": { 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.331 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: "obj2": { 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.332 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.333 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3": { 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.334 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3-2": { 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.335 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.336 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns=ns i= 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns=ns i= 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns=ns i= 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout: "obj1": { 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.337 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.338 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "obj2": { 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.339 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3": { 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.340 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.341 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.341 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.341 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.341 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.341 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.341 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.341 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.341 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3-2": { 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.345 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.346 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns= i=v1 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns= i=v1 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns= i=v1 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout: "obj1": { 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.347 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.348 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "obj2": { 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.349 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3": { 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.350 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.351 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3-2": { 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.352 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.353 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: _obj[v1] 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout: "obj1": { 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.354 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.355 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "obj2": { 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.356 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.357 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3": { 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.358 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3-2": { 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.359 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_obj", 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.360 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns= i= 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns= i= 2024-09-12T00:11:32.361 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns= i= 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "obj1": { 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.362 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "obj2": { 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.363 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3": { 2024-09-12T00:11:32.364 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.365 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3-2": { 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.366 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns=ns i= 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns=ns i= 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.367 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns=ns i= 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "obj1": { 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.368 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "obj2": { 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.369 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.370 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3": { 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.371 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3-2": { 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.372 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.373 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns= i=v1 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns= i=v1 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns= i=v1 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout: "obj1": { 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.374 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.375 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "obj2": { 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.376 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3": { 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.377 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.378 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3-2": { 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.379 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.380 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:parsed: obj[v1] 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout: "obj1": { 2024-09-12T00:11:32.381 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.382 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "obj2": { 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.383 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3": { 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.384 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.385 INFO:tasks.workunit.client.0.smithi033.stdout: "obj3-2": { 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "obj", 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "v1", 2024-09-12T00:11:32.386 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.387 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.387 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.387 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.387 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:11:32.387 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:11:32.387 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.387 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.387 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.388 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.388 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.388 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.388 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.388 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.388 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.388 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.388 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.389 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.390 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker_myobj", 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.391 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.392 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.392 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.392 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.392 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.392 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.392 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.392 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.392 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.393 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.394 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.394 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.394 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.394 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.394 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.395 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.396 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker_myobj", 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.397 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.398 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.399 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.399 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.399 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.399 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.399 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.399 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.399 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.400 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.401 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.402 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.403 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.404 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.405 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.406 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.407 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.408 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.409 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.410 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.411 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.412 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.413 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.414 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.415 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.416 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.417 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.418 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.419 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.420 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.421 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:11:32.422 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.423 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.424 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.425 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.426 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker___myobj", 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj" 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.427 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.428 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.429 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.430 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker___myobj", 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj" 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.431 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.432 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.433 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.434 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.435 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.436 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.437 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.438 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.439 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.440 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.441 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.442 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj" 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.443 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.444 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.445 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.446 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj" 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.447 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.448 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.449 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.450 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.451 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.452 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.453 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.454 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.455 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.456 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.457 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.458 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker___myobj_", 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj_" 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.459 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.460 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.461 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.462 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker___myobj_", 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj_" 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.463 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.464 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.465 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.466 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.467 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.468 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.469 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.470 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:11:32.471 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.472 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.473 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.474 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.475 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj_" 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.476 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.477 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.478 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.479 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj_" 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.480 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.481 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.482 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.483 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": "default-placement.data", 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "test", 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.484 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.485 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.485 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.485 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": "", 2024-09-12T00:11:32.485 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.485 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": "" 2024-09-12T00:11:32.485 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.485 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.485 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.486 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "obj": { 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.487 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:11:32.488 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.489 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker_myobj", 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.490 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.491 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker_myobj", 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.492 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.493 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.494 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.495 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.496 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.497 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.498 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.499 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.500 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:11:32.501 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.502 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.503 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.504 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "myobj", 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker___myobj", 2024-09-12T00:11:32.505 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj" 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.506 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker___myobj", 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj" 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.507 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.508 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.509 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.510 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.511 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.512 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj" 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.513 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.514 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj" 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.515 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.516 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.517 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.518 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.519 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj", 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.520 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker___myobj_", 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj_" 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.521 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker___myobj_", 2024-09-12T00:11:32.522 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj_" 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.523 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.524 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.525 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.526 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.527 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "", 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj_" 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.528 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.529 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "marker__myobj_" 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.530 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "" 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.531 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj": { 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj": { 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.532 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:11:32.533 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "raw_obj2": { 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "pool": ".data-pool", 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "loc": "" 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "new_obj2": { 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket": { 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "ebtest", 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "marker": "marker", 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_id": "bucket-id", 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "tenant": "", 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "explicit_placement": { 2024-09-12T00:11:32.534 INFO:tasks.workunit.client.0.smithi033.stdout: "data_pool": ".data-pool", 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: "data_extra_pool": "", 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: "index_pool": ".index-pool" 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: "key": { 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: "name": "_myobj_", 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: "instance": "inst", 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: "ns": "ns" 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T00:11:32.535 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:11:32.536 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:11:32.536 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T00:11:32.536 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 4 tests. 2024-09-12T00:11:32.536 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:11:32.536 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:11:32.580 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:11:32.581 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:11:32.581 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:11:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:32.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.743+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.744+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.744+0000 7fc60d213800 20 realm 2024-09-12T00:11:32.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.744+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.744+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.744+0000 7fc60d213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:11:32.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.744+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.745+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.745+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.746+0000 7fc60d213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:11:32.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.746+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.747+0000 7fc60d213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:11:32.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.747+0000 7fc60d213800 20 searching for the correct realm 2024-09-12T00:11:32.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.749+0000 7fc608147640 0 -- 172.21.15.33:0/1152910296 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x56385a93e2b0 msgr2=0x56385a9406c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:11:32.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.754+0000 7fc608948640 0 -- 172.21.15.33:0/1152910296 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fc5fc04d650 msgr2=0x7fc5fc0599d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:11:32.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.961+0000 7fc60d213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:11:32.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.961+0000 7fc60d213800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:11:32.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.961+0000 7fc60d213800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:11:32.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.961+0000 7fc60d213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:11:32.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.961+0000 7fc60d213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:11:32.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.961+0000 7fc60d213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:11:32.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.961+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.961+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:11:32.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:11:32.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 zone default found 2024-09-12T00:11:32.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 4 Realm: () 2024-09-12T00:11:32.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:11:32.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:11:32.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:11:32.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 zonegroup default 2024-09-12T00:11:32.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.962+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.963+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.963+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.963+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.963+0000 7fc60d213800 20 started sync module instance, tier type = 2024-09-12T00:11:32.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.963+0000 7fc60d213800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:11:32.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.974+0000 7fc60d213800 20 add_watcher() i=0 2024-09-12T00:11:32.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.974+0000 7fc60d213800 20 add_watcher() i=1 2024-09-12T00:11:32.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.974+0000 7fc60d213800 20 add_watcher() i=2 2024-09-12T00:11:32.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.974+0000 7fc60d213800 20 add_watcher() i=3 2024-09-12T00:11:32.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.974+0000 7fc60d213800 20 add_watcher() i=4 2024-09-12T00:11:32.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.974+0000 7fc60d213800 20 add_watcher() i=5 2024-09-12T00:11:32.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.974+0000 7fc60d213800 20 add_watcher() i=6 2024-09-12T00:11:32.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.975+0000 7fc60d213800 20 add_watcher() i=7 2024-09-12T00:11:32.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.975+0000 7fc60d213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:11:32.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.977+0000 7fc4befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:11:32.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.977+0000 7fc60d213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:11:32.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.977+0000 7fc60d213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:11:32.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.977+0000 7fc60d213800 5 note: GC not initialized 2024-09-12T00:11:32.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.978+0000 7fc4bdfe3640 20 reqs_thread_entry: start 2024-09-12T00:11:32.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.978+0000 7fc60d213800 20 init_complete bucket index max shards: 11 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.978+0000 7fc60d213800 20 Filter name: none 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.978+0000 7fc42f7fe640 20 reqs_thread_entry: start 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.978+0000 7fc60d213800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.978+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:11:32.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:11:32.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 cache get: name=default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= : miss 2024-09-12T00:11:32.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 20 rados->read ofs=0 len=0 2024-09-12T00:11:32.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:32.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 cache put: name=default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= info.flags=0x0 2024-09-12T00:11:32.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 adding default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= to cache LRU end 2024-09-12T00:11:32.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 cache get: name=default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= : hit (negative entry) 2024-09-12T00:11:32.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.979+0000 7fc60d213800 10 cache get: name=default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= : hit (negative entry) 2024-09-12T00:11:32.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.981+0000 7fc60d213800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:11:32.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.981+0000 7fc60d213800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:11:32.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.981+0000 7fc60d213800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:11:32.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.981+0000 7fc4dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725893 cookie 94800037803232 notifier 5291 bl.length()=697 2024-09-12T00:11:32.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.981+0000 7fc4dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:11:32.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.981+0000 7fc4dffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:11:32.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.984+0000 7fc60d213800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:11:32.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.984+0000 7fc60d213800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:11:32.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.984+0000 7fc60d213800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:11:32.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.985+0000 7fc4dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725888 cookie 94800037830640 notifier 5291 bl.length()=194 2024-09-12T00:11:32.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.985+0000 7fc4dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:11:32.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.985+0000 7fc4dffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:11:32.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.987+0000 7fc60d213800 10 cache put: name=default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= info.flags=0x7 2024-09-12T00:11:32.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.987+0000 7fc60d213800 10 moving default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= to cache LRU end 2024-09-12T00:11:32.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.987+0000 7fc60d213800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g=, ofs0, ns] 2024-09-12T00:11:32.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.988+0000 7fc4dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 94800037805440 notifier 5291 bl.length()=203 2024-09-12T00:11:32.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.988+0000 7fc4dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= info.flags=0x7 2024-09-12T00:11:32.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.988+0000 7fc4dffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g= to cache LRU end 2024-09-12T00:11:32.988 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:11:32.988 INFO:tasks.workunit.client.0.smithi033.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:11:32.989 INFO:tasks.workunit.client.0.smithi033.stdout: "display_name": "librgw test user", 2024-09-12T00:11:32.989 INFO:tasks.workunit.client.0.smithi033.stdout: "email": "librgw@example.com", 2024-09-12T00:11:32.989 INFO:tasks.workunit.client.0.smithi033.stdout: "suspended": 0, 2024-09-12T00:11:32.989 INFO:tasks.workunit.client.0.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:11:32.989 INFO:tasks.workunit.client.0.smithi033.stdout: "subusers": [], 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "keys": [ 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: { 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "access_key": "DSpvHGcmU4bJ5SOBIQ4Wu2+Es5g=", 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "secret_key": "Xnj0LcRe92O9BkBp6rYNkOEmHeTzsth1BKmlb/OhrdVU1k+LqM3LGg==", 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "active": true, 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "create_date": "2024-09-12T00:11:32.980537Z" 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: ], 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "swift_keys": [], 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "caps": [], 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:11:32.990 INFO:tasks.workunit.client.0.smithi033.stdout: "default_placement": "", 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "placement_tags": [], 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_quota": { 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "enabled": false, 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size": -1, 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "max_objects": -1 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "user_quota": { 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "enabled": false, 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size": -1, 2024-09-12T00:11:32.991 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "max_objects": -1 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "type": "rgw", 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "account_id": "", 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "path": "/", 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "create_date": "2024-09-12T00:11:32.980524Z", 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "tags": [], 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: "group_ids": [] 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:11:32.992 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:11:32.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.990+0000 7fc4befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:11:32.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.993+0000 7fc60d213800 20 remove_watcher() i=0 2024-09-12T00:11:32.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.993+0000 7fc60d213800 2 removed watcher, disabling cache 2024-09-12T00:11:32.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.994+0000 7fc60d213800 20 remove_watcher() i=1 2024-09-12T00:11:32.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.995+0000 7fc60d213800 20 remove_watcher() i=2 2024-09-12T00:11:32.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.997+0000 7fc60d213800 20 remove_watcher() i=3 2024-09-12T00:11:32.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.998+0000 7fc60d213800 20 remove_watcher() i=4 2024-09-12T00:11:32.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:32.999+0000 7fc60d213800 20 remove_watcher() i=5 2024-09-12T00:11:32.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:33.000+0000 7fc60d213800 20 remove_watcher() i=6 2024-09-12T00:11:33.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:33.001+0000 7fc60d213800 20 remove_watcher() i=7 2024-09-12T00:11:33.011 INFO:tasks.workunit.client.0.smithi033.stdout:phase 1.1 2024-09-12T00:11:33.033 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:11:33.033 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:11:33.034 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:11:33.034 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:11:33.044 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:33.045 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:33.427 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (394 ms) 2024-09-12T00:11:33.427 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:11:33.429 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:11:33.429 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:11:33.430 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:11:33.430 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:11:33.441 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:11:33.447 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/f1 2024-09-12T00:11:33.450 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/f2 2024-09-12T00:11:33.453 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:11:33.457 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:11:33.460 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:11:33.463 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:11:33.466 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:11:33.469 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:11:33.473 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:11:33.475 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:11:33.479 INFO:tasks.workunit.client.0.smithi033.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:11:33.482 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETUP_HIER1 (52 ms) 2024-09-12T00:11:33.482 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:11:33.586 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETUP_DIRS1 (105 ms) 2024-09-12T00:11:33.587 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:11:33.587 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:11:33.587 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:11:33.605 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-12T00:11:33.605 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:11:33.661 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (49 ms) 2024-09-12T00:11:33.661 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:11:33.661 INFO:tasks.workunit.client.0.smithi033.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:11:33.661 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-12T00:11:33.662 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:11:33.662 INFO:tasks.workunit.client.0.smithi033.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:11:33.667 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:11:33.668 INFO:tasks.workunit.client.0.smithi033.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:11:33.669 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:11:33.671 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:11:33.671 INFO:tasks.workunit.client.0.smithi033.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:11:33.671 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:11:33.672 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:11:33.673 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:11:33.674 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:11:33.674 INFO:tasks.workunit.client.0.smithi033.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:11:33.674 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:11:33.675 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:11:33.675 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:11:33.677 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:11:33.677 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T00:11:33.677 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:11:33.857 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-12T00:11:33.857 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:11:33.857 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:11:33.857 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:11:33.858 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:11:33.859 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:11:33.866 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:11:33.866 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:11:33.869 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:11:33.871 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:11:33.874 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:11:33.875 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:11:33.875 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:11:33.876 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:11:33.876 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:11:33.876 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:11:33.877 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.HIER1 (22 ms) 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:11:33.880 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:11:33.881 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:11:33.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:33.880+0000 7fc9091208c0 -1 shutting down 2024-09-12T00:11:33.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:11:33.882+0000 7fc7e1002640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64148, si_uid : 1000, si_addr0x3e80000fa94, si_status0 2024-09-12T00:12:03.637 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (29757 ms) 2024-09-12T00:12:03.637 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 24 tests from LibRGW (30603 ms total) 2024-09-12T00:12:03.637 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:12:03.637 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:12:03.637 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 24 tests from 1 test suite ran. (30603 ms total) 2024-09-12T00:12:03.637 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 24 tests. 2024-09-12T00:12:03.643 INFO:tasks.workunit.client.0.smithi033.stdout:phase 1.2 2024-09-12T00:12:03.668 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:12:03.668 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:12:03.668 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:12:03.669 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:12:03.677 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:03.677 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:04.072 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (404 ms) 2024-09-12T00:12:04.072 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:12:04.074 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:12:04.074 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:12:04.074 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:12:04.074 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:12:04.074 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:12:04.074 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:12:04.075 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:12:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:12:04.077 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:12:04.078 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:12:04.078 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:12:04.078 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:12:04.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:12:04.075+0000 7f7a156a48c0 -1 shutting down 2024-09-12T00:12:04.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:12:04.076+0000 7f78ef3e3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64767, si_uid : 1000, si_addr0x3e80000fcff, si_status0 2024-09-12T00:12:34.207 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (30133 ms) 2024-09-12T00:12:34.208 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 24 tests from LibRGW (30539 ms total) 2024-09-12T00:12:34.208 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:12:34.208 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:12:34.208 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 24 tests from 1 test suite ran. (30539 ms total) 2024-09-12T00:12:34.208 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 24 tests. 2024-09-12T00:12:34.213 INFO:tasks.workunit.client.0.smithi033.stdout:phase 1.3 2024-09-12T00:12:34.239 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:12:34.239 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:12:34.239 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:12:34.239 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:12:34.249 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:34.250 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:34.645 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (406 ms) 2024-09-12T00:12:34.645 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:12:34.646 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:12:34.646 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:12:34.647 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:12:34.647 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:12:34.652 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T00:12:34.652 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:12:34.717 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETUP_DIRS1 (64 ms) 2024-09-12T00:12:34.717 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:12:34.717 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:12:34.717 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:12:34.717 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:12:34.717 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:12:34.718 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:12:34.719 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:12:34.720 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:12:34.720 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:12:34.720 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:12:34.720 INFO:tasks.workunit.client.0.smithi033.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:12:34.720 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:12:34.721 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:12:34.721 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:12:34.723 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:12:34.723 INFO:tasks.workunit.client.0.smithi033.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:12:34.723 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:12:34.724 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:12:34.724 INFO:tasks.workunit.client.0.smithi033.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:12:34.725 INFO:tasks.workunit.client.0.smithi033.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:12:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:12:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:12:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:12:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:12:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:12:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:12:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:12:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:12:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:12:34.734 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:12:34.734 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:12:34.737 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:12:34.739 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:12:34.743 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:12:34.744 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:12:34.744 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:12:34.745 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:12:34.745 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:12:34.746 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:12:34.746 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:12:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:12:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:12:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:12:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:12:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:12:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.HIER1 (23 ms) 2024-09-12T00:12:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:12:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:12:34.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:12:34.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:12:34.750+0000 7f7e585228c0 -1 shutting down 2024-09-12T00:12:34.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:12:34.751+0000 7f7d3039b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65387, si_uid : 1000, si_addr0x3e80000ff6b, si_status0 2024-09-12T00:13:05.018 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (30268 ms) 2024-09-12T00:13:05.018 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 24 tests from LibRGW (30778 ms total) 2024-09-12T00:13:05.018 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:13:05.018 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:13:05.018 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 24 tests from 1 test suite ran. (30778 ms total) 2024-09-12T00:13:05.018 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 24 tests. 2024-09-12T00:13:05.023 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2.1 2024-09-12T00:13:05.050 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:13:05.050 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:13:05.050 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:13:05.050 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:13:05.059 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:05.060 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:05.452 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-12T00:13:05.453 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:13:05.453 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:13:05.453 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:13:05.464 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-12T00:13:05.464 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:13:05.464 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:13:05.464 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:13:05.476 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave0 2024-09-12T00:13:05.486 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave1 2024-09-12T00:13:05.499 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave2 2024-09-12T00:13:05.511 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave3 2024-09-12T00:13:05.522 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave4 2024-09-12T00:13:05.537 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave5 2024-09-12T00:13:05.548 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave6 2024-09-12T00:13:05.557 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave7 2024-09-12T00:13:05.573 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave8 2024-09-12T00:13:05.588 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave9 2024-09-12T00:13:05.588 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (124 ms) 2024-09-12T00:13:05.588 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:13:05.897 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (309 ms) 2024-09-12T00:13:05.897 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:13:05.897 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:13:05.897 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:13:05.897 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:13:05.897 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:13:05.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:13:05.898+0000 7f25697418c0 -1 shutting down 2024-09-12T00:13:05.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:13:05.899+0000 7f244347e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66006, si_uid : 1000, si_addr0x3e8000101d6, si_status0 2024-09-12T00:13:35.843 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (29946 ms) 2024-09-12T00:13:35.844 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 9 tests from LibRGW (30793 ms total) 2024-09-12T00:13:35.844 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:13:35.844 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:13:35.844 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 9 tests from 1 test suite ran. (30793 ms total) 2024-09-12T00:13:35.844 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 9 tests. 2024-09-12T00:13:35.849 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2.2 2024-09-12T00:13:35.876 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:13:35.876 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:13:35.876 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:13:35.876 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:13:35.886 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:35.886 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:36.070 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (194 ms) 2024-09-12T00:13:36.070 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:13:36.070 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:13:36.071 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:13:36.071 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:13:36.071 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:13:36.105 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_BUCKET (34 ms) 2024-09-12T00:13:36.105 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:13:36.115 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave0 2024-09-12T00:13:36.130 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave1 2024-09-12T00:13:36.141 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave2 2024-09-12T00:13:36.152 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave3 2024-09-12T00:13:36.164 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave4 2024-09-12T00:13:36.173 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave5 2024-09-12T00:13:36.184 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave6 2024-09-12T00:13:36.194 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave7 2024-09-12T00:13:36.204 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave8 2024-09-12T00:13:36.214 INFO:tasks.workunit.client.0.smithi033.stdout:created: sorrydave9 2024-09-12T00:13:36.214 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (109 ms) 2024-09-12T00:13:36.214 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:13:36.523 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (309 ms) 2024-09-12T00:13:36.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:13:36.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:13:36.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:13:36.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:13:36.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:13:36.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:13:36.525+0000 7fbd448c18c0 -1 shutting down 2024-09-12T00:13:36.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:13:36.526+0000 7fbc1b8c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66626, si_uid : 1000, si_addr0x3e800010442, si_status0 2024-09-12T00:14:06.288 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (29764 ms) 2024-09-12T00:14:06.289 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 9 tests from LibRGW (30412 ms total) 2024-09-12T00:14:06.289 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:14:06.289 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:14:06.289 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 9 tests from 1 test suite ran. (30412 ms total) 2024-09-12T00:14:06.289 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 9 tests. 2024-09-12T00:14:06.295 INFO:tasks.workunit.client.0.smithi033.stdout:phase 3.1 2024-09-12T00:14:06.627 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:14:06.627 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:14:06.627 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:14:06.627 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:14:06.636 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:14:06.636 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:14:06.818 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (191 ms) 2024-09-12T00:14:06.818 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:14:06.819 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:14:06.819 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:14:06.830 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-12T00:14:06.830 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:14:06.834 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:14:06.834 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:14:06.836 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T00:14:06.836 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:14:07.307 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LARGE1 (471 ms) 2024-09-12T00:14:07.307 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:14:07.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LARGE2 (49 ms) 2024-09-12T00:14:07.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:14:07.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:14:07.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:14:07.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:14:07.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:14:07.356 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:14:07.357 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:14:07.357 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:14:07.357 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:14:07.357 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:14:07.357 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:14:07.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:14:07.357+0000 7f60c3d2f8c0 -1 shutting down 2024-09-12T00:14:07.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:14:07.359+0000 7f5f9bcc7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67245, si_uid : 1000, si_addr0x3e8000106ad, si_status0 2024-09-12T00:14:37.057 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (29701 ms) 2024-09-12T00:14:37.058 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 13 tests from LibRGW (30430 ms total) 2024-09-12T00:14:37.058 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:14:37.058 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:14:37.058 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 13 tests from 1 test suite ran. (30430 ms total) 2024-09-12T00:14:37.058 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 13 tests. 2024-09-12T00:14:37.064 INFO:tasks.workunit.client.0.smithi033.stdout:phase 3.2 2024-09-12T00:14:37.395 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:14:37.395 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:14:37.395 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:14:37.395 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:14:37.403 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:14:37.403 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:14:37.582 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-09-12T00:14:37.582 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:14:37.583 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:14:37.583 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:14:37.583 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:14:37.583 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:14:37.589 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:14:37.589 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:14:37.593 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:14:37.593 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:14:37.670 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LARGE1 (78 ms) 2024-09-12T00:14:37.671 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:14:37.671 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:14:37.671 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:14:37.671 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:14:37.671 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:14:37.675 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-12T00:14:37.675 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:14:37.706 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_BUCKET (31 ms) 2024-09-12T00:14:37.706 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:14:37.706 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:14:37.706 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:14:37.707 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:14:37.707 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:14:37.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:14:37.706+0000 7f2b79b258c0 -1 shutting down 2024-09-12T00:14:37.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:14:37.708+0000 7f2a51af7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67864, si_uid : 1000, si_addr0x3e800010918, si_status0 2024-09-12T00:15:07.870 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (30164 ms) 2024-09-12T00:15:07.870 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 13 tests from LibRGW (30475 ms total) 2024-09-12T00:15:07.871 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:15:07.871 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:15:07.871 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 13 tests from 1 test suite ran. (30475 ms total) 2024-09-12T00:15:07.871 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 13 tests. 2024-09-12T00:15:07.878 INFO:tasks.workunit.client.0.smithi033.stdout:phase 4.1 2024-09-12T00:15:07.904 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:15:07.904 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:15:07.904 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:15:07.905 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:15:07.905 INFO:tasks.workunit.client.0.smithi033.stdout:read i1: 64001 2024-09-12T00:15:07.905 INFO:tasks.workunit.client.0.smithi033.stdout:read s1: blunderbuss 2024-09-12T00:15:07.905 INFO:tasks.workunit.client.0.smithi033.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:15:07.905 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:15:07.916 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:07.916 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:08.306 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (401 ms) 2024-09-12T00:15:08.307 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:15:08.307 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:15:08.307 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:15:08.326 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (19 ms) 2024-09-12T00:15:08.327 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_0 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_1 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_2 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_3 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_4 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_5 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_6 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_7 2024-09-12T00:15:08.797 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_8 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_9 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_10 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_11 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_12 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_13 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_14 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_15 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_16 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_17 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_18 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_19 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_20 2024-09-12T00:15:08.798 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_21 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_22 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_23 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_24 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_25 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_26 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_27 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_28 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_29 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_30 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_31 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_32 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_33 2024-09-12T00:15:08.799 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_34 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_35 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_36 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_37 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_38 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_39 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_40 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_41 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_42 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_43 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_44 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_45 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_46 2024-09-12T00:15:08.800 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_47 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_48 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_49 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_50 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_51 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_52 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_53 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_54 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_55 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_56 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_57 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_58 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_59 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_60 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_61 2024-09-12T00:15:08.801 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_62 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_63 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_64 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_65 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_66 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_67 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_68 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_69 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_70 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_71 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_72 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_73 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_74 2024-09-12T00:15:08.802 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_75 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_76 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_77 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_78 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_79 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_80 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_81 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_82 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_83 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_84 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_85 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_86 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_87 2024-09-12T00:15:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_88 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_89 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_90 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_91 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_92 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_93 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_94 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_95 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_96 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_97 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_98 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:created: dmarker:f_99 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (470 ms) 2024-09-12T00:15:08.804 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:15:08.806 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:15:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:15:08.808 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:15:08.809 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:15:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:15:08.811 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:15:08.812 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:15:08.813 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:15:08.814 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:15:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:15:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:15:08.817 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:15:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:15:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:15:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:15:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:15:08.822 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:15:08.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:15:08.802+0000 7f952312b8c0 -1 shutting down 2024-09-12T00:15:08.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:15:08.803+0000 7f93fb0a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68483, si_uid : 1000, si_addr0x3e800010b83, si_status0 2024-09-12T00:15:38.584 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (29782 ms) 2024-09-12T00:15:38.584 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 11 tests from LibRGW (30678 ms total) 2024-09-12T00:15:38.584 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:15:38.584 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:15:38.584 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 11 tests from 1 test suite ran. (30678 ms total) 2024-09-12T00:15:38.584 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 11 tests. 2024-09-12T00:15:38.590 INFO:tasks.workunit.client.0.smithi033.stdout:phase 4.2 2024-09-12T00:15:38.615 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:15:38.615 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:15:38.615 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:15:38.615 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:15:38.615 INFO:tasks.workunit.client.0.smithi033.stdout:read i1: 64001 2024-09-12T00:15:38.615 INFO:tasks.workunit.client.0.smithi033.stdout:read s1: blunderbuss 2024-09-12T00:15:38.615 INFO:tasks.workunit.client.0.smithi033.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:15:38.616 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:15:38.623 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:38.624 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:39.014 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (399 ms) 2024-09-12T00:15:39.014 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:15:39.015 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:15:39.015 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:15:39.026 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (11 ms) 2024-09-12T00:15:39.026 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:15:39.026 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:15:39.026 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:15:39.026 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:15:39.026 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:15:39.029 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:15:39.029 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:15:39.030 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:15:39.031 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:15:39.032 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:15:39.033 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:15:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:15:39.035 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:15:39.036 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:15:39.037 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:15:39.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:15:39.030+0000 7ff668b2b8c0 -1 shutting down 2024-09-12T00:15:39.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:15:39.031+0000 7ff540b2e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69102, si_uid : 1000, si_addr0x3e800010dee, si_status0 2024-09-12T00:16:09.272 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (30242 ms) 2024-09-12T00:16:09.272 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 11 tests from LibRGW (30657 ms total) 2024-09-12T00:16:09.273 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:16:09.273 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:16:09.273 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 11 tests from 1 test suite ran. (30657 ms total) 2024-09-12T00:16:09.273 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 11 tests. 2024-09-12T00:16:09.278 INFO:tasks.workunit.client.0.smithi033.stdout:phase 5.1 2024-09-12T00:16:09.313 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:16:09.313 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:16:09.313 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:16:09.313 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:16:09.323 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:09.324 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:09.508 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (195 ms) 2024-09-12T00:16:09.508 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:16:09.509 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:16:09.509 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:16:09.520 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKET (12 ms) 2024-09-12T00:16:09.521 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:16:09.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:16:09.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:16:09.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:16:09.525 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:16:09.526 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:16:09.526 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:16:09.526 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:16:09.526 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:16:09.530 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-12T00:16:09.530 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:16:09.532 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:16:09.533 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:16:09.534+0000 7f61d81228c0 -1 shutting down 2024-09-12T00:16:09.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:16:09.535+0000 7f60aff9b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69721, si_uid : 1000, si_addr0x3e800011059, si_status0 2024-09-12T00:16:39.871 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (30338 ms) 2024-09-12T00:16:39.872 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 19 tests from LibRGW (30558 ms total) 2024-09-12T00:16:39.872 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:16:39.872 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:16:39.872 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 19 tests from 1 test suite ran. (30558 ms total) 2024-09-12T00:16:39.872 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 19 tests. 2024-09-12T00:16:39.877 INFO:tasks.workunit.client.0.smithi033.stdout:phase 5.2 2024-09-12T00:16:39.913 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:16:39.913 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:16:39.913 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:16:39.913 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:16:39.920 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:39.921 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:40.522 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (610 ms) 2024-09-12T00:16:40.523 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:16:40.523 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:16:40.523 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:16:40.523 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:16:40.523 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:16:40.530 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:16:40.530 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:16:40.530 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:16:40.530 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:16:40.530 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:16:40.530 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:16:40.531 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:16:40.532 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:16:40.532 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:16:40.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T00:16:40.534 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:16:40.567 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.DELETE_BUCKET (32 ms) 2024-09-12T00:16:40.567 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:16:40.568 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:16:40.568 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:16:40.568 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:16:40.568 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:16:40.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:16:40.568+0000 7fcdcea0e8c0 -1 shutting down 2024-09-12T00:16:40.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:16:40.569+0000 7fcca440e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70340, si_uid : 1000, si_addr0x3e8000112c4, si_status0 2024-09-12T00:17:10.845 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (30278 ms) 2024-09-12T00:17:10.846 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 19 tests from LibRGW (30932 ms total) 2024-09-12T00:17:10.846 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:17:10.846 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:10.846 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 19 tests from 1 test suite ran. (30932 ms total) 2024-09-12T00:17:10.846 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 19 tests. 2024-09-12T00:17:10.851 INFO:tasks.workunit.client.0.smithi033.stdout:phase 6.1 2024-09-12T00:17:10.879 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:17:10.879 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:10.879 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:17:10.879 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:17:10.886 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:10.886 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:11.073 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.INIT (195 ms) 2024-09-12T00:17:11.073 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:17:11.074 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:17:11.074 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:17:11.097 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CREATE_BUCKETS (23 ms) 2024-09-12T00:17:11.097 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:17:11.105 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-12T00:17:11.105 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:17:11.123 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-12T00:17:11.123 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:17:11.144 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SUBDIR_RENAME (21 ms) 2024-09-12T00:17:11.144 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:17:11.166 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (22 ms) 2024-09-12T00:17:11.166 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:17:11.166 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:17:11.166 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:17:11.167 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:17:11.167 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:17:11.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:11.168+0000 7f5f1f7688c0 -1 shutting down 2024-09-12T00:17:11.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:11.169+0000 7f5df7765640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70959, si_uid : 1000, si_addr0x3e80001152f, si_status0 2024-09-12T00:17:41.325 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibRGW.SHUTDOWN (30159 ms) 2024-09-12T00:17:41.325 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 10 tests from LibRGW (30447 ms total) 2024-09-12T00:17:41.325 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:17:41.326 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:41.326 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 10 tests from 1 test suite ran. (30447 ms total) 2024-09-12T00:17:41.326 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 10 tests. 2024-09-12T00:17:41.332 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:41.332 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:41.377 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:17:41.379 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:17:41.379 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:17:41.453 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -z ']' 2024-09-12T00:17:41.453 INFO:tasks.workunit.client.0.smithi033.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:17:41.454 INFO:tasks.workunit.client.0.smithi033.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:17:41.454 INFO:tasks.workunit.client.0.smithi033.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:17:41.454 INFO:tasks.workunit.client.0.smithi033.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:17:41.454 INFO:tasks.workunit.client.0.smithi033.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T00:17:41.491 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:41.491 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:41.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.534+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.536+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.536+0000 7ff23a4b7800 20 realm 2024-09-12T00:17:41.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.536+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.536+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.536+0000 7ff23a4b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:41.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.536+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.536+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.536+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.537+0000 7ff23a4b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:41.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.537+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.538+0000 7ff23a4b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:41.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.538+0000 7ff23a4b7800 20 searching for the correct realm 2024-09-12T00:17:41.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.741+0000 7ff237fa1640 0 -- 172.21.15.33:0/1649365295 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x557760bbce50 msgr2=0x7ff2300601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:41.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.948+0000 7ff2377a0640 0 -- 172.21.15.33:0/1649365295 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7ff22808f020 msgr2=0x7ff228056030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.955+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:41.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 20 zone default found 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 4 Realm: () 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 20 zonegroup default 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.956+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.957+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.957+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.957+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.957+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.957+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.957+0000 7ff23a4b7800 20 started sync module instance, tier type = 2024-09-12T00:17:41.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.957+0000 7ff23a4b7800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:17:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.968+0000 7ff23a4b7800 20 add_watcher() i=0 2024-09-12T00:17:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.968+0000 7ff23a4b7800 20 add_watcher() i=1 2024-09-12T00:17:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.968+0000 7ff23a4b7800 20 add_watcher() i=2 2024-09-12T00:17:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.968+0000 7ff23a4b7800 20 add_watcher() i=3 2024-09-12T00:17:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.968+0000 7ff23a4b7800 20 add_watcher() i=4 2024-09-12T00:17:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.968+0000 7ff23a4b7800 20 add_watcher() i=5 2024-09-12T00:17:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.968+0000 7ff23a4b7800 20 add_watcher() i=6 2024-09-12T00:17:41.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.969+0000 7ff23a4b7800 20 add_watcher() i=7 2024-09-12T00:17:41.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.969+0000 7ff23a4b7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:41.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.971+0000 7ff0edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.971+0000 7ff23a4b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.971+0000 7ff23a4b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.971+0000 7ff23a4b7800 5 note: GC not initialized 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff0ecfe1640 20 reqs_thread_entry: start 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 20 init_complete bucket index max shards: 11 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 20 Filter name: none 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff0667fc640 20 reqs_thread_entry: start 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.972+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:17:41.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:17:41.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.973+0000 7ff23a4b7800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:17:41.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.974+0000 7ff23a4b7800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:17:41.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.974+0000 7ff23a4b7800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:17:41.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.974+0000 7ff23a4b7800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:17:41.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.975+0000 7ff116ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 93971214794336 notifier 5504 bl.length()=677 2024-09-12T00:17:41.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.975+0000 7ff116ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:17:41.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.975+0000 7ff116ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:17:41.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.978+0000 7ff23a4b7800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:17:41.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.978+0000 7ff23a4b7800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:17:41.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.978+0000 7ff23a4b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:17:41.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.978+0000 7ff116ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725899 cookie 93971214778672 notifier 5504 bl.length()=187 2024-09-12T00:17:41.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.978+0000 7ff116ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:17:41.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.978+0000 7ff116ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:17:41.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.981+0000 7ff23a4b7800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:17:41.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.981+0000 7ff23a4b7800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:17:41.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.981+0000 7ff23a4b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:17:41.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.982+0000 7ff116ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725900 cookie 93971214778672 notifier 5504 bl.length()=197 2024-09-12T00:17:41.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.982+0000 7ff116ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:17:41.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.982+0000 7ff116ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:17:41.981 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:17:41.981 INFO:tasks.workunit.client.0.smithi033.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:17:41.981 INFO:tasks.workunit.client.0.smithi033.stdout: "display_name": "maven test user", 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "email": "sigv4@example.com", 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "suspended": 0, 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "subusers": [], 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "keys": [ 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: { 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "user": "ceph-test-maven", 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "active": true, 2024-09-12T00:17:41.982 INFO:tasks.workunit.client.0.smithi033.stdout: "create_date": "2024-09-12T00:17:41.974371Z" 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: ], 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "swift_keys": [], 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "caps": [], 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "default_placement": "", 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "placement_tags": [], 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_quota": { 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "enabled": false, 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:17:41.983 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size": -1, 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "max_objects": -1 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "user_quota": { 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "enabled": false, 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size": -1, 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "max_objects": -1 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "type": "rgw", 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi033.stdout: "account_id": "", 2024-09-12T00:17:41.985 INFO:tasks.workunit.client.0.smithi033.stdout: "path": "/", 2024-09-12T00:17:41.985 INFO:tasks.workunit.client.0.smithi033.stdout: "create_date": "2024-09-12T00:17:41.974351Z", 2024-09-12T00:17:41.985 INFO:tasks.workunit.client.0.smithi033.stdout: "tags": [], 2024-09-12T00:17:41.985 INFO:tasks.workunit.client.0.smithi033.stdout: "group_ids": [] 2024-09-12T00:17:41.985 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:17:41.985 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:17:41.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.984+0000 7ff0edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:41.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.987+0000 7ff23a4b7800 20 remove_watcher() i=0 2024-09-12T00:17:41.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.987+0000 7ff23a4b7800 2 removed watcher, disabling cache 2024-09-12T00:17:41.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.988+0000 7ff23a4b7800 20 remove_watcher() i=1 2024-09-12T00:17:41.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.989+0000 7ff23a4b7800 20 remove_watcher() i=2 2024-09-12T00:17:41.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.990+0000 7ff23a4b7800 20 remove_watcher() i=3 2024-09-12T00:17:41.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.991+0000 7ff23a4b7800 20 remove_watcher() i=4 2024-09-12T00:17:41.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.992+0000 7ff23a4b7800 20 remove_watcher() i=5 2024-09-12T00:17:41.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.993+0000 7ff23a4b7800 20 remove_watcher() i=6 2024-09-12T00:17:41.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:17:41.994+0000 7ff23a4b7800 20 remove_watcher() i=7 2024-09-12T00:17:42.005 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -z ']' 2024-09-12T00:17:42.005 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T00:17:42.005 INFO:tasks.workunit.client.0.smithi033.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:17:42.006 INFO:tasks.workunit.client.0.smithi033.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi033.front.sepia.ceph.com:443 2024-09-12T00:17:42.006 INFO:tasks.workunit.client.0.smithi033.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi033.front.sepia.ceph.com:443 2024-09-12T00:17:42.006 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T00:17:42.006 INFO:tasks.workunit.client.0.smithi033.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:17:42.006 INFO:tasks.workunit.client.0.smithi033.stderr:+ ./mvnw clean package 2024-09-12T00:17:42.016 INFO:tasks.workunit.client.0.smithi033.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:17:43.923 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Scanning for projects... 2024-09-12T00:17:44.071 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:17:44.163 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 59 kB/s) 2024-09-12T00:17:44.180 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:17:44.225 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.8 MB/s) 2024-09-12T00:17:44.232 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:17:44.255 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.5 MB/s) 2024-09-12T00:17:44.277 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:44.277 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:17:44.277 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:17:44.277 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] from pom.xml 2024-09-12T00:17:44.277 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:17:44.280 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:17:44.296 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T00:17:44.304 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:17:44.322 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 521 kB/s) 2024-09-12T00:17:44.326 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:17:44.342 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T00:17:44.347 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:17:44.365 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-12T00:17:44.376 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:17:44.394 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.9 MB/s) 2024-09-12T00:17:44.401 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:17:44.418 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 510 kB/s) 2024-09-12T00:17:44.420 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:17:44.436 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-12T00:17:44.438 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:17:44.456 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-12T00:17:44.460 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:17:44.475 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-12T00:17:44.480 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:17:44.499 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.6 MB/s) 2024-09-12T00:17:44.504 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:17:44.520 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-12T00:17:44.526 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:17:44.546 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.3 MB/s) 2024-09-12T00:17:44.552 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:17:44.568 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T00:17:44.570 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:17:44.589 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-09-12T00:17:44.591 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:17:44.607 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-12T00:17:44.611 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:17:44.627 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-12T00:17:44.633 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:17:44.649 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T00:17:44.653 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:17:44.676 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.9 MB/s) 2024-09-12T00:17:44.683 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:17:44.698 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 423 kB/s) 2024-09-12T00:17:44.701 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:17:44.717 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-12T00:17:44.720 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:17:44.736 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-12T00:17:44.739 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:17:44.753 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-12T00:17:44.758 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:17:44.774 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-12T00:17:44.788 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:17:44.802 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-12T00:17:44.804 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:17:44.820 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-12T00:17:44.824 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:17:44.843 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T00:17:44.850 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:17:44.866 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-12T00:17:44.869 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:17:44.884 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-12T00:17:44.886 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:17:44.902 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 139 kB/s) 2024-09-12T00:17:44.906 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:17:44.922 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-12T00:17:44.926 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:17:44.943 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-09-12T00:17:44.947 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:17:44.964 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-12T00:17:44.968 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:17:44.985 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 99 kB/s) 2024-09-12T00:17:44.989 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:17:45.005 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-12T00:17:45.008 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:17:45.024 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-12T00:17:45.027 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:17:45.041 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T00:17:45.043 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:17:45.058 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-12T00:17:45.059 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:17:45.074 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-12T00:17:45.077 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:17:45.092 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-09-12T00:17:45.096 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:17:45.113 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T00:17:45.116 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:17:45.132 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 182 kB/s) 2024-09-12T00:17:45.135 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:17:45.149 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T00:17:45.153 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:17:45.170 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-12T00:17:45.174 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:17:45.189 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-12T00:17:45.193 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:17:45.208 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-12T00:17:45.210 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:17:45.225 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 172 kB/s) 2024-09-12T00:17:45.229 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:17:45.245 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-09-12T00:17:45.249 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:17:45.266 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 337 kB/s) 2024-09-12T00:17:45.270 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:17:45.285 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-12T00:17:45.289 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:17:45.309 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-12T00:17:45.314 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:17:45.327 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-12T00:17:45.329 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:17:45.344 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 111 kB/s) 2024-09-12T00:17:45.348 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:17:45.362 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-12T00:17:45.364 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:17:45.379 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.0 MB/s) 2024-09-12T00:17:45.381 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:17:45.396 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T00:17:45.399 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:17:45.415 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-12T00:17:45.418 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:17:45.433 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-12T00:17:45.435 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:17:45.450 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-12T00:17:45.454 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:17:45.468 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-12T00:17:45.470 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:17:45.487 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-12T00:17:45.492 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:17:45.507 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-12T00:17:45.511 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:17:45.525 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-12T00:17:45.526 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:17:45.543 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-12T00:17:45.546 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:17:45.561 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-12T00:17:45.564 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:17:45.581 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-12T00:17:45.583 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:17:45.607 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.4 MB/s) 2024-09-12T00:17:45.612 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:17:45.630 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 213 kB/s) 2024-09-12T00:17:45.632 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:17:45.648 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 863 kB/s) 2024-09-12T00:17:45.651 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:17:45.666 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:17:45.668 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:17:45.684 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 212 kB/s) 2024-09-12T00:17:45.686 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:17:45.701 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-12T00:17:45.703 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:17:45.721 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-09-12T00:17:45.723 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:17:45.739 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-09-12T00:17:45.741 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:17:45.759 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-09-12T00:17:45.761 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:17:45.776 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T00:17:45.780 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:17:45.793 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T00:17:45.795 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:17:45.810 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-12T00:17:45.813 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:17:45.828 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T00:17:45.831 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:17:45.846 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-12T00:17:45.848 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:17:45.863 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-09-12T00:17:45.865 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:17:45.882 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T00:17:45.884 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:17:45.900 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-12T00:17:45.902 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:17:45.917 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 189 kB/s) 2024-09-12T00:17:45.934 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:17:46.023 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 37 MB/s) 2024-09-12T00:17:46.025 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:17:46.025 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:17:46.025 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:17:46.025 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:17:46.025 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:17:46.044 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.5 MB/s) 2024-09-12T00:17:46.044 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:17:46.059 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 472 kB/s) 2024-09-12T00:17:46.059 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:17:46.079 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (2): 6.9/16 kB | 1.4/35 kB Progress (2): 8.3/16 kB | 1.4/35 kB Progress (2): 8.3/16 kB | 2.8/35 kB Progress (2): 9.7/16 kB | 2.8/35 kB Progress (3): 9.7/16 kB | 2.8/35 kB | 1.4/98 kB Progress (3): 9.7/16 kB | 4.1/35 kB | 1.4/98 kB Progress (3): 11/16 kB | 4.1/35 kB | 1.4/98 kB Progress (3): 11/16 kB | 4.1/35 kB | 2.8/98 kB Progress (3): 11/16 kB | 5.5/35 kB | 2.8/98 kB Progress (3): 11/16 kB | 5.5/35 kB | 4.1/98 kB Progress (3): 12/16 kB | 5.5/35 kB | 4.1/98 kB Progress (3): 12/16 kB | 5.5/35 kB | 5.5/98 kB Progress (3): 12/16 kB | 6.9/35 kB | 5.5/98 kB Progress (3): 12/16 kB | 6.9/35 kB | 6.9/98 kB Progress (3): 14/16 kB | 6.9/35 kB | 6.9/98 kB Progress (3): 14/16 kB | 8.3/35 kB | 6.9/98 kB Progress (3): 14/16 kB | 8.3/35 kB | 8.3/98 kB Progress (4): 14/16 kB | 8.3/35 kB | 8.3/98 kB | 16/782 kB Progress (4): 15/16 kB | 8.3/35 kB | 8.3/98 kB | 16/782 kB Progress (4): 15/16 kB | 8.3/35 kB | 9.7/98 kB | 16/782 kB Progress (4): 15/16 kB | 9.7/35 kB | 9.7/98 kB | 16/782 kB Progress (4): 15/16 kB | 9.7/35 kB | 11/98 kB | 16/782 kB Progress (4): 16 kB | 9.7/35 kB | 11/98 kB | 16/782 kB Progress (4): 16 kB | 9.7/35 kB | 11/98 kB | 33/782 kB Progress (4): 16 kB | 9.7/35 kB | 12/98 kB | 33/782 kB Progress (4): 16 kB | 11/35 kB | 12/98 kB | 33/782 kB Progress (4): 16 kB | 11/35 kB | 14/98 kB | 33/782 kB Progress (4): 16 kB | 12/35 kB | 14/98 kB | 33/782 kB Progress (4): 16 kB | 12/35 kB | 15/98 kB | 33/782 kB Progress (4): 16 kB | 12/35 kB | 15/98 kB | 49/782 kB Progress (4): 16 kB | 12/35 kB | 16/98 kB | 49/782 kB Progress (4): 16 kB | 14/35 kB | 16/98 kB | 49/782 kB Progress (4): 16 kB | 14/35 kB | 18/98 kB | 49/782 kB Progress (4): 16 kB | 15/35 kB | 18/98 kB | 49/782 kB Progress (4): 16 kB | 15/35 kB | 19/98 kB | 49/782 kB Progress (4): 16 kB | 15/35 kB | 19/98 kB | 62/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 316 kB/s) 2024-09-12T00:17:46.079 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 15/35 kB | 21/98 kB | 62/782 kB Progress (3): 16/35 kB | 21/98 kB | 62/782 kB Progress (3): 16/35 kB | 22/98 kB | 62/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:17:46.086 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 16/35 kB | 22/98 kB | 78/782 kB Progress (3): 17/35 kB | 22/98 kB | 78/782 kB Progress (3): 17/35 kB | 23/98 kB | 78/782 kB Progress (3): 19/35 kB | 23/98 kB | 78/782 kB Progress (3): 19/35 kB | 25/98 kB | 78/782 kB Progress (3): 19/35 kB | 25/98 kB | 95/782 kB Progress (3): 20/35 kB | 25/98 kB | 95/782 kB Progress (3): 20/35 kB | 26/98 kB | 95/782 kB Progress (3): 21/35 kB | 26/98 kB | 95/782 kB Progress (3): 21/35 kB | 27/98 kB | 95/782 kB Progress (3): 23/35 kB | 27/98 kB | 95/782 kB Progress (3): 23/35 kB | 27/98 kB | 111/782 kB Progress (3): 23/35 kB | 29/98 kB | 111/782 kB Progress (3): 24/35 kB | 29/98 kB | 111/782 kB Progress (4): 24/35 kB | 29/98 kB | 111/782 kB | 1.4/49 kB Progress (4): 24/35 kB | 30/98 kB | 111/782 kB | 1.4/49 kB Progress (4): 24/35 kB | 30/98 kB | 111/782 kB | 2.8/49 kB Progress (4): 25/35 kB | 30/98 kB | 111/782 kB | 2.8/49 kB Progress (4): 25/35 kB | 30/98 kB | 111/782 kB | 4.1/49 kB Progress (4): 25/35 kB | 30/98 kB | 128/782 kB | 4.1/49 kB Progress (4): 25/35 kB | 30/98 kB | 128/782 kB | 5.5/49 kB Progress (4): 27/35 kB | 30/98 kB | 128/782 kB | 5.5/49 kB Progress (4): 27/35 kB | 30/98 kB | 128/782 kB | 6.9/49 kB Progress (4): 28/35 kB | 30/98 kB | 128/782 kB | 6.9/49 kB Progress (4): 28/35 kB | 30/98 kB | 128/782 kB | 8.3/49 kB Progress (4): 28/35 kB | 30/98 kB | 144/782 kB | 8.3/49 kB Progress (4): 30/35 kB | 30/98 kB | 144/782 kB | 8.3/49 kB Progress (4): 30/35 kB | 30/98 kB | 144/782 kB | 9.7/49 kB Progress (4): 30/35 kB | 30/98 kB | 144/782 kB | 11/49 kB Progress (4): 30/35 kB | 30/98 kB | 144/782 kB | 12/49 kB Progress (4): 30/35 kB | 30/98 kB | 160/782 kB | 12/49 kB Progress (4): 30/35 kB | 30/98 kB | 160/782 kB | 14/49 kB Progress (4): 30/35 kB | 30/98 kB | 160/782 kB | 15/49 kB Progress (4): 30/35 kB | 30/98 kB | 177/782 kB | 15/49 kB Progress (4): 30/35 kB | 30/98 kB | 193/782 kB | 15/49 kB Progress (4): 30/35 kB | 30/98 kB | 209/782 kB | 15/49 kB Progress (4): 30/35 kB | 30/98 kB | 209/782 kB | 16/49 kB Progress (4): 30/35 kB | 30/98 kB | 226/782 kB | 16/49 kB Progress (4): 30/35 kB | 30/98 kB | 226/782 kB | 18/49 kB Progress (4): 30/35 kB | 30/98 kB | 226/782 kB | 19/49 kB Progress (4): 30/35 kB | 30/98 kB | 226/782 kB | 21/49 kB Progress (4): 30/35 kB | 30/98 kB | 242/782 kB | 21/49 kB Progress (4): 30/35 kB | 30/98 kB | 242/782 kB | 22/49 kB Progress (4): 30/35 kB | 30/98 kB | 242/782 kB | 23/49 kB Progress (4): 30/35 kB | 30/98 kB | 242/782 kB | 25/49 kB Progress (4): 30/35 kB | 30/98 kB | 259/782 kB | 25/49 kB Progress (4): 30/35 kB | 30/98 kB | 259/782 kB | 26/49 kB Progress (4): 30/35 kB | 30/98 kB | 259/782 kB | 27/49 kB Progress (4): 30/35 kB | 30/98 kB | 259/782 kB | 29/49 kB Progress (4): 30/35 kB | 30/98 kB | 275/782 kB | 29/49 kB Progress (4): 30/35 kB | 30/98 kB | 275/782 kB | 30/49 kB Progress (4): 30/35 kB | 30/98 kB | 291/782 kB | 30/49 kB Progress (4): 30/35 kB | 30/98 kB | 308/782 kB | 30/49 kB Progress (4): 30/35 kB | 30/98 kB | 324/782 kB | 30/49 kB Progress (4): 30/35 kB | 30/98 kB | 341/782 kB | 30/49 kB Progress (4): 31/35 kB | 30/98 kB | 341/782 kB | 30/49 kB Progress (4): 32/35 kB | 30/98 kB | 341/782 kB | 30/49 kB Progress (4): 34/35 kB | 30/98 kB | 341/782 kB | 30/49 kB Progress (4): 35/35 kB | 30/98 kB | 341/782 kB | 30/49 kB Progress (4): 35/35 kB | 30/98 kB | 357/782 kB | 30/49 kB Progress (4): 35 kB | 30/98 kB | 357/782 kB | 30/49 kB Progress (4): 35 kB | 32/98 kB | 357/782 kB | 30/49 kB Progress (4): 35 kB | 33/98 kB | 357/782 kB | 30/49 kB Progress (4): 35 kB | 33/98 kB | 373/782 kB | 30/49 kB Progress (4): 35 kB | 34/98 kB | 373/782 kB | 30/49 kB Progress (4): 35 kB | 36/98 kB | 373/782 kB | 30/49 kB Progress (4): 35 kB | 37/98 kB | 373/782 kB | 30/49 kB Progress (4): 35 kB | 37/98 kB | 390/782 kB | 30/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 586 kB/s) 2024-09-12T00:17:46.086 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 38/98 kB | 390/782 kB | 30/49 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:17:46.094 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 40/98 kB | 390/782 kB | 30/49 kB Progress (3): 40/98 kB | 406/782 kB | 30/49 kB Progress (3): 41/98 kB | 406/782 kB | 30/49 kB Progress (3): 43/98 kB | 406/782 kB | 30/49 kB Progress (3): 43/98 kB | 422/782 kB | 30/49 kB Progress (3): 44/98 kB | 422/782 kB | 30/49 kB Progress (3): 45/98 kB | 422/782 kB | 30/49 kB Progress (3): 45/98 kB | 439/782 kB | 30/49 kB Progress (3): 45/98 kB | 455/782 kB | 30/49 kB Progress (3): 45/98 kB | 472/782 kB | 30/49 kB Progress (3): 47/98 kB | 472/782 kB | 30/49 kB Progress (3): 47/98 kB | 488/782 kB | 30/49 kB Progress (3): 48/98 kB | 488/782 kB | 30/49 kB Progress (3): 49/98 kB | 488/782 kB | 30/49 kB Progress (3): 49/98 kB | 504/782 kB | 30/49 kB Progress (3): 49/98 kB | 521/782 kB | 30/49 kB Progress (3): 49/98 kB | 537/782 kB | 30/49 kB Progress (3): 49/98 kB | 537/782 kB | 32/49 kB Progress (3): 49/98 kB | 537/782 kB | 33/49 kB Progress (3): 49/98 kB | 537/782 kB | 34/49 kB Progress (3): 49/98 kB | 554/782 kB | 34/49 kB Progress (3): 49/98 kB | 554/782 kB | 36/49 kB Progress (3): 49/98 kB | 570/782 kB | 36/49 kB Progress (3): 49/98 kB | 570/782 kB | 37/49 kB Progress (3): 49/98 kB | 570/782 kB | 38/49 kB Progress (3): 49/98 kB | 570/782 kB | 40/49 kB Progress (3): 49/98 kB | 586/782 kB | 40/49 kB Progress (3): 49/98 kB | 586/782 kB | 41/49 kB Progress (3): 49/98 kB | 586/782 kB | 43/49 kB Progress (3): 49/98 kB | 586/782 kB | 44/49 kB Progress (3): 49/98 kB | 586/782 kB | 45/49 kB Progress (3): 49/98 kB | 603/782 kB | 45/49 kB Progress (3): 49/98 kB | 619/782 kB | 45/49 kB Progress (3): 49/98 kB | 635/782 kB | 45/49 kB Progress (3): 49/98 kB | 652/782 kB | 45/49 kB Progress (3): 49/98 kB | 668/782 kB | 45/49 kB Progress (3): 49/98 kB | 685/782 kB | 45/49 kB Progress (3): 49/98 kB | 701/782 kB | 45/49 kB Progress (3): 49/98 kB | 717/782 kB | 45/49 kB Progress (3): 49/98 kB | 717/782 kB | 47/49 kB Progress (3): 49/98 kB | 734/782 kB | 47/49 kB Progress (3): 49/98 kB | 734/782 kB | 48/49 kB Progress (3): 49/98 kB | 734/782 kB | 49 kB Progress (3): 49/98 kB | 750/782 kB | 49 kB Progress (3): 49/98 kB | 767/782 kB | 49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 724 kB/s) 2024-09-12T00:17:46.094 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:17:46.094 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 49/98 kB | 782 kB Progress (3): 49/98 kB | 782 kB | 1.4/11 kB Progress (3): 49/98 kB | 782 kB | 2.8/11 kB Progress (3): 49/98 kB | 782 kB | 4.1/11 kB Progress (3): 49/98 kB | 782 kB | 5.5/11 kB Progress (3): 49/98 kB | 782 kB | 6.9/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-12T00:17:46.094 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 49/98 kB | 8.3/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:17:46.094 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 49/98 kB | 9.7/11 kB Progress (2): 49/98 kB | 11/11 kB Progress (2): 49/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 165 kB/s) 2024-09-12T00:17:46.095 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:17:46.100 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 66/98 kB Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-12T00:17:46.100 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:17:46.110 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 15/30 kB Progress (2): 16/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 359 kB/s) 2024-09-12T00:17:46.110 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:17:46.116 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 16/205 kB | 1.4/81 kB Progress (2): 16/205 kB | 2.8/81 kB Progress (2): 16/205 kB | 4.1/81 kB Progress (2): 16/205 kB | 5.5/81 kB Progress (2): 16/205 kB | 6.9/81 kB Progress (2): 16/205 kB | 8.3/81 kB Progress (2): 16/205 kB | 9.7/81 kB Progress (2): 16/205 kB | 11/81 kB Progress (2): 16/205 kB | 12/81 kB Progress (2): 16/205 kB | 14/81 kB Progress (2): 16/205 kB | 15/81 kB Progress (2): 16/205 kB | 16/81 kB Progress (2): 33/205 kB | 16/81 kB Progress (2): 49/205 kB | 16/81 kB Progress (2): 66/205 kB | 16/81 kB Progress (3): 66/205 kB | 16/81 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 147 kB/s) 2024-09-12T00:17:46.117 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:17:46.127 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 82/205 kB | 16/81 kB Progress (2): 97/205 kB | 16/81 kB Progress (2): 113/205 kB | 16/81 kB Progress (3): 113/205 kB | 16/81 kB | 16/798 kB Progress (3): 113/205 kB | 33/81 kB | 16/798 kB Progress (3): 113/205 kB | 33/81 kB | 32/798 kB Progress (3): 113/205 kB | 33/81 kB | 49/798 kB Progress (3): 113/205 kB | 49/81 kB | 49/798 kB Progress (4): 113/205 kB | 49/81 kB | 49/798 kB | 16/182 kB Progress (4): 113/205 kB | 49/81 kB | 49/798 kB | 33/182 kB Progress (4): 113/205 kB | 66/81 kB | 49/798 kB | 33/182 kB Progress (4): 113/205 kB | 66/81 kB | 49/798 kB | 49/182 kB Progress (4): 113/205 kB | 66/81 kB | 49/798 kB | 62/182 kB Progress (4): 113/205 kB | 66/81 kB | 49/798 kB | 78/182 kB Progress (4): 129/205 kB | 66/81 kB | 49/798 kB | 78/182 kB Progress (4): 129/205 kB | 66/81 kB | 49/798 kB | 94/182 kB Progress (4): 129/205 kB | 66/81 kB | 49/798 kB | 111/182 kB Progress (4): 129/205 kB | 81 kB | 49/798 kB | 111/182 kB Progress (4): 129/205 kB | 81 kB | 49/798 kB | 127/182 kB Progress (4): 129/205 kB | 81 kB | 49/798 kB | 143/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 805 kB/s) 2024-09-12T00:17:46.127 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 146/205 kB | 49/798 kB | 143/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:17:46.128 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 146/205 kB | 49/798 kB | 160/182 kB Progress (3): 146/205 kB | 49/798 kB | 176/182 kB Progress (3): 146/205 kB | 49/798 kB | 182 kB Progress (3): 162/205 kB | 49/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.8 MB/s) 2024-09-12T00:17:46.128 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:17:46.129 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 179/205 kB | 49/798 kB Progress (2): 195/205 kB | 49/798 kB Progress (2): 205 kB | 49/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T00:17:46.130 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:17:46.143 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 65/798 kB Progress (1): 81/798 kB Progress (1): 98/798 kB Progress (1): 114/798 kB Progress (1): 130/798 kB Progress (2): 130/798 kB | 16/151 kB Progress (2): 144/798 kB | 16/151 kB Progress (2): 144/798 kB | 33/151 kB Progress (2): 160/798 kB | 33/151 kB Progress (2): 160/798 kB | 48/151 kB Progress (2): 177/798 kB | 48/151 kB Progress (2): 177/798 kB | 64/151 kB Progress (2): 177/798 kB | 81/151 kB Progress (2): 177/798 kB | 97/151 kB Progress (3): 177/798 kB | 97/151 kB | 16/27 kB Progress (3): 177/798 kB | 97/151 kB | 27 kB Progress (4): 177/798 kB | 97/151 kB | 27 kB | 16/30 kB Progress (4): 177/798 kB | 97/151 kB | 27 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 235 kB/s) 2024-09-12T00:17:46.144 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:17:46.144 INFO:tasks.workunit.client.0.smithi033.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 259 kB/s) 2024-09-12T00:17:46.144 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 193/798 kB | 97/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:17:46.149 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 209/798 kB | 97/151 kB Progress (2): 226/798 kB | 97/151 kB Progress (3): 226/798 kB | 97/151 kB | 16/385 kB Progress (3): 226/798 kB | 97/151 kB | 33/385 kB Progress (3): 242/798 kB | 97/151 kB | 33/385 kB Progress (3): 259/798 kB | 97/151 kB | 33/385 kB Progress (3): 259/798 kB | 97/151 kB | 49/385 kB Progress (3): 259/798 kB | 97/151 kB | 66/385 kB Progress (3): 259/798 kB | 97/151 kB | 82/385 kB Progress (3): 275/798 kB | 97/151 kB | 82/385 kB Progress (3): 275/798 kB | 97/151 kB | 98/385 kB Progress (3): 291/798 kB | 97/151 kB | 98/385 kB Progress (3): 308/798 kB | 97/151 kB | 98/385 kB Progress (3): 308/798 kB | 97/151 kB | 114/385 kB Progress (3): 324/798 kB | 97/151 kB | 114/385 kB Progress (3): 324/798 kB | 113/151 kB | 114/385 kB Progress (3): 324/798 kB | 113/151 kB | 131/385 kB Progress (3): 324/798 kB | 130/151 kB | 131/385 kB Progress (3): 341/798 kB | 130/151 kB | 131/385 kB Progress (3): 341/798 kB | 130/151 kB | 147/385 kB Progress (3): 357/798 kB | 130/151 kB | 147/385 kB Progress (3): 357/798 kB | 130/151 kB | 164/385 kB Progress (3): 357/798 kB | 146/151 kB | 164/385 kB Progress (3): 357/798 kB | 146/151 kB | 180/385 kB Progress (3): 357/798 kB | 151 kB | 180/385 kB Progress (3): 373/798 kB | 151 kB | 180/385 kB Progress (3): 373/798 kB | 151 kB | 196/385 kB Progress (3): 390/798 kB | 151 kB | 196/385 kB Progress (3): 390/798 kB | 151 kB | 213/385 kB Progress (3): 406/798 kB | 151 kB | 213/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T00:17:46.150 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:17:46.160 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 422/798 kB | 213/385 kB Progress (2): 422/798 kB | 229/385 kB Progress (2): 422/798 kB | 245/385 kB Progress (2): 439/798 kB | 245/385 kB Progress (2): 455/798 kB | 245/385 kB Progress (2): 472/798 kB | 245/385 kB Progress (2): 488/798 kB | 245/385 kB Progress (2): 488/798 kB | 262/385 kB Progress (2): 504/798 kB | 262/385 kB Progress (2): 504/798 kB | 278/385 kB Progress (2): 521/798 kB | 278/385 kB Progress (2): 537/798 kB | 278/385 kB Progress (2): 537/798 kB | 295/385 kB Progress (2): 554/798 kB | 295/385 kB Progress (2): 554/798 kB | 311/385 kB Progress (2): 554/798 kB | 327/385 kB Progress (3): 554/798 kB | 327/385 kB | 16/75 kB Progress (3): 554/798 kB | 344/385 kB | 16/75 kB Progress (3): 570/798 kB | 344/385 kB | 16/75 kB Progress (3): 570/798 kB | 344/385 kB | 33/75 kB Progress (3): 586/798 kB | 344/385 kB | 33/75 kB Progress (3): 586/798 kB | 360/385 kB | 33/75 kB Progress (3): 603/798 kB | 360/385 kB | 33/75 kB Progress (3): 603/798 kB | 376/385 kB | 33/75 kB Progress (3): 619/798 kB | 376/385 kB | 33/75 kB Progress (3): 619/798 kB | 385 kB | 33/75 kB Progress (3): 619/798 kB | 385 kB | 49/75 kB Progress (3): 635/798 kB | 385 kB | 49/75 kB Progress (3): 652/798 kB | 385 kB | 49/75 kB Progress (3): 668/798 kB | 385 kB | 49/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.9 MB/s) 2024-09-12T00:17:46.160 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:17:46.161 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 668/798 kB | 66/75 kB Progress (2): 685/798 kB | 66/75 kB Progress (2): 685/798 kB | 75 kB Progress (2): 701/798 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 556 kB/s) 2024-09-12T00:17:46.161 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 717/798 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:17:46.163 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 734/798 kB Progress (1): 750/798 kB Progress (1): 766/798 kB Progress (2): 766/798 kB | 13 kB Progress (2): 783/798 kB | 13 kB Progress (2): 798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 97 kB/s) 2024-09-12T00:17:46.163 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:17:46.163 INFO:tasks.workunit.client.0.smithi033.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.9 MB/s) 2024-09-12T00:17:46.163 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:17:46.180 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/780 kB Progress (1): 32/780 kB Progress (1): 49/780 kB Progress (1): 65/780 kB Progress (1): 81/780 kB Progress (1): 98/780 kB Progress (1): 114/780 kB Progress (1): 130/780 kB Progress (1): 147/780 kB Progress (1): 163/780 kB Progress (1): 180/780 kB Progress (1): 196/780 kB Progress (1): 212/780 kB Progress (1): 229/780 kB Progress (1): 245/780 kB Progress (2): 245/780 kB | 16/329 kB Progress (2): 245/780 kB | 33/329 kB Progress (2): 245/780 kB | 49/329 kB Progress (2): 245/780 kB | 64/329 kB Progress (3): 245/780 kB | 64/329 kB | 16/501 kB Progress (3): 245/780 kB | 64/329 kB | 32/501 kB Progress (3): 245/780 kB | 64/329 kB | 49/501 kB Progress (3): 245/780 kB | 81/329 kB | 49/501 kB Progress (3): 245/780 kB | 81/329 kB | 63/501 kB Progress (3): 245/780 kB | 81/329 kB | 79/501 kB Progress (3): 245/780 kB | 81/329 kB | 96/501 kB Progress (3): 262/780 kB | 81/329 kB | 96/501 kB Progress (3): 262/780 kB | 97/329 kB | 96/501 kB Progress (3): 262/780 kB | 97/329 kB | 112/501 kB Progress (3): 278/780 kB | 97/329 kB | 112/501 kB Progress (4): 278/780 kB | 97/329 kB | 112/501 kB | 16/41 kB Progress (4): 278/780 kB | 114/329 kB | 112/501 kB | 16/41 kB Progress (4): 278/780 kB | 114/329 kB | 128/501 kB | 16/41 kB Progress (4): 294/780 kB | 114/329 kB | 128/501 kB | 16/41 kB Progress (4): 294/780 kB | 114/329 kB | 128/501 kB | 33/41 kB Progress (4): 294/780 kB | 114/329 kB | 145/501 kB | 33/41 kB Progress (4): 294/780 kB | 130/329 kB | 145/501 kB | 33/41 kB Progress (4): 294/780 kB | 130/329 kB | 145/501 kB | 41 kB Progress (4): 311/780 kB | 130/329 kB | 145/501 kB | 41 kB Progress (4): 311/780 kB | 130/329 kB | 161/501 kB | 41 kB Progress (4): 324/780 kB | 130/329 kB | 161/501 kB | 41 kB Progress (4): 324/780 kB | 130/329 kB | 177/501 kB | 41 kB Progress (4): 324/780 kB | 146/329 kB | 177/501 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 269 kB/s) 2024-09-12T00:17:46.180 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 340/780 kB | 146/329 kB | 177/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:17:46.185 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 340/780 kB | 146/329 kB | 194/501 kB Progress (3): 356/780 kB | 146/329 kB | 194/501 kB Progress (3): 356/780 kB | 146/329 kB | 210/501 kB Progress (3): 373/780 kB | 146/329 kB | 210/501 kB Progress (3): 373/780 kB | 146/329 kB | 227/501 kB Progress (3): 389/780 kB | 146/329 kB | 227/501 kB Progress (3): 389/780 kB | 146/329 kB | 243/501 kB Progress (3): 406/780 kB | 146/329 kB | 243/501 kB Progress (3): 406/780 kB | 146/329 kB | 259/501 kB Progress (3): 422/780 kB | 146/329 kB | 259/501 kB Progress (3): 422/780 kB | 146/329 kB | 276/501 kB Progress (3): 438/780 kB | 146/329 kB | 276/501 kB Progress (3): 438/780 kB | 146/329 kB | 292/501 kB Progress (3): 455/780 kB | 146/329 kB | 292/501 kB Progress (3): 455/780 kB | 146/329 kB | 309/501 kB Progress (3): 471/780 kB | 146/329 kB | 309/501 kB Progress (3): 471/780 kB | 146/329 kB | 325/501 kB Progress (3): 488/780 kB | 146/329 kB | 325/501 kB Progress (3): 488/780 kB | 146/329 kB | 341/501 kB Progress (3): 504/780 kB | 146/329 kB | 341/501 kB Progress (3): 504/780 kB | 146/329 kB | 358/501 kB Progress (3): 520/780 kB | 146/329 kB | 358/501 kB Progress (3): 520/780 kB | 146/329 kB | 374/501 kB Progress (3): 537/780 kB | 146/329 kB | 374/501 kB Progress (3): 537/780 kB | 146/329 kB | 390/501 kB Progress (3): 553/780 kB | 146/329 kB | 390/501 kB Progress (3): 553/780 kB | 146/329 kB | 407/501 kB Progress (3): 569/780 kB | 146/329 kB | 407/501 kB Progress (3): 569/780 kB | 146/329 kB | 423/501 kB Progress (3): 586/780 kB | 146/329 kB | 423/501 kB Progress (3): 586/780 kB | 146/329 kB | 440/501 kB Progress (3): 602/780 kB | 146/329 kB | 440/501 kB Progress (3): 602/780 kB | 146/329 kB | 456/501 kB Progress (3): 619/780 kB | 146/329 kB | 456/501 kB Progress (3): 619/780 kB | 146/329 kB | 472/501 kB Progress (3): 635/780 kB | 146/329 kB | 472/501 kB Progress (3): 635/780 kB | 146/329 kB | 489/501 kB Progress (3): 651/780 kB | 146/329 kB | 489/501 kB Progress (3): 651/780 kB | 146/329 kB | 501 kB Progress (3): 668/780 kB | 146/329 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.2 MB/s) 2024-09-12T00:17:46.185 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:17:46.189 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 684/780 kB | 146/329 kB Progress (2): 701/780 kB | 146/329 kB Progress (2): 701/780 kB | 163/329 kB Progress (2): 717/780 kB | 163/329 kB Progress (2): 717/780 kB | 179/329 kB Progress (2): 733/780 kB | 179/329 kB Progress (2): 733/780 kB | 195/329 kB Progress (2): 750/780 kB | 195/329 kB Progress (2): 766/780 kB | 195/329 kB Progress (2): 766/780 kB | 212/329 kB Progress (2): 766/780 kB | 228/329 kB Progress (2): 766/780 kB | 245/329 kB Progress (2): 766/780 kB | 261/329 kB Progress (2): 780 kB | 261/329 kB Progress (2): 780 kB | 277/329 kB Progress (2): 780 kB | 294/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.8 MB/s) 2024-09-12T00:17:46.189 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:17:46.191 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 310/329 kB Progress (1): 327/329 kB Progress (1): 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-12T00:17:46.191 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:17:46.195 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 38 kB/s) 2024-09-12T00:17:46.195 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:17:46.222 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/586 kB Progress (1): 32/586 kB Progress (1): 49/586 kB Progress (1): 65/586 kB Progress (1): 81/586 kB Progress (1): 98/586 kB Progress (1): 114/586 kB Progress (1): 130/586 kB Progress (1): 147/586 kB Progress (1): 163/586 kB Progress (1): 180/586 kB Progress (1): 196/586 kB Progress (1): 212/586 kB Progress (1): 229/586 kB Progress (1): 245/586 kB Progress (1): 262/586 kB Progress (1): 278/586 kB Progress (1): 294/586 kB Progress (1): 311/586 kB Progress (1): 327/586 kB Progress (1): 343/586 kB Progress (1): 360/586 kB Progress (1): 376/586 kB Progress (1): 393/586 kB Progress (2): 393/586 kB | 16/211 kB Progress (2): 402/586 kB | 16/211 kB Progress (2): 402/586 kB | 33/211 kB Progress (3): 402/586 kB | 33/211 kB | 14 kB Progress (3): 402/586 kB | 49/211 kB | 14 kB Progress (3): 418/586 kB | 49/211 kB | 14 kB Progress (4): 418/586 kB | 49/211 kB | 14 kB | 16/106 kB Progress (4): 418/586 kB | 66/211 kB | 14 kB | 16/106 kB Progress (4): 435/586 kB | 66/211 kB | 14 kB | 16/106 kB Progress (4): 435/586 kB | 66/211 kB | 14 kB | 32/106 kB Progress (4): 435/586 kB | 82/211 kB | 14 kB | 32/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 74 kB/s) 2024-09-12T00:17:46.222 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:17:46.224 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 451/586 kB | 82/211 kB | 32/106 kB Progress (3): 451/586 kB | 98/211 kB | 32/106 kB Progress (3): 451/586 kB | 98/211 kB | 49/106 kB Progress (3): 451/586 kB | 115/211 kB | 49/106 kB Progress (3): 468/586 kB | 115/211 kB | 49/106 kB Progress (3): 468/586 kB | 115/211 kB | 65/106 kB Progress (3): 468/586 kB | 131/211 kB | 65/106 kB Progress (3): 484/586 kB | 131/211 kB | 65/106 kB Progress (3): 484/586 kB | 131/211 kB | 81/106 kB Progress (3): 484/586 kB | 147/211 kB | 81/106 kB Progress (3): 500/586 kB | 147/211 kB | 81/106 kB Progress (3): 500/586 kB | 164/211 kB | 81/106 kB Progress (3): 500/586 kB | 164/211 kB | 98/106 kB Progress (3): 500/586 kB | 180/211 kB | 98/106 kB Progress (3): 500/586 kB | 180/211 kB | 106 kB Progress (3): 517/586 kB | 180/211 kB | 106 kB Progress (3): 517/586 kB | 197/211 kB | 106 kB Progress (3): 533/586 kB | 197/211 kB | 106 kB Progress (3): 533/586 kB | 211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 542 kB/s) 2024-09-12T00:17:46.224 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 549/586 kB | 211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:17:46.224 INFO:tasks.workunit.client.0.smithi033.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-12T00:17:46.224 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:17:46.225 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 566/586 kB Progress (1): 582/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.0 MB/s) 2024-09-12T00:17:46.225 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:17:46.239 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 32 kB/s) 2024-09-12T00:17:46.239 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:17:46.242 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/205 kB Progress (1): 32/205 kB Progress (1): 49/205 kB Progress (2): 49/205 kB | 16/245 kB Progress (2): 65/205 kB | 16/245 kB Progress (3): 65/205 kB | 16/245 kB | 15 kB Progress (3): 81/205 kB | 16/245 kB | 15 kB Progress (3): 81/205 kB | 32/245 kB | 15 kB Progress (3): 98/205 kB | 32/245 kB | 15 kB Progress (3): 98/205 kB | 49/245 kB | 15 kB Progress (3): 114/205 kB | 49/245 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 71 kB/s) 2024-09-12T00:17:46.242 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:17:46.245 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 114/205 kB | 65/245 kB Progress (2): 130/205 kB | 65/245 kB Progress (2): 147/205 kB | 65/245 kB Progress (2): 147/205 kB | 81/245 kB Progress (2): 163/205 kB | 81/245 kB Progress (2): 163/205 kB | 98/245 kB Progress (2): 180/205 kB | 98/245 kB Progress (2): 180/205 kB | 114/245 kB Progress (2): 196/205 kB | 114/245 kB Progress (2): 196/205 kB | 130/245 kB Progress (2): 205 kB | 130/245 kB Progress (2): 205 kB | 147/245 kB Progress (2): 205 kB | 163/245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 944 kB/s) 2024-09-12T00:17:46.245 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 180/245 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:17:46.246 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 196/245 kB Progress (1): 212/245 kB Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-09-12T00:17:46.246 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:17:46.254 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/354 kB Progress (1): 32/354 kB Progress (1): 49/354 kB Progress (1): 65/354 kB Progress (1): 81/354 kB Progress (1): 98/354 kB Progress (1): 114/354 kB Progress (1): 130/354 kB Progress (1): 147/354 kB Progress (1): 163/354 kB Progress (1): 180/354 kB Progress (1): 196/354 kB Progress (1): 209/354 kB Progress (1): 225/354 kB Progress (1): 242/354 kB Progress (1): 258/354 kB Progress (1): 274/354 kB Progress (1): 291/354 kB Progress (1): 307/354 kB Progress (2): 307/354 kB | 16/16 kB Progress (2): 324/354 kB | 16/16 kB Progress (2): 324/354 kB | 16 kB Progress (2): 340/354 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 73 kB/s) 2024-09-12T00:17:46.254 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:17:46.254 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.6 MB/s) 2024-09-12T00:17:46.254 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:17:46.257 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 28 kB/s) 2024-09-12T00:17:46.261 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/24 kB Progress (2): 23 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 97 kB/s) 2024-09-12T00:17:46.261 INFO:tasks.workunit.client.0.smithi033.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 104 kB/s) 2024-09-12T00:17:46.274 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 747 kB/s) 2024-09-12T00:17:46.277 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 70 kB/s) 2024-09-12T00:17:46.296 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:46.296 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:17:46.302 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:17:46.323 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 278 kB/s) 2024-09-12T00:17:46.325 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:17:46.343 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 268 kB/s) 2024-09-12T00:17:46.345 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:17:46.373 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 1.5 MB/s) 2024-09-12T00:17:46.377 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:17:46.393 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-09-12T00:17:46.397 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:17:46.420 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.0 MB/s) 2024-09-12T00:17:46.420 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:17:46.461 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 130/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 5.2 MB/s) 2024-09-12T00:17:46.498 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:46.498 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:17:46.501 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:17:46.545 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 60 kB/s) 2024-09-12T00:17:46.547 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:17:46.592 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 500 kB/s) 2024-09-12T00:17:46.596 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:17:46.615 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 438 kB/s) 2024-09-12T00:17:46.617 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:17:46.639 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.2 MB/s) 2024-09-12T00:17:46.641 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:17:46.657 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-09-12T00:17:46.659 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:17:46.675 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 189 kB/s) 2024-09-12T00:17:46.678 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:17:46.693 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T00:17:46.695 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:17:46.710 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 171 kB/s) 2024-09-12T00:17:46.712 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:17:46.727 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 940 kB/s) 2024-09-12T00:17:46.729 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:17:46.743 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T00:17:46.744 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:17:46.765 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 418 kB/s) 2024-09-12T00:17:46.766 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:17:46.808 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 204 kB/s) 2024-09-12T00:17:46.810 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:17:46.842 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 258 kB/s) 2024-09-12T00:17:46.844 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:17:46.863 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.0 MB/s) 2024-09-12T00:17:46.868 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:17:46.886 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 283 kB/s) 2024-09-12T00:17:46.888 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:17:46.905 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.9 MB/s) 2024-09-12T00:17:46.909 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:17:46.924 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T00:17:46.928 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:17:46.946 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-09-12T00:17:46.947 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:17:46.947 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:17:46.947 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:17:46.947 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:17:46.948 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:17:46.962 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/41 kB Progress (1): 33/41 kB Progress (1): 41 kB Progress (2): 41 kB | 16/55 kB Progress (3): 41 kB | 16/55 kB | 2.5 kB Progress (3): 41 kB | 33/55 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T00:17:46.962 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:17:46.962 INFO:tasks.workunit.client.0.smithi033.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-12T00:17:46.963 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:17:46.963 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 49/55 kB Progress (1): 55 kB Progress (2): 55 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-12T00:17:46.963 INFO:tasks.workunit.client.0.smithi033.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-12T00:17:46.978 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15/269 kB Progress (1): 31/269 kB Progress (1): 48/269 kB Progress (1): 64/269 kB Progress (1): 80/269 kB Progress (1): 96/269 kB Progress (1): 112/269 kB Progress (1): 129/269 kB Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 8.7 MB/s) 2024-09-12T00:17:46.983 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/327 kB Progress (1): 32/327 kB Progress (2): 32/327 kB | 16/587 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 49/327 kB | 32/587 kB Progress (2): 65/327 kB | 32/587 kB Progress (2): 65/327 kB | 49/587 kB Progress (2): 81/327 kB | 49/587 kB Progress (2): 81/327 kB | 65/587 kB Progress (2): 98/327 kB | 65/587 kB Progress (2): 98/327 kB | 81/587 kB Progress (2): 114/327 kB | 81/587 kB Progress (2): 114/327 kB | 98/587 kB Progress (2): 130/327 kB | 98/587 kB Progress (2): 130/327 kB | 114/587 kB Progress (2): 147/327 kB | 114/587 kB Progress (2): 147/327 kB | 130/587 kB Progress (2): 163/327 kB | 130/587 kB Progress (2): 163/327 kB | 147/587 kB Progress (2): 180/327 kB | 147/587 kB Progress (2): 180/327 kB | 163/587 kB Progress (2): 196/327 kB | 163/587 kB Progress (2): 196/327 kB | 180/587 kB Progress (2): 212/327 kB | 180/587 kB Progress (2): 212/327 kB | 196/587 kB Progress (2): 229/327 kB | 196/587 kB Progress (2): 229/327 kB | 212/587 kB Progress (2): 245/327 kB | 212/587 kB Progress (2): 245/327 kB | 219/587 kB Progress (2): 262/327 kB | 219/587 kB Progress (2): 262/327 kB | 236/587 kB Progress (2): 278/327 kB | 236/587 kB Progress (2): 278/327 kB | 252/587 kB Progress (2): 294/327 kB | 252/587 kB Progress (2): 294/327 kB | 268/587 kB Progress (2): 311/327 kB | 268/587 kB Progress (2): 311/327 kB | 285/587 kB Progress (2): 327/327 kB | 285/587 kB Progress (2): 327 kB | 285/587 kB Progress (2): 327 kB | 301/587 kB Progress (2): 327 kB | 318/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.1 MB/s) 2024-09-12T00:17:46.987 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 334/587 kB Progress (1): 350/587 kB Progress (1): 367/587 kB Progress (1): 383/587 kB Progress (1): 399/587 kB Progress (1): 416/587 kB Progress (1): 432/587 kB Progress (1): 449/587 kB Progress (1): 465/587 kB Progress (1): 475/587 kB Progress (1): 491/587 kB Progress (1): 508/587 kB Progress (1): 524/587 kB Progress (1): 541/587 kB Progress (1): 557/587 kB Progress (1): 573/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T00:17:47.028 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:17:47.029 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:47.029 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:17:47.034 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:17:47.058 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 206 kB/s) 2024-09-12T00:17:47.060 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:17:47.077 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 374 kB/s) 2024-09-12T00:17:47.079 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:17:47.093 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-12T00:17:47.095 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:17:47.112 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 822 kB/s) 2024-09-12T00:17:47.116 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:17:47.155 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 20 kB/s) 2024-09-12T00:17:47.158 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:17:47.192 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 125 kB/s) 2024-09-12T00:17:47.194 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:17:47.209 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T00:17:47.213 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:17:47.228 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-12T00:17:47.230 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:17:47.244 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T00:17:47.248 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:17:47.262 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T00:17:47.264 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:17:47.280 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 706 kB/s) 2024-09-12T00:17:47.283 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:17:47.298 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T00:17:47.301 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:17:47.316 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 411 kB/s) 2024-09-12T00:17:47.319 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:17:47.335 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-09-12T00:17:47.337 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:17:47.351 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-12T00:17:47.353 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:17:47.368 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-12T00:17:47.371 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:17:47.387 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-12T00:17:47.390 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:17:47.411 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 54 kB/s) 2024-09-12T00:17:47.414 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:17:47.431 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-12T00:17:47.433 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:17:47.448 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-12T00:17:47.449 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:17:47.465 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-12T00:17:47.468 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:17:47.482 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-12T00:17:47.484 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:17:47.497 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-12T00:17:47.505 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:17:47.523 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 752 kB/s) 2024-09-12T00:17:47.523 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:17:47.523 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:17:47.523 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:17:47.523 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:17:47.523 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:17:47.541 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/122 kB Progress (1): 32/122 kB Progress (2): 32/122 kB | 16/334 kB Progress (2): 49/122 kB | 16/334 kB Progress (2): 49/122 kB | 33/334 kB Progress (3): 49/122 kB | 33/334 kB | 16/55 kB Progress (3): 65/122 kB | 33/334 kB | 16/55 kB Progress (3): 65/122 kB | 49/334 kB | 16/55 kB Progress (4): 65/122 kB | 49/334 kB | 16/55 kB | 16/27 kB Progress (4): 81/122 kB | 49/334 kB | 16/55 kB | 16/27 kB Progress (4): 81/122 kB | 62/334 kB | 16/55 kB | 16/27 kB Progress (4): 81/122 kB | 62/334 kB | 32/55 kB | 16/27 kB Progress (4): 81/122 kB | 62/334 kB | 32/55 kB | 27 kB Progress (4): 98/122 kB | 62/334 kB | 32/55 kB | 27 kB Progress (4): 98/122 kB | 79/334 kB | 32/55 kB | 27 kB Progress (4): 114/122 kB | 79/334 kB | 32/55 kB | 27 kB Progress (4): 114/122 kB | 95/334 kB | 32/55 kB | 27 kB Progress (4): 114/122 kB | 95/334 kB | 49/55 kB | 27 kB Progress (4): 122 kB | 95/334 kB | 49/55 kB | 27 kB Progress (4): 122 kB | 95/334 kB | 55 kB | 27 kB Progress (4): 122 kB | 111/334 kB | 55 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.6 MB/s) 2024-09-12T00:17:47.541 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:17:47.541 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (4): 122 kB | 111/334 kB | 55 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-12T00:17:47.542 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:17:47.542 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 128/334 kB | 55 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-12T00:17:47.542 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:17:47.542 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 144/334 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 248 kB/s) 2024-09-12T00:17:47.543 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 161/334 kB Progress (1): 177/334 kB Progress (1): 193/334 kB Progress (1): 210/334 kB Progress (1): 226/334 kB Progress (1): 242/334 kB Progress (1): 259/334 kB Progress (1): 275/334 kB Progress (1): 292/334 kB Progress (1): 308/334 kB Progress (1): 324/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T00:17:47.555 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 712 kB/s) 2024-09-12T00:17:47.556 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 137 kB/s) 2024-09-12T00:17:47.561 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.0 MB/s) 2024-09-12T00:17:47.609 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:17:47.610 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:17:48.248 INFO:tasks.workunit.client.0.smithi033.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:17:48.249 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:48.249 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:17:48.251 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:17:48.251 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:48.251 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:17:48.255 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:17:48.256 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:17:48.405 INFO:tasks.workunit.client.0.smithi033.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:17:48.405 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:48.405 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:17:48.409 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:17:48.425 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T00:17:48.429 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:17:48.444 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T00:17:48.447 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:17:48.467 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 163 kB/s) 2024-09-12T00:17:48.471 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:17:48.488 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 239 kB/s) 2024-09-12T00:17:48.490 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:17:48.506 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 207 kB/s) 2024-09-12T00:17:48.510 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:17:48.527 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 262 kB/s) 2024-09-12T00:17:48.530 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:17:48.545 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-12T00:17:48.548 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:17:48.563 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-12T00:17:48.565 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:17:48.580 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-12T00:17:48.583 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:17:48.598 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:17:48.601 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:17:48.616 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 362 kB/s) 2024-09-12T00:17:48.619 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:17:48.640 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 112 kB/s) 2024-09-12T00:17:48.642 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:17:48.657 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-12T00:17:48.659 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:17:48.674 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-12T00:17:48.677 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:17:48.693 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 952 kB/s) 2024-09-12T00:17:48.696 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:17:48.711 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 577 kB/s) 2024-09-12T00:17:48.712 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:17:48.728 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-12T00:17:48.731 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:17:48.747 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-12T00:17:48.750 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:17:48.768 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 114 kB/s) 2024-09-12T00:17:48.771 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:17:48.786 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T00:17:48.789 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:17:48.803 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T00:17:48.804 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:17:48.818 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 236 kB/s) 2024-09-12T00:17:48.819 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:17:48.835 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.3 MB/s) 2024-09-12T00:17:48.838 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:17:48.852 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T00:17:48.853 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:17:48.867 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T00:17:48.869 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:17:48.883 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 228 kB/s) 2024-09-12T00:17:48.884 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:17:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-12T00:17:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:17:48.914 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-09-12T00:17:48.917 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:17:48.930 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-12T00:17:48.932 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:17:48.946 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-12T00:17:48.950 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:17:48.965 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 189 kB/s) 2024-09-12T00:17:48.968 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:17:48.985 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-09-12T00:17:48.987 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:17:49.008 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 691 kB/s) 2024-09-12T00:17:49.010 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:17:49.026 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 840 kB/s) 2024-09-12T00:17:49.028 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:17:49.041 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T00:17:49.043 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:17:49.058 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 418 kB/s) 2024-09-12T00:17:49.060 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:17:49.076 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15/32 kB Progress (1): 31/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-12T00:17:49.078 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:17:49.093 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T00:17:49.094 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:17:49.111 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-12T00:17:49.113 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:17:49.129 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 50 kB/s) 2024-09-12T00:17:49.130 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:17:49.144 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T00:17:49.146 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:17:49.161 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-12T00:17:49.163 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:17:49.177 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-12T00:17:49.179 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:17:49.195 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-12T00:17:49.197 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:17:49.211 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-12T00:17:49.213 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:17:49.227 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-12T00:17:49.229 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:17:49.243 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-12T00:17:49.245 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:17:49.260 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-12T00:17:49.261 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:17:49.276 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-12T00:17:49.278 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:17:49.293 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-12T00:17:49.294 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:17:49.308 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-12T00:17:49.310 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:17:49.325 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-12T00:17:49.327 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:17:49.340 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T00:17:49.343 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:17:49.360 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-09-12T00:17:49.362 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:17:49.377 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T00:17:49.378 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:17:49.395 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.9 MB/s) 2024-09-12T00:17:49.398 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:17:49.413 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-12T00:17:49.416 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:17:49.431 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-12T00:17:49.433 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:17:49.450 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 251 kB/s) 2024-09-12T00:17:49.451 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:17:49.467 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T00:17:49.468 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:17:49.483 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.7 MB/s) 2024-09-12T00:17:49.486 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:17:49.500 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-12T00:17:49.505 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:17:49.524 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 16 MB/s) 2024-09-12T00:17:49.525 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:17:49.525 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:17:49.525 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:17:49.525 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:17:49.525 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:17:49.540 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Progress (2): 26 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.7 MB/s) 2024-09-12T00:17:49.540 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:17:49.540 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 14 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-12T00:17:49.540 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:17:49.541 INFO:tasks.workunit.client.0.smithi033.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 511 kB/s) 2024-09-12T00:17:49.541 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:17:49.544 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/118 kB Progress (1): 33/118 kB Progress (1): 49/118 kB Progress (1): 66/118 kB Progress (1): 82/118 kB Progress (1): 98/118 kB Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.2 MB/s) 2024-09-12T00:17:49.544 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:17:49.549 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 66/171 kB Progress (1): 82/171 kB Progress (1): 98/171 kB Progress (1): 115/171 kB Progress (1): 131/171 kB Progress (1): 147/171 kB Progress (1): 164/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 6.8 MB/s) 2024-09-12T00:17:49.549 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:17:49.557 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/61 kB Progress (2): 33/136 kB | 16/61 kB Progress (2): 33/136 kB | 33/61 kB Progress (3): 33/136 kB | 33/61 kB | 16/146 kB Progress (3): 49/136 kB | 33/61 kB | 16/146 kB Progress (3): 49/136 kB | 49/61 kB | 16/146 kB Progress (3): 65/136 kB | 49/61 kB | 16/146 kB Progress (3): 65/136 kB | 49/61 kB | 32/146 kB Progress (3): 65/136 kB | 61 kB | 32/146 kB Progress (3): 81/136 kB | 61 kB | 32/146 kB Progress (3): 81/136 kB | 61 kB | 49/146 kB Progress (3): 98/136 kB | 61 kB | 49/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-12T00:17:49.557 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:17:49.558 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 98/136 kB | 65/146 kB Progress (2): 114/136 kB | 65/146 kB Progress (2): 130/136 kB | 65/146 kB Progress (2): 130/136 kB | 81/146 kB Progress (2): 136 kB | 81/146 kB Progress (2): 136 kB | 98/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.1 MB/s) 2024-09-12T00:17:49.558 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 114/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:17:49.559 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 130/146 kB Progress (1): 146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.3 MB/s) 2024-09-12T00:17:49.568 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/501 kB Progress (1): 32/501 kB Progress (1): 49/501 kB Progress (1): 65/501 kB Progress (1): 81/501 kB Progress (1): 98/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 180/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (2): 360/501 kB | 16/58 kB Progress (2): 376/501 kB | 16/58 kB Progress (2): 393/501 kB | 16/58 kB Progress (2): 409/501 kB | 16/58 kB Progress (2): 425/501 kB | 16/58 kB Progress (2): 442/501 kB | 16/58 kB Progress (2): 458/501 kB | 16/58 kB Progress (2): 475/501 kB | 16/58 kB Progress (2): 491/501 kB | 16/58 kB Progress (2): 501 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-12T00:17:49.573 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 16/58 kB | 15/124 kB Progress (2): 32/58 kB | 15/124 kB Progress (2): 32/58 kB | 31/124 kB Progress (2): 49/58 kB | 31/124 kB Progress (2): 49/58 kB | 48/124 kB Progress (2): 58 kB | 48/124 kB Progress (2): 58 kB | 64/124 kB Progress (3): 58 kB | 64/124 kB | 0/2.4 MB Progress (3): 58 kB | 81/124 kB | 0/2.4 MB Progress (3): 58 kB | 81/124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.2 MB/s) 2024-09-12T00:17:49.574 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 81/124 kB | 0/2.4 MB Progress (2): 97/124 kB | 0/2.4 MB Progress (2): 97/124 kB | 0.1/2.4 MB Progress (2): 110/124 kB | 0.1/2.4 MB Progress (2): 110/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.5 MB/s) 2024-09-12T00:17:49.606 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 30 MB/s) 2024-09-12T00:17:49.701 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:49.701 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:17:49.705 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:17:49.729 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 187 kB/s) 2024-09-12T00:17:49.731 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:17:49.746 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-12T00:17:49.748 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:17:49.764 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15/45 kB Progress (1): 31/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T00:17:49.767 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:17:49.784 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 9.6/21 kB Progress (1): 18/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.3 MB/s) 2024-09-12T00:17:49.786 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:17:49.800 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T00:17:49.802 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:17:49.818 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-12T00:17:49.820 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:17:49.835 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-09-12T00:17:49.837 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:17:49.852 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T00:17:49.854 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:17:49.868 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.3 MB/s) 2024-09-12T00:17:49.872 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:17:49.886 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 969 kB/s) 2024-09-12T00:17:49.888 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:17:49.903 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-12T00:17:49.905 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:17:49.929 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 357 kB/s) 2024-09-12T00:17:49.931 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:17:49.946 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-12T00:17:49.950 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:17:49.965 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-12T00:17:49.967 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:17:49.967 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:17:49.967 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:17:49.967 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:17:49.968 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:17:49.981 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/26 kB Progress (2): 16/58 kB | 26 kB Progress (2): 32/58 kB | 26 kB Progress (2): 49/58 kB | 26 kB Progress (2): 58 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-12T00:17:49.981 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:17:49.981 INFO:tasks.workunit.client.0.smithi033.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-12T00:17:49.982 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:17:49.984 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (2): 49/79 kB | 0/1.0 MB Progress (2): 65/79 kB | 0/1.0 MB Progress (2): 65/79 kB | 0/1.0 MB Progress (2): 65/79 kB | 0/1.0 MB Progress (2): 79 kB | 0/1.0 MB Progress (2): 79 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T00:17:50.003 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/211 kB Progress (2): 0.6/1.0 MB | 16/211 kB Progress (2): 0.6/1.0 MB | 32/211 kB Progress (2): 0.6/1.0 MB | 32/211 kB Progress (2): 0.6/1.0 MB | 49/211 kB Progress (2): 0.7/1.0 MB | 49/211 kB Progress (2): 0.7/1.0 MB | 65/211 kB Progress (2): 0.7/1.0 MB | 65/211 kB Progress (2): 0.7/1.0 MB | 78/211 kB Progress (2): 0.7/1.0 MB | 78/211 kB Progress (2): 0.7/1.0 MB | 94/211 kB Progress (2): 0.7/1.0 MB | 94/211 kB Progress (2): 0.7/1.0 MB | 111/211 kB Progress (2): 0.7/1.0 MB | 111/211 kB Progress (2): 0.7/1.0 MB | 127/211 kB Progress (2): 0.7/1.0 MB | 127/211 kB Progress (2): 0.7/1.0 MB | 144/211 kB Progress (2): 0.8/1.0 MB | 144/211 kB Progress (2): 0.8/1.0 MB | 160/211 kB Progress (2): 0.8/1.0 MB | 160/211 kB Progress (3): 0.8/1.0 MB | 160/211 kB | 16/116 kB Progress (3): 0.8/1.0 MB | 176/211 kB | 16/116 kB Progress (3): 0.8/1.0 MB | 176/211 kB | 16/116 kB Progress (3): 0.8/1.0 MB | 176/211 kB | 33/116 kB Progress (3): 0.8/1.0 MB | 193/211 kB | 33/116 kB Progress (3): 0.8/1.0 MB | 193/211 kB | 49/116 kB Progress (3): 0.8/1.0 MB | 193/211 kB | 49/116 kB Progress (3): 0.8/1.0 MB | 209/211 kB | 49/116 kB Progress (3): 0.8/1.0 MB | 209/211 kB | 63/116 kB Progress (3): 0.8/1.0 MB | 211 kB | 63/116 kB Progress (3): 0.8/1.0 MB | 211 kB | 63/116 kB Progress (3): 0.8/1.0 MB | 211 kB | 79/116 kB Progress (3): 0.8/1.0 MB | 211 kB | 79/116 kB Progress (3): 0.8/1.0 MB | 211 kB | 95/116 kB Progress (3): 0.8/1.0 MB | 211 kB | 112/116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 6.8 MB/s) 2024-09-12T00:17:50.004 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 0.9/1.0 MB | 112/116 kB Progress (2): 0.9/1.0 MB | 116 kB Progress (3): 0.9/1.0 MB | 116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 116 kB | 16/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-12T00:17:50.004 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 0.9/1.0 MB | 16/267 kB Progress (2): 0.9/1.0 MB | 32/267 kB Progress (2): 0.9/1.0 MB | 32/267 kB Progress (2): 0.9/1.0 MB | 49/267 kB Progress (2): 0.9/1.0 MB | 49/267 kB Progress (2): 0.9/1.0 MB | 65/267 kB Progress (2): 0.9/1.0 MB | 65/267 kB Progress (2): 0.9/1.0 MB | 81/267 kB Progress (2): 1.0/1.0 MB | 81/267 kB Progress (2): 1.0/1.0 MB | 98/267 kB Progress (2): 1.0/1.0 MB | 98/267 kB Progress (2): 1.0/1.0 MB | 114/267 kB Progress (2): 1.0/1.0 MB | 114/267 kB Progress (2): 1.0/1.0 MB | 130/267 kB Progress (2): 1.0/1.0 MB | 130/267 kB Progress (2): 1.0/1.0 MB | 147/267 kB Progress (2): 1.0 MB | 147/267 kB Progress (2): 1.0 MB | 163/267 kB Progress (2): 1.0 MB | 180/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 30 MB/s) 2024-09-12T00:17:50.004 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 196/267 kB Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.6 MB/s) 2024-09-12T00:17:50.149 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:17:50.174 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:17:50.174 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:17:50.175 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:17:50.175 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Total time: 6.285 s 2024-09-12T00:17:50.176 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Finished at: 2024-09-12T00:17:50Z 2024-09-12T00:17:50.176 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:17:50.198 INFO:tasks.workunit.client.0.smithi033.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:17:50.208 INFO:tasks.workunit.client.0.smithi033.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:17:51.280 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Scanning for projects... 2024-09-12T00:17:51.378 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:51.378 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:17:51.378 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:17:51.378 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] from pom.xml 2024-09-12T00:17:51.378 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:17:51.725 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:51.725 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:17:51.830 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:17:51.831 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:51.831 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:17:51.918 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:17:51.918 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:51.918 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:17:51.920 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:17:51.921 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:51.921 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:17:51.925 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:17:51.925 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:51.925 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:17:52.112 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:17:52.343 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:17:52.548 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 22 kB/s) 2024-09-12T00:17:52.557 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:17:52.575 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-12T00:17:52.580 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:17:52.599 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-12T00:17:52.603 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:17:52.623 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 151 kB/s) 2024-09-12T00:17:52.626 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:17:52.643 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T00:17:52.645 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:17:52.662 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T00:17:52.664 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:17:52.682 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T00:17:52.686 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:17:52.712 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 17/27 kB Progress (1): 19/27 kB Progress (1): 20/27 kB Progress (1): 21/27 kB Progress (1): 23/27 kB Progress (1): 24/27 kB Progress (1): 25/27 kB Progress (1): 27/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-12T00:17:52.713 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:17:52.713 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:17:52.714 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:17:52.714 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:17:52.715 INFO:tasks.workunit.client.0.smithi033.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:17:52.733 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 836 kB/s) 2024-09-12T00:17:52.769 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 1.4/189 kB Progress (2): 1.4/189 kB | 1.4/7.7 kB Progress (2): 2.8/189 kB | 1.4/7.7 kB Progress (2): 2.8/189 kB | 2.8/7.7 kB Progress (2): 4.1/189 kB | 2.8/7.7 kB Progress (3): 4.1/189 kB | 2.8/7.7 kB | 1.4/103 kB Progress (3): 5.5/189 kB | 2.8/7.7 kB | 1.4/103 kB Progress (3): 5.5/189 kB | 2.8/7.7 kB | 2.8/103 kB Progress (3): 5.5/189 kB | 4.1/7.7 kB | 2.8/103 kB Progress (3): 5.5/189 kB | 4.1/7.7 kB | 4.1/103 kB Progress (3): 5.5/189 kB | 5.5/7.7 kB | 4.1/103 kB Progress (4): 5.5/189 kB | 5.5/7.7 kB | 4.1/103 kB | 1.4/169 kB Progress (4): 6.9/189 kB | 5.5/7.7 kB | 4.1/103 kB | 1.4/169 kB Progress (4): 6.9/189 kB | 5.5/7.7 kB | 4.1/103 kB | 2.8/169 kB Progress (4): 6.9/189 kB | 6.9/7.7 kB | 4.1/103 kB | 2.8/169 kB Progress (4): 6.9/189 kB | 6.9/7.7 kB | 5.5/103 kB | 2.8/169 kB Progress (4): 6.9/189 kB | 7.7 kB | 5.5/103 kB | 2.8/169 kB Progress (4): 6.9/189 kB | 7.7 kB | 5.5/103 kB | 4.1/169 kB Progress (4): 8.3/189 kB | 7.7 kB | 5.5/103 kB | 4.1/169 kB Progress (4): 8.3/189 kB | 7.7 kB | 5.5/103 kB | 5.5/169 kB Progress (4): 8.3/189 kB | 7.7 kB | 6.9/103 kB | 5.5/169 kB Progress (4): 8.3/189 kB | 7.7 kB | 6.9/103 kB | 6.9/169 kB Progress (4): 8.3/189 kB | 7.7 kB | 8.3/103 kB | 6.9/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 139 kB/s) 2024-09-12T00:17:52.801 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (3): 9.7/189 kB | 8.3/103 kB | 6.9/169 kB Progress (3): 9.7/189 kB | 9.7/103 kB | 6.9/169 kB Progress (3): 9.7/189 kB | 9.7/103 kB | 8.3/169 kB Progress (3): 11/189 kB | 9.7/103 kB | 8.3/169 kB Progress (3): 11/189 kB | 9.7/103 kB | 9.7/169 kB Progress (3): 12/189 kB | 9.7/103 kB | 9.7/169 kB Progress (3): 12/189 kB | 11/103 kB | 9.7/169 kB Progress (3): 14/189 kB | 11/103 kB | 9.7/169 kB Progress (3): 14/189 kB | 11/103 kB | 11/169 kB Progress (3): 15/189 kB | 11/103 kB | 11/169 kB Progress (3): 15/189 kB | 12/103 kB | 11/169 kB Progress (3): 16/189 kB | 12/103 kB | 11/169 kB Progress (3): 16/189 kB | 12/103 kB | 12/169 kB Progress (3): 18/189 kB | 12/103 kB | 12/169 kB Progress (3): 18/189 kB | 14/103 kB | 12/169 kB Progress (3): 19/189 kB | 14/103 kB | 12/169 kB Progress (3): 19/189 kB | 14/103 kB | 14/169 kB Progress (3): 19/189 kB | 15/103 kB | 14/169 kB Progress (3): 19/189 kB | 15/103 kB | 15/169 kB Progress (3): 21/189 kB | 15/103 kB | 15/169 kB Progress (3): 21/189 kB | 15/103 kB | 17/169 kB Progress (3): 21/189 kB | 17/103 kB | 17/169 kB Progress (3): 21/189 kB | 17/103 kB | 18/169 kB Progress (3): 22/189 kB | 17/103 kB | 18/169 kB Progress (3): 22/189 kB | 17/103 kB | 19/169 kB Progress (3): 22/189 kB | 18/103 kB | 19/169 kB Progress (3): 22/189 kB | 18/103 kB | 21/169 kB Progress (3): 23/189 kB | 18/103 kB | 21/169 kB Progress (3): 23/189 kB | 18/103 kB | 22/169 kB Progress (3): 23/189 kB | 19/103 kB | 22/169 kB Progress (3): 23/189 kB | 19/103 kB | 23/169 kB Progress (3): 25/189 kB | 19/103 kB | 23/169 kB Progress (3): 25/189 kB | 19/103 kB | 25/169 kB Progress (3): 25/189 kB | 21/103 kB | 25/169 kB Progress (3): 25/189 kB | 21/103 kB | 26/169 kB Progress (3): 26/189 kB | 21/103 kB | 26/169 kB Progress (3): 26/189 kB | 21/103 kB | 28/169 kB Progress (3): 26/189 kB | 22/103 kB | 28/169 kB Progress (3): 26/189 kB | 22/103 kB | 29/169 kB Progress (3): 27/189 kB | 22/103 kB | 29/169 kB Progress (3): 27/189 kB | 22/103 kB | 30/169 kB Progress (3): 27/189 kB | 23/103 kB | 30/169 kB Progress (3): 27/189 kB | 23/103 kB | 31/169 kB Progress (3): 29/189 kB | 23/103 kB | 31/169 kB Progress (3): 29/189 kB | 25/103 kB | 31/169 kB Progress (3): 30/189 kB | 25/103 kB | 31/169 kB Progress (3): 30/189 kB | 26/103 kB | 31/169 kB Progress (3): 30/189 kB | 26/103 kB | 48/169 kB Progress (3): 32/189 kB | 26/103 kB | 48/169 kB Progress (3): 32/189 kB | 28/103 kB | 48/169 kB Progress (3): 33/189 kB | 28/103 kB | 48/169 kB Progress (3): 33/189 kB | 29/103 kB | 48/169 kB Progress (3): 34/189 kB | 29/103 kB | 48/169 kB Progress (3): 34/189 kB | 30/103 kB | 48/169 kB Progress (3): 36/189 kB | 30/103 kB | 48/169 kB Progress (3): 36/189 kB | 32/103 kB | 48/169 kB Progress (3): 37/189 kB | 32/103 kB | 48/169 kB Progress (3): 37/189 kB | 33/103 kB | 48/169 kB Progress (3): 38/189 kB | 33/103 kB | 48/169 kB Progress (3): 40/189 kB | 33/103 kB | 48/169 kB Progress (3): 41/189 kB | 33/103 kB | 48/169 kB Progress (3): 43/189 kB | 33/103 kB | 48/169 kB Progress (3): 44/189 kB | 33/103 kB | 48/169 kB Progress (3): 44/189 kB | 49/103 kB | 48/169 kB Progress (3): 45/189 kB | 49/103 kB | 48/169 kB Progress (3): 47/189 kB | 49/103 kB | 48/169 kB Progress (3): 48/189 kB | 49/103 kB | 48/169 kB Progress (3): 49/189 kB | 49/103 kB | 48/169 kB Progress (3): 51/189 kB | 49/103 kB | 48/169 kB Progress (3): 51/189 kB | 66/103 kB | 48/169 kB Progress (3): 52/189 kB | 66/103 kB | 48/169 kB Progress (3): 52/189 kB | 66/103 kB | 64/169 kB Progress (3): 54/189 kB | 66/103 kB | 64/169 kB Progress (3): 55/189 kB | 66/103 kB | 64/169 kB Progress (3): 56/189 kB | 66/103 kB | 64/169 kB Progress (3): 58/189 kB | 66/103 kB | 64/169 kB Progress (3): 59/189 kB | 66/103 kB | 64/169 kB Progress (3): 59/189 kB | 82/103 kB | 64/169 kB Progress (3): 61/189 kB | 82/103 kB | 64/169 kB Progress (3): 61/189 kB | 82/103 kB | 81/169 kB Progress (3): 62/189 kB | 82/103 kB | 81/169 kB Progress (3): 63/189 kB | 82/103 kB | 81/169 kB Progress (3): 63/189 kB | 82/103 kB | 97/169 kB Progress (3): 79/189 kB | 82/103 kB | 97/169 kB Progress (3): 79/189 kB | 82/103 kB | 113/169 kB Progress (3): 96/189 kB | 82/103 kB | 113/169 kB Progress (3): 96/189 kB | 82/103 kB | 130/169 kB Progress (3): 112/189 kB | 82/103 kB | 130/169 kB Progress (3): 128/189 kB | 82/103 kB | 130/169 kB Progress (3): 145/189 kB | 82/103 kB | 130/169 kB Progress (3): 145/189 kB | 82/103 kB | 146/169 kB Progress (3): 145/189 kB | 82/103 kB | 162/169 kB Progress (3): 145/189 kB | 82/103 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.9 MB/s) 2024-09-12T00:17:52.804 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (2): 161/189 kB | 82/103 kB Progress (2): 161/189 kB | 98/103 kB Progress (2): 161/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.1 MB/s) 2024-09-12T00:17:52.808 INFO:tasks.workunit.client.0.smithi033.stdout:Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-12T00:17:52.822 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:17:52.822 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:17:52.822 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] T E S T S 2024-09-12T00:17:52.822 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:17:53.248 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:17:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjects.java: starting test run: 2024-09-12T00:17:53.379 INFO:tasks.workunit.client.0.smithi033.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:17:53.379 INFO:tasks.workunit.client.0.smithi033.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:17:53.379 INFO:tasks.workunit.client.0.smithi033.stdout: EndpointUrl=https://smithi033.front.sepia.ceph.com:443 2024-09-12T00:17:53.379 INFO:tasks.workunit.client.0.smithi033.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:17:53.476 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Environment Variables Read 2024-09-12T00:17:53.778 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:17:53.778 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Generating File 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: File Generated 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Generating File 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: File Generated 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Generating File 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: File Generated 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Generating File 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: File Generated 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Generating File 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: File Generated 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Generating File 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: File Generated 2024-09-12T00:17:53.779 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Generated Big Files 2024-09-12T00:17:54.232 INFO:tasks.workunit.client.0.smithi033.stdout:HeadBucketResponse() 2024-09-12T00:17:54.232 INFO:tasks.workunit.client.0.smithi033.stdout:sheik is ready 2024-09-12T00:17:54.232 INFO:tasks.workunit.client.0.smithi033.stdout:DEBUG: Test Bucket Created 2024-09-12T00:17:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:17:54.478 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:17:54.578 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:17:54.678 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:17:54.878 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:17:54.978 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:17:55.279 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:17:55.479 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:17:55.980 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:17:56.481 INFO:tasks.workunit.client.0.smithi033.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:18:00.688 INFO:tasks.workunit.client.0.smithi033.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:18:04.794 INFO:tasks.workunit.client.0.smithi033.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:18:38.093 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-0b 2024-09-12T00:18:38.095 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-8b 2024-09-12T00:18:38.095 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-200b 2024-09-12T00:18:38.095 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-21983b 2024-09-12T00:18:38.096 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-5519b 2024-09-12T00:18:38.097 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-204329b 2024-09-12T00:18:38.098 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-256k 2024-09-12T00:18:38.099 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-1m 2024-09-12T00:18:38.100 INFO:tasks.workunit.client.0.smithi033.stdout:arg: file-1038757b 2024-09-12T00:18:38.133 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:18:38.233 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:38.333 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:18:38.334 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:38.434 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:18:38.434 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:38.534 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:18:38.627 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:38.634 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:18:38.734 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:38.834 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:18:38.934 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:39.034 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:18:39.210 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:39.235 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:18:39.835 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:40.035 INFO:tasks.workunit.client.0.smithi033.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:18:40.336 INFO:tasks.workunit.client.0.smithi033.stdout:PutObjectResponse 2024-09-12T00:18:40.536 INFO:tasks.workunit.client.0.smithi033.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:18:43.539 INFO:tasks.workunit.client.0.smithi033.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:18:48.344 INFO:tasks.workunit.client.0.smithi033.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:19:56.210 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 123.0 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:19:56.230 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:19:56.230 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Results: 2024-09-12T00:19:56.230 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:19:56.230 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:19:56.230 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] 2024-09-12T00:19:56.232 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:19:56.232 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:19:56.232 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:19:56.233 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Total time: 02:04 min 2024-09-12T00:19:56.234 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] Finished at: 2024-09-12T00:19:56Z 2024-09-12T00:19:56.234 INFO:tasks.workunit.client.0.smithi033.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:19:56.257 INFO:tasks.workunit.client.0.smithi033.stderr:+ exit 2024-09-12T00:19:56.258 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:56.258 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:56.337 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:19:56.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:19:56.728 DEBUG:teuthology.parallel:result is None 2024-09-12T00:19:56.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:19:56.771 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:19:56.771 DEBUG:teuthology.orchestra.run.smithi033:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:19:56.841 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:19:56.841 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:19:56.851 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:19:56.851 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:19:56.852 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:19:56.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:19:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:19:56.912 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:19:56.981 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:19:56.981 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:19:57.051 INFO:tasks.workunit:timeout=3h 2024-09-12T00:19:57.051 INFO:tasks.workunit:cleanup=True 2024-09-12T00:19:57.052 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:19:57.122 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:20:43.367 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-09-12T00:20:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:20:43.369 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-09-12T00:20:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:20:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-09-12T00:20:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:20:43.369 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:20:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:20:43.369 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:20:43.372 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:20:43.442 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:20:43.444 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:20:43.444 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:20:43.494 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:20:43.546 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:20:43.587 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:20:43.589 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:20:43.589 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:20:43.629 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:20:43.633 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:20:43.633 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:20:43.705 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:20:43.709 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:20:43.709 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:20:43.780 INFO:tasks.workunit.client.0.smithi033.stdout:INFO: fully qualified domain name: smithi033.front.sepia.ceph.com 2024-09-12T00:20:43.780 INFO:tasks.workunit.client.0.smithi033.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:20:43.781 INFO:tasks.workunit.client.0.smithi033.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:20:46.395 INFO:tasks.workunit.client.0.smithi033.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:20:46.587 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting pip 2024-09-12T00:20:46.593 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:20:46.639 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: pip 2024-09-12T00:20:46.639 INFO:tasks.workunit.client.0.smithi033.stdout: Attempting uninstall: pip 2024-09-12T00:20:46.639 INFO:tasks.workunit.client.0.smithi033.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:20:46.803 INFO:tasks.workunit.client.0.smithi033.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:20:46.809 INFO:tasks.workunit.client.0.smithi033.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:20:47.581 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed pip-24.2 2024-09-12T00:20:48.439 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting boto3 2024-09-12T00:20:48.440 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:20:48.997 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:20:48.999 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:20:49.050 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:20:49.051 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:20:49.097 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:20:49.098 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:20:49.157 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:20:49.158 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:20:49.237 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:20:49.238 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:20:49.413 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:20:49.414 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:20:49.418 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:20:49.419 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:20:49.429 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:20:49.430 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:20:49.432 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:20:49.433 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:20:49.434 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:20:49.510 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:20:50.559 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:20:51.007 INFO:tasks.workunit.client.0.smithi033.stdout:INFO: creating user 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout:{ 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: "user_id": "testid", 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: "display_name": "M. Tester", 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: "email": "tester@ceph.com", 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: "suspended": 0, 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: "subusers": [], 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: "keys": [ 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: { 2024-09-12T00:20:51.126 INFO:tasks.workunit.client.0.smithi033.stdout: "user": "testid", 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "active": true, 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "create_date": "2024-09-12T00:20:51.119717Z" 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: } 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: ], 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "swift_keys": [], 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "caps": [], 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "default_placement": "", 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "placement_tags": [], 2024-09-12T00:20:51.127 INFO:tasks.workunit.client.0.smithi033.stdout: "bucket_quota": { 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "enabled": false, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size": -1, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "max_objects": -1 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "user_quota": { 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "enabled": false, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size": -1, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: "max_objects": -1 2024-09-12T00:20:51.128 INFO:tasks.workunit.client.0.smithi033.stdout: }, 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: "type": "rgw", 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: "account_id": "", 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: "path": "/", 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: "create_date": "2024-09-12T00:20:51.119701Z", 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: "tags": [], 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: "group_ids": [] 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout:} 2024-09-12T00:20:51.129 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-09-12T00:20:56.375 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:20:56.375 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:20:56.450 INFO:tasks.workunit.client.0.smithi033.stderr:5+0 records in 2024-09-12T00:20:56.450 INFO:tasks.workunit.client.0.smithi033.stderr:5+0 records out 2024-09-12T00:20:56.450 INFO:tasks.workunit.client.0.smithi033.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0143435 s, 366 MB/s 2024-09-12T00:20:56.453 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:20:56.453 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:20:56.532 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:20:56.533 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:20:57.614 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:20:57.614 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:20:58.692 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:20:58.692 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:20:59.781 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:20:59.781 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:00.868 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:00.869 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:01.957 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:01.957 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:03.094 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:03.094 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:04.191 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:04.192 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:05.276 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:05.276 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:06.373 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:06.373 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:07.464 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:07.465 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:08.546 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:08.546 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:09.643 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:09.643 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:10.723 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:21:10.723 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:21:10.838 INFO:tasks.workunit.client.0.smithi033.stdout:bucket nams is reupload-bkt-130879 2024-09-12T00:21:10.838 INFO:tasks.workunit.client.0.smithi033.stdout:endpoint is https://smithi033.front.sepia.ceph.com:443 2024-09-12T00:21:10.838 INFO:tasks.workunit.client.0.smithi033.stdout:start UploadId=2~iVBpgi4pSWZKoS452eXQNylur46vzFe 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 1 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 1 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 2} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:phase 2 uploaded part {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1} 2024-09-12T00:21:10.840 INFO:tasks.workunit.client.0.smithi033.stdout:completing multipart upload, parts=[{'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 1}, {'ETag': '"b50a81fb70ecb3c2e18d8ffba7857965"', 'PartNumber': 2}] 2024-09-12T00:21:11.852 INFO:tasks.workunit.client.0.smithi033.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:21:11.853 INFO:tasks.workunit.client.0.smithi033.stdout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4_mpu_test4 2024-09-12T00:21:11.853 INFO:tasks.workunit.client.0.smithi033.stdout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4__multipart_mpu_test4.2~iVBpgi4pSWZKoS452eXQNylur46vzFe.2 2024-09-12T00:21:11.853 INFO:tasks.workunit.client.0.smithi033.stdout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4__multipart_mpu_test4.yBB9s7uUuIUyoDnPGG4cSch3Iltb9bi2.1 2024-09-12T00:21:11.912 INFO:tasks.workunit.client.0.smithi033.stdout:rados ls: 2024-09-12T00:21:11.913 INFO:tasks.workunit.client.0.smithi033.stdout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4_mpu_test4 2024-09-12T00:21:11.913 INFO:tasks.workunit.client.0.smithi033.stdout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4__multipart_mpu_test4.2~iVBpgi4pSWZKoS452eXQNylur46vzFe.2 2024-09-12T00:21:11.913 INFO:tasks.workunit.client.0.smithi033.stdout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4__multipart_mpu_test4.yBB9s7uUuIUyoDnPGG4cSch3Iltb9bi2.1 2024-09-12T00:21:11.917 INFO:tasks.workunit.client.0.smithi033.stdout:== PASSED == 2024-09-12T00:21:11.917 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:21:11.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:21:11.998 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:21:11.999 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:21:12.399 DEBUG:teuthology.parallel:result is None 2024-09-12T00:21:12.400 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:21:12.440 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:21:12.441 DEBUG:teuthology.orchestra.run.smithi033:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:21:12.510 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:21:12.510 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:21:12.526 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:21:12.526 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:21:12.527 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:21:12.527 DEBUG:teuthology.orchestra.run.smithi033:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:21:12.580 INFO:teuthology.orchestra.run.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:21:12.757 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:21:12.758 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:21:12.758 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key QGDROSUNZGOTNTZUHEGA --secret nrBBeeIQwkqwLuQCuyP3gVP258Idg7jl5wLznTHJzGWcJVGs+MWFhw== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:21:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.905+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.907+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.907+0000 7f520560f800 20 realm 2024-09-12T00:21:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.907+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.907+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.907+0000 7f520560f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.907+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.907+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.907+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.908+0000 7f520560f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.908+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.909+0000 7f520560f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.909+0000 7f520560f800 20 searching for the correct realm 2024-09-12T00:21:12.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:12.919+0000 7f5201523640 0 -- 172.21.15.33:0/1995655732 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f51ec039b70 msgr2=0x7f51ec02c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.126+0000 7f5200d22640 0 -- 172.21.15.33:0/1995655732 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x55840bef2b50 msgr2=0x55840bef4f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.129+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 20 zone default found 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 4 Realm: () 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 20 zonegroup default 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.130+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.131+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.131+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.131+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.131+0000 7f520560f800 20 started sync module instance, tier type = 2024-09-12T00:21:13.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.131+0000 7f520560f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:21:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.141+0000 7f520560f800 20 add_watcher() i=0 2024-09-12T00:21:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.141+0000 7f520560f800 20 add_watcher() i=1 2024-09-12T00:21:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.141+0000 7f520560f800 20 add_watcher() i=2 2024-09-12T00:21:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.141+0000 7f520560f800 20 add_watcher() i=3 2024-09-12T00:21:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.141+0000 7f520560f800 20 add_watcher() i=4 2024-09-12T00:21:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.141+0000 7f520560f800 20 add_watcher() i=5 2024-09-12T00:21:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.141+0000 7f520560f800 20 add_watcher() i=6 2024-09-12T00:21:13.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.142+0000 7f520560f800 20 add_watcher() i=7 2024-09-12T00:21:13.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.142+0000 7f520560f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:13.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.144+0000 7f50b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.144+0000 7f520560f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:13.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.144+0000 7f520560f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:13.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.144+0000 7f520560f800 5 note: GC not initialized 2024-09-12T00:21:13.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.144+0000 7f50b67e4640 20 reqs_thread_entry: start 2024-09-12T00:21:13.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.144+0000 7f520560f800 20 init_complete bucket index max shards: 11 2024-09-12T00:21:13.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.144+0000 7f520560f800 20 Filter name: none 2024-09-12T00:21:13.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f50af7fe640 20 reqs_thread_entry: start 2024-09-12T00:21:13.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:21:13.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:21:13.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:21:13.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:21:13.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:21:13.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:21:13.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 10 cache get: name=default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA : miss 2024-09-12T00:21:13.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.145+0000 7f520560f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.146+0000 7f520560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.146+0000 7f520560f800 10 cache put: name=default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA info.flags=0x0 2024-09-12T00:21:13.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.146+0000 7f520560f800 10 adding default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA to cache LRU end 2024-09-12T00:21:13.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.146+0000 7f520560f800 10 cache get: name=default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA : hit (negative entry) 2024-09-12T00:21:13.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.146+0000 7f520560f800 10 cache get: name=default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA : hit (negative entry) 2024-09-12T00:21:13.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.147+0000 7f520560f800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:21:13.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.147+0000 7f520560f800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:21:13.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.147+0000 7f520560f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:21:13.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.148+0000 7f50d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627842 cookie 94025624326160 notifier 5603 bl.length()=675 2024-09-12T00:21:13.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.148+0000 7f50d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:21:13.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.148+0000 7f50d7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:21:13.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.151+0000 7f520560f800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:21:13.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.151+0000 7f520560f800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:21:13.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.151+0000 7f520560f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:21:13.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.152+0000 7f50d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627790 cookie 94025624320704 notifier 5603 bl.length()=202 2024-09-12T00:21:13.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.152+0000 7f50d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:21:13.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.152+0000 7f50d7fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:21:13.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.154+0000 7f520560f800 10 cache put: name=default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA info.flags=0x7 2024-09-12T00:21:13.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.154+0000 7f520560f800 10 moving default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA to cache LRU end 2024-09-12T00:21:13.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.154+0000 7f520560f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:QGDROSUNZGOTNTZUHEGA, ofs0, ns] 2024-09-12T00:21:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.155+0000 7f50d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627843 cookie 94025624275408 notifier 5603 bl.length()=190 2024-09-12T00:21:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.155+0000 7f50d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA info.flags=0x7 2024-09-12T00:21:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.155+0000 7f50d7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QGDROSUNZGOTNTZUHEGA to cache LRU end 2024-09-12T00:21:13.156 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:21:13.156 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:21:13.156 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:21:13.156 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:21:13.157 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:21:13.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:21:13.157 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:21:13.157 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:21:13.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:21:13.158 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "ragweed.client.0", 2024-09-12T00:21:13.158 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "QGDROSUNZGOTNTZUHEGA", 2024-09-12T00:21:13.158 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "nrBBeeIQwkqwLuQCuyP3gVP258Idg7jl5wLznTHJzGWcJVGs+MWFhw==", 2024-09-12T00:21:13.158 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:21:13.158 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:21:13.148068Z" 2024-09-12T00:21:13.158 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:21:13.158 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:21:13.159 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:21:13.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:21:13.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:21:13.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:21:13.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:21:13.160 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:21:13.160 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:21:13.161 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:21:13.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:21:13.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:21:13.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:21:13.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:21:13.161 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:21:13.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "rgw", 2024-09-12T00:21:13.162 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:21:13.162 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "", 2024-09-12T00:21:13.162 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:21:13.162 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:21:13.148050Z", 2024-09-12T00:21:13.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:21:13.162 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:21:13.163 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:21:13.163 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:21:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.157+0000 7f50b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.159+0000 7f520560f800 20 remove_watcher() i=0 2024-09-12T00:21:13.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.159+0000 7f520560f800 2 removed watcher, disabling cache 2024-09-12T00:21:13.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.161+0000 7f520560f800 20 remove_watcher() i=1 2024-09-12T00:21:13.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.162+0000 7f520560f800 20 remove_watcher() i=2 2024-09-12T00:21:13.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.163+0000 7f520560f800 20 remove_watcher() i=3 2024-09-12T00:21:13.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.164+0000 7f520560f800 20 remove_watcher() i=4 2024-09-12T00:21:13.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.165+0000 7f520560f800 20 remove_watcher() i=5 2024-09-12T00:21:13.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.166+0000 7f520560f800 20 remove_watcher() i=6 2024-09-12T00:21:13.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.167+0000 7f520560f800 20 remove_watcher() i=7 2024-09-12T00:21:13.178 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:21:13.179 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key NBKOFEFYDJOCOUEGBAJF --secret igfk5nAra16ZLFqL/T1M2hN8lwdnoMwuxVRilz76F5C9AKGJoqV8Bg== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:21:13.247 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:13.248 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:13.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.285+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.287+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.287+0000 7f0089d2d800 20 realm 2024-09-12T00:21:13.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.287+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.287+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.287+0000 7f0089d2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:13.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.287+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.287+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.287+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.288+0000 7f0089d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.288+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.289+0000 7f0089d2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.289+0000 7f0089d2d800 20 searching for the correct realm 2024-09-12T00:21:13.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.293+0000 7f0086277640 0 -- 172.21.15.33:0/2597377948 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f007c041020 msgr2=0x7f007c06afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.499+0000 7f0085a76640 0 -- 172.21.15.33:0/2597377948 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x559134f84140 msgr2=0x559134f86530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.502+0000 7f0089d2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:13.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.502+0000 7f0089d2d800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:21:13.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.502+0000 7f0089d2d800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:21:13.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.502+0000 7f0089d2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:13.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.502+0000 7f0089d2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:13.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.502+0000 7f0089d2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:13.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.502+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 20 zone default found 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 4 Realm: () 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 20 zonegroup default 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.503+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.504+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.504+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.504+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.504+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.504+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.504+0000 7f0089d2d800 20 started sync module instance, tier type = 2024-09-12T00:21:13.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.504+0000 7f0089d2d800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:21:13.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.515+0000 7f0089d2d800 20 add_watcher() i=0 2024-09-12T00:21:13.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.515+0000 7f0089d2d800 20 add_watcher() i=1 2024-09-12T00:21:13.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.515+0000 7f0089d2d800 20 add_watcher() i=2 2024-09-12T00:21:13.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.515+0000 7f0089d2d800 20 add_watcher() i=3 2024-09-12T00:21:13.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.515+0000 7f0089d2d800 20 add_watcher() i=4 2024-09-12T00:21:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.515+0000 7f0089d2d800 20 add_watcher() i=5 2024-09-12T00:21:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.515+0000 7f0089d2d800 20 add_watcher() i=6 2024-09-12T00:21:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.516+0000 7f0089d2d800 20 add_watcher() i=7 2024-09-12T00:21:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.516+0000 7f0089d2d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:13.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.517+0000 7eff377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.517+0000 7f0089d2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:13.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.517+0000 7f0089d2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:13.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.517+0000 7f0089d2d800 5 note: GC not initialized 2024-09-12T00:21:13.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7eff367fc640 20 reqs_thread_entry: start 2024-09-12T00:21:13.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 20 init_complete bucket index max shards: 11 2024-09-12T00:21:13.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 20 Filter name: none 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7efea7fff640 20 reqs_thread_entry: start 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.518+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:21:13.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:21:13.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 10 cache get: name=default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF : miss 2024-09-12T00:21:13.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 10 cache put: name=default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF info.flags=0x0 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 10 adding default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF to cache LRU end 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 10 cache get: name=default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF : hit (negative entry) 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.519+0000 7f0089d2d800 10 cache get: name=default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF : hit (negative entry) 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.521+0000 7f0089d2d800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.521+0000 7f0089d2d800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.521+0000 7f0089d2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.521+0000 7eff697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627791 cookie 94082147353264 notifier 5895 bl.length()=675 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.521+0000 7eff697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:21:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.521+0000 7eff697fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:21:13.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.524+0000 7f0089d2d800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:21:13.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.524+0000 7f0089d2d800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:21:13.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.524+0000 7f0089d2d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:21:13.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.524+0000 7eff697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627844 cookie 94082147359840 notifier 5895 bl.length()=202 2024-09-12T00:21:13.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.524+0000 7eff697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:21:13.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.524+0000 7eff697fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:21:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.528+0000 7f0089d2d800 10 cache put: name=default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF info.flags=0x7 2024-09-12T00:21:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.528+0000 7f0089d2d800 10 moving default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF to cache LRU end 2024-09-12T00:21:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.528+0000 7f0089d2d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:NBKOFEFYDJOCOUEGBAJF, ofs0, ns] 2024-09-12T00:21:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.528+0000 7eff697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627785 cookie 94082147350720 notifier 5895 bl.length()=190 2024-09-12T00:21:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.528+0000 7eff697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF info.flags=0x7 2024-09-12T00:21:13.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.528+0000 7eff697fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NBKOFEFYDJOCOUEGBAJF to cache LRU end 2024-09-12T00:21:13.528 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:21:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "sysuser.client.0", 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "NBKOFEFYDJOCOUEGBAJF", 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "igfk5nAra16ZLFqL/T1M2hN8lwdnoMwuxVRilz76F5C9AKGJoqV8Bg==", 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:21:13.521384Z" 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "system": true, 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:21:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:21:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:21:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:21:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:21:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:21:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:21:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "rgw", 2024-09-12T00:21:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:21:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "", 2024-09-12T00:21:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:21:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:21:13.521373Z", 2024-09-12T00:21:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:21:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:21:13.533 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:21:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:21:13.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.530+0000 7eff377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.532+0000 7f0089d2d800 20 remove_watcher() i=0 2024-09-12T00:21:13.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.532+0000 7f0089d2d800 2 removed watcher, disabling cache 2024-09-12T00:21:13.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.534+0000 7f0089d2d800 20 remove_watcher() i=1 2024-09-12T00:21:13.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.535+0000 7f0089d2d800 20 remove_watcher() i=2 2024-09-12T00:21:13.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.536+0000 7f0089d2d800 20 remove_watcher() i=3 2024-09-12T00:21:13.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.537+0000 7f0089d2d800 20 remove_watcher() i=4 2024-09-12T00:21:13.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.538+0000 7f0089d2d800 20 remove_watcher() i=5 2024-09-12T00:21:13.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.539+0000 7f0089d2d800 20 remove_watcher() i=6 2024-09-12T00:21:13.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:21:13.540+0000 7f0089d2d800 20 remove_watcher() i=7 2024-09-12T00:21:13.551 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:21:13.552 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:21:13.552 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:21:13.581 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:21:13.581 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:21:13.582 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:21:13.651 DEBUG:teuthology.orchestra.run.smithi033:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:21:13.846 INFO:teuthology.orchestra.run.smithi033.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:21:14.013 INFO:teuthology.orchestra.run.smithi033.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:21:14.625 INFO:teuthology.orchestra.run.smithi033.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:21:21.091 INFO:teuthology.orchestra.run.smithi033.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:21:24.638 INFO:teuthology.orchestra.run.smithi033.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=a29fbd77c234e88d1dd912db33f62879a89078d67bd838733d0280ba408b9d98,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:21:24.638 INFO:teuthology.orchestra.run.smithi033.stdout:py run-test-pre: PYTHONHASHSEED='1232764328' 2024-09-12T00:21:24.638 INFO:teuthology.orchestra.run.smithi033.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:21:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:============================= test session starts ============================== 2024-09-12T00:21:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:21:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:21:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:21:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:configfile: pytest.ini 2024-09-12T00:21:24.939 INFO:teuthology.orchestra.run.smithi033.stdout:collecting ... collected 9 items 2024-09-12T00:21:24.940 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:21:30.841 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:21:37.364 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:21:41.878 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:21:49.918 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:21:56.638 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:22:11.776 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:22:24.547 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:22:38.543 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:23:05.703 INFO:teuthology.orchestra.run.smithi033.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:23:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:23:05.703 INFO:teuthology.orchestra.run.smithi033.stdout:=============================== warnings summary =============================== 2024-09-12T00:23:05.703 INFO:teuthology.orchestra.run.smithi033.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T00:23:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T00:23:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: import imp 2024-09-12T00:23:05.704 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:23:05.704 INFO:teuthology.orchestra.run.smithi033.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:23:05.704 INFO:teuthology.orchestra.run.smithi033.stdout:=================== 9 passed, 1 warning in 100.86s (0:01:40) =================== 2024-09-12T00:23:05.734 INFO:teuthology.orchestra.run.smithi033.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:23:05.734 INFO:teuthology.orchestra.run.smithi033.stdout: py: commands succeeded 2024-09-12T00:23:05.734 INFO:teuthology.orchestra.run.smithi033.stdout: congratulations :) 2024-09-12T00:23:05.752 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:23:05.753 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:23:05.783 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:23:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.927+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.929+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.929+0000 7fb128319800 20 realm 2024-09-12T00:23:05.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.929+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.929+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.929+0000 7fb128319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:05.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.929+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.929+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:05.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.929+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.930+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.930+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.931+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.931+0000 7fb128319800 20 searching for the correct realm 2024-09-12T00:23:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:05.935+0000 7fb126604640 0 -- 172.21.15.33:0/589830771 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fb110091020 msgr2=0x7fb110091b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:06.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.142+0000 7fb125e03640 0 -- 172.21.15.33:0/589830771 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x55bf1cc42600 msgr2=0x55bf1cc44a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.145+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 20 zone default found 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 4 Realm: () 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 20 zonegroup default 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.146+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.147+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.147+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.147+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.147+0000 7fb128319800 20 started sync module instance, tier type = 2024-09-12T00:23:06.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.147+0000 7fb128319800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:23:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.156+0000 7fb128319800 20 add_watcher() i=0 2024-09-12T00:23:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.156+0000 7fb128319800 20 add_watcher() i=1 2024-09-12T00:23:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.156+0000 7fb128319800 20 add_watcher() i=2 2024-09-12T00:23:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.156+0000 7fb128319800 20 add_watcher() i=3 2024-09-12T00:23:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.156+0000 7fb128319800 20 add_watcher() i=4 2024-09-12T00:23:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.156+0000 7fb128319800 20 add_watcher() i=5 2024-09-12T00:23:06.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.156+0000 7fb128319800 20 add_watcher() i=6 2024-09-12T00:23:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.157+0000 7fb128319800 20 add_watcher() i=7 2024-09-12T00:23:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.157+0000 7fb128319800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:06.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.159+0000 7fafd7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:06.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.159+0000 7fb128319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:06.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.159+0000 7fb128319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:06.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.199+0000 7fafd6ffd640 20 reqs_thread_entry: start 2024-09-12T00:23:06.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.199+0000 7fb128319800 20 init_complete bucket index max shards: 11 2024-09-12T00:23:06.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.200+0000 7fb128319800 20 Filter name: none 2024-09-12T00:23:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.200+0000 7fafd4ff9640 20 reqs_thread_entry: start 2024-09-12T00:23:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.200+0000 7fb128319800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:23:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.200+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.201+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:23:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.201+0000 7fb128319800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:23:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.201+0000 7fb128319800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:23:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.201+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.201+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5 : miss 2024-09-12T00:23:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.201+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.202+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:23:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.202+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5 info.flags=0x17 2024-09-12T00:23:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.202+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5 to cache LRU end 2024-09-12T00:23:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.202+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.202+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.202+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5 2024-09-12T00:23:06.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.203+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:23:06.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.203+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:23:06.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.203+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:23:06.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.204+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:23:06.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.204+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:23:06.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.204+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:23:06.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.205+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:23:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.205+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:23:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.206+0000 7fb128319800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:23:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.207+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55bf1cd0b478 s->prefetch_data=0 2024-09-12T00:23:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.207+0000 7fb128319800 10 manifest: total_size = 7739 2024-09-12T00:23:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.207+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4697731534003423868 2024-09-12T00:23:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.207+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55bf1cd0b478 s->prefetch_data=0 2024-09-12T00:23:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.207+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cd0b478 2024-09-12T00:23:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.207+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.1 2024-09-12T00:23:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.210+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55bf1cd0b438 s->prefetch_data=0 2024-09-12T00:23:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.211+0000 7fb128319800 10 manifest: total_size = 7498 2024-09-12T00:23:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.211+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12220709142923017649 2024-09-12T00:23:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.211+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55bf1cd0b438 s->prefetch_data=0 2024-09-12T00:23:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.211+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cd0b438 2024-09-12T00:23:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.211+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.2 2024-09-12T00:23:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.211+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:23:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.213+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55bf1cd0b2a8 s->prefetch_data=0 2024-09-12T00:23:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.214+0000 7fb128319800 10 manifest: total_size = 7754 2024-09-12T00:23:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.214+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.647134995705686075 2024-09-12T00:23:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.214+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55bf1cd0b2a8 s->prefetch_data=0 2024-09-12T00:23:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.214+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cd0b2a8 2024-09-12T00:23:06.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.214+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.2 2024-09-12T00:23:06.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.215+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:23:06.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.217+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55bf1cd0b238 s->prefetch_data=0 2024-09-12T00:23:06.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.217+0000 7fb128319800 10 manifest: total_size = 13127 2024-09-12T00:23:06.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.217+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13945192798558764901 2024-09-12T00:23:06.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.217+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55bf1cd0b238 s->prefetch_data=0 2024-09-12T00:23:06.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.217+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cd0b238 2024-09-12T00:23:06.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.217+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.3 2024-09-12T00:23:06.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.218+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:23:06.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.220+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55bf1cd0b218 s->prefetch_data=0 2024-09-12T00:23:06.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.220+0000 7fb128319800 10 manifest: total_size = 7540 2024-09-12T00:23:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.220+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.951196649231457872 2024-09-12T00:23:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.220+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55bf1cd0b218 s->prefetch_data=0 2024-09-12T00:23:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.220+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cd0b218 2024-09-12T00:23:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.220+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.4 2024-09-12T00:23:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.221+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:23:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.223+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55bf1cd0b218 s->prefetch_data=0 2024-09-12T00:23:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.223+0000 7fb128319800 10 manifest: total_size = 7538 2024-09-12T00:23:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.223+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3594554080810882052 2024-09-12T00:23:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.223+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55bf1cd0b218 s->prefetch_data=0 2024-09-12T00:23:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.223+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cd0b218 2024-09-12T00:23:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.223+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.4 2024-09-12T00:23:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.224+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:23:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.226+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55bf1cc98048 s->prefetch_data=0 2024-09-12T00:23:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.226+0000 7fb128319800 10 manifest: total_size = 5092 2024-09-12T00:23:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.226+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9658953670521956585 2024-09-12T00:23:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.226+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55bf1cc98048 s->prefetch_data=0 2024-09-12T00:23:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.226+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cc98048 2024-09-12T00:23:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.226+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.5 2024-09-12T00:23:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.227+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:23:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.228+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55bf1cc96fd8 s->prefetch_data=0 2024-09-12T00:23:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.229+0000 7fb128319800 10 manifest: total_size = 5374 2024-09-12T00:23:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.229+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11832683354882964143 2024-09-12T00:23:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.229+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55bf1cc96fd8 s->prefetch_data=0 2024-09-12T00:23:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.229+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cc96fd8 2024-09-12T00:23:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.229+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.7 2024-09-12T00:23:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.230+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:23:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.231+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55bf1cc92408 s->prefetch_data=0 2024-09-12T00:23:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.232+0000 7fb128319800 10 manifest: total_size = 8745 2024-09-12T00:23:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.232+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3879013154777918594 2024-09-12T00:23:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.232+0000 7fb128319800 20 get_obj_state: octx=0x7fb110092d30 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55bf1cc92408 s->prefetch_data=0 2024-09-12T00:23:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.232+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cc92408 2024-09-12T00:23:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.232+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5.8 2024-09-12T00:23:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.233+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:23:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.235+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.235+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.236+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:23:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.236+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.236+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.236+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.236+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.236+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.238+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:23:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.238+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.238+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:23:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.238+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:23:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.238+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:23:06.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.239+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:23:06.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.239+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:23:06.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.240+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94279309739280 notifier 5648 bl.length()=162 2024-09-12T00:23:06.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.243+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5 from cache 2024-09-12T00:23:06.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.243+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5, ofs0, ns] 2024-09-12T00:23:06.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.243+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366151 cookie 94279309791456 notifier 5648 bl.length()=219 2024-09-12T00:23:06.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.247+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5 : miss 2024-09-12T00:23:06.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.247+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.247+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.247+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5 info.flags=0x0 2024-09-12T00:23:06.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.247+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5 to cache LRU end 2024-09-12T00:23:06.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.249+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12 : miss 2024-09-12T00:23:06.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.249+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.250+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:23:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.250+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12 info.flags=0x17 2024-09-12T00:23:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.250+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12 to cache LRU end 2024-09-12T00:23:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.250+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.250+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.250+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12 2024-09-12T00:23:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.254+0000 7fb128319800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:23:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.254+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc99460 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55bf1cd0acc8 s->prefetch_data=0 2024-09-12T00:23:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.254+0000 7fb128319800 10 manifest: total_size = 26080 2024-09-12T00:23:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.254+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.761558948079615941 2024-09-12T00:23:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.254+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc99460 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55bf1cd0acc8 s->prefetch_data=0 2024-09-12T00:23:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.254+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cd0acc8 2024-09-12T00:23:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.254+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12.10 2024-09-12T00:23:06.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-12T00:23:06.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-09-12T00:23:06.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-09-12T00:23:06.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T00:23:06.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7672 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7671 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=7671 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=23013 stripe_ofs=23013 part_ofs=23013 rule->part_size=3067 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6314469 part_ofs=23013 rule->part_size=3067 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=26080 stripe_ofs=26080 part_ofs=26080 rule->part_size=3067 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.761558948079615941 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12__multipart_foo.2~pFORWXdcC5QnLrQe1vUM0bSeForCJIg.1 2024-09-12T00:23:06.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T00:23:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12__multipart_foo.2~pFORWXdcC5QnLrQe1vUM0bSeForCJIg.2 2024-09-12T00:23:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T00:23:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12__multipart_foo.2~pFORWXdcC5QnLrQe1vUM0bSeForCJIg.3 2024-09-12T00:23:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T00:23:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12__multipart_foo.2~pFORWXdcC5QnLrQe1vUM0bSeForCJIg.4 2024-09-12T00:23:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1083 2024-09-12T00:23:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.259+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.761558948079615941 2024-09-12T00:23:06.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.260+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:23:06.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.260+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.260+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.261+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.261+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.261+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.261+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.261+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.263+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:23:06.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.263+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.264+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:23:06.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.264+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:23:06.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.264+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:23:06.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.265+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:23:06.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.265+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:23:06.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.266+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 94279309779536 notifier 5648 bl.length()=191 2024-09-12T00:23:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.270+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12 from cache 2024-09-12T00:23:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.270+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12, ofs0, ns] 2024-09-12T00:23:06.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.270+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366152 cookie 94279309791456 notifier 5648 bl.length()=249 2024-09-12T00:23:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.274+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12 : miss 2024-09-12T00:23:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.274+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.274+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.274+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12 info.flags=0x0 2024-09-12T00:23:06.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.274+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12 to cache LRU end 2024-09-12T00:23:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.276+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13 : miss 2024-09-12T00:23:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.276+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.277+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:23:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.277+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13 info.flags=0x17 2024-09-12T00:23:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.277+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13 to cache LRU end 2024-09-12T00:23:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.277+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.277+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.277+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13 2024-09-12T00:23:06.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.282+0000 7fb128319800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:23:06.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.282+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94e50 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55bf1cd0acc8 s->prefetch_data=0 2024-09-12T00:23:06.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.282+0000 7fb128319800 10 manifest: total_size = 886297 2024-09-12T00:23:06.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.282+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3741958473258818720 2024-09-12T00:23:06.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.282+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94e50 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55bf1cd0acc8 s->prefetch_data=0 2024-09-12T00:23:06.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.282+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cd0acc8 2024-09-12T00:23:06.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.282+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13.10 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:23:06.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3741958473258818720 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13__multipart_foo.2~Qi3nBS9Yct2gCEzHPn_KVMKzsHf3srD.1 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13__multipart_foo.2~Qi3nBS9Yct2gCEzHPn_KVMKzsHf3srD.2 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13__multipart_foo.2~Qi3nBS9Yct2gCEzHPn_KVMKzsHf3srD.3 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13__multipart_foo.2~Qi3nBS9Yct2gCEzHPn_KVMKzsHf3srD.4 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.285+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3741958473258818720 2024-09-12T00:23:06.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.286+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:23:06.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.286+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.286+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.287+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.287+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.287+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.287+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.287+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.289+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:23:06.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.289+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.289+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:23:06.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.289+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:23:06.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.289+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:23:06.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.290+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:23:06.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.290+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:23:06.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.291+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94279309781664 notifier 5648 bl.length()=198 2024-09-12T00:23:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.293+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13 from cache 2024-09-12T00:23:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.293+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13, ofs0, ns] 2024-09-12T00:23:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.294+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94279309790400 notifier 5648 bl.length()=256 2024-09-12T00:23:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.297+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13 : miss 2024-09-12T00:23:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.297+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.297+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.297+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13 info.flags=0x0 2024-09-12T00:23:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.297+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13 to cache LRU end 2024-09-12T00:23:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.299+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11 : miss 2024-09-12T00:23:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.299+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.300+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:23:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.300+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11 info.flags=0x17 2024-09-12T00:23:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.300+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11 to cache LRU end 2024-09-12T00:23:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.300+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.300+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.300+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11 2024-09-12T00:23:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.304+0000 7fb128319800 10 cls_bucket_list_unordered: got foo[SsowETibEUohyQJ-OLpae5j7VGPSxDF] 2024-09-12T00:23:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.304+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11.10 2024-09-12T00:23:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.304+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8ff60 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55bf1ccb3838 s->prefetch_data=0 2024-09-12T00:23:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.305+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to nhb6fbmv2de5cm0rrg5d3xyx98p7zesq 2024-09-12T00:23:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.305+0000 7fb128319800 20 get_obj_state_impl: setting s->olh_tag to 0jwa3ylux1d8t1llyss3ip5bsuojlb2x 2024-09-12T00:23:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.305+0000 7fb128319800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0jwa3ylux1d8t1llyss3ip5bsuojlb2x 2024-09-12T00:23:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.306+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11.10 2024-09-12T00:23:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11.10 2024-09-12T00:23:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:23:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 20 olh_log_entry: epoch=3 op=3 key=foo[SsowETibEUohyQJ-OLpae5j7VGPSxDF] 2024-09-12T00:23:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8ff60 obj=test-client.0-r-test-multipart-index-versioning.1:_:SsowETibEUohyQJ-OLpae5j7VGPSxDF_foo state=0x55bf1cca2bf8 s->prefetch_data=0 2024-09-12T00:23:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 10 manifest: total_size = 1667 2024-09-12T00:23:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11891220471994533789 2024-09-12T00:23:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8ff60 obj=test-client.0-r-test-multipart-index-versioning.1:_:SsowETibEUohyQJ-OLpae5j7VGPSxDF_foo state=0x55bf1cca2bf8 s->prefetch_data=0 2024-09-12T00:23:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cca2bf8 2024-09-12T00:23:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.308+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11.10 2024-09-12T00:23:06.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:23:06.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:23:06.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:23:06.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:23:06.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11891220471994533789 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11__multipart_foo.2~5JmT0o-C3m22UhL_tS1wXAd_2v60nl-.1 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11__multipart_foo.2~5JmT0o-C3m22UhL_tS1wXAd_2v60nl-.2 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11__multipart_foo.2~5JmT0o-C3m22UhL_tS1wXAd_2v60nl-.3 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11__multipart_foo.2~5JmT0o-C3m22UhL_tS1wXAd_2v60nl-.4 2024-09-12T00:23:06.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:23:06.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.311+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11891220471994533789 2024-09-12T00:23:06.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.312+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo[SsowETibEUohyQJ-OLpae5j7VGPSxDF] 2024-09-12T00:23:06.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.314+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8ff60 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55bf1ccb3838 s->prefetch_data=0 2024-09-12T00:23:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.315+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11.10 2024-09-12T00:23:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.316+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11.10 2024-09-12T00:23:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.316+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.316+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.317+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.317+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.317+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.317+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.317+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.319+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:23:06.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.319+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.319+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:23:06.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.319+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:23:06.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.319+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:23:06.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.320+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:23:06.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.320+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:23:06.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.321+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 94279309781664 notifier 5648 bl.length()=193 2024-09-12T00:23:06.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.325+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11 from cache 2024-09-12T00:23:06.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.325+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11, ofs0, ns] 2024-09-12T00:23:06.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.326+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94279309781664 notifier 5648 bl.length()=251 2024-09-12T00:23:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.330+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11 : miss 2024-09-12T00:23:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.330+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.331+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.331+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11 info.flags=0x0 2024-09-12T00:23:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.331+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11 to cache LRU end 2024-09-12T00:23:06.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.333+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10 : miss 2024-09-12T00:23:06.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.333+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.334+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T00:23:06.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.334+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10 info.flags=0x17 2024-09-12T00:23:06.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.334+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10 to cache LRU end 2024-09-12T00:23:06.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.334+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.334+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.334+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10 2024-09-12T00:23:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.338+0000 7fb128319800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:23:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.338+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc901e0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55bf1cc8eed8 s->prefetch_data=0 2024-09-12T00:23:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.338+0000 7fb128319800 10 manifest: total_size = 1667 2024-09-12T00:23:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.338+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.339850139422300829 2024-09-12T00:23:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.338+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc901e0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55bf1cc8eed8 s->prefetch_data=0 2024-09-12T00:23:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.338+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cc8eed8 2024-09-12T00:23:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.338+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10.10 2024-09-12T00:23:06.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:23:06.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.339850139422300829 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10__multipart_foo.2~yf9MQWznC0tlOGNwdalps-pC_DnJm8t.1 2024-09-12T00:23:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T00:23:06.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10__multipart_foo.2~yf9MQWznC0tlOGNwdalps-pC_DnJm8t.2 2024-09-12T00:23:06.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T00:23:06.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10__multipart_foo.2~yf9MQWznC0tlOGNwdalps-pC_DnJm8t.3 2024-09-12T00:23:06.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T00:23:06.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10__multipart_foo.2~yf9MQWznC0tlOGNwdalps-pC_DnJm8t.4 2024-09-12T00:23:06.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1083 2024-09-12T00:23:06.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.341+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.339850139422300829 2024-09-12T00:23:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.342+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:23:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.342+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.342+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.343+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.343+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.343+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.343+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.343+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.345+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:23:06.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.345+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.345+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T00:23:06.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.345+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:23:06.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.345+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:23:06.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.346+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:23:06.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.346+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:23:06.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.347+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94279309790400 notifier 5648 bl.length()=183 2024-09-12T00:23:06.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.349+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10 from cache 2024-09-12T00:23:06.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.349+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10, ofs0, ns] 2024-09-12T00:23:06.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.350+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94279309739280 notifier 5648 bl.length()=241 2024-09-12T00:23:06.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.354+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10 : miss 2024-09-12T00:23:06.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.354+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.355+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.355+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10 info.flags=0x0 2024-09-12T00:23:06.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.355+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10 to cache LRU end 2024-09-12T00:23:06.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16 : miss 2024-09-12T00:23:06.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:23:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16 info.flags=0x17 2024-09-12T00:23:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16 to cache LRU end 2024-09-12T00:23:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16 2024-09-12T00:23:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.357+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:23:06.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.358+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:23:06.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.359+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:23:06.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.359+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:23:06.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.359+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:23:06.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.359+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:23:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.360+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:23:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.360+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:23:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.360+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:23:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.361+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:23:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.361+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:23:06.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.361+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:23:06.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.362+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0bf80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55bf1ccb2c58 s->prefetch_data=0 2024-09-12T00:23:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.362+0000 7fb128319800 10 manifest: total_size = 324647 2024-09-12T00:23:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.362+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _bMI8IR3uKoUiPBekq0xyP0bb-QDLioy 2024-09-12T00:23:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.362+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0bf80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55bf1ccb2c58 s->prefetch_data=0 2024-09-12T00:23:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.362+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c58 2024-09-12T00:23:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.362+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.0 2024-09-12T00:23:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.365+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.365+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.365+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _bMI8IR3uKoUiPBekq0xyP0bb-QDLioy 2024-09-12T00:23:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.365+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.365+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.dW3StSUh2ghm5hWG1MKwdY28xwYLtoy_0 2024-09-12T00:23:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.365+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:23:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.365+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.365+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _bMI8IR3uKoUiPBekq0xyP0bb-QDLioy 2024-09-12T00:23:06.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.366+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:23:06.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.366+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0bf80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55bf1ccb2c58 s->prefetch_data=0 2024-09-12T00:23:06.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.366+0000 7fb128319800 10 manifest: total_size = 5242880 2024-09-12T00:23:06.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.366+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _dEfXOVeltz8ojTPngXElXfR29SeM0wc 2024-09-12T00:23:06.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.366+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0bf80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55bf1ccb2c58 s->prefetch_data=0 2024-09-12T00:23:06.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.366+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c58 2024-09-12T00:23:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.367+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.2 2024-09-12T00:23:06.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.369+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.369+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.369+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _dEfXOVeltz8ojTPngXElXfR29SeM0wc 2024-09-12T00:23:06.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.369+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.369+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.IQ1wkY3JZOTi8v9letUVdK0Po0Efeby_1 2024-09-12T00:23:06.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.369+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:23:06.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.369+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.369+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _dEfXOVeltz8ojTPngXElXfR29SeM0wc 2024-09-12T00:23:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.370+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0ae60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55bf1ccb2c58 s->prefetch_data=0 2024-09-12T00:23:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.370+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:23:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.371+0000 7fb128319800 10 manifest: total_size = 5242880 2024-09-12T00:23:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.371+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1350686612888003823 2024-09-12T00:23:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.371+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0ae60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55bf1ccb2c58 s->prefetch_data=0 2024-09-12T00:23:06.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.371+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c58 2024-09-12T00:23:06.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.371+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.3 2024-09-12T00:23:06.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.373+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.373+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.373+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1350686612888003823 2024-09-12T00:23:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.373+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.373+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.VZ9zvwv5WLW9JIq8AydDI9gGdazxrHO_0 2024-09-12T00:23:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.373+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:23:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.373+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.373+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1350686612888003823 2024-09-12T00:23:06.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.374+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:23:06.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.374+0000 7fb128319800 20 get_obj_state: octx=0x7fb118072500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55bf1ccb2c38 s->prefetch_data=0 2024-09-12T00:23:06.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.375+0000 7fb128319800 10 manifest: total_size = 5242880 2024-09-12T00:23:06.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.375+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _KJUTIirt4Ndl5niOsd8UB9ukUwnH1kX 2024-09-12T00:23:06.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.375+0000 7fb128319800 20 get_obj_state: octx=0x7fb118072500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55bf1ccb2c38 s->prefetch_data=0 2024-09-12T00:23:06.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.375+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c38 2024-09-12T00:23:06.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.375+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.5 2024-09-12T00:23:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.377+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.377+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.377+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _KJUTIirt4Ndl5niOsd8UB9ukUwnH1kX 2024-09-12T00:23:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.377+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.377+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.D1o4XPIKgaqXzISi_xx5i6AgM5ieJ1s_0 2024-09-12T00:23:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.377+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:23:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.377+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.377+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _KJUTIirt4Ndl5niOsd8UB9ukUwnH1kX 2024-09-12T00:23:06.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.378+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:23:06.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.379+0000 7fb128319800 20 get_obj_state: octx=0x7fb11808b490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.379+0000 7fb128319800 10 manifest: total_size = 5242880 2024-09-12T00:23:06.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.379+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _ZfbJx-feufZNxPbPPs-6VgmfWz-fS5f 2024-09-12T00:23:06.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.379+0000 7fb128319800 20 get_obj_state: octx=0x7fb11808b490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.379+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c08 2024-09-12T00:23:06.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.379+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.5 2024-09-12T00:23:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.382+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.382+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.382+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZfbJx-feufZNxPbPPs-6VgmfWz-fS5f 2024-09-12T00:23:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.382+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.382+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.0GnNfDw-0P82Wrp33IJvak97nPJzfad_0 2024-09-12T00:23:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.382+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:23:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.382+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.382+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _ZfbJx-feufZNxPbPPs-6VgmfWz-fS5f 2024-09-12T00:23:06.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.383+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:23:06.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.383+0000 7fb128319800 20 get_obj_state: octx=0x7fb118072500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.383+0000 7fb128319800 10 manifest: total_size = 324647 2024-09-12T00:23:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.383+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2486781189251179382 2024-09-12T00:23:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.383+0000 7fb128319800 20 get_obj_state: octx=0x7fb118072500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.383+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c08 2024-09-12T00:23:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.383+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.5 2024-09-12T00:23:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.385+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc934a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.386+0000 7fb128319800 10 manifest: total_size = 5242880 2024-09-12T00:23:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.386+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _ZZ2hmMqduE-aeZUsoExQ6ylHtndHlyc 2024-09-12T00:23:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.386+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc934a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.386+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c08 2024-09-12T00:23:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.386+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.7 2024-09-12T00:23:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.387+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:23:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.389+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.389+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.389+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZZ2hmMqduE-aeZUsoExQ6ylHtndHlyc 2024-09-12T00:23:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.389+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.389+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.tSAEI11KL7L0x2xjW8S1p0-Uf1hCaV1_1 2024-09-12T00:23:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.389+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:23:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.389+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.389+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _ZZ2hmMqduE-aeZUsoExQ6ylHtndHlyc 2024-09-12T00:23:06.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.390+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:23:06.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.390+0000 7fb128319800 20 get_obj_state: octx=0x7fb118072500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.390+0000 7fb128319800 10 manifest: total_size = 5242880 2024-09-12T00:23:06.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.390+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.840223848198242399 2024-09-12T00:23:06.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.390+0000 7fb128319800 20 get_obj_state: octx=0x7fb118072500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.390+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c08 2024-09-12T00:23:06.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.390+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.7 2024-09-12T00:23:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.393+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.393+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.393+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.840223848198242399 2024-09-12T00:23:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.393+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.393+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.UJKgrQw-VMdDbPTmYljSFpyVcUQr7Hj_0 2024-09-12T00:23:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.393+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:23:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.393+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.393+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.840223848198242399 2024-09-12T00:23:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.394+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:23:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.394+0000 7fb128319800 20 get_obj_state: octx=0x7fb118035490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.394+0000 7fb128319800 10 manifest: total_size = 324647 2024-09-12T00:23:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.394+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _ghuos8q60jYN3YU56njG9W_0hDrtPSI 2024-09-12T00:23:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.394+0000 7fb128319800 20 get_obj_state: octx=0x7fb118035490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.394+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c08 2024-09-12T00:23:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.394+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.7 2024-09-12T00:23:06.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.397+0000 7fb128319800 20 get_obj_state: octx=0x55bf1ccb2560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.397+0000 7fb128319800 10 manifest: total_size = 5242880 2024-09-12T00:23:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.397+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.812037649198332474 2024-09-12T00:23:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.397+0000 7fb128319800 20 get_obj_state: octx=0x55bf1ccb2560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.397+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c08 2024-09-12T00:23:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.397+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.8 2024-09-12T00:23:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.398+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:23:06.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.400+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.400+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.400+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.812037649198332474 2024-09-12T00:23:06.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.400+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.400+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.UJKgrQw-VMdDbPTmYljSFpyVcUQr7Hj_0 2024-09-12T00:23:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.400+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:23:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.400+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.400+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.812037649198332474 2024-09-12T00:23:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.401+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:23:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.401+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0ae60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.402+0000 7fb128319800 10 manifest: total_size = 324647 2024-09-12T00:23:06.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.402+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _i-rYVF5VVYRK-aAVZAZiUzLcwMlMPtc 2024-09-12T00:23:06.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.402+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0ae60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.402+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c08 2024-09-12T00:23:06.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.402+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.8 2024-09-12T00:23:06.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.404+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.404+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.404+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _i-rYVF5VVYRK-aAVZAZiUzLcwMlMPtc 2024-09-12T00:23:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.404+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.404+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.JCr1Z57KbCqDxPfrxoeoXLW1-HpVt93_0 2024-09-12T00:23:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.404+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:23:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.404+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.404+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _i-rYVF5VVYRK-aAVZAZiUzLcwMlMPtc 2024-09-12T00:23:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.405+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:23:06.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.405+0000 7fb128319800 20 get_obj_state: octx=0x7fb11000a350 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.405+0000 7fb128319800 10 manifest: total_size = 5242880 2024-09-12T00:23:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.405+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9802233030281994754 2024-09-12T00:23:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.405+0000 7fb128319800 20 get_obj_state: octx=0x7fb11000a350 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55bf1ccb2c08 s->prefetch_data=0 2024-09-12T00:23:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.405+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb2c08 2024-09-12T00:23:06.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.405+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16.9 2024-09-12T00:23:06.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.409+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.409+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.409+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9802233030281994754 2024-09-12T00:23:06.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.409+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.409+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.VZ9zvwv5WLW9JIq8AydDI9gGdazxrHO_0 2024-09-12T00:23:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.409+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:23:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.409+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.409+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9802233030281994754 2024-09-12T00:23:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.410+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.410+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.410+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:23:06.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.411+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.411+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.411+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.411+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.411+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.413+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:23:06.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.413+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.413+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:23:06.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.413+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:23:06.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.413+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:23:06.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.414+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:23:06.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.414+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:23:06.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.415+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94279309781664 notifier 5648 bl.length()=189 2024-09-12T00:23:06.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.417+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16 from cache 2024-09-12T00:23:06.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.417+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16, ofs0, ns] 2024-09-12T00:23:06.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.418+0000 7fb0097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94279309781664 notifier 5648 bl.length()=247 2024-09-12T00:23:06.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.421+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16 : miss 2024-09-12T00:23:06.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.421+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.422+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.422+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16 info.flags=0x0 2024-09-12T00:23:06.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.422+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16 to cache LRU end 2024-09-12T00:23:06.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.424+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17 : miss 2024-09-12T00:23:06.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.424+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.424+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:23:06.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.425+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17 info.flags=0x17 2024-09-12T00:23:06.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.425+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17 to cache LRU end 2024-09-12T00:23:06.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.425+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.425+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.425+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17 2024-09-12T00:23:06.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.425+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:23:06.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.426+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:23:06.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.426+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:23:06.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.427+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:23:06.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.427+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:23:06.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.427+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:23:06.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.428+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:23:06.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.428+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:23:06.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.428+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:23:06.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.428+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:23:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.428+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:23:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.428+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:23:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.429+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc92c10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55bf1cc8eae8 s->prefetch_data=0 2024-09-12T00:23:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.429+0000 7fb128319800 10 manifest: total_size = 1087 2024-09-12T00:23:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.429+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _TEUQ2RkLk1-SVO5zfHrxDeK3KJZSycU 2024-09-12T00:23:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.429+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc92c10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55bf1cc8eae8 s->prefetch_data=0 2024-09-12T00:23:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.429+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cc8eae8 2024-09-12T00:23:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.429+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.0 2024-09-12T00:23:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.431+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.431+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.431+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _TEUQ2RkLk1-SVO5zfHrxDeK3KJZSycU 2024-09-12T00:23:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.431+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.431+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.gpfmo8VSnYYz5GMbItpueb4-uVhFTZ6_0 2024-09-12T00:23:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.431+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:23:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.431+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.431+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _TEUQ2RkLk1-SVO5zfHrxDeK3KJZSycU 2024-09-12T00:23:06.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.432+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:23:06.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.433+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55bf1cc8eae8 s->prefetch_data=0 2024-09-12T00:23:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.433+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.433+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _GKuZhZO6aM8z9Xhh2qgVEPBmGoZpIpP 2024-09-12T00:23:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.433+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55bf1cc8eae8 s->prefetch_data=0 2024-09-12T00:23:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.433+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cc8eae8 2024-09-12T00:23:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.433+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.2 2024-09-12T00:23:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _GKuZhZO6aM8z9Xhh2qgVEPBmGoZpIpP 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.Qilc03yDIjhEiiz_JWCk36LzDn0q8B__1 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.Qilc03yDIjhEiiz_JWCk36LzDn0q8B__2 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.436+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _GKuZhZO6aM8z9Xhh2qgVEPBmGoZpIpP 2024-09-12T00:23:06.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.437+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:23:06.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.438+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55bf1cc8eae8 s->prefetch_data=0 2024-09-12T00:23:06.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.438+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.438+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10515876718468785174 2024-09-12T00:23:06.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.438+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55bf1cc8eae8 s->prefetch_data=0 2024-09-12T00:23:06.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.438+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1cc8eae8 2024-09-12T00:23:06.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.438+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.3 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10515876718468785174 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.1 2024-09-12T00:23:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:23:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.2 2024-09-12T00:23:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T00:23:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.3 2024-09-12T00:23:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T00:23:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.440+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10515876718468785174 2024-09-12T00:23:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.441+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:23:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.442+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc914b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.442+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.442+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _3mwq_aTcsapZ7C5w8ZdIIe6Lkn3wRMO 2024-09-12T00:23:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.442+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc914b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.442+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.442+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.5 2024-09-12T00:23:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _3mwq_aTcsapZ7C5w8ZdIIe6Lkn3wRMO 2024-09-12T00:23:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.FZvhrgQ61-6hltUb2aA04k6hrcwoGjt_0 2024-09-12T00:23:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:23:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.FZvhrgQ61-6hltUb2aA04k6hrcwoGjt_1 2024-09-12T00:23:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:23:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.444+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _3mwq_aTcsapZ7C5w8ZdIIe6Lkn3wRMO 2024-09-12T00:23:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.446+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:23:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.446+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.446+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.446+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _9z8pHboebCwnVTblDcYA-L83iMQyauP 2024-09-12T00:23:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.446+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.446+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.446+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.5 2024-09-12T00:23:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _9z8pHboebCwnVTblDcYA-L83iMQyauP 2024-09-12T00:23:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.5FZibK090_fSaSXzPhTndhRVq37UN36_0 2024-09-12T00:23:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:23:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.5FZibK090_fSaSXzPhTndhRVq37UN36_1 2024-09-12T00:23:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:23:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.448+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _9z8pHboebCwnVTblDcYA-L83iMQyauP 2024-09-12T00:23:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.449+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:23:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.450+0000 7fb128319800 20 get_obj_state: octx=0x7fb11804f360 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.450+0000 7fb128319800 10 manifest: total_size = 1087 2024-09-12T00:23:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.450+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.187960881258044629 2024-09-12T00:23:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.450+0000 7fb128319800 20 get_obj_state: octx=0x7fb11804f360 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.450+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.450+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.5 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.187960881258044629 2024-09-12T00:23:06.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.1 2024-09-12T00:23:06.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-12T00:23:06.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.2 2024-09-12T00:23:06.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T00:23:06.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.3 2024-09-12T00:23:06.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T00:23:06.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.452+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.187960881258044629 2024-09-12T00:23:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.454+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:23:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.454+0000 7fb128319800 20 get_obj_state: octx=0x55bf1ccaf150 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.454+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.454+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _m5M-R2C-VWsW6SPn0ZE1TK1BZHK7uzN 2024-09-12T00:23:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.454+0000 7fb128319800 20 get_obj_state: octx=0x55bf1ccaf150 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.454+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.454+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.7 2024-09-12T00:23:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _m5M-R2C-VWsW6SPn0ZE1TK1BZHK7uzN 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.nt8CntH8_t9bdcnclzCngr6gJedNtD4_1 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.nt8CntH8_t9bdcnclzCngr6gJedNtD4_2 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.457+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _m5M-R2C-VWsW6SPn0ZE1TK1BZHK7uzN 2024-09-12T00:23:06.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.458+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:23:06.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.458+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.459+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.459+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16834470540148393673 2024-09-12T00:23:06.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.459+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.459+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.459+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.7 2024-09-12T00:23:06.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:23:06.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:23:06.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16834470540148393673 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.1 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.2 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.3 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.461+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16834470540148393673 2024-09-12T00:23:06.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.462+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:23:06.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.462+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc57eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.462+0000 7fb128319800 10 manifest: total_size = 1087 2024-09-12T00:23:06.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.462+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6058135197744258908 2024-09-12T00:23:06.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.462+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc57eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.462+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.462+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.7 2024-09-12T00:23:06.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:23:06.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6058135197744258908 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.1 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.2 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.3 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.465+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6058135197744258908 2024-09-12T00:23:06.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.466+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94af0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.467+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.467+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17274097010246404863 2024-09-12T00:23:06.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.467+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94af0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.467+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.467+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.8 2024-09-12T00:23:06.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.467+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:23:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:23:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:23:06.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17274097010246404863 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.1 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.2 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.3 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.469+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17274097010246404863 2024-09-12T00:23:06.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.471+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:23:06.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.471+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.472+0000 7fb128319800 10 manifest: total_size = 1087 2024-09-12T00:23:06.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.472+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to _apqim-GRIzi5QvrMwjPMcWNw1G2v7OX 2024-09-12T00:23:06.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.472+0000 7fb128319800 20 get_obj_state: octx=0x7fb120050720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.472+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.472+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.8 2024-09-12T00:23:06.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.475+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.475+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.475+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: _apqim-GRIzi5QvrMwjPMcWNw1G2v7OX 2024-09-12T00:23:06.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.475+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.475+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.M6EWKlsP6PXbF9NS94I0I9jokYHcb4d_0 2024-09-12T00:23:06.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.475+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:23:06.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.475+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.475+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _apqim-GRIzi5QvrMwjPMcWNw1G2v7OX 2024-09-12T00:23:06.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.476+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:23:06.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.477+0000 7fb128319800 20 get_obj_state: octx=0x7fb11807df00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.477+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.477+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8538537911214557494 2024-09-12T00:23:06.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.477+0000 7fb128319800 20 get_obj_state: octx=0x7fb11807df00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55bf1ccb3998 s->prefetch_data=0 2024-09-12T00:23:06.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.477+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3998 2024-09-12T00:23:06.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.477+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17.9 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:23:06.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8538537911214557494 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.1 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.2 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.3 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.479+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8538537911214557494 2024-09-12T00:23:06.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.480+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:23:06.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.482+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.482+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.482+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.482+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.482+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.482+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.482+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.484+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:23:06.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.484+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.485+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:23:06.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.485+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:23:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.485+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:23:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.486+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:23:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.486+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:23:06.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.486+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366155 cookie 94279309784208 notifier 5648 bl.length()=199 2024-09-12T00:23:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.489+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17 from cache 2024-09-12T00:23:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.489+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17, ofs0, ns] 2024-09-12T00:23:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.489+0000 7fb0097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366158 cookie 94279309793952 notifier 5648 bl.length()=257 2024-09-12T00:23:06.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.494+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17 : miss 2024-09-12T00:23:06.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.494+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.494+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.494+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17 info.flags=0x0 2024-09-12T00:23:06.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.494+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17 to cache LRU end 2024-09-12T00:23:06.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.496+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15 : miss 2024-09-12T00:23:06.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.496+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.497+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:23:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.497+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15 info.flags=0x17 2024-09-12T00:23:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.497+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15 to cache LRU end 2024-09-12T00:23:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.497+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.497+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.497+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15 2024-09-12T00:23:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.498+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:23:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.499+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:23:06.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.499+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:23:06.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.501+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0ac00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.501+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.501+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6521000508985767440 2024-09-12T00:23:06.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.501+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0ac00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.501+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.501+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15.3 2024-09-12T00:23:06.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:23:06.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6521000508985767440 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-FROZEN.2~c7xu676OKUObEFwjZQuN0xFhcxVnmvY.1 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-FROZEN.2~c7xu676OKUObEFwjZQuN0xFhcxVnmvY.2 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-FROZEN.2~c7xu676OKUObEFwjZQuN0xFhcxVnmvY.3 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.503+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6521000508985767440 2024-09-12T00:23:06.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.504+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:23:06.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.505+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8ff60 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.505+0000 7fb128319800 10 manifest: total_size = 541681 2024-09-12T00:23:06.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.505+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17118100129180405829 2024-09-12T00:23:06.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.505+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8ff60 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.505+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.505+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15.5 2024-09-12T00:23:06.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:23:06.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17118100129180405829 2024-09-12T00:23:06.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-STANDARD.2~gvONtXLOMo64XzGcyo8CcZ4h_zqBULg.1 2024-09-12T00:23:06.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:23:06.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-STANDARD.2~gvONtXLOMo64XzGcyo8CcZ4h_zqBULg.2 2024-09-12T00:23:06.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:23:06.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-STANDARD.2~gvONtXLOMo64XzGcyo8CcZ4h_zqBULg.3 2024-09-12T00:23:06.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:23:06.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.508+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17118100129180405829 2024-09-12T00:23:06.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.509+0000 7fb128319800 20 get_obj_state: octx=0x7fb12000fe00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.509+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:23:06.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.509+0000 7fb128319800 10 manifest: total_size = 11534336 2024-09-12T00:23:06.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.509+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.787241855193822931 2024-09-12T00:23:06.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.509+0000 7fb128319800 20 get_obj_state: octx=0x7fb12000fe00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.509+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.510+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15.7 2024-09-12T00:23:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:23:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:23:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:23:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:23:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.787241855193822931 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-LUKEWARM.2~8NlwYfwKu79rc3c_eZOw1cUg_5ESSSP.1 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-LUKEWARM.2~8NlwYfwKu79rc3c_eZOw1cUg_5ESSSP.2 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-LUKEWARM.2~8NlwYfwKu79rc3c_eZOw1cUg_5ESSSP.3 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:23:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.512+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.787241855193822931 2024-09-12T00:23:06.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.513+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:23:06.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.513+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.513+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.514+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.514+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.514+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.514+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.514+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.516+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:23:06.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.516+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.516+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:23:06.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.516+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:23:06.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.516+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:23:06.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.517+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:23:06.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.517+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:23:06.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.518+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366159 cookie 94279309793952 notifier 5648 bl.length()=194 2024-09-12T00:23:06.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.520+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15 from cache 2024-09-12T00:23:06.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.520+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15, ofs0, ns] 2024-09-12T00:23:06.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.521+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366160 cookie 94279309793952 notifier 5648 bl.length()=252 2024-09-12T00:23:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.524+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15 : miss 2024-09-12T00:23:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.524+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.525+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.525+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15 info.flags=0x0 2024-09-12T00:23:06.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.525+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15 to cache LRU end 2024-09-12T00:23:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.527+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14 : miss 2024-09-12T00:23:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.527+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.527+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:23:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.527+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14 info.flags=0x17 2024-09-12T00:23:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.527+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14 to cache LRU end 2024-09-12T00:23:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.527+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.527+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.527+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14 2024-09-12T00:23:06.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.529+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:23:06.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.529+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:23:06.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.530+0000 7fb128319800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:23:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.531+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc92830 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.532+0000 7fb128319800 10 manifest: total_size = 10485760 2024-09-12T00:23:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.532+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16446452755842528498 2024-09-12T00:23:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.532+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc92830 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.532+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.532+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14.3 2024-09-12T00:23:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16446452755842528498 2024-09-12T00:23:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14__shadow_.ERj7mLRv1DYJefXpp4odevAwY29kmCY_0 2024-09-12T00:23:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:23:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14__shadow_.ERj7mLRv1DYJefXpp4odevAwY29kmCY_1 2024-09-12T00:23:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:23:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.534+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16446452755842528498 2024-09-12T00:23:06.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.536+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:23:06.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.536+0000 7fb128319800 20 get_obj_state: octx=0x7fb11804f340 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.536+0000 7fb128319800 10 manifest: total_size = 649292 2024-09-12T00:23:06.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.536+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5440188613729959646 2024-09-12T00:23:06.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.536+0000 7fb128319800 20 get_obj_state: octx=0x7fb11804f340 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.536+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.536+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14.5 2024-09-12T00:23:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.538+0000 7fb128319800 20 get_obj_state: octx=0x7fb11804e110 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.539+0000 7fb128319800 10 manifest: total_size = 10485760 2024-09-12T00:23:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.539+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12075984103037939474 2024-09-12T00:23:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.539+0000 7fb128319800 20 get_obj_state: octx=0x7fb11804e110 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.539+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.539+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14.7 2024-09-12T00:23:06.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.539+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12075984103037939474 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14__shadow_.zy_JsR9v4j7pAS-yzIzukpQ6I0BG7-B_0 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14__shadow_.zy_JsR9v4j7pAS-yzIzukpQ6I0BG7-B_1 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:23:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.542+0000 7fb128319800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12075984103037939474 2024-09-12T00:23:06.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.543+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:23:06.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.543+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.543+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.544+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.544+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.544+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.544+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.544+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.546+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:23:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.546+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.547+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:23:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.547+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:23:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.547+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:23:06.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.548+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:23:06.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.548+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:23:06.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.548+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94279309781664 notifier 5648 bl.length()=184 2024-09-12T00:23:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.551+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14 from cache 2024-09-12T00:23:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.551+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14, ofs0, ns] 2024-09-12T00:23:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.552+0000 7fb0097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94279309790400 notifier 5648 bl.length()=242 2024-09-12T00:23:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.556+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14 : miss 2024-09-12T00:23:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.556+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.556+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.556+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14 info.flags=0x0 2024-09-12T00:23:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.556+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14 to cache LRU end 2024-09-12T00:23:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.558+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7 : miss 2024-09-12T00:23:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.558+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.558+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:23:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.558+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7 info.flags=0x17 2024-09-12T00:23:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.558+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7 to cache LRU end 2024-09-12T00:23:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.558+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.558+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.559+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7 2024-09-12T00:23:06.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.559+0000 7fb128319800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:23:06.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.560+0000 7fb128319800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:23:06.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.561+0000 7fb128319800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:23:06.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.562+0000 7fb128319800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:23:06.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.563+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94e00 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.563+0000 7fb128319800 10 manifest: total_size = 0 2024-09-12T00:23:06.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.563+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18156709762146357381 2024-09-12T00:23:06.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.563+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94e00 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.563+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.563+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7.2 2024-09-12T00:23:06.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.565+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94e00 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.566+0000 7fb128319800 10 manifest: total_size = 0 2024-09-12T00:23:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.566+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9678139177575179739 2024-09-12T00:23:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.566+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94e00 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.566+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.566+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7.3 2024-09-12T00:23:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.567+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:23:06.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.569+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94e00 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.569+0000 7fb128319800 10 manifest: total_size = 0 2024-09-12T00:23:06.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.569+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5231563851746772191 2024-09-12T00:23:06.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.569+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc94e00 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.569+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.569+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7.6 2024-09-12T00:23:06.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.570+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:23:06.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.573+0000 7fb128319800 20 get_obj_state: octx=0x7fb11804f340 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.573+0000 7fb128319800 10 manifest: total_size = 0 2024-09-12T00:23:06.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.573+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2535309446705846006 2024-09-12T00:23:06.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.573+0000 7fb128319800 20 get_obj_state: octx=0x7fb11804f340 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.573+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.573+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7.8 2024-09-12T00:23:06.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.574+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:23:06.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.576+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.576+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.577+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:23:06.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.577+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.577+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.577+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.577+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.577+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.579+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:23:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.579+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.580+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:23:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.580+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:23:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.580+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:23:06.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.581+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:23:06.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.581+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:23:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.581+0000 7fb0097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 94279309779536 notifier 5648 bl.length()=181 2024-09-12T00:23:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.584+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7 from cache 2024-09-12T00:23:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.584+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7, ofs0, ns] 2024-09-12T00:23:06.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.584+0000 7fb0097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94279309781664 notifier 5648 bl.length()=238 2024-09-12T00:23:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.588+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7 : miss 2024-09-12T00:23:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.588+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.588+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.588+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7 info.flags=0x0 2024-09-12T00:23:06.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.588+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7 to cache LRU end 2024-09-12T00:23:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.590+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8 : miss 2024-09-12T00:23:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.590+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.591+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:23:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.591+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8 info.flags=0x17 2024-09-12T00:23:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.591+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8 to cache LRU end 2024-09-12T00:23:06.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.591+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.591+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.591+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8 2024-09-12T00:23:06.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.592+0000 7fb128319800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:23:06.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.593+0000 7fb128319800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:23:06.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.594+0000 7fb128319800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:23:06.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.594+0000 7fb128319800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:23:06.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.595+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8f500 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.595+0000 7fb128319800 10 manifest: total_size = 524288 2024-09-12T00:23:06.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.595+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11345854283655008165 2024-09-12T00:23:06.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.595+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8f500 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.595+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.595+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8.2 2024-09-12T00:23:06.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.598+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8f500 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.599+0000 7fb128319800 10 manifest: total_size = 527 2024-09-12T00:23:06.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.599+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15156987332834948508 2024-09-12T00:23:06.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.599+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cc8f500 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.599+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.599+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8.3 2024-09-12T00:23:06.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.600+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:23:06.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.601+0000 7fb128319800 20 get_obj_state: octx=0x7fb1100668a0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.602+0000 7fb128319800 10 manifest: total_size = 38 2024-09-12T00:23:06.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.602+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13174441979452117510 2024-09-12T00:23:06.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.602+0000 7fb128319800 20 get_obj_state: octx=0x7fb1100668a0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.602+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.602+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8.6 2024-09-12T00:23:06.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.602+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:23:06.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.604+0000 7fb128319800 20 get_obj_state: octx=0x7fb1100668a0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.605+0000 7fb128319800 10 manifest: total_size = 2078 2024-09-12T00:23:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.605+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2560870257681780875 2024-09-12T00:23:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.605+0000 7fb128319800 20 get_obj_state: octx=0x7fb1100668a0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55bf1ccb3968 s->prefetch_data=0 2024-09-12T00:23:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.605+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccb3968 2024-09-12T00:23:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.605+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8.8 2024-09-12T00:23:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.606+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:23:06.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.608+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.608+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.609+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:23:06.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.610+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.610+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.610+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.610+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.610+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.611+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:23:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.611+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.612+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:23:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.612+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:23:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.612+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:23:06.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.613+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:23:06.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.613+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:23:06.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.613+0000 7fb0097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 94279309779536 notifier 5648 bl.length()=181 2024-09-12T00:23:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.616+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8 from cache 2024-09-12T00:23:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.616+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8, ofs0, ns] 2024-09-12T00:23:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.616+0000 7fb0097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94279309781664 notifier 5648 bl.length()=238 2024-09-12T00:23:06.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.620+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8 : miss 2024-09-12T00:23:06.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.620+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.620+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.620+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8 info.flags=0x0 2024-09-12T00:23:06.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.620+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8 to cache LRU end 2024-09-12T00:23:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.622+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9 : miss 2024-09-12T00:23:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.622+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.623+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:23:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.623+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9 info.flags=0x17 2024-09-12T00:23:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.623+0000 7fb128319800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9 to cache LRU end 2024-09-12T00:23:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.623+0000 7fb128319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.623+0000 7fb128319800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:23:06.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.623+0000 7fb128319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9 2024-09-12T00:23:06.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.624+0000 7fb128319800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:23:06.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.624+0000 7fb128319800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:23:06.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.625+0000 7fb128319800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:23:06.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.626+0000 7fb128319800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:23:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.627+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0a720 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55bf1ccaf4b8 s->prefetch_data=0 2024-09-12T00:23:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.627+0000 7fb128319800 10 manifest: total_size = 1035 2024-09-12T00:23:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.627+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3616350579045026544 2024-09-12T00:23:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.627+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0a720 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55bf1ccaf4b8 s->prefetch_data=0 2024-09-12T00:23:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.627+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccaf4b8 2024-09-12T00:23:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.627+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9.2 2024-09-12T00:23:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.630+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0a720 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55bf1ccaf4b8 s->prefetch_data=0 2024-09-12T00:23:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.630+0000 7fb128319800 10 manifest: total_size = 1035 2024-09-12T00:23:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.630+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11841857691568780041 2024-09-12T00:23:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.630+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0a720 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55bf1ccaf4b8 s->prefetch_data=0 2024-09-12T00:23:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.630+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccaf4b8 2024-09-12T00:23:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.630+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9.3 2024-09-12T00:23:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.631+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:23:06.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.633+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0a720 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55bf1ccaf4b8 s->prefetch_data=0 2024-09-12T00:23:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.633+0000 7fb128319800 10 manifest: total_size = 55 2024-09-12T00:23:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.633+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16164070078588593962 2024-09-12T00:23:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.633+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0a720 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55bf1ccaf4b8 s->prefetch_data=0 2024-09-12T00:23:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.633+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccaf4b8 2024-09-12T00:23:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.633+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9.6 2024-09-12T00:23:06.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.634+0000 7fb0097fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:23:06.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.636+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0a720 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55bf1ccaf4b8 s->prefetch_data=0 2024-09-12T00:23:06.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.636+0000 7fb128319800 10 manifest: total_size = 1035 2024-09-12T00:23:06.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.636+0000 7fb128319800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6086421023585184409 2024-09-12T00:23:06.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.636+0000 7fb128319800 20 get_obj_state: octx=0x55bf1cd0a720 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55bf1ccaf4b8 s->prefetch_data=0 2024-09-12T00:23:06.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.636+0000 7fb128319800 20 prepare_atomic_modification: state is not atomic. state=0x55bf1ccaf4b8 2024-09-12T00:23:06.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.636+0000 7fb128319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9.8 2024-09-12T00:23:06.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.637+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:23:06.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.638+0000 7fb128319800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:23:06.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.638+0000 7fb128319800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:23:06.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.640+0000 7fb008ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:23:06.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.640+0000 7fb128319800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:23:06.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.640+0000 7fb128319800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:23:06.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.640+0000 7fb128319800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:23:06.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.640+0000 7fb128319800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:23:06.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.640+0000 7fb128319800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:23:06.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.642+0000 7fb128319800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:23:06.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.642+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.642+0000 7fb128319800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:23:06.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.642+0000 7fb128319800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:23:06.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.642+0000 7fb128319800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:23:06.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.643+0000 7fb128319800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:23:06.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.643+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:23:06.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.643+0000 7fb0097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 94279309779536 notifier 5648 bl.length()=181 2024-09-12T00:23:06.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.646+0000 7fb128319800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9 from cache 2024-09-12T00:23:06.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.646+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9, ofs0, ns] 2024-09-12T00:23:06.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.647+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94279309781664 notifier 5648 bl.length()=238 2024-09-12T00:23:06.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.652+0000 7fb128319800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9 : miss 2024-09-12T00:23:06.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.652+0000 7fb128319800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.652+0000 7fb128319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.652+0000 7fb128319800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9 info.flags=0x0 2024-09-12T00:23:06.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.652+0000 7fb128319800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9 to cache LRU end 2024-09-12T00:23:06.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.654+0000 7fb128319800 10 removing key index: QGDROSUNZGOTNTZUHEGA 2024-09-12T00:23:06.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.655+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:QGDROSUNZGOTNTZUHEGA, ofs0, ns] 2024-09-12T00:23:06.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.655+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 94279309739280 notifier 5648 bl.length()=170 2024-09-12T00:23:06.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.657+0000 7fb128319800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:23:06.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.658+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:23:06.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.658+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94279309781664 notifier 5648 bl.length()=182 2024-09-12T00:23:06.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.659+0000 7fb128319800 10 removing user buckets index 2024-09-12T00:23:06.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.660+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:23:06.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.660+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366161 cookie 94279309793952 notifier 5648 bl.length()=173 2024-09-12T00:23:06.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.661+0000 7fb128319800 10 removing user index: ragweed.client.0 2024-09-12T00:23:06.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.663+0000 7fb128319800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:23:06.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.663+0000 7fb128319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:23:06.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.663+0000 7fb008ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94279309790400 notifier 5648 bl.length()=165 2024-09-12T00:23:06.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.666+0000 7fafd7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.669+0000 7fb128319800 20 remove_watcher() i=0 2024-09-12T00:23:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.669+0000 7fb128319800 2 removed watcher, disabling cache 2024-09-12T00:23:06.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.675+0000 7fb128319800 20 remove_watcher() i=1 2024-09-12T00:23:06.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.678+0000 7fb128319800 20 remove_watcher() i=2 2024-09-12T00:23:06.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.680+0000 7fb128319800 20 remove_watcher() i=3 2024-09-12T00:23:06.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.683+0000 7fb128319800 20 remove_watcher() i=4 2024-09-12T00:23:06.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.683+0000 7fb128319800 20 remove_watcher() i=5 2024-09-12T00:23:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.685+0000 7fb128319800 20 remove_watcher() i=6 2024-09-12T00:23:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.685+0000 7fb128319800 20 remove_watcher() i=7 2024-09-12T00:23:06.696 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:23:06.756 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:06.756 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:06.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.794+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.796+0000 7fe69b344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.796+0000 7fe69b344800 20 realm 2024-09-12T00:23:06.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.796+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.796+0000 7fe69b344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.796+0000 7fe69b344800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:06.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.796+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.796+0000 7fe69b344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.796+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.797+0000 7fe69b344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:06.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.797+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.798+0000 7fe69b344800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:06.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.798+0000 7fe69b344800 20 searching for the correct realm 2024-09-12T00:23:06.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.801+0000 7fe6978f5640 0 -- 172.21.15.33:0/2470042004 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55d3a9bd4590 msgr2=0x55d3a9bd6a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:06.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.804+0000 7fe6970f4640 0 -- 172.21.15.33:0/2470042004 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fe680096960 msgr2=0x7fe680064440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.809+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 20 zone default found 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 4 Realm: () 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 20 zonegroup default 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.810+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.811+0000 7fe69b344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.811+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.812+0000 7fe69b344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.812+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.812+0000 7fe69b344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:06.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.812+0000 7fe69b344800 20 started sync module instance, tier type = 2024-09-12T00:23:06.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.812+0000 7fe69b344800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:23:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.825+0000 7fe69b344800 20 add_watcher() i=0 2024-09-12T00:23:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.825+0000 7fe69b344800 20 add_watcher() i=1 2024-09-12T00:23:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.825+0000 7fe69b344800 20 add_watcher() i=2 2024-09-12T00:23:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.825+0000 7fe69b344800 20 add_watcher() i=3 2024-09-12T00:23:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.825+0000 7fe69b344800 20 add_watcher() i=4 2024-09-12T00:23:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.825+0000 7fe69b344800 20 add_watcher() i=5 2024-09-12T00:23:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.825+0000 7fe69b344800 20 add_watcher() i=6 2024-09-12T00:23:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.826+0000 7fe69b344800 20 add_watcher() i=7 2024-09-12T00:23:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.826+0000 7fe69b344800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.828+0000 7fe54dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:06.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.828+0000 7fe69b344800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:06.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.828+0000 7fe69b344800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:06.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.863+0000 7fe54cfe1640 20 reqs_thread_entry: start 2024-09-12T00:23:06.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.863+0000 7fe69b344800 20 init_complete bucket index max shards: 11 2024-09-12T00:23:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.863+0000 7fe69b344800 20 Filter name: none 2024-09-12T00:23:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.863+0000 7fe4c67fc640 20 reqs_thread_entry: start 2024-09-12T00:23:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.863+0000 7fe69b344800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:23:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.863+0000 7fe69b344800 20 rados->read ofs=0 len=0 2024-09-12T00:23:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.864+0000 7fe69b344800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:23:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.864+0000 7fe69b344800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:23:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.864+0000 7fe69b344800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:23:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.864+0000 7fe69b344800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.864+0000 7fe69b344800 10 removing key index: NBKOFEFYDJOCOUEGBAJF 2024-09-12T00:23:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.865+0000 7fe69b344800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:NBKOFEFYDJOCOUEGBAJF, ofs0, ns] 2024-09-12T00:23:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.865+0000 7fe57affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366156 cookie 94367574232944 notifier 5943 bl.length()=170 2024-09-12T00:23:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.867+0000 7fe69b344800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:23:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.868+0000 7fe69b344800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:23:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.868+0000 7fe57affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366225 cookie 94367574235216 notifier 5943 bl.length()=182 2024-09-12T00:23:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.869+0000 7fe69b344800 10 removing user buckets index 2024-09-12T00:23:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.870+0000 7fe69b344800 10 removing user index: sysuser.client.0 2024-09-12T00:23:06.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.871+0000 7fe69b344800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:23:06.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.871+0000 7fe69b344800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:23:06.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.871+0000 7fe57affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94367574228176 notifier 5943 bl.length()=165 2024-09-12T00:23:06.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.874+0000 7fe54dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.876+0000 7fe69b344800 20 remove_watcher() i=0 2024-09-12T00:23:06.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.876+0000 7fe69b344800 2 removed watcher, disabling cache 2024-09-12T00:23:06.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.877+0000 7fe69b344800 20 remove_watcher() i=1 2024-09-12T00:23:06.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.878+0000 7fe69b344800 20 remove_watcher() i=2 2024-09-12T00:23:06.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.880+0000 7fe69b344800 20 remove_watcher() i=3 2024-09-12T00:23:06.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.881+0000 7fe69b344800 20 remove_watcher() i=4 2024-09-12T00:23:06.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.882+0000 7fe69b344800 20 remove_watcher() i=5 2024-09-12T00:23:06.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.883+0000 7fe69b344800 20 remove_watcher() i=6 2024-09-12T00:23:06.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:23:06.884+0000 7fe69b344800 20 remove_watcher() i=7 2024-09-12T00:23:06.893 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:23:06.893 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:23:06.977 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:23:06.999 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:23:07.000 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:23:07.000 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:23:07.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:23:07.030 INFO:teuthology.orchestra.run.smithi033.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:23:07.031 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:23:07.100 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:23:07.101 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:23:07.170 INFO:tasks.workunit:timeout=3h 2024-09-12T00:23:07.170 INFO:tasks.workunit:cleanup=True 2024-09-12T00:23:07.170 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:23:07.240 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:23:53.596 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:23:53.597 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:23:53.597 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:23:53.597 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:23:53.597 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:23:53.597 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:23:53.597 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:23:53.597 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:23:53.598 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:23:53.601 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:23:53.671 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:23:53.673 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:23:53.673 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:23:53.724 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:23:53.773 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:23:53.813 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:23:53.814 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:23:53.815 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:23:53.854 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:23:53.858 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:23:53.858 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:23:53.929 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:23:53.930 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:23:53.930 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:23:54.003 INFO:tasks.workunit.client.0.smithi033.stderr:+ ulimit -c 0 2024-09-12T00:23:54.003 INFO:tasks.workunit.client.0.smithi033.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:23:54.003 INFO:tasks.workunit.client.0.smithi033.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:23:54.004 INFO:tasks.workunit.client.0.smithi033.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:23:56.365 INFO:tasks.workunit.client.0.smithi033.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:23:56.365 INFO:tasks.workunit.client.0.smithi033.stderr:++ deactivate nondestructive 2024-09-12T00:23:56.365 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:23:56.365 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ hash -r 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ export VIRTUAL_ENV 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ export PATH 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -z '' ']' 2024-09-12T00:23:56.366 INFO:tasks.workunit.client.0.smithi033.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:23:56.367 INFO:tasks.workunit.client.0.smithi033.stderr:++ PS1='(rgw) ' 2024-09-12T00:23:56.367 INFO:tasks.workunit.client.0.smithi033.stderr:++ export PS1 2024-09-12T00:23:56.367 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:23:56.367 INFO:tasks.workunit.client.0.smithi033.stderr:++ hash -r 2024-09-12T00:23:56.367 INFO:tasks.workunit.client.0.smithi033.stderr:+ pip install pip --upgrade 2024-09-12T00:23:56.604 INFO:tasks.workunit.client.0.smithi033.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:23:56.796 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting pip 2024-09-12T00:23:56.802 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:23:56.849 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: pip 2024-09-12T00:23:56.849 INFO:tasks.workunit.client.0.smithi033.stdout: Attempting uninstall: pip 2024-09-12T00:23:56.849 INFO:tasks.workunit.client.0.smithi033.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:23:57.012 INFO:tasks.workunit.client.0.smithi033.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:23:57.018 INFO:tasks.workunit.client.0.smithi033.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:23:57.792 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed pip-24.2 2024-09-12T00:23:57.841 INFO:tasks.workunit.client.0.smithi033.stderr:+ pip install boto3 2024-09-12T00:23:58.657 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting boto3 2024-09-12T00:23:58.659 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:23:59.453 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:23:59.454 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:23:59.503 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:23:59.504 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:23:59.559 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:23:59.560 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:23:59.610 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:23:59.611 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:23:59.696 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:23:59.698 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:23:59.898 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:23:59.899 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:23:59.904 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:23:59.905 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:23:59.914 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:23:59.916 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:23:59.917 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:23:59.919 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:23:59.920 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:23:59.997 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:24:01.005 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:24:01.123 INFO:tasks.workunit.client.0.smithi033.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:24:01.252 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:24:01.287 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:01.287 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:01.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.328+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.330+0000 7f0284232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:01.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.330+0000 7f0284232800 20 realm 2024-09-12T00:24:01.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.330+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.330+0000 7f0284232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:01.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.330+0000 7f0284232800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:01.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.330+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.330+0000 7f0284232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:01.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.330+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.331+0000 7f0284232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:01.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.331+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.332+0000 7f0284232800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:01.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.332+0000 7f0284232800 20 searching for the correct realm 2024-09-12T00:24:01.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.336+0000 7f027fd54640 0 -- 172.21.15.33:0/539969746 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5648375b5d90 msgr2=0x5648375b8250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:01.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.340+0000 7f027f553640 0 -- 172.21.15.33:0/539969746 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f0274048770 msgr2=0x7f0274060cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:01.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:01.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:01.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:01.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:01.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:01.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:01.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:01.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:01.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 zone default found 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 4 Realm: () 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 zonegroup default 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.345+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.346+0000 7f0284232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.346+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.346+0000 7f0284232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.346+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.346+0000 7f0284232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:01.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.346+0000 7f0284232800 20 started sync module instance, tier type = 2024-09-12T00:24:01.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.346+0000 7f0284232800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:01.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.355+0000 7f0284232800 20 add_watcher() i=0 2024-09-12T00:24:01.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.355+0000 7f0284232800 20 add_watcher() i=1 2024-09-12T00:24:01.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.355+0000 7f0284232800 20 add_watcher() i=2 2024-09-12T00:24:01.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.355+0000 7f0284232800 20 add_watcher() i=3 2024-09-12T00:24:01.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.355+0000 7f0284232800 20 add_watcher() i=4 2024-09-12T00:24:01.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.355+0000 7f0284232800 20 add_watcher() i=5 2024-09-12T00:24:01.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.356+0000 7f0284232800 20 add_watcher() i=6 2024-09-12T00:24:01.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.356+0000 7f0284232800 20 add_watcher() i=7 2024-09-12T00:24:01.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.357+0000 7f0284232800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:01.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.358+0000 7f0135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f0284232800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f0284232800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f0284232800 5 note: GC not initialized 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f0134fe1640 20 reqs_thread_entry: start 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f0284232800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f0284232800 20 Filter name: none 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f00ae7fc640 20 reqs_thread_entry: start 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f0284232800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:24:01.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.359+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:24:01.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T00:24:01.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.360+0000 7f0284232800 20 rados->read ofs=0 len=0 2024-09-12T00:24:01.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.361+0000 7f0284232800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T00:24:01.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.361+0000 7f0284232800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T00:24:01.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.361+0000 7f0284232800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T00:24:01.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.361+0000 7f0284232800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:01.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.361+0000 7f0284232800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T00:24:01.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.361+0000 7f0284232800 20 get_user_info_from_index found 0 xattrs 2024-09-12T00:24:01.361 INFO:tasks.workunit.client.0.smithi033.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T00:24:01.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.362+0000 7f0135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:01.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.364+0000 7f0284232800 20 remove_watcher() i=0 2024-09-12T00:24:01.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.364+0000 7f0284232800 2 removed watcher, disabling cache 2024-09-12T00:24:01.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.366+0000 7f0284232800 20 remove_watcher() i=1 2024-09-12T00:24:01.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.367+0000 7f0284232800 20 remove_watcher() i=2 2024-09-12T00:24:01.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.368+0000 7f0284232800 20 remove_watcher() i=3 2024-09-12T00:24:01.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.369+0000 7f0284232800 20 remove_watcher() i=4 2024-09-12T00:24:01.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.370+0000 7f0284232800 20 remove_watcher() i=5 2024-09-12T00:24:01.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.371+0000 7f0284232800 20 remove_watcher() i=6 2024-09-12T00:24:01.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:01.372+0000 7f0284232800 20 remove_watcher() i=7 2024-09-12T00:24:11.893 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:11.893 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:11.940 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:11.941 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:11.988 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:11.988 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:12.036 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:12.036 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:12.064 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:12.064 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:12.126 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:12.126 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:12.182 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard add 2024-09-12T00:24:12.182 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:12.183 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:24:12.212 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:12.212 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:12.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.253+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.255+0000 7f4f4d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.255+0000 7f4f4d087800 20 realm 2024-09-12T00:24:12.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.255+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.255+0000 7f4f4d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.255+0000 7f4f4d087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:12.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.256+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.256+0000 7f4f4d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.256+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.257+0000 7f4f4d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:12.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.257+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.258+0000 7f4f4d087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:12.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.258+0000 7f4f4d087800 20 searching for the correct realm 2024-09-12T00:24:12.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.261+0000 7f4f4ab71640 0 -- 172.21.15.33:0/1015538799 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f4f440644a0 msgr2=0x7f4f44062f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:12.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.264+0000 7f4f4ab71640 0 -- 172.21.15.33:0/1015538799 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f4f4000b040 msgr2=0x7f4f4005f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:12.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:12.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:12.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:12.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:12.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:12.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:12.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:12.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.471+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:12.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 20 zone default found 2024-09-12T00:24:12.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 4 Realm: () 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 20 zonegroup default 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.472+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.473+0000 7f4f4d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.473+0000 7f4f4d087800 20 started sync module instance, tier type = 2024-09-12T00:24:12.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.473+0000 7f4f4d087800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:12.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.483+0000 7f4f4d087800 20 add_watcher() i=0 2024-09-12T00:24:12.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.483+0000 7f4f4d087800 20 add_watcher() i=1 2024-09-12T00:24:12.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.483+0000 7f4f4d087800 20 add_watcher() i=2 2024-09-12T00:24:12.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.483+0000 7f4f4d087800 20 add_watcher() i=3 2024-09-12T00:24:12.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.483+0000 7f4f4d087800 20 add_watcher() i=4 2024-09-12T00:24:12.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.483+0000 7f4f4d087800 20 add_watcher() i=5 2024-09-12T00:24:12.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.483+0000 7f4f4d087800 20 add_watcher() i=6 2024-09-12T00:24:12.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.484+0000 7f4f4d087800 20 add_watcher() i=7 2024-09-12T00:24:12.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.484+0000 7f4f4d087800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:12.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.485+0000 7f4e017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.486+0000 7f4f4d087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.486+0000 7f4f4d087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.486+0000 7f4f4d087800 5 note: GC not initialized 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.486+0000 7f4d7bfff640 20 reqs_thread_entry: start 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.486+0000 7f4f4d087800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.486+0000 7f4f4d087800 20 Filter name: none 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.486+0000 7f4d79ffb640 20 reqs_thread_entry: start 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.486+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.487+0000 7f4f4d087800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:12.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.487+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.488+0000 7f4f4d087800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:12.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.488+0000 7f4f4d087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:12.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.488+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.488+0000 7f4f4d087800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:12.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.488+0000 7f4f4d087800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.489+0000 7f4f4d087800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:12.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.489+0000 7f4f4d087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:12.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.491+0000 7f4e017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:12.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.493+0000 7f4f4d087800 20 remove_watcher() i=0 2024-09-12T00:24:12.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.493+0000 7f4f4d087800 2 removed watcher, disabling cache 2024-09-12T00:24:12.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.494+0000 7f4f4d087800 20 remove_watcher() i=1 2024-09-12T00:24:12.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.495+0000 7f4f4d087800 20 remove_watcher() i=2 2024-09-12T00:24:12.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.496+0000 7f4f4d087800 20 remove_watcher() i=3 2024-09-12T00:24:12.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.498+0000 7f4f4d087800 20 remove_watcher() i=4 2024-09-12T00:24:12.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.499+0000 7f4f4d087800 20 remove_watcher() i=5 2024-09-12T00:24:12.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.500+0000 7f4f4d087800 20 remove_watcher() i=6 2024-09-12T00:24:12.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.501+0000 7f4f4d087800 20 remove_watcher() i=7 2024-09-12T00:24:12.511 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:12.511 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:12.511 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: a-bucket id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:24:12.511 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:12.512 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T00:24:12.544 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:12.544 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:12.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.585+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.587+0000 7f209b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.587+0000 7f209b146800 20 realm 2024-09-12T00:24:12.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.587+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.587+0000 7f209b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.587+0000 7f209b146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:12.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.587+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.587+0000 7f209b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.587+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.588+0000 7f209b146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:12.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.588+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.589+0000 7f209b146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:12.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.589+0000 7f209b146800 20 searching for the correct realm 2024-09-12T00:24:12.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.593+0000 7f209842f640 0 -- 172.21.15.33:0/3105317078 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x560098396570 msgr2=0x560098398960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:12.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.597+0000 7f209842f640 0 -- 172.21.15.33:0/3105317078 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x7f1f64086c20 msgr2=0x7f1f64089050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:12.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:12.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:12.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:12.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:12.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:12.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:12.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:12.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.601+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:12.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 20 zone default found 2024-09-12T00:24:12.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 4 Realm: () 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 20 zonegroup default 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.602+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.603+0000 7f209b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.603+0000 7f209b146800 20 started sync module instance, tier type = 2024-09-12T00:24:12.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.603+0000 7f209b146800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:12.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.619+0000 7f209b146800 20 add_watcher() i=0 2024-09-12T00:24:12.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.619+0000 7f209b146800 20 add_watcher() i=1 2024-09-12T00:24:12.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.619+0000 7f209b146800 20 add_watcher() i=2 2024-09-12T00:24:12.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.619+0000 7f209b146800 20 add_watcher() i=3 2024-09-12T00:24:12.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.619+0000 7f209b146800 20 add_watcher() i=4 2024-09-12T00:24:12.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.619+0000 7f209b146800 20 add_watcher() i=5 2024-09-12T00:24:12.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.619+0000 7f209b146800 20 add_watcher() i=6 2024-09-12T00:24:12.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.620+0000 7f209b146800 20 add_watcher() i=7 2024-09-12T00:24:12.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.620+0000 7f209b146800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:12.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f1f4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:12.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f209b146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:12.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f209b146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:12.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f209b146800 5 note: GC not initialized 2024-09-12T00:24:12.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f1f4dfe3640 20 reqs_thread_entry: start 2024-09-12T00:24:12.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f209b146800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:12.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f209b146800 20 Filter name: none 2024-09-12T00:24:12.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f1ebf7fe640 20 reqs_thread_entry: start 2024-09-12T00:24:12.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f209b146800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:12.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.622+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.623+0000 7f209b146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:12.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.624+0000 7f209b146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:24:12.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.626+0000 7f1f4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:12.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.628+0000 7f209b146800 20 remove_watcher() i=0 2024-09-12T00:24:12.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.628+0000 7f209b146800 2 removed watcher, disabling cache 2024-09-12T00:24:12.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.629+0000 7f209b146800 20 remove_watcher() i=1 2024-09-12T00:24:12.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.630+0000 7f209b146800 20 remove_watcher() i=2 2024-09-12T00:24:12.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.631+0000 7f209b146800 20 remove_watcher() i=3 2024-09-12T00:24:12.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.633+0000 7f209b146800 20 remove_watcher() i=4 2024-09-12T00:24:12.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.634+0000 7f209b146800 20 remove_watcher() i=5 2024-09-12T00:24:12.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.635+0000 7f209b146800 20 remove_watcher() i=6 2024-09-12T00:24:12.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.636+0000 7f209b146800 20 remove_watcher() i=7 2024-09-12T00:24:12.646 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshard list 2024-09-12T00:24:12.674 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:12.674 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:12.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.715+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.717+0000 7f811f640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.717+0000 7f811f640800 20 realm 2024-09-12T00:24:12.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.717+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.717+0000 7f811f640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.717+0000 7f811f640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:12.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.717+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.717+0000 7f811f640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.717+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.718+0000 7f811f640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:12.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.718+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.719+0000 7f811f640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:12.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.719+0000 7f811f640800 20 searching for the correct realm 2024-09-12T00:24:12.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.721+0000 7f811c929640 0 -- 172.21.15.33:0/3100118929 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f8110020060 msgr2=0x7f811005fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:12.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.725+0000 7f811d12a640 0 -- 172.21.15.33:0/3100118929 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f8114056460 msgr2=0x7f81140568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:12.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:12.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:12.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:12.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:12.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:12.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.932+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 20 zone default found 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 4 Realm: () 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:12.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:12.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:12.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 20 zonegroup default 2024-09-12T00:24:12.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.933+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.934+0000 7f811f640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.934+0000 7f811f640800 20 rados->read ofs=0 len=0 2024-09-12T00:24:12.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.934+0000 7f811f640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:12.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.934+0000 7f811f640800 20 started sync module instance, tier type = 2024-09-12T00:24:12.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.934+0000 7f811f640800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:12.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.944+0000 7f811f640800 20 add_watcher() i=0 2024-09-12T00:24:12.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.944+0000 7f811f640800 20 add_watcher() i=1 2024-09-12T00:24:12.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.944+0000 7f811f640800 20 add_watcher() i=2 2024-09-12T00:24:12.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.944+0000 7f811f640800 20 add_watcher() i=3 2024-09-12T00:24:12.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.944+0000 7f811f640800 20 add_watcher() i=4 2024-09-12T00:24:12.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.944+0000 7f811f640800 20 add_watcher() i=5 2024-09-12T00:24:12.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.944+0000 7f811f640800 20 add_watcher() i=6 2024-09-12T00:24:12.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.945+0000 7f811f640800 20 add_watcher() i=7 2024-09-12T00:24:12.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.945+0000 7f811f640800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:12.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.947+0000 7f7fd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:12.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.947+0000 7f811f640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:12.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.947+0000 7f811f640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:12.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.947+0000 7f811f640800 5 note: GC not initialized 2024-09-12T00:24:12.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.947+0000 7f7fd27e4640 20 reqs_thread_entry: start 2024-09-12T00:24:12.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.947+0000 7f811f640800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:12.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.947+0000 7f811f640800 20 Filter name: none 2024-09-12T00:24:12.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.947+0000 7f7f43fff640 20 reqs_thread_entry: start 2024-09-12T00:24:12.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.954+0000 7f7fd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:12.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.957+0000 7f811f640800 20 remove_watcher() i=0 2024-09-12T00:24:12.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.957+0000 7f811f640800 2 removed watcher, disabling cache 2024-09-12T00:24:12.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.958+0000 7f811f640800 20 remove_watcher() i=1 2024-09-12T00:24:12.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.959+0000 7f811f640800 20 remove_watcher() i=2 2024-09-12T00:24:12.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.960+0000 7f811f640800 20 remove_watcher() i=3 2024-09-12T00:24:12.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.961+0000 7f811f640800 20 remove_watcher() i=4 2024-09-12T00:24:12.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.962+0000 7f811f640800 20 remove_watcher() i=5 2024-09-12T00:24:12.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.963+0000 7f811f640800 20 remove_watcher() i=6 2024-09-12T00:24:12.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:12.964+0000 7f811f640800 20 remove_watcher() i=7 2024-09-12T00:24:12.974 INFO:tasks.workunit.client.0.smithi033.stderr:bucket name a-bucket 2024-09-12T00:24:12.974 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard process 2024-09-12T00:24:12.974 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:12.975 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshard process 2024-09-12T00:24:13.003 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:13.003 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:13.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.044+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.046+0000 7f1bed1ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:13.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.046+0000 7f1bed1ab800 20 realm 2024-09-12T00:24:13.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.046+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.046+0000 7f1bed1ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:13.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.046+0000 7f1bed1ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:13.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.046+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.046+0000 7f1bed1ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:13.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.046+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.047+0000 7f1bed1ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:13.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.047+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.048+0000 7f1bed1ab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:13.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.048+0000 7f1bed1ab800 20 searching for the correct realm 2024-09-12T00:24:13.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.051+0000 7f1be2494640 0 -- 172.21.15.33:0/3400718680 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55d1deba0a00 msgr2=0x55d1deba2df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:13.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.054+0000 7f1beac95640 0 -- 172.21.15.33:0/3400718680 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f1bd4022070 msgr2=0x7f1bd40093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:13.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.260+0000 7f1bed1ab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:13.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.260+0000 7f1bed1ab800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:13.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.260+0000 7f1bed1ab800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:13.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.260+0000 7f1bed1ab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:13.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.260+0000 7f1bed1ab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:13.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.260+0000 7f1bed1ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:13.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.260+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:13.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:13.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:13.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 20 zone default found 2024-09-12T00:24:13.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 4 Realm: () 2024-09-12T00:24:13.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:13.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:13.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:13.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 20 zonegroup default 2024-09-12T00:24:13.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.261+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.262+0000 7f1bed1ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:13.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.262+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.262+0000 7f1bed1ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:13.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.262+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.262+0000 7f1bed1ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:13.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.262+0000 7f1bed1ab800 20 started sync module instance, tier type = 2024-09-12T00:24:13.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.262+0000 7f1bed1ab800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:13.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.273+0000 7f1bed1ab800 20 add_watcher() i=0 2024-09-12T00:24:13.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.273+0000 7f1bed1ab800 20 add_watcher() i=1 2024-09-12T00:24:13.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.273+0000 7f1bed1ab800 20 add_watcher() i=2 2024-09-12T00:24:13.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.273+0000 7f1bed1ab800 20 add_watcher() i=3 2024-09-12T00:24:13.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.273+0000 7f1bed1ab800 20 add_watcher() i=4 2024-09-12T00:24:13.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.273+0000 7f1bed1ab800 20 add_watcher() i=5 2024-09-12T00:24:13.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.273+0000 7f1bed1ab800 20 add_watcher() i=6 2024-09-12T00:24:13.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.274+0000 7f1bed1ab800 20 add_watcher() i=7 2024-09-12T00:24:13.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.274+0000 7f1bed1ab800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:13.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.276+0000 7f1aa17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.276+0000 7f1bed1ab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.276+0000 7f1bed1ab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.277+0000 7f1bed1ab800 5 note: GC not initialized 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.277+0000 7f1a1bfff640 20 reqs_thread_entry: start 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.277+0000 7f1bed1ab800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.277+0000 7f1bed1ab800 20 Filter name: none 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.277+0000 7f1a19ffb640 20 reqs_thread_entry: start 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.277+0000 7f1bed1ab800 20 processing logshard = reshard.0000000000 2024-09-12T00:24:13.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.280+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:24:13.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.280+0000 7f1bed1ab800 20 processing logshard = reshard.0000000001 2024-09-12T00:24:13.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.283+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:24:13.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.283+0000 7f1bed1ab800 20 processing logshard = reshard.0000000002 2024-09-12T00:24:13.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.286+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:24:13.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.286+0000 7f1bed1ab800 20 processing logshard = reshard.0000000003 2024-09-12T00:24:13.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.288+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:24:13.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.288+0000 7f1bed1ab800 20 processing logshard = reshard.0000000004 2024-09-12T00:24:13.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.291+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:24:13.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.291+0000 7f1bed1ab800 20 processing logshard = reshard.0000000005 2024-09-12T00:24:13.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.293+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:24:13.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.293+0000 7f1bed1ab800 20 processing logshard = reshard.0000000006 2024-09-12T00:24:13.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.295+0000 7f1bed1ab800 20 process_entry resharding a-bucket 2024-09-12T00:24:13.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.295+0000 7f1bed1ab800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:13.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.295+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:13.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:24:13.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:13.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:24:13.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 20 rados->read ofs=0 len=0 2024-09-12T00:24:13.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:13.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:13.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:13.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:13.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:13.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.296+0000 7f1bed1ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:24:13.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.303+0000 7f1bed1ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:13.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.303+0000 7f1bed1ab800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:13.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.303+0000 7f1bed1ab800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:13.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.303+0000 7f1bed1ab800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:24:13.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.303+0000 7f1ace7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366154 cookie 94359873302800 notifier 6039 bl.length()=911 2024-09-12T00:24:13.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.303+0000 7f1ace7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:13.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.303+0000 7f1ace7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:13.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.303+0000 7f1ace7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:13.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.305+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:24:13.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.305+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:24:13.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.305+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:24:13.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.305+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:24:13.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.0 2024-09-12T00:24:13.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.0 2024-09-12T00:24:13.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.1 2024-09-12T00:24:13.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.1 2024-09-12T00:24:13.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.2 2024-09-12T00:24:13.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.2 2024-09-12T00:24:13.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.3 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.3 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.4 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.4 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.5 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.5 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.6 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.6 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.7 2024-09-12T00:24:13.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.7 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.8 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.8 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.9 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.9 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.10 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.10 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.11 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.11 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.310+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.0 2024-09-12T00:24:13.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.311+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1 2024-09-12T00:24:13.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.311+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2 2024-09-12T00:24:13.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.311+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3 2024-09-12T00:24:13.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.312+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.4 2024-09-12T00:24:13.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.312+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.5 2024-09-12T00:24:13.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.313+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.6 2024-09-12T00:24:13.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.313+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.7 2024-09-12T00:24:13.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.314+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.8 2024-09-12T00:24:13.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.314+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.9 2024-09-12T00:24:13.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.315+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.10 2024-09-12T00:24:13.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.316+0000 7f1bed1ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:13.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.316+0000 7f1bed1ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:24:13.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.317+0000 7f1bed1ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:13.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.317+0000 7f1bed1ab800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:13.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.317+0000 7f1bed1ab800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:13.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.317+0000 7f1bed1ab800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:24:13.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.318+0000 7f1ace7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366155 cookie 94359873302800 notifier 6039 bl.length()=911 2024-09-12T00:24:13.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.318+0000 7f1ace7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:13.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.318+0000 7f1ace7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:13.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.318+0000 7f1ace7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:13.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.319+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:24:13.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.319+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:24:13.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.319+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:24:13.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.319+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:24:13.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.322+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.0 2024-09-12T00:24:13.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.322+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1 2024-09-12T00:24:13.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.322+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2 2024-09-12T00:24:13.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.323+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3 2024-09-12T00:24:13.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.323+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.4 2024-09-12T00:24:13.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.323+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.5 2024-09-12T00:24:13.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.324+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.6 2024-09-12T00:24:13.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.324+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.7 2024-09-12T00:24:13.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.324+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.8 2024-09-12T00:24:13.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.325+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.9 2024-09-12T00:24:13.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.325+0000 7f1bed1ab800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.10 2024-09-12T00:24:13.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.325+0000 7f1bed1ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:13.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.325+0000 7f1bed1ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:24:13.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.327+0000 7f1bed1ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:13.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.327+0000 7f1bed1ab800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:13.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.327+0000 7f1bed1ab800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:13.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.327+0000 7f1bed1ab800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:24:13.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.327+0000 7f1acdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366156 cookie 94359873302800 notifier 6039 bl.length()=879 2024-09-12T00:24:13.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.327+0000 7f1acdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:13.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.327+0000 7f1acdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:13.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.327+0000 7f1acdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:13.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.328+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:24:13.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.328+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:24:13.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.328+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:24:13.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.328+0000 7f1bed1ab800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:24:13.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.331+0000 7f1bed1ab800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T00:24:13.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.332+0000 7f1bed1ab800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:24:13.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.334+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:24:13.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.334+0000 7f1bed1ab800 20 processing logshard = reshard.0000000007 2024-09-12T00:24:13.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.337+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:24:13.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.337+0000 7f1bed1ab800 20 processing logshard = reshard.0000000008 2024-09-12T00:24:13.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.340+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:24:13.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.340+0000 7f1bed1ab800 20 processing logshard = reshard.0000000009 2024-09-12T00:24:13.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.342+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:24:13.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.342+0000 7f1bed1ab800 20 processing logshard = reshard.0000000010 2024-09-12T00:24:13.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.345+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:24:13.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.345+0000 7f1bed1ab800 20 processing logshard = reshard.0000000011 2024-09-12T00:24:13.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.347+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:24:13.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.347+0000 7f1bed1ab800 20 processing logshard = reshard.0000000012 2024-09-12T00:24:13.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.350+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:24:13.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.350+0000 7f1bed1ab800 20 processing logshard = reshard.0000000013 2024-09-12T00:24:13.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.353+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:24:13.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.353+0000 7f1bed1ab800 20 processing logshard = reshard.0000000014 2024-09-12T00:24:13.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.355+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:24:13.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.355+0000 7f1bed1ab800 20 processing logshard = reshard.0000000015 2024-09-12T00:24:13.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.358+0000 7f1bed1ab800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:24:13.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.359+0000 7f1aa17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:13.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.361+0000 7f1bed1ab800 20 remove_watcher() i=0 2024-09-12T00:24:13.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.361+0000 7f1bed1ab800 2 removed watcher, disabling cache 2024-09-12T00:24:13.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.362+0000 7f1bed1ab800 20 remove_watcher() i=1 2024-09-12T00:24:13.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.363+0000 7f1bed1ab800 20 remove_watcher() i=2 2024-09-12T00:24:13.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.364+0000 7f1bed1ab800 20 remove_watcher() i=3 2024-09-12T00:24:13.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.366+0000 7f1bed1ab800 20 remove_watcher() i=4 2024-09-12T00:24:13.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.367+0000 7f1bed1ab800 20 remove_watcher() i=5 2024-09-12T00:24:13.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.368+0000 7f1bed1ab800 20 remove_watcher() i=6 2024-09-12T00:24:13.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:13.369+0000 7f1bed1ab800 20 remove_watcher() i=7 2024-09-12T00:24:18.386 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:24:18.419 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:18.419 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:18.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.468+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:18.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.469+0000 7f50a042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:18.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.469+0000 7f50a042f800 20 realm 2024-09-12T00:24:18.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.469+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:18.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.470+0000 7f50a042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:18.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.470+0000 7f50a042f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:18.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.470+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:18.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.470+0000 7f50a042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:18.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.470+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:18.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.471+0000 7f50a042f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:18.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.471+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:18.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.472+0000 7f50a042f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:18.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.472+0000 7f50a042f800 20 searching for the correct realm 2024-09-12T00:24:18.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.676+0000 7f509d718640 0 -- 172.21.15.33:0/833748820 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f5090088760 msgr2=0x7f5090001bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:18.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:18.883+0000 7f509df19640 0 -- 172.21.15.33:0/833748820 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f5094074040 msgr2=0x7f509408e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.091+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:19.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 20 zone default found 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 4 Realm: () 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 20 zonegroup default 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.092+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.093+0000 7f50a042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.093+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.093+0000 7f50a042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.093+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.093+0000 7f50a042f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.093+0000 7f50a042f800 20 started sync module instance, tier type = 2024-09-12T00:24:19.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.093+0000 7f50a042f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:19.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.105+0000 7f50a042f800 20 add_watcher() i=0 2024-09-12T00:24:19.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.105+0000 7f50a042f800 20 add_watcher() i=1 2024-09-12T00:24:19.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.105+0000 7f50a042f800 20 add_watcher() i=2 2024-09-12T00:24:19.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.105+0000 7f50a042f800 20 add_watcher() i=3 2024-09-12T00:24:19.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.105+0000 7f50a042f800 20 add_watcher() i=4 2024-09-12T00:24:19.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.105+0000 7f50a042f800 20 add_watcher() i=5 2024-09-12T00:24:19.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.105+0000 7f50a042f800 20 add_watcher() i=6 2024-09-12T00:24:19.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.106+0000 7f50a042f800 20 add_watcher() i=7 2024-09-12T00:24:19.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.106+0000 7f50a042f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:19.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.108+0000 7f4f4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.108+0000 7f50a042f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.108+0000 7f50a042f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.108+0000 7f50a042f800 5 note: GC not initialized 2024-09-12T00:24:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.109+0000 7f4f4e7fc640 20 reqs_thread_entry: start 2024-09-12T00:24:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.109+0000 7f50a042f800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.109+0000 7f50a042f800 20 Filter name: none 2024-09-12T00:24:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.109+0000 7f4ebffff640 20 reqs_thread_entry: start 2024-09-12T00:24:19.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.109+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.110+0000 7f50a042f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:19.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.110+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.110+0000 7f50a042f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:19.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.110+0000 7f50a042f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:19.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.110+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.111+0000 7f50a042f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:19.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.111+0000 7f50a042f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.111+0000 7f50a042f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:19.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.111+0000 7f50a042f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:19.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.113+0000 7f4f4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.116+0000 7f50a042f800 20 remove_watcher() i=0 2024-09-12T00:24:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.116+0000 7f50a042f800 2 removed watcher, disabling cache 2024-09-12T00:24:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.117+0000 7f50a042f800 20 remove_watcher() i=1 2024-09-12T00:24:19.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.118+0000 7f50a042f800 20 remove_watcher() i=2 2024-09-12T00:24:19.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.119+0000 7f50a042f800 20 remove_watcher() i=3 2024-09-12T00:24:19.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.121+0000 7f50a042f800 20 remove_watcher() i=4 2024-09-12T00:24:19.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.122+0000 7f50a042f800 20 remove_watcher() i=5 2024-09-12T00:24:19.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.123+0000 7f50a042f800 20 remove_watcher() i=6 2024-09-12T00:24:19.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.124+0000 7f50a042f800 20 remove_watcher() i=7 2024-09-12T00:24:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:19.137 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:19.137 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: a-bucket id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:24:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:19.137 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard add non empty bucket 2024-09-12T00:24:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:19.141 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:19.182 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:19.216 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:19.216 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:19.251 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:19.251 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:19.285 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:19.285 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:19.319 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:19.320 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:19.352 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:19.353 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:19.385 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:19.385 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:19.418 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:24:19.446 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:19.447 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:19.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.488+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.490+0000 7f0976d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.490+0000 7f0976d25800 20 realm 2024-09-12T00:24:19.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.490+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.490+0000 7f0976d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.490+0000 7f0976d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:19.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.490+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.490+0000 7f0976d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.490+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.491+0000 7f0976d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:19.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.491+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.492+0000 7f0976d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:19.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.492+0000 7f0976d25800 20 searching for the correct realm 2024-09-12T00:24:19.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.495+0000 7f0972933640 0 -- 172.21.15.33:0/2351272090 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f096c039060 msgr2=0x7f096c065710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:19.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.499+0000 7f0972933640 0 -- 172.21.15.33:0/2351272090 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f095c089420 msgr2=0x7f095c0898a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:19.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:19.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:19.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:19.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:19.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:19.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:19.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:19.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.706+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 20 zone default found 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 4 Realm: () 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 20 zonegroup default 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.707 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.707+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.708+0000 7f0976d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.708+0000 7f0976d25800 20 started sync module instance, tier type = 2024-09-12T00:24:19.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.708+0000 7f0976d25800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:19.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.718+0000 7f0976d25800 20 add_watcher() i=0 2024-09-12T00:24:19.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.718+0000 7f0976d25800 20 add_watcher() i=1 2024-09-12T00:24:19.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.718+0000 7f0976d25800 20 add_watcher() i=2 2024-09-12T00:24:19.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.718+0000 7f0976d25800 20 add_watcher() i=3 2024-09-12T00:24:19.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.718+0000 7f0976d25800 20 add_watcher() i=4 2024-09-12T00:24:19.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.718+0000 7f0976d25800 20 add_watcher() i=5 2024-09-12T00:24:19.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.718+0000 7f0976d25800 20 add_watcher() i=6 2024-09-12T00:24:19.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.719+0000 7f0976d25800 20 add_watcher() i=7 2024-09-12T00:24:19.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.719+0000 7f0976d25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:19.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.720+0000 7f08297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:19.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.721+0000 7f0976d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:19.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.721+0000 7f0976d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:19.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.721+0000 7f0976d25800 5 note: GC not initialized 2024-09-12T00:24:19.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.721+0000 7f07a3fff640 20 reqs_thread_entry: start 2024-09-12T00:24:19.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.721+0000 7f0976d25800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:19.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.721+0000 7f0976d25800 20 Filter name: none 2024-09-12T00:24:19.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.721+0000 7f07a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:24:19.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.721+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.722+0000 7f0976d25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:19.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.722+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.722+0000 7f0976d25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:19.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.722+0000 7f0976d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:19.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.722+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.723+0000 7f0976d25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:19.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.723+0000 7f0976d25800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.723+0000 7f0976d25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:19.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.723+0000 7f0976d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:19.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.726+0000 7f08297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:19.727 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.728+0000 7f0976d25800 20 remove_watcher() i=0 2024-09-12T00:24:19.727 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.728+0000 7f0976d25800 2 removed watcher, disabling cache 2024-09-12T00:24:19.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.730+0000 7f0976d25800 20 remove_watcher() i=1 2024-09-12T00:24:19.729 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.731+0000 7f0976d25800 20 remove_watcher() i=2 2024-09-12T00:24:19.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.732+0000 7f0976d25800 20 remove_watcher() i=3 2024-09-12T00:24:19.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.733+0000 7f0976d25800 20 remove_watcher() i=4 2024-09-12T00:24:19.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.734+0000 7f0976d25800 20 remove_watcher() i=5 2024-09-12T00:24:19.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.735+0000 7f0976d25800 20 remove_watcher() i=6 2024-09-12T00:24:19.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.736+0000 7f0976d25800 20 remove_watcher() i=7 2024-09-12T00:24:19.745 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:19.745 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:19.746 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: a-bucket id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T00:24:19.746 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:19.747 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T00:24:19.778 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:19.778 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:19.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.820+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.821+0000 7f7491c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.821+0000 7f7491c0e800 20 realm 2024-09-12T00:24:19.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.821+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.821+0000 7f7491c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.821+0000 7f7491c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:19.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.821+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.821+0000 7f7491c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.821+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.822+0000 7f7491c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:19.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.823+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.823+0000 7f7491c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:19.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.823+0000 7f7491c0e800 20 searching for the correct realm 2024-09-12T00:24:19.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.827+0000 7f748da5a640 0 -- 172.21.15.33:0/22519088 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x555e82b2a080 msgr2=0x555e82b2c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:19.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.830+0000 7f748d259640 0 -- 172.21.15.33:0/22519088 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f74840710f0 msgr2=0x7f7484066770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:19.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:19.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:19.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:19.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:19.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:19.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:19.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.835+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 zone default found 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 4 Realm: () 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 zonegroup default 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 started sync module instance, tier type = 2024-09-12T00:24:19.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.836+0000 7f7491c0e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:19.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.845+0000 7f7491c0e800 20 add_watcher() i=0 2024-09-12T00:24:19.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.845+0000 7f7491c0e800 20 add_watcher() i=1 2024-09-12T00:24:19.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.845+0000 7f7491c0e800 20 add_watcher() i=2 2024-09-12T00:24:19.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.845+0000 7f7491c0e800 20 add_watcher() i=3 2024-09-12T00:24:19.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.845+0000 7f7491c0e800 20 add_watcher() i=4 2024-09-12T00:24:19.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.845+0000 7f7491c0e800 20 add_watcher() i=5 2024-09-12T00:24:19.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.845+0000 7f7491c0e800 20 add_watcher() i=6 2024-09-12T00:24:19.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.846+0000 7f7491c0e800 20 add_watcher() i=7 2024-09-12T00:24:19.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.846+0000 7f7491c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:19.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.848+0000 7f7343fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:19.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.848+0000 7f7491c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:19.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.848+0000 7f7491c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:19.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.848+0000 7f7491c0e800 5 note: GC not initialized 2024-09-12T00:24:19.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7342fe5640 20 reqs_thread_entry: start 2024-09-12T00:24:19.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:19.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 20 Filter name: none 2024-09-12T00:24:19.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7340fe1640 20 reqs_thread_entry: start 2024-09-12T00:24:19.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:19.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.849+0000 7f7491c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.850+0000 7f7491c0e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.850+0000 7f7491c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.850+0000 7f7491c0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:19.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.850+0000 7f7491c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:19.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.850+0000 7f7491c0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:19.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.850+0000 7f7491c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:24:19.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.852+0000 7f7343fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:19.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.855+0000 7f7491c0e800 20 remove_watcher() i=0 2024-09-12T00:24:19.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.855+0000 7f7491c0e800 2 removed watcher, disabling cache 2024-09-12T00:24:19.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.856+0000 7f7491c0e800 20 remove_watcher() i=1 2024-09-12T00:24:19.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.857+0000 7f7491c0e800 20 remove_watcher() i=2 2024-09-12T00:24:19.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.858+0000 7f7491c0e800 20 remove_watcher() i=3 2024-09-12T00:24:19.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.859+0000 7f7491c0e800 20 remove_watcher() i=4 2024-09-12T00:24:19.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.860+0000 7f7491c0e800 20 remove_watcher() i=5 2024-09-12T00:24:19.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.861+0000 7f7491c0e800 20 remove_watcher() i=6 2024-09-12T00:24:19.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.862+0000 7f7491c0e800 20 remove_watcher() i=7 2024-09-12T00:24:19.873 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshard list 2024-09-12T00:24:19.901 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:19.901 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:19.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.942+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.944+0000 7f6557739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.944+0000 7f6557739800 20 realm 2024-09-12T00:24:19.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.944+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.944+0000 7f6557739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.944+0000 7f6557739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:19.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.944+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.944+0000 7f6557739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:19.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.944+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.945+0000 7f6557739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:19.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.945+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:19.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.946+0000 7f6557739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:19.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.946+0000 7f6557739800 20 searching for the correct realm 2024-09-12T00:24:19.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.948+0000 7f65533c7640 0 -- 172.21.15.33:0/1531202804 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f654c06b070 msgr2=0x7f654c0c1da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:19.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:19.952+0000 7f65533c7640 0 -- 172.21.15.33:0/1531202804 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f6548038b30 msgr2=0x7f6548046980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:20.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:20.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:20.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:20.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:20.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:20.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:20.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.159+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:20.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:20.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 20 zone default found 2024-09-12T00:24:20.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 4 Realm: () 2024-09-12T00:24:20.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:20.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:20.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:20.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 20 zonegroup default 2024-09-12T00:24:20.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.160+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.161+0000 7f6557739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.161+0000 7f6557739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.161+0000 7f6557739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.161+0000 7f6557739800 20 started sync module instance, tier type = 2024-09-12T00:24:20.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.161+0000 7f6557739800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:20.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.171+0000 7f6557739800 20 add_watcher() i=0 2024-09-12T00:24:20.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.171+0000 7f6557739800 20 add_watcher() i=1 2024-09-12T00:24:20.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.171+0000 7f6557739800 20 add_watcher() i=2 2024-09-12T00:24:20.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.171+0000 7f6557739800 20 add_watcher() i=3 2024-09-12T00:24:20.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.171+0000 7f6557739800 20 add_watcher() i=4 2024-09-12T00:24:20.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.171+0000 7f6557739800 20 add_watcher() i=5 2024-09-12T00:24:20.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.171+0000 7f6557739800 20 add_watcher() i=6 2024-09-12T00:24:20.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.172+0000 7f6557739800 20 add_watcher() i=7 2024-09-12T00:24:20.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.172+0000 7f6557739800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:20.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.173+0000 7f6409fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.174+0000 7f6557739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.174+0000 7f6557739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.174+0000 7f6557739800 5 note: GC not initialized 2024-09-12T00:24:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.174+0000 7f6408fe1640 20 reqs_thread_entry: start 2024-09-12T00:24:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.174+0000 7f6557739800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.174+0000 7f6557739800 20 Filter name: none 2024-09-12T00:24:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.174+0000 7f63827fc640 20 reqs_thread_entry: start 2024-09-12T00:24:20.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.180+0000 7f6409fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.183+0000 7f6557739800 20 remove_watcher() i=0 2024-09-12T00:24:20.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.183+0000 7f6557739800 2 removed watcher, disabling cache 2024-09-12T00:24:20.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.184+0000 7f6557739800 20 remove_watcher() i=1 2024-09-12T00:24:20.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.185+0000 7f6557739800 20 remove_watcher() i=2 2024-09-12T00:24:20.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.187+0000 7f6557739800 20 remove_watcher() i=3 2024-09-12T00:24:20.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.188+0000 7f6557739800 20 remove_watcher() i=4 2024-09-12T00:24:20.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.189+0000 7f6557739800 20 remove_watcher() i=5 2024-09-12T00:24:20.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.190+0000 7f6557739800 20 remove_watcher() i=6 2024-09-12T00:24:20.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.191+0000 7f6557739800 20 remove_watcher() i=7 2024-09-12T00:24:20.202 INFO:tasks.workunit.client.0.smithi033.stderr:bucket name a-bucket 2024-09-12T00:24:20.202 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard process non empty bucket 2024-09-12T00:24:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:20.202 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshard process 2024-09-12T00:24:20.229 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:20.229 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:20.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.271+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.272+0000 7f9c474bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.272+0000 7f9c474bb800 20 realm 2024-09-12T00:24:20.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.272+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.273+0000 7f9c474bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.273+0000 7f9c474bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:20.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.273+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.273+0000 7f9c474bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.273+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.274+0000 7f9c474bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:20.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.274+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.274+0000 7f9c474bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:20.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.274+0000 7f9c474bb800 20 searching for the correct realm 2024-09-12T00:24:20.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.277+0000 7f9c44fa5640 0 -- 172.21.15.33:0/2606767595 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f9c3c017020 msgr2=0x7f9c3c064a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:20.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.281+0000 7f9c44fa5640 0 -- 172.21.15.33:0/2606767595 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f9c380adcd0 msgr2=0x7f9c380dc910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:20.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:20.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:20.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:20.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:20.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:20.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:20.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:20.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.488+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:20.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 20 zone default found 2024-09-12T00:24:20.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 4 Realm: () 2024-09-12T00:24:20.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:20.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:20.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:20.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 20 zonegroup default 2024-09-12T00:24:20.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.489+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.490+0000 7f9c474bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.490+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.490+0000 7f9c474bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.490+0000 7f9c474bb800 20 started sync module instance, tier type = 2024-09-12T00:24:20.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.490+0000 7f9c474bb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:20.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.499+0000 7f9c474bb800 20 add_watcher() i=0 2024-09-12T00:24:20.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.499+0000 7f9c474bb800 20 add_watcher() i=1 2024-09-12T00:24:20.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.499+0000 7f9c474bb800 20 add_watcher() i=2 2024-09-12T00:24:20.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.499+0000 7f9c474bb800 20 add_watcher() i=3 2024-09-12T00:24:20.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.499+0000 7f9c474bb800 20 add_watcher() i=4 2024-09-12T00:24:20.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.499+0000 7f9c474bb800 20 add_watcher() i=5 2024-09-12T00:24:20.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.499+0000 7f9c474bb800 20 add_watcher() i=6 2024-09-12T00:24:20.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.500+0000 7f9c474bb800 20 add_watcher() i=7 2024-09-12T00:24:20.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.500+0000 7f9c474bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:20.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.503+0000 7f9afb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:20.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.503+0000 7f9c474bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:20.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.503+0000 7f9c474bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:20.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.503+0000 7f9c474bb800 5 note: GC not initialized 2024-09-12T00:24:20.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.503+0000 7f9afa7e4640 20 reqs_thread_entry: start 2024-09-12T00:24:20.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.503+0000 7f9c474bb800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:20.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.503+0000 7f9c474bb800 20 Filter name: none 2024-09-12T00:24:20.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.503+0000 7f9af3fff640 20 reqs_thread_entry: start 2024-09-12T00:24:20.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.504+0000 7f9c474bb800 20 processing logshard = reshard.0000000000 2024-09-12T00:24:20.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.506+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:24:20.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.506+0000 7f9c474bb800 20 processing logshard = reshard.0000000001 2024-09-12T00:24:20.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.509+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:24:20.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.509+0000 7f9c474bb800 20 processing logshard = reshard.0000000002 2024-09-12T00:24:20.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.512+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:24:20.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.512+0000 7f9c474bb800 20 processing logshard = reshard.0000000003 2024-09-12T00:24:20.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.515+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:24:20.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.515+0000 7f9c474bb800 20 processing logshard = reshard.0000000004 2024-09-12T00:24:20.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.518+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:24:20.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.518+0000 7f9c474bb800 20 processing logshard = reshard.0000000005 2024-09-12T00:24:20.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.520+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:24:20.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.520+0000 7f9c474bb800 20 processing logshard = reshard.0000000006 2024-09-12T00:24:20.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.522+0000 7f9c474bb800 20 process_entry resharding a-bucket 2024-09-12T00:24:20.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.522+0000 7f9c474bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:20.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.522+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.522+0000 7f9c474bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:20.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.522+0000 7f9c474bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:24:20.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.522+0000 7f9c474bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:20.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.522+0000 7f9c474bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:24:20.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.522+0000 7f9c474bb800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.523+0000 7f9c474bb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:20.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.523+0000 7f9c474bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:20.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.523+0000 7f9c474bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:20.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.523+0000 7f9c474bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:20.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.523+0000 7f9c474bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:20.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.523+0000 7f9c474bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:24:20.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.531+0000 7f9c474bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:20.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.531+0000 7f9c474bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:20.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.531+0000 7f9c474bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:20.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.531+0000 7f9c474bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:24:20.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.532+0000 7f9b1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366157 cookie 94035000146032 notifier 5831 bl.length()=911 2024-09-12T00:24:20.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.532+0000 7f9b1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:20.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.532+0000 7f9b1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:20.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.532+0000 7f9b1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:20.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.533+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:24:20.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.533+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:24:20.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.533+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:24:20.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.533+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:24:20.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:24:20.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:24:20.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:24:20.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:24:20.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:24:20.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:24:20.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:24:20.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:24:20.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:24:20.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:24:20.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:24:20.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:24:20.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:24:20.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:24:20.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:24:20.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:24:20.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:24:20.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:24:20.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:24:20.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:24:20.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:24:20.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:24:20.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:24:20.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:24:20.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:24:20.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:24:20.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.0 2024-09-12T00:24:20.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.538+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.0 2024-09-12T00:24:20.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.539+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.1 2024-09-12T00:24:20.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.539+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.1 2024-09-12T00:24:20.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.539+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.2 2024-09-12T00:24:20.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.539+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.2 2024-09-12T00:24:20.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.540+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.3 2024-09-12T00:24:20.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.540+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.3 2024-09-12T00:24:20.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.540+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.4 2024-09-12T00:24:20.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.540+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.4 2024-09-12T00:24:20.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.541+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.5 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.541+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.5 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.541+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.6 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.541+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.6 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.541+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.7 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.541+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.7 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.542+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.8 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.542+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.8 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.542+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.9 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.542+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.9 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.543+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.10 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.543+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.10 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.543+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.11 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.543+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.11 2024-09-12T00:24:20.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.546+0000 7f9c474bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:20.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.546+0000 7f9c474bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:24:20.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.548+0000 7f9c474bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:20.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.548+0000 7f9c474bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:20.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.548+0000 7f9c474bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:20.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.548+0000 7f9c474bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:24:20.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.548+0000 7f9b1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366158 cookie 94035000146032 notifier 5831 bl.length()=911 2024-09-12T00:24:20.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.548+0000 7f9b1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:20.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.548+0000 7f9b1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:20.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.548+0000 7f9b1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:20.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.549+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:24:20.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.549+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:24:20.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.549+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:24:20.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.549+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:24:20.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.552+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.0 2024-09-12T00:24:20.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.552+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.0 2024-09-12T00:24:20.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.552+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.1 2024-09-12T00:24:20.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.552+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.1 2024-09-12T00:24:20.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.552+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.2 2024-09-12T00:24:20.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.553+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.2 2024-09-12T00:24:20.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.553+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.3 2024-09-12T00:24:20.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.553+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.3 2024-09-12T00:24:20.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.553+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.4 2024-09-12T00:24:20.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.553+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.4 2024-09-12T00:24:20.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.553+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.5 2024-09-12T00:24:20.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.553+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.5 2024-09-12T00:24:20.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.554+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.6 2024-09-12T00:24:20.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.554+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.6 2024-09-12T00:24:20.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.554+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.7 2024-09-12T00:24:20.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.554+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.7 2024-09-12T00:24:20.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.554+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.8 2024-09-12T00:24:20.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.554+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.8 2024-09-12T00:24:20.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.555+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.9 2024-09-12T00:24:20.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.555+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.9 2024-09-12T00:24:20.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.555+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.10 2024-09-12T00:24:20.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.555+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.10 2024-09-12T00:24:20.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.555+0000 7f9c474bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.11 2024-09-12T00:24:20.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.555+0000 7f9c474bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.1.11 2024-09-12T00:24:20.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.556+0000 7f9c474bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:20.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.556+0000 7f9c474bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:24:20.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.557+0000 7f9c474bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:20.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.557+0000 7f9c474bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:20.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.557+0000 7f9c474bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:20.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.557+0000 7f9c474bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:24:20.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.558+0000 7f9b1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366159 cookie 94035000146032 notifier 5831 bl.length()=879 2024-09-12T00:24:20.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.558+0000 7f9b1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:24:20.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.558+0000 7f9b1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:24:20.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.558+0000 7f9b1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:24:20.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.559+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:24:20.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.559+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:24:20.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.559+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:24:20.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.559+0000 7f9c474bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:24:20.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.562+0000 7f9c474bb800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T00:24:20.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.563+0000 7f9c474bb800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:24:20.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.565+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:24:20.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.565+0000 7f9c474bb800 20 processing logshard = reshard.0000000007 2024-09-12T00:24:20.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.567+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:24:20.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.567+0000 7f9c474bb800 20 processing logshard = reshard.0000000008 2024-09-12T00:24:20.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.569+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:24:20.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.569+0000 7f9c474bb800 20 processing logshard = reshard.0000000009 2024-09-12T00:24:20.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.572+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:24:20.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.572+0000 7f9c474bb800 20 processing logshard = reshard.0000000010 2024-09-12T00:24:20.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.574+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:24:20.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.574+0000 7f9c474bb800 20 processing logshard = reshard.0000000011 2024-09-12T00:24:20.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.577+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:24:20.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.577+0000 7f9c474bb800 20 processing logshard = reshard.0000000012 2024-09-12T00:24:20.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.580+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:24:20.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.580+0000 7f9c474bb800 20 processing logshard = reshard.0000000013 2024-09-12T00:24:20.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.583+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:24:20.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.583+0000 7f9c474bb800 20 processing logshard = reshard.0000000014 2024-09-12T00:24:20.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.585+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:24:20.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.585+0000 7f9c474bb800 20 processing logshard = reshard.0000000015 2024-09-12T00:24:20.587 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.588+0000 7f9c474bb800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:24:20.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.589+0000 7f9afb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:20.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.592+0000 7f9c474bb800 20 remove_watcher() i=0 2024-09-12T00:24:20.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.592+0000 7f9c474bb800 2 removed watcher, disabling cache 2024-09-12T00:24:20.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.594+0000 7f9c474bb800 20 remove_watcher() i=1 2024-09-12T00:24:20.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.595+0000 7f9c474bb800 20 remove_watcher() i=2 2024-09-12T00:24:20.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.596+0000 7f9c474bb800 20 remove_watcher() i=3 2024-09-12T00:24:20.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.597+0000 7f9c474bb800 20 remove_watcher() i=4 2024-09-12T00:24:20.596 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.598+0000 7f9c474bb800 20 remove_watcher() i=5 2024-09-12T00:24:20.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.599+0000 7f9c474bb800 20 remove_watcher() i=6 2024-09-12T00:24:20.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.600+0000 7f9c474bb800 20 remove_watcher() i=7 2024-09-12T00:24:20.611 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:24:20.641 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:20.641 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:20.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.681+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.683+0000 7f4ab652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.683+0000 7f4ab652c800 20 realm 2024-09-12T00:24:20.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.683+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.683+0000 7f4ab652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.683+0000 7f4ab652c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:20.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.683+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.683+0000 7f4ab652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.683+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.684+0000 7f4ab652c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:20.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.684+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.685+0000 7f4ab652c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:20.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.685+0000 7f4ab652c800 20 searching for the correct realm 2024-09-12T00:24:20.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.687+0000 7f4ab293f640 0 -- 172.21.15.33:0/1186169831 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55ad911c4540 msgr2=0x55ad911c6a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:20.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.691+0000 7f4ab213e640 0 -- 172.21.15.33:0/1186169831 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f4aa801a040 msgr2=0x7f4aa808a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:20.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:20.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:20.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:20.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:20.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 zone default found 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 4 Realm: () 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:20.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 zonegroup default 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.696+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.697+0000 7f4ab652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.697+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.697+0000 7f4ab652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.697+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.697+0000 7f4ab652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.697+0000 7f4ab652c800 20 started sync module instance, tier type = 2024-09-12T00:24:20.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.697+0000 7f4ab652c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:20.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.706+0000 7f4ab652c800 20 add_watcher() i=0 2024-09-12T00:24:20.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.706+0000 7f4ab652c800 20 add_watcher() i=1 2024-09-12T00:24:20.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.706+0000 7f4ab652c800 20 add_watcher() i=2 2024-09-12T00:24:20.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.706+0000 7f4ab652c800 20 add_watcher() i=3 2024-09-12T00:24:20.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.706+0000 7f4ab652c800 20 add_watcher() i=4 2024-09-12T00:24:20.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.706+0000 7f4ab652c800 20 add_watcher() i=5 2024-09-12T00:24:20.705 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.706+0000 7f4ab652c800 20 add_watcher() i=6 2024-09-12T00:24:20.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.707+0000 7f4ab652c800 20 add_watcher() i=7 2024-09-12T00:24:20.706 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.707+0000 7f4ab652c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:20.708 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.709+0000 7f4968fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:20.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.710+0000 7f4ab652c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:20.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.710+0000 7f4ab652c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:20.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.710+0000 7f4ab652c800 5 note: GC not initialized 2024-09-12T00:24:20.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.710+0000 7f48e37fe640 20 reqs_thread_entry: start 2024-09-12T00:24:20.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.710+0000 7f4ab652c800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:20.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.710+0000 7f4ab652c800 20 Filter name: none 2024-09-12T00:24:20.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.710+0000 7f48e17fa640 20 reqs_thread_entry: start 2024-09-12T00:24:20.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.710+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.711+0000 7f4ab652c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.711+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.711+0000 7f4ab652c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.711+0000 7f4ab652c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.711+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.712+0000 7f4ab652c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.712+0000 7f4ab652c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.712+0000 7f4ab652c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.712+0000 7f4ab652c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:20.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.714+0000 7f4968fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:20.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.716+0000 7f4ab652c800 20 remove_watcher() i=0 2024-09-12T00:24:20.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.716+0000 7f4ab652c800 2 removed watcher, disabling cache 2024-09-12T00:24:20.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.717+0000 7f4ab652c800 20 remove_watcher() i=1 2024-09-12T00:24:20.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.718+0000 7f4ab652c800 20 remove_watcher() i=2 2024-09-12T00:24:20.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.720+0000 7f4ab652c800 20 remove_watcher() i=3 2024-09-12T00:24:20.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.721+0000 7f4ab652c800 20 remove_watcher() i=4 2024-09-12T00:24:20.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.722+0000 7f4ab652c800 20 remove_watcher() i=5 2024-09-12T00:24:20.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.723+0000 7f4ab652c800 20 remove_watcher() i=6 2024-09-12T00:24:20.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:20.724+0000 7f4ab652c800 20 remove_watcher() i=7 2024-09-12T00:24:20.733 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:20.734 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:20.734 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: a-bucket id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:24:20.734 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:20.734 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:24:20.734 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:20.736 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:20.736 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:20.787 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:20.787 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:20.848 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:20.849 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:20.884 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:20.885 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:20.918 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:20.918 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:20.953 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:20.954 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:20.988 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:20.988 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.024 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.024 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.056 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.056 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.090 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.090 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.125 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.125 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.159 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.159 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.194 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.194 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.229 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.229 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.262 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.262 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.296 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.297 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.332 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.332 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.366 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.366 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.398 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.398 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.433 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.433 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.468 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.468 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.503 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:21.504 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:21.538 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:24:21.567 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:21.567 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:21.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.608+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.610+0000 7f272fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.610+0000 7f272fb23800 20 realm 2024-09-12T00:24:21.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.610+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.610+0000 7f272fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.610+0000 7f272fb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:21.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.610+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.610+0000 7f272fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.610+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.609 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.611+0000 7f272fb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:21.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.611+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.612+0000 7f272fb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:21.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.612+0000 7f272fb23800 20 searching for the correct realm 2024-09-12T00:24:21.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.615+0000 7f272b80c640 0 -- 172.21.15.33:0/4285023770 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f2724086070 msgr2=0x7f27240e1520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:21.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.618+0000 7f272b80c640 0 -- 172.21.15.33:0/4285023770 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f2720056460 msgr2=0x7f27200568e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:21.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:21.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:21.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 zone default found 2024-09-12T00:24:21.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 4 Realm: () 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 zonegroup default 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.824+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.825+0000 7f272fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.825+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.825+0000 7f272fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.825+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.826+0000 7f272fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.826+0000 7f272fb23800 20 started sync module instance, tier type = 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.826+0000 7f272fb23800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:21.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.835+0000 7f272fb23800 20 add_watcher() i=0 2024-09-12T00:24:21.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.835+0000 7f272fb23800 20 add_watcher() i=1 2024-09-12T00:24:21.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.835+0000 7f272fb23800 20 add_watcher() i=2 2024-09-12T00:24:21.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.835+0000 7f272fb23800 20 add_watcher() i=3 2024-09-12T00:24:21.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.835+0000 7f272fb23800 20 add_watcher() i=4 2024-09-12T00:24:21.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.835+0000 7f272fb23800 20 add_watcher() i=5 2024-09-12T00:24:21.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.835+0000 7f272fb23800 20 add_watcher() i=6 2024-09-12T00:24:21.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.836+0000 7f272fb23800 20 add_watcher() i=7 2024-09-12T00:24:21.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.836+0000 7f272fb23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:21.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.838+0000 7f25e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:21.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.838+0000 7f272fb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:21.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.838+0000 7f272fb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:21.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.838+0000 7f272fb23800 5 note: GC not initialized 2024-09-12T00:24:21.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.838+0000 7f25e0fe1640 20 reqs_thread_entry: start 2024-09-12T00:24:21.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.838+0000 7f272fb23800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:21.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.839+0000 7f272fb23800 20 Filter name: none 2024-09-12T00:24:21.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.839+0000 7f255a7fc640 20 reqs_thread_entry: start 2024-09-12T00:24:21.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.839+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.840+0000 7f272fb23800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:21.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.840+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.840+0000 7f272fb23800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:21.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.840+0000 7f272fb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:21.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.840+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.841+0000 7f272fb23800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:21.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.841+0000 7f272fb23800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.841+0000 7f272fb23800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:21.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.841+0000 7f272fb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:21.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.843+0000 7f25e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:21.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.845+0000 7f272fb23800 20 remove_watcher() i=0 2024-09-12T00:24:21.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.845+0000 7f272fb23800 2 removed watcher, disabling cache 2024-09-12T00:24:21.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.846+0000 7f272fb23800 20 remove_watcher() i=1 2024-09-12T00:24:21.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.847+0000 7f272fb23800 20 remove_watcher() i=2 2024-09-12T00:24:21.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.848+0000 7f272fb23800 20 remove_watcher() i=3 2024-09-12T00:24:21.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.850+0000 7f272fb23800 20 remove_watcher() i=4 2024-09-12T00:24:21.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.851+0000 7f272fb23800 20 remove_watcher() i=5 2024-09-12T00:24:21.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.852+0000 7f272fb23800 20 remove_watcher() i=6 2024-09-12T00:24:21.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.853+0000 7f272fb23800 20 remove_watcher() i=7 2024-09-12T00:24:21.863 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:21.863 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:21.863 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-init-index id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:24:21.863 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:21.864 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:24:21.899 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:21.899 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:21.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.940+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.941+0000 7f742f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.941+0000 7f742f20f800 20 realm 2024-09-12T00:24:21.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.941+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.942+0000 7f742f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.942+0000 7f742f20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:21.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.942+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.942+0000 7f742f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.942+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.943+0000 7f742f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:21.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.943+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.944+0000 7f742f20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:21.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.944+0000 7f742f20f800 20 searching for the correct realm 2024-09-12T00:24:21.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.946+0000 7f742a992640 0 -- 172.21.15.33:0/2477801450 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f7424069040 msgr2=0x7f7424060430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:21.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.950+0000 7f742a992640 0 -- 172.21.15.33:0/2477801450 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f741407c030 msgr2=0x7f7414096310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:21.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:21.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:21.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:21.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:21.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:21.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:21.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.955+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 zone default found 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 4 Realm: () 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:21.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 zonegroup default 2024-09-12T00:24:21.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.956+0000 7f742f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:21.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.957+0000 7f742f20f800 20 started sync module instance, tier type = 2024-09-12T00:24:21.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.957+0000 7f742f20f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:21.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.966+0000 7f742f20f800 20 add_watcher() i=0 2024-09-12T00:24:21.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.966+0000 7f742f20f800 20 add_watcher() i=1 2024-09-12T00:24:21.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.966+0000 7f742f20f800 20 add_watcher() i=2 2024-09-12T00:24:21.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.966+0000 7f742f20f800 20 add_watcher() i=3 2024-09-12T00:24:21.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.966+0000 7f742f20f800 20 add_watcher() i=4 2024-09-12T00:24:21.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.966+0000 7f742f20f800 20 add_watcher() i=5 2024-09-12T00:24:21.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.966+0000 7f742f20f800 20 add_watcher() i=6 2024-09-12T00:24:21.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.967+0000 7f742f20f800 20 add_watcher() i=7 2024-09-12T00:24:21.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.967+0000 7f742f20f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:21.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.968+0000 7f72e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:21.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f742f20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:21.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f742f20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f742f20f800 5 note: GC not initialized 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f725bfff640 20 reqs_thread_entry: start 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f742f20f800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f742f20f800 20 Filter name: none 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f7259ffb640 20 reqs_thread_entry: start 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f742f20f800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.969+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:24:21.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:24:21.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 : miss 2024-09-12T00:24:21.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:21.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:21.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 info.flags=0x17 2024-09-12T00:24:21.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 to cache LRU end 2024-09-12T00:24:21.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:21.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:21.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.970+0000 7f742f20f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 2024-09-12T00:24:21.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.971+0000 7f742f20f800 -1 Injecting error=-5 at location=init_index 2024-09-12T00:24:21.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.971+0000 7f742f20f800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:24:21.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.974+0000 7f72e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:21.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.976+0000 7f742f20f800 20 remove_watcher() i=0 2024-09-12T00:24:21.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.976+0000 7f742f20f800 2 removed watcher, disabling cache 2024-09-12T00:24:21.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.977+0000 7f742f20f800 20 remove_watcher() i=1 2024-09-12T00:24:21.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.978+0000 7f742f20f800 20 remove_watcher() i=2 2024-09-12T00:24:21.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.979+0000 7f742f20f800 20 remove_watcher() i=3 2024-09-12T00:24:21.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.980+0000 7f742f20f800 20 remove_watcher() i=4 2024-09-12T00:24:21.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.981+0000 7f742f20f800 20 remove_watcher() i=5 2024-09-12T00:24:21.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.982+0000 7f742f20f800 20 remove_watcher() i=6 2024-09-12T00:24:21.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:21.983+0000 7f742f20f800 20 remove_watcher() i=7 2024-09-12T00:24:21.994 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:24:22.023 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:22.024 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:22.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.065+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.067+0000 7fe229daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.067+0000 7fe229daf800 20 realm 2024-09-12T00:24:22.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.067+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.067+0000 7fe229daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.067+0000 7fe229daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:22.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.067+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.067+0000 7fe229daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.067+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.068+0000 7fe229daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:22.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.068+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.069+0000 7fe229daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:22.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.069+0000 7fe229daf800 20 searching for the correct realm 2024-09-12T00:24:22.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.071+0000 7fe227098640 0 -- 172.21.15.33:0/2785745140 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fe21806c070 msgr2=0x7fe218086410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:22.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.075+0000 7fe227899640 0 -- 172.21.15.33:0/2785745140 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fe21c01c070 msgr2=0x7fe21c067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:22.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:22.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:22.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:22.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:22.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:22.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:22.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.282+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 20 zone default found 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 4 Realm: () 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 20 zonegroup default 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.283+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.284+0000 7fe229daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.284+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.284+0000 7fe229daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.284+0000 7fe229daf800 20 started sync module instance, tier type = 2024-09-12T00:24:22.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.284+0000 7fe229daf800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:22.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.293+0000 7fe229daf800 20 add_watcher() i=0 2024-09-12T00:24:22.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.293+0000 7fe229daf800 20 add_watcher() i=1 2024-09-12T00:24:22.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.293+0000 7fe229daf800 20 add_watcher() i=2 2024-09-12T00:24:22.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.293+0000 7fe229daf800 20 add_watcher() i=3 2024-09-12T00:24:22.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.293+0000 7fe229daf800 20 add_watcher() i=4 2024-09-12T00:24:22.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.293+0000 7fe229daf800 20 add_watcher() i=5 2024-09-12T00:24:22.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.293+0000 7fe229daf800 20 add_watcher() i=6 2024-09-12T00:24:22.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.294+0000 7fe229daf800 20 add_watcher() i=7 2024-09-12T00:24:22.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.294+0000 7fe229daf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:22.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.296+0000 7fe0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:22.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.296+0000 7fe229daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:22.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.296+0000 7fe229daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:22.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.296+0000 7fe229daf800 5 note: GC not initialized 2024-09-12T00:24:22.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.296+0000 7fe0dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:24:22.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.297+0000 7fe229daf800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:22.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.297+0000 7fe229daf800 20 Filter name: none 2024-09-12T00:24:22.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.297+0000 7fe0567fc640 20 reqs_thread_entry: start 2024-09-12T00:24:22.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.297+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.297+0000 7fe229daf800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.297+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.298+0000 7fe229daf800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.298+0000 7fe229daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.298+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.298+0000 7fe229daf800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.298+0000 7fe229daf800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.299+0000 7fe229daf800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.299+0000 7fe229daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.301+0000 7fe0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.303+0000 7fe229daf800 20 remove_watcher() i=0 2024-09-12T00:24:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.303+0000 7fe229daf800 2 removed watcher, disabling cache 2024-09-12T00:24:22.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.304+0000 7fe229daf800 20 remove_watcher() i=1 2024-09-12T00:24:22.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.305+0000 7fe229daf800 20 remove_watcher() i=2 2024-09-12T00:24:22.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.306+0000 7fe229daf800 20 remove_watcher() i=3 2024-09-12T00:24:22.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.307+0000 7fe229daf800 20 remove_watcher() i=4 2024-09-12T00:24:22.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.309+0000 7fe229daf800 20 remove_watcher() i=5 2024-09-12T00:24:22.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.311+0000 7fe229daf800 20 remove_watcher() i=6 2024-09-12T00:24:22.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.312+0000 7fe229daf800 20 remove_watcher() i=7 2024-09-12T00:24:22.322 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:22.322 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:22.322 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-init-index id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:24:22.322 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:22.324 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:22.324 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:22.355 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:22.355 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:22.414 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:24:22.449 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:22.449 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:22.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.490+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.492+0000 7f21abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.492+0000 7f21abb26800 20 realm 2024-09-12T00:24:22.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.492+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.492+0000 7f21abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.492+0000 7f21abb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:22.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.492+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.492+0000 7f21abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.492+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.493+0000 7f21abb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:22.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.493+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.494+0000 7f21abb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:22.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.494+0000 7f21abb26800 20 searching for the correct realm 2024-09-12T00:24:22.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.497+0000 7f21a804c640 0 -- 172.21.15.33:0/521042999 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x559252a8e3c0 msgr2=0x559252a90880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:22.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.500+0000 7f21a704a640 0 -- 172.21.15.33:0/521042999 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x559252a89600 msgr2=0x559252a8ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:22.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:22.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:22.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:22.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:22.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:22.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:22.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.505+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:22.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:22.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 20 zone default found 2024-09-12T00:24:22.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 4 Realm: () 2024-09-12T00:24:22.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:22.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:22.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:22.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 20 zonegroup default 2024-09-12T00:24:22.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.506+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.507+0000 7f21abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.507+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.507+0000 7f21abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.507+0000 7f21abb26800 20 started sync module instance, tier type = 2024-09-12T00:24:22.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.507+0000 7f21abb26800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:22.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.516+0000 7f21abb26800 20 add_watcher() i=0 2024-09-12T00:24:22.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.516+0000 7f21abb26800 20 add_watcher() i=1 2024-09-12T00:24:22.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.516+0000 7f21abb26800 20 add_watcher() i=2 2024-09-12T00:24:22.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.516+0000 7f21abb26800 20 add_watcher() i=3 2024-09-12T00:24:22.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.516+0000 7f21abb26800 20 add_watcher() i=4 2024-09-12T00:24:22.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.516+0000 7f21abb26800 20 add_watcher() i=5 2024-09-12T00:24:22.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.516+0000 7f21abb26800 20 add_watcher() i=6 2024-09-12T00:24:22.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.517+0000 7f21abb26800 20 add_watcher() i=7 2024-09-12T00:24:22.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.517+0000 7f21abb26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:22.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.519+0000 7f205dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:22.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.519+0000 7f21abb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:22.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.519+0000 7f21abb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:22.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.519+0000 7f21abb26800 5 note: GC not initialized 2024-09-12T00:24:22.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.519+0000 7f205cfe1640 20 reqs_thread_entry: start 2024-09-12T00:24:22.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.519+0000 7f21abb26800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:22.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.519+0000 7f21abb26800 20 Filter name: none 2024-09-12T00:24:22.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.520+0000 7f1fd67fc640 20 reqs_thread_entry: start 2024-09-12T00:24:22.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.520+0000 7f21abb26800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:24:22.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.520+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.520+0000 7f21abb26800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:22.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.520+0000 7f21abb26800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:24:22.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.520+0000 7f21abb26800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:24:22.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.520+0000 7f21abb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 : miss 2024-09-12T00:24:22.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.520+0000 7f21abb26800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.521+0000 7f21abb26800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:22.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.521+0000 7f21abb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 info.flags=0x17 2024-09-12T00:24:22.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.521+0000 7f21abb26800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 to cache LRU end 2024-09-12T00:24:22.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.521+0000 7f21abb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:22.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.521+0000 7f21abb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:22.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.521+0000 7f21abb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 2024-09-12T00:24:22.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.526+0000 7f21abb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 info.flags=0x17 2024-09-12T00:24:22.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.526+0000 7f21abb26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 to cache LRU end 2024-09-12T00:24:22.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.526+0000 7f21abb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:22.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.526+0000 7f21abb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20, ofs0, ns] 2024-09-12T00:24:22.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.526+0000 7f20867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366214 cookie 94086940373552 notifier 6225 bl.length()=995 2024-09-12T00:24:22.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.526+0000 7f20867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 info.flags=0x17 2024-09-12T00:24:22.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.526+0000 7f20867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 to cache LRU end 2024-09-12T00:24:22.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.526+0000 7f20867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:22.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.528+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): orig_sources= new_sources= 2024-09-12T00:24:22.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.528+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): potential sources added=[] removed=[] 2024-09-12T00:24:22.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.528+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): orig_dests= new_dests= 2024-09-12T00:24:22.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.528+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): potential dests added=[] removed=[] 2024-09-12T00:24:22.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.0 2024-09-12T00:24:22.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.0 2024-09-12T00:24:22.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.1 2024-09-12T00:24:22.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.1 2024-09-12T00:24:22.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.2 2024-09-12T00:24:22.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.2 2024-09-12T00:24:22.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.3 2024-09-12T00:24:22.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.3 2024-09-12T00:24:22.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.4 2024-09-12T00:24:22.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.4 2024-09-12T00:24:22.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.5 2024-09-12T00:24:22.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.5 2024-09-12T00:24:22.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.6 2024-09-12T00:24:22.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.6 2024-09-12T00:24:22.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.7 2024-09-12T00:24:22.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.7 2024-09-12T00:24:22.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.8 2024-09-12T00:24:22.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.8 2024-09-12T00:24:22.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.9 2024-09-12T00:24:22.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.9 2024-09-12T00:24:22.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.10 2024-09-12T00:24:22.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.10 2024-09-12T00:24:22.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.11 2024-09-12T00:24:22.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1.11 2024-09-12T00:24:22.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.532+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.0 2024-09-12T00:24:22.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.533+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1 2024-09-12T00:24:22.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.533+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.2 2024-09-12T00:24:22.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.534+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.3 2024-09-12T00:24:22.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.534+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.4 2024-09-12T00:24:22.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.535+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.5 2024-09-12T00:24:22.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.536+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.6 2024-09-12T00:24:22.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.536+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.7 2024-09-12T00:24:22.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.537+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.8 2024-09-12T00:24:22.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.537+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.9 2024-09-12T00:24:22.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.538+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.10 2024-09-12T00:24:22.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.541+0000 7f21abb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:22.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.541+0000 7f21abb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 2024-09-12T00:24:22.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.542+0000 7f21abb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 info.flags=0x17 2024-09-12T00:24:22.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.542+0000 7f21abb26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 to cache LRU end 2024-09-12T00:24:22.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.542+0000 7f21abb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:22.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.542+0000 7f21abb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20, ofs0, ns] 2024-09-12T00:24:22.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.543+0000 7f2086ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94086940373552 notifier 6225 bl.length()=995 2024-09-12T00:24:22.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.543+0000 7f2086ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 info.flags=0x17 2024-09-12T00:24:22.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.543+0000 7f2086ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 to cache LRU end 2024-09-12T00:24:22.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.543+0000 7f2086ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:22.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.544+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): orig_sources= new_sources= 2024-09-12T00:24:22.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.544+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): potential sources added=[] removed=[] 2024-09-12T00:24:22.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.544+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): orig_dests= new_dests= 2024-09-12T00:24:22.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.544+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): potential dests added=[] removed=[] 2024-09-12T00:24:22.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.547+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.0 2024-09-12T00:24:22.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.547+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.1 2024-09-12T00:24:22.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.547+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.2 2024-09-12T00:24:22.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.548+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.3 2024-09-12T00:24:22.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.548+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.4 2024-09-12T00:24:22.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.548+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.5 2024-09-12T00:24:22.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.548+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.6 2024-09-12T00:24:22.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.549+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.7 2024-09-12T00:24:22.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.549+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.8 2024-09-12T00:24:22.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.549+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.9 2024-09-12T00:24:22.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.550+0000 7f21abb26800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20.10 2024-09-12T00:24:22.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.550+0000 7f21abb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:22.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.550+0000 7f21abb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.551+0000 7f21abb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 info.flags=0x17 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.551+0000 7f21abb26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 to cache LRU end 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.551+0000 7f21abb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.551+0000 7f21abb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20, ofs0, ns] 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.552+0000 7f2086ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 94086940373552 notifier 6225 bl.length()=963 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.552+0000 7f2086ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 info.flags=0x17 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.552+0000 7f2086ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 to cache LRU end 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.552+0000 7f2086ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:22.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.553+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): orig_sources= new_sources= 2024-09-12T00:24:22.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.553+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): potential sources added=[] removed=[] 2024-09-12T00:24:22.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.553+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): orig_dests= new_dests= 2024-09-12T00:24:22.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.553+0000 7f21abb26800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20]): potential dests added=[] removed=[] 2024-09-12T00:24:22.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.555+0000 7f21abb26800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:24:22.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.557+0000 7f205dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:22.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.559+0000 7f21abb26800 20 remove_watcher() i=0 2024-09-12T00:24:22.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.559+0000 7f21abb26800 2 removed watcher, disabling cache 2024-09-12T00:24:22.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.560+0000 7f21abb26800 20 remove_watcher() i=1 2024-09-12T00:24:22.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.561+0000 7f21abb26800 20 remove_watcher() i=2 2024-09-12T00:24:22.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.562+0000 7f21abb26800 20 remove_watcher() i=3 2024-09-12T00:24:22.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.563+0000 7f21abb26800 20 remove_watcher() i=4 2024-09-12T00:24:22.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.565+0000 7f21abb26800 20 remove_watcher() i=5 2024-09-12T00:24:22.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.565+0000 7f21abb26800 20 remove_watcher() i=6 2024-09-12T00:24:22.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.567+0000 7f21abb26800 20 remove_watcher() i=7 2024-09-12T00:24:22.578 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:24:22.608 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:22.608 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:22.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.648+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.650+0000 7f3a12a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.650+0000 7f3a12a98800 20 realm 2024-09-12T00:24:22.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.650+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.650+0000 7f3a12a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.650+0000 7f3a12a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:22.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.650+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.650+0000 7f3a12a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.650+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.651+0000 7f3a12a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:22.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.651+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.652+0000 7f3a12a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:22.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.652+0000 7f3a12a98800 20 searching for the correct realm 2024-09-12T00:24:22.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.654+0000 7f3a10582640 0 -- 172.21.15.33:0/4174879608 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f3a08035420 msgr2=0x7f3a08035880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:22.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.659+0000 7f3a10582640 0 -- 172.21.15.33:0/4174879608 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f3a0406c960 msgr2=0x7f3a040a6400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.865+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 20 zone default found 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 4 Realm: () 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 20 zonegroup default 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.866+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.867+0000 7f3a12a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.867+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.867+0000 7f3a12a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:22.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.867+0000 7f3a12a98800 20 started sync module instance, tier type = 2024-09-12T00:24:22.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.867+0000 7f3a12a98800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:22.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.877+0000 7f3a12a98800 20 add_watcher() i=0 2024-09-12T00:24:22.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.877+0000 7f3a12a98800 20 add_watcher() i=1 2024-09-12T00:24:22.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.877+0000 7f3a12a98800 20 add_watcher() i=2 2024-09-12T00:24:22.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.877+0000 7f3a12a98800 20 add_watcher() i=3 2024-09-12T00:24:22.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.877+0000 7f3a12a98800 20 add_watcher() i=4 2024-09-12T00:24:22.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.877+0000 7f3a12a98800 20 add_watcher() i=5 2024-09-12T00:24:22.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.877+0000 7f3a12a98800 20 add_watcher() i=6 2024-09-12T00:24:22.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.878+0000 7f3a12a98800 20 add_watcher() i=7 2024-09-12T00:24:22.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.878+0000 7f3a12a98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:22.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.880+0000 7f38c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:22.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.880+0000 7f3a12a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:22.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.880+0000 7f3a12a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:22.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.880+0000 7f3a12a98800 5 note: GC not initialized 2024-09-12T00:24:22.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.880+0000 7f38c57e2640 20 reqs_thread_entry: start 2024-09-12T00:24:22.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.880+0000 7f3a12a98800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:22.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.880+0000 7f3a12a98800 20 Filter name: none 2024-09-12T00:24:22.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.881+0000 7f3836ffd640 20 reqs_thread_entry: start 2024-09-12T00:24:22.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.881+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.881+0000 7f3a12a98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:22.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.881+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.882+0000 7f3a12a98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:22.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.882+0000 7f3a12a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:22.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.882+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.882+0000 7f3a12a98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:22.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.882+0000 7f3a12a98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:22.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.883+0000 7f3a12a98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:22.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.883+0000 7f3a12a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:22.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.884+0000 7f38c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:22.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.887+0000 7f3a12a98800 20 remove_watcher() i=0 2024-09-12T00:24:22.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.887+0000 7f3a12a98800 2 removed watcher, disabling cache 2024-09-12T00:24:22.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.888+0000 7f3a12a98800 20 remove_watcher() i=1 2024-09-12T00:24:22.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.889+0000 7f3a12a98800 20 remove_watcher() i=2 2024-09-12T00:24:22.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.890+0000 7f3a12a98800 20 remove_watcher() i=3 2024-09-12T00:24:22.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.891+0000 7f3a12a98800 20 remove_watcher() i=4 2024-09-12T00:24:22.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.892+0000 7f3a12a98800 20 remove_watcher() i=5 2024-09-12T00:24:22.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.893+0000 7f3a12a98800 20 remove_watcher() i=6 2024-09-12T00:24:22.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:22.894+0000 7f3a12a98800 20 remove_watcher() i=7 2024-09-12T00:24:22.904 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:22.904 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:22.904 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-init-index id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:24:22.904 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:22.906 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:22.907 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:22.928 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:22.928 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.120 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.120 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.366 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.366 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.398 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.399 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.432 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.432 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.466 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.467 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.502 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.503 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.535 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.535 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.569 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.569 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.602 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.602 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.636 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.637 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.671 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.671 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.705 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.705 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.738 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.739 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.772 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.772 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.805 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.805 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.837 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.838 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.870 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.870 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.903 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.903 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.936 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.937 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:23.970 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:23.971 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:24.005 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:24.006 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:24.038 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:24:24.069 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:24.069 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:24.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.110+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.112+0000 7f6cc7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.112+0000 7f6cc7f46800 20 realm 2024-09-12T00:24:24.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.112+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.112+0000 7f6cc7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.112+0000 7f6cc7f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:24.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.112+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.112+0000 7f6cc7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.112+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.113+0000 7f6cc7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:24.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.113+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.114+0000 7f6cc7f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:24.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.114+0000 7f6cc7f46800 20 searching for the correct realm 2024-09-12T00:24:24.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.116+0000 7f6cc5a37640 0 -- 172.21.15.33:0/2808458206 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f6cc002e410 msgr2=0x7f6cc002e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:24.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.120+0000 7f6cc5a37640 0 -- 172.21.15.33:0/2808458206 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f6cb007c920 msgr2=0x7f6cb008b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:24.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:24.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:24.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:24.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:24.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:24.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:24.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:24.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.327+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:24.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 20 zone default found 2024-09-12T00:24:24.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 4 Realm: () 2024-09-12T00:24:24.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:24.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 20 zonegroup default 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.328+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.329+0000 7f6cc7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.329+0000 7f6cc7f46800 20 started sync module instance, tier type = 2024-09-12T00:24:24.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.329+0000 7f6cc7f46800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:24.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.340+0000 7f6cc7f46800 20 add_watcher() i=0 2024-09-12T00:24:24.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.340+0000 7f6cc7f46800 20 add_watcher() i=1 2024-09-12T00:24:24.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.340+0000 7f6cc7f46800 20 add_watcher() i=2 2024-09-12T00:24:24.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.340+0000 7f6cc7f46800 20 add_watcher() i=3 2024-09-12T00:24:24.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.340+0000 7f6cc7f46800 20 add_watcher() i=4 2024-09-12T00:24:24.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.340+0000 7f6cc7f46800 20 add_watcher() i=5 2024-09-12T00:24:24.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.340+0000 7f6cc7f46800 20 add_watcher() i=6 2024-09-12T00:24:24.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.341+0000 7f6cc7f46800 20 add_watcher() i=7 2024-09-12T00:24:24.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.341+0000 7f6cc7f46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:24.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.343+0000 7f6b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:24.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.343+0000 7f6cc7f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:24.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.343+0000 7f6cc7f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:24.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.343+0000 7f6cc7f46800 5 note: GC not initialized 2024-09-12T00:24:24.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.343+0000 7f6b767fc640 20 reqs_thread_entry: start 2024-09-12T00:24:24.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.343+0000 7f6cc7f46800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:24.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.344+0000 7f6cc7f46800 20 Filter name: none 2024-09-12T00:24:24.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.344+0000 7f6ae7fff640 20 reqs_thread_entry: start 2024-09-12T00:24:24.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.344+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.344+0000 7f6cc7f46800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:24.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.344+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.345+0000 7f6cc7f46800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:24.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.345+0000 7f6cc7f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:24.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.345+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.346+0000 7f6cc7f46800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:24.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.346+0000 7f6cc7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.346+0000 7f6cc7f46800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:24.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.346+0000 7f6cc7f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:24.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.348+0000 7f6b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:24.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.351+0000 7f6cc7f46800 20 remove_watcher() i=0 2024-09-12T00:24:24.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.351+0000 7f6cc7f46800 2 removed watcher, disabling cache 2024-09-12T00:24:24.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.352+0000 7f6cc7f46800 20 remove_watcher() i=1 2024-09-12T00:24:24.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.353+0000 7f6cc7f46800 20 remove_watcher() i=2 2024-09-12T00:24:24.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.354+0000 7f6cc7f46800 20 remove_watcher() i=3 2024-09-12T00:24:24.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.356+0000 7f6cc7f46800 20 remove_watcher() i=4 2024-09-12T00:24:24.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.357+0000 7f6cc7f46800 20 remove_watcher() i=5 2024-09-12T00:24:24.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.358+0000 7f6cc7f46800 20 remove_watcher() i=6 2024-09-12T00:24:24.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.359+0000 7f6cc7f46800 20 remove_watcher() i=7 2024-09-12T00:24:24.372 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:24.373 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:24.373 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-init-index id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:24:24.373 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:24.374 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:24:24.411 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:24.411 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:24.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.452+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.453+0000 7f9541214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.453+0000 7f9541214800 20 realm 2024-09-12T00:24:24.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.453+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.453+0000 7f9541214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.453+0000 7f9541214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:24.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.453+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.453+0000 7f9541214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.453+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.454+0000 7f9541214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:24.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.454+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.455+0000 7f9541214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:24.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.455+0000 7f9541214800 20 searching for the correct realm 2024-09-12T00:24:24.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.458+0000 7f953d1e1640 0 -- 172.21.15.33:0/357491142 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x562a2f776ed0 msgr2=0x562a2f7792c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:24.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.461+0000 7f953c9e0640 0 -- 172.21.15.33:0/357491142 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f952407e410 msgr2=0x7f952407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:24.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 zone default found 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 4 Realm: () 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 zonegroup default 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.466+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.467+0000 7f9541214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.467+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.467+0000 7f9541214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.467+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.467+0000 7f9541214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.467+0000 7f9541214800 20 started sync module instance, tier type = 2024-09-12T00:24:24.469 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.467+0000 7f9541214800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:24.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.476+0000 7f9541214800 20 add_watcher() i=0 2024-09-12T00:24:24.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.476+0000 7f9541214800 20 add_watcher() i=1 2024-09-12T00:24:24.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.476+0000 7f9541214800 20 add_watcher() i=2 2024-09-12T00:24:24.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.476+0000 7f9541214800 20 add_watcher() i=3 2024-09-12T00:24:24.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.476+0000 7f9541214800 20 add_watcher() i=4 2024-09-12T00:24:24.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.476+0000 7f9541214800 20 add_watcher() i=5 2024-09-12T00:24:24.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.476+0000 7f9541214800 20 add_watcher() i=6 2024-09-12T00:24:24.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.477+0000 7f9541214800 20 add_watcher() i=7 2024-09-12T00:24:24.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.477+0000 7f9541214800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:24.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.478+0000 7f93f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:24.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f9541214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:24.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f9541214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f9541214800 5 note: GC not initialized 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f93f27e4640 20 reqs_thread_entry: start 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f9541214800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f9541214800 20 Filter name: none 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f93eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f9541214800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.479+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 : miss 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 info.flags=0x17 2024-09-12T00:24:24.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 to cache LRU end 2024-09-12T00:24:24.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:24.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:24.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.480+0000 7f9541214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 2024-09-12T00:24:24.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.481+0000 7f9541214800 -1 Injecting error=-95 at location=init_index 2024-09-12T00:24:24.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.481+0000 7f9541214800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:24:24.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.485+0000 7f9541214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 info.flags=0x17 2024-09-12T00:24:24.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.485+0000 7f9541214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 to cache LRU end 2024-09-12T00:24:24.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.485+0000 7f9541214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:24.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.485+0000 7f9541214800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21, ofs0, ns] 2024-09-12T00:24:24.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.485+0000 7f94137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94739184984240 notifier 5969 bl.length()=995 2024-09-12T00:24:24.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.485+0000 7f94137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 info.flags=0x17 2024-09-12T00:24:24.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.485+0000 7f94137fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 to cache LRU end 2024-09-12T00:24:24.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.485+0000 7f94137fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:24.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.487+0000 7f9541214800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21]): orig_sources= new_sources= 2024-09-12T00:24:24.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.487+0000 7f9541214800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21]): potential sources added=[] removed=[] 2024-09-12T00:24:24.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.487+0000 7f9541214800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21]): orig_dests= new_dests= 2024-09-12T00:24:24.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.487+0000 7f9541214800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21]): potential dests added=[] removed=[] 2024-09-12T00:24:24.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.0 2024-09-12T00:24:24.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.0 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.1 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.1 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.2 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.2 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.3 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.3 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.4 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.4 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.5 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.5 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.6 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.6 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.7 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.7 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.8 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.8 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.9 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.9 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.10 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.10 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.11 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1.11 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.489+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.0 2024-09-12T00:24:24.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.490+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.1 2024-09-12T00:24:24.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.490+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.2 2024-09-12T00:24:24.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.491+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.3 2024-09-12T00:24:24.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.491+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.4 2024-09-12T00:24:24.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.492+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.5 2024-09-12T00:24:24.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.493+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.6 2024-09-12T00:24:24.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.493+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.7 2024-09-12T00:24:24.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.493+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.8 2024-09-12T00:24:24.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.494+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.9 2024-09-12T00:24:24.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.495+0000 7f9541214800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21.10 2024-09-12T00:24:24.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.498+0000 7f9541214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:24.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.498+0000 7f9541214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 2024-09-12T00:24:24.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.499+0000 7f9541214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 info.flags=0x17 2024-09-12T00:24:24.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.499+0000 7f9541214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 to cache LRU end 2024-09-12T00:24:24.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.499+0000 7f9541214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:24.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.499+0000 7f9541214800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21, ofs0, ns] 2024-09-12T00:24:24.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.499+0000 7f94137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94739184984240 notifier 5969 bl.length()=963 2024-09-12T00:24:24.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.499+0000 7f94137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 info.flags=0x17 2024-09-12T00:24:24.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.499+0000 7f94137fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 to cache LRU end 2024-09-12T00:24:24.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.499+0000 7f94137fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:24.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.501+0000 7f9541214800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21]): orig_sources= new_sources= 2024-09-12T00:24:24.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.501+0000 7f9541214800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21]): potential sources added=[] removed=[] 2024-09-12T00:24:24.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.501+0000 7f9541214800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21]): orig_dests= new_dests= 2024-09-12T00:24:24.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.501+0000 7f9541214800 20 handle_bi_update(): bucket=:error-at-init-index[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21]): potential dests added=[] removed=[] 2024-09-12T00:24:24.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.503+0000 7f9541214800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:24:24.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.505+0000 7f93f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:24.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.507+0000 7f9541214800 20 remove_watcher() i=0 2024-09-12T00:24:24.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.507+0000 7f9541214800 2 removed watcher, disabling cache 2024-09-12T00:24:24.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.508+0000 7f9541214800 20 remove_watcher() i=1 2024-09-12T00:24:24.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.509+0000 7f9541214800 20 remove_watcher() i=2 2024-09-12T00:24:24.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.510+0000 7f9541214800 20 remove_watcher() i=3 2024-09-12T00:24:24.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.511+0000 7f9541214800 20 remove_watcher() i=4 2024-09-12T00:24:24.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.512+0000 7f9541214800 20 remove_watcher() i=5 2024-09-12T00:24:24.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.513+0000 7f9541214800 20 remove_watcher() i=6 2024-09-12T00:24:24.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.514+0000 7f9541214800 20 remove_watcher() i=7 2024-09-12T00:24:24.528 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:24:24.556 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:24.556 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:24.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.595+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.597+0000 7f1710c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.597+0000 7f1710c98800 20 realm 2024-09-12T00:24:24.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.597+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.598+0000 7f1710c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.598+0000 7f1710c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:24.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.598+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.598+0000 7f1710c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.598+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.599+0000 7f1710c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:24.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.599+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.599+0000 7f1710c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:24.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.599+0000 7f1710c98800 20 searching for the correct realm 2024-09-12T00:24:24.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.603+0000 7f170df81640 0 -- 172.21.15.33:0/3785467498 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x556faae60ac0 msgr2=0x556faae62eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:24.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.606+0000 7f170ef83640 0 -- 172.21.15.33:0/3785467498 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f170406c070 msgr2=0x7f170404dd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:24.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 zone default found 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 4 Realm: () 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 zonegroup default 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.610+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.611+0000 7f1710c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.611+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.611+0000 7f1710c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.611+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.611+0000 7f1710c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:24.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.611+0000 7f1710c98800 20 started sync module instance, tier type = 2024-09-12T00:24:24.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.611+0000 7f1710c98800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:24.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.620+0000 7f1710c98800 20 add_watcher() i=0 2024-09-12T00:24:24.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.620+0000 7f1710c98800 20 add_watcher() i=1 2024-09-12T00:24:24.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.620+0000 7f1710c98800 20 add_watcher() i=2 2024-09-12T00:24:24.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.620+0000 7f1710c98800 20 add_watcher() i=3 2024-09-12T00:24:24.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.620+0000 7f1710c98800 20 add_watcher() i=4 2024-09-12T00:24:24.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.620+0000 7f1710c98800 20 add_watcher() i=5 2024-09-12T00:24:24.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.620+0000 7f1710c98800 20 add_watcher() i=6 2024-09-12T00:24:24.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.621+0000 7f1710c98800 20 add_watcher() i=7 2024-09-12T00:24:24.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.621+0000 7f1710c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:24.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.622+0000 7f15c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:24.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.623+0000 7f1710c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:24.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.623+0000 7f1710c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:24.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.623+0000 7f1710c98800 5 note: GC not initialized 2024-09-12T00:24:24.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.623+0000 7f153f7fe640 20 reqs_thread_entry: start 2024-09-12T00:24:24.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.623+0000 7f1710c98800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:24.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.623+0000 7f1710c98800 20 Filter name: none 2024-09-12T00:24:24.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.623+0000 7f153d7fa640 20 reqs_thread_entry: start 2024-09-12T00:24:24.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.623+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.624+0000 7f1710c98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:24.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.624+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.624+0000 7f1710c98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:24.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.624+0000 7f1710c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:24.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.624+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.625+0000 7f1710c98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:24:24.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.625+0000 7f1710c98800 20 rados->read ofs=0 len=0 2024-09-12T00:24:24.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.625+0000 7f1710c98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:24:24.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.625+0000 7f1710c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:24.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.627+0000 7f15c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:24.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.628+0000 7f1710c98800 20 remove_watcher() i=0 2024-09-12T00:24:24.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.628+0000 7f1710c98800 2 removed watcher, disabling cache 2024-09-12T00:24:24.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.629+0000 7f1710c98800 20 remove_watcher() i=1 2024-09-12T00:24:24.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.630+0000 7f1710c98800 20 remove_watcher() i=2 2024-09-12T00:24:24.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.631+0000 7f1710c98800 20 remove_watcher() i=3 2024-09-12T00:24:24.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.632+0000 7f1710c98800 20 remove_watcher() i=4 2024-09-12T00:24:24.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.633+0000 7f1710c98800 20 remove_watcher() i=5 2024-09-12T00:24:24.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.634+0000 7f1710c98800 20 remove_watcher() i=6 2024-09-12T00:24:24.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:24.635+0000 7f1710c98800 20 remove_watcher() i=7 2024-09-12T00:24:24.647 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:24.647 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:24.647 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-init-index id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:24:24.647 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:24.648 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:24.648 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:24.666 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:24.667 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:24.865 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:24.865 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.005 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:24:25.005 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:25.007 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.007 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.057 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.057 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.114 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.114 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.152 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.152 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.187 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.187 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.223 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.223 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.257 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.257 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.291 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.291 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.325 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.325 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.361 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.361 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.394 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.394 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.428 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.428 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.463 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.463 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.498 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.498 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.533 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.534 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.566 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.566 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.600 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.600 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.635 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.635 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.670 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.670 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.705 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.705 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.738 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.738 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.771 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:25.771 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:25.805 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:24:25.835 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:25.835 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:25.874 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.874+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:25.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.876+0000 7fd8ce739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:25.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.876+0000 7fd8ce739800 20 realm 2024-09-12T00:24:25.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.876+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:25.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.877+0000 7fd8ce739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:25.876 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.877+0000 7fd8ce739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:25.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.877+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:25.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.877+0000 7fd8ce739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:25.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.877+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:25.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.878+0000 7fd8ce739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:25.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.878+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:25.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.878+0000 7fd8ce739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:25.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.878+0000 7fd8ce739800 20 searching for the correct realm 2024-09-12T00:24:25.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.881+0000 7fd8c9bc6640 0 -- 172.21.15.33:0/1407776223 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x557ae7faa0f0 msgr2=0x557ae7fac4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:25.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:25.884+0000 7fd8ca3c7640 0 -- 172.21.15.33:0/1407776223 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd8c0016030 msgr2=0x7fd8c0060b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:26.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:26.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.493+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:26.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 20 zone default found 2024-09-12T00:24:26.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 4 Realm: () 2024-09-12T00:24:26.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:26.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 20 zonegroup default 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.494+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.495+0000 7fd8ce739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.495+0000 7fd8ce739800 20 started sync module instance, tier type = 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.495+0000 7fd8ce739800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:26.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.504+0000 7fd8ce739800 20 add_watcher() i=0 2024-09-12T00:24:26.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.504+0000 7fd8ce739800 20 add_watcher() i=1 2024-09-12T00:24:26.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.504+0000 7fd8ce739800 20 add_watcher() i=2 2024-09-12T00:24:26.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.504+0000 7fd8ce739800 20 add_watcher() i=3 2024-09-12T00:24:26.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.504+0000 7fd8ce739800 20 add_watcher() i=4 2024-09-12T00:24:26.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.504+0000 7fd8ce739800 20 add_watcher() i=5 2024-09-12T00:24:26.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.504+0000 7fd8ce739800 20 add_watcher() i=6 2024-09-12T00:24:26.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.505+0000 7fd8ce739800 20 add_watcher() i=7 2024-09-12T00:24:26.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.505+0000 7fd8ce739800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:26.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.507+0000 7fd780fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:26.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.507+0000 7fd8ce739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:26.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.507+0000 7fd8ce739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:26.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.507+0000 7fd8ce739800 5 note: GC not initialized 2024-09-12T00:24:26.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.508+0000 7fd6fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:24:26.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.508+0000 7fd8ce739800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:26.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.508+0000 7fd8ce739800 20 Filter name: none 2024-09-12T00:24:26.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.508+0000 7fd6f97fa640 20 reqs_thread_entry: start 2024-09-12T00:24:26.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.508+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.509+0000 7fd8ce739800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:26.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.509+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.509+0000 7fd8ce739800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:26.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.509+0000 7fd8ce739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:26.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.509+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.509+0000 7fd8ce739800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:26.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.509+0000 7fd8ce739800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.510+0000 7fd8ce739800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:26.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.510+0000 7fd8ce739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:26.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.512+0000 7fd780fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:26.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.514+0000 7fd8ce739800 20 remove_watcher() i=0 2024-09-12T00:24:26.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.514+0000 7fd8ce739800 2 removed watcher, disabling cache 2024-09-12T00:24:26.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.515+0000 7fd8ce739800 20 remove_watcher() i=1 2024-09-12T00:24:26.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.516+0000 7fd8ce739800 20 remove_watcher() i=2 2024-09-12T00:24:26.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.517+0000 7fd8ce739800 20 remove_watcher() i=3 2024-09-12T00:24:26.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.518+0000 7fd8ce739800 20 remove_watcher() i=4 2024-09-12T00:24:26.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.520+0000 7fd8ce739800 20 remove_watcher() i=5 2024-09-12T00:24:26.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.521+0000 7fd8ce739800 20 remove_watcher() i=6 2024-09-12T00:24:26.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.522+0000 7fd8ce739800 20 remove_watcher() i=7 2024-09-12T00:24:26.533 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:26.533 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:26.533 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-init-indext id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:24:26.533 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:26.535 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:24:26.570 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:26.570 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:26.611 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.611+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.613+0000 7fa1aa535800 20 realm 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.613+0000 7fa1aa535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.614+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:26.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.614+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:26.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.817+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:26.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.817+0000 7fa1aa535800 20 searching for the correct realm 2024-09-12T00:24:26.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:26.819+0000 7fa1a59c2640 0 -- 172.21.15.33:0/10546909 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fa198017070 msgr2=0x7fa1980670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.024+0000 7fa1a61c3640 0 -- 172.21.15.33:0/10546909 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa19c069dd0 msgr2=0x7fa19c08f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:27.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:27.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:27.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:27.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:27.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:27.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:27.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 20 zone default found 2024-09-12T00:24:27.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 4 Realm: () 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 20 zonegroup default 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.234+0000 7fa1aa535800 20 started sync module instance, tier type = 2024-09-12T00:24:27.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.234+0000 7fa1aa535800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:27.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=0 2024-09-12T00:24:27.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=1 2024-09-12T00:24:27.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=2 2024-09-12T00:24:27.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=3 2024-09-12T00:24:27.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=4 2024-09-12T00:24:27.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=5 2024-09-12T00:24:27.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=6 2024-09-12T00:24:27.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.245+0000 7fa1aa535800 20 add_watcher() i=7 2024-09-12T00:24:27.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.245+0000 7fa1aa535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:27.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.247+0000 7fa05cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:27.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:27.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:27.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7fa1aa535800 5 note: GC not initialized 2024-09-12T00:24:27.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7f9fd77fe640 20 reqs_thread_entry: start 2024-09-12T00:24:27.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7fa1aa535800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:27.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7fa1aa535800 20 Filter name: none 2024-09-12T00:24:27.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7f9fd57fa640 20 reqs_thread_entry: start 2024-09-12T00:24:27.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7fa1aa535800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:24:27.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:27.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 : miss 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.249+0000 7fa1aa535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa1aa535800 time 2024-09-12T00:24:27.252665+0000 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa1abb8c71a] 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa1abb8c8d8] 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558818853641] 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd877a4) [0x558818d657a4] 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55881886331d] 2024-09-12T00:24:27.251 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa1aa829590] 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.251+0000 7fa1aa535800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa1aa535800 time 2024-09-12T00:24:27.252665+0000 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa1abb8c71a] 2024-09-12T00:24:27.252 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa1abb8c8d8] 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558818853641] 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd877a4) [0x558818d657a4] 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55881886331d] 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa1aa829590] 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fa1aa535800 thread_name:radosgw-admin 2024-09-12T00:24:27.270 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:27.270 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa1aa83e6f0] 2024-09-12T00:24:27.270 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa1aa88b99c] 2024-09-12T00:24:27.270 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:24:27.270 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:24:27.270 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa1abb8c774] 2024-09-12T00:24:27.270 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa1abb8c8d8] 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558818853641] 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd877a4) [0x558818d657a4] 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55881886331d] 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa1aa829590] 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.252+0000 7fa1aa535800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fa1aa535800 thread_name:radosgw-admin 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.271 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa1aa83e6f0] 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa1aa88b99c] 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa1abb8c774] 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa1abb8c8d8] 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558818853641] 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd877a4) [0x558818d657a4] 2024-09-12T00:24:27.272 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55881886331d] 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa1aa829590] 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:24:26.593+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:24:26.593+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_done global_id 6327 payload 274 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:24:26.593+0000 7fa1a59c2640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:24:26.593+0000 7fa1a59c2640 1 monclient: found mon.noname-a 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:24:26.593+0000 7fa1a59c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: dump: 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.274 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:24:26.593+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6327 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:24:26.593+0000 7fa1aa535800 10 monclient: get_monmap_and_config success 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:24:26.593+0000 7fa1aa535800 4 set_mon_vals no callback set 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: dump: 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.275 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:24:26.594+0000 7fa1aa535800 10 monclient: shutdown 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 asok(0x55881a7dd630) unregister_commands rotate-key 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:24:26.594+0000 7fa1aa535800 10 monclient: build_initial_monmap 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 build_initial for_mkfs: 0 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:24:26.594+0000 7fa1aa535800 10 monclient: monmap: 2024-09-12T00:24:27.276 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding auth protocol: cephx 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding auth protocol: cephx 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding auth protocol: cephx 2024-09-12T00:24:27.277 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:24:26.594+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 librados: starting msgr at 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 librados: starting objecter 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command objecter_requests hook 0x55881aa30db0 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 librados: setting wanted keys 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 librados: calling monclient init 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:24:26.594+0000 7fa1aa535800 10 monclient: init 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding auth protocol: cephx 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding auth protocol: cephx 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding auth protocol: cephx 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.279 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:24:26.595+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:24:26.595+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:24:26.595+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command rotate-key hook 0x55881a9fca58 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:27.280 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-c con 0x55881a8b6220 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-a con 0x55881a93ff90 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-b con 0x55881a940390 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): authenticate will time out at 2086.161347s 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request con 0x55881a8b6220 auth_method 0 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.281 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request con 0x55881a93ff90 auth_method 0 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:24:26.595+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request con 0x55881a940390 auth_method 0 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:24:26.595+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:24:26.595+0000 7fa1a69c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:24:26.595+0000 7fa1a69c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_done global_id 6008 payload 824 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 1 monclient: found mon.noname-c 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: dump: 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.283 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:24:26.595+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6008 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:24:26.596+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:24:26.596+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:24:26.596+0000 7fa092e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:24:26.596+0000 7fa092e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:24:26.596+0000 7fa092e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:24:26.596+0000 7fa092e05640 10 monclient: dump: 2024-09-12T00:24:27.284 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:24:26.596+0000 7fa094608640 4 set_mon_vals no callback set 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:24:26.596+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:24:26.596+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.285 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:24:26.596+0000 7fa1aa535800 1 librados: init done 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:24:26.597+0000 7fa092e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:24:26.597+0000 7fa092e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:24:26.597+0000 7fa092e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:24:26.598+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x7fa08c076470 auth_method 0 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:24:26.598+0000 7fa1a69c4640 10 monclient: get_auth_request con 0x55881aa260e0 auth_method 0 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:24:26.599+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x55881aa49280 auth_method 0 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:24:26.600+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x55881aa4d470 auth_method 0 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:24:26.601+0000 7fa1aa535800 10 monclient: build_initial_monmap 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:24:26.601+0000 7fa1aa535800 1 build_initial for_mkfs: 0 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:24:26.601+0000 7fa1aa535800 10 monclient: monmap: 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding auth protocol: cephx 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding auth protocol: cephx 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding auth protocol: cephx 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.287 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:24:26.601+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.288 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command objecter_requests cmddesc objecter_requests hook 0x55881aa55d10 EEXIST 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient: init 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding auth protocol: cephx 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding auth protocol: cephx 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding auth protocol: cephx 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.289 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:24:26.602+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:24:26.602+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command rotate-key cmddesc rotate-key hook 0x55881aa50ae0 EEXIST 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-b con 0x55881aa79a00 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-c con 0x55881aa7bcd0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-a con 0x55881aa781d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.290 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): authenticate will time out at 2086.168783s 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request con 0x55881aa781d0 auth_method 0 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:24:26.602+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request con 0x55881aa7bcd0 auth_method 0 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:24:26.602+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:24:26.602+0000 7fa1a59c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:24:26.602+0000 7fa1a59c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:24:26.602+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request con 0x55881aa79a00 auth_method 0 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:24:26.602+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:24:26.602+0000 7fa1a61c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:24:26.602+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:24:26.603+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:24:26.603+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:24:26.603+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:24:26.603+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:24:26.603+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:24:26.603+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_done global_id 6333 payload 824 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 1 monclient: found mon.noname-a 2024-09-12T00:24:27.292 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: dump: 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.293 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: dump: 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:24:26.603+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6333 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:24:26.603+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:24:26.603+0000 7fa1a71c5640 4 set_mon_vals no callback set 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:24:26.603+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:24:26.603+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:24:26.603+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:24:26.605+0000 7fa08bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:24:26.605+0000 7fa08bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:24:26.605+0000 7fa08bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:24:26.605+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x7fa080076380 auth_method 0 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: get_monmap_and_config 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: build_initial_monmap 2024-09-12T00:24:27.295 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:24:26.606+0000 7fa1aa535800 1 build_initial for_mkfs: 0 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: monmap: 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding auth protocol: cephx 2024-09-12T00:24:27.296 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding auth protocol: cephx 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding auth protocol: cephx 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:24:26.606+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: init 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding auth protocol: cephx 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding auth protocol: cephx 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding auth protocol: cephx 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.298 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:24:26.606+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:24:26.606+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command rotate-key cmddesc rotate-key hook 0x7fff163425c8 EEXIST 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-c con 0x55881aacdee0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-b con 0x55881aabe830 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-a con 0x55881aac9310 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.299 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): authenticate will time out at 2086.172995s 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request con 0x55881aacdee0 auth_method 0 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request con 0x55881aac9310 auth_method 0 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request con 0x55881aabe830 auth_method 0 2024-09-12T00:24:27.300 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_done global_id 6014 payload 274 2024-09-12T00:24:27.301 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 1 monclient: found mon.noname-c 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: dump: 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.302 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:24:26.607+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6014 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:24:26.607+0000 7fa1aa535800 10 monclient: get_monmap_and_config success 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:24:26.607+0000 7fa1aa535800 4 set_mon_vals no callback set 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: dump: 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.304 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:24:26.608+0000 7fa1aa535800 10 monclient: shutdown 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:24:26.608+0000 7fa1aa535800 10 monclient: build_initial_monmap 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 build_initial for_mkfs: 0 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:24:26.608+0000 7fa1aa535800 10 monclient: monmap: 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:24:27.305 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding auth protocol: cephx 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding auth protocol: cephx 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding auth protocol: cephx 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.306 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:24:26.608+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 librados: starting msgr at 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 librados: starting objecter 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command objecter_requests cmddesc objecter_requests hook 0x55881aa9f910 EEXIST 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 librados: setting wanted keys 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 librados: calling monclient init 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:24:26.608+0000 7fa1aa535800 10 monclient: init 2024-09-12T00:24:27.307 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding auth protocol: cephx 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding auth protocol: cephx 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding auth protocol: cephx 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.308 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:24:26.609+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:24:26.609+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:24:26.609+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command rotate-key cmddesc rotate-key hook 0x55881aa918f8 EEXIST 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-a con 0x55881aabe830 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-c con 0x55881aac9310 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-b con 0x55881aacdee0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): authenticate will time out at 2086.175322s 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request con 0x55881aabe830 auth_method 0 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request con 0x55881aac9310 auth_method 0 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.310 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:24:26.609+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request con 0x55881aacdee0 auth_method 0 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:24:26.609+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:24:26.609+0000 7fa1a69c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:24:26.609+0000 7fa1a69c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_done global_id 6017 payload 824 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.311 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 1 monclient: found mon.noname-c 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: dump: 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: dump: 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.313 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:24:26.609+0000 7fa089ffb640 4 set_mon_vals no callback set 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:24:26.610+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6017 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:24:26.610+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:24:26.610+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:24:26.610+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.314 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:24:26.610+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:24:26.610+0000 7fa1aa535800 1 librados: init done 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:24:26.610+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cr dump hook 0x55881aac4d68 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:24:26.611+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:24:26.612+0000 7fa077fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:24:26.612+0000 7fa077fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:24:26.612+0000 7fa077fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:24:26.612+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x7fa070076470 auth_method 0 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:24:26.612+0000 7fa1a69c4640 10 monclient: get_auth_request con 0x55881aae8490 auth_method 0 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 realm 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:24:26.613+0000 7fa1aa535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:24:26.614+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x55881aaec6d0 auth_method 0 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:24:26.614+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:24:26.614+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:24:26.614+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x55881aaeff30 auth_method 0 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:24:26.816+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x55881aaeff30 auth_method 0 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:24:26.817+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:24:26.817+0000 7fa1aa535800 20 searching for the correct realm 2024-09-12T00:24:27.316 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:24:26.817+0000 7fa1a69c4640 10 monclient: get_auth_request con 0x55881aaf4c80 auth_method 0 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:24:26.818+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x7fa1a00a88d0 auth_method 0 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:24:26.819+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x7fa198017070 auth_method 0 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:24:26.819+0000 7fa1a59c2640 0 -- 172.21.15.33:0/10546909 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fa198017070 msgr2=0x7fa1980670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:24:27.020+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x7fa198017070 auth_method 0 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:24:27.022+0000 7fa1a69c4640 10 monclient: get_auth_request con 0x7fa19c027040 auth_method 0 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:24:27.024+0000 7fa1a61c3640 0 -- 172.21.15.33:0/10546909 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa19c069dd0 msgr2=0x7fa19c08f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:24:27.226+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x7fa19c069dd0 auth_method 0 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:27.317 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 zone default found 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:24:27.233+0000 7fa1aa535800 4 Realm: () 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:24:27.233+0000 7fa1aa535800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:24:27.233+0000 7fa1aa535800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:27.318 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:24:27.233+0000 7fa1aa535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 zonegroup default 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 started sync module instance, tier type = 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=0 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=1 2024-09-12T00:24:27.319 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=2 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=3 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=4 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=5 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=6 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:24:27.245+0000 7fa1aa535800 20 add_watcher() i=7 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:24:27.245+0000 7fa1aa535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding auth protocol: cephx 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding auth protocol: cephx 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding auth protocol: cephx 2024-09-12T00:24:27.320 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:24:27.247+0000 7fa05cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:27.321 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:24:27.248+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cache list hook 0x55881aac7610 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cache inspect hook 0x55881aac7610 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cache erase hook 0x55881aac7610 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cache zap hook 0x55881aac7610 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 note: GC not initialized 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:24:27.248+0000 7f9fd77fe640 20 reqs_thread_entry: start 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command sync trace show hook 0x7fa1a0004900 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command sync trace history hook 0x7fa1a0004900 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command sync trace active hook 0x7fa1a0004900 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command sync trace active_short hook 0x7fa1a0004900 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 Filter name: none 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:24:27.248+0000 7f9fd57fa640 20 reqs_thread_entry: start 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:24:27.248+0000 7fa1aa535800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 : miss 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:27.323 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:24:27.251+0000 7fa1aa535800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa1aa535800 time 2024-09-12T00:24:27.252665+0000 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa1abb8c71a] 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa1abb8c8d8] 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558818853641] 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd877a4) [0x558818d657a4] 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55881886331d] 2024-09-12T00:24:27.324 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa1aa829590] 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:24:27.252+0000 7fa1aa535800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fa1aa535800 thread_name:radosgw-admin 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa1aa83e6f0] 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa1aa88b99c] 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa1abb8c774] 2024-09-12T00:24:27.325 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa1abb8c8d8] 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558818853641] 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd877a4) [0x558818d657a4] 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55881886331d] 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa1aa829590] 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:24:27.326 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:24:27.328 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:24:27.330 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:24:27.331 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:24:27.332 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9fd57fa640 / http_manager 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9fd77fe640 / http_manager 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa05cfe1640 / rgw_dt_lg_renew 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa077fff640 / ms_dispatch 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa089ffb640 / io_context_pool 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa08bfff640 / ms_dispatch 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa092e05640 / ms_dispatch 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa094608640 / io_context_pool 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1a59c2640 / msgr-worker-2 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1a61c3640 / msgr-worker-1 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1a69c4640 / msgr-worker-0 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1a71c5640 / io_context_pool 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1aa535800 / radosgw-admin 2024-09-12T00:24:27.334 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.90378.log 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:24:26.593+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:24:26.593+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_done global_id 6327 payload 274 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:24:26.593+0000 7fa1a59c2640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:24:26.593+0000 7fa1a59c2640 1 monclient: found mon.noname-a 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:24:26.593+0000 7fa1a59c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: dump: 2024-09-12T00:24:27.335 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:24:26.593+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6327 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:24:26.593+0000 7fa1aa535800 10 monclient: get_monmap_and_config success 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:24:26.593+0000 7fa1aa535800 4 set_mon_vals no callback set 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:24:26.593+0000 7fa094608640 10 monclient: dump: 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:24:26.594+0000 7fa1aa535800 10 monclient: shutdown 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 asok(0x55881a7dd630) unregister_commands rotate-key 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:24:26.594+0000 7fa1aa535800 10 monclient: build_initial_monmap 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 build_initial for_mkfs: 0 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:24:26.594+0000 7fa1aa535800 10 monclient: monmap: 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:27.338 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding auth protocol: cephx 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding auth protocol: cephx 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding auth protocol: cephx 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.339 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: crc 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881aa02400) adding con mode: secure 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:24:26.594+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 librados: starting msgr at 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 librados: starting objecter 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command objecter_requests hook 0x55881aa30db0 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 librados: setting wanted keys 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:24:26.594+0000 7fa1aa535800 1 librados: calling monclient init 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:24:26.594+0000 7fa1aa535800 10 monclient: init 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding auth protocol: cephx 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding auth protocol: cephx 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding auth protocol: cephx 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.341 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: crc 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:24:26.594+0000 7fa1aa535800 5 AuthRegistry(0x55881a9fc910) adding con mode: secure 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:24:26.595+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:24:26.595+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:24:26.595+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command rotate-key hook 0x55881a9fca58 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-c con 0x55881a8b6220 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-a con 0x55881a93ff90 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-b con 0x55881a940390 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:24:26.595+0000 7fa1aa535800 10 monclient(hunting): authenticate will time out at 2086.161347s 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request con 0x55881a8b6220 auth_method 0 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request con 0x55881a93ff90 auth_method 0 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.343 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:24:26.595+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:24:26.595+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request con 0x55881a940390 auth_method 0 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:24:26.595+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:24:26.595+0000 7fa1a69c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:24:26.595+0000 7fa1a69c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_done global_id 6008 payload 824 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 1 monclient: found mon.noname-c 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:24:26.595+0000 7fa1a61c3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.344 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: dump: 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.345 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:24:26.595+0000 7fa092e05640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:24:26.595+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6008 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:24:26.596+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:24:26.596+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:24:26.596+0000 7fa092e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:24:26.596+0000 7fa092e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:24:26.596+0000 7fa092e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:24:26.596+0000 7fa092e05640 10 monclient: dump: 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:24:26.596+0000 7fa094608640 4 set_mon_vals no callback set 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:24:26.596+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:24:26.596+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:24:26.596+0000 7fa1aa535800 1 librados: init done 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:24:26.597+0000 7fa092e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:24:26.597+0000 7fa092e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:24:26.597+0000 7fa092e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:24:26.598+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x7fa08c076470 auth_method 0 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:24:26.598+0000 7fa1a69c4640 10 monclient: get_auth_request con 0x55881aa260e0 auth_method 0 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:24:26.599+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x55881aa49280 auth_method 0 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:24:26.600+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x55881aa4d470 auth_method 0 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:24:26.601+0000 7fa1aa535800 10 monclient: build_initial_monmap 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:24:26.601+0000 7fa1aa535800 1 build_initial for_mkfs: 0 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:24:26.601+0000 7fa1aa535800 10 monclient: monmap: 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:24:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding auth protocol: cephx 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding auth protocol: cephx 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding auth protocol: cephx 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.349 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: crc 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:24:26.601+0000 7fa1aa535800 5 AuthRegistry(0x55881aa522c0) adding con mode: secure 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:24:26.601+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command objecter_requests cmddesc objecter_requests hook 0x55881aa55d10 EEXIST 2024-09-12T00:24:27.350 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient: init 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding auth protocol: cephx 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding auth protocol: cephx 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding auth protocol: cephx 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: crc 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 AuthRegistry(0x55881aa50998) adding con mode: secure 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:24:26.602+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:24:26.602+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:24:26.602+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command rotate-key cmddesc rotate-key hook 0x55881aa50ae0 EEXIST 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-b con 0x55881aa79a00 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-c con 0x55881aa7bcd0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-a con 0x55881aa781d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:24:27.352 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:24:26.602+0000 7fa1aa535800 10 monclient(hunting): authenticate will time out at 2086.168783s 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request con 0x55881aa781d0 auth_method 0 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:24:26.602+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request con 0x55881aa7bcd0 auth_method 0 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:24:26.602+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:24:26.602+0000 7fa1a59c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:24:26.602+0000 7fa1a59c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.353 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:24:26.602+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request con 0x55881aa79a00 auth_method 0 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:24:26.602+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:24:26.602+0000 7fa1a61c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:24:26.602+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:24:26.602+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:24:26.603+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:24:26.603+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:24:26.603+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:24:26.603+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:24:26.603+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:24:26.603+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_done global_id 6333 payload 824 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 1 monclient: found mon.noname-a 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:24:26.603+0000 7fa1a69c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: dump: 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.355 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:24:26.603+0000 7fa08bfff640 10 monclient: dump: 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.356 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:24:26.603+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6333 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:24:26.603+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:24:26.603+0000 7fa1a71c5640 4 set_mon_vals no callback set 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:24:26.603+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:24:26.603+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:24:26.603+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:24:26.605+0000 7fa08bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:24:26.605+0000 7fa08bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:24:26.605+0000 7fa08bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:24:26.605+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x7fa080076380 auth_method 0 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: get_monmap_and_config 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: build_initial_monmap 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:24:26.606+0000 7fa1aa535800 1 build_initial for_mkfs: 0 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: monmap: 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:24:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding auth protocol: cephx 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding auth protocol: cephx 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding auth protocol: cephx 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.359 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: crc 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x55881aa998c0) adding con mode: secure 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:24:26.606+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: init 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding auth protocol: cephx 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding auth protocol: cephx 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding auth protocol: cephx 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.360 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: crc 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342480) adding con mode: secure 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:24:26.606+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:24:26.606+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:24:26.606+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command rotate-key cmddesc rotate-key hook 0x7fff163425c8 EEXIST 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-c con 0x55881aacdee0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-b con 0x55881aabe830 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-a con 0x55881aac9310 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:24:26.606+0000 7fa1aa535800 10 monclient(hunting): authenticate will time out at 2086.172995s 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request con 0x55881aacdee0 auth_method 0 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.362 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request con 0x55881aac9310 auth_method 0 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request con 0x55881aabe830 auth_method 0 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.363 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:24:26.607+0000 7fa1a69c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:24:26.607+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_done global_id 6014 payload 274 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 1 monclient: found mon.noname-c 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:24:26.607+0000 7fa1a61c3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: dump: 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:24:26.607+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6014 2024-09-12T00:24:27.365 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:24:26.607+0000 7fa1aa535800 10 monclient: get_monmap_and_config success 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:24:26.607+0000 7fa1aa535800 4 set_mon_vals no callback set 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:24:26.607+0000 7fa089ffb640 10 monclient: dump: 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.366 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:24:26.608+0000 7fa1aa535800 10 monclient: shutdown 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:24:26.608+0000 7fa1aa535800 10 monclient: build_initial_monmap 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 build_initial for_mkfs: 0 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:24:26.608+0000 7fa1aa535800 10 monclient: monmap: 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:24:27.367 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding auth protocol: cephx 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding auth protocol: cephx 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding auth protocol: cephx 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.368 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: crc 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa9d440) adding con mode: secure 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:24:26.608+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 librados: starting msgr at 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 librados: starting objecter 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command objecter_requests cmddesc objecter_requests hook 0x55881aa9f910 EEXIST 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 librados: setting wanted keys 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:24:26.608+0000 7fa1aa535800 1 librados: calling monclient init 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:24:26.608+0000 7fa1aa535800 10 monclient: init 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding auth protocol: cephx 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding auth protocol: cephx 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding auth protocol: cephx 2024-09-12T00:24:27.369 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: crc 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:24:26.608+0000 7fa1aa535800 5 AuthRegistry(0x55881aa917b0) adding con mode: secure 2024-09-12T00:24:27.370 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:24:26.609+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:24:26.609+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:24:26.609+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command rotate-key cmddesc rotate-key hook 0x55881aa918f8 EEXIST 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-a con 0x55881aabe830 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-c con 0x55881aac9310 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): picked mon.noname-b con 0x55881aacdee0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:24:26.609+0000 7fa1aa535800 10 monclient(hunting): authenticate will time out at 2086.175322s 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request con 0x55881aabe830 auth_method 0 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request con 0x55881aac9310 auth_method 0 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:24:26.609+0000 7fa1a61c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:27.372 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:24:26.609+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request con 0x55881aacdee0 auth_method 0 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:24:26.609+0000 7fa1a69c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:24:26.609+0000 7fa1a69c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:24:26.609+0000 7fa1a69c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient(hunting): handle_auth_done global_id 6017 payload 824 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient: _finish_hunting 0 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 1 monclient: found mon.noname-c 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:24:26.609+0000 7fa1a59c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: dump: 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: _finish_auth 0 2024-09-12T00:24:27.374 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: _check_auth_tickets 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:24:26.609+0000 7fa077fff640 10 monclient: dump: 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:24:27.375 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:24:26.609+0000 7fa089ffb640 4 set_mon_vals no callback set 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:24:26.610+0000 7fa1aa535800 5 monclient: authenticate success, global_id 6017 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:24:26.610+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:24:26.610+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:24:26.610+0000 7fa1aa535800 10 monclient: _renew_subs 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:24:26.610+0000 7fa1aa535800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:24:26.610+0000 7fa1aa535800 1 librados: init done 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:24:26.610+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cr dump hook 0x55881aac4d68 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:24:26.611+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:24:26.612+0000 7fa077fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:24:26.612+0000 7fa077fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.377 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:24:26.612+0000 7fa077fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:24:27.377 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:24:26.612+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x7fa070076470 auth_method 0 2024-09-12T00:24:27.380 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:24:26.612+0000 7fa1a69c4640 10 monclient: get_auth_request con 0x55881aae8490 auth_method 0 2024-09-12T00:24:27.380 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.380 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 realm 2024-09-12T00:24:27.380 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.380 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:24:26.613+0000 7fa1aa535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:24:26.613+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:24:26.614+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x55881aaec6d0 auth_method 0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:24:26.614+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:24:26.614+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:24:26.614+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x55881aaeff30 auth_method 0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:24:26.816+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x55881aaeff30 auth_method 0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:24:26.817+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:24:26.817+0000 7fa1aa535800 20 searching for the correct realm 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:24:26.817+0000 7fa1a69c4640 10 monclient: get_auth_request con 0x55881aaf4c80 auth_method 0 2024-09-12T00:24:27.381 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:24:26.818+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x7fa1a00a88d0 auth_method 0 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:24:26.819+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x7fa198017070 auth_method 0 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:24:26.819+0000 7fa1a59c2640 0 -- 172.21.15.33:0/10546909 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fa198017070 msgr2=0x7fa1980670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:24:27.020+0000 7fa1a59c2640 10 monclient: get_auth_request con 0x7fa198017070 auth_method 0 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:24:27.022+0000 7fa1a69c4640 10 monclient: get_auth_request con 0x7fa19c027040 auth_method 0 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:24:27.024+0000 7fa1a61c3640 0 -- 172.21.15.33:0/10546909 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa19c069dd0 msgr2=0x7fa19c08f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:24:27.226+0000 7fa1a61c3640 10 monclient: get_auth_request con 0x7fa19c069dd0 auth_method 0 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:24:27.232+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 zone default found 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:24:27.233+0000 7fa1aa535800 4 Realm: () 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:24:27.233+0000 7fa1aa535800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:24:27.233+0000 7fa1aa535800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:24:27.233+0000 7fa1aa535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 zonegroup default 2024-09-12T00:24:27.383 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:24:27.233+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 started sync module instance, tier type = 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:24:27.234+0000 7fa1aa535800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=0 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=1 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=2 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=3 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=4 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=5 2024-09-12T00:24:27.384 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:24:27.244+0000 7fa1aa535800 20 add_watcher() i=6 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:24:27.245+0000 7fa1aa535800 20 add_watcher() i=7 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:24:27.245+0000 7fa1aa535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding auth protocol: cephx 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding auth protocol: cephx 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding auth protocol: cephx 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.385 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: crc 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:24:27.247+0000 7fa1aa535800 5 AuthRegistry(0x7fff16342960) adding con mode: secure 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:24:27.247+0000 7fa05cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:24:27.248+0000 7fa1aa535800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cache list hook 0x55881aac7610 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cache inspect hook 0x55881aac7610 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cache erase hook 0x55881aac7610 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command cache zap hook 0x55881aac7610 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 note: GC not initialized 2024-09-12T00:24:27.386 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:24:27.248+0000 7f9fd77fe640 20 reqs_thread_entry: start 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command sync trace show hook 0x7fa1a0004900 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command sync trace history hook 0x7fa1a0004900 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command sync trace active hook 0x7fa1a0004900 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:24:27.248+0000 7fa1aa535800 5 asok(0x55881a7dd630) register_command sync trace active_short hook 0x7fa1a0004900 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 Filter name: none 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:24:27.248+0000 7f9fd57fa640 20 reqs_thread_entry: start 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:24:27.248+0000 7fa1aa535800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:24:27.248+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 : miss 2024-09-12T00:24:27.387 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:24:27.249+0000 7fa1aa535800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:24:27.249+0000 7fa1aa535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:24:27.251+0000 7fa1aa535800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa1aa535800 time 2024-09-12T00:24:27.252665+0000 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa1abb8c71a] 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa1abb8c8d8] 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558818853641] 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd877a4) [0x558818d657a4] 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55881886331d] 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa1aa829590] 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:24:27.252+0000 7fa1aa535800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fa1aa535800 thread_name:radosgw-admin 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa1aa83e6f0] 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa1aa88b99c] 2024-09-12T00:24:27.389 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa1abb8c774] 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa1abb8c8d8] 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558818853641] 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd877a4) [0x558818d657a4] 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55881886331d] 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa1aa829590] 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.390 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:24:27.391 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:24:27.392 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:24:27.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:24:27.395 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:24:27.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9fd57fa640 / http_manager 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9fd77fe640 / http_manager 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa05cfe1640 / rgw_dt_lg_renew 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa077fff640 / ms_dispatch 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa089ffb640 / io_context_pool 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa08bfff640 / ms_dispatch 2024-09-12T00:24:27.397 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa092e05640 / ms_dispatch 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa094608640 / io_context_pool 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1a59c2640 / msgr-worker-2 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1a61c3640 / msgr-worker-1 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1a69c4640 / msgr-worker-0 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1a71c5640 / io_context_pool 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: 7fa1aa535800 / radosgw-admin 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:24:27.254352Z_d7ebc3dd-db6e-403f-8df1-1f62a58a0553/log 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:24:27.403 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:27.403 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:27.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.335+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.338+0000 7fa46b746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.338+0000 7fa46b746800 20 realm 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.338+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.338+0000 7fa46b746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.338+0000 7fa46b746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.338+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.338+0000 7fa46b746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.338+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.339+0000 7fa46b746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.339+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.340+0000 7fa46b746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.340+0000 7fa46b746800 20 searching for the correct realm 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.343+0000 7fa469a31640 0 -- 172.21.15.33:0/1278993625 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5628c73a01d0 msgr2=0x5628c73a2690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.346+0000 7fa469230640 0 -- 172.21.15.33:0/1278993625 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa46006c660 msgr2=0x7fa4600347f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.352+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 zone default found 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 4 Realm: () 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 zonegroup default 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.353+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.354+0000 7fa46b746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.354+0000 7fa46b746800 20 started sync module instance, tier type = 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.354+0000 7fa46b746800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.362+0000 7fa46b746800 20 add_watcher() i=0 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.362+0000 7fa46b746800 20 add_watcher() i=1 2024-09-12T00:24:27.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.362+0000 7fa46b746800 20 add_watcher() i=2 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.362+0000 7fa46b746800 20 add_watcher() i=3 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.362+0000 7fa46b746800 20 add_watcher() i=4 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.362+0000 7fa46b746800 20 add_watcher() i=5 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.362+0000 7fa46b746800 20 add_watcher() i=6 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.363+0000 7fa46b746800 20 add_watcher() i=7 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.363+0000 7fa46b746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.365+0000 7fa31f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.365+0000 7fa46b746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.365+0000 7fa46b746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.365+0000 7fa46b746800 5 note: GC not initialized 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.365+0000 7fa31e7e4640 20 reqs_thread_entry: start 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa46b746800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa46b746800 20 Filter name: none 2024-09-12T00:24:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa28ffff640 20 reqs_thread_entry: start 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa46b746800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa46b746800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa46b746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.366+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.367+0000 7fa46b746800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.367+0000 7fa46b746800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.367+0000 7fa46b746800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.367+0000 7fa46b746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.369+0000 7fa31f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.371+0000 7fa46b746800 20 remove_watcher() i=0 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.371+0000 7fa46b746800 2 removed watcher, disabling cache 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.372+0000 7fa46b746800 20 remove_watcher() i=1 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.373+0000 7fa46b746800 20 remove_watcher() i=2 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.374+0000 7fa46b746800 20 remove_watcher() i=3 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.375+0000 7fa46b746800 20 remove_watcher() i=4 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.376+0000 7fa46b746800 20 remove_watcher() i=5 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.377+0000 7fa46b746800 20 remove_watcher() i=6 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.378+0000 7fa46b746800 20 remove_watcher() i=7 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-init-indext id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:27.409 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:27.420 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:27.420 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:27.478 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:24:27.512 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:27.512 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:27.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.553+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.554+0000 7f0f89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.554+0000 7f0f89526800 20 realm 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.554+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.554+0000 7f0f89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.554+0000 7f0f89526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.554+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.555+0000 7f0f89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.555+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.556+0000 7f0f89526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.556+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.556+0000 7f0f89526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:27.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.556+0000 7f0f89526800 20 searching for the correct realm 2024-09-12T00:24:27.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.557+0000 7f0f85109640 0 -- 172.21.15.33:0/2675323501 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f0f80035040 msgr2=0x7f0f80035420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.762+0000 7f0f84908640 0 -- 172.21.15.33:0/2675323501 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f0f78060040 msgr2=0x7f0f780a2920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:27.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:27.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:27.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:27.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:27.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:27.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:27.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.769+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 20 zone default found 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 4 Realm: () 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 20 zonegroup default 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.770+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.771+0000 7f0f89526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:27.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.771+0000 7f0f89526800 20 started sync module instance, tier type = 2024-09-12T00:24:27.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.771+0000 7f0f89526800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:27.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.780+0000 7f0f89526800 20 add_watcher() i=0 2024-09-12T00:24:27.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.780+0000 7f0f89526800 20 add_watcher() i=1 2024-09-12T00:24:27.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.780+0000 7f0f89526800 20 add_watcher() i=2 2024-09-12T00:24:27.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.780+0000 7f0f89526800 20 add_watcher() i=3 2024-09-12T00:24:27.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.780+0000 7f0f89526800 20 add_watcher() i=4 2024-09-12T00:24:27.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.780+0000 7f0f89526800 20 add_watcher() i=5 2024-09-12T00:24:27.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.780+0000 7f0f89526800 20 add_watcher() i=6 2024-09-12T00:24:27.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.781+0000 7f0f89526800 20 add_watcher() i=7 2024-09-12T00:24:27.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.781+0000 7f0f89526800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:27.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.783+0000 7f0e3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:27.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.783+0000 7f0f89526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:27.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.783+0000 7f0f89526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:27.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.783+0000 7f0f89526800 5 note: GC not initialized 2024-09-12T00:24:27.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.783+0000 7f0e3afe5640 20 reqs_thread_entry: start 2024-09-12T00:24:27.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.783+0000 7f0f89526800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:27.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.783+0000 7f0f89526800 20 Filter name: none 2024-09-12T00:24:27.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0e38fe1640 20 reqs_thread_entry: start 2024-09-12T00:24:27.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:24:27.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 : miss 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 20 rados->read ofs=0 len=0 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:27.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.784+0000 7f0f89526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 2024-09-12T00:24:27.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.786+0000 7f0f89526800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to be held by another RGW process; skipping for now 2024-09-12T00:24:27.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.787+0000 7f0e3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:27.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.789+0000 7f0f89526800 20 remove_watcher() i=0 2024-09-12T00:24:27.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.789+0000 7f0f89526800 2 removed watcher, disabling cache 2024-09-12T00:24:27.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.790+0000 7f0f89526800 20 remove_watcher() i=1 2024-09-12T00:24:27.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.791+0000 7f0f89526800 20 remove_watcher() i=2 2024-09-12T00:24:27.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.792+0000 7f0f89526800 20 remove_watcher() i=3 2024-09-12T00:24:27.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.793+0000 7f0f89526800 20 remove_watcher() i=4 2024-09-12T00:24:27.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.794+0000 7f0f89526800 20 remove_watcher() i=5 2024-09-12T00:24:27.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.795+0000 7f0f89526800 20 remove_watcher() i=6 2024-09-12T00:24:27.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:27.796+0000 7f0f89526800 20 remove_watcher() i=7 2024-09-12T00:24:27.807 INFO:tasks.workunit.client.0.smithi033.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:24:57.820 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:24:57.856 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:57.857 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:57.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.904+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:57.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.906+0000 7f1965126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:57.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.906+0000 7f1965126800 20 realm 2024-09-12T00:24:57.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.906+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:57.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.906+0000 7f1965126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:57.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.906+0000 7f1965126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:57.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.906+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:57.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.906+0000 7f1965126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:57.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.906+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:57.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.907+0000 7f1965126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:57.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.907+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:57.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.908+0000 7f1965126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:57.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.908+0000 7f1965126800 20 searching for the correct realm 2024-09-12T00:24:57.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:57.911+0000 7f196150a640 0 -- 172.21.15.33:0/526802772 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x563b220838c0 msgr2=0x563b22085d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:58.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.118+0000 7f1960d09640 0 -- 172.21.15.33:0/526802772 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f195c02f040 msgr2=0x7f195c02f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:58.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:58.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:58.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:58.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:58.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:58.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:58.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:58.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.125+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:58.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 20 zone default found 2024-09-12T00:24:58.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 4 Realm: () 2024-09-12T00:24:58.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:58.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:58.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:58.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 20 zonegroup default 2024-09-12T00:24:58.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.126+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.127+0000 7f1965126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.127+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.127+0000 7f1965126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.127+0000 7f1965126800 20 started sync module instance, tier type = 2024-09-12T00:24:58.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.127+0000 7f1965126800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:58.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.137+0000 7f1965126800 20 add_watcher() i=0 2024-09-12T00:24:58.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.137+0000 7f1965126800 20 add_watcher() i=1 2024-09-12T00:24:58.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.137+0000 7f1965126800 20 add_watcher() i=2 2024-09-12T00:24:58.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.137+0000 7f1965126800 20 add_watcher() i=3 2024-09-12T00:24:58.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.137+0000 7f1965126800 20 add_watcher() i=4 2024-09-12T00:24:58.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.137+0000 7f1965126800 20 add_watcher() i=5 2024-09-12T00:24:58.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.137+0000 7f1965126800 20 add_watcher() i=6 2024-09-12T00:24:58.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.139+0000 7f1965126800 20 add_watcher() i=7 2024-09-12T00:24:58.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.139+0000 7f1965126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:58.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.141+0000 7f1816fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:58.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.141+0000 7f1965126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:58.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.141+0000 7f1965126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:58.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.141+0000 7f1965126800 5 note: GC not initialized 2024-09-12T00:24:58.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.141+0000 7f1815fe3640 20 reqs_thread_entry: start 2024-09-12T00:24:58.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.141+0000 7f1965126800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:58.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f1965126800 20 Filter name: none 2024-09-12T00:24:58.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f17877fe640 20 reqs_thread_entry: start 2024-09-12T00:24:58.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f1965126800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f1965126800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f1965126800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f1965126800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f1965126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 : miss 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.142+0000 7f1965126800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.143+0000 7f1965126800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.143+0000 7f1965126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.143+0000 7f1965126800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.143+0000 7f1965126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.143+0000 7f1965126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:58.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.143+0000 7f1965126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 2024-09-12T00:24:58.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.149+0000 7f1965126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:58.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.149+0000 7f1965126800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:58.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.149+0000 7f1965126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:58.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.149+0000 7f1965126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22, ofs0, ns] 2024-09-12T00:24:58.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.149+0000 7f18377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94811974032192 notifier 6390 bl.length()=997 2024-09-12T00:24:58.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.149+0000 7f18377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:58.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.149+0000 7f18377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:58.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.149+0000 7f18377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:58.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.151+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): orig_sources= new_sources= 2024-09-12T00:24:58.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.151+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): potential sources added=[] removed=[] 2024-09-12T00:24:58.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.151+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): orig_dests= new_dests= 2024-09-12T00:24:58.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.151+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): potential dests added=[] removed=[] 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.0 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.0 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.1 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.1 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.2 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.2 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.3 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.3 2024-09-12T00:24:58.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.4 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.4 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.5 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.5 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.6 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.6 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.7 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.7 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.8 2024-09-12T00:24:58.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.8 2024-09-12T00:24:58.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.9 2024-09-12T00:24:58.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.9 2024-09-12T00:24:58.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.10 2024-09-12T00:24:58.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.10 2024-09-12T00:24:58.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.11 2024-09-12T00:24:58.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1.11 2024-09-12T00:24:58.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.156+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.0 2024-09-12T00:24:58.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.157+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1 2024-09-12T00:24:58.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.157+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.2 2024-09-12T00:24:58.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.158+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.3 2024-09-12T00:24:58.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.159+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.4 2024-09-12T00:24:58.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.160+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.5 2024-09-12T00:24:58.159 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.161+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.6 2024-09-12T00:24:58.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.161+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.7 2024-09-12T00:24:58.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.162+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.8 2024-09-12T00:24:58.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.162+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.9 2024-09-12T00:24:58.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.163+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.10 2024-09-12T00:24:58.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.167+0000 7f1965126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:58.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.167+0000 7f1965126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 2024-09-12T00:24:58.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.169+0000 7f1965126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:58.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.169+0000 7f1965126800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:58.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.169+0000 7f1965126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:58.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.169+0000 7f1965126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22, ofs0, ns] 2024-09-12T00:24:58.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.169+0000 7f18377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366225 cookie 94811974032192 notifier 6390 bl.length()=997 2024-09-12T00:24:58.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.169+0000 7f18377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:58.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.169+0000 7f18377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:58.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.169+0000 7f18377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:58.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.171+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): orig_sources= new_sources= 2024-09-12T00:24:58.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.171+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): potential sources added=[] removed=[] 2024-09-12T00:24:58.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.171+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): orig_dests= new_dests= 2024-09-12T00:24:58.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.171+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): potential dests added=[] removed=[] 2024-09-12T00:24:58.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.174+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.0 2024-09-12T00:24:58.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.174+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.1 2024-09-12T00:24:58.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.175+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.2 2024-09-12T00:24:58.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.175+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.3 2024-09-12T00:24:58.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.175+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.4 2024-09-12T00:24:58.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.176+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.5 2024-09-12T00:24:58.175 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.176+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.6 2024-09-12T00:24:58.175 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.177+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.7 2024-09-12T00:24:58.175 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.177+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.8 2024-09-12T00:24:58.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.177+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.9 2024-09-12T00:24:58.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.178+0000 7f1965126800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22.10 2024-09-12T00:24:58.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.178+0000 7f1965126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:24:58.176 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.178+0000 7f1965126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 2024-09-12T00:24:58.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.180+0000 7f1965126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:58.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.180+0000 7f1965126800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:58.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.180+0000 7f1965126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:58.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.180+0000 7f1965126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22, ofs0, ns] 2024-09-12T00:24:58.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.180+0000 7f18377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366226 cookie 94811974032192 notifier 6390 bl.length()=965 2024-09-12T00:24:58.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.180+0000 7f18377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 info.flags=0x17 2024-09-12T00:24:58.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.180+0000 7f18377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 to cache LRU end 2024-09-12T00:24:58.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.180+0000 7f18377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:24:58.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.182+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): orig_sources= new_sources= 2024-09-12T00:24:58.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.182+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): potential sources added=[] removed=[] 2024-09-12T00:24:58.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.182+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): orig_dests= new_dests= 2024-09-12T00:24:58.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.182+0000 7f1965126800 20 handle_bi_update(): bucket=:abort-at-init-indext[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22]): potential dests added=[] removed=[] 2024-09-12T00:24:58.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.184+0000 7f1965126800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T00:24:58.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.186+0000 7f1816fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:58.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.188+0000 7f1965126800 20 remove_watcher() i=0 2024-09-12T00:24:58.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.188+0000 7f1965126800 2 removed watcher, disabling cache 2024-09-12T00:24:58.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.190+0000 7f1965126800 20 remove_watcher() i=1 2024-09-12T00:24:58.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.191+0000 7f1965126800 20 remove_watcher() i=2 2024-09-12T00:24:58.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.192+0000 7f1965126800 20 remove_watcher() i=3 2024-09-12T00:24:58.191 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.193+0000 7f1965126800 20 remove_watcher() i=4 2024-09-12T00:24:58.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.194+0000 7f1965126800 20 remove_watcher() i=5 2024-09-12T00:24:58.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.195+0000 7f1965126800 20 remove_watcher() i=6 2024-09-12T00:24:58.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.196+0000 7f1965126800 20 remove_watcher() i=7 2024-09-12T00:24:58.209 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:24:58.239 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:58.239 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:58.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.281+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.282+0000 7f2216d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.282+0000 7f2216d1f800 20 realm 2024-09-12T00:24:58.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.282+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.282+0000 7f2216d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.282+0000 7f2216d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:58.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.282+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.283+0000 7f2216d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.283+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.283+0000 7f2216d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:58.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.284+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.284+0000 7f2216d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:58.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.284+0000 7f2216d1f800 20 searching for the correct realm 2024-09-12T00:24:58.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.288+0000 7f221220b640 0 -- 172.21.15.33:0/3634517695 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x556497f6cb20 msgr2=0x556497f6ef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:58.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.292+0000 7f221320d640 0 -- 172.21.15.33:0/3634517695 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f2208009040 msgr2=0x7f2208067e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:58.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.295+0000 7f2216d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:58.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.295+0000 7f2216d1f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:58.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.295+0000 7f2216d1f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:58.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.295+0000 7f2216d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:58.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.295+0000 7f2216d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:58.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.295+0000 7f2216d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:58.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.295+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.296+0000 7f2216d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.296+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.296+0000 7f2216d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:58.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.296+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:58.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 20 zone default found 2024-09-12T00:24:58.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 4 Realm: () 2024-09-12T00:24:58.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 20 zonegroup default 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.297+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.298+0000 7f2216d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.298+0000 7f2216d1f800 20 started sync module instance, tier type = 2024-09-12T00:24:58.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.298+0000 7f2216d1f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:58.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.306+0000 7f2216d1f800 20 add_watcher() i=0 2024-09-12T00:24:58.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.306+0000 7f2216d1f800 20 add_watcher() i=1 2024-09-12T00:24:58.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.306+0000 7f2216d1f800 20 add_watcher() i=2 2024-09-12T00:24:58.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.306+0000 7f2216d1f800 20 add_watcher() i=3 2024-09-12T00:24:58.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.306+0000 7f2216d1f800 20 add_watcher() i=4 2024-09-12T00:24:58.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.306+0000 7f2216d1f800 20 add_watcher() i=5 2024-09-12T00:24:58.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.306+0000 7f2216d1f800 20 add_watcher() i=6 2024-09-12T00:24:58.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.307+0000 7f2216d1f800 20 add_watcher() i=7 2024-09-12T00:24:58.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.307+0000 7f2216d1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:58.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.309+0000 7f20c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:58.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.309+0000 7f2216d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:58.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.309+0000 7f2216d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:58.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.310+0000 7f2216d1f800 5 note: GC not initialized 2024-09-12T00:24:58.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.310+0000 7f2043fff640 20 reqs_thread_entry: start 2024-09-12T00:24:58.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.310+0000 7f2216d1f800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:58.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.310+0000 7f2216d1f800 20 Filter name: none 2024-09-12T00:24:58.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.310+0000 7f2041ffb640 20 reqs_thread_entry: start 2024-09-12T00:24:58.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.310+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.310+0000 7f2216d1f800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:58.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.310+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.311+0000 7f2216d1f800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:58.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.311+0000 7f2216d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:58.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.311+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.311+0000 7f2216d1f800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:24:58.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.311+0000 7f2216d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:24:58.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.312+0000 7f2216d1f800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:24:58.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.312+0000 7f2216d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:58.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.313+0000 7f20c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:58.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.316+0000 7f2216d1f800 20 remove_watcher() i=0 2024-09-12T00:24:58.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.316+0000 7f2216d1f800 2 removed watcher, disabling cache 2024-09-12T00:24:58.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.317+0000 7f2216d1f800 20 remove_watcher() i=1 2024-09-12T00:24:58.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.318+0000 7f2216d1f800 20 remove_watcher() i=2 2024-09-12T00:24:58.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.319+0000 7f2216d1f800 20 remove_watcher() i=3 2024-09-12T00:24:58.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.320+0000 7f2216d1f800 20 remove_watcher() i=4 2024-09-12T00:24:58.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.321+0000 7f2216d1f800 20 remove_watcher() i=5 2024-09-12T00:24:58.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.322+0000 7f2216d1f800 20 remove_watcher() i=6 2024-09-12T00:24:58.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:58.323+0000 7f2216d1f800 20 remove_watcher() i=7 2024-09-12T00:24:58.332 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:58.332 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:58.332 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-init-indext id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:24:58.332 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:58.334 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.334 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.356 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.356 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.553 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.554 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.694 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:24:58.695 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:58.696 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.696 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.743 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.743 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.800 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.800 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.837 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.837 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.870 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.870 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.905 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.905 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.940 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.940 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:58.975 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:58.975 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.008 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.008 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.041 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.041 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.075 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.076 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.109 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.110 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.142 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.142 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.175 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.175 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.209 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.209 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.243 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.243 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.277 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.277 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.310 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.310 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.344 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.344 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.378 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.378 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.411 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.412 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.446 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:24:59.446 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:24:59.480 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:24:59.508 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:59.509 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:59.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.550+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.552+0000 7fd4d6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.552+0000 7fd4d6c0e800 20 realm 2024-09-12T00:24:59.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.552+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.552+0000 7fd4d6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.552+0000 7fd4d6c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:59.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.552+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.552+0000 7fd4d6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.552+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.553+0000 7fd4d6c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:59.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.553+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.554+0000 7fd4d6c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:59.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.554+0000 7fd4d6c0e800 20 searching for the correct realm 2024-09-12T00:24:59.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.556+0000 7fd4d23bc640 0 -- 172.21.15.33:0/4052862698 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd4cc0ae8a0 msgr2=0x7fd4cc0a4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:59.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.559+0000 7fd4d23bc640 0 -- 172.21.15.33:0/4052862698 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd4c802f070 msgr2=0x7fd4c8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:59.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.767+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 20 zone default found 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 4 Realm: () 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 20 zonegroup default 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.768+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.769+0000 7fd4d6c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.769+0000 7fd4d6c0e800 20 started sync module instance, tier type = 2024-09-12T00:24:59.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.769+0000 7fd4d6c0e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.778+0000 7fd4d6c0e800 20 add_watcher() i=0 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.778+0000 7fd4d6c0e800 20 add_watcher() i=1 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.778+0000 7fd4d6c0e800 20 add_watcher() i=2 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.778+0000 7fd4d6c0e800 20 add_watcher() i=3 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.778+0000 7fd4d6c0e800 20 add_watcher() i=4 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.778+0000 7fd4d6c0e800 20 add_watcher() i=5 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.778+0000 7fd4d6c0e800 20 add_watcher() i=6 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.779+0000 7fd4d6c0e800 20 add_watcher() i=7 2024-09-12T00:24:59.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.779+0000 7fd4d6c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:59.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.781+0000 7fd388fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:59.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.781+0000 7fd4d6c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:59.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.781+0000 7fd4d6c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:59.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.781+0000 7fd4d6c0e800 5 note: GC not initialized 2024-09-12T00:24:59.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.781+0000 7fd3037fe640 20 reqs_thread_entry: start 2024-09-12T00:24:59.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.782+0000 7fd4d6c0e800 20 init_complete bucket index max shards: 11 2024-09-12T00:24:59.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.782+0000 7fd4d6c0e800 20 Filter name: none 2024-09-12T00:24:59.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.782+0000 7fd3017fa640 20 reqs_thread_entry: start 2024-09-12T00:24:59.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.782+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.782+0000 7fd4d6c0e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:24:59.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.782+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.783+0000 7fd4d6c0e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:24:59.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.783+0000 7fd4d6c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:59.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.783+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.783+0000 7fd4d6c0e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:24:59.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.783+0000 7fd4d6c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.784+0000 7fd4d6c0e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:24:59.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.784+0000 7fd4d6c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:59.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.786+0000 7fd388fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:59.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.788+0000 7fd4d6c0e800 20 remove_watcher() i=0 2024-09-12T00:24:59.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.788+0000 7fd4d6c0e800 2 removed watcher, disabling cache 2024-09-12T00:24:59.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.789+0000 7fd4d6c0e800 20 remove_watcher() i=1 2024-09-12T00:24:59.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.790+0000 7fd4d6c0e800 20 remove_watcher() i=2 2024-09-12T00:24:59.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.791+0000 7fd4d6c0e800 20 remove_watcher() i=3 2024-09-12T00:24:59.790 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.792+0000 7fd4d6c0e800 20 remove_watcher() i=4 2024-09-12T00:24:59.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.793+0000 7fd4d6c0e800 20 remove_watcher() i=5 2024-09-12T00:24:59.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.794+0000 7fd4d6c0e800 20 remove_watcher() i=6 2024-09-12T00:24:59.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.795+0000 7fd4d6c0e800 20 remove_watcher() i=7 2024-09-12T00:24:59.805 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:59.805 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:24:59.806 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-set-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:24:59.806 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:24:59.807 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:24:59.842 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:59.842 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:59.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.884+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.886+0000 7f8a06975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.886+0000 7f8a06975800 20 realm 2024-09-12T00:24:59.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.886+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.886+0000 7f8a06975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.886+0000 7f8a06975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:59.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.886+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.886+0000 7f8a06975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.886+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.887+0000 7f8a06975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:59.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.887+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.888+0000 7f8a06975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:59.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.888+0000 7f8a06975800 20 searching for the correct realm 2024-09-12T00:24:59.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:24:59.890+0000 7f8a03c5e640 0 -- 172.21.15.33:0/833120558 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f89f40ce040 msgr2=0x7f89f40ba0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:00.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.096+0000 7f8a0445f640 0 -- 172.21.15.33:0/833120558 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f89ec0030f0 msgr2=0x7f89f8008930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:00.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.303+0000 7f8a06975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:00.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.303+0000 7f8a06975800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:00.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.303+0000 7f8a06975800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:00.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.303+0000 7f8a06975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:00.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.303+0000 7f8a06975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:00.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.303+0000 7f8a06975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:00.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.303+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.304+0000 7f8a06975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.304+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.304+0000 7f8a06975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:00.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.304+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.304+0000 7f8a06975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:00.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.304+0000 7f8a06975800 20 zone default found 2024-09-12T00:25:00.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 4 Realm: () 2024-09-12T00:25:00.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:00.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 20 zonegroup default 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.305+0000 7f8a06975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.306+0000 7f8a06975800 20 started sync module instance, tier type = 2024-09-12T00:25:00.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.306+0000 7f8a06975800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:00.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.315+0000 7f8a06975800 20 add_watcher() i=0 2024-09-12T00:25:00.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.315+0000 7f8a06975800 20 add_watcher() i=1 2024-09-12T00:25:00.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.315+0000 7f8a06975800 20 add_watcher() i=2 2024-09-12T00:25:00.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.315+0000 7f8a06975800 20 add_watcher() i=3 2024-09-12T00:25:00.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.315+0000 7f8a06975800 20 add_watcher() i=4 2024-09-12T00:25:00.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.315+0000 7f8a06975800 20 add_watcher() i=5 2024-09-12T00:25:00.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.315+0000 7f8a06975800 20 add_watcher() i=6 2024-09-12T00:25:00.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.316+0000 7f8a06975800 20 add_watcher() i=7 2024-09-12T00:25:00.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.316+0000 7f8a06975800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:00.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.318+0000 7f88bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:00.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.318+0000 7f8a06975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:00.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.318+0000 7f8a06975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:00.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.318+0000 7f8a06975800 5 note: GC not initialized 2024-09-12T00:25:00.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f88b9fdb640 20 reqs_thread_entry: start 2024-09-12T00:25:00.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:00.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 20 Filter name: none 2024-09-12T00:25:00.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f882b7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:00.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:25:00.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 : miss 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.319+0000 7f8a06975800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.320+0000 7f8a06975800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.320+0000 7f8a06975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 info.flags=0x17 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.320+0000 7f8a06975800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 to cache LRU end 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.320+0000 7f8a06975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:00.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.320+0000 7f8a06975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:00.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.320+0000 7f8a06975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 2024-09-12T00:25:00.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.325+0000 7f8a06975800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:25:00.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.325+0000 7f8a06975800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:25:00.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.330+0000 7f88bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:00.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.332+0000 7f8a06975800 20 remove_watcher() i=0 2024-09-12T00:25:00.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.332+0000 7f8a06975800 2 removed watcher, disabling cache 2024-09-12T00:25:00.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.333+0000 7f8a06975800 20 remove_watcher() i=1 2024-09-12T00:25:00.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.334+0000 7f8a06975800 20 remove_watcher() i=2 2024-09-12T00:25:00.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.336+0000 7f8a06975800 20 remove_watcher() i=3 2024-09-12T00:25:00.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.337+0000 7f8a06975800 20 remove_watcher() i=4 2024-09-12T00:25:00.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.338+0000 7f8a06975800 20 remove_watcher() i=5 2024-09-12T00:25:00.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.339+0000 7f8a06975800 20 remove_watcher() i=6 2024-09-12T00:25:00.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.340+0000 7f8a06975800 20 remove_watcher() i=7 2024-09-12T00:25:00.352 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:25:00.382 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:00.382 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:00.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.607+0000 7fa59d733640 0 --2- 172.21.15.33:0/639648467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5565cce21d00 0x5565ccf94e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:25:00.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.625+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.627+0000 7fa5a1b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.627+0000 7fa5a1b25800 20 realm 2024-09-12T00:25:00.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.627+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.627+0000 7fa5a1b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.627+0000 7fa5a1b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:00.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.627+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.628+0000 7fa5a1b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.628+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.628+0000 7fa5a1b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:00.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.629+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.629+0000 7fa5a1b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:00.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.629+0000 7fa5a1b25800 20 searching for the correct realm 2024-09-12T00:25:00.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.631+0000 7fa59cf32640 0 -- 172.21.15.33:0/3287554591 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fa590057bc0 msgr2=0x7fa5900a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:00.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:00.837+0000 7fa59d733640 0 -- 172.21.15.33:0/3287554591 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa594046410 msgr2=0x7fa594046890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:01.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:01.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:01.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:01.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:01.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:01.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:01.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.045+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:01.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 20 zone default found 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 4 Realm: () 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 20 zonegroup default 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.046+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.047+0000 7fa5a1b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.047+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.047+0000 7fa5a1b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.047+0000 7fa5a1b25800 20 started sync module instance, tier type = 2024-09-12T00:25:01.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.047+0000 7fa5a1b25800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:01.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.058+0000 7fa5a1b25800 20 add_watcher() i=0 2024-09-12T00:25:01.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.058+0000 7fa5a1b25800 20 add_watcher() i=1 2024-09-12T00:25:01.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.058+0000 7fa5a1b25800 20 add_watcher() i=2 2024-09-12T00:25:01.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.058+0000 7fa5a1b25800 20 add_watcher() i=3 2024-09-12T00:25:01.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.058+0000 7fa5a1b25800 20 add_watcher() i=4 2024-09-12T00:25:01.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.058+0000 7fa5a1b25800 20 add_watcher() i=5 2024-09-12T00:25:01.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.058+0000 7fa5a1b25800 20 add_watcher() i=6 2024-09-12T00:25:01.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.059+0000 7fa5a1b25800 20 add_watcher() i=7 2024-09-12T00:25:01.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.059+0000 7fa5a1b25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:01.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.061+0000 7fa4537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:01.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.061+0000 7fa5a1b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:01.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.061+0000 7fa5a1b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:01.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.061+0000 7fa5a1b25800 5 note: GC not initialized 2024-09-12T00:25:01.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.061+0000 7fa4527e4640 20 reqs_thread_entry: start 2024-09-12T00:25:01.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.061+0000 7fa5a1b25800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:01.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.061+0000 7fa5a1b25800 20 Filter name: none 2024-09-12T00:25:01.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.062+0000 7fa3c3fff640 20 reqs_thread_entry: start 2024-09-12T00:25:01.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.062+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.062+0000 7fa5a1b25800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:01.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.062+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.063+0000 7fa5a1b25800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:01.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.063+0000 7fa5a1b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:01.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.063+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.063+0000 7fa5a1b25800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:01.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.063+0000 7fa5a1b25800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.064+0000 7fa5a1b25800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:01.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.064+0000 7fa5a1b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:01.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.066+0000 7fa4537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:01.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.068+0000 7fa5a1b25800 20 remove_watcher() i=0 2024-09-12T00:25:01.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.068+0000 7fa5a1b25800 2 removed watcher, disabling cache 2024-09-12T00:25:01.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.069+0000 7fa5a1b25800 20 remove_watcher() i=1 2024-09-12T00:25:01.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.071+0000 7fa5a1b25800 20 remove_watcher() i=2 2024-09-12T00:25:01.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.072+0000 7fa5a1b25800 20 remove_watcher() i=3 2024-09-12T00:25:01.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.073+0000 7fa5a1b25800 20 remove_watcher() i=4 2024-09-12T00:25:01.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.074+0000 7fa5a1b25800 20 remove_watcher() i=5 2024-09-12T00:25:01.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.075+0000 7fa5a1b25800 20 remove_watcher() i=6 2024-09-12T00:25:01.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.076+0000 7fa5a1b25800 20 remove_watcher() i=7 2024-09-12T00:25:01.087 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:01.087 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:01.087 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-set-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:01.087 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:01.089 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:01.089 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:01.120 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:01.120 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:01.178 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:25:01.211 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:01.211 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:01.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.252+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.255+0000 7ff6dfa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.255+0000 7ff6dfa0f800 20 realm 2024-09-12T00:25:01.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.255+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.255+0000 7ff6dfa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.255+0000 7ff6dfa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:01.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.255+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.255+0000 7ff6dfa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.255+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.256+0000 7ff6dfa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:01.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.256+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.257+0000 7ff6dfa0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:01.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.257+0000 7ff6dfa0f800 20 searching for the correct realm 2024-09-12T00:25:01.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.261+0000 7ff6ddcfa640 0 -- 172.21.15.33:0/4247491968 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7ff6d4088110 msgr2=0x7ff6d408b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:01.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.468+0000 7ff6dd4f9640 0 -- 172.21.15.33:0/4247491968 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x556bdee53db0 msgr2=0x556bdee561a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.471+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 20 zone default found 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 4 Realm: () 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 20 zonegroup default 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.472+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.473+0000 7ff6dfa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.473+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.473+0000 7ff6dfa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.473+0000 7ff6dfa0f800 20 started sync module instance, tier type = 2024-09-12T00:25:01.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.473+0000 7ff6dfa0f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:01.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.483+0000 7ff6dfa0f800 20 add_watcher() i=0 2024-09-12T00:25:01.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.483+0000 7ff6dfa0f800 20 add_watcher() i=1 2024-09-12T00:25:01.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.483+0000 7ff6dfa0f800 20 add_watcher() i=2 2024-09-12T00:25:01.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.483+0000 7ff6dfa0f800 20 add_watcher() i=3 2024-09-12T00:25:01.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.483+0000 7ff6dfa0f800 20 add_watcher() i=4 2024-09-12T00:25:01.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.483+0000 7ff6dfa0f800 20 add_watcher() i=5 2024-09-12T00:25:01.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.483+0000 7ff6dfa0f800 20 add_watcher() i=6 2024-09-12T00:25:01.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.484+0000 7ff6dfa0f800 20 add_watcher() i=7 2024-09-12T00:25:01.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.484+0000 7ff6dfa0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:01.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.486+0000 7ff5937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff6dfa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff6dfa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff6dfa0f800 5 note: GC not initialized 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff5927e4640 20 reqs_thread_entry: start 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff6dfa0f800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff6dfa0f800 20 Filter name: none 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff503fff640 20 reqs_thread_entry: start 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff6dfa0f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:25:01.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.487+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:01.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:25:01.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:25:01.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 : miss 2024-09-12T00:25:01.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:01.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 info.flags=0x17 2024-09-12T00:25:01.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 to cache LRU end 2024-09-12T00:25:01.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:01.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:01.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.488+0000 7ff6dfa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 2024-09-12T00:25:01.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.494+0000 7ff6dfa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 info.flags=0x17 2024-09-12T00:25:01.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.494+0000 7ff6dfa0f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 to cache LRU end 2024-09-12T00:25:01.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.494+0000 7ff6dfa0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:01.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.494+0000 7ff6dfa0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23, ofs0, ns] 2024-09-12T00:25:01.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.494+0000 7ff5b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 93921789477632 notifier 6486 bl.length()=1009 2024-09-12T00:25:01.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.494+0000 7ff5b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 info.flags=0x17 2024-09-12T00:25:01.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.494+0000 7ff5b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 to cache LRU end 2024-09-12T00:25:01.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.494+0000 7ff5b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:01.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.496+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): orig_sources= new_sources= 2024-09-12T00:25:01.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.496+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): potential sources added=[] removed=[] 2024-09-12T00:25:01.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.496+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): orig_dests= new_dests= 2024-09-12T00:25:01.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.496+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): potential dests added=[] removed=[] 2024-09-12T00:25:01.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.0 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.0 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.1 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.1 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.2 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.2 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.3 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.3 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.4 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.4 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.5 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.5 2024-09-12T00:25:01.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.6 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.6 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.7 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.7 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.8 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.8 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.9 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.9 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.10 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.10 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.11 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1.11 2024-09-12T00:25:01.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.0 2024-09-12T00:25:01.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.501+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1 2024-09-12T00:25:01.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.502+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.2 2024-09-12T00:25:01.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.502+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.3 2024-09-12T00:25:01.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.503+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.4 2024-09-12T00:25:01.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.504+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.5 2024-09-12T00:25:01.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.504+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.6 2024-09-12T00:25:01.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.505+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.7 2024-09-12T00:25:01.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.505+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.8 2024-09-12T00:25:01.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.506+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.9 2024-09-12T00:25:01.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.507+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.10 2024-09-12T00:25:01.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.510+0000 7ff6dfa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:01.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.510+0000 7ff6dfa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 2024-09-12T00:25:01.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.512+0000 7ff6dfa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 info.flags=0x17 2024-09-12T00:25:01.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.512+0000 7ff6dfa0f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 to cache LRU end 2024-09-12T00:25:01.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.512+0000 7ff6dfa0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:01.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.512+0000 7ff6dfa0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23, ofs0, ns] 2024-09-12T00:25:01.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.512+0000 7ff5b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 93921789477632 notifier 6486 bl.length()=1009 2024-09-12T00:25:01.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.512+0000 7ff5b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 info.flags=0x17 2024-09-12T00:25:01.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.512+0000 7ff5b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 to cache LRU end 2024-09-12T00:25:01.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.512+0000 7ff5b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:01.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.513+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): orig_sources= new_sources= 2024-09-12T00:25:01.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.513+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): potential sources added=[] removed=[] 2024-09-12T00:25:01.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.513+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): orig_dests= new_dests= 2024-09-12T00:25:01.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.513+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): potential dests added=[] removed=[] 2024-09-12T00:25:01.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.516+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.0 2024-09-12T00:25:01.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.517+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.1 2024-09-12T00:25:01.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.517+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.2 2024-09-12T00:25:01.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.517+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.3 2024-09-12T00:25:01.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.518+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.4 2024-09-12T00:25:01.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.518+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.5 2024-09-12T00:25:01.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.518+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.6 2024-09-12T00:25:01.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.519+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.7 2024-09-12T00:25:01.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.519+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.8 2024-09-12T00:25:01.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.520+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.9 2024-09-12T00:25:01.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.520+0000 7ff6dfa0f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23.10 2024-09-12T00:25:01.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.520+0000 7ff6dfa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:01.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.520+0000 7ff6dfa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 2024-09-12T00:25:01.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.522+0000 7ff6dfa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 info.flags=0x17 2024-09-12T00:25:01.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.522+0000 7ff6dfa0f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 to cache LRU end 2024-09-12T00:25:01.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.522+0000 7ff6dfa0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:01.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.522+0000 7ff6dfa0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23, ofs0, ns] 2024-09-12T00:25:01.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.522+0000 7ff5c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 93921789477632 notifier 6486 bl.length()=977 2024-09-12T00:25:01.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.522+0000 7ff5c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 info.flags=0x17 2024-09-12T00:25:01.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.522+0000 7ff5c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 to cache LRU end 2024-09-12T00:25:01.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.522+0000 7ff5c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:01.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.523+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): orig_sources= new_sources= 2024-09-12T00:25:01.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.523+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): potential sources added=[] removed=[] 2024-09-12T00:25:01.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.523+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): orig_dests= new_dests= 2024-09-12T00:25:01.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.523+0000 7ff6dfa0f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23]): potential dests added=[] removed=[] 2024-09-12T00:25:01.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.528+0000 7ff6dfa0f800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:25:01.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.530+0000 7ff5937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:01.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.532+0000 7ff6dfa0f800 20 remove_watcher() i=0 2024-09-12T00:25:01.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.532+0000 7ff6dfa0f800 2 removed watcher, disabling cache 2024-09-12T00:25:01.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.533+0000 7ff6dfa0f800 20 remove_watcher() i=1 2024-09-12T00:25:01.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.534+0000 7ff6dfa0f800 20 remove_watcher() i=2 2024-09-12T00:25:01.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.535+0000 7ff6dfa0f800 20 remove_watcher() i=3 2024-09-12T00:25:01.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.537+0000 7ff6dfa0f800 20 remove_watcher() i=4 2024-09-12T00:25:01.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.537+0000 7ff6dfa0f800 20 remove_watcher() i=5 2024-09-12T00:25:01.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.538+0000 7ff6dfa0f800 20 remove_watcher() i=6 2024-09-12T00:25:01.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.539+0000 7ff6dfa0f800 20 remove_watcher() i=7 2024-09-12T00:25:01.551 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:25:01.580 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:01.580 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:01.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.621+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.623+0000 7fe6a5da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.623+0000 7fe6a5da9800 20 realm 2024-09-12T00:25:01.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.623+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.623+0000 7fe6a5da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.623+0000 7fe6a5da9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:01.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.623+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.623+0000 7fe6a5da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.623+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.624+0000 7fe6a5da9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:01.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.624+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.625+0000 7fe6a5da9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:01.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.625+0000 7fe6a5da9800 20 searching for the correct realm 2024-09-12T00:25:01.626 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.627+0000 7fe6a3092640 0 -- 172.21.15.33:0/1669816807 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fe69404a040 msgr2=0x7fe69400b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:01.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.631+0000 7fe6a3893640 0 -- 172.21.15.33:0/1669816807 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fe69404a040 msgr2=0x7fe56c08bdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:01.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:01.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:01.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:01.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:01.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:01.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:01.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.636+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:01.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:01.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 20 zone default found 2024-09-12T00:25:01.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 4 Realm: () 2024-09-12T00:25:01.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 20 zonegroup default 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.637+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.638+0000 7fe6a5da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.638+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.638+0000 7fe6a5da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.638+0000 7fe6a5da9800 20 started sync module instance, tier type = 2024-09-12T00:25:01.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.638+0000 7fe6a5da9800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:01.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 20 add_watcher() i=0 2024-09-12T00:25:01.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 20 add_watcher() i=1 2024-09-12T00:25:01.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 20 add_watcher() i=2 2024-09-12T00:25:01.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 20 add_watcher() i=3 2024-09-12T00:25:01.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 20 add_watcher() i=4 2024-09-12T00:25:01.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 20 add_watcher() i=5 2024-09-12T00:25:01.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 20 add_watcher() i=6 2024-09-12T00:25:01.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 20 add_watcher() i=7 2024-09-12T00:25:01.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.647+0000 7fe6a5da9800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:01.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.649+0000 7fe559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:01.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.650+0000 7fe6a5da9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:01.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.650+0000 7fe6a5da9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:01.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.650+0000 7fe6a5da9800 5 note: GC not initialized 2024-09-12T00:25:01.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.650+0000 7fe558fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:01.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.650+0000 7fe6a5da9800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:01.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.650+0000 7fe6a5da9800 20 Filter name: none 2024-09-12T00:25:01.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.650+0000 7fe4d27fc640 20 reqs_thread_entry: start 2024-09-12T00:25:01.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.650+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.651+0000 7fe6a5da9800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:01.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.651+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.651+0000 7fe6a5da9800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:01.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.651+0000 7fe6a5da9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:01.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.651+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.651+0000 7fe6a5da9800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:01.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.651+0000 7fe6a5da9800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.652+0000 7fe6a5da9800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:01.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.652+0000 7fe6a5da9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:01.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.654+0000 7fe559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:01.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.656+0000 7fe6a5da9800 20 remove_watcher() i=0 2024-09-12T00:25:01.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.656+0000 7fe6a5da9800 2 removed watcher, disabling cache 2024-09-12T00:25:01.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.658+0000 7fe6a5da9800 20 remove_watcher() i=1 2024-09-12T00:25:01.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.659+0000 7fe6a5da9800 20 remove_watcher() i=2 2024-09-12T00:25:01.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.661+0000 7fe6a5da9800 20 remove_watcher() i=3 2024-09-12T00:25:01.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.662+0000 7fe6a5da9800 20 remove_watcher() i=4 2024-09-12T00:25:01.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.663+0000 7fe6a5da9800 20 remove_watcher() i=5 2024-09-12T00:25:01.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.664+0000 7fe6a5da9800 20 remove_watcher() i=6 2024-09-12T00:25:01.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:01.665+0000 7fe6a5da9800 20 remove_watcher() i=7 2024-09-12T00:25:01.674 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:01.674 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:01.674 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-set-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:25:01.674 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:01.676 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:01.676 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:01.697 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:01.697 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:01.887 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:01.887 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.021 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:25:02.021 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:02.022 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.022 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.071 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.071 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.129 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.129 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.162 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.163 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.197 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.197 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.233 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.234 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.267 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.268 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.301 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.301 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.334 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.335 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.367 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.368 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.402 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.403 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.437 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.437 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.475 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.475 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.508 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.508 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.543 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.543 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.577 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.577 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.611 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.611 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.645 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.646 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.680 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.680 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.714 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.714 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.747 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.747 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.781 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:02.781 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:02.816 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:25:02.845 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:02.845 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:02.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.886+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.888+0000 7f8d95614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.888+0000 7f8d95614800 20 realm 2024-09-12T00:25:02.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.888+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.888+0000 7f8d95614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.888+0000 7f8d95614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:02.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.888+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.888+0000 7f8d95614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.888+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.889+0000 7f8d95614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:02.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.889+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.889+0000 7f8d95614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:02.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.889+0000 7f8d95614800 20 searching for the correct realm 2024-09-12T00:25:02.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.892+0000 7f8d904ca640 0 -- 172.21.15.33:0/2367900109 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5600be7ab0a0 msgr2=0x5600be7ad490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:02.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:02.895+0000 7f8d90ccb640 0 -- 172.21.15.33:0/2367900109 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f8d8407a1b0 msgr2=0x7f8d8407a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:03.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:03.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:03.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:03.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:03.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:03.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:03.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.101+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 20 zone default found 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 4 Realm: () 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 20 zonegroup default 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.102+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.103+0000 7f8d95614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.103+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.103+0000 7f8d95614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.103+0000 7f8d95614800 20 started sync module instance, tier type = 2024-09-12T00:25:03.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.103+0000 7f8d95614800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:03.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.112+0000 7f8d95614800 20 add_watcher() i=0 2024-09-12T00:25:03.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.112+0000 7f8d95614800 20 add_watcher() i=1 2024-09-12T00:25:03.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.112+0000 7f8d95614800 20 add_watcher() i=2 2024-09-12T00:25:03.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.112+0000 7f8d95614800 20 add_watcher() i=3 2024-09-12T00:25:03.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.112+0000 7f8d95614800 20 add_watcher() i=4 2024-09-12T00:25:03.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.112+0000 7f8d95614800 20 add_watcher() i=5 2024-09-12T00:25:03.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.113+0000 7f8d95614800 20 add_watcher() i=6 2024-09-12T00:25:03.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.114+0000 7f8d95614800 20 add_watcher() i=7 2024-09-12T00:25:03.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.114+0000 7f8d95614800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:03.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.115+0000 7f8c477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.116+0000 7f8d95614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:03.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.116+0000 7f8d95614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:03.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.116+0000 7f8d95614800 5 note: GC not initialized 2024-09-12T00:25:03.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.116+0000 7f8c467e4640 20 reqs_thread_entry: start 2024-09-12T00:25:03.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.116+0000 7f8d95614800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:03.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.116+0000 7f8d95614800 20 Filter name: none 2024-09-12T00:25:03.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.116+0000 7f8c3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:03.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.116+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.117+0000 7f8d95614800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:03.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.117+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.117+0000 7f8d95614800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:03.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.117+0000 7f8d95614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:03.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.117+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.118+0000 7f8d95614800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:03.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.118+0000 7f8d95614800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.118+0000 7f8d95614800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:03.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.118+0000 7f8d95614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:03.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.120+0000 7f8c477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.122+0000 7f8d95614800 20 remove_watcher() i=0 2024-09-12T00:25:03.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.122+0000 7f8d95614800 2 removed watcher, disabling cache 2024-09-12T00:25:03.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.123+0000 7f8d95614800 20 remove_watcher() i=1 2024-09-12T00:25:03.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.124+0000 7f8d95614800 20 remove_watcher() i=2 2024-09-12T00:25:03.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.125+0000 7f8d95614800 20 remove_watcher() i=3 2024-09-12T00:25:03.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.126+0000 7f8d95614800 20 remove_watcher() i=4 2024-09-12T00:25:03.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.127+0000 7f8d95614800 20 remove_watcher() i=5 2024-09-12T00:25:03.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.128+0000 7f8d95614800 20 remove_watcher() i=6 2024-09-12T00:25:03.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.129+0000 7f8d95614800 20 remove_watcher() i=7 2024-09-12T00:25:03.139 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:03.140 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:03.140 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-set-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:03.140 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:03.141 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:25:03.178 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:03.178 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:03.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.220+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.221+0000 7f9178f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.221+0000 7f9178f2c800 20 realm 2024-09-12T00:25:03.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.221+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.221+0000 7f9178f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.221+0000 7f9178f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:03.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.221+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.221+0000 7f9178f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.221+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.222+0000 7f9178f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.222+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.223+0000 7f9178f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:03.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.223+0000 7f9178f2c800 20 searching for the correct realm 2024-09-12T00:25:03.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.225+0000 7f9174c56640 0 -- 172.21.15.33:0/3350315938 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f917002e950 msgr2=0x7f91700233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:03.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.228+0000 7f9174c56640 0 -- 172.21.15.33:0/3350315938 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f9040087a30 msgr2=0x7f9040089e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.234+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:03.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 zone default found 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 4 Realm: () 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 zonegroup default 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 started sync module instance, tier type = 2024-09-12T00:25:03.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.235+0000 7f9178f2c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:03.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.244+0000 7f9178f2c800 20 add_watcher() i=0 2024-09-12T00:25:03.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.244+0000 7f9178f2c800 20 add_watcher() i=1 2024-09-12T00:25:03.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.244+0000 7f9178f2c800 20 add_watcher() i=2 2024-09-12T00:25:03.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.244+0000 7f9178f2c800 20 add_watcher() i=3 2024-09-12T00:25:03.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.244+0000 7f9178f2c800 20 add_watcher() i=4 2024-09-12T00:25:03.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.244+0000 7f9178f2c800 20 add_watcher() i=5 2024-09-12T00:25:03.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.244+0000 7f9178f2c800 20 add_watcher() i=6 2024-09-12T00:25:03.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.245+0000 7f9178f2c800 20 add_watcher() i=7 2024-09-12T00:25:03.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.245+0000 7f9178f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:03.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.247+0000 7f902afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.247+0000 7f9178f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:03.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.247+0000 7f9178f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:03.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.247+0000 7f9178f2c800 5 note: GC not initialized 2024-09-12T00:25:03.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.247+0000 7f9029fe3640 20 reqs_thread_entry: start 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.247+0000 7f9178f2c800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.247+0000 7f9178f2c800 20 Filter name: none 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f8f9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 : miss 2024-09-12T00:25:03.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:03.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 info.flags=0x17 2024-09-12T00:25:03.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 to cache LRU end 2024-09-12T00:25:03.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:03.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:03.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.248+0000 7f9178f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 2024-09-12T00:25:03.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.252+0000 7f9178f2c800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:25:03.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.254+0000 7f9178f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 info.flags=0x17 2024-09-12T00:25:03.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.254+0000 7f9178f2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 to cache LRU end 2024-09-12T00:25:03.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.254+0000 7f9178f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:03.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.254+0000 7f9178f2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24, ofs0, ns] 2024-09-12T00:25:03.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.254+0000 7f904bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94250314099328 notifier 6543 bl.length()=1009 2024-09-12T00:25:03.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.254+0000 7f904bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 info.flags=0x17 2024-09-12T00:25:03.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.254+0000 7f904bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 to cache LRU end 2024-09-12T00:25:03.253 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.254+0000 7f904bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:03.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.256+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): orig_sources= new_sources= 2024-09-12T00:25:03.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.256+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): potential sources added=[] removed=[] 2024-09-12T00:25:03.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.256+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): orig_dests= new_dests= 2024-09-12T00:25:03.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.256+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): potential dests added=[] removed=[] 2024-09-12T00:25:03.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.0 2024-09-12T00:25:03.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.0 2024-09-12T00:25:03.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.1 2024-09-12T00:25:03.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.1 2024-09-12T00:25:03.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.2 2024-09-12T00:25:03.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.2 2024-09-12T00:25:03.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.3 2024-09-12T00:25:03.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.3 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.4 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.4 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.5 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.5 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.6 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.6 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.7 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.7 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.8 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.8 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.9 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.9 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.10 2024-09-12T00:25:03.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.10 2024-09-12T00:25:03.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.11 2024-09-12T00:25:03.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1.11 2024-09-12T00:25:03.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.0 2024-09-12T00:25:03.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.261+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1 2024-09-12T00:25:03.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.262+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.2 2024-09-12T00:25:03.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.262+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.3 2024-09-12T00:25:03.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.263+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.4 2024-09-12T00:25:03.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.263+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.5 2024-09-12T00:25:03.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.264+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.6 2024-09-12T00:25:03.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.264+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.7 2024-09-12T00:25:03.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.265+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.8 2024-09-12T00:25:03.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.265+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.9 2024-09-12T00:25:03.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.266+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.10 2024-09-12T00:25:03.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.269+0000 7f9178f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:03.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.269+0000 7f9178f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.270+0000 7f9178f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 info.flags=0x17 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.270+0000 7f9178f2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 to cache LRU end 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.270+0000 7f9178f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.270+0000 7f9178f2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24, ofs0, ns] 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.271+0000 7f904b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 94250314099328 notifier 6543 bl.length()=1009 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.271+0000 7f904b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 info.flags=0x17 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.271+0000 7f904b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 to cache LRU end 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.271+0000 7f904b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:03.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.272+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): orig_sources= new_sources= 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.272+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): potential sources added=[] removed=[] 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.272+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): orig_dests= new_dests= 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.272+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): potential dests added=[] removed=[] 2024-09-12T00:25:03.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.275+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.0 2024-09-12T00:25:03.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.275+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.1 2024-09-12T00:25:03.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.275+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.2 2024-09-12T00:25:03.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.276+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.3 2024-09-12T00:25:03.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.276+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.4 2024-09-12T00:25:03.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.276+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.5 2024-09-12T00:25:03.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.277+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.6 2024-09-12T00:25:03.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.277+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.7 2024-09-12T00:25:03.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.278+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.8 2024-09-12T00:25:03.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.278+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.9 2024-09-12T00:25:03.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.278+0000 7f9178f2c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24.10 2024-09-12T00:25:03.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.279+0000 7f9178f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:03.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.279+0000 7f9178f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 2024-09-12T00:25:03.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.280+0000 7f9178f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 info.flags=0x17 2024-09-12T00:25:03.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.280+0000 7f9178f2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 to cache LRU end 2024-09-12T00:25:03.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.280+0000 7f9178f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:03.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.280+0000 7f9178f2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24, ofs0, ns] 2024-09-12T00:25:03.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.280+0000 7f904bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94250314099328 notifier 6543 bl.length()=977 2024-09-12T00:25:03.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.280+0000 7f904bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 info.flags=0x17 2024-09-12T00:25:03.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.280+0000 7f904bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 to cache LRU end 2024-09-12T00:25:03.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.280+0000 7f904bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:03.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.282+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): orig_sources= new_sources= 2024-09-12T00:25:03.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.282+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): potential sources added=[] removed=[] 2024-09-12T00:25:03.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.282+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): orig_dests= new_dests= 2024-09-12T00:25:03.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.282+0000 7f9178f2c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24]): potential dests added=[] removed=[] 2024-09-12T00:25:03.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.284+0000 7f9178f2c800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:25:03.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.286+0000 7f902afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.288+0000 7f9178f2c800 20 remove_watcher() i=0 2024-09-12T00:25:03.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.288+0000 7f9178f2c800 2 removed watcher, disabling cache 2024-09-12T00:25:03.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.289+0000 7f9178f2c800 20 remove_watcher() i=1 2024-09-12T00:25:03.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.290+0000 7f9178f2c800 20 remove_watcher() i=2 2024-09-12T00:25:03.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.291+0000 7f9178f2c800 20 remove_watcher() i=3 2024-09-12T00:25:03.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.293+0000 7f9178f2c800 20 remove_watcher() i=4 2024-09-12T00:25:03.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.294+0000 7f9178f2c800 20 remove_watcher() i=5 2024-09-12T00:25:03.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.295+0000 7f9178f2c800 20 remove_watcher() i=6 2024-09-12T00:25:03.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.296+0000 7f9178f2c800 20 remove_watcher() i=7 2024-09-12T00:25:03.307 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:25:03.336 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:03.336 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:03.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.376+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.378+0000 7f3f3e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.378+0000 7f3f3e535800 20 realm 2024-09-12T00:25:03.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.378+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.379+0000 7f3f3e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.379+0000 7f3f3e535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:03.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.379+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.379+0000 7f3f3e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.379+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.380+0000 7f3f3e535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.380+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.380+0000 7f3f3e535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:03.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.380+0000 7f3f3e535800 20 searching for the correct realm 2024-09-12T00:25:03.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.383+0000 7f3f3a2e4640 0 -- 172.21.15.33:0/1230666840 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f3f340a9b70 msgr2=0x7f3f340a85e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:03.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.386+0000 7f3f3a2e4640 0 -- 172.21.15.33:0/1230666840 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f3f300a2410 msgr2=0x7f3f3008edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:03.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:03.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:03.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:03.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:03.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:03.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:03.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.592+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 20 zone default found 2024-09-12T00:25:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 4 Realm: () 2024-09-12T00:25:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 20 zonegroup default 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.593+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.594+0000 7f3f3e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.594+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.594+0000 7f3f3e535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.594+0000 7f3f3e535800 20 started sync module instance, tier type = 2024-09-12T00:25:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.594+0000 7f3f3e535800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:03.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.603+0000 7f3f3e535800 20 add_watcher() i=0 2024-09-12T00:25:03.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.603+0000 7f3f3e535800 20 add_watcher() i=1 2024-09-12T00:25:03.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.603+0000 7f3f3e535800 20 add_watcher() i=2 2024-09-12T00:25:03.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.603+0000 7f3f3e535800 20 add_watcher() i=3 2024-09-12T00:25:03.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.603+0000 7f3f3e535800 20 add_watcher() i=4 2024-09-12T00:25:03.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.603+0000 7f3f3e535800 20 add_watcher() i=5 2024-09-12T00:25:03.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.603+0000 7f3f3e535800 20 add_watcher() i=6 2024-09-12T00:25:03.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.604+0000 7f3f3e535800 20 add_watcher() i=7 2024-09-12T00:25:03.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.604+0000 7f3f3e535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:03.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3df0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3f3e535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:03.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3f3e535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:03.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3f3e535800 5 note: GC not initialized 2024-09-12T00:25:03.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3d6b7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:03.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3f3e535800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:03.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3f3e535800 20 Filter name: none 2024-09-12T00:25:03.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3d697fa640 20 reqs_thread_entry: start 2024-09-12T00:25:03.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.606+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.607+0000 7f3f3e535800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:03.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.607+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.607+0000 7f3f3e535800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:03.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.607+0000 7f3f3e535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:03.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.607+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.608+0000 7f3f3e535800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:03.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.608+0000 7f3f3e535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.608+0000 7f3f3e535800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:03.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.608+0000 7f3f3e535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:03.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.610+0000 7f3df0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.612+0000 7f3f3e535800 20 remove_watcher() i=0 2024-09-12T00:25:03.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.612+0000 7f3f3e535800 2 removed watcher, disabling cache 2024-09-12T00:25:03.612 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.613+0000 7f3f3e535800 20 remove_watcher() i=1 2024-09-12T00:25:03.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.615+0000 7f3f3e535800 20 remove_watcher() i=2 2024-09-12T00:25:03.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.616+0000 7f3f3e535800 20 remove_watcher() i=3 2024-09-12T00:25:03.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.617+0000 7f3f3e535800 20 remove_watcher() i=4 2024-09-12T00:25:03.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.618+0000 7f3f3e535800 20 remove_watcher() i=5 2024-09-12T00:25:03.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.619+0000 7f3f3e535800 20 remove_watcher() i=6 2024-09-12T00:25:03.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:03.620+0000 7f3f3e535800 20 remove_watcher() i=7 2024-09-12T00:25:03.629 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:03.629 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:03.629 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-set-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:25:03.629 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:03.632 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:03.632 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:03.652 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:03.652 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:03.854 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:03.854 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:03.986 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:25:03.986 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:03.987 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:03.987 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.036 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.036 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.093 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.093 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.131 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.131 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.168 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.168 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.202 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.202 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.236 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.236 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.271 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.271 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.305 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.305 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.339 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.339 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.373 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.373 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.407 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.407 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.443 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.443 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.475 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.475 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.509 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.510 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.543 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.544 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.583 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.583 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.617 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.617 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.651 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.651 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.685 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.685 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.718 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.718 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.750 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:04.751 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:04.786 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:25:04.816 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:04.816 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:04.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.856+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.858+0000 7fb714c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:04.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.858+0000 7fb714c0e800 20 realm 2024-09-12T00:25:04.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.858+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.858+0000 7fb714c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:04.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.858+0000 7fb714c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:04.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.858+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.859+0000 7fb714c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:04.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.859+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.859+0000 7fb714c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:04.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.859+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.860+0000 7fb714c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:04.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.860+0000 7fb714c0e800 20 searching for the correct realm 2024-09-12T00:25:04.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:04.864+0000 7fb710b7b640 0 -- 172.21.15.33:0/383737802 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fb7040a5040 msgr2=0x7fb70406be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:05.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.070+0000 7fb71037a640 0 -- 172.21.15.33:0/383737802 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x56156c598250 msgr2=0x56156c59a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.073+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 zone default found 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 4 Realm: () 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 zonegroup default 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.074+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.075+0000 7fb714c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.075+0000 7fb714c0e800 20 started sync module instance, tier type = 2024-09-12T00:25:05.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.075+0000 7fb714c0e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:05.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.084+0000 7fb714c0e800 20 add_watcher() i=0 2024-09-12T00:25:05.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.084+0000 7fb714c0e800 20 add_watcher() i=1 2024-09-12T00:25:05.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.084+0000 7fb714c0e800 20 add_watcher() i=2 2024-09-12T00:25:05.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.084+0000 7fb714c0e800 20 add_watcher() i=3 2024-09-12T00:25:05.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.084+0000 7fb714c0e800 20 add_watcher() i=4 2024-09-12T00:25:05.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.084+0000 7fb714c0e800 20 add_watcher() i=5 2024-09-12T00:25:05.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.084+0000 7fb714c0e800 20 add_watcher() i=6 2024-09-12T00:25:05.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.085+0000 7fb714c0e800 20 add_watcher() i=7 2024-09-12T00:25:05.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.085+0000 7fb714c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:05.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb5c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb714c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:05.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb714c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:05.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb714c0e800 5 note: GC not initialized 2024-09-12T00:25:05.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb5c5fdb640 20 reqs_thread_entry: start 2024-09-12T00:25:05.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb714c0e800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:05.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb714c0e800 20 Filter name: none 2024-09-12T00:25:05.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb5377fe640 20 reqs_thread_entry: start 2024-09-12T00:25:05.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.087+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.088+0000 7fb714c0e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:05.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.088+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.089+0000 7fb714c0e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:05.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.089+0000 7fb714c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:05.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.089+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.089+0000 7fb714c0e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:05.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.089+0000 7fb714c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.090+0000 7fb714c0e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:05.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.090+0000 7fb714c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:05.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.092+0000 7fb5c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.094+0000 7fb714c0e800 20 remove_watcher() i=0 2024-09-12T00:25:05.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.094+0000 7fb714c0e800 2 removed watcher, disabling cache 2024-09-12T00:25:05.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.095+0000 7fb714c0e800 20 remove_watcher() i=1 2024-09-12T00:25:05.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.096+0000 7fb714c0e800 20 remove_watcher() i=2 2024-09-12T00:25:05.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.097+0000 7fb714c0e800 20 remove_watcher() i=3 2024-09-12T00:25:05.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.098+0000 7fb714c0e800 20 remove_watcher() i=4 2024-09-12T00:25:05.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.099+0000 7fb714c0e800 20 remove_watcher() i=5 2024-09-12T00:25:05.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.100+0000 7fb714c0e800 20 remove_watcher() i=6 2024-09-12T00:25:05.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.101+0000 7fb714c0e800 20 remove_watcher() i=7 2024-09-12T00:25:05.111 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.111 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:05.111 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-set-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:05.111 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.112 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:25:05.147 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:05.147 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:05.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.187+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.189+0000 7f1da8f20800 20 realm 2024-09-12T00:25:05.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.189+0000 7f1da8f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:05.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.190+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.190+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:05.190 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.191+0000 7f1da8f20800 20 searching for the correct realm 2024-09-12T00:25:05.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.194+0000 7f1da4301640 0 -- 172.21.15.33:0/2437380464 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55a296e6be40 msgr2=0x55a296e6e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:05.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.197+0000 7f1da4b02640 0 -- 172.21.15.33:0/2437380464 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f1d980398b0 msgr2=0x7f1d9801c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 zone default found 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 4 Realm: () 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 zonegroup default 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.405+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.405+0000 7f1da8f20800 20 started sync module instance, tier type = 2024-09-12T00:25:05.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.405+0000 7f1da8f20800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:05.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=0 2024-09-12T00:25:05.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=1 2024-09-12T00:25:05.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=2 2024-09-12T00:25:05.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=3 2024-09-12T00:25:05.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=4 2024-09-12T00:25:05.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=5 2024-09-12T00:25:05.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=6 2024-09-12T00:25:05.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.415+0000 7f1da8f20800 20 add_watcher() i=7 2024-09-12T00:25:05.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.415+0000 7f1da8f20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.416+0000 7f1c5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1da8f20800 5 note: GC not initialized 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1c5a7e4640 20 reqs_thread_entry: start 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1da8f20800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1da8f20800 20 Filter name: none 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1c53fff640 20 reqs_thread_entry: start 2024-09-12T00:25:05.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1da8f20800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:25:05.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:05.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 : miss 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:05.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.418+0000 7f1da8f20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 2024-09-12T00:25:05.421 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1da8f20800 time 2024-09-12T00:25:05.423712+0000 2024-09-12T00:25:05.421 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1daa58c71a] 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1daa58c8d8] 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a295365641] 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd878e8) [0x55a2958778e8] 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29537531d] 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1da9229590] 2024-09-12T00:25:05.422 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:25:05.423 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:25:05.423 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:25:05.423 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f1da8f20800 thread_name:radosgw-admin 2024-09-12T00:25:05.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.423+0000 7f1da8f20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1da8f20800 time 2024-09-12T00:25:05.423712+0000 2024-09-12T00:25:05.424 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:25:05.424 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.424 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:05.424 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1daa58c71a] 2024-09-12T00:25:05.425 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1daa58c8d8] 2024-09-12T00:25:05.425 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a295365641] 2024-09-12T00:25:05.425 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd878e8) [0x55a2958778e8] 2024-09-12T00:25:05.426 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29537531d] 2024-09-12T00:25:05.426 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:25:05.426 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1da9229590] 2024-09-12T00:25:05.426 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:25:05.426 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:25:05.427 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.452 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:05.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1da923e6f0] 2024-09-12T00:25:05.452 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1da928b99c] 2024-09-12T00:25:05.452 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:25:05.452 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:25:05.452 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1daa58c774] 2024-09-12T00:25:05.452 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1daa58c8d8] 2024-09-12T00:25:05.452 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a295365641] 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd878e8) [0x55a2958778e8] 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29537531d] 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1da9229590] 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.424+0000 7f1da8f20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f1da8f20800 thread_name:radosgw-admin 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1da923e6f0] 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1da928b99c] 2024-09-12T00:25:05.453 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1daa58c774] 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1daa58c8d8] 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a295365641] 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd878e8) [0x55a2958778e8] 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29537531d] 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1da9229590] 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:25:05.454 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:25:05.169+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:25:05.169+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:25:05.169+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6591 payload 274 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:25:05.169+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:25:05.169+0000 7f1da4b02640 1 monclient: found mon.noname-a 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:25:05.169+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: dump: 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.455 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:05.456 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: dump: 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:25:05.170+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6591 2024-09-12T00:25:05.457 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:25:05.170+0000 7f1da8f20800 10 monclient: get_monmap_and_config success 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:25:05.170+0000 7f1da8f20800 4 set_mon_vals no callback set 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:25:05.171+0000 7f1da8f20800 10 monclient: shutdown 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 asok(0x55a296b58630) unregister_commands rotate-key 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:25:05.171+0000 7f1da8f20800 10 monclient: build_initial_monmap 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 build_initial for_mkfs: 0 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:25:05.171+0000 7f1da8f20800 10 monclient: monmap: 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:05.458 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding auth protocol: cephx 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding auth protocol: cephx 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding auth protocol: cephx 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.459 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.460 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.460 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.460 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.460 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.460 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.460 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.460 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.460 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:25:05.171+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.461 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 librados: starting msgr at 2024-09-12T00:25:05.461 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 librados: starting objecter 2024-09-12T00:25:05.461 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command objecter_requests hook 0x55a296d802b0 2024-09-12T00:25:05.461 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 librados: setting wanted keys 2024-09-12T00:25:05.461 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 librados: calling monclient init 2024-09-12T00:25:05.461 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:25:05.171+0000 7f1da8f20800 10 monclient: init 2024-09-12T00:25:05.464 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding auth protocol: cephx 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding auth protocol: cephx 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding auth protocol: cephx 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.465 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:25:05.171+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:25:05.172+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:25:05.172+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command rotate-key hook 0x55a296d7ae38 2024-09-12T00:25:05.466 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-a con 0x55a296c24a10 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-b con 0x55a296c31220 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-c con 0x55a296cbe470 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): authenticate will time out at 2124.737206s 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): get_auth_request con 0x55a296c24a10 auth_method 0 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.467 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): get_auth_request con 0x55a296cbe470 auth_method 0 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): get_auth_request con 0x55a296c31220 auth_method 0 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.468 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6594 payload 824 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:25:05.172+0000 7f1da4b02640 1 monclient: found mon.noname-a 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: dump: 2024-09-12T00:25:05.469 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.470 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: dump: 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.471 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:25:05.172+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6594 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:25:05.172+0000 7f1c92e0d640 4 set_mon_vals no callback set 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:25:05.172+0000 7f1da8f20800 1 librados: init done 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:25:05.174+0000 7f1c9160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:25:05.174+0000 7f1c9160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.472 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:25:05.174+0000 7f1c9160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:25:05.175+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1c8c076470 auth_method 0 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:25:05.175+0000 7f1da5303640 10 monclient: get_auth_request con 0x55a296da3990 auth_method 0 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:25:05.176+0000 7f1da4b02640 10 monclient: get_auth_request con 0x55a296dc6300 auth_method 0 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:25:05.177+0000 7f1da4301640 10 monclient: get_auth_request con 0x55a296dca6b0 auth_method 0 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:25:05.178+0000 7f1da8f20800 10 monclient: build_initial_monmap 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:25:05.178+0000 7f1da8f20800 1 build_initial for_mkfs: 0 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:25:05.178+0000 7f1da8f20800 10 monclient: monmap: 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:05.473 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding auth protocol: cephx 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding auth protocol: cephx 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding auth protocol: cephx 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.474 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:25:05.178+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command objecter_requests cmddesc objecter_requests hook 0x55a296dd2f60 EEXIST 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:25:05.178+0000 7f1da8f20800 10 monclient: init 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding auth protocol: cephx 2024-09-12T00:25:05.475 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding auth protocol: cephx 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding auth protocol: cephx 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.476 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:25:05.179+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:25:05.179+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:25:05.179+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command rotate-key cmddesc rotate-key hook 0x55a296dcdd60 EEXIST 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-c con 0x55a296df6c50 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-a con 0x55a296df8f20 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-b con 0x55a296df5420 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.477 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): authenticate will time out at 2124.744438s 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): get_auth_request con 0x55a296df6c50 auth_method 0 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): get_auth_request con 0x55a296df8f20 auth_method 0 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.478 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:25:05.179+0000 7f1da5303640 10 monclient(hunting): get_auth_request con 0x55a296df5420 auth_method 0 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:25:05.179+0000 7f1da5303640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:25:05.179+0000 7f1da5303640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:25:05.179+0000 7f1da5303640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6242 payload 824 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:25:05.179+0000 7f1da4b02640 1 monclient: found mon.noname-c 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.479 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: dump: 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.480 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.481 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.481 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:25:05.481 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: dump: 2024-09-12T00:25:05.481 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.481 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.481 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.481 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.481 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:25:05.180+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6242 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:25:05.180+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:25:05.180+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:25:05.180+0000 7f1da5b04640 4 set_mon_vals no callback set 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:25:05.180+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:25:05.180+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:25:05.181+0000 7f1c8a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:25:05.181+0000 7f1c8a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.482 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:25:05.181+0000 7f1c8a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:25:05.181+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1c7c076380 auth_method 0 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:25:05.182+0000 7f1da8f20800 10 monclient: get_monmap_and_config 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:25:05.182+0000 7f1da8f20800 10 monclient: build_initial_monmap 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:25:05.182+0000 7f1da8f20800 1 build_initial for_mkfs: 0 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:25:05.182+0000 7f1da8f20800 10 monclient: monmap: 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.483 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding auth protocol: cephx 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding auth protocol: cephx 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding auth protocol: cephx 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.484 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:25:05.182+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:25:05.182+0000 7f1da8f20800 10 monclient: init 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding auth protocol: cephx 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding auth protocol: cephx 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding auth protocol: cephx 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.485 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:25:05.182+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:25:05.183+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:25:05.183+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command rotate-key cmddesc rotate-key hook 0x7ffd619f7e58 EEXIST 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:25:05.486 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-a con 0x55a296e4acc0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-c con 0x55a296e45260 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-b con 0x55a296e1ab00 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): authenticate will time out at 2124.748214s 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): get_auth_request con 0x55a296e4acc0 auth_method 0 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): get_auth_request con 0x55a296e45260 auth_method 0 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.487 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.488 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.488 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.488 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.488 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.488 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): get_auth_request con 0x55a296e1ab00 auth_method 0 2024-09-12T00:25:05.488 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.488 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.488 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.489 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.489 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.489 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.489 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.489 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.489 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.490 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6600 payload 274 2024-09-12T00:25:05.490 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.490 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:25:05.183+0000 7f1da4b02640 1 monclient: found mon.noname-a 2024-09-12T00:25:05.490 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.490 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.490 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:05.491 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: dump: 2024-09-12T00:25:05.491 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.491 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.491 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.491 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.491 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.491 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.492 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.492 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.492 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.493 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.493 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:25:05.183+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6600 2024-09-12T00:25:05.493 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient: get_monmap_and_config success 2024-09-12T00:25:05.494 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:25:05.183+0000 7f1da8f20800 4 set_mon_vals no callback set 2024-09-12T00:25:05.494 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.494 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:05.494 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: dump: 2024-09-12T00:25:05.494 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.495 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.495 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.495 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.495 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.495 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.495 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.496 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.496 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.496 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.496 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:25:05.184+0000 7f1da8f20800 10 monclient: shutdown 2024-09-12T00:25:05.496 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:25:05.184+0000 7f1da8f20800 10 monclient: build_initial_monmap 2024-09-12T00:25:05.497 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:25:05.184+0000 7f1da8f20800 1 build_initial for_mkfs: 0 2024-09-12T00:25:05.497 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:25:05.184+0000 7f1da8f20800 10 monclient: monmap: 2024-09-12T00:25:05.497 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:05.497 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:05.497 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:05.497 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:05.498 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:05.498 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.498 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:05.498 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:05.498 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding auth protocol: cephx 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding auth protocol: cephx 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding auth protocol: cephx 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.499 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:25:05.184+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:25:05.184+0000 7f1da8f20800 1 librados: starting msgr at 2024-09-12T00:25:05.500 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:25:05.184+0000 7f1da8f20800 1 librados: starting objecter 2024-09-12T00:25:05.501 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command objecter_requests cmddesc objecter_requests hook 0x55a296dae130 EEXIST 2024-09-12T00:25:05.501 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:25:05.185+0000 7f1da8f20800 1 librados: setting wanted keys 2024-09-12T00:25:05.501 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:25:05.185+0000 7f1da8f20800 1 librados: calling monclient init 2024-09-12T00:25:05.501 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient: init 2024-09-12T00:25:05.501 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding auth protocol: cephx 2024-09-12T00:25:05.502 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding auth protocol: cephx 2024-09-12T00:25:05.502 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding auth protocol: cephx 2024-09-12T00:25:05.502 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.502 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.502 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.502 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.503 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.503 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.503 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.503 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.504 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.504 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.504 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.504 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.504 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:25:05.185+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.504 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:25:05.185+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.505 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command rotate-key cmddesc rotate-key hook 0x55a296e0eb48 EEXIST 2024-09-12T00:25:05.505 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:05.505 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:25:05.505 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-c con 0x55a296e1ab00 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:05.505 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-a con 0x55a296e45260 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:05.505 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-b con 0x55a296e4acc0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:05.506 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.506 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.506 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.506 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:05.506 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): authenticate will time out at 2124.750585s 2024-09-12T00:25:05.506 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): get_auth_request con 0x55a296e1ab00 auth_method 0 2024-09-12T00:25:05.507 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.507 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.507 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.507 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): get_auth_request con 0x55a296e45260 auth_method 0 2024-09-12T00:25:05.507 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.507 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.507 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.508 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.508 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.508 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.508 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.508 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.508 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.509 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6248 payload 824 2024-09-12T00:25:05.509 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.509 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:25:05.185+0000 7f1da4b02640 1 monclient: found mon.noname-c 2024-09-12T00:25:05.509 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.509 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.509 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: dump: 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.510 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: dump: 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:25:05.186+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6248 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:25:05.186+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:25:05.186+0000 7f1c7bfff640 4 set_mon_vals no callback set 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:25:05.186+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:25:05.186+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:25:05.186+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:25:05.186+0000 7f1da8f20800 1 librados: init done 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:25:05.186+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cr dump hook 0x55a296e18578 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:25:05.187+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:25:05.188+0000 7f1c7a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:05.512 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:25:05.188+0000 7f1c7a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:25:05.188+0000 7f1c7a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:25:05.188+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1c70076470 auth_method 0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:25:05.189+0000 7f1da5303640 10 monclient: get_auth_request con 0x55a296e643a0 auth_method 0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 realm 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:25:05.189+0000 7f1da8f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:25:05.190+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:25:05.190+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:25:05.190+0000 7f1da4b02640 10 monclient: get_auth_request con 0x55a296e685c0 auth_method 0 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.513 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:25:05.191+0000 7f1da4301640 10 monclient: get_auth_request con 0x55a296e6be40 auth_method 0 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:25:05.191+0000 7f1da8f20800 20 searching for the correct realm 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:25:05.192+0000 7f1da5303640 10 monclient: get_auth_request con 0x55a296e70c00 auth_method 0 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:25:05.192+0000 7f1da4b02640 10 monclient: get_auth_request con 0x7f1d9c057ba0 auth_method 0 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:25:05.193+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1d94092280 auth_method 0 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:25:05.194+0000 7f1da4301640 0 -- 172.21.15.33:0/2437380464 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55a296e6be40 msgr2=0x55a296e6e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:25:05.194+0000 7f1c7a7fc640 1 client.6248.objecter ms_handle_reset 0x55a296e6be40 session 0x55a296e67950 osd.4 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:25:05.194+0000 7f1c7a7fc640 10 monclient: _renew_subs 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:25:05.194+0000 7f1c7a7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:25:05.194+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1c70086c80 auth_method 0 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:25:05.195+0000 7f1da5303640 10 monclient: get_auth_request con 0x7f1d9803ab70 auth_method 0 2024-09-12T00:25:05.514 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:25:05.197+0000 7f1da4b02640 10 monclient: get_auth_request con 0x7f1d980398b0 auth_method 0 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:25:05.197+0000 7f1da4b02640 0 -- 172.21.15.33:0/2437380464 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f1d980398b0 msgr2=0x7f1d9801c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:25:05.398+0000 7f1da4b02640 10 monclient: get_auth_request con 0x7f1d980398b0 auth_method 0 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.515 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 zone default found 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:25:05.404+0000 7f1da8f20800 4 Realm: () 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:25:05.404+0000 7f1da8f20800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:25:05.404+0000 7f1da8f20800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:25:05.404+0000 7f1da8f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 zonegroup default 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.516 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:25:05.405+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:25:05.405+0000 7f1da8f20800 20 started sync module instance, tier type = 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:25:05.405+0000 7f1da8f20800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=0 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=1 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=2 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=3 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=4 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=5 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=6 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:25:05.415+0000 7f1da8f20800 20 add_watcher() i=7 2024-09-12T00:25:05.517 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:25:05.415+0000 7f1da8f20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding auth protocol: cephx 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding auth protocol: cephx 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding auth protocol: cephx 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:25:05.416+0000 7f1c5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.518 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:25:05.417+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cache list hook 0x55a296e413c0 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cache inspect hook 0x55a296e413c0 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cache erase hook 0x55a296e413c0 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cache zap hook 0x55a296e413c0 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 note: GC not initialized 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:25:05.417+0000 7f1c5a7e4640 20 reqs_thread_entry: start 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command sync trace show hook 0x7f1d9407a070 2024-09-12T00:25:05.519 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command sync trace history hook 0x7f1d9407a070 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command sync trace active hook 0x7f1d9407a070 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command sync trace active_short hook 0x7f1d9407a070 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 Filter name: none 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:25:05.417+0000 7f1c53fff640 20 reqs_thread_entry: start 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:25:05.417+0000 7f1da8f20800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 : miss 2024-09-12T00:25:05.520 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:25:05.423+0000 7f1da8f20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1da8f20800 time 2024-09-12T00:25:05.423712+0000 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1daa58c71a] 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1daa58c8d8] 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a295365641] 2024-09-12T00:25:05.521 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd878e8) [0x55a2958778e8] 2024-09-12T00:25:05.522 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29537531d] 2024-09-12T00:25:05.522 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:25:05.522 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1da9229590] 2024-09-12T00:25:05.522 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:25:05.522 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:25:05.424+0000 7f1da8f20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f1da8f20800 thread_name:radosgw-admin 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1da923e6f0] 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1da928b99c] 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:25:05.523 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1daa58c774] 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1daa58c8d8] 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a295365641] 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd878e8) [0x55a2958778e8] 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29537531d] 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1da9229590] 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:25:05.524 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:25:05.525 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:25:05.526 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:25:05.527 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:25:05.528 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:25:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:25:05.530 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:25:05.531 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c53fff640 / http_manager 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c5a7e4640 / http_manager 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c5b7e6640 / rgw_dt_lg_renew 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c7a7fc640 / ms_dispatch 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c7bfff640 / io_context_pool 2024-09-12T00:25:05.532 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c8a7fc640 / ms_dispatch 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c9160a640 / ms_dispatch 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c92e0d640 / io_context_pool 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da4301640 / msgr-worker-2 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da4b02640 / msgr-worker-1 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da5303640 / msgr-worker-0 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da5b04640 / io_context_pool 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da8f20800 / radosgw-admin 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.98624.log 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:25:05.169+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.533 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:25:05.169+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:25:05.169+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6591 payload 274 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:25:05.169+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:25:05.169+0000 7f1da4b02640 1 monclient: found mon.noname-a 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:25:05.169+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: dump: 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.534 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:25:05.170+0000 7f1c92e0d640 10 monclient: dump: 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.535 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:25:05.170+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6591 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:25:05.170+0000 7f1da8f20800 10 monclient: get_monmap_and_config success 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:25:05.170+0000 7f1da8f20800 4 set_mon_vals no callback set 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:25:05.171+0000 7f1da8f20800 10 monclient: shutdown 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 asok(0x55a296b58630) unregister_commands rotate-key 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:25:05.171+0000 7f1da8f20800 10 monclient: build_initial_monmap 2024-09-12T00:25:05.536 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 build_initial for_mkfs: 0 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:25:05.171+0000 7f1da8f20800 10 monclient: monmap: 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:05.537 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding auth protocol: cephx 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding auth protocol: cephx 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding auth protocol: cephx 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.538 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: crc 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d808c0) adding con mode: secure 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:25:05.171+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 librados: starting msgr at 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 librados: starting objecter 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command objecter_requests hook 0x55a296d802b0 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 librados: setting wanted keys 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:25:05.171+0000 7f1da8f20800 1 librados: calling monclient init 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:25:05.171+0000 7f1da8f20800 10 monclient: init 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding auth protocol: cephx 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding auth protocol: cephx 2024-09-12T00:25:05.539 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding auth protocol: cephx 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: crc 2024-09-12T00:25:05.540 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:25:05.171+0000 7f1da8f20800 5 AuthRegistry(0x55a296d7acf0) adding con mode: secure 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:25:05.171+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:25:05.172+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:25:05.172+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command rotate-key hook 0x55a296d7ae38 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-a con 0x55a296c24a10 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-b con 0x55a296c31220 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-c con 0x55a296cbe470 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:05.541 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient(hunting): authenticate will time out at 2124.737206s 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): get_auth_request con 0x55a296c24a10 auth_method 0 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): get_auth_request con 0x55a296cbe470 auth_method 0 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.542 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): get_auth_request con 0x55a296c31220 auth_method 0 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:25:05.172+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:25:05.172+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6594 payload 824 2024-09-12T00:25:05.543 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:25:05.172+0000 7f1da4b02640 1 monclient: found mon.noname-a 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:25:05.172+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: dump: 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.544 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:25:05.172+0000 7f1c9160a640 10 monclient: dump: 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.545 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:25:05.172+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6594 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:25:05.172+0000 7f1c92e0d640 4 set_mon_vals no callback set 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:25:05.172+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.546 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:25:05.172+0000 7f1da8f20800 1 librados: init done 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:25:05.174+0000 7f1c9160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:25:05.174+0000 7f1c9160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:25:05.174+0000 7f1c9160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:25:05.175+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1c8c076470 auth_method 0 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:25:05.175+0000 7f1da5303640 10 monclient: get_auth_request con 0x55a296da3990 auth_method 0 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:25:05.176+0000 7f1da4b02640 10 monclient: get_auth_request con 0x55a296dc6300 auth_method 0 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:25:05.177+0000 7f1da4301640 10 monclient: get_auth_request con 0x55a296dca6b0 auth_method 0 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:25:05.178+0000 7f1da8f20800 10 monclient: build_initial_monmap 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:25:05.178+0000 7f1da8f20800 1 build_initial for_mkfs: 0 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:25:05.178+0000 7f1da8f20800 10 monclient: monmap: 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:05.547 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding auth protocol: cephx 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding auth protocol: cephx 2024-09-12T00:25:05.548 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding auth protocol: cephx 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: crc 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcf540) adding con mode: secure 2024-09-12T00:25:05.549 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:25:05.178+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command objecter_requests cmddesc objecter_requests hook 0x55a296dd2f60 EEXIST 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:25:05.178+0000 7f1da8f20800 10 monclient: init 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding auth protocol: cephx 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding auth protocol: cephx 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding auth protocol: cephx 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.550 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: crc 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:25:05.178+0000 7f1da8f20800 5 AuthRegistry(0x55a296dcdc18) adding con mode: secure 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:25:05.179+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:25:05.179+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:25:05.179+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command rotate-key cmddesc rotate-key hook 0x55a296dcdd60 EEXIST 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-c con 0x55a296df6c50 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-a con 0x55a296df8f20 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-b con 0x55a296df5420 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.551 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:25:05.179+0000 7f1da8f20800 10 monclient(hunting): authenticate will time out at 2124.744438s 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): get_auth_request con 0x55a296df6c50 auth_method 0 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): get_auth_request con 0x55a296df8f20 auth_method 0 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.552 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:25:05.179+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:25:05.179+0000 7f1da5303640 10 monclient(hunting): get_auth_request con 0x55a296df5420 auth_method 0 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:25:05.179+0000 7f1da5303640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:25:05.179+0000 7f1da5303640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:25:05.179+0000 7f1da5303640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6242 payload 824 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:25:05.179+0000 7f1da4b02640 1 monclient: found mon.noname-c 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:25:05.179+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.553 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: dump: 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.554 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:25:05.180+0000 7f1c8a7fc640 10 monclient: dump: 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.555 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:25:05.180+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6242 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:25:05.180+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:25:05.180+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:25:05.180+0000 7f1da5b04640 4 set_mon_vals no callback set 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:25:05.180+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:25:05.180+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:25:05.181+0000 7f1c8a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:25:05.181+0000 7f1c8a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:25:05.181+0000 7f1c8a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:25:05.181+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1c7c076380 auth_method 0 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:25:05.182+0000 7f1da8f20800 10 monclient: get_monmap_and_config 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:25:05.182+0000 7f1da8f20800 10 monclient: build_initial_monmap 2024-09-12T00:25:05.556 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:25:05.182+0000 7f1da8f20800 1 build_initial for_mkfs: 0 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:25:05.182+0000 7f1da8f20800 10 monclient: monmap: 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding auth protocol: cephx 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding auth protocol: cephx 2024-09-12T00:25:05.557 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding auth protocol: cephx 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: crc 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x55a296e16740) adding con mode: secure 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:25:05.182+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.558 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:25:05.182+0000 7f1da8f20800 10 monclient: init 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding auth protocol: cephx 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding auth protocol: cephx 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding auth protocol: cephx 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.559 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: crc 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:25:05.182+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f7d10) adding con mode: secure 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:25:05.182+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:25:05.183+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:25:05.183+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command rotate-key cmddesc rotate-key hook 0x7ffd619f7e58 EEXIST 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-a con 0x55a296e4acc0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-c con 0x55a296e45260 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-b con 0x55a296e1ab00 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.560 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient(hunting): authenticate will time out at 2124.748214s 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): get_auth_request con 0x55a296e4acc0 auth_method 0 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): get_auth_request con 0x55a296e45260 auth_method 0 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.561 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): get_auth_request con 0x55a296e1ab00 auth_method 0 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:25:05.183+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:25:05.183+0000 7f1da5303640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6600 payload 274 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:25:05.183+0000 7f1da4b02640 1 monclient: found mon.noname-a 2024-09-12T00:25:05.562 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:25:05.183+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: dump: 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.563 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:25:05.183+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6600 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:25:05.183+0000 7f1da8f20800 10 monclient: get_monmap_and_config success 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:25:05.183+0000 7f1da8f20800 4 set_mon_vals no callback set 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:25:05.183+0000 7f1c7bfff640 10 monclient: dump: 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.564 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:25:05.184+0000 7f1da8f20800 10 monclient: shutdown 2024-09-12T00:25:05.565 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:25:05.184+0000 7f1da8f20800 10 monclient: build_initial_monmap 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:25:05.184+0000 7f1da8f20800 1 build_initial for_mkfs: 0 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:25:05.184+0000 7f1da8f20800 10 monclient: monmap: 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.566 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding auth protocol: cephx 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding auth protocol: cephx 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding auth protocol: cephx 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.567 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: crc 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 AuthRegistry(0x55a296e46220) adding con mode: secure 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:25:05.184+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:25:05.184+0000 7f1da8f20800 1 librados: starting msgr at 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:25:05.184+0000 7f1da8f20800 1 librados: starting objecter 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:25:05.184+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command objecter_requests cmddesc objecter_requests hook 0x55a296dae130 EEXIST 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:25:05.185+0000 7f1da8f20800 1 librados: setting wanted keys 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:25:05.185+0000 7f1da8f20800 1 librados: calling monclient init 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient: init 2024-09-12T00:25:05.568 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding auth protocol: cephx 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding auth protocol: cephx 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding auth protocol: cephx 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: crc 2024-09-12T00:25:05.569 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 AuthRegistry(0x55a296e0ea00) adding con mode: secure 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:25:05.185+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:25:05.185+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:25:05.185+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command rotate-key cmddesc rotate-key hook 0x55a296e0eb48 EEXIST 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-c con 0x55a296e1ab00 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-a con 0x55a296e45260 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): picked mon.noname-b con 0x55a296e4acc0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:05.570 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:25:05.185+0000 7f1da8f20800 10 monclient(hunting): authenticate will time out at 2124.750585s 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): get_auth_request con 0x55a296e1ab00 auth_method 0 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): get_auth_request con 0x55a296e45260 auth_method 0 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:05.571 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:25:05.185+0000 7f1da4301640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient(hunting): handle_auth_done global_id 6248 payload 824 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient: _finish_hunting 0 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:25:05.185+0000 7f1da4b02640 1 monclient: found mon.noname-c 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:25:05.185+0000 7f1da4b02640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: dump: 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.572 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: _finish_auth 0 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:25:05.186+0000 7f1c7a7fc640 10 monclient: dump: 2024-09-12T00:25:05.573 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:25:05.186+0000 7f1da8f20800 5 monclient: authenticate success, global_id 6248 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:25:05.186+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:25:05.186+0000 7f1c7bfff640 4 set_mon_vals no callback set 2024-09-12T00:25:05.574 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:25:05.186+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:25:05.186+0000 7f1da8f20800 10 monclient: _renew_subs 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:25:05.186+0000 7f1da8f20800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:25:05.186+0000 7f1da8f20800 1 librados: init done 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:25:05.186+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cr dump hook 0x55a296e18578 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:25:05.187+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:25:05.188+0000 7f1c7a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:25:05.188+0000 7f1c7a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:25:05.188+0000 7f1c7a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:25:05.188+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1c70076470 auth_method 0 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:25:05.189+0000 7f1da5303640 10 monclient: get_auth_request con 0x55a296e643a0 auth_method 0 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 realm 2024-09-12T00:25:05.575 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:25:05.189+0000 7f1da8f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:25:05.189+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:25:05.190+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:25:05.190+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:25:05.190+0000 7f1da4b02640 10 monclient: get_auth_request con 0x55a296e685c0 auth_method 0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:25:05.191+0000 7f1da4301640 10 monclient: get_auth_request con 0x55a296e6be40 auth_method 0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:25:05.191+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:25:05.191+0000 7f1da8f20800 20 searching for the correct realm 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:25:05.192+0000 7f1da5303640 10 monclient: get_auth_request con 0x55a296e70c00 auth_method 0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:25:05.192+0000 7f1da4b02640 10 monclient: get_auth_request con 0x7f1d9c057ba0 auth_method 0 2024-09-12T00:25:05.576 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:25:05.193+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1d94092280 auth_method 0 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:25:05.194+0000 7f1da4301640 0 -- 172.21.15.33:0/2437380464 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55a296e6be40 msgr2=0x55a296e6e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:25:05.194+0000 7f1c7a7fc640 1 client.6248.objecter ms_handle_reset 0x55a296e6be40 session 0x55a296e67950 osd.4 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:25:05.194+0000 7f1c7a7fc640 10 monclient: _renew_subs 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:25:05.194+0000 7f1c7a7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:25:05.194+0000 7f1da4301640 10 monclient: get_auth_request con 0x7f1c70086c80 auth_method 0 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:25:05.195+0000 7f1da5303640 10 monclient: get_auth_request con 0x7f1d9803ab70 auth_method 0 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:25:05.197+0000 7f1da4b02640 10 monclient: get_auth_request con 0x7f1d980398b0 auth_method 0 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:25:05.197+0000 7f1da4b02640 0 -- 172.21.15.33:0/2437380464 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f1d980398b0 msgr2=0x7f1d9801c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:25:05.398+0000 7f1da4b02640 10 monclient: get_auth_request con 0x7f1d980398b0 auth_method 0 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:05.577 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:25:05.403+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 zone default found 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:25:05.404+0000 7f1da8f20800 4 Realm: () 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:25:05.404+0000 7f1da8f20800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:25:05.404+0000 7f1da8f20800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:05.578 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:25:05.404+0000 7f1da8f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 zonegroup default 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:25:05.404+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:25:05.405+0000 7f1da8f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:25:05.405+0000 7f1da8f20800 20 started sync module instance, tier type = 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:25:05.405+0000 7f1da8f20800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=0 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=1 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=2 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=3 2024-09-12T00:25:05.579 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=4 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=5 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:25:05.414+0000 7f1da8f20800 20 add_watcher() i=6 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:25:05.415+0000 7f1da8f20800 20 add_watcher() i=7 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:25:05.415+0000 7f1da8f20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding auth protocol: cephx 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding auth protocol: cephx 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding auth protocol: cephx 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:25:05.416+0000 7f1c5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.580 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: crc 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:25:05.416+0000 7f1da8f20800 5 AuthRegistry(0x7ffd619f81f0) adding con mode: secure 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:25:05.417+0000 7f1da8f20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cache list hook 0x55a296e413c0 2024-09-12T00:25:05.581 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cache inspect hook 0x55a296e413c0 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cache erase hook 0x55a296e413c0 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command cache zap hook 0x55a296e413c0 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 note: GC not initialized 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:25:05.417+0000 7f1c5a7e4640 20 reqs_thread_entry: start 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command sync trace show hook 0x7f1d9407a070 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command sync trace history hook 0x7f1d9407a070 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command sync trace active hook 0x7f1d9407a070 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:25:05.417+0000 7f1da8f20800 5 asok(0x55a296b58630) register_command sync trace active_short hook 0x7f1d9407a070 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 Filter name: none 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:25:05.417+0000 7f1c53fff640 20 reqs_thread_entry: start 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:25:05.417+0000 7f1da8f20800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:25:05.582 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:25:05.417+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 : miss 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:25:05.418+0000 7f1da8f20800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:25:05.418+0000 7f1da8f20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:25:05.423+0000 7f1da8f20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1da8f20800 time 2024-09-12T00:25:05.423712+0000 2024-09-12T00:25:05.583 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1daa58c71a] 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1daa58c8d8] 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a295365641] 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd878e8) [0x55a2958778e8] 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29537531d] 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1da9229590] 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:25:05.424+0000 7f1da8f20800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:25:05.584 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f1da8f20800 thread_name:radosgw-admin 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1da923e6f0] 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1da928b99c] 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1daa58c774] 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1daa58c8d8] 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a295365641] 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd878e8) [0x55a2958778e8] 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a29537531d] 2024-09-12T00:25:05.585 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1da9229590] 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:25:05.586 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:25:05.587 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:25:05.588 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:25:05.589 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:25:05.590 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:25:05.591 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:25:05.592 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c53fff640 / http_manager 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c5a7e4640 / http_manager 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c5b7e6640 / rgw_dt_lg_renew 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c7a7fc640 / ms_dispatch 2024-09-12T00:25:05.593 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c7bfff640 / io_context_pool 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c8a7fc640 / ms_dispatch 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c9160a640 / ms_dispatch 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1c92e0d640 / io_context_pool 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da4301640 / msgr-worker-2 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da4b02640 / msgr-worker-1 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da5303640 / msgr-worker-0 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da5b04640 / io_context_pool 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: 7f1da8f20800 / radosgw-admin 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:25:05.425401Z_9525c139-6522-4029-8d4c-6562137cbf82/log 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:25:05.594 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.503+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.505+0000 7f5285346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.505+0000 7f5285346800 20 realm 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.505+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.505+0000 7f5285346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.505+0000 7f5285346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.505+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.505+0000 7f5285346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.505+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.506+0000 7f5285346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.506+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.507+0000 7f5285346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.507+0000 7f5285346800 20 searching for the correct realm 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.510+0000 7f5283631640 0 -- 172.21.15.33:0/479756866 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x55bea7a021a0 msgr2=0x55bea7a04630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.513+0000 7f528262f640 0 -- 172.21.15.33:0/479756866 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55bea7a09c70 msgr2=0x55bea7a0c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:05.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.517+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 zone default found 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 4 Realm: () 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 zonegroup default 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.518+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.519+0000 7f5285346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.519+0000 7f5285346800 20 started sync module instance, tier type = 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.519+0000 7f5285346800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.528+0000 7f5285346800 20 add_watcher() i=0 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.528+0000 7f5285346800 20 add_watcher() i=1 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.528+0000 7f5285346800 20 add_watcher() i=2 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.528+0000 7f5285346800 20 add_watcher() i=3 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.528+0000 7f5285346800 20 add_watcher() i=4 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.528+0000 7f5285346800 20 add_watcher() i=5 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.528+0000 7f5285346800 20 add_watcher() i=6 2024-09-12T00:25:05.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.529+0000 7f5285346800 20 add_watcher() i=7 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.529+0000 7f5285346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.531+0000 7f51397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.531+0000 7f5285346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.531+0000 7f5285346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.531+0000 7f5285346800 5 note: GC not initialized 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.531+0000 7f50b3fff640 20 reqs_thread_entry: start 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.531+0000 7f5285346800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.531+0000 7f5285346800 20 Filter name: none 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.532+0000 7f50b1ffb640 20 reqs_thread_entry: start 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.532+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.532+0000 7f5285346800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.532+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.532+0000 7f5285346800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.532+0000 7f5285346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.532+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.533+0000 7f5285346800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.533+0000 7f5285346800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.533+0000 7f5285346800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.533+0000 7f5285346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.535+0000 7f51397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.537+0000 7f5285346800 20 remove_watcher() i=0 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.537+0000 7f5285346800 2 removed watcher, disabling cache 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.538+0000 7f5285346800 20 remove_watcher() i=1 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.539+0000 7f5285346800 20 remove_watcher() i=2 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.540+0000 7f5285346800 20 remove_watcher() i=3 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.541+0000 7f5285346800 20 remove_watcher() i=4 2024-09-12T00:25:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.542+0000 7f5285346800 20 remove_watcher() i=5 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.543+0000 7f5285346800 20 remove_watcher() i=6 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.544+0000 7f5285346800 20 remove_watcher() i=7 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-set-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:05.606 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:05.645 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:25:05.678 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:05.678 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:05.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.719+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.721+0000 7f3dcd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.721+0000 7f3dcd525800 20 realm 2024-09-12T00:25:05.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.721+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.721+0000 7f3dcd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.721+0000 7f3dcd525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:05.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.721+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.721+0000 7f3dcd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.722+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.722+0000 7f3dcd525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.722+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.723+0000 7f3dcd525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:05.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.723+0000 7f3dcd525800 20 searching for the correct realm 2024-09-12T00:25:05.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.726+0000 7f3dc9133640 0 -- 172.21.15.33:0/3577056445 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f3dc4017020 msgr2=0x7f3dc40659f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:05.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.730+0000 7f3dc9133640 0 -- 172.21.15.33:0/3577056445 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f3dc009f960 msgr2=0x7f3dc009e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:05.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.936+0000 7f3dcd525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:05.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.936+0000 7f3dcd525800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:05.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.936+0000 7f3dcd525800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:05.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.936+0000 7f3dcd525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:05.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.936+0000 7f3dcd525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:05.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.936+0000 7f3dcd525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:05.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.936+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:05.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:05.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 20 zone default found 2024-09-12T00:25:05.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 4 Realm: () 2024-09-12T00:25:05.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 20 zonegroup default 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.937+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.938+0000 7f3dcd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.938+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.938+0000 7f3dcd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.938+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.938+0000 7f3dcd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.938+0000 7f3dcd525800 20 started sync module instance, tier type = 2024-09-12T00:25:05.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.938+0000 7f3dcd525800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:05.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.947+0000 7f3dcd525800 20 add_watcher() i=0 2024-09-12T00:25:05.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.947+0000 7f3dcd525800 20 add_watcher() i=1 2024-09-12T00:25:05.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.947+0000 7f3dcd525800 20 add_watcher() i=2 2024-09-12T00:25:05.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.947+0000 7f3dcd525800 20 add_watcher() i=3 2024-09-12T00:25:05.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.947+0000 7f3dcd525800 20 add_watcher() i=4 2024-09-12T00:25:05.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.947+0000 7f3dcd525800 20 add_watcher() i=5 2024-09-12T00:25:05.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.947+0000 7f3dcd525800 20 add_watcher() i=6 2024-09-12T00:25:05.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.948+0000 7f3dcd525800 20 add_watcher() i=7 2024-09-12T00:25:05.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.948+0000 7f3dcd525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:05.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.950+0000 7f3c7ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.950+0000 7f3dcd525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:05.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.950+0000 7f3dcd525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:05.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.950+0000 7f3dcd525800 5 note: GC not initialized 2024-09-12T00:25:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.950+0000 7f3c7efe5640 20 reqs_thread_entry: start 2024-09-12T00:25:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.950+0000 7f3dcd525800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3dcd525800 20 Filter name: none 2024-09-12T00:25:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3c7cfe1640 20 reqs_thread_entry: start 2024-09-12T00:25:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3dcd525800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:25:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3dcd525800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3dcd525800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:25:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3dcd525800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:25:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3dcd525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 : miss 2024-09-12T00:25:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.951+0000 7f3dcd525800 20 rados->read ofs=0 len=0 2024-09-12T00:25:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.952+0000 7f3dcd525800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.952+0000 7f3dcd525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:05.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.952+0000 7f3dcd525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:05.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.952+0000 7f3dcd525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:05.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.952+0000 7f3dcd525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:05.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.952+0000 7f3dcd525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 2024-09-12T00:25:05.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.953+0000 7f3dcd525800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to be held by another RGW process; skipping for now 2024-09-12T00:25:05.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.954+0000 7f3c7ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:05.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.956+0000 7f3dcd525800 20 remove_watcher() i=0 2024-09-12T00:25:05.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.956+0000 7f3dcd525800 2 removed watcher, disabling cache 2024-09-12T00:25:05.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.957+0000 7f3dcd525800 20 remove_watcher() i=1 2024-09-12T00:25:05.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.958+0000 7f3dcd525800 20 remove_watcher() i=2 2024-09-12T00:25:05.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.959+0000 7f3dcd525800 20 remove_watcher() i=3 2024-09-12T00:25:05.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.960+0000 7f3dcd525800 20 remove_watcher() i=4 2024-09-12T00:25:05.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.961+0000 7f3dcd525800 20 remove_watcher() i=5 2024-09-12T00:25:05.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.962+0000 7f3dcd525800 20 remove_watcher() i=6 2024-09-12T00:25:05.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:05.963+0000 7f3dcd525800 20 remove_watcher() i=7 2024-09-12T00:25:05.973 INFO:tasks.workunit.client.0.smithi033.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:25:35.988 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:25:36.027 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:36.027 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:36.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.073+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.074+0000 7fbe63946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.074+0000 7fbe63946800 20 realm 2024-09-12T00:25:36.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.074+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.075+0000 7fbe63946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.075+0000 7fbe63946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:36.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.075+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.075+0000 7fbe63946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.075+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.076+0000 7fbe63946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:36.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.076+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.077+0000 7fbe63946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:36.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.077+0000 7fbe63946800 20 searching for the correct realm 2024-09-12T00:25:36.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.080+0000 7fbe61437640 0 -- 172.21.15.33:0/3086220201 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fbe5c0a8fa0 msgr2=0x7fbe5c0a7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:36.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.084+0000 7fbe61437640 0 -- 172.21.15.33:0/3086220201 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fbe5806fcf0 msgr2=0x7fbe5806ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:36.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:36.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:36.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:36.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:36.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:36.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:36.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.291+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:36.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:36.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 20 zone default found 2024-09-12T00:25:36.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 4 Realm: () 2024-09-12T00:25:36.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:36.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:36.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:36.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 20 zonegroup default 2024-09-12T00:25:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.292+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.293+0000 7fbe63946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.293+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.293+0000 7fbe63946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.293+0000 7fbe63946800 20 started sync module instance, tier type = 2024-09-12T00:25:36.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.293+0000 7fbe63946800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:36.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.304+0000 7fbe63946800 20 add_watcher() i=0 2024-09-12T00:25:36.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.304+0000 7fbe63946800 20 add_watcher() i=1 2024-09-12T00:25:36.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.304+0000 7fbe63946800 20 add_watcher() i=2 2024-09-12T00:25:36.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.304+0000 7fbe63946800 20 add_watcher() i=3 2024-09-12T00:25:36.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.304+0000 7fbe63946800 20 add_watcher() i=4 2024-09-12T00:25:36.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.304+0000 7fbe63946800 20 add_watcher() i=5 2024-09-12T00:25:36.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.304+0000 7fbe63946800 20 add_watcher() i=6 2024-09-12T00:25:36.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.305+0000 7fbe63946800 20 add_watcher() i=7 2024-09-12T00:25:36.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.305+0000 7fbe63946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:36.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.307+0000 7fbd17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:36.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.307+0000 7fbe63946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.307+0000 7fbe63946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.307+0000 7fbe63946800 5 note: GC not initialized 2024-09-12T00:25:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbd16fe5640 20 reqs_thread_entry: start 2024-09-12T00:25:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 20 Filter name: none 2024-09-12T00:25:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbd14fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:25:36.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:36.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:25:36.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:25:36.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 : miss 2024-09-12T00:25:36.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.308+0000 7fbe63946800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.309+0000 7fbe63946800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:36.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.309+0000 7fbe63946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:36.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.309+0000 7fbe63946800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:36.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.309+0000 7fbe63946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:36.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.309+0000 7fbe63946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:36.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.309+0000 7fbe63946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 2024-09-12T00:25:36.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.315+0000 7fbe63946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:36.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.315+0000 7fbe63946800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:36.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.315+0000 7fbe63946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:36.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.315+0000 7fbe63946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25, ofs0, ns] 2024-09-12T00:25:36.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.315+0000 7fbd44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366230 cookie 94292131500800 notifier 6296 bl.length()=1009 2024-09-12T00:25:36.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.315+0000 7fbd44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:36.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.315+0000 7fbd44ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:36.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.315+0000 7fbd44ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:36.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.317+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): orig_sources= new_sources= 2024-09-12T00:25:36.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.317+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): potential sources added=[] removed=[] 2024-09-12T00:25:36.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.317+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): orig_dests= new_dests= 2024-09-12T00:25:36.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.317+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): potential dests added=[] removed=[] 2024-09-12T00:25:36.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.0 2024-09-12T00:25:36.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.0 2024-09-12T00:25:36.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.1 2024-09-12T00:25:36.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.1 2024-09-12T00:25:36.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.2 2024-09-12T00:25:36.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.2 2024-09-12T00:25:36.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.3 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.3 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.4 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.4 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.5 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.5 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.6 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.6 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.7 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.7 2024-09-12T00:25:36.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.8 2024-09-12T00:25:36.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.8 2024-09-12T00:25:36.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.9 2024-09-12T00:25:36.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.9 2024-09-12T00:25:36.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.10 2024-09-12T00:25:36.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.10 2024-09-12T00:25:36.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.11 2024-09-12T00:25:36.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1.11 2024-09-12T00:25:36.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.322+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.0 2024-09-12T00:25:36.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.323+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1 2024-09-12T00:25:36.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.323+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.2 2024-09-12T00:25:36.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.324+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.3 2024-09-12T00:25:36.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.324+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.4 2024-09-12T00:25:36.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.325+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.5 2024-09-12T00:25:36.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.326+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.6 2024-09-12T00:25:36.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.327+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.7 2024-09-12T00:25:36.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.327+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.8 2024-09-12T00:25:36.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.328+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.9 2024-09-12T00:25:36.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.328+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.10 2024-09-12T00:25:36.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.332+0000 7fbe63946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:36.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.332+0000 7fbe63946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 2024-09-12T00:25:36.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.333+0000 7fbe63946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:36.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.333+0000 7fbe63946800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:36.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.333+0000 7fbe63946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:36.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.333+0000 7fbe63946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25, ofs0, ns] 2024-09-12T00:25:36.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.334+0000 7fbd33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366231 cookie 94292131500800 notifier 6296 bl.length()=1009 2024-09-12T00:25:36.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.334+0000 7fbd33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:36.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.334+0000 7fbd33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:36.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.334+0000 7fbd33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:36.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.336+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): orig_sources= new_sources= 2024-09-12T00:25:36.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.336+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): potential sources added=[] removed=[] 2024-09-12T00:25:36.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.336+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): orig_dests= new_dests= 2024-09-12T00:25:36.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.336+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): potential dests added=[] removed=[] 2024-09-12T00:25:36.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.338+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.0 2024-09-12T00:25:36.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.339+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.1 2024-09-12T00:25:36.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.339+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.2 2024-09-12T00:25:36.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.339+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.3 2024-09-12T00:25:36.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.339+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.4 2024-09-12T00:25:36.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.340+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.5 2024-09-12T00:25:36.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.340+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.6 2024-09-12T00:25:36.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.341+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.7 2024-09-12T00:25:36.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.341+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.8 2024-09-12T00:25:36.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.341+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.9 2024-09-12T00:25:36.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.342+0000 7fbe63946800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25.10 2024-09-12T00:25:36.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.342+0000 7fbe63946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:36.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.342+0000 7fbe63946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 2024-09-12T00:25:36.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.343+0000 7fbe63946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:36.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.343+0000 7fbe63946800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:36.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.343+0000 7fbe63946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:36.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.343+0000 7fbe63946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25, ofs0, ns] 2024-09-12T00:25:36.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.344+0000 7fbd33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366232 cookie 94292131500800 notifier 6296 bl.length()=977 2024-09-12T00:25:36.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.344+0000 7fbd33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 info.flags=0x17 2024-09-12T00:25:36.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.344+0000 7fbd33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 to cache LRU end 2024-09-12T00:25:36.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.344+0000 7fbd33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:36.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.345+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): orig_sources= new_sources= 2024-09-12T00:25:36.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.345+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): potential sources added=[] removed=[] 2024-09-12T00:25:36.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.345+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): orig_dests= new_dests= 2024-09-12T00:25:36.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.345+0000 7fbe63946800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25]): potential dests added=[] removed=[] 2024-09-12T00:25:36.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.350+0000 7fbe63946800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:25:36.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.352+0000 7fbd17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:36.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.354+0000 7fbe63946800 20 remove_watcher() i=0 2024-09-12T00:25:36.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.354+0000 7fbe63946800 2 removed watcher, disabling cache 2024-09-12T00:25:36.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.356+0000 7fbe63946800 20 remove_watcher() i=1 2024-09-12T00:25:36.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.357+0000 7fbe63946800 20 remove_watcher() i=2 2024-09-12T00:25:36.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.358+0000 7fbe63946800 20 remove_watcher() i=3 2024-09-12T00:25:36.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.359+0000 7fbe63946800 20 remove_watcher() i=4 2024-09-12T00:25:36.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.360+0000 7fbe63946800 20 remove_watcher() i=5 2024-09-12T00:25:36.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.361+0000 7fbe63946800 20 remove_watcher() i=6 2024-09-12T00:25:36.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.362+0000 7fbe63946800 20 remove_watcher() i=7 2024-09-12T00:25:36.375 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:25:36.405 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:36.405 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:36.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.445+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.447+0000 7ff002335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.447+0000 7ff002335800 20 realm 2024-09-12T00:25:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.447+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.447+0000 7ff002335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.447+0000 7ff002335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.447+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.447+0000 7ff002335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.447+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.448+0000 7ff002335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:36.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.448+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.449+0000 7ff002335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:36.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.449+0000 7ff002335800 20 searching for the correct realm 2024-09-12T00:25:36.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.452+0000 7feffd8e3640 0 -- 172.21.15.33:0/3481495468 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5583129f2fa0 msgr2=0x5583129f5390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:36.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.456+0000 7feffd8e3640 0 -- 172.21.15.33:0/3481495468 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x7feec8086c20 msgr2=0x7feec8089050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.460+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 zone default found 2024-09-12T00:25:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 4 Realm: () 2024-09-12T00:25:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:36.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 zonegroup default 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.461+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.462+0000 7ff002335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.462+0000 7ff002335800 20 started sync module instance, tier type = 2024-09-12T00:25:36.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.462+0000 7ff002335800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:36.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.471+0000 7ff002335800 20 add_watcher() i=0 2024-09-12T00:25:36.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.471+0000 7ff002335800 20 add_watcher() i=1 2024-09-12T00:25:36.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.471+0000 7ff002335800 20 add_watcher() i=2 2024-09-12T00:25:36.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.471+0000 7ff002335800 20 add_watcher() i=3 2024-09-12T00:25:36.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.471+0000 7ff002335800 20 add_watcher() i=4 2024-09-12T00:25:36.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.471+0000 7ff002335800 20 add_watcher() i=5 2024-09-12T00:25:36.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.471+0000 7ff002335800 20 add_watcher() i=6 2024-09-12T00:25:36.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.472+0000 7ff002335800 20 add_watcher() i=7 2024-09-12T00:25:36.471 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.472+0000 7ff002335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:36.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.473+0000 7feeb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:36.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.474+0000 7ff002335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:36.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.474+0000 7ff002335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:36.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.474+0000 7ff002335800 5 note: GC not initialized 2024-09-12T00:25:36.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.474+0000 7fee2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:36.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.474+0000 7ff002335800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:36.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.474+0000 7ff002335800 20 Filter name: none 2024-09-12T00:25:36.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.474+0000 7fee2d7fa640 20 reqs_thread_entry: start 2024-09-12T00:25:36.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.474+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.475+0000 7ff002335800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:36.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.475+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.475+0000 7ff002335800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.475+0000 7ff002335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.475+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.476+0000 7ff002335800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:25:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.476+0000 7ff002335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.476+0000 7ff002335800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:25:36.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.476+0000 7ff002335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:36.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.478+0000 7feeb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:36.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.480+0000 7ff002335800 20 remove_watcher() i=0 2024-09-12T00:25:36.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.480+0000 7ff002335800 2 removed watcher, disabling cache 2024-09-12T00:25:36.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.481+0000 7ff002335800 20 remove_watcher() i=1 2024-09-12T00:25:36.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.482+0000 7ff002335800 20 remove_watcher() i=2 2024-09-12T00:25:36.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.483+0000 7ff002335800 20 remove_watcher() i=3 2024-09-12T00:25:36.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.484+0000 7ff002335800 20 remove_watcher() i=4 2024-09-12T00:25:36.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.485+0000 7ff002335800 20 remove_watcher() i=5 2024-09-12T00:25:36.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.486+0000 7ff002335800 20 remove_watcher() i=6 2024-09-12T00:25:36.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:36.487+0000 7ff002335800 20 remove_watcher() i=7 2024-09-12T00:25:36.498 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:36.498 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:36.498 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-set-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:25:36.498 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:36.500 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:36.501 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:36.519 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:36.519 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:36.706 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:36.707 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:36.842 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:25:36.842 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:36.843 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:36.843 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:36.891 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:36.891 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:36.948 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:36.949 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:36.985 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:36.985 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.020 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.020 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.054 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.055 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.089 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.090 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.124 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.124 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.158 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.158 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.193 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.193 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.227 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.227 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.263 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.264 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.298 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.298 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.333 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.333 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.367 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.367 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.402 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.402 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.436 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.436 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.506 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.506 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.540 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.540 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.574 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.574 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.608 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.608 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.642 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:37.642 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:37.677 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:25:37.706 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:37.706 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:37.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.745+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.747+0000 7fb9cf325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.747+0000 7fb9cf325800 20 realm 2024-09-12T00:25:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.747+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.748+0000 7fb9cf325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:37.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.748+0000 7fb9cf325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:37.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.748+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.748+0000 7fb9cf325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:37.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.748+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.749+0000 7fb9cf325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:37.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.749+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.749+0000 7fb9cf325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:37.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.750+0000 7fb9cf325800 20 searching for the correct realm 2024-09-12T00:25:37.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.752+0000 7fb9cafb5640 0 -- 172.21.15.33:0/3740619088 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fb9c4025040 msgr2=0x7fb9c4014980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:37.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.756+0000 7fb9cafb5640 0 -- 172.21.15.33:0/3740619088 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fb9c0018070 msgr2=0x7fb9c005fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:37.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.962+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 20 zone default found 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 4 Realm: () 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 20 zonegroup default 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:37.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:37.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.963+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.964+0000 7fb9cf325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:37.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.964+0000 7fb9cf325800 20 started sync module instance, tier type = 2024-09-12T00:25:37.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.964+0000 7fb9cf325800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:37.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.973+0000 7fb9cf325800 20 add_watcher() i=0 2024-09-12T00:25:37.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.973+0000 7fb9cf325800 20 add_watcher() i=1 2024-09-12T00:25:37.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.973+0000 7fb9cf325800 20 add_watcher() i=2 2024-09-12T00:25:37.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.973+0000 7fb9cf325800 20 add_watcher() i=3 2024-09-12T00:25:37.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.973+0000 7fb9cf325800 20 add_watcher() i=4 2024-09-12T00:25:37.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.973+0000 7fb9cf325800 20 add_watcher() i=5 2024-09-12T00:25:37.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.973+0000 7fb9cf325800 20 add_watcher() i=6 2024-09-12T00:25:37.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.974+0000 7fb9cf325800 20 add_watcher() i=7 2024-09-12T00:25:37.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.974+0000 7fb9cf325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:37.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.975+0000 7fb8817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:37.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.976+0000 7fb9cf325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:37.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.976+0000 7fb9cf325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:37.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.976+0000 7fb9cf325800 5 note: GC not initialized 2024-09-12T00:25:37.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.976+0000 7fb7fbfff640 20 reqs_thread_entry: start 2024-09-12T00:25:37.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.976+0000 7fb9cf325800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:37.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.976+0000 7fb9cf325800 20 Filter name: none 2024-09-12T00:25:37.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.976+0000 7fb7f9ffb640 20 reqs_thread_entry: start 2024-09-12T00:25:37.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.976+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.977+0000 7fb9cf325800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:37.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.977+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.978+0000 7fb9cf325800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:37.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.978+0000 7fb9cf325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:37.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.978+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.979+0000 7fb9cf325800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:37.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.979+0000 7fb9cf325800 20 rados->read ofs=0 len=0 2024-09-12T00:25:37.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.979+0000 7fb9cf325800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:37.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.979+0000 7fb9cf325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:37.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.981+0000 7fb8817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:37.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.983+0000 7fb9cf325800 20 remove_watcher() i=0 2024-09-12T00:25:37.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.983+0000 7fb9cf325800 2 removed watcher, disabling cache 2024-09-12T00:25:37.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.984+0000 7fb9cf325800 20 remove_watcher() i=1 2024-09-12T00:25:37.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.985+0000 7fb9cf325800 20 remove_watcher() i=2 2024-09-12T00:25:37.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.986+0000 7fb9cf325800 20 remove_watcher() i=3 2024-09-12T00:25:37.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.987+0000 7fb9cf325800 20 remove_watcher() i=4 2024-09-12T00:25:37.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.988+0000 7fb9cf325800 20 remove_watcher() i=5 2024-09-12T00:25:37.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.989+0000 7fb9cf325800 20 remove_watcher() i=6 2024-09-12T00:25:37.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:37.990+0000 7fb9cf325800 20 remove_watcher() i=7 2024-09-12T00:25:38.001 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:38.001 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:38.001 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-trim-reshard-log-entries id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:38.001 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:38.002 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:25:38.037 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:38.038 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:38.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.078+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.080+0000 7f6a95335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.080+0000 7f6a95335800 20 realm 2024-09-12T00:25:38.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.080+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.080+0000 7f6a95335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.080+0000 7f6a95335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:38.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.080+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.080+0000 7f6a95335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.080+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.081+0000 7f6a95335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:38.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.081+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.082+0000 7f6a95335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:38.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.082+0000 7f6a95335800 20 searching for the correct realm 2024-09-12T00:25:38.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.083+0000 7f6a908e3640 0 -- 172.21.15.33:0/1404188390 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f6a84033040 msgr2=0x7f6a84068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:38.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.289+0000 7f6a910e4640 0 -- 172.21.15.33:0/1404188390 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f6a88044b00 msgr2=0x7f6a88054910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:38.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:38.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.496+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:38.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:38.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 20 zone default found 2024-09-12T00:25:38.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 4 Realm: () 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 20 zonegroup default 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.497+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.498+0000 7f6a95335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.498+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.498+0000 7f6a95335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.498+0000 7f6a95335800 20 started sync module instance, tier type = 2024-09-12T00:25:38.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.498+0000 7f6a95335800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:38.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.508+0000 7f6a95335800 20 add_watcher() i=0 2024-09-12T00:25:38.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.508+0000 7f6a95335800 20 add_watcher() i=1 2024-09-12T00:25:38.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.508+0000 7f6a95335800 20 add_watcher() i=2 2024-09-12T00:25:38.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.508+0000 7f6a95335800 20 add_watcher() i=3 2024-09-12T00:25:38.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.508+0000 7f6a95335800 20 add_watcher() i=4 2024-09-12T00:25:38.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.508+0000 7f6a95335800 20 add_watcher() i=5 2024-09-12T00:25:38.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.508+0000 7f6a95335800 20 add_watcher() i=6 2024-09-12T00:25:38.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.509+0000 7f6a95335800 20 add_watcher() i=7 2024-09-12T00:25:38.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.509+0000 7f6a95335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:38.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.510+0000 7f6947fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:38.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6a95335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:38.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6a95335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:38.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6a95335800 5 note: GC not initialized 2024-09-12T00:25:38.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6946fe5640 20 reqs_thread_entry: start 2024-09-12T00:25:38.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6a95335800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:38.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6a95335800 20 Filter name: none 2024-09-12T00:25:38.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6944fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:38.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6a95335800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:25:38.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.511+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.512+0000 7f6a95335800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:38.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.512+0000 7f6a95335800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.512+0000 7f6a95335800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.512+0000 7f6a95335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 : miss 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.512+0000 7f6a95335800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.513+0000 7f6a95335800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.513+0000 7f6a95335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.513+0000 7f6a95335800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.513+0000 7f6a95335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.513+0000 7f6a95335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:38.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.513+0000 7f6a95335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 2024-09-12T00:25:38.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.518+0000 7f6a95335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:38.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.518+0000 7f6a95335800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:38.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.518+0000 7f6a95335800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:38.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.518+0000 7f6a95335800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26, ofs0, ns] 2024-09-12T00:25:38.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.518+0000 7f6963fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 93888637004128 notifier 6344 bl.length()=1023 2024-09-12T00:25:38.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.518+0000 7f6963fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:38.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.518+0000 7f6963fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:38.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.518+0000 7f6963fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:38.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.520+0000 7f6a95335800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): orig_sources= new_sources= 2024-09-12T00:25:38.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.520+0000 7f6a95335800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): potential sources added=[] removed=[] 2024-09-12T00:25:38.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.520+0000 7f6a95335800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): orig_dests= new_dests= 2024-09-12T00:25:38.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.520+0000 7f6a95335800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): potential dests added=[] removed=[] 2024-09-12T00:25:38.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.520+0000 7f6a95335800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:25:38.520 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.520+0000 7f6a95335800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:25:38.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.522+0000 7f6947fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:38.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.524+0000 7f6a95335800 20 remove_watcher() i=0 2024-09-12T00:25:38.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.524+0000 7f6a95335800 2 removed watcher, disabling cache 2024-09-12T00:25:38.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.525+0000 7f6a95335800 20 remove_watcher() i=1 2024-09-12T00:25:38.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.526+0000 7f6a95335800 20 remove_watcher() i=2 2024-09-12T00:25:38.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.527+0000 7f6a95335800 20 remove_watcher() i=3 2024-09-12T00:25:38.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.528+0000 7f6a95335800 20 remove_watcher() i=4 2024-09-12T00:25:38.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.529+0000 7f6a95335800 20 remove_watcher() i=5 2024-09-12T00:25:38.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.530+0000 7f6a95335800 20 remove_watcher() i=6 2024-09-12T00:25:38.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.531+0000 7f6a95335800 20 remove_watcher() i=7 2024-09-12T00:25:38.543 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:25:38.572 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:38.572 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:38.613 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.613+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.615+0000 7f20a252e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.615+0000 7f20a252e800 20 realm 2024-09-12T00:25:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.615+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.615+0000 7f20a252e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.615+0000 7f20a252e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.615+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.615+0000 7f20a252e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.615 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.615+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.616+0000 7f20a252e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:38.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.616+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.616 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.617+0000 7f20a252e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:38.617 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.617+0000 7f20a252e800 20 searching for the correct realm 2024-09-12T00:25:38.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.618+0000 7f209e2dd640 0 -- 172.21.15.33:0/4068701885 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f2098032440 msgr2=0x7f2098032880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:38.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.824+0000 7f209dadc640 0 -- 172.21.15.33:0/4068701885 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f20900c6c20 msgr2=0x7f20900b3490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:38.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.830+0000 7f20a252e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:38.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.830+0000 7f20a252e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:38.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.830+0000 7f20a252e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:38.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.830+0000 7f20a252e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:38.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.830+0000 7f20a252e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:38.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.830+0000 7f20a252e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:38.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.830+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:38.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:38.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 20 zone default found 2024-09-12T00:25:38.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 4 Realm: () 2024-09-12T00:25:38.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 20 zonegroup default 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.831+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.832+0000 7f20a252e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.832+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.832+0000 7f20a252e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.832+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.832+0000 7f20a252e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.832+0000 7f20a252e800 20 started sync module instance, tier type = 2024-09-12T00:25:38.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.832+0000 7f20a252e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:38.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.842+0000 7f20a252e800 20 add_watcher() i=0 2024-09-12T00:25:38.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.842+0000 7f20a252e800 20 add_watcher() i=1 2024-09-12T00:25:38.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.842+0000 7f20a252e800 20 add_watcher() i=2 2024-09-12T00:25:38.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.842+0000 7f20a252e800 20 add_watcher() i=3 2024-09-12T00:25:38.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.842+0000 7f20a252e800 20 add_watcher() i=4 2024-09-12T00:25:38.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.842+0000 7f20a252e800 20 add_watcher() i=5 2024-09-12T00:25:38.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.842+0000 7f20a252e800 20 add_watcher() i=6 2024-09-12T00:25:38.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.843+0000 7f20a252e800 20 add_watcher() i=7 2024-09-12T00:25:38.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.843+0000 7f20a252e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:38.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.845+0000 7f1f54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:38.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.845+0000 7f20a252e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:38.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.845+0000 7f20a252e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.845+0000 7f20a252e800 5 note: GC not initialized 2024-09-12T00:25:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.846+0000 7f1ecf7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.846+0000 7f20a252e800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.846+0000 7f20a252e800 20 Filter name: none 2024-09-12T00:25:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.846+0000 7f1ecd7fa640 20 reqs_thread_entry: start 2024-09-12T00:25:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.846+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.846+0000 7f20a252e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:38.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.846+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.847+0000 7f20a252e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:25:38.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.847+0000 7f20a252e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:38.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.847+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.848+0000 7f20a252e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:38.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.848+0000 7f20a252e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:38.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.848+0000 7f20a252e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:25:38.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.848+0000 7f20a252e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:38.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.850+0000 7f1f54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:38.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.852+0000 7f20a252e800 20 remove_watcher() i=0 2024-09-12T00:25:38.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.852+0000 7f20a252e800 2 removed watcher, disabling cache 2024-09-12T00:25:38.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.853+0000 7f20a252e800 20 remove_watcher() i=1 2024-09-12T00:25:38.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.854+0000 7f20a252e800 20 remove_watcher() i=2 2024-09-12T00:25:38.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.855+0000 7f20a252e800 20 remove_watcher() i=3 2024-09-12T00:25:38.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.856+0000 7f20a252e800 20 remove_watcher() i=4 2024-09-12T00:25:38.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.857+0000 7f20a252e800 20 remove_watcher() i=5 2024-09-12T00:25:38.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.858+0000 7f20a252e800 20 remove_watcher() i=6 2024-09-12T00:25:38.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:38.859+0000 7f20a252e800 20 remove_watcher() i=7 2024-09-12T00:25:38.869 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:38.870 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:38.870 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-trim-reshard-log-entries id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:38.870 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:38.872 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:38.872 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:38.903 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:38.903 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:38.961 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:25:38.993 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:38.993 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:39.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.032+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.034+0000 7f49ce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.034+0000 7f49ce4bb800 20 realm 2024-09-12T00:25:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.034+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.034+0000 7f49ce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.034+0000 7f49ce4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.034+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.034+0000 7f49ce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.034+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.035+0000 7f49ce4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:39.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.035+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.036+0000 7f49ce4bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.036+0000 7f49ce4bb800 20 searching for the correct realm 2024-09-12T00:25:39.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.039+0000 7f49cc7a6640 0 -- 172.21.15.33:0/958811572 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55f5d5b99340 msgr2=0x55f5d5b9b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:39.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.043+0000 7f49cbfa5640 0 -- 172.21.15.33:0/958811572 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f49c00c1100 msgr2=0x7f49c0093c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:39.049 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.048+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:39.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 20 zone default found 2024-09-12T00:25:39.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 4 Realm: () 2024-09-12T00:25:39.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:39.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:39.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 20 zonegroup default 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.049+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.050+0000 7f49ce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.050+0000 7f49ce4bb800 20 started sync module instance, tier type = 2024-09-12T00:25:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.050+0000 7f49ce4bb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:39.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.059+0000 7f49ce4bb800 20 add_watcher() i=0 2024-09-12T00:25:39.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.059+0000 7f49ce4bb800 20 add_watcher() i=1 2024-09-12T00:25:39.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.059+0000 7f49ce4bb800 20 add_watcher() i=2 2024-09-12T00:25:39.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.059+0000 7f49ce4bb800 20 add_watcher() i=3 2024-09-12T00:25:39.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.059+0000 7f49ce4bb800 20 add_watcher() i=4 2024-09-12T00:25:39.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.059+0000 7f49ce4bb800 20 add_watcher() i=5 2024-09-12T00:25:39.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.059+0000 7f49ce4bb800 20 add_watcher() i=6 2024-09-12T00:25:39.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.060+0000 7f49ce4bb800 20 add_watcher() i=7 2024-09-12T00:25:39.060 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.060+0000 7f49ce4bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:39.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.062+0000 7f4881fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:39.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f49ce4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f49ce4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f49ce4bb800 5 note: GC not initialized 2024-09-12T00:25:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f4880fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f49ce4bb800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f49ce4bb800 20 Filter name: none 2024-09-12T00:25:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f47fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f49ce4bb800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:25:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.063+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:39.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:25:39.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:25:39.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 : miss 2024-09-12T00:25:39.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:25:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.064+0000 7f49ce4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 2024-09-12T00:25:39.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.066+0000 7f49ce4bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:25:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.072+0000 7f49ce4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.072+0000 7f49ce4bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.072+0000 7f49ce4bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.072+0000 7f49ce4bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26, ofs0, ns] 2024-09-12T00:25:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.072+0000 7f48aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94514341079984 notifier 6753 bl.length()=1023 2024-09-12T00:25:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.072+0000 7f48aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.072+0000 7f48aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.072+0000 7f48aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:39.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.074+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): orig_sources= new_sources= 2024-09-12T00:25:39.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.074+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): potential sources added=[] removed=[] 2024-09-12T00:25:39.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.074+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): orig_dests= new_dests= 2024-09-12T00:25:39.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.074+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): potential dests added=[] removed=[] 2024-09-12T00:25:39.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.0 2024-09-12T00:25:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.0 2024-09-12T00:25:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.1 2024-09-12T00:25:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.1 2024-09-12T00:25:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.2 2024-09-12T00:25:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.2 2024-09-12T00:25:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.3 2024-09-12T00:25:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.3 2024-09-12T00:25:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.4 2024-09-12T00:25:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.4 2024-09-12T00:25:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.5 2024-09-12T00:25:39.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.5 2024-09-12T00:25:39.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.6 2024-09-12T00:25:39.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.6 2024-09-12T00:25:39.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.7 2024-09-12T00:25:39.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.7 2024-09-12T00:25:39.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.8 2024-09-12T00:25:39.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.8 2024-09-12T00:25:39.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.9 2024-09-12T00:25:39.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.9 2024-09-12T00:25:39.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.10 2024-09-12T00:25:39.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.10 2024-09-12T00:25:39.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.11 2024-09-12T00:25:39.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2.11 2024-09-12T00:25:39.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.0 2024-09-12T00:25:39.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.079+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.1 2024-09-12T00:25:39.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.080+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2 2024-09-12T00:25:39.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.080+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.3 2024-09-12T00:25:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.081+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.4 2024-09-12T00:25:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.082+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.5 2024-09-12T00:25:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.082+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.6 2024-09-12T00:25:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.083+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.7 2024-09-12T00:25:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.083+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.8 2024-09-12T00:25:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.084+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.9 2024-09-12T00:25:39.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.085+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.10 2024-09-12T00:25:39.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.090+0000 7f49ce4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:39.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.090+0000 7f49ce4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 2024-09-12T00:25:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.092+0000 7f49ce4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.092+0000 7f49ce4bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.092+0000 7f49ce4bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.092+0000 7f49ce4bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26, ofs0, ns] 2024-09-12T00:25:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.093+0000 7f48aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94514341079984 notifier 6753 bl.length()=1023 2024-09-12T00:25:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.093+0000 7f48aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:39.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.093+0000 7f48aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:39.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.093+0000 7f48aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:39.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.094+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): orig_sources= new_sources= 2024-09-12T00:25:39.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.094+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): potential sources added=[] removed=[] 2024-09-12T00:25:39.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.094+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): orig_dests= new_dests= 2024-09-12T00:25:39.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.094+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): potential dests added=[] removed=[] 2024-09-12T00:25:39.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.096+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.0 2024-09-12T00:25:39.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.097+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.1 2024-09-12T00:25:39.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.097+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.2 2024-09-12T00:25:39.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.098+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.3 2024-09-12T00:25:39.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.098+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.4 2024-09-12T00:25:39.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.098+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.5 2024-09-12T00:25:39.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.099+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.6 2024-09-12T00:25:39.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.099+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.7 2024-09-12T00:25:39.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.099+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.8 2024-09-12T00:25:39.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.100+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.9 2024-09-12T00:25:39.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.100+0000 7f49ce4bb800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26.10 2024-09-12T00:25:39.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.101+0000 7f49ce4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:39.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.101+0000 7f49ce4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 2024-09-12T00:25:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.102+0000 7f49ce4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.102+0000 7f49ce4bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.102+0000 7f49ce4bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.102+0000 7f49ce4bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26, ofs0, ns] 2024-09-12T00:25:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.102+0000 7f48aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94514341079984 notifier 6753 bl.length()=991 2024-09-12T00:25:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.102+0000 7f48aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 info.flags=0x17 2024-09-12T00:25:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.102+0000 7f48aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 to cache LRU end 2024-09-12T00:25:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.102+0000 7f48aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:39.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.104+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): orig_sources= new_sources= 2024-09-12T00:25:39.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.104+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): potential sources added=[] removed=[] 2024-09-12T00:25:39.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.104+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): orig_dests= new_dests= 2024-09-12T00:25:39.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.104+0000 7f49ce4bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26]): potential dests added=[] removed=[] 2024-09-12T00:25:39.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.106+0000 7f49ce4bb800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:25:39.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.108+0000 7f4881fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:39.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.111+0000 7f49ce4bb800 20 remove_watcher() i=0 2024-09-12T00:25:39.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.111+0000 7f49ce4bb800 2 removed watcher, disabling cache 2024-09-12T00:25:39.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.112+0000 7f49ce4bb800 20 remove_watcher() i=1 2024-09-12T00:25:39.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.113+0000 7f49ce4bb800 20 remove_watcher() i=2 2024-09-12T00:25:39.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.114+0000 7f49ce4bb800 20 remove_watcher() i=3 2024-09-12T00:25:39.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.115+0000 7f49ce4bb800 20 remove_watcher() i=4 2024-09-12T00:25:39.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.116+0000 7f49ce4bb800 20 remove_watcher() i=5 2024-09-12T00:25:39.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.117+0000 7f49ce4bb800 20 remove_watcher() i=6 2024-09-12T00:25:39.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.118+0000 7f49ce4bb800 20 remove_watcher() i=7 2024-09-12T00:25:39.131 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:25:39.160 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:39.160 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:39.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.200+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.202+0000 7fe66a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.202+0000 7fe66a336800 20 realm 2024-09-12T00:25:39.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.202+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.202+0000 7fe66a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.202+0000 7fe66a336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:39.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.202+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.202+0000 7fe66a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.202+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.203+0000 7fe66a336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:39.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.203+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.204+0000 7fe66a336800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:39.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.204+0000 7fe66a336800 20 searching for the correct realm 2024-09-12T00:25:39.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.207+0000 7fe6668b8640 0 -- 172.21.15.33:0/3332655853 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55ef3dd9db50 msgr2=0x55ef3dd9ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:39.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.210+0000 7fe6660b7640 0 -- 172.21.15.33:0/3332655853 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fe65c075920 msgr2=0x7fe65c09d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:39.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:39.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:39.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:39.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:39.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:39.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:39.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 zone default found 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 4 Realm: () 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 zonegroup default 2024-09-12T00:25:39.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.215+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.216+0000 7fe66a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.216+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.216+0000 7fe66a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.216+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.216+0000 7fe66a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:39.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.216+0000 7fe66a336800 20 started sync module instance, tier type = 2024-09-12T00:25:39.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.216+0000 7fe66a336800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:39.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.226+0000 7fe66a336800 20 add_watcher() i=0 2024-09-12T00:25:39.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.226+0000 7fe66a336800 20 add_watcher() i=1 2024-09-12T00:25:39.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.226+0000 7fe66a336800 20 add_watcher() i=2 2024-09-12T00:25:39.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.226+0000 7fe66a336800 20 add_watcher() i=3 2024-09-12T00:25:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.226+0000 7fe66a336800 20 add_watcher() i=4 2024-09-12T00:25:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.226+0000 7fe66a336800 20 add_watcher() i=5 2024-09-12T00:25:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.226+0000 7fe66a336800 20 add_watcher() i=6 2024-09-12T00:25:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.227+0000 7fe66a336800 20 add_watcher() i=7 2024-09-12T00:25:39.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.227+0000 7fe66a336800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:39.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.228+0000 7fe51cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.229+0000 7fe66a336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.229+0000 7fe66a336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.229+0000 7fe66a336800 5 note: GC not initialized 2024-09-12T00:25:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.229+0000 7fe4977fe640 20 reqs_thread_entry: start 2024-09-12T00:25:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.229+0000 7fe66a336800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.229+0000 7fe66a336800 20 Filter name: none 2024-09-12T00:25:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.229+0000 7fe4957fa640 20 reqs_thread_entry: start 2024-09-12T00:25:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.229+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.230+0000 7fe66a336800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:39.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.230+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.230+0000 7fe66a336800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.230+0000 7fe66a336800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.230+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.231+0000 7fe66a336800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.231+0000 7fe66a336800 20 rados->read ofs=0 len=0 2024-09-12T00:25:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.231+0000 7fe66a336800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.231+0000 7fe66a336800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:39.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.233+0000 7fe51cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:39.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.235+0000 7fe66a336800 20 remove_watcher() i=0 2024-09-12T00:25:39.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.235+0000 7fe66a336800 2 removed watcher, disabling cache 2024-09-12T00:25:39.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.236+0000 7fe66a336800 20 remove_watcher() i=1 2024-09-12T00:25:39.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.237+0000 7fe66a336800 20 remove_watcher() i=2 2024-09-12T00:25:39.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.238+0000 7fe66a336800 20 remove_watcher() i=3 2024-09-12T00:25:39.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.239+0000 7fe66a336800 20 remove_watcher() i=4 2024-09-12T00:25:39.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.240+0000 7fe66a336800 20 remove_watcher() i=5 2024-09-12T00:25:39.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.241+0000 7fe66a336800 20 remove_watcher() i=6 2024-09-12T00:25:39.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:39.242+0000 7fe66a336800 20 remove_watcher() i=7 2024-09-12T00:25:39.252 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:39.252 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:39.252 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-trim-reshard-log-entries id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:25:39.253 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:39.254 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.254 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.275 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.276 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.463 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.463 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.599 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:25:39.599 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:39.599 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.599 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.649 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.649 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.706 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.706 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.738 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.738 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.772 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.772 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.806 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.806 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.840 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.840 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.874 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.874 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.909 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.909 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.943 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.943 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:39.978 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:39.979 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.011 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.012 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.048 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.048 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.081 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.082 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.116 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.116 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.149 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.149 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.183 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.183 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.217 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.217 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.251 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.251 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.285 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.285 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.319 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.319 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.353 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:40.354 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:40.388 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:25:40.417 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:40.417 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:40.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.456+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.458+0000 7fa02dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.458+0000 7fa02dd46800 20 realm 2024-09-12T00:25:40.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.458+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.458+0000 7fa02dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.458+0000 7fa02dd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:40.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.458+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.458+0000 7fa02dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.458+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.459+0000 7fa02dd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:40.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.459+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.460+0000 7fa02dd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:40.459 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.460+0000 7fa02dd46800 20 searching for the correct realm 2024-09-12T00:25:40.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.463+0000 7fa02b837640 0 -- 172.21.15.33:0/435820714 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fa024033040 msgr2=0x7fa024025a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.466+0000 7fa02b837640 0 -- 172.21.15.33:0/435820714 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa014001c20 msgr2=0x7fa014086a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:40.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:40.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:40.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:40.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:40.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:40.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:40.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:40.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.673+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:40.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 20 zone default found 2024-09-12T00:25:40.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 4 Realm: () 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 20 zonegroup default 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.674+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.675+0000 7fa02dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.675+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.675+0000 7fa02dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.675+0000 7fa02dd46800 20 started sync module instance, tier type = 2024-09-12T00:25:40.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.675+0000 7fa02dd46800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:40.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.685+0000 7fa02dd46800 20 add_watcher() i=0 2024-09-12T00:25:40.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.685+0000 7fa02dd46800 20 add_watcher() i=1 2024-09-12T00:25:40.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.685+0000 7fa02dd46800 20 add_watcher() i=2 2024-09-12T00:25:40.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.685+0000 7fa02dd46800 20 add_watcher() i=3 2024-09-12T00:25:40.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.685+0000 7fa02dd46800 20 add_watcher() i=4 2024-09-12T00:25:40.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.685+0000 7fa02dd46800 20 add_watcher() i=5 2024-09-12T00:25:40.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.685+0000 7fa02dd46800 20 add_watcher() i=6 2024-09-12T00:25:40.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.686+0000 7fa02dd46800 20 add_watcher() i=7 2024-09-12T00:25:40.686 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.686+0000 7fa02dd46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:40.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.688+0000 7f9ee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:40.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.688+0000 7fa02dd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:40.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.688+0000 7fa02dd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:40.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.688+0000 7fa02dd46800 5 note: GC not initialized 2024-09-12T00:25:40.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.688+0000 7f9ee0fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:40.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.688+0000 7fa02dd46800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:40.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.688+0000 7fa02dd46800 20 Filter name: none 2024-09-12T00:25:40.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.689+0000 7f9e5a7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:40.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.689+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.689+0000 7fa02dd46800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:40.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.689+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.690+0000 7fa02dd46800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:40.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.690+0000 7fa02dd46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:40.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.690+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.690+0000 7fa02dd46800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:40.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.690+0000 7fa02dd46800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.690+0000 7fa02dd46800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:40.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.690+0000 7fa02dd46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:40.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.692+0000 7f9ee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:40.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.694+0000 7fa02dd46800 20 remove_watcher() i=0 2024-09-12T00:25:40.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.694+0000 7fa02dd46800 2 removed watcher, disabling cache 2024-09-12T00:25:40.695 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.696+0000 7fa02dd46800 20 remove_watcher() i=1 2024-09-12T00:25:40.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.697+0000 7fa02dd46800 20 remove_watcher() i=2 2024-09-12T00:25:40.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.698+0000 7fa02dd46800 20 remove_watcher() i=3 2024-09-12T00:25:40.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.699+0000 7fa02dd46800 20 remove_watcher() i=4 2024-09-12T00:25:40.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.700+0000 7fa02dd46800 20 remove_watcher() i=5 2024-09-12T00:25:40.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.701+0000 7fa02dd46800 20 remove_watcher() i=6 2024-09-12T00:25:40.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.702+0000 7fa02dd46800 20 remove_watcher() i=7 2024-09-12T00:25:40.713 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:40.713 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:40.713 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-trim-reshard-log-entries id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:40.713 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:40.715 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:25:40.752 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:40.752 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:40.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.792+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.794+0000 7f192151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.794+0000 7f192151f800 20 realm 2024-09-12T00:25:40.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.794+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.794+0000 7f192151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.794+0000 7f192151f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:40.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.794+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.794+0000 7f192151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:40.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.794+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.795+0000 7f192151f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:40.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.795+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:40.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.796+0000 7f192151f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:40.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.796+0000 7f192151f800 20 searching for the correct realm 2024-09-12T00:25:40.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.798+0000 7f191caa8640 0 -- 172.21.15.33:0/4125180425 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x559d90eec470 msgr2=0x559d90eee880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:40.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:40.802+0000 7f191d2a9640 0 -- 172.21.15.33:0/4125180425 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f19140a6060 msgr2=0x7f19140780c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.007+0000 7f192151f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.007+0000 7f192151f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.007+0000 7f192151f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.007+0000 7f192151f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.007+0000 7f192151f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.007+0000 7f192151f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.007+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.008+0000 7f192151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.008+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.008+0000 7f192151f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:41.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.008+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 20 zone default found 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 4 Realm: () 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 20 zonegroup default 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.009+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.010+0000 7f192151f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.010+0000 7f192151f800 20 started sync module instance, tier type = 2024-09-12T00:25:41.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.010+0000 7f192151f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:41.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.019+0000 7f192151f800 20 add_watcher() i=0 2024-09-12T00:25:41.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.019+0000 7f192151f800 20 add_watcher() i=1 2024-09-12T00:25:41.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.019+0000 7f192151f800 20 add_watcher() i=2 2024-09-12T00:25:41.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.019+0000 7f192151f800 20 add_watcher() i=3 2024-09-12T00:25:41.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.019+0000 7f192151f800 20 add_watcher() i=4 2024-09-12T00:25:41.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.019+0000 7f192151f800 20 add_watcher() i=5 2024-09-12T00:25:41.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.019+0000 7f192151f800 20 add_watcher() i=6 2024-09-12T00:25:41.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.020+0000 7f192151f800 20 add_watcher() i=7 2024-09-12T00:25:41.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.020+0000 7f192151f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:41.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.022+0000 7f17d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:41.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.022+0000 7f192151f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:41.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.022+0000 7f192151f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:41.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.022+0000 7f192151f800 5 note: GC not initialized 2024-09-12T00:25:41.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.023+0000 7f17d27e4640 20 reqs_thread_entry: start 2024-09-12T00:25:41.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.023+0000 7f192151f800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:41.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.023+0000 7f192151f800 20 Filter name: none 2024-09-12T00:25:41.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.023+0000 7f1743fff640 20 reqs_thread_entry: start 2024-09-12T00:25:41.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.023+0000 7f192151f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:25:41.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.023+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:41.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:25:41.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:25:41.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 : miss 2024-09-12T00:25:41.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:41.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 info.flags=0x17 2024-09-12T00:25:41.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 to cache LRU end 2024-09-12T00:25:41.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:41.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:41.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.024+0000 7f192151f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 2024-09-12T00:25:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.029+0000 7f192151f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 info.flags=0x17 2024-09-12T00:25:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.029+0000 7f192151f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 to cache LRU end 2024-09-12T00:25:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.029+0000 7f192151f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.029+0000 7f192151f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27, ofs0, ns] 2024-09-12T00:25:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.029+0000 7f17effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94135229839296 notifier 6807 bl.length()=1023 2024-09-12T00:25:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.029+0000 7f17effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 info.flags=0x17 2024-09-12T00:25:41.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.029+0000 7f17effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 to cache LRU end 2024-09-12T00:25:41.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.029+0000 7f17effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:41.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.031+0000 7f192151f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27]): orig_sources= new_sources= 2024-09-12T00:25:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.031+0000 7f192151f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27]): potential sources added=[] removed=[] 2024-09-12T00:25:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.031+0000 7f192151f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27]): orig_dests= new_dests= 2024-09-12T00:25:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.031+0000 7f192151f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27]): potential dests added=[] removed=[] 2024-09-12T00:25:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.031+0000 7f192151f800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:25:41.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.031+0000 7f192151f800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:25:41.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.0 2024-09-12T00:25:41.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.0 2024-09-12T00:25:41.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.1 2024-09-12T00:25:41.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.1 2024-09-12T00:25:41.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.2 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.2 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.3 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.3 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.4 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.4 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.5 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.5 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.6 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.6 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.7 2024-09-12T00:25:41.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.7 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.8 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.8 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.9 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.9 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.10 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.10 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.11 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1.11 2024-09-12T00:25:41.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.033+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.0 2024-09-12T00:25:41.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.034+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.1 2024-09-12T00:25:41.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.034+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.2 2024-09-12T00:25:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.035+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.3 2024-09-12T00:25:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.036+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.4 2024-09-12T00:25:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.036+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.5 2024-09-12T00:25:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.037+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.6 2024-09-12T00:25:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.037+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.7 2024-09-12T00:25:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.038+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.8 2024-09-12T00:25:41.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.038+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.9 2024-09-12T00:25:41.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.039+0000 7f192151f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27.10 2024-09-12T00:25:41.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.042+0000 7f192151f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:41.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.042+0000 7f192151f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 2024-09-12T00:25:41.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.043+0000 7f192151f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 info.flags=0x17 2024-09-12T00:25:41.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.043+0000 7f192151f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 to cache LRU end 2024-09-12T00:25:41.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.043+0000 7f192151f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:41.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.043+0000 7f192151f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27, ofs0, ns] 2024-09-12T00:25:41.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.043+0000 7f17effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94135229839296 notifier 6807 bl.length()=991 2024-09-12T00:25:41.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.043+0000 7f17effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 info.flags=0x17 2024-09-12T00:25:41.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.043+0000 7f17effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 to cache LRU end 2024-09-12T00:25:41.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.043+0000 7f17effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:41.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.045+0000 7f192151f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27]): orig_sources= new_sources= 2024-09-12T00:25:41.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.045+0000 7f192151f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27]): potential sources added=[] removed=[] 2024-09-12T00:25:41.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.045+0000 7f192151f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27]): orig_dests= new_dests= 2024-09-12T00:25:41.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.045+0000 7f192151f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27]): potential dests added=[] removed=[] 2024-09-12T00:25:41.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.047+0000 7f192151f800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:25:41.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.049+0000 7f17d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:41.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.051+0000 7f192151f800 20 remove_watcher() i=0 2024-09-12T00:25:41.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.051+0000 7f192151f800 2 removed watcher, disabling cache 2024-09-12T00:25:41.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.052+0000 7f192151f800 20 remove_watcher() i=1 2024-09-12T00:25:41.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.053+0000 7f192151f800 20 remove_watcher() i=2 2024-09-12T00:25:41.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.054+0000 7f192151f800 20 remove_watcher() i=3 2024-09-12T00:25:41.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.055+0000 7f192151f800 20 remove_watcher() i=4 2024-09-12T00:25:41.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.056+0000 7f192151f800 20 remove_watcher() i=5 2024-09-12T00:25:41.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.057+0000 7f192151f800 20 remove_watcher() i=6 2024-09-12T00:25:41.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.058+0000 7f192151f800 20 remove_watcher() i=7 2024-09-12T00:25:41.070 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:25:41.099 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:41.099 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:41.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.139+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.141+0000 7f1117f34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.141+0000 7f1117f34800 20 realm 2024-09-12T00:25:41.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.141+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.141+0000 7f1117f34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.141+0000 7f1117f34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:41.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.141+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.141+0000 7f1117f34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.141+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.142+0000 7f1117f34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:41.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.142+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.143+0000 7f1117f34800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:41.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.143+0000 7f1117f34800 20 searching for the correct realm 2024-09-12T00:25:41.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.146+0000 7f1113cb7640 0 -- 172.21.15.33:0/3291360264 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f110c07b020 msgr2=0x7f110c0c2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:41.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.149+0000 7f1113cb7640 0 -- 172.21.15.33:0/3291360264 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f1108019040 msgr2=0x7f110806e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.355+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 20 zone default found 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 4 Realm: () 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 20 zonegroup default 2024-09-12T00:25:41.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.356+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.357+0000 7f1117f34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.357+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.357+0000 7f1117f34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:41.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.357+0000 7f1117f34800 20 started sync module instance, tier type = 2024-09-12T00:25:41.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.357+0000 7f1117f34800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.366+0000 7f1117f34800 20 add_watcher() i=0 2024-09-12T00:25:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.366+0000 7f1117f34800 20 add_watcher() i=1 2024-09-12T00:25:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.366+0000 7f1117f34800 20 add_watcher() i=2 2024-09-12T00:25:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.366+0000 7f1117f34800 20 add_watcher() i=3 2024-09-12T00:25:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.366+0000 7f1117f34800 20 add_watcher() i=4 2024-09-12T00:25:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.366+0000 7f1117f34800 20 add_watcher() i=5 2024-09-12T00:25:41.366 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.366+0000 7f1117f34800 20 add_watcher() i=6 2024-09-12T00:25:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.367+0000 7f1117f34800 20 add_watcher() i=7 2024-09-12T00:25:41.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.367+0000 7f1117f34800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:41.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.369+0000 7f0fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.370+0000 7f1117f34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.370+0000 7f1117f34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.370+0000 7f1117f34800 5 note: GC not initialized 2024-09-12T00:25:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.370+0000 7f0fc8fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.370+0000 7f1117f34800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.370+0000 7f1117f34800 20 Filter name: none 2024-09-12T00:25:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.370+0000 7f0f427fc640 20 reqs_thread_entry: start 2024-09-12T00:25:41.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.370+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.371+0000 7f1117f34800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:41.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.371+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.371+0000 7f1117f34800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:41.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.371+0000 7f1117f34800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:41.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.371+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.372+0000 7f1117f34800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:41.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.372+0000 7f1117f34800 20 rados->read ofs=0 len=0 2024-09-12T00:25:41.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.372+0000 7f1117f34800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:41.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.372+0000 7f1117f34800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:41.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.374+0000 7f0fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:41.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.378+0000 7f1117f34800 20 remove_watcher() i=0 2024-09-12T00:25:41.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.378+0000 7f1117f34800 2 removed watcher, disabling cache 2024-09-12T00:25:41.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.379+0000 7f1117f34800 20 remove_watcher() i=1 2024-09-12T00:25:41.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.380+0000 7f1117f34800 20 remove_watcher() i=2 2024-09-12T00:25:41.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.381+0000 7f1117f34800 20 remove_watcher() i=3 2024-09-12T00:25:41.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.382+0000 7f1117f34800 20 remove_watcher() i=4 2024-09-12T00:25:41.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.383+0000 7f1117f34800 20 remove_watcher() i=5 2024-09-12T00:25:41.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.384+0000 7f1117f34800 20 remove_watcher() i=6 2024-09-12T00:25:41.385 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:41.385+0000 7f1117f34800 20 remove_watcher() i=7 2024-09-12T00:25:41.396 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:41.396 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:41.396 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-trim-reshard-log-entries id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:25:41.396 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:41.398 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.398 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:41.419 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.419 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:41.618 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.618 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:41.756 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:25:41.756 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:41.757 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.758 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:41.807 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.807 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:41.864 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.864 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:41.903 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.903 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:41.937 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.937 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:41.970 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:41.970 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.004 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.004 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.037 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.037 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.073 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.073 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.107 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.108 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.141 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.141 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.175 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.175 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.210 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.210 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.244 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.244 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.281 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.281 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.315 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.315 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.353 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.353 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.388 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.389 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.423 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.423 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.459 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.459 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.496 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.497 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.531 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:42.531 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:42.564 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:25:42.594 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:42.594 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:42.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.634+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.636+0000 7f36c5726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.636+0000 7f36c5726800 20 realm 2024-09-12T00:25:42.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.636+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.636+0000 7f36c5726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.636+0000 7f36c5726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.636+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.636+0000 7f36c5726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.636+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.637+0000 7f36c5726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.637+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.638+0000 7f36c5726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:42.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.638+0000 7f36c5726800 20 searching for the correct realm 2024-09-12T00:25:42.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.639+0000 7f36c13d9640 0 -- 172.21.15.33:0/1894760191 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x556e9a2ba520 msgr2=0x7f36bc04d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:42.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.643+0000 7f36c0bd8640 0 -- 172.21.15.33:0/1894760191 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f36b404d070 msgr2=0x7f36b408e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:42.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:42.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:42.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:42.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:42.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:42.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:42.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 zone default found 2024-09-12T00:25:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 4 Realm: () 2024-09-12T00:25:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:42.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 zonegroup default 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.649+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.650+0000 7f36c5726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.650+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.650+0000 7f36c5726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.650+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.650+0000 7f36c5726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.650+0000 7f36c5726800 20 started sync module instance, tier type = 2024-09-12T00:25:42.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.650+0000 7f36c5726800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:42.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.661+0000 7f36c5726800 20 add_watcher() i=0 2024-09-12T00:25:42.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.661+0000 7f36c5726800 20 add_watcher() i=1 2024-09-12T00:25:42.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.661+0000 7f36c5726800 20 add_watcher() i=2 2024-09-12T00:25:42.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.661+0000 7f36c5726800 20 add_watcher() i=3 2024-09-12T00:25:42.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.661+0000 7f36c5726800 20 add_watcher() i=4 2024-09-12T00:25:42.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.661+0000 7f36c5726800 20 add_watcher() i=5 2024-09-12T00:25:42.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.661+0000 7f36c5726800 20 add_watcher() i=6 2024-09-12T00:25:42.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.662+0000 7f36c5726800 20 add_watcher() i=7 2024-09-12T00:25:42.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.662+0000 7f36c5726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:42.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.664+0000 7f3577fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:42.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.664+0000 7f36c5726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:42.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.664+0000 7f36c5726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:42.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.664+0000 7f36c5726800 5 note: GC not initialized 2024-09-12T00:25:42.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.664+0000 7f3576fe5640 20 reqs_thread_entry: start 2024-09-12T00:25:42.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.665+0000 7f36c5726800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:42.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.665+0000 7f36c5726800 20 Filter name: none 2024-09-12T00:25:42.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.665+0000 7f3574fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:42.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.665+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.665+0000 7f36c5726800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:42.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.665+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.666+0000 7f36c5726800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:42.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.666+0000 7f36c5726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:42.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.666+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.666+0000 7f36c5726800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:42.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.666+0000 7f36c5726800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.667+0000 7f36c5726800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:42.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.667+0000 7f36c5726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:42.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.668+0000 7f3577fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:42.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.670+0000 7f36c5726800 20 remove_watcher() i=0 2024-09-12T00:25:42.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.670+0000 7f36c5726800 2 removed watcher, disabling cache 2024-09-12T00:25:42.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.672+0000 7f36c5726800 20 remove_watcher() i=1 2024-09-12T00:25:42.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.673+0000 7f36c5726800 20 remove_watcher() i=2 2024-09-12T00:25:42.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.674+0000 7f36c5726800 20 remove_watcher() i=3 2024-09-12T00:25:42.674 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.675+0000 7f36c5726800 20 remove_watcher() i=4 2024-09-12T00:25:42.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.676+0000 7f36c5726800 20 remove_watcher() i=5 2024-09-12T00:25:42.676 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.677+0000 7f36c5726800 20 remove_watcher() i=6 2024-09-12T00:25:42.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.678+0000 7f36c5726800 20 remove_watcher() i=7 2024-09-12T00:25:42.688 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:42.688 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:42.688 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-trim-reshard-log-entries id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:42.689 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:42.690 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:25:42.725 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:42.725 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:42.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.766+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 realm 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.768+0000 7f7bb1c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.769+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:42.769 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.769+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:42.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.770+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:42.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.770+0000 7f7bb1c98800 20 searching for the correct realm 2024-09-12T00:25:42.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.772+0000 7f7baf782640 0 -- 172.21.15.33:0/3209272811 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f7ba802f040 msgr2=0x7f7ba803d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:42.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:42.977+0000 7f7baef81640 0 -- 172.21.15.33:0/3209272811 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f7ba0061a50 msgr2=0x7f7ba00be130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 zone default found 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 Realm: () 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 zonegroup default 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 started sync module instance, tier type = 2024-09-12T00:25:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:43.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=0 2024-09-12T00:25:43.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=1 2024-09-12T00:25:43.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=2 2024-09-12T00:25:43.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=3 2024-09-12T00:25:43.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=4 2024-09-12T00:25:43.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=5 2024-09-12T00:25:43.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=6 2024-09-12T00:25:43.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.200+0000 7f7bb1c98800 20 add_watcher() i=7 2024-09-12T00:25:43.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.200+0000 7f7bb1c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:43.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.202+0000 7f7a65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 note: GC not initialized 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f7a64fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 Filter name: none 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f79de7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f7bb1c98800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:25:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:43.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:25:43.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:25:43.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 : miss 2024-09-12T00:25:43.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:43.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:43.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 2024-09-12T00:25:43.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28, ofs0, ns] 2024-09-12T00:25:43.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94560471206480 notifier 6864 bl.length()=1023 2024-09-12T00:25:43.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.211 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7bb1c98800 time 2024-09-12T00:25:43.213810+0000 2024-09-12T00:25:43.211 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:25:43.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.212+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_sources= new_sources= 2024-09-12T00:25:43.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.212+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential sources added=[] removed=[] 2024-09-12T00:25:43.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.213+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_dests= new_dests= 2024-09-12T00:25:43.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.213+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential dests added=[] removed=[] 2024-09-12T00:25:43.212 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:43.212 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7bb518c71a] 2024-09-12T00:25:43.212 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bb518c8d8] 2024-09-12T00:25:43.212 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560090af2641] 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd884de) [0x5600910054de] 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560090b0231d] 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7bb3e29590] 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f7bb1c98800 thread_name:radosgw-admin 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.213+0000 7f7bb1c98800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7bb1c98800 time 2024-09-12T00:25:43.213810+0000 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:43.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7bb518c71a] 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bb518c8d8] 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560090af2641] 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd884de) [0x5600910054de] 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560090b0231d] 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7bb3e29590] 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:25:43.214 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.248 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:43.248 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7bb3e3e6f0] 2024-09-12T00:25:43.248 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7bb3e8b99c] 2024-09-12T00:25:43.248 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:25:43.248 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:25:43.249 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7bb518c774] 2024-09-12T00:25:43.249 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bb518c8d8] 2024-09-12T00:25:43.249 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560090af2641] 2024-09-12T00:25:43.249 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd884de) [0x5600910054de] 2024-09-12T00:25:43.249 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560090b0231d] 2024-09-12T00:25:43.250 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:25:43.250 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7bb3e29590] 2024-09-12T00:25:43.250 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:25:43.250 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:25:43.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.214+0000 7f7bb1c98800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:25:43.250 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f7bb1c98800 thread_name:radosgw-admin 2024-09-12T00:25:43.251 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.251 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:43.251 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7bb3e3e6f0] 2024-09-12T00:25:43.251 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7bb3e8b99c] 2024-09-12T00:25:43.251 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:25:43.252 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:25:43.252 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7bb518c774] 2024-09-12T00:25:43.252 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bb518c8d8] 2024-09-12T00:25:43.252 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560090af2641] 2024-09-12T00:25:43.252 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd884de) [0x5600910054de] 2024-09-12T00:25:43.252 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560090b0231d] 2024-09-12T00:25:43.253 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:25:43.253 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7bb3e29590] 2024-09-12T00:25:43.253 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:25:43.253 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:25:43.253 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:25:43.254 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.254 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:25:43.254 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 4 set_mon_vals no callback set 2024-09-12T00:25:43.254 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 10 monclient: shutdown 2024-09-12T00:25:43.254 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 asok(0x56009319c630) unregister_commands rotate-key 2024-09-12T00:25:43.254 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 10 monclient: build_initial_monmap 2024-09-12T00:25:43.255 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 1 build_initial for_mkfs: 0 2024-09-12T00:25:43.255 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 10 monclient: monmap: 2024-09-12T00:25:43.255 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:43.255 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:43.255 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:43.255 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:43.256 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:43.256 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.256 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:43.256 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:43.257 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:43.257 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.257 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding auth protocol: cephx 2024-09-12T00:25:43.257 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding auth protocol: cephx 2024-09-12T00:25:43.257 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding auth protocol: cephx 2024-09-12T00:25:43.257 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.257 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.258 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.259 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.259 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.259 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 1 librados: starting msgr at 2024-09-12T00:25:43.259 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 1 librados: starting objecter 2024-09-12T00:25:43.259 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command objecter_requests hook 0x5600933eb8e0 2024-09-12T00:25:43.259 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 1 librados: setting wanted keys 2024-09-12T00:25:43.259 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 1 librados: calling monclient init 2024-09-12T00:25:43.260 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient: init 2024-09-12T00:25:43.260 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding auth protocol: cephx 2024-09-12T00:25:43.260 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding auth protocol: cephx 2024-09-12T00:25:43.260 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding auth protocol: cephx 2024-09-12T00:25:43.260 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.260 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.260 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.261 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.261 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.261 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.261 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.261 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.261 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.262 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.262 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.262 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.262 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.262 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.262 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command rotate-key hook 0x5600933bccc8 2024-09-12T00:25:43.262 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:43.263 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:25:43.263 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-a con 0x5600933e6a30 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:43.263 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-c con 0x5600933e73b0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:43.263 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-b con 0x7f7b98002340 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:43.263 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.263 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.263 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.264 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:43.264 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): authenticate will time out at 2162.316718s 2024-09-12T00:25:43.264 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): get_auth_request con 0x5600933e6a30 auth_method 0 2024-09-12T00:25:43.264 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.264 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): get_auth_request con 0x5600933e73b0 auth_method 0 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:25:42.750+0000 7f7baff83640 10 monclient(hunting): get_auth_request con 0x7f7b98002340 auth_method 0 2024-09-12T00:25:43.265 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:25:42.750+0000 7f7baff83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:25:42.750+0000 7f7baff83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:25:42.750+0000 7f7baff83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:25:42.751+0000 7f7baf782640 10 monclient(hunting): handle_auth_done global_id 6855 payload 824 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:25:42.751+0000 7f7baf782640 10 monclient: _finish_hunting 0 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:25:42.751+0000 7f7baf782640 1 monclient: found mon.noname-a 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:25:42.751+0000 7f7baf782640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: dump: 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.266 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: _finish_auth 0 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: _check_auth_tickets 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: dump: 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.267 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 5 monclient: authenticate success, global_id 6855 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:25:42.751+0000 7f7a9d60a640 4 set_mon_vals no callback set 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.268 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 1 librados: init done 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:25:42.753+0000 7f7a9be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:25:42.753+0000 7f7a9be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:25:42.753+0000 7f7a9be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:25:42.753+0000 7f7baef81640 10 monclient: get_auth_request con 0x7f7a94076470 auth_method 0 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:25:42.753+0000 7f7baff83640 10 monclient: get_auth_request con 0x5600933ef700 auth_method 0 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:25:42.754+0000 7f7baf782640 10 monclient: get_auth_request con 0x560093408c00 auth_method 0 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:25:42.755+0000 7f7baef81640 10 monclient: get_auth_request con 0x56009340cf60 auth_method 0 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 10 monclient: build_initial_monmap 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 1 build_initial for_mkfs: 0 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 10 monclient: monmap: 2024-09-12T00:25:43.269 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding auth protocol: cephx 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding auth protocol: cephx 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding auth protocol: cephx 2024-09-12T00:25:43.270 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.271 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command objecter_requests cmddesc objecter_requests hook 0x560093415860 EEXIST 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient: init 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding auth protocol: cephx 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding auth protocol: cephx 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding auth protocol: cephx 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.272 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.273 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command rotate-key cmddesc rotate-key hook 0x560093410610 EEXIST 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-a con 0x560093439550 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-c con 0x56009343b820 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-b con 0x560093437d20 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): authenticate will time out at 2162.323916s 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): get_auth_request con 0x56009343b820 auth_method 0 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.274 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): get_auth_request con 0x560093439550 auth_method 0 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): get_auth_request con 0x560093437d20 auth_method 0 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.275 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): handle_auth_done global_id 6467 payload 824 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient: _finish_hunting 0 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:25:42.758+0000 7f7baef81640 1 monclient: found mon.noname-c 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: dump: 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.276 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: _finish_auth 0 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: _check_auth_tickets 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:25:43.277 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: dump: 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 5 monclient: authenticate success, global_id 6467 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.278 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:25:42.758+0000 7f7bb0784640 4 set_mon_vals no callback set 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:25:42.760+0000 7f7a99602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:25:42.760+0000 7f7a99602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:25:42.760+0000 7f7a99602640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:25:42.760+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7a88076380 auth_method 0 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:25:42.760+0000 7f7bb1c98800 10 monclient: get_monmap_and_config 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:25:42.760+0000 7f7bb1c98800 10 monclient: build_initial_monmap 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:25:42.760+0000 7f7bb1c98800 1 build_initial for_mkfs: 0 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:25:42.760+0000 7f7bb1c98800 10 monclient: monmap: 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:43.279 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding auth protocol: cephx 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding auth protocol: cephx 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding auth protocol: cephx 2024-09-12T00:25:43.280 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.281 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient: init 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding auth protocol: cephx 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding auth protocol: cephx 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding auth protocol: cephx 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.282 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command rotate-key cmddesc rotate-key hook 0x7ffefe4dbff8 EEXIST 2024-09-12T00:25:43.283 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-c con 0x56009348d5a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-b con 0x56009348d980 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-a con 0x5600934930d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): authenticate will time out at 2162.327970s 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): get_auth_request con 0x5600934930d0 auth_method 0 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.284 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): get_auth_request con 0x56009348d5a0 auth_method 0 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): get_auth_request con 0x56009348d980 auth_method 0 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.285 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): handle_auth_done global_id 6861 payload 274 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient: _finish_hunting 0 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:25:42.762+0000 7f7baff83640 1 monclient: found mon.noname-a 2024-09-12T00:25:43.286 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: dump: 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.287 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: _finish_auth 0 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:25:42.762+0000 7f7bb1c98800 5 monclient: authenticate success, global_id 6861 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:25:42.762+0000 7f7bb1c98800 10 monclient: get_monmap_and_config success 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:25:42.762+0000 7f7bb1c98800 4 set_mon_vals no callback set 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: dump: 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.288 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 10 monclient: shutdown 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 10 monclient: build_initial_monmap 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 build_initial for_mkfs: 0 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 10 monclient: monmap: 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:43.289 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding auth protocol: cephx 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding auth protocol: cephx 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding auth protocol: cephx 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.290 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.291 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 librados: starting msgr at 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 librados: starting objecter 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command objecter_requests cmddesc objecter_requests hook 0x560093438930 EEXIST 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 librados: setting wanted keys 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 librados: calling monclient init 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 10 monclient: init 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding auth protocol: cephx 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding auth protocol: cephx 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding auth protocol: cephx 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.292 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.293 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command rotate-key cmddesc rotate-key hook 0x560093451448 EEXIST 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-c con 0x56009348d5a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-a con 0x5600934930d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-b con 0x560093459bd0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): authenticate will time out at 2162.330349s 2024-09-12T00:25:43.294 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): get_auth_request con 0x56009348d5a0 auth_method 0 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): get_auth_request con 0x5600934930d0 auth_method 0 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.295 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:25:42.764+0000 7f7baff83640 10 monclient(hunting): get_auth_request con 0x560093459bd0 auth_method 0 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:25:42.764+0000 7f7baff83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:25:42.764+0000 7f7baff83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:25:42.764+0000 7f7baff83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): handle_auth_done global_id 6864 payload 824 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient: _finish_hunting 0 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:25:42.764+0000 7f7baef81640 1 monclient: found mon.noname-a 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:25:42.764+0000 7f7a917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: dump: 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.296 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: _finish_auth 0 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: _check_auth_tickets 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:43.297 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: dump: 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.298 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 5 monclient: authenticate success, global_id 6864 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:25:42.765+0000 7f7a92ffd640 4 set_mon_vals no callback set 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 1 librados: init done 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cr dump hook 0x56009348c258 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:25:42.766+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:25:42.767+0000 7f7a917fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:25:42.767+0000 7f7a917fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:25:42.767+0000 7f7a917fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:25:42.767+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7a780764a0 auth_method 0 2024-09-12T00:25:43.299 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:25:42.767+0000 7f7baff83640 10 monclient: get_auth_request con 0x5600934a8340 auth_method 0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 realm 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:25:42.769+0000 7f7baf782640 10 monclient: get_auth_request con 0x5600934ac5a0 auth_method 0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:25:42.769+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:25:42.769+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:25:42.769+0000 7f7baef81640 10 monclient: get_auth_request con 0x5600934afe00 auth_method 0 2024-09-12T00:25:43.300 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:25:42.770+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:25:42.770+0000 7f7bb1c98800 20 searching for the correct realm 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:25:42.770+0000 7f7baff83640 10 monclient: get_auth_request con 0x5600934b4b80 auth_method 0 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:25:42.772+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7ba802f040 auth_method 0 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:25:42.772+0000 7f7baf782640 0 -- 172.21.15.33:0/3209272811 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f7ba802f040 msgr2=0x7f7ba803d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:25:42.974+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7ba802f040 auth_method 0 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:25:42.974+0000 7f7baef81640 10 monclient: get_auth_request con 0x7f7ba0061a50 auth_method 0 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:25:42.976+0000 7f7baff83640 10 monclient: get_auth_request con 0x7f7b980030f0 auth_method 0 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:25:42.977+0000 7f7baef81640 0 -- 172.21.15.33:0/3209272811 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f7ba0061a50 msgr2=0x7f7ba00be130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:43.301 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:25:42.977+0000 7f7a917fa640 1 client.6864.objecter ms_handle_reset 0x7f7ba0061a50 session 0x7f7ba00adea0 osd.2 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:25:42.977+0000 7f7a917fa640 10 monclient: _renew_subs 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:25:42.977+0000 7f7a917fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:25:42.977+0000 7f7baef81640 10 monclient: get_auth_request con 0x7f7a78086c30 auth_method 0 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:25:42.978+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7ba40240a0 auth_method 0 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:25:43.180+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7ba40240a0 auth_method 0 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:43.302 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 zone default found 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 Realm: () 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:43.303 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 zonegroup default 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 started sync module instance, tier type = 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=0 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=1 2024-09-12T00:25:43.304 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=2 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=3 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=4 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=5 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=6 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:25:43.200+0000 7f7bb1c98800 20 add_watcher() i=7 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:25:43.200+0000 7f7bb1c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding auth protocol: cephx 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding auth protocol: cephx 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding auth protocol: cephx 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.305 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:25:43.202+0000 7f7a65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:43.306 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cache list hook 0x5600934594c0 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cache inspect hook 0x5600934594c0 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cache erase hook 0x5600934594c0 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cache zap hook 0x5600934594c0 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 note: GC not initialized 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:25:43.203+0000 7f7a64fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command sync trace show hook 0x7f7ba800dba0 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command sync trace history hook 0x7f7ba800dba0 2024-09-12T00:25:43.307 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command sync trace active hook 0x7f7ba800dba0 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command sync trace active_short hook 0x7f7ba800dba0 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 Filter name: none 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:25:43.203+0000 7f79de7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:25:43.308 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:25:43.309 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 : miss 2024-09-12T00:25:43.309 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.309 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:43.309 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.309 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.309 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:43.309 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.309 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 2024-09-12T00:25:43.310 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.310 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.310 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.310 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28, ofs0, ns] 2024-09-12T00:25:43.310 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94560471206480 notifier 6864 bl.length()=1023 2024-09-12T00:25:43.310 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.310 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.310 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.311 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:25:43.212+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_sources= new_sources= 2024-09-12T00:25:43.311 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:25:43.212+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential sources added=[] removed=[] 2024-09-12T00:25:43.311 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:25:43.213+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_dests= new_dests= 2024-09-12T00:25:43.311 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:25:43.213+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential dests added=[] removed=[] 2024-09-12T00:25:43.311 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:25:43.213+0000 7f7bb1c98800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7bb1c98800 time 2024-09-12T00:25:43.213810+0000 2024-09-12T00:25:43.311 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:25:43.311 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.312 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:43.312 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7bb518c71a] 2024-09-12T00:25:43.312 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bb518c8d8] 2024-09-12T00:25:43.312 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560090af2641] 2024-09-12T00:25:43.312 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd884de) [0x5600910054de] 2024-09-12T00:25:43.312 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560090b0231d] 2024-09-12T00:25:43.312 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:25:43.312 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7bb3e29590] 2024-09-12T00:25:43.313 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:25:43.313 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:25:43.313 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.313 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:25:43.214+0000 7f7bb1c98800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:25:43.313 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f7bb1c98800 thread_name:radosgw-admin 2024-09-12T00:25:43.313 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.313 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:43.313 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7bb3e3e6f0] 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7bb3e8b99c] 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7bb518c774] 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bb518c8d8] 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560090af2641] 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd884de) [0x5600910054de] 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560090b0231d] 2024-09-12T00:25:43.314 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:25:43.315 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7bb3e29590] 2024-09-12T00:25:43.315 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:25:43.315 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:25:43.315 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:25:43.315 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.315 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:25:43.315 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:25:43.315 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:25:43.316 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:25:43.317 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:25:43.317 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:25:43.317 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:25:43.317 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:25:43.317 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:25:43.317 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:25:43.317 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:25:43.317 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:25:43.318 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:25:43.319 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:25:43.319 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:25:43.319 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:25:43.319 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:25:43.319 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:25:43.319 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:25:43.319 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:25:43.320 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:25:43.320 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:25:43.320 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:25:43.320 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:25:43.320 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:25:43.320 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:25:43.320 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:25:43.320 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:25:43.321 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:25:43.322 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:25:43.323 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:25:43.324 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f79de7fc640 / http_manager 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a64fe1640 / http_manager 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a65fe3640 / rgw_dt_lg_renew 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a917fa640 / ms_dispatch 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a927fc640 / io_context_pool 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a92ffd640 / io_context_pool 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a99602640 / ms_dispatch 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a9be07640 / ms_dispatch 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a9d60a640 / io_context_pool 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7baef81640 / msgr-worker-2 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7baf782640 / msgr-worker-1 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7baff83640 / msgr-worker-0 2024-09-12T00:25:43.325 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7bb0784640 / io_context_pool 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7bb1c98800 / radosgw-admin 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.106870.log 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 4 set_mon_vals no callback set 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 10 monclient: shutdown 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 asok(0x56009319c630) unregister_commands rotate-key 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 10 monclient: build_initial_monmap 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 1 build_initial for_mkfs: 0 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 10 monclient: monmap: 2024-09-12T00:25:43.326 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding auth protocol: cephx 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding auth protocol: cephx 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding auth protocol: cephx 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.327 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: crc 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 5 AuthRegistry(0x5600933c26e0) adding con mode: secure 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.328 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 1 librados: starting msgr at 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:25:42.749+0000 7f7bb1c98800 1 librados: starting objecter 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command objecter_requests hook 0x5600933eb8e0 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 1 librados: setting wanted keys 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 1 librados: calling monclient init 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient: init 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding auth protocol: cephx 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding auth protocol: cephx 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding auth protocol: cephx 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.329 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.330 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.330 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.330 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.330 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.330 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.330 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.330 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.331 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.331 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: crc 2024-09-12T00:25:43.331 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 AuthRegistry(0x5600933bcb80) adding con mode: secure 2024-09-12T00:25:43.331 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.331 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.331 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command rotate-key hook 0x5600933bccc8 2024-09-12T00:25:43.332 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:43.332 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:25:43.332 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-a con 0x5600933e6a30 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:43.332 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-c con 0x5600933e73b0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:43.332 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-b con 0x7f7b98002340 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:43.332 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.333 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.333 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.333 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:43.333 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:25:42.750+0000 7f7bb1c98800 10 monclient(hunting): authenticate will time out at 2162.316718s 2024-09-12T00:25:43.333 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): get_auth_request con 0x5600933e6a30 auth_method 0 2024-09-12T00:25:43.333 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.334 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.334 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.334 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): get_auth_request con 0x5600933e73b0 auth_method 0 2024-09-12T00:25:43.334 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.334 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.334 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.335 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.335 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.335 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:25:42.750+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.335 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.335 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.336 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:25:42.750+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.336 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:25:42.750+0000 7f7baff83640 10 monclient(hunting): get_auth_request con 0x7f7b98002340 auth_method 0 2024-09-12T00:25:43.336 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:25:42.750+0000 7f7baff83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.336 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:25:42.750+0000 7f7baff83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.336 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:25:42.750+0000 7f7baff83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.336 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:25:42.751+0000 7f7baf782640 10 monclient(hunting): handle_auth_done global_id 6855 payload 824 2024-09-12T00:25:43.337 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:25:42.751+0000 7f7baf782640 10 monclient: _finish_hunting 0 2024-09-12T00:25:43.337 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:25:42.751+0000 7f7baf782640 1 monclient: found mon.noname-a 2024-09-12T00:25:43.337 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:25:42.751+0000 7f7baf782640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.337 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.337 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:43.337 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: dump: 2024-09-12T00:25:43.338 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.338 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.338 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.338 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.338 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.338 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.339 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.339 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.339 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.339 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.339 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: _finish_auth 0 2024-09-12T00:25:43.340 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: _check_auth_tickets 2024-09-12T00:25:43.340 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:43.340 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.340 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:43.340 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:25:42.751+0000 7f7a9be07640 10 monclient: dump: 2024-09-12T00:25:43.340 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.341 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.341 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.341 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.341 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.341 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.341 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.342 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.342 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.342 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.342 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 5 monclient: authenticate success, global_id 6855 2024-09-12T00:25:43.342 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.342 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:25:42.751+0000 7f7a9d60a640 4 set_mon_vals no callback set 2024-09-12T00:25:43.343 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.343 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.343 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.343 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:25:42.751+0000 7f7bb1c98800 1 librados: init done 2024-09-12T00:25:43.343 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:25:42.753+0000 7f7a9be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:43.343 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:25:42.753+0000 7f7a9be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.344 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:25:42.753+0000 7f7a9be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.344 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:25:42.753+0000 7f7baef81640 10 monclient: get_auth_request con 0x7f7a94076470 auth_method 0 2024-09-12T00:25:43.344 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:25:42.753+0000 7f7baff83640 10 monclient: get_auth_request con 0x5600933ef700 auth_method 0 2024-09-12T00:25:43.344 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:25:42.754+0000 7f7baf782640 10 monclient: get_auth_request con 0x560093408c00 auth_method 0 2024-09-12T00:25:43.344 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:25:42.755+0000 7f7baef81640 10 monclient: get_auth_request con 0x56009340cf60 auth_method 0 2024-09-12T00:25:43.344 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 10 monclient: build_initial_monmap 2024-09-12T00:25:43.345 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 1 build_initial for_mkfs: 0 2024-09-12T00:25:43.345 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 10 monclient: monmap: 2024-09-12T00:25:43.345 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:43.345 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:43.345 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:43.345 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:43.345 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:43.346 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.346 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:43.346 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:43.346 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:43.346 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.346 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding auth protocol: cephx 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding auth protocol: cephx 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding auth protocol: cephx 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.347 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: crc 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:25:42.756+0000 7f7bb1c98800 5 AuthRegistry(0x560093411e10) adding con mode: secure 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command objecter_requests cmddesc objecter_requests hook 0x560093415860 EEXIST 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient: init 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding auth protocol: cephx 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding auth protocol: cephx 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding auth protocol: cephx 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.348 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: crc 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 AuthRegistry(0x5600934104c8) adding con mode: secure 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.349 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command rotate-key cmddesc rotate-key hook 0x560093410610 EEXIST 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-a con 0x560093439550 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-c con 0x56009343b820 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-b con 0x560093437d20 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:25:42.757+0000 7f7bb1c98800 10 monclient(hunting): authenticate will time out at 2162.323916s 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): get_auth_request con 0x56009343b820 auth_method 0 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.350 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): get_auth_request con 0x560093439550 auth_method 0 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:25:42.758+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): get_auth_request con 0x560093437d20 auth_method 0 2024-09-12T00:25:43.351 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:25:42.758+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient(hunting): handle_auth_done global_id 6467 payload 824 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient: _finish_hunting 0 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:25:42.758+0000 7f7baef81640 1 monclient: found mon.noname-c 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:25:42.758+0000 7f7baef81640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: dump: 2024-09-12T00:25:43.352 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: _finish_auth 0 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: _check_auth_tickets 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:43.353 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:25:42.758+0000 7f7a99602640 10 monclient: dump: 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 5 monclient: authenticate success, global_id 6467 2024-09-12T00:25:43.354 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:25:42.758+0000 7f7bb0784640 4 set_mon_vals no callback set 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:25:42.758+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:25:42.760+0000 7f7a99602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:25:42.760+0000 7f7a99602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:25:42.760+0000 7f7a99602640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:25:42.760+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7a88076380 auth_method 0 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:25:42.760+0000 7f7bb1c98800 10 monclient: get_monmap_and_config 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:25:42.760+0000 7f7bb1c98800 10 monclient: build_initial_monmap 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:25:42.760+0000 7f7bb1c98800 1 build_initial for_mkfs: 0 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:25:42.760+0000 7f7bb1c98800 10 monclient: monmap: 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:43.355 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding auth protocol: cephx 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding auth protocol: cephx 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding auth protocol: cephx 2024-09-12T00:25:43.356 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: crc 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x560093459320) adding con mode: secure 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.357 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient: init 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding auth protocol: cephx 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding auth protocol: cephx 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding auth protocol: cephx 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.358 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: crc 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dbeb0) adding con mode: secure 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command rotate-key cmddesc rotate-key hook 0x7ffefe4dbff8 EEXIST 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-c con 0x56009348d5a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-b con 0x56009348d980 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-a con 0x5600934930d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.359 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:25:42.761+0000 7f7bb1c98800 10 monclient(hunting): authenticate will time out at 2162.327970s 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): get_auth_request con 0x5600934930d0 auth_method 0 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): get_auth_request con 0x56009348d5a0 auth_method 0 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.360 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): get_auth_request con 0x56009348d980 auth_method 0 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:25:42.762+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.361 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:25:42.762+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient(hunting): handle_auth_done global_id 6861 payload 274 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient: _finish_hunting 0 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:25:42.762+0000 7f7baff83640 1 monclient: found mon.noname-a 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:25:42.762+0000 7f7baff83640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: dump: 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.362 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: _finish_auth 0 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:25:42.762+0000 7f7bb1c98800 5 monclient: authenticate success, global_id 6861 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:25:42.762+0000 7f7bb1c98800 10 monclient: get_monmap_and_config success 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:25:42.762+0000 7f7bb1c98800 4 set_mon_vals no callback set 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.363 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:25:42.762+0000 7f7a92ffd640 10 monclient: dump: 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.364 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 10 monclient: shutdown 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 10 monclient: build_initial_monmap 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 build_initial for_mkfs: 0 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 10 monclient: monmap: 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:25:43.365 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding auth protocol: cephx 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding auth protocol: cephx 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding auth protocol: cephx 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.366 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: crc 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093488e80) adding con mode: secure 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 librados: starting msgr at 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 librados: starting objecter 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command objecter_requests cmddesc objecter_requests hook 0x560093438930 EEXIST 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 librados: setting wanted keys 2024-09-12T00:25:43.367 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 1 librados: calling monclient init 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 10 monclient: init 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding auth protocol: cephx 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding auth protocol: cephx 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding auth protocol: cephx 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.368 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: crc 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:25:42.763+0000 7f7bb1c98800 5 AuthRegistry(0x560093451300) adding con mode: secure 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command rotate-key cmddesc rotate-key hook 0x560093451448 EEXIST 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient: _reopen_session rank -1 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-c con 0x56009348d5a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-a con 0x5600934930d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:25:43.369 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): picked mon.noname-b con 0x560093459bd0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): start opening mon connection 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): _renew_subs 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:25:42.764+0000 7f7bb1c98800 10 monclient(hunting): authenticate will time out at 2162.330349s 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): get_auth_request con 0x56009348d5a0 auth_method 0 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): get_auth_request con 0x5600934930d0 auth_method 0 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.370 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:25:42.764+0000 7f7baf782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:25:42.764+0000 7f7baff83640 10 monclient(hunting): get_auth_request con 0x560093459bd0 auth_method 0 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:25:42.764+0000 7f7baff83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:25:42.764+0000 7f7baff83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:25:42.764+0000 7f7baff83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:25:43.371 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient(hunting): handle_auth_done global_id 6864 payload 824 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient: _finish_hunting 0 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:25:42.764+0000 7f7baef81640 1 monclient: found mon.noname-a 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:25:42.764+0000 7f7baef81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:25:42.764+0000 7f7a917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: dump: 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.372 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.373 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.373 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.373 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.373 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.373 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.373 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.373 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: _finish_auth 0 2024-09-12T00:25:43.373 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: _check_auth_tickets 2024-09-12T00:25:43.374 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:25:43.374 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:25:43.374 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:25:43.374 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:25:42.765+0000 7f7a917fa640 10 monclient: dump: 2024-09-12T00:25:43.374 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:25:43.374 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:25:43.375 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.375 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:25:43.375 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:25:43.375 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:25:43.375 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:25:43.375 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:25:43.376 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:25:43.376 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.376 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 5 monclient: authenticate success, global_id 6864 2024-09-12T00:25:43.376 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:25:42.765+0000 7f7a92ffd640 4 set_mon_vals no callback set 2024-09-12T00:25:43.376 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.376 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.377 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 10 monclient: _renew_subs 2024-09-12T00:25:43.377 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.377 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 1 librados: init done 2024-09-12T00:25:43.377 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:25:42.765+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cr dump hook 0x56009348c258 2024-09-12T00:25:43.377 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:25:42.766+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.377 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:25:42.767+0000 7f7a917fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:25:43.378 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:25:42.767+0000 7f7a917fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.378 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:25:42.767+0000 7f7a917fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:25:43.378 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:25:42.767+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7a780764a0 auth_method 0 2024-09-12T00:25:43.378 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:25:42.767+0000 7f7baff83640 10 monclient: get_auth_request con 0x5600934a8340 auth_method 0 2024-09-12T00:25:43.378 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.378 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 realm 2024-09-12T00:25:43.378 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.379 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.379 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:43.379 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.379 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.379 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:25:42.768+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.379 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:25:42.769+0000 7f7baf782640 10 monclient: get_auth_request con 0x5600934ac5a0 auth_method 0 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:25:42.769+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:25:42.769+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:25:42.769+0000 7f7baef81640 10 monclient: get_auth_request con 0x5600934afe00 auth_method 0 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:25:42.770+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:25:42.770+0000 7f7bb1c98800 20 searching for the correct realm 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:25:42.770+0000 7f7baff83640 10 monclient: get_auth_request con 0x5600934b4b80 auth_method 0 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:25:42.772+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7ba802f040 auth_method 0 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:25:42.772+0000 7f7baf782640 0 -- 172.21.15.33:0/3209272811 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f7ba802f040 msgr2=0x7f7ba803d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:25:42.974+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7ba802f040 auth_method 0 2024-09-12T00:25:43.380 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:25:42.974+0000 7f7baef81640 10 monclient: get_auth_request con 0x7f7ba0061a50 auth_method 0 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:25:42.976+0000 7f7baff83640 10 monclient: get_auth_request con 0x7f7b980030f0 auth_method 0 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:25:42.977+0000 7f7baef81640 0 -- 172.21.15.33:0/3209272811 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f7ba0061a50 msgr2=0x7f7ba00be130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:25:42.977+0000 7f7a917fa640 1 client.6864.objecter ms_handle_reset 0x7f7ba0061a50 session 0x7f7ba00adea0 osd.2 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:25:42.977+0000 7f7a917fa640 10 monclient: _renew_subs 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:25:42.977+0000 7f7a917fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:25:42.977+0000 7f7baef81640 10 monclient: get_auth_request con 0x7f7a78086c30 auth_method 0 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:25:42.978+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7ba40240a0 auth_method 0 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:25:43.180+0000 7f7baf782640 10 monclient: get_auth_request con 0x7f7ba40240a0 auth_method 0 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:43.381 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:43.382 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:43.382 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:25:43.185+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.382 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.382 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.382 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.382 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.382 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:43.382 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 zone default found 2024-09-12T00:25:43.383 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 Realm: () 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 zonegroup default 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:25:43.186+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 started sync module instance, tier type = 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:25:43.187+0000 7f7bb1c98800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:43.384 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=0 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=1 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=2 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=3 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=4 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=5 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:25:43.198+0000 7f7bb1c98800 20 add_watcher() i=6 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:25:43.200+0000 7f7bb1c98800 20 add_watcher() i=7 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:25:43.200+0000 7f7bb1c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding auth protocol: cephx 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding auth protocol: cephx 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding auth protocol: cephx 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.385 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: crc 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 5 AuthRegistry(0x7ffefe4dc390) adding con mode: secure 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:25:43.202+0000 7f7a65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:25:43.202+0000 7f7bb1c98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:43.386 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cache list hook 0x5600934594c0 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cache inspect hook 0x5600934594c0 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cache erase hook 0x5600934594c0 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command cache zap hook 0x5600934594c0 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 note: GC not initialized 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:25:43.203+0000 7f7a64fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command sync trace show hook 0x7f7ba800dba0 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command sync trace history hook 0x7f7ba800dba0 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command sync trace active hook 0x7f7ba800dba0 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 5 asok(0x56009319c630) register_command sync trace active_short hook 0x7f7ba800dba0 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 Filter name: none 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:25:43.203+0000 7f79de7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:43.387 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:25:43.203+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 : miss 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:25:43.204+0000 7f7bb1c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 2024-09-12T00:25:43.388 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:25:43.210+0000 7f7bb1c98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28, ofs0, ns] 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94560471206480 notifier 6864 bl.length()=1023 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:25:43.211+0000 7f7a927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:25:43.212+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_sources= new_sources= 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:25:43.212+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential sources added=[] removed=[] 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:25:43.213+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_dests= new_dests= 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:25:43.213+0000 7f7bb1c98800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential dests added=[] removed=[] 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:25:43.213+0000 7f7bb1c98800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7bb1c98800 time 2024-09-12T00:25:43.213810+0000 2024-09-12T00:25:43.389 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7bb518c71a] 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bb518c8d8] 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560090af2641] 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd884de) [0x5600910054de] 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560090b0231d] 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7bb3e29590] 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:25:43.214+0000 7f7bb1c98800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:25:43.390 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f7bb1c98800 thread_name:radosgw-admin 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7bb3e3e6f0] 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7bb3e8b99c] 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7bb518c774] 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7bb518c8d8] 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560090af2641] 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd884de) [0x5600910054de] 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560090b0231d] 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7bb3e29590] 2024-09-12T00:25:43.391 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:25:43.392 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:25:43.393 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:25:43.394 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:25:43.395 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:25:43.396 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:25:43.397 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 7f79de7fc640 / http_manager 2024-09-12T00:25:43.398 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a64fe1640 / http_manager 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a65fe3640 / rgw_dt_lg_renew 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a917fa640 / ms_dispatch 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a927fc640 / io_context_pool 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a92ffd640 / io_context_pool 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a99602640 / ms_dispatch 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a9be07640 / ms_dispatch 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7a9d60a640 / io_context_pool 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7baef81640 / msgr-worker-2 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7baf782640 / msgr-worker-1 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7baff83640 / msgr-worker-0 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7bb0784640 / io_context_pool 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7bb1c98800 / radosgw-admin 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:25:43.399 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:25:43.400 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:25:43.215494Z_39fadc3e-3ad5-4e04-bfdd-8884ad0ce313/log 2024-09-12T00:25:43.400 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:25:43.400 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:25:43.401 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:43.401 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:43.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.296+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.297+0000 7f9404b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.297+0000 7f9404b23800 20 realm 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.297+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.298+0000 7f9404b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.298+0000 7f9404b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.298+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.298+0000 7f9404b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.298+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.299+0000 7f9404b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.299+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.300+0000 7f9404b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.300+0000 7f9404b23800 20 searching for the correct realm 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.303+0000 7f940080c640 0 -- 172.21.15.33:0/958200910 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f93fc069040 msgr2=0x7f93fc0a5d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:43.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.307+0000 7f940080c640 0 -- 172.21.15.33:0/958200910 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f93ec062200 msgr2=0x7f93ec095860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:43.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.513+0000 7f9404b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:43.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.513+0000 7f9404b23800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:43.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.513+0000 7f9404b23800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:43.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.513+0000 7f9404b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:43.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.513+0000 7f9404b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:43.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.513+0000 7f9404b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:43.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.513+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.514+0000 7f9404b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.514+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.514+0000 7f9404b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.514+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:43.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 20 zone default found 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 4 Realm: () 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 20 zonegroup default 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.515+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.516+0000 7f9404b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.516+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.516+0000 7f9404b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.516+0000 7f9404b23800 20 started sync module instance, tier type = 2024-09-12T00:25:43.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.516+0000 7f9404b23800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:43.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.525+0000 7f9404b23800 20 add_watcher() i=0 2024-09-12T00:25:43.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.525+0000 7f9404b23800 20 add_watcher() i=1 2024-09-12T00:25:43.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.525+0000 7f9404b23800 20 add_watcher() i=2 2024-09-12T00:25:43.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.525+0000 7f9404b23800 20 add_watcher() i=3 2024-09-12T00:25:43.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.525+0000 7f9404b23800 20 add_watcher() i=4 2024-09-12T00:25:43.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.525+0000 7f9404b23800 20 add_watcher() i=5 2024-09-12T00:25:43.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.525+0000 7f9404b23800 20 add_watcher() i=6 2024-09-12T00:25:43.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.526+0000 7f9404b23800 20 add_watcher() i=7 2024-09-12T00:25:43.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.526+0000 7f9404b23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:43.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.528+0000 7f92b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:43.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.528+0000 7f9404b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:43.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.528+0000 7f9404b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:43.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.528+0000 7f9404b23800 5 note: GC not initialized 2024-09-12T00:25:43.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.528+0000 7f92b5fe3640 20 reqs_thread_entry: start 2024-09-12T00:25:43.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.528+0000 7f9404b23800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:43.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.528+0000 7f9404b23800 20 Filter name: none 2024-09-12T00:25:43.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.529+0000 7f92277fe640 20 reqs_thread_entry: start 2024-09-12T00:25:43.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.529+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.529+0000 7f9404b23800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:43.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.529+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.530+0000 7f9404b23800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:25:43.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.530+0000 7f9404b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:43.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.530+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.530+0000 7f9404b23800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:43.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.530+0000 7f9404b23800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.531+0000 7f9404b23800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:25:43.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.531+0000 7f9404b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:43.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.532+0000 7f92b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:43.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.535+0000 7f9404b23800 20 remove_watcher() i=0 2024-09-12T00:25:43.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.535+0000 7f9404b23800 2 removed watcher, disabling cache 2024-09-12T00:25:43.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.536+0000 7f9404b23800 20 remove_watcher() i=1 2024-09-12T00:25:43.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.537+0000 7f9404b23800 20 remove_watcher() i=2 2024-09-12T00:25:43.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.539+0000 7f9404b23800 20 remove_watcher() i=3 2024-09-12T00:25:43.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.540+0000 7f9404b23800 20 remove_watcher() i=4 2024-09-12T00:25:43.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.541+0000 7f9404b23800 20 remove_watcher() i=5 2024-09-12T00:25:43.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.542+0000 7f9404b23800 20 remove_watcher() i=6 2024-09-12T00:25:43.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.543+0000 7f9404b23800 20 remove_watcher() i=7 2024-09-12T00:25:43.553 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.553 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:25:43.553 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-trim-reshard-log-entries id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:25:43.553 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:25:43.556 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:43.556 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:43.588 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:25:43.588 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:25:43.644 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:25:43.676 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:43.676 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:43.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.718+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.719+0000 7f3ff5123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.719+0000 7f3ff5123800 20 realm 2024-09-12T00:25:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.719+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.719+0000 7f3ff5123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.719+0000 7f3ff5123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.719+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.719+0000 7f3ff5123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.719+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.720+0000 7f3ff5123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.720+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.721+0000 7f3ff5123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:43.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.721+0000 7f3ff5123800 20 searching for the correct realm 2024-09-12T00:25:43.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.722+0000 7f3ff0e0c640 0 -- 172.21.15.33:0/2098477190 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f3fe8061040 msgr2=0x7f3fe8078920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:43.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.929+0000 7f3ff060b640 0 -- 172.21.15.33:0/2098477190 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f3fe0082c20 msgr2=0x7f3fe00a1ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:43.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:25:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:25:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.935+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 20 zone default found 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 4 Realm: () 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 20 zonegroup default 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.936+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.937+0000 7f3ff5123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.937+0000 7f3ff5123800 20 started sync module instance, tier type = 2024-09-12T00:25:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.937+0000 7f3ff5123800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:25:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.946+0000 7f3ff5123800 20 add_watcher() i=0 2024-09-12T00:25:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.946+0000 7f3ff5123800 20 add_watcher() i=1 2024-09-12T00:25:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.946+0000 7f3ff5123800 20 add_watcher() i=2 2024-09-12T00:25:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.946+0000 7f3ff5123800 20 add_watcher() i=3 2024-09-12T00:25:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.946+0000 7f3ff5123800 20 add_watcher() i=4 2024-09-12T00:25:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.946+0000 7f3ff5123800 20 add_watcher() i=5 2024-09-12T00:25:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.946+0000 7f3ff5123800 20 add_watcher() i=6 2024-09-12T00:25:43.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.947+0000 7f3ff5123800 20 add_watcher() i=7 2024-09-12T00:25:43.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.947+0000 7f3ff5123800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:43.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.949+0000 7f3ea6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:43.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.949+0000 7f3ff5123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:43.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.949+0000 7f3ff5123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:43.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.949+0000 7f3ff5123800 5 note: GC not initialized 2024-09-12T00:25:43.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.949+0000 7f3ea5fe3640 20 reqs_thread_entry: start 2024-09-12T00:25:43.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:43.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 20 Filter name: none 2024-09-12T00:25:43.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3e177fe640 20 reqs_thread_entry: start 2024-09-12T00:25:43.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:25:43.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:25:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:25:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:25:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 : miss 2024-09-12T00:25:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.950+0000 7f3ff5123800 20 rados->read ofs=0 len=0 2024-09-12T00:25:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.951+0000 7f3ff5123800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:25:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.951+0000 7f3ff5123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:25:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.951+0000 7f3ff5123800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:25:43.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.951+0000 7f3ff5123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:43.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.951+0000 7f3ff5123800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:25:43.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.951+0000 7f3ff5123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 2024-09-12T00:25:43.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.952+0000 7f3ff5123800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to be held by another RGW process; skipping for now 2024-09-12T00:25:43.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.953+0000 7f3ea6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:43.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.955+0000 7f3ff5123800 20 remove_watcher() i=0 2024-09-12T00:25:43.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.955+0000 7f3ff5123800 2 removed watcher, disabling cache 2024-09-12T00:25:43.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.956+0000 7f3ff5123800 20 remove_watcher() i=1 2024-09-12T00:25:43.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.957+0000 7f3ff5123800 20 remove_watcher() i=2 2024-09-12T00:25:43.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.959+0000 7f3ff5123800 20 remove_watcher() i=3 2024-09-12T00:25:43.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.960+0000 7f3ff5123800 20 remove_watcher() i=4 2024-09-12T00:25:43.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.960+0000 7f3ff5123800 20 remove_watcher() i=5 2024-09-12T00:25:43.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.961+0000 7f3ff5123800 20 remove_watcher() i=6 2024-09-12T00:25:43.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:25:43.963+0000 7f3ff5123800 20 remove_watcher() i=7 2024-09-12T00:25:43.972 INFO:tasks.workunit.client.0.smithi033.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:26:13.986 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:26:14.022 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:14.022 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:14.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.069+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.071+0000 7f6f92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.071+0000 7f6f92936800 20 realm 2024-09-12T00:26:14.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.071+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.071+0000 7f6f92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.071+0000 7f6f92936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:14.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.071+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.071+0000 7f6f92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.071+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.072+0000 7f6f92936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:14.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.072+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.073+0000 7f6f92936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:14.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.073+0000 7f6f92936800 20 searching for the correct realm 2024-09-12T00:26:14.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.076+0000 7f6f8e6b7640 0 -- 172.21.15.33:0/111599237 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f6f8809c190 msgr2=0x7f6f88062a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:14.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.081+0000 7f6f8e6b7640 0 -- 172.21.15.33:0/111599237 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f6f840011e0 msgr2=0x7f6f840bf210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:14.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:14.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:14.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:14.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:14.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:14.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:14.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:14.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.289+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 20 zone default found 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 4 Realm: () 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 20 zonegroup default 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.290+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.291+0000 7f6f92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.291+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.291+0000 7f6f92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.291+0000 7f6f92936800 20 started sync module instance, tier type = 2024-09-12T00:26:14.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.291+0000 7f6f92936800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:14.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.301+0000 7f6f92936800 20 add_watcher() i=0 2024-09-12T00:26:14.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.301+0000 7f6f92936800 20 add_watcher() i=1 2024-09-12T00:26:14.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.301+0000 7f6f92936800 20 add_watcher() i=2 2024-09-12T00:26:14.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.301+0000 7f6f92936800 20 add_watcher() i=3 2024-09-12T00:26:14.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.301+0000 7f6f92936800 20 add_watcher() i=4 2024-09-12T00:26:14.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.301+0000 7f6f92936800 20 add_watcher() i=5 2024-09-12T00:26:14.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.302+0000 7f6f92936800 20 add_watcher() i=6 2024-09-12T00:26:14.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.303+0000 7f6f92936800 20 add_watcher() i=7 2024-09-12T00:26:14.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.303+0000 7f6f92936800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:14.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.305+0000 7f6e457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:14.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.305+0000 7f6f92936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:14.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.305+0000 7f6f92936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:14.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.305+0000 7f6f92936800 5 note: GC not initialized 2024-09-12T00:26:14.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.305+0000 7f6e3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:14.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.305+0000 7f6f92936800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:14.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6f92936800 20 Filter name: none 2024-09-12T00:26:14.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6e3d7fa640 20 reqs_thread_entry: start 2024-09-12T00:26:14.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6f92936800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:26:14.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6f92936800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:26:14.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6f92936800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:26:14.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6f92936800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:26:14.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6f92936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 : miss 2024-09-12T00:26:14.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.306+0000 7f6f92936800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.307+0000 7f6f92936800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:26:14.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.307+0000 7f6f92936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:26:14.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.307+0000 7f6f92936800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:26:14.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.307+0000 7f6f92936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:14.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.307+0000 7f6f92936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:14.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.307+0000 7f6f92936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 2024-09-12T00:26:14.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.308+0000 7f6f92936800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:26:14.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.316+0000 7f6f92936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:26:14.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.316+0000 7f6f92936800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:26:14.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.316+0000 7f6f92936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:14.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.316+0000 7f6f92936800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28, ofs0, ns] 2024-09-12T00:26:14.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.317+0000 7f6e717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366237 cookie 94913924428224 notifier 6921 bl.length()=1023 2024-09-12T00:26:14.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.317+0000 7f6e717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:26:14.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.317+0000 7f6e717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:26:14.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.317+0000 7f6e717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:14.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.319+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_sources= new_sources= 2024-09-12T00:26:14.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.319+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential sources added=[] removed=[] 2024-09-12T00:26:14.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.319+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_dests= new_dests= 2024-09-12T00:26:14.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.319+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential dests added=[] removed=[] 2024-09-12T00:26:14.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.0 2024-09-12T00:26:14.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.0 2024-09-12T00:26:14.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.1 2024-09-12T00:26:14.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.1 2024-09-12T00:26:14.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.2 2024-09-12T00:26:14.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.2 2024-09-12T00:26:14.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.3 2024-09-12T00:26:14.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.3 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.4 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.4 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.5 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.5 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.6 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.6 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.7 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.7 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.8 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.8 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.9 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.9 2024-09-12T00:26:14.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.10 2024-09-12T00:26:14.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.10 2024-09-12T00:26:14.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.11 2024-09-12T00:26:14.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2.11 2024-09-12T00:26:14.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.324+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.0 2024-09-12T00:26:14.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.325+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.1 2024-09-12T00:26:14.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.325+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2 2024-09-12T00:26:14.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.326+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.3 2024-09-12T00:26:14.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.326+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.4 2024-09-12T00:26:14.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.327+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.5 2024-09-12T00:26:14.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.327+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.6 2024-09-12T00:26:14.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.328+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.7 2024-09-12T00:26:14.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.328+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.8 2024-09-12T00:26:14.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.329+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.9 2024-09-12T00:26:14.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.330+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.10 2024-09-12T00:26:14.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.333+0000 7f6f92936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:14.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.333+0000 7f6f92936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 2024-09-12T00:26:14.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.335+0000 7f6f92936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:26:14.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.335+0000 7f6f92936800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:26:14.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.335+0000 7f6f92936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:14.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.335+0000 7f6f92936800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28, ofs0, ns] 2024-09-12T00:26:14.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.335+0000 7f6e717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366238 cookie 94913924428224 notifier 6921 bl.length()=1023 2024-09-12T00:26:14.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.335+0000 7f6e717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:26:14.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.335+0000 7f6e717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:26:14.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.335+0000 7f6e717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:14.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.337+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_sources= new_sources= 2024-09-12T00:26:14.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.337+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential sources added=[] removed=[] 2024-09-12T00:26:14.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.337+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_dests= new_dests= 2024-09-12T00:26:14.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.337+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential dests added=[] removed=[] 2024-09-12T00:26:14.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.340+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.0 2024-09-12T00:26:14.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.340+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.1 2024-09-12T00:26:14.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.341+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.2 2024-09-12T00:26:14.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.341+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.3 2024-09-12T00:26:14.340 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.342+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.4 2024-09-12T00:26:14.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.342+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.5 2024-09-12T00:26:14.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.342+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.6 2024-09-12T00:26:14.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.343+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.7 2024-09-12T00:26:14.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.343+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.8 2024-09-12T00:26:14.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.344+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.9 2024-09-12T00:26:14.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.344+0000 7f6f92936800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28.10 2024-09-12T00:26:14.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.344+0000 7f6f92936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:14.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.344+0000 7f6f92936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 2024-09-12T00:26:14.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.346+0000 7f6f92936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:26:14.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.346+0000 7f6f92936800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:26:14.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.346+0000 7f6f92936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:14.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.346+0000 7f6f92936800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28, ofs0, ns] 2024-09-12T00:26:14.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.346+0000 7f6e717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366239 cookie 94913924428224 notifier 6921 bl.length()=991 2024-09-12T00:26:14.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.346+0000 7f6e717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 info.flags=0x17 2024-09-12T00:26:14.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.346+0000 7f6e717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 to cache LRU end 2024-09-12T00:26:14.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.346+0000 7f6e717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:14.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.348+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_sources= new_sources= 2024-09-12T00:26:14.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.348+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential sources added=[] removed=[] 2024-09-12T00:26:14.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.348+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): orig_dests= new_dests= 2024-09-12T00:26:14.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.348+0000 7f6f92936800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28]): potential dests added=[] removed=[] 2024-09-12T00:26:14.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.351+0000 7f6f92936800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:26:14.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.353+0000 7f6e457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:14.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.355+0000 7f6f92936800 20 remove_watcher() i=0 2024-09-12T00:26:14.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.355+0000 7f6f92936800 2 removed watcher, disabling cache 2024-09-12T00:26:14.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.357+0000 7f6f92936800 20 remove_watcher() i=1 2024-09-12T00:26:14.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.358+0000 7f6f92936800 20 remove_watcher() i=2 2024-09-12T00:26:14.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.359+0000 7f6f92936800 20 remove_watcher() i=3 2024-09-12T00:26:14.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.360+0000 7f6f92936800 20 remove_watcher() i=4 2024-09-12T00:26:14.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.361+0000 7f6f92936800 20 remove_watcher() i=5 2024-09-12T00:26:14.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.362+0000 7f6f92936800 20 remove_watcher() i=6 2024-09-12T00:26:14.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.363+0000 7f6f92936800 20 remove_watcher() i=7 2024-09-12T00:26:14.376 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:26:14.406 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:14.406 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:14.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.449+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.450+0000 7f9630a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.450+0000 7f9630a98800 20 realm 2024-09-12T00:26:14.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.450+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.451+0000 7f9630a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.451+0000 7f9630a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:14.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.451+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.451+0000 7f9630a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.451+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.452+0000 7f9630a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:14.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.452+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.453+0000 7f9630a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:14.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.453+0000 7f9630a98800 20 searching for the correct realm 2024-09-12T00:26:14.454 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.456+0000 7f962ed83640 0 -- 172.21.15.33:0/954045801 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x560cfb0cf4e0 msgr2=0x560cfb0d19a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:14.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.459+0000 7f962e582640 0 -- 172.21.15.33:0/954045801 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f962405ff80 msgr2=0x7f962407a190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:14.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:14.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:14.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:14.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:14.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:14.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:14.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:14.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.464+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:14.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 20 zone default found 2024-09-12T00:26:14.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 4 Realm: () 2024-09-12T00:26:14.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 20 zonegroup default 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.465+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.466+0000 7f9630a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.466+0000 7f9630a98800 20 started sync module instance, tier type = 2024-09-12T00:26:14.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.466+0000 7f9630a98800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:14.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.474+0000 7f9630a98800 20 add_watcher() i=0 2024-09-12T00:26:14.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.474+0000 7f9630a98800 20 add_watcher() i=1 2024-09-12T00:26:14.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.474+0000 7f9630a98800 20 add_watcher() i=2 2024-09-12T00:26:14.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.474+0000 7f9630a98800 20 add_watcher() i=3 2024-09-12T00:26:14.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.474+0000 7f9630a98800 20 add_watcher() i=4 2024-09-12T00:26:14.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.474+0000 7f9630a98800 20 add_watcher() i=5 2024-09-12T00:26:14.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.474+0000 7f9630a98800 20 add_watcher() i=6 2024-09-12T00:26:14.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.475+0000 7f9630a98800 20 add_watcher() i=7 2024-09-12T00:26:14.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.475+0000 7f9630a98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:14.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.478+0000 7f94e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:14.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.478+0000 7f9630a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:14.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.478+0000 7f9630a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:14.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.478+0000 7f9630a98800 5 note: GC not initialized 2024-09-12T00:26:14.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.478+0000 7f945f7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:14.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.478+0000 7f9630a98800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:14.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.478+0000 7f9630a98800 20 Filter name: none 2024-09-12T00:26:14.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.479+0000 7f945d7fa640 20 reqs_thread_entry: start 2024-09-12T00:26:14.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.479+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.479+0000 7f9630a98800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:26:14.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.479+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.480+0000 7f9630a98800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:26:14.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.480+0000 7f9630a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:14.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.480+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.480+0000 7f9630a98800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:26:14.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.480+0000 7f9630a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:14.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.481+0000 7f9630a98800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:26:14.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.481+0000 7f9630a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:14.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.482+0000 7f94e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:14.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.485+0000 7f9630a98800 20 remove_watcher() i=0 2024-09-12T00:26:14.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.485+0000 7f9630a98800 2 removed watcher, disabling cache 2024-09-12T00:26:14.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.486+0000 7f9630a98800 20 remove_watcher() i=1 2024-09-12T00:26:14.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.487+0000 7f9630a98800 20 remove_watcher() i=2 2024-09-12T00:26:14.486 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.488+0000 7f9630a98800 20 remove_watcher() i=3 2024-09-12T00:26:14.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.489+0000 7f9630a98800 20 remove_watcher() i=4 2024-09-12T00:26:14.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.489+0000 7f9630a98800 20 remove_watcher() i=5 2024-09-12T00:26:14.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.491+0000 7f9630a98800 20 remove_watcher() i=6 2024-09-12T00:26:14.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:14.491+0000 7f9630a98800 20 remove_watcher() i=7 2024-09-12T00:26:14.501 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:14.501 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:14.502 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-trim-reshard-log-entries id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:26:14.502 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:14.504 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:14.504 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:14.525 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:14.525 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:14.710 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:14.710 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:14.846 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:26:14.846 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:14.847 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:14.847 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:14.896 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:14.896 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:14.953 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:14.953 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:14.991 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:14.992 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.026 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.026 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.060 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.061 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.093 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.093 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.129 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.129 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.165 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.165 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.198 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.198 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.232 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.232 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.268 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.268 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.302 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.302 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.336 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.336 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.372 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.372 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.406 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.406 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.440 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.440 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.474 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.474 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.508 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.509 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.544 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.545 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.576 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.577 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.610 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:15.610 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:15.645 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:26:15.674 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:15.674 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:15.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.714+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.716+0000 7fd798926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:15.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.716+0000 7fd798926800 20 realm 2024-09-12T00:26:15.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.716+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.716+0000 7fd798926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:15.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.716+0000 7fd798926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:15.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.716+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.716+0000 7fd798926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:15.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.716+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.718+0000 7fd798926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:15.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.718+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.719+0000 7fd798926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:15.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.719+0000 7fd798926800 20 searching for the correct realm 2024-09-12T00:26:15.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.721+0000 7fd7945d9640 0 -- 172.21.15.33:0/3581622714 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd78c029420 msgr2=0x7fd78c0298a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:15.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.724+0000 7fd7945d9640 0 -- 172.21.15.33:0/3581622714 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd7880760b0 msgr2=0x7fd788067730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:15.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:15.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:15.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:15.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:15.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:15.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:15.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:15.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.931+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:15.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 20 zone default found 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 4 Realm: () 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 20 zonegroup default 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:15.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.932+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.933+0000 7fd798926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:15.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.933+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.933+0000 7fd798926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:15.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.933+0000 7fd798926800 20 started sync module instance, tier type = 2024-09-12T00:26:15.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.933+0000 7fd798926800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:15.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.942+0000 7fd798926800 20 add_watcher() i=0 2024-09-12T00:26:15.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.942+0000 7fd798926800 20 add_watcher() i=1 2024-09-12T00:26:15.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.942+0000 7fd798926800 20 add_watcher() i=2 2024-09-12T00:26:15.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.942+0000 7fd798926800 20 add_watcher() i=3 2024-09-12T00:26:15.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.942+0000 7fd798926800 20 add_watcher() i=4 2024-09-12T00:26:15.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.942+0000 7fd798926800 20 add_watcher() i=5 2024-09-12T00:26:15.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.942+0000 7fd798926800 20 add_watcher() i=6 2024-09-12T00:26:15.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.943+0000 7fd798926800 20 add_watcher() i=7 2024-09-12T00:26:15.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.943+0000 7fd798926800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:15.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.945+0000 7fd64afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:15.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.945+0000 7fd798926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:15.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.945+0000 7fd798926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:15.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.945+0000 7fd798926800 5 note: GC not initialized 2024-09-12T00:26:15.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.945+0000 7fd649fdb640 20 reqs_thread_entry: start 2024-09-12T00:26:15.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.945+0000 7fd798926800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:15.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.945+0000 7fd798926800 20 Filter name: none 2024-09-12T00:26:15.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.945+0000 7fd5bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:15.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.946+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.946+0000 7fd798926800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:15.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.946+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.947+0000 7fd798926800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:15.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.947+0000 7fd798926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:15.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.947+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.947+0000 7fd798926800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:15.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.947+0000 7fd798926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:15.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.947+0000 7fd798926800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:15.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.947+0000 7fd798926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:15.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.949+0000 7fd64afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:15.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.951+0000 7fd798926800 20 remove_watcher() i=0 2024-09-12T00:26:15.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.951+0000 7fd798926800 2 removed watcher, disabling cache 2024-09-12T00:26:15.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.952+0000 7fd798926800 20 remove_watcher() i=1 2024-09-12T00:26:15.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.953+0000 7fd798926800 20 remove_watcher() i=2 2024-09-12T00:26:15.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.954+0000 7fd798926800 20 remove_watcher() i=3 2024-09-12T00:26:15.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.955+0000 7fd798926800 20 remove_watcher() i=4 2024-09-12T00:26:15.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.956+0000 7fd798926800 20 remove_watcher() i=5 2024-09-12T00:26:15.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.957+0000 7fd798926800 20 remove_watcher() i=6 2024-09-12T00:26:15.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:15.958+0000 7fd798926800 20 remove_watcher() i=7 2024-09-12T00:26:15.968 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:15.968 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:15.968 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-block-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:15.969 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:15.970 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:26:16.005 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:16.005 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:16.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.046+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.047+0000 7f0ee4346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.047+0000 7f0ee4346800 20 realm 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.047+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.048+0000 7f0ee4346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.048+0000 7f0ee4346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.048+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.048+0000 7f0ee4346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.048+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.049+0000 7f0ee4346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:16.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.049+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.050+0000 7f0ee4346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:16.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.050+0000 7f0ee4346800 20 searching for the correct realm 2024-09-12T00:26:16.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.052+0000 7f0ee1e37640 0 -- 172.21.15.33:0/3563318266 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f0edc069040 msgr2=0x7f0edc069930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:16.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.056+0000 7f0ee1e37640 0 -- 172.21.15.33:0/3563318266 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f0ed8096040 msgr2=0x7f0ed80675e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:16.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:16.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:16.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:16.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:16.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:16.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:16.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:16.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.263+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 20 zone default found 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 4 Realm: () 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 20 zonegroup default 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.264+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.265+0000 7f0ee4346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.265+0000 7f0ee4346800 20 started sync module instance, tier type = 2024-09-12T00:26:16.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.265+0000 7f0ee4346800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:16.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.274+0000 7f0ee4346800 20 add_watcher() i=0 2024-09-12T00:26:16.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.274+0000 7f0ee4346800 20 add_watcher() i=1 2024-09-12T00:26:16.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.274+0000 7f0ee4346800 20 add_watcher() i=2 2024-09-12T00:26:16.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.274+0000 7f0ee4346800 20 add_watcher() i=3 2024-09-12T00:26:16.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.274+0000 7f0ee4346800 20 add_watcher() i=4 2024-09-12T00:26:16.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.274+0000 7f0ee4346800 20 add_watcher() i=5 2024-09-12T00:26:16.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.274+0000 7f0ee4346800 20 add_watcher() i=6 2024-09-12T00:26:16.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.275+0000 7f0ee4346800 20 add_watcher() i=7 2024-09-12T00:26:16.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.275+0000 7f0ee4346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:16.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.277+0000 7f0d937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:16.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.277+0000 7f0ee4346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:16.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.277+0000 7f0ee4346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:16.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.277+0000 7f0ee4346800 5 note: GC not initialized 2024-09-12T00:26:16.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.277+0000 7f0d927fc640 20 reqs_thread_entry: start 2024-09-12T00:26:16.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.277+0000 7f0ee4346800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:16.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.277+0000 7f0ee4346800 20 Filter name: none 2024-09-12T00:26:16.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.278+0000 7f0d03fff640 20 reqs_thread_entry: start 2024-09-12T00:26:16.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.278+0000 7f0ee4346800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:26:16.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.278+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.278+0000 7f0ee4346800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:16.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.278+0000 7f0ee4346800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:26:16.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.278+0000 7f0ee4346800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:26:16.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.278+0000 7f0ee4346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 : miss 2024-09-12T00:26:16.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.278+0000 7f0ee4346800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.279+0000 7f0ee4346800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:16.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.279+0000 7f0ee4346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:16.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.279+0000 7f0ee4346800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:16.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.279+0000 7f0ee4346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:16.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.279+0000 7f0ee4346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:16.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.279+0000 7f0ee4346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 2024-09-12T00:26:16.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.286+0000 7f0ee4346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:16.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.286+0000 7f0ee4346800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:16.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.286+0000 7f0ee4346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:16.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.286+0000 7f0ee4346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29, ofs0, ns] 2024-09-12T00:26:16.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.287+0000 7f0dc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94283598185760 notifier 6569 bl.length()=999 2024-09-12T00:26:16.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.287+0000 7f0dc57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:16.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.287+0000 7f0dc57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:16.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.287+0000 7f0dc57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:16.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.288+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_sources= new_sources= 2024-09-12T00:26:16.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.289+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential sources added=[] removed=[] 2024-09-12T00:26:16.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.289+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_dests= new_dests= 2024-09-12T00:26:16.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.289+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential dests added=[] removed=[] 2024-09-12T00:26:16.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.0 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.0 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.1 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.1 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.2 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.2 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.3 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.3 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.4 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.4 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.5 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.5 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.6 2024-09-12T00:26:16.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.6 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.7 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.7 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.8 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.8 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.9 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.9 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.10 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.10 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.11 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.11 2024-09-12T00:26:16.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.0 2024-09-12T00:26:16.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.293+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1 2024-09-12T00:26:16.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.294+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.2 2024-09-12T00:26:16.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.294+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.3 2024-09-12T00:26:16.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.295+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.4 2024-09-12T00:26:16.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.295+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.5 2024-09-12T00:26:16.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.296+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.6 2024-09-12T00:26:16.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.297+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.7 2024-09-12T00:26:16.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.297+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.8 2024-09-12T00:26:16.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.297+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.9 2024-09-12T00:26:16.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.298+0000 7f0ee4346800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.10 2024-09-12T00:26:16.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.301+0000 7f0ee4346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:16.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.301+0000 7f0ee4346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 2024-09-12T00:26:16.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.303+0000 7f0ee4346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:16.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.303+0000 7f0ee4346800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:16.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.303+0000 7f0ee4346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:16.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.303+0000 7f0ee4346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29, ofs0, ns] 2024-09-12T00:26:16.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.303+0000 7f0dc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94283598185760 notifier 6569 bl.length()=999 2024-09-12T00:26:16.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.303+0000 7f0dc57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:16.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.303+0000 7f0dc57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:16.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.303+0000 7f0dc57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:16.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.304+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_sources= new_sources= 2024-09-12T00:26:16.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.305+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential sources added=[] removed=[] 2024-09-12T00:26:16.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.305+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_dests= new_dests= 2024-09-12T00:26:16.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.305+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential dests added=[] removed=[] 2024-09-12T00:26:16.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.305+0000 7f0ee4346800 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:26:16.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.305+0000 7f0ee4346800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:26:16.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.311+0000 7f0ee4346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:16.309 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.311+0000 7f0ee4346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 2024-09-12T00:26:16.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.312+0000 7f0ee4346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:16.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.312+0000 7f0ee4346800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:16.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.312+0000 7f0ee4346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:16.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.312+0000 7f0ee4346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29, ofs0, ns] 2024-09-12T00:26:16.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.312+0000 7f0dc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94283598185760 notifier 6569 bl.length()=967 2024-09-12T00:26:16.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.312+0000 7f0dc57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:16.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.312+0000 7f0dc57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:16.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.312+0000 7f0dc57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:16.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.314+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_sources= new_sources= 2024-09-12T00:26:16.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.314+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential sources added=[] removed=[] 2024-09-12T00:26:16.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.314+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_dests= new_dests= 2024-09-12T00:26:16.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.314+0000 7f0ee4346800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential dests added=[] removed=[] 2024-09-12T00:26:16.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.318+0000 7f0ee4346800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:26:16.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.320+0000 7f0d937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:16.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.322+0000 7f0ee4346800 20 remove_watcher() i=0 2024-09-12T00:26:16.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.322+0000 7f0ee4346800 2 removed watcher, disabling cache 2024-09-12T00:26:16.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.323+0000 7f0ee4346800 20 remove_watcher() i=1 2024-09-12T00:26:16.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.324+0000 7f0ee4346800 20 remove_watcher() i=2 2024-09-12T00:26:16.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.326+0000 7f0ee4346800 20 remove_watcher() i=3 2024-09-12T00:26:16.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.327+0000 7f0ee4346800 20 remove_watcher() i=4 2024-09-12T00:26:16.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.328+0000 7f0ee4346800 20 remove_watcher() i=5 2024-09-12T00:26:16.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.329+0000 7f0ee4346800 20 remove_watcher() i=6 2024-09-12T00:26:16.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.330+0000 7f0ee4346800 20 remove_watcher() i=7 2024-09-12T00:26:16.341 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:26:16.371 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:16.371 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:16.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.412+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.413+0000 7f5e58736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.413+0000 7f5e58736800 20 realm 2024-09-12T00:26:16.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.413+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.413+0000 7f5e58736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.413+0000 7f5e58736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:16.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.413+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.414+0000 7f5e58736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.414+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.414+0000 7f5e58736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:16.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.414+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.415+0000 7f5e58736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:16.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.415+0000 7f5e58736800 20 searching for the correct realm 2024-09-12T00:26:16.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.417+0000 7f5e53cb6640 0 -- 172.21.15.33:0/3002887111 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f5e4408f050 msgr2=0x7f5e4408f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:16.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.422+0000 7f5e544b7640 0 -- 172.21.15.33:0/3002887111 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f5e480682f0 msgr2=0x7f5e4807e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:16.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:16.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:16.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:16.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:16.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:16.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:16.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.629+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 20 zone default found 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 4 Realm: () 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 20 zonegroup default 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.630+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.631+0000 7f5e58736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.631+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.630 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.631+0000 7f5e58736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.631+0000 7f5e58736800 20 started sync module instance, tier type = 2024-09-12T00:26:16.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.631+0000 7f5e58736800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:16.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.640+0000 7f5e58736800 20 add_watcher() i=0 2024-09-12T00:26:16.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.640+0000 7f5e58736800 20 add_watcher() i=1 2024-09-12T00:26:16.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.640+0000 7f5e58736800 20 add_watcher() i=2 2024-09-12T00:26:16.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.640+0000 7f5e58736800 20 add_watcher() i=3 2024-09-12T00:26:16.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.640+0000 7f5e58736800 20 add_watcher() i=4 2024-09-12T00:26:16.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.640+0000 7f5e58736800 20 add_watcher() i=5 2024-09-12T00:26:16.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.640+0000 7f5e58736800 20 add_watcher() i=6 2024-09-12T00:26:16.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.641+0000 7f5e58736800 20 add_watcher() i=7 2024-09-12T00:26:16.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.641+0000 7f5e58736800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:16.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.643+0000 7f5d0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:16.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.643+0000 7f5e58736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:16.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.643+0000 7f5e58736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:16.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.643+0000 7f5e58736800 5 note: GC not initialized 2024-09-12T00:26:16.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.643+0000 7f5d09fdb640 20 reqs_thread_entry: start 2024-09-12T00:26:16.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.643+0000 7f5e58736800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:16.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.643+0000 7f5e58736800 20 Filter name: none 2024-09-12T00:26:16.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.644+0000 7f5c7b7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:16.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.644+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.644+0000 7f5e58736800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:16.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.644+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.645+0000 7f5e58736800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:16.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.645+0000 7f5e58736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:16.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.645+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.645+0000 7f5e58736800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:16.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.645+0000 7f5e58736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.645+0000 7f5e58736800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:16.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.645+0000 7f5e58736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:16.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.647+0000 7f5d0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:16.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.649+0000 7f5e58736800 20 remove_watcher() i=0 2024-09-12T00:26:16.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.649+0000 7f5e58736800 2 removed watcher, disabling cache 2024-09-12T00:26:16.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.650+0000 7f5e58736800 20 remove_watcher() i=1 2024-09-12T00:26:16.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.651+0000 7f5e58736800 20 remove_watcher() i=2 2024-09-12T00:26:16.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.652+0000 7f5e58736800 20 remove_watcher() i=3 2024-09-12T00:26:16.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.653+0000 7f5e58736800 20 remove_watcher() i=4 2024-09-12T00:26:16.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.654+0000 7f5e58736800 20 remove_watcher() i=5 2024-09-12T00:26:16.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.655+0000 7f5e58736800 20 remove_watcher() i=6 2024-09-12T00:26:16.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.656+0000 7f5e58736800 20 remove_watcher() i=7 2024-09-12T00:26:16.666 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:16.666 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:16.666 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-block-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:16.666 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:16.668 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:16.668 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:16.700 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:16.700 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:16.758 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:26:16.791 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:16.791 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:16.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.832+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.833+0000 7f4cae62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.833+0000 7f4cae62f800 20 realm 2024-09-12T00:26:16.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.833+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.833+0000 7f4cae62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.833+0000 7f4cae62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:16.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.833+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.833+0000 7f4cae62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:16.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.833+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.834+0000 7f4cae62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:16.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.834+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:16.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.835+0000 7f4cae62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:16.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.835+0000 7f4cae62f800 20 searching for the correct realm 2024-09-12T00:26:16.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.837+0000 7f4ca918a640 0 -- 172.21.15.33:0/1493637028 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x556a78fc00b0 msgr2=0x556a78fc24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:16.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:16.841+0000 7f4ca998b640 0 -- 172.21.15.33:0/1493637028 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f4ca0064970 msgr2=0x7f4ca009a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:17.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.046+0000 7f4cae62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:17.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.046+0000 7f4cae62f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:17.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.046+0000 7f4cae62f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:17.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.046+0000 7f4cae62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:17.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.046+0000 7f4cae62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:17.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.046+0000 7f4cae62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:17.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.046+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:17.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:17.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 20 zone default found 2024-09-12T00:26:17.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 4 Realm: () 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 20 zonegroup default 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.047+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.048+0000 7f4cae62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.048+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.048+0000 7f4cae62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.048+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.049+0000 7f4cae62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.049+0000 7f4cae62f800 20 started sync module instance, tier type = 2024-09-12T00:26:17.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.049+0000 7f4cae62f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:17.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.058+0000 7f4cae62f800 20 add_watcher() i=0 2024-09-12T00:26:17.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.058+0000 7f4cae62f800 20 add_watcher() i=1 2024-09-12T00:26:17.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.058+0000 7f4cae62f800 20 add_watcher() i=2 2024-09-12T00:26:17.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.058+0000 7f4cae62f800 20 add_watcher() i=3 2024-09-12T00:26:17.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.058+0000 7f4cae62f800 20 add_watcher() i=4 2024-09-12T00:26:17.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.058+0000 7f4cae62f800 20 add_watcher() i=5 2024-09-12T00:26:17.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.058+0000 7f4cae62f800 20 add_watcher() i=6 2024-09-12T00:26:17.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.059+0000 7f4cae62f800 20 add_watcher() i=7 2024-09-12T00:26:17.057 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.059+0000 7f4cae62f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:17.059 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.061+0000 7f4b5bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.061+0000 7f4cae62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.061+0000 7f4cae62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.061+0000 7f4cae62f800 5 note: GC not initialized 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.062+0000 7f4b5affd640 20 reqs_thread_entry: start 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.062+0000 7f4cae62f800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.062+0000 7f4cae62f800 20 Filter name: none 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.062+0000 7f4b58ff9640 20 reqs_thread_entry: start 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.062+0000 7f4cae62f800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:26:17.061 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.062+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:17.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:26:17.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:26:17.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 : miss 2024-09-12T00:26:17.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:17.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:17.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:17.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:17.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:17.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.063+0000 7f4cae62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 2024-09-12T00:26:17.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.068+0000 7f4cae62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:17.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.068+0000 7f4cae62f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:17.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.068+0000 7f4cae62f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:17.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.068+0000 7f4cae62f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29, ofs0, ns] 2024-09-12T00:26:17.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.068+0000 7f4b8d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 93915784720624 notifier 6599 bl.length()=999 2024-09-12T00:26:17.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.068+0000 7f4b8d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:17.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.068+0000 7f4b8d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:17.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.068+0000 7f4b8d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:17.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.070+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_sources= new_sources= 2024-09-12T00:26:17.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.070+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential sources added=[] removed=[] 2024-09-12T00:26:17.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.070+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_dests= new_dests= 2024-09-12T00:26:17.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.070+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential dests added=[] removed=[] 2024-09-12T00:26:17.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.0 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.0 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.1 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.1 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.2 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.2 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.3 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.3 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.4 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.4 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.5 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.5 2024-09-12T00:26:17.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.6 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.6 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.7 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.7 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.8 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.8 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.9 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.9 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.10 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.10 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.11 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1.11 2024-09-12T00:26:17.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.0 2024-09-12T00:26:17.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.075+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1 2024-09-12T00:26:17.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.076+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.2 2024-09-12T00:26:17.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.076+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.3 2024-09-12T00:26:17.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.077+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.4 2024-09-12T00:26:17.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.077+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.5 2024-09-12T00:26:17.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.078+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.6 2024-09-12T00:26:17.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.078+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.7 2024-09-12T00:26:17.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.079+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.8 2024-09-12T00:26:17.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.080+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.9 2024-09-12T00:26:17.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.080+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.10 2024-09-12T00:26:17.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.083+0000 7f4cae62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:17.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.083+0000 7f4cae62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 2024-09-12T00:26:17.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.084+0000 7f4cae62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:17.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.084+0000 7f4cae62f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:17.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.084+0000 7f4cae62f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:17.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.084+0000 7f4cae62f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29, ofs0, ns] 2024-09-12T00:26:17.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.085+0000 7f4b8cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 93915784720624 notifier 6599 bl.length()=999 2024-09-12T00:26:17.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.085+0000 7f4b8cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:17.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.085+0000 7f4b8cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:17.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.085+0000 7f4b8cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:17.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.086+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_sources= new_sources= 2024-09-12T00:26:17.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.086+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential sources added=[] removed=[] 2024-09-12T00:26:17.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.086+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_dests= new_dests= 2024-09-12T00:26:17.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.086+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential dests added=[] removed=[] 2024-09-12T00:26:17.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.089+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.0 2024-09-12T00:26:17.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.089+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.1 2024-09-12T00:26:17.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.089+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.2 2024-09-12T00:26:17.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.090+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.3 2024-09-12T00:26:17.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.090+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.4 2024-09-12T00:26:17.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.090+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.5 2024-09-12T00:26:17.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.091+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.6 2024-09-12T00:26:17.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.091+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.7 2024-09-12T00:26:17.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.092+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.8 2024-09-12T00:26:17.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.092+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.9 2024-09-12T00:26:17.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.092+0000 7f4cae62f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29.10 2024-09-12T00:26:17.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.092+0000 7f4cae62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:17.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.092+0000 7f4cae62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 2024-09-12T00:26:17.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.094+0000 7f4cae62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:17.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.094+0000 7f4cae62f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:17.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.094+0000 7f4cae62f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:17.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.094+0000 7f4cae62f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29, ofs0, ns] 2024-09-12T00:26:17.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.094+0000 7f4b8cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 93915784720624 notifier 6599 bl.length()=967 2024-09-12T00:26:17.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.094+0000 7f4b8cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 info.flags=0x17 2024-09-12T00:26:17.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.094+0000 7f4b8cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 to cache LRU end 2024-09-12T00:26:17.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.094+0000 7f4b8cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:17.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.096+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_sources= new_sources= 2024-09-12T00:26:17.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.096+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential sources added=[] removed=[] 2024-09-12T00:26:17.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.096+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): orig_dests= new_dests= 2024-09-12T00:26:17.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.096+0000 7f4cae62f800 20 handle_bi_update(): bucket=:error-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29]): potential dests added=[] removed=[] 2024-09-12T00:26:17.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.098+0000 7f4cae62f800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:26:17.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.100+0000 7f4b5bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:17.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.102+0000 7f4cae62f800 20 remove_watcher() i=0 2024-09-12T00:26:17.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.102+0000 7f4cae62f800 2 removed watcher, disabling cache 2024-09-12T00:26:17.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.103+0000 7f4cae62f800 20 remove_watcher() i=1 2024-09-12T00:26:17.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.104+0000 7f4cae62f800 20 remove_watcher() i=2 2024-09-12T00:26:17.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.105+0000 7f4cae62f800 20 remove_watcher() i=3 2024-09-12T00:26:17.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.106+0000 7f4cae62f800 20 remove_watcher() i=4 2024-09-12T00:26:17.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.107+0000 7f4cae62f800 20 remove_watcher() i=5 2024-09-12T00:26:17.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.108+0000 7f4cae62f800 20 remove_watcher() i=6 2024-09-12T00:26:17.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.109+0000 7f4cae62f800 20 remove_watcher() i=7 2024-09-12T00:26:17.121 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:26:17.150 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:17.150 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:17.191 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.192+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.194+0000 7ffa80ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.194+0000 7ffa80ebb800 20 realm 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.194+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.194+0000 7ffa80ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.194+0000 7ffa80ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.194+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.194+0000 7ffa80ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.194+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.195+0000 7ffa80ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:17.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.195+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.196+0000 7ffa80ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:17.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.196+0000 7ffa80ebb800 20 searching for the correct realm 2024-09-12T00:26:17.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.198+0000 7ffa7e1ab640 0 -- 172.21.15.33:0/1342475096 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7ffa700ce040 msgr2=0x7ffa70098460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:17.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.202+0000 7ffa7e9ac640 0 -- 172.21.15.33:0/1342475096 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7ffa74099a30 msgr2=0x7ffa74048a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:17.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.409+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 zone default found 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 4 Realm: () 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 zonegroup default 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 started sync module instance, tier type = 2024-09-12T00:26:17.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.410+0000 7ffa80ebb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:17.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 20 add_watcher() i=0 2024-09-12T00:26:17.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 20 add_watcher() i=1 2024-09-12T00:26:17.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 20 add_watcher() i=2 2024-09-12T00:26:17.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 20 add_watcher() i=3 2024-09-12T00:26:17.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 20 add_watcher() i=4 2024-09-12T00:26:17.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 20 add_watcher() i=5 2024-09-12T00:26:17.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 20 add_watcher() i=6 2024-09-12T00:26:17.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 20 add_watcher() i=7 2024-09-12T00:26:17.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.420+0000 7ffa80ebb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:17.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.422+0000 7ff9357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:17.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.423+0000 7ffa80ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:17.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.423+0000 7ffa80ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:17.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.423+0000 7ffa80ebb800 5 note: GC not initialized 2024-09-12T00:26:17.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.423+0000 7ff8affff640 20 reqs_thread_entry: start 2024-09-12T00:26:17.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.423+0000 7ffa80ebb800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:17.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.423+0000 7ffa80ebb800 20 Filter name: none 2024-09-12T00:26:17.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.423+0000 7ff8adffb640 20 reqs_thread_entry: start 2024-09-12T00:26:17.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.423+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.424+0000 7ffa80ebb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:17.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.424+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.424+0000 7ffa80ebb800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:17.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.424+0000 7ffa80ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:17.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.424+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.425+0000 7ffa80ebb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:17.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.425+0000 7ffa80ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:17.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.425+0000 7ffa80ebb800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:17.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.425+0000 7ffa80ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:17.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.427+0000 7ff9357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:17.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.429+0000 7ffa80ebb800 20 remove_watcher() i=0 2024-09-12T00:26:17.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.429+0000 7ffa80ebb800 2 removed watcher, disabling cache 2024-09-12T00:26:17.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.430+0000 7ffa80ebb800 20 remove_watcher() i=1 2024-09-12T00:26:17.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.431+0000 7ffa80ebb800 20 remove_watcher() i=2 2024-09-12T00:26:17.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.432+0000 7ffa80ebb800 20 remove_watcher() i=3 2024-09-12T00:26:17.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.433+0000 7ffa80ebb800 20 remove_watcher() i=4 2024-09-12T00:26:17.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.434+0000 7ffa80ebb800 20 remove_watcher() i=5 2024-09-12T00:26:17.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.435+0000 7ffa80ebb800 20 remove_watcher() i=6 2024-09-12T00:26:17.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:17.436+0000 7ffa80ebb800 20 remove_watcher() i=7 2024-09-12T00:26:17.446 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:17.446 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:17.446 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-block-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:26:17.446 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:17.448 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:17.448 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:17.471 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:17.471 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:17.666 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:17.666 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:17.802 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:26:17.803 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:17.803 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:17.803 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:17.854 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:17.854 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:17.911 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:17.911 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:17.948 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:17.948 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:17.982 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:17.982 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.018 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.018 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.051 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.087 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.121 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.155 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.189 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.189 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.223 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.223 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.257 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.257 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.292 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.292 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.327 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.327 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.362 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.362 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.396 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.396 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.430 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.431 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.464 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.464 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.499 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.499 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.533 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.534 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.567 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:18.568 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:18.601 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:26:18.630 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:18.630 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:18.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.670+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.672+0000 7f5d8080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:18.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.672+0000 7f5d8080e800 20 realm 2024-09-12T00:26:18.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.672+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.673+0000 7f5d8080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:18.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.673+0000 7f5d8080e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:18.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.673+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.673+0000 7f5d8080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:18.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.673+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.674+0000 7f5d8080e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:18.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.674+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.675+0000 7f5d8080e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:18.673 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.675+0000 7f5d8080e800 20 searching for the correct realm 2024-09-12T00:26:18.675 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.677+0000 7f5d7b779640 0 -- 172.21.15.33:0/201751878 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55a64c442930 msgr2=0x55a64c444d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:18.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.681+0000 7f5d7bf7a640 0 -- 172.21.15.33:0/201751878 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f5d700731d0 msgr2=0x7f5d7007f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:18.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:18.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:18.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:18.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:18.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:18.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:18.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:18.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:18.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.888+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 20 zone default found 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 4 Realm: () 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 20 zonegroup default 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:18.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.889+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.890+0000 7f5d8080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:18.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.890+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.890+0000 7f5d8080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:18.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.890+0000 7f5d8080e800 20 started sync module instance, tier type = 2024-09-12T00:26:18.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.890+0000 7f5d8080e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:18.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.899+0000 7f5d8080e800 20 add_watcher() i=0 2024-09-12T00:26:18.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.899+0000 7f5d8080e800 20 add_watcher() i=1 2024-09-12T00:26:18.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.899+0000 7f5d8080e800 20 add_watcher() i=2 2024-09-12T00:26:18.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.899+0000 7f5d8080e800 20 add_watcher() i=3 2024-09-12T00:26:18.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.899+0000 7f5d8080e800 20 add_watcher() i=4 2024-09-12T00:26:18.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.899+0000 7f5d8080e800 20 add_watcher() i=5 2024-09-12T00:26:18.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.899+0000 7f5d8080e800 20 add_watcher() i=6 2024-09-12T00:26:18.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.900+0000 7f5d8080e800 20 add_watcher() i=7 2024-09-12T00:26:18.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.900+0000 7f5d8080e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:18.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5c31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:18.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5d8080e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:18.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5d8080e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:18.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5d8080e800 5 note: GC not initialized 2024-09-12T00:26:18.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5c30fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:18.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5d8080e800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:18.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5d8080e800 20 Filter name: none 2024-09-12T00:26:18.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5baa7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:18.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.902+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.903+0000 7f5d8080e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:18.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.903+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.904+0000 7f5d8080e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:18.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.904+0000 7f5d8080e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:18.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.904+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.904+0000 7f5d8080e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:18.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.904+0000 7f5d8080e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:18.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.905+0000 7f5d8080e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:18.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.905+0000 7f5d8080e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:18.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.907+0000 7f5c31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:18.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.909+0000 7f5d8080e800 20 remove_watcher() i=0 2024-09-12T00:26:18.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.909+0000 7f5d8080e800 2 removed watcher, disabling cache 2024-09-12T00:26:18.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.911+0000 7f5d8080e800 20 remove_watcher() i=1 2024-09-12T00:26:18.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.912+0000 7f5d8080e800 20 remove_watcher() i=2 2024-09-12T00:26:18.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.913+0000 7f5d8080e800 20 remove_watcher() i=3 2024-09-12T00:26:18.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.914+0000 7f5d8080e800 20 remove_watcher() i=4 2024-09-12T00:26:18.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.915+0000 7f5d8080e800 20 remove_watcher() i=5 2024-09-12T00:26:18.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.915+0000 7f5d8080e800 20 remove_watcher() i=6 2024-09-12T00:26:18.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:18.917+0000 7f5d8080e800 20 remove_watcher() i=7 2024-09-12T00:26:18.926 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:18.926 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:18.926 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-block-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:18.927 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:18.928 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:26:18.963 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:18.963 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:19.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.003+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.005+0000 7fb600612800 20 realm 2024-09-12T00:26:19.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.005+0000 7fb600612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:19.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.006+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.006+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.007+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:19.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.007+0000 7fb600612800 20 searching for the correct realm 2024-09-12T00:26:19.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.009+0000 7fb5fbccb640 0 -- 172.21.15.33:0/1735026284 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fb5f4074040 msgr2=0x7fb5f404da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.012+0000 7fb5fbccb640 0 -- 172.21.15.33:0/1735026284 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fb5f0050b10 msgr2=0x7fb5f005d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:19.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:19.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:19.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.017+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 20 zone default found 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 4 Realm: () 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:19.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 20 zonegroup default 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.019+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.019+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.019+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.019+0000 7fb600612800 20 started sync module instance, tier type = 2024-09-12T00:26:19.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.019+0000 7fb600612800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:19.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=0 2024-09-12T00:26:19.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=1 2024-09-12T00:26:19.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=2 2024-09-12T00:26:19.026 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=3 2024-09-12T00:26:19.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=4 2024-09-12T00:26:19.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=5 2024-09-12T00:26:19.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=6 2024-09-12T00:26:19.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=7 2024-09-12T00:26:19.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.028+0000 7fb600612800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:19.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.030+0000 7fb4b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:19.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb600612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:19.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb600612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:19.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb600612800 5 note: GC not initialized 2024-09-12T00:26:19.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb4b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:19.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb600612800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:19.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb600612800 20 Filter name: none 2024-09-12T00:26:19.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb42a7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:19.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:26:19.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.031+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:19.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:26:19.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:26:19.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : miss 2024-09-12T00:26:19.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:19.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:19.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.032+0000 7fb600612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:19.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.037+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.037+0000 7fb600612800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.037+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.037+0000 7fb600612800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:19.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 94792095228896 notifier 6650 bl.length()=999 2024-09-12T00:26:19.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:19.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:19.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:19.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:19.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.0 2024-09-12T00:26:19.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.0 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.1 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.1 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.2 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.2 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.3 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.3 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.4 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.4 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.5 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.5 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.6 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.6 2024-09-12T00:26:19.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.7 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.7 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.8 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.8 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.9 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.9 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.10 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.10 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.11 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.11 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.0 2024-09-12T00:26:19.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1 2024-09-12T00:26:19.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.046+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2 2024-09-12T00:26:19.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.046+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.3 2024-09-12T00:26:19.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.047+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.4 2024-09-12T00:26:19.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.5 2024-09-12T00:26:19.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.6 2024-09-12T00:26:19.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.7 2024-09-12T00:26:19.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.049+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.8 2024-09-12T00:26:19.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.050+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.9 2024-09-12T00:26:19.048 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.050+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.10 2024-09-12T00:26:19.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.053+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:19.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.053+0000 7fb600612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:19.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.054+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.054+0000 7fb600612800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.054+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.054+0000 7fb600612800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:19.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94792095228896 notifier 6650 bl.length()=999 2024-09-12T00:26:19.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:19.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:19.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:19.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:19.055 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb600612800 time 2024-09-12T00:26:19.057278+0000 2024-09-12T00:26:19.055 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:26:19.055 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb60178c71a] 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb60178c8d8] 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636803d3641] 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5636803e2582] 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5636803e33e4] 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb600429590] 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.057+0000 7fb600612800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb600612800 time 2024-09-12T00:26:19.057278+0000 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:26:19.056 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb60178c71a] 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb60178c8d8] 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636803d3641] 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5636803e2582] 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5636803e33e4] 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb600429590] 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:26:19.057 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fb600612800 thread_name:radosgw-admin 2024-09-12T00:26:19.080 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:19.080 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb60043e6f0] 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb60048b99c] 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb60178c774] 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb60178c8d8] 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636803d3641] 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5636803e2582] 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5636803e33e4] 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb600429590] 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:26:19.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.058+0000 7fb600612800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fb600612800 thread_name:radosgw-admin 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb60043e6f0] 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb60048b99c] 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb60178c774] 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb60178c8d8] 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636803d3641] 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5636803e2582] 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5636803e33e4] 2024-09-12T00:26:19.082 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb600429590] 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:26:18.987+0000 7fb600612800 5 AuthRegistry(0x56368119fab0) adding con mode: crc 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:26:18.987+0000 7fb600612800 5 AuthRegistry(0x56368119fab0) adding con mode: secure 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:26:18.987+0000 7fb600612800 5 AuthRegistry(0x56368119fab0) adding con mode: crc 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:26:18.987+0000 7fb600612800 5 AuthRegistry(0x56368119fab0) adding con mode: secure 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:26:18.987+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:26:18.987+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:26:18.987+0000 7fb600612800 5 asok(0x563680f80630) register_command rotate-key hook 0x56368119fbf8 2024-09-12T00:26:19.083 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:26:18.987+0000 7fb600612800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:26:18.987+0000 7fb600612800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): picked mon.noname-a con 0x563681059220 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): picked mon.noname-c con 0x5636810e2f90 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): picked mon.noname-b con 0x5636810e3390 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): authenticate will time out at 2198.553048s 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): get_auth_request con 0x5636810e2f90 auth_method 0 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.084 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request con 0x563681059220 auth_method 0 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request con 0x5636810e3390 auth_method 0 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.085 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_done global_id 7071 payload 824 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient: _finish_hunting 0 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 1 monclient: found mon.noname-a 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: dump: 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.086 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: _finish_auth 0 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:19.087 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: dump: 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:26:18.988+0000 7fb600612800 5 monclient: authenticate success, global_id 7071 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.088 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:26:18.988+0000 7fb4e9e0b640 4 set_mon_vals no callback set 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:26:18.988+0000 7fb600612800 1 librados: init done 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:26:18.990+0000 7fb4e3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:26:18.990+0000 7fb4e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:26:18.990+0000 7fb4e3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:26:18.990+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x7fb4e40764a0 auth_method 0 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:26:18.991+0000 7fb5fc4cc640 10 monclient: get_auth_request con 0x5636811df520 auth_method 0 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:26:18.992+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x5636811eaff0 auth_method 0 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:26:18.992+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x5636811ef440 auth_method 0 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:26:18.994+0000 7fb600612800 10 monclient: build_initial_monmap 2024-09-12T00:26:19.089 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:26:18.994+0000 7fb600612800 1 build_initial for_mkfs: 0 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:26:18.994+0000 7fb600612800 10 monclient: monmap: 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding auth protocol: cephx 2024-09-12T00:26:19.090 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding auth protocol: cephx 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding auth protocol: cephx 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.091 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:26:18.994+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:26:18.994+0000 7fb600612800 5 asok(0x563680f80630) register_command objecter_requests cmddesc objecter_requests hook 0x5636811f7ce0 EEXIST 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:26:18.994+0000 7fb600612800 10 monclient: init 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding auth protocol: cephx 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding auth protocol: cephx 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding auth protocol: cephx 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.092 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:26:18.995+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:26:18.995+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:26:18.995+0000 7fb600612800 5 asok(0x563680f80630) register_command rotate-key cmddesc rotate-key hook 0x5636811f2b20 EEXIST 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): picked mon.noname-a con 0x56368121b9d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): picked mon.noname-b con 0x56368121dca0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:19.093 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): picked mon.noname-c con 0x56368121a1a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): authenticate will time out at 2198.560407s 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request con 0x56368121b9d0 auth_method 0 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request con 0x56368121a1a0 auth_method 0 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.094 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_done global_id 7074 payload 824 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient: _finish_hunting 0 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 1 monclient: found mon.noname-a 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:26:18.995+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x56368121dca0 auth_method 0 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.095 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: dump: 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.096 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: dump: 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.097 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:26:18.996+0000 7fb600612800 5 monclient: authenticate success, global_id 7074 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:26:18.996+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:26:18.996+0000 7fb5fcccd640 4 set_mon_vals no callback set 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:26:18.996+0000 7fb600612800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:26:18.996+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.098 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:26:18.996+0000 7fb600612800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:26:18.997+0000 7fb4e1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:26:18.997+0000 7fb4e1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:26:18.997+0000 7fb4e1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:26:18.997+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x7fb4d4076380 auth_method 0 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:26:18.998+0000 7fb600612800 10 monclient: get_monmap_and_config 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:26:18.998+0000 7fb600612800 10 monclient: build_initial_monmap 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:26:18.998+0000 7fb600612800 1 build_initial for_mkfs: 0 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:26:18.998+0000 7fb600612800 10 monclient: monmap: 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:19.099 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding auth protocol: cephx 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding auth protocol: cephx 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding auth protocol: cephx 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.100 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:26:18.998+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:26:18.998+0000 7fb600612800 10 monclient: init 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding auth protocol: cephx 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding auth protocol: cephx 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding auth protocol: cephx 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.101 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:26:18.998+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:26:18.998+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:26:18.999+0000 7fb600612800 5 asok(0x563680f80630) register_command rotate-key cmddesc rotate-key hook 0x7ffe80fc1f28 EEXIST 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:19.102 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): picked mon.noname-a con 0x56368126fee0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): picked mon.noname-b con 0x563681240df0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): picked mon.noname-c con 0x56368126b3e0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): authenticate will time out at 2198.564085s 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request con 0x56368126fee0 auth_method 0 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.103 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request con 0x56368126b3e0 auth_method 0 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_done global_id 7077 payload 274 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient: _finish_hunting 0 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 1 monclient: found mon.noname-a 2024-09-12T00:26:19.104 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: dump: 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.105 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: _finish_auth 0 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: _check_auth_tickets 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: dump: 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.106 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:26:18.999+0000 7fb600612800 5 monclient: authenticate success, global_id 7077 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient: get_monmap_and_config success 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:26:18.999+0000 7fb600612800 4 set_mon_vals no callback set 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:26:19.000+0000 7fb600612800 10 monclient: shutdown 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:26:19.000+0000 7fb600612800 10 monclient: build_initial_monmap 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:26:19.000+0000 7fb600612800 1 build_initial for_mkfs: 0 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:26:19.000+0000 7fb600612800 10 monclient: monmap: 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:19.107 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding auth protocol: cephx 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding auth protocol: cephx 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding auth protocol: cephx 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.108 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:26:19.000+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:26:19.000+0000 7fb600612800 1 librados: starting msgr at 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:26:19.000+0000 7fb600612800 1 librados: starting objecter 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:26:19.000+0000 7fb600612800 5 asok(0x563680f80630) register_command objecter_requests cmddesc objecter_requests hook 0x563681262dd0 EEXIST 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:26:19.000+0000 7fb600612800 1 librados: setting wanted keys 2024-09-12T00:26:19.109 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:26:19.000+0000 7fb600612800 1 librados: calling monclient init 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:26:19.000+0000 7fb600612800 10 monclient: init 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding auth protocol: cephx 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding auth protocol: cephx 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding auth protocol: cephx 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.110 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:26:19.001+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:26:19.001+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:26:19.001+0000 7fb600612800 5 asok(0x563680f80630) register_command rotate-key cmddesc rotate-key hook 0x5636812338c8 EEXIST 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): picked mon.noname-c con 0x563681240df0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): picked mon.noname-a con 0x56368126b3e0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): picked mon.noname-b con 0x56368126fee0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.111 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): authenticate will time out at 2198.566396s 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request con 0x563681240df0 auth_method 0 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): get_auth_request con 0x56368126b3e0 auth_method 0 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.112 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:26:19.001+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request con 0x56368126fee0 auth_method 0 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:26:19.001+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:26:19.001+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:26:19.001+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_done global_id 6650 payload 824 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient: _finish_hunting 0 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 1 monclient: found mon.noname-c 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: dump: 2024-09-12T00:26:19.113 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: _finish_auth 0 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: _check_auth_tickets 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:19.114 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: dump: 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:26:19.002+0000 7fb600612800 5 monclient: authenticate success, global_id 6650 2024-09-12T00:26:19.115 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:26:19.002+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:26:19.002+0000 7fb4daffd640 4 set_mon_vals no callback set 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:26:19.002+0000 7fb600612800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:26:19.002+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:26:19.002+0000 7fb600612800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:26:19.002+0000 7fb600612800 1 librados: init done 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:26:19.002+0000 7fb600612800 5 asok(0x563680f80630) register_command cr dump hook 0x563681268d98 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:26:19.003+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:26:19.004+0000 7fb4d97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:26:19.004+0000 7fb4d97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:26:19.004+0000 7fb4d97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:26:19.004+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x7fb4c4076470 auth_method 0 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:26:19.004+0000 7fb5fc4cc640 10 monclient: get_auth_request con 0x56368128a5a0 auth_method 0 2024-09-12T00:26:19.116 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:26:19.005+0000 7fb600612800 20 realm 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:26:19.005+0000 7fb600612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:26:19.005+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x56368128e900 auth_method 0 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:26:19.006+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:26:19.006+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.117 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:26:19.006+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x563681292020 auth_method 0 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:26:19.007+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:26:19.007+0000 7fb600612800 20 searching for the correct realm 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:26:19.007+0000 7fb5fc4cc640 10 monclient: get_auth_request con 0x563681296de0 auth_method 0 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:26:19.007+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x7fb5f4074040 auth_method 0 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:26:19.008+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x7fb5ec0a70c0 auth_method 0 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:26:19.009+0000 7fb5fbccb640 0 -- 172.21.15.33:0/1735026284 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fb5f4074040 msgr2=0x7fb5f404da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:26:19.009+0000 7fb4d97fa640 1 client.6650.objecter ms_handle_reset 0x7fb5f4074040 session 0x7fb5f4005040 osd.7 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:26:19.009+0000 7fb4d97fa640 10 monclient: _renew_subs 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:26:19.009+0000 7fb4d97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:26:19.009+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x7fb4c4086c20 auth_method 0 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:26:19.010+0000 7fb5fc4cc640 10 monclient: get_auth_request con 0x7fb5f0039040 auth_method 0 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:26:19.012+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x7fb5f0050b10 auth_method 0 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:26:19.012+0000 7fb5fbccb640 0 -- 172.21.15.33:0/1735026284 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fb5f0050b10 msgr2=0x7fb5f005d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.118 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:26:19.013+0000 7fb4d97fa640 1 client.6650.objecter ms_handle_reset 0x7fb5f0050b10 session 0x7fb5f001d040 osd.0 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:26:19.013+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x7fb5f4074040 auth_method 0 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:26:19.017+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:26:19.017+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:26:19.017+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:19.119 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:26:19.018+0000 7fb600612800 20 zone default found 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:26:19.018+0000 7fb600612800 4 Realm: () 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:26:19.018+0000 7fb600612800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:26:19.018+0000 7fb600612800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:26:19.018+0000 7fb600612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:26:19.018+0000 7fb600612800 20 zonegroup default 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:26:19.019+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:26:19.019+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:26:19.019+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:26:19.019+0000 7fb600612800 20 started sync module instance, tier type = 2024-09-12T00:26:19.120 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:26:19.019+0000 7fb600612800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=0 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=1 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=2 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=3 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=4 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=5 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=6 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=7 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:26:19.028+0000 7fb600612800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding auth protocol: cephx 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding auth protocol: cephx 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding auth protocol: cephx 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.121 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:26:19.030+0000 7fb4b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:26:19.031+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:26:19.031+0000 7fb600612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:19.122 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:26:19.031+0000 7fb600612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command cache list hook 0x56368125d350 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command cache inspect hook 0x56368125d350 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command cache erase hook 0x56368125d350 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command cache zap hook 0x56368125d350 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:26:19.031+0000 7fb600612800 5 note: GC not initialized 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:26:19.031+0000 7fb4b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command sync trace show hook 0x7fb5ec086070 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command sync trace history hook 0x7fb5ec086070 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command sync trace active hook 0x7fb5ec086070 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command sync trace active_short hook 0x7fb5ec086070 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:26:19.031+0000 7fb600612800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:26:19.031+0000 7fb600612800 20 Filter name: none 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:26:19.031+0000 7fb42a7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:19.123 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:26:19.031+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:26:19.031+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:26:19.032+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:26:19.032+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:26:19.032+0000 7fb600612800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:26:19.032+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : miss 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:26:19.032+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:26:19.032+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:26:19.032+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:26:19.032+0000 7fb600612800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:26:19.032+0000 7fb600612800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:26:19.032+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:26:19.032+0000 7fb600612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:19.124 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:26:19.037+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:26:19.037+0000 7fb600612800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:26:19.037+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:26:19.037+0000 7fb600612800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 94792095228896 notifier 6650 bl.length()=999 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.0 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.0 2024-09-12T00:26:19.125 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.1 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.1 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.2 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.2 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.3 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.3 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.4 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.4 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.5 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.5 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.6 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.6 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.7 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.7 2024-09-12T00:26:19.126 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.8 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.8 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.9 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.9 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.10 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.10 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.11 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.11 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.0 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:26:19.046+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:26:19.046+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.3 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:26:19.047+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.4 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.5 2024-09-12T00:26:19.127 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.6 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.7 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:26:19.049+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.8 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:26:19.050+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.9 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:26:19.050+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.10 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:26:19.053+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:26:19.053+0000 7fb600612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:26:19.054+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:26:19.054+0000 7fb600612800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:26:19.054+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:26:19.054+0000 7fb600612800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94792095228896 notifier 6650 bl.length()=999 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.128 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:26:19.057+0000 7fb600612800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb600612800 time 2024-09-12T00:26:19.057278+0000 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb60178c71a] 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb60178c8d8] 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636803d3641] 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5636803e2582] 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5636803e33e4] 2024-09-12T00:26:19.129 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb600429590] 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:26:19.058+0000 7fb600612800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fb600612800 thread_name:radosgw-admin 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb60043e6f0] 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb60048b99c] 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb60178c774] 2024-09-12T00:26:19.130 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb60178c8d8] 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636803d3641] 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5636803e2582] 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5636803e33e4] 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb600429590] 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:26:19.131 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:26:19.132 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:26:19.132 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:26:19.132 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:26:19.132 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:26:19.132 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:26:19.133 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:26:19.134 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:26:19.135 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:26:19.136 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:26:19.137 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:26:19.138 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb42a7fc640 / http_manager 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4b0fe1640 / http_manager 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4b1fe3640 / rgw_dt_lg_renew 2024-09-12T00:26:19.139 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4d97fa640 / ms_dispatch 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4da7fc640 / io_context_pool 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4daffd640 / io_context_pool 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4e1ffb640 / ms_dispatch 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4e3fff640 / ms_dispatch 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4e9e0b640 / io_context_pool 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb5fb4ca640 / msgr-worker-2 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb5fbccb640 / msgr-worker-1 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb5fc4cc640 / msgr-worker-0 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb5fcccd640 / io_context_pool 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb600612800 / radosgw-admin 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:26:19.140 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.113350.log 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:26:18.987+0000 7fb600612800 5 AuthRegistry(0x56368119fab0) adding con mode: crc 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:26:18.987+0000 7fb600612800 5 AuthRegistry(0x56368119fab0) adding con mode: secure 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:26:18.987+0000 7fb600612800 5 AuthRegistry(0x56368119fab0) adding con mode: crc 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:26:18.987+0000 7fb600612800 5 AuthRegistry(0x56368119fab0) adding con mode: secure 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:26:18.987+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:26:18.987+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:26:18.987+0000 7fb600612800 5 asok(0x563680f80630) register_command rotate-key hook 0x56368119fbf8 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:26:18.987+0000 7fb600612800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:26:18.987+0000 7fb600612800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:26:19.141 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): picked mon.noname-a con 0x563681059220 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): picked mon.noname-c con 0x5636810e2f90 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): picked mon.noname-b con 0x5636810e3390 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient(hunting): authenticate will time out at 2198.553048s 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): get_auth_request con 0x5636810e2f90 auth_method 0 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request con 0x563681059220 auth_method 0 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.142 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:26:18.988+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request con 0x5636810e3390 auth_method 0 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.143 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:26:18.988+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_done global_id 7071 payload 824 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient: _finish_hunting 0 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 1 monclient: found mon.noname-a 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:26:18.988+0000 7fb5fbccb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: dump: 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.144 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: _finish_auth 0 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:26:18.988+0000 7fb4e3fff640 10 monclient: dump: 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.145 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:26:18.988+0000 7fb600612800 5 monclient: authenticate success, global_id 7071 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:26:18.988+0000 7fb4e9e0b640 4 set_mon_vals no callback set 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.146 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:26:18.988+0000 7fb600612800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:26:18.988+0000 7fb600612800 1 librados: init done 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:26:18.990+0000 7fb4e3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:26:18.990+0000 7fb4e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:26:18.990+0000 7fb4e3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:26:18.990+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x7fb4e40764a0 auth_method 0 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:26:18.991+0000 7fb5fc4cc640 10 monclient: get_auth_request con 0x5636811df520 auth_method 0 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:26:18.992+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x5636811eaff0 auth_method 0 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:26:18.992+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x5636811ef440 auth_method 0 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:26:18.994+0000 7fb600612800 10 monclient: build_initial_monmap 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:26:18.994+0000 7fb600612800 1 build_initial for_mkfs: 0 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:26:18.994+0000 7fb600612800 10 monclient: monmap: 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:19.147 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding auth protocol: cephx 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding auth protocol: cephx 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding auth protocol: cephx 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.148 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: crc 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f4270) adding con mode: secure 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:26:18.994+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:26:18.994+0000 7fb600612800 5 asok(0x563680f80630) register_command objecter_requests cmddesc objecter_requests hook 0x5636811f7ce0 EEXIST 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:26:18.994+0000 7fb600612800 10 monclient: init 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding auth protocol: cephx 2024-09-12T00:26:19.149 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding auth protocol: cephx 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding auth protocol: cephx 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: crc 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:26:18.994+0000 7fb600612800 5 AuthRegistry(0x5636811f29d8) adding con mode: secure 2024-09-12T00:26:19.150 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:26:18.995+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:26:18.995+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:26:18.995+0000 7fb600612800 5 asok(0x563680f80630) register_command rotate-key cmddesc rotate-key hook 0x5636811f2b20 EEXIST 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): picked mon.noname-a con 0x56368121b9d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): picked mon.noname-b con 0x56368121dca0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): picked mon.noname-c con 0x56368121a1a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:26:18.995+0000 7fb600612800 10 monclient(hunting): authenticate will time out at 2198.560407s 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request con 0x56368121b9d0 auth_method 0 2024-09-12T00:26:19.151 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request con 0x56368121a1a0 auth_method 0 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:26:18.995+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_done global_id 7074 payload 824 2024-09-12T00:26:19.152 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient: _finish_hunting 0 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 1 monclient: found mon.noname-a 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:26:18.995+0000 7fb5fbccb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:26:18.995+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x56368121dca0 auth_method 0 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: dump: 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.153 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:26:18.996+0000 7fb4e1ffb640 10 monclient: dump: 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.154 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:26:18.996+0000 7fb600612800 5 monclient: authenticate success, global_id 7074 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:26:18.996+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:26:18.996+0000 7fb5fcccd640 4 set_mon_vals no callback set 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:26:18.996+0000 7fb600612800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:26:18.996+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:26:18.996+0000 7fb600612800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:26:18.997+0000 7fb4e1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:26:18.997+0000 7fb4e1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.155 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:26:18.997+0000 7fb4e1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:26:18.997+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x7fb4d4076380 auth_method 0 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:26:18.998+0000 7fb600612800 10 monclient: get_monmap_and_config 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:26:18.998+0000 7fb600612800 10 monclient: build_initial_monmap 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:26:18.998+0000 7fb600612800 1 build_initial for_mkfs: 0 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:26:18.998+0000 7fb600612800 10 monclient: monmap: 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:19.156 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding auth protocol: cephx 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding auth protocol: cephx 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding auth protocol: cephx 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.157 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: crc 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x56368123b8f0) adding con mode: secure 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:26:18.998+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:26:18.998+0000 7fb600612800 10 monclient: init 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding auth protocol: cephx 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding auth protocol: cephx 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding auth protocol: cephx 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.158 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: crc 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:26:18.998+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc1de0) adding con mode: secure 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:26:18.998+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:26:18.998+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:26:18.999+0000 7fb600612800 5 asok(0x563680f80630) register_command rotate-key cmddesc rotate-key hook 0x7ffe80fc1f28 EEXIST 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): picked mon.noname-a con 0x56368126fee0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): picked mon.noname-b con 0x563681240df0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): picked mon.noname-c con 0x56368126b3e0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:19.159 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient(hunting): authenticate will time out at 2198.564085s 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request con 0x56368126fee0 auth_method 0 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request con 0x56368126b3e0 auth_method 0 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.160 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:26:18.999+0000 7fb5fc4cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_done global_id 7077 payload 274 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient: _finish_hunting 0 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 1 monclient: found mon.noname-a 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:26:18.999+0000 7fb5fbccb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: dump: 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.161 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: _finish_auth 0 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: _check_auth_tickets 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:19.162 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:26:18.999+0000 7fb4daffd640 10 monclient: dump: 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:26:18.999+0000 7fb600612800 5 monclient: authenticate success, global_id 7077 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:26:18.999+0000 7fb600612800 10 monclient: get_monmap_and_config success 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:26:18.999+0000 7fb600612800 4 set_mon_vals no callback set 2024-09-12T00:26:19.163 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:26:19.000+0000 7fb600612800 10 monclient: shutdown 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:26:19.000+0000 7fb600612800 10 monclient: build_initial_monmap 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:26:19.000+0000 7fb600612800 1 build_initial for_mkfs: 0 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:26:19.000+0000 7fb600612800 10 monclient: monmap: 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.164 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding auth protocol: cephx 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding auth protocol: cephx 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding auth protocol: cephx 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.165 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: crc 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681260e70) adding con mode: secure 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:26:19.000+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:26:19.000+0000 7fb600612800 1 librados: starting msgr at 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:26:19.000+0000 7fb600612800 1 librados: starting objecter 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:26:19.000+0000 7fb600612800 5 asok(0x563680f80630) register_command objecter_requests cmddesc objecter_requests hook 0x563681262dd0 EEXIST 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:26:19.000+0000 7fb600612800 1 librados: setting wanted keys 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:26:19.000+0000 7fb600612800 1 librados: calling monclient init 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:26:19.000+0000 7fb600612800 10 monclient: init 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding auth protocol: cephx 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding auth protocol: cephx 2024-09-12T00:26:19.166 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding auth protocol: cephx 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.167 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: crc 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:26:19.000+0000 7fb600612800 5 AuthRegistry(0x563681233780) adding con mode: secure 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:26:19.001+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:26:19.001+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:26:19.001+0000 7fb600612800 5 asok(0x563680f80630) register_command rotate-key cmddesc rotate-key hook 0x5636812338c8 EEXIST 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): picked mon.noname-c con 0x563681240df0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): picked mon.noname-a con 0x56368126b3e0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): picked mon.noname-b con 0x56368126fee0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:19.168 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:26:19.001+0000 7fb600612800 10 monclient(hunting): authenticate will time out at 2198.566396s 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request con 0x563681240df0 auth_method 0 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): get_auth_request con 0x56368126b3e0 auth_method 0 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.169 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:26:19.001+0000 7fb5fb4ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:26:19.001+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request con 0x56368126fee0 auth_method 0 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:26:19.001+0000 7fb5fc4cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:26:19.001+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:26:19.001+0000 7fb5fc4cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient(hunting): handle_auth_done global_id 6650 payload 824 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient: _finish_hunting 0 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 1 monclient: found mon.noname-c 2024-09-12T00:26:19.170 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:26:19.001+0000 7fb5fbccb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: dump: 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.171 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: _finish_auth 0 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: _check_auth_tickets 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:26:19.002+0000 7fb4d97fa640 10 monclient: dump: 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:19.172 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:26:19.002+0000 7fb600612800 5 monclient: authenticate success, global_id 6650 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:26:19.002+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:26:19.002+0000 7fb4daffd640 4 set_mon_vals no callback set 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:26:19.002+0000 7fb600612800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:26:19.002+0000 7fb600612800 10 monclient: _renew_subs 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:26:19.002+0000 7fb600612800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:26:19.002+0000 7fb600612800 1 librados: init done 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:26:19.002+0000 7fb600612800 5 asok(0x563680f80630) register_command cr dump hook 0x563681268d98 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:26:19.003+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:26:19.004+0000 7fb4d97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:26:19.004+0000 7fb4d97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.173 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:26:19.004+0000 7fb4d97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:26:19.004+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x7fb4c4076470 auth_method 0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:26:19.004+0000 7fb5fc4cc640 10 monclient: get_auth_request con 0x56368128a5a0 auth_method 0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:26:19.005+0000 7fb600612800 20 realm 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:26:19.005+0000 7fb600612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:26:19.005+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:26:19.005+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x56368128e900 auth_method 0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:26:19.006+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:26:19.006+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.174 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:26:19.006+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x563681292020 auth_method 0 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:26:19.007+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:26:19.007+0000 7fb600612800 20 searching for the correct realm 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:26:19.007+0000 7fb5fc4cc640 10 monclient: get_auth_request con 0x563681296de0 auth_method 0 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:26:19.007+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x7fb5f4074040 auth_method 0 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:26:19.008+0000 7fb5fb4ca640 10 monclient: get_auth_request con 0x7fb5ec0a70c0 auth_method 0 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:26:19.009+0000 7fb5fbccb640 0 -- 172.21.15.33:0/1735026284 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fb5f4074040 msgr2=0x7fb5f404da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:26:19.009+0000 7fb4d97fa640 1 client.6650.objecter ms_handle_reset 0x7fb5f4074040 session 0x7fb5f4005040 osd.7 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:26:19.009+0000 7fb4d97fa640 10 monclient: _renew_subs 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:26:19.009+0000 7fb4d97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:26:19.009+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x7fb4c4086c20 auth_method 0 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:26:19.010+0000 7fb5fc4cc640 10 monclient: get_auth_request con 0x7fb5f0039040 auth_method 0 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:26:19.012+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x7fb5f0050b10 auth_method 0 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:26:19.012+0000 7fb5fbccb640 0 -- 172.21.15.33:0/1735026284 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fb5f0050b10 msgr2=0x7fb5f005d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.175 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:26:19.013+0000 7fb4d97fa640 1 client.6650.objecter ms_handle_reset 0x7fb5f0050b10 session 0x7fb5f001d040 osd.0 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:26:19.013+0000 7fb5fbccb640 10 monclient: get_auth_request con 0x7fb5f4074040 auth_method 0 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:26:19.017+0000 7fb600612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:26:19.017+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.176 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:26:19.017+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:26:19.017+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:26:19.018+0000 7fb600612800 20 zone default found 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:26:19.018+0000 7fb600612800 4 Realm: () 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:26:19.018+0000 7fb600612800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:26:19.018+0000 7fb600612800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:26:19.018+0000 7fb600612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:19.177 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:26:19.018+0000 7fb600612800 20 zonegroup default 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:26:19.018+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:26:19.019+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:26:19.019+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:26:19.019+0000 7fb600612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:26:19.019+0000 7fb600612800 20 started sync module instance, tier type = 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:26:19.019+0000 7fb600612800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=0 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=1 2024-09-12T00:26:19.178 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=2 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=3 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=4 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=5 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=6 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:26:19.028+0000 7fb600612800 20 add_watcher() i=7 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:26:19.028+0000 7fb600612800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding auth protocol: cephx 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding auth protocol: cephx 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding auth protocol: cephx 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.179 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:26:19.030+0000 7fb4b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: crc 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:26:19.030+0000 7fb600612800 5 AuthRegistry(0x7ffe80fc22c0) adding con mode: secure 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:26:19.031+0000 7fb600612800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:26:19.031+0000 7fb600612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:26:19.031+0000 7fb600612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:19.180 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command cache list hook 0x56368125d350 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command cache inspect hook 0x56368125d350 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command cache erase hook 0x56368125d350 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command cache zap hook 0x56368125d350 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:26:19.031+0000 7fb600612800 5 note: GC not initialized 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:26:19.031+0000 7fb4b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command sync trace show hook 0x7fb5ec086070 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command sync trace history hook 0x7fb5ec086070 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command sync trace active hook 0x7fb5ec086070 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:26:19.031+0000 7fb600612800 5 asok(0x563680f80630) register_command sync trace active_short hook 0x7fb5ec086070 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:26:19.031+0000 7fb600612800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:26:19.031+0000 7fb600612800 20 Filter name: none 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:26:19.031+0000 7fb42a7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:19.181 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:26:19.031+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:26:19.031+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:26:19.032+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:26:19.032+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:26:19.032+0000 7fb600612800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:26:19.032+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : miss 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:26:19.032+0000 7fb600612800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:26:19.032+0000 7fb600612800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:26:19.032+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:26:19.032+0000 7fb600612800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:26:19.032+0000 7fb600612800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:26:19.032+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:26:19.032+0000 7fb600612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:19.182 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:26:19.037+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:26:19.037+0000 7fb600612800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:26:19.037+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:26:19.037+0000 7fb600612800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 94792095228896 notifier 6650 bl.length()=999 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:26:19.038+0000 7fb4daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:26:19.040+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.0 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.0 2024-09-12T00:26:19.183 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.1 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.1 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.2 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.2 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.3 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.3 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.4 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.4 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.5 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.5 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.6 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.6 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.7 2024-09-12T00:26:19.184 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.7 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.8 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.8 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.9 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.9 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.10 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.10 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:26:19.045+0000 7fb600612800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.11 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1.11 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.0 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:26:19.045+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:26:19.046+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:26:19.046+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.3 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:26:19.047+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.4 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.5 2024-09-12T00:26:19.185 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.6 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:26:19.048+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.7 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:26:19.049+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.8 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:26:19.050+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.9 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:26:19.050+0000 7fb600612800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.10 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:26:19.053+0000 7fb600612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:26:19.053+0000 7fb600612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:26:19.054+0000 7fb600612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:26:19.054+0000 7fb600612800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:26:19.054+0000 7fb600612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:26:19.054+0000 7fb600612800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94792095228896 notifier 6650 bl.length()=999 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.186 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:26:19.054+0000 7fb4da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:26:19.056+0000 7fb600612800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:26:19.057+0000 7fb600612800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb600612800 time 2024-09-12T00:26:19.057278+0000 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb60178c71a] 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb60178c8d8] 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636803d3641] 2024-09-12T00:26:19.187 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5636803e2582] 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5636803e33e4] 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb600429590] 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:26:19.058+0000 7fb600612800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fb600612800 thread_name:radosgw-admin 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb60043e6f0] 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb60048b99c] 2024-09-12T00:26:19.188 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb60178c774] 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb60178c8d8] 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636803d3641] 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5636803e2582] 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5636803e33e4] 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb600429590] 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:26:19.189 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:26:19.190 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:26:19.191 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:26:19.192 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:26:19.193 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:26:19.194 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:26:19.195 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:26:19.196 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb42a7fc640 / http_manager 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4b0fe1640 / http_manager 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4b1fe3640 / rgw_dt_lg_renew 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4d97fa640 / ms_dispatch 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4da7fc640 / io_context_pool 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4daffd640 / io_context_pool 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4e1ffb640 / ms_dispatch 2024-09-12T00:26:19.197 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4e3fff640 / ms_dispatch 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb4e9e0b640 / io_context_pool 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb5fb4ca640 / msgr-worker-2 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb5fbccb640 / msgr-worker-1 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb5fc4cc640 / msgr-worker-0 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb5fcccd640 / io_context_pool 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: 7fb600612800 / radosgw-admin 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:26:19.058936Z_73a254a1-0c3d-4107-9252-6554f9b93bc7/log 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:26:19.198 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.137+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.139+0000 7f107a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.139+0000 7f107a926800 20 realm 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.139+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.139+0000 7f107a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.139+0000 7f107a926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.139+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.139+0000 7f107a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.139+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.140+0000 7f107a926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.140+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.141+0000 7f107a926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:19.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.141+0000 7f107a926800 20 searching for the correct realm 2024-09-12T00:26:19.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.144+0000 7f1075d5c640 0 -- 172.21.15.33:0/1351062580 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5635bd071160 msgr2=0x5635bd073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.147+0000 7f107655d640 0 -- 172.21.15.33:0/1351062580 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f106c07a130 msgr2=0x7f106c096290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:19.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:19.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:19.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:19.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:19.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:19.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.354+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 20 zone default found 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 4 Realm: () 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:19.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 20 zonegroup default 2024-09-12T00:26:19.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.355+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.356+0000 7f107a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.356+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.356+0000 7f107a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.356+0000 7f107a926800 20 started sync module instance, tier type = 2024-09-12T00:26:19.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.356+0000 7f107a926800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:19.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.365+0000 7f107a926800 20 add_watcher() i=0 2024-09-12T00:26:19.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.365+0000 7f107a926800 20 add_watcher() i=1 2024-09-12T00:26:19.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.365+0000 7f107a926800 20 add_watcher() i=2 2024-09-12T00:26:19.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.365+0000 7f107a926800 20 add_watcher() i=3 2024-09-12T00:26:19.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.365+0000 7f107a926800 20 add_watcher() i=4 2024-09-12T00:26:19.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.365+0000 7f107a926800 20 add_watcher() i=5 2024-09-12T00:26:19.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.365+0000 7f107a926800 20 add_watcher() i=6 2024-09-12T00:26:19.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.366+0000 7f107a926800 20 add_watcher() i=7 2024-09-12T00:26:19.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.366+0000 7f107a926800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:19.367 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.368+0000 7f0f2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:19.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.368+0000 7f107a926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:19.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.368+0000 7f107a926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:19.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.368+0000 7f107a926800 5 note: GC not initialized 2024-09-12T00:26:19.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.369+0000 7f0ea77fe640 20 reqs_thread_entry: start 2024-09-12T00:26:19.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.369+0000 7f107a926800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:19.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.369+0000 7f107a926800 20 Filter name: none 2024-09-12T00:26:19.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.369+0000 7f0ea57fa640 20 reqs_thread_entry: start 2024-09-12T00:26:19.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.369+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.369+0000 7f107a926800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.369+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.370+0000 7f107a926800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.370+0000 7f107a926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.370+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.370+0000 7f107a926800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.370+0000 7f107a926800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.371+0000 7f107a926800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:26:19.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.371+0000 7f107a926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:19.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.373+0000 7f0f2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:19.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.375+0000 7f107a926800 20 remove_watcher() i=0 2024-09-12T00:26:19.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.375+0000 7f107a926800 2 removed watcher, disabling cache 2024-09-12T00:26:19.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.376+0000 7f107a926800 20 remove_watcher() i=1 2024-09-12T00:26:19.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.377+0000 7f107a926800 20 remove_watcher() i=2 2024-09-12T00:26:19.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.379+0000 7f107a926800 20 remove_watcher() i=3 2024-09-12T00:26:19.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.380+0000 7f107a926800 20 remove_watcher() i=4 2024-09-12T00:26:19.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.381+0000 7f107a926800 20 remove_watcher() i=5 2024-09-12T00:26:19.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.382+0000 7f107a926800 20 remove_watcher() i=6 2024-09-12T00:26:19.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.383+0000 7f107a926800 20 remove_watcher() i=7 2024-09-12T00:26:19.393 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.393 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:19.393 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-block-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:19.396 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:19.396 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:19.397 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:19.425 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:19.425 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:19.483 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:26:19.516 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:19.516 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:19.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.557+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.558+0000 7f5c42726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.558+0000 7f5c42726800 20 realm 2024-09-12T00:26:19.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.558+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.558+0000 7f5c42726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.558+0000 7f5c42726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:19.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.558+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.559+0000 7f5c42726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.559+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.559+0000 7f5c42726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.559+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.560+0000 7f5c42726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:19.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.560+0000 7f5c42726800 20 searching for the correct realm 2024-09-12T00:26:19.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.563+0000 7f5c3eb5e640 0 -- 172.21.15.33:0/3968851926 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5592b0e81470 msgr2=0x5592b0e83930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.567+0000 7f5c3e35d640 0 -- 172.21.15.33:0/3968851926 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f5c3401f060 msgr2=0x7f5c34096680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:19.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:19.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:19.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:19.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 zone default found 2024-09-12T00:26:19.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 4 Realm: () 2024-09-12T00:26:19.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 zonegroup default 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.571+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.572+0000 7f5c42726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.572+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.572+0000 7f5c42726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.572+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.572+0000 7f5c42726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.572+0000 7f5c42726800 20 started sync module instance, tier type = 2024-09-12T00:26:19.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.572+0000 7f5c42726800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:19.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.581+0000 7f5c42726800 20 add_watcher() i=0 2024-09-12T00:26:19.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.581+0000 7f5c42726800 20 add_watcher() i=1 2024-09-12T00:26:19.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.581+0000 7f5c42726800 20 add_watcher() i=2 2024-09-12T00:26:19.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.581+0000 7f5c42726800 20 add_watcher() i=3 2024-09-12T00:26:19.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.581+0000 7f5c42726800 20 add_watcher() i=4 2024-09-12T00:26:19.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.581+0000 7f5c42726800 20 add_watcher() i=5 2024-09-12T00:26:19.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.581+0000 7f5c42726800 20 add_watcher() i=6 2024-09-12T00:26:19.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.582+0000 7f5c42726800 20 add_watcher() i=7 2024-09-12T00:26:19.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.582+0000 7f5c42726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:19.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.584+0000 7f5af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:19.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.584+0000 7f5c42726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:19.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.585+0000 7f5c42726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:19.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.585+0000 7f5c42726800 5 note: GC not initialized 2024-09-12T00:26:19.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.585+0000 7f5a6f7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:19.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.585+0000 7f5c42726800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:19.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.585+0000 7f5c42726800 20 Filter name: none 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.585+0000 7f5a6d7fa640 20 reqs_thread_entry: start 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.585+0000 7f5c42726800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.585+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : miss 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 20 rados->read ofs=0 len=0 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:26:19.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:19.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:19.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:19.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:19.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.586+0000 7f5c42726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:19.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.587+0000 7f5c42726800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to be held by another RGW process; skipping for now 2024-09-12T00:26:19.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.588+0000 7f5af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:19.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.590+0000 7f5c42726800 20 remove_watcher() i=0 2024-09-12T00:26:19.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.590+0000 7f5c42726800 2 removed watcher, disabling cache 2024-09-12T00:26:19.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.591+0000 7f5c42726800 20 remove_watcher() i=1 2024-09-12T00:26:19.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.592+0000 7f5c42726800 20 remove_watcher() i=2 2024-09-12T00:26:19.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.593+0000 7f5c42726800 20 remove_watcher() i=3 2024-09-12T00:26:19.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.594+0000 7f5c42726800 20 remove_watcher() i=4 2024-09-12T00:26:19.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.595+0000 7f5c42726800 20 remove_watcher() i=5 2024-09-12T00:26:19.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.596+0000 7f5c42726800 20 remove_watcher() i=6 2024-09-12T00:26:19.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:19.597+0000 7f5c42726800 20 remove_watcher() i=7 2024-09-12T00:26:19.606 INFO:tasks.workunit.client.0.smithi033.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:26:49.632 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:26:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:49.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.720+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.721+0000 7f1142a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.721+0000 7f1142a98800 20 realm 2024-09-12T00:26:49.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.721+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.722+0000 7f1142a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.722+0000 7f1142a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:49.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.722+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.722+0000 7f1142a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.722+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.723+0000 7f1142a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:49.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.723+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.725+0000 7f1142a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:49.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.725+0000 7f1142a98800 20 searching for the correct realm 2024-09-12T00:26:49.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.726+0000 7f1140582640 0 -- 172.21.15.33:0/218086893 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f113802b030 msgr2=0x7f1138063cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:49.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.933+0000 7f1137d81640 0 -- 172.21.15.33:0/218086893 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f112c002570 msgr2=0x7f1130078040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.941+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 20 zone default found 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 4 Realm: () 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 20 zonegroup default 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.942+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.943+0000 7f1142a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.943+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.943+0000 7f1142a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.943+0000 7f1142a98800 20 started sync module instance, tier type = 2024-09-12T00:26:49.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.943+0000 7f1142a98800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:49.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.954+0000 7f1142a98800 20 add_watcher() i=0 2024-09-12T00:26:49.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.954+0000 7f1142a98800 20 add_watcher() i=1 2024-09-12T00:26:49.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.954+0000 7f1142a98800 20 add_watcher() i=2 2024-09-12T00:26:49.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.954+0000 7f1142a98800 20 add_watcher() i=3 2024-09-12T00:26:49.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.954+0000 7f1142a98800 20 add_watcher() i=4 2024-09-12T00:26:49.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.954+0000 7f1142a98800 20 add_watcher() i=5 2024-09-12T00:26:49.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.954+0000 7f1142a98800 20 add_watcher() i=6 2024-09-12T00:26:49.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.955+0000 7f1142a98800 20 add_watcher() i=7 2024-09-12T00:26:49.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.955+0000 7f1142a98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:49.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.957+0000 7f0ff6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:49.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.958+0000 7f1142a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:49.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.958+0000 7f1142a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:49.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.958+0000 7f1142a98800 5 note: GC not initialized 2024-09-12T00:26:49.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.958+0000 7f0ff5fdb640 20 reqs_thread_entry: start 2024-09-12T00:26:49.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.958+0000 7f1142a98800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:49.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.958+0000 7f1142a98800 20 Filter name: none 2024-09-12T00:26:49.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.958+0000 7f0f677fe640 20 reqs_thread_entry: start 2024-09-12T00:26:49.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.959+0000 7f1142a98800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:26:49.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.959+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.959+0000 7f1142a98800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.959+0000 7f1142a98800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.959+0000 7f1142a98800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.959+0000 7f1142a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : miss 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.959+0000 7f1142a98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.960+0000 7f1142a98800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.960+0000 7f1142a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.960+0000 7f1142a98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.960+0000 7f1142a98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.960+0000 7f1142a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:49.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.960+0000 7f1142a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:49.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.961+0000 7f1142a98800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:26:49.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.968+0000 7f1142a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:49.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.968+0000 7f1142a98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:49.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.968+0000 7f1142a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:49.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.968+0000 7f1142a98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:49.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.969+0000 7f10177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366246 cookie 94316049370752 notifier 6701 bl.length()=999 2024-09-12T00:26:49.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.969+0000 7f10177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:49.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.969+0000 7f10177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:49.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.969+0000 7f10177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:49.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.971+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:49.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.971+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:49.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.971+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:49.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.971+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:49.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.0 2024-09-12T00:26:49.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.0 2024-09-12T00:26:49.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.1 2024-09-12T00:26:49.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.1 2024-09-12T00:26:49.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.2 2024-09-12T00:26:49.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.2 2024-09-12T00:26:49.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.3 2024-09-12T00:26:49.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.3 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.4 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.4 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.5 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.5 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.6 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.6 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.7 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.7 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.8 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.8 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.9 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.9 2024-09-12T00:26:49.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.10 2024-09-12T00:26:49.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.10 2024-09-12T00:26:49.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.11 2024-09-12T00:26:49.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2.11 2024-09-12T00:26:49.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.0 2024-09-12T00:26:49.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.977+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1 2024-09-12T00:26:49.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.978+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2 2024-09-12T00:26:49.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.979+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.3 2024-09-12T00:26:49.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.979+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.4 2024-09-12T00:26:49.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.980+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.5 2024-09-12T00:26:49.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.980+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.6 2024-09-12T00:26:49.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.981+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.7 2024-09-12T00:26:49.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.981+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.8 2024-09-12T00:26:49.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.982+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.9 2024-09-12T00:26:49.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.983+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.10 2024-09-12T00:26:49.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.989+0000 7f1142a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:49.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.989+0000 7f1142a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:49.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.992+0000 7f1142a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:49.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.992+0000 7f1142a98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:49.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.992+0000 7f1142a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:49.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.992+0000 7f1142a98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:49.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.992+0000 7f10177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366247 cookie 94316049370752 notifier 6701 bl.length()=999 2024-09-12T00:26:49.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.992+0000 7f10177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:49.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.992+0000 7f10177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:49.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.992+0000 7f10177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:49.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.994+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:49.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.994+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:49.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.994+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:49.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.994+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:49.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.996+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.0 2024-09-12T00:26:49.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.997+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.1 2024-09-12T00:26:49.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.997+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.2 2024-09-12T00:26:49.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.997+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.3 2024-09-12T00:26:49.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.998+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.4 2024-09-12T00:26:49.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.998+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.5 2024-09-12T00:26:49.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.998+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.6 2024-09-12T00:26:49.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.999+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.7 2024-09-12T00:26:49.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:49.999+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.8 2024-09-12T00:26:49.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.000+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.9 2024-09-12T00:26:49.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.000+0000 7f1142a98800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30.10 2024-09-12T00:26:49.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.000+0000 7f1142a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:49.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.000+0000 7f1142a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 2024-09-12T00:26:50.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.002+0000 7f1142a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:50.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.002+0000 7f1142a98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:50.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.002+0000 7f1142a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:50.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.002+0000 7f1142a98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30, ofs0, ns] 2024-09-12T00:26:50.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.003+0000 7f10177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366248 cookie 94316049370752 notifier 6701 bl.length()=967 2024-09-12T00:26:50.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.003+0000 7f10177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 info.flags=0x17 2024-09-12T00:26:50.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.003+0000 7f10177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 to cache LRU end 2024-09-12T00:26:50.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.003+0000 7f10177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:50.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.004+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_sources= new_sources= 2024-09-12T00:26:50.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.004+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential sources added=[] removed=[] 2024-09-12T00:26:50.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.004+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): orig_dests= new_dests= 2024-09-12T00:26:50.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.004+0000 7f1142a98800 20 handle_bi_update(): bucket=:abort-at-block-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30]): potential dests added=[] removed=[] 2024-09-12T00:26:50.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.009+0000 7f1142a98800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:26:50.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.011+0000 7f0ff6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.013+0000 7f1142a98800 20 remove_watcher() i=0 2024-09-12T00:26:50.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.013+0000 7f1142a98800 2 removed watcher, disabling cache 2024-09-12T00:26:50.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.014+0000 7f1142a98800 20 remove_watcher() i=1 2024-09-12T00:26:50.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.016+0000 7f1142a98800 20 remove_watcher() i=2 2024-09-12T00:26:50.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.017+0000 7f1142a98800 20 remove_watcher() i=3 2024-09-12T00:26:50.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.019+0000 7f1142a98800 20 remove_watcher() i=4 2024-09-12T00:26:50.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.020+0000 7f1142a98800 20 remove_watcher() i=5 2024-09-12T00:26:50.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.021+0000 7f1142a98800 20 remove_watcher() i=6 2024-09-12T00:26:50.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.022+0000 7f1142a98800 20 remove_watcher() i=7 2024-09-12T00:26:50.033 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:26:50.063 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:50.063 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:50.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.106+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.108+0000 7fac7c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.108+0000 7fac7c440800 20 realm 2024-09-12T00:26:50.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.108+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.108+0000 7fac7c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.108+0000 7fac7c440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:50.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.108+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.108+0000 7fac7c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.108+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.109+0000 7fac7c440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:50.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.109+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.110+0000 7fac7c440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:50.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.110+0000 7fac7c440800 20 searching for the correct realm 2024-09-12T00:26:50.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.113+0000 7fac7a72b640 0 -- 172.21.15.33:0/4163598481 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x556ab030fad0 msgr2=0x556ab0311f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:50.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.116+0000 7fac79f2a640 0 -- 172.21.15.33:0/4163598481 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fac7003d060 msgr2=0x7fac700970b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:50.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.120+0000 7fac7c440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:50.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.120+0000 7fac7c440800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.120+0000 7fac7c440800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.120+0000 7fac7c440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.120+0000 7fac7c440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.120+0000 7fac7c440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.120+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:50.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:50.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 20 zone default found 2024-09-12T00:26:50.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 4 Realm: () 2024-09-12T00:26:50.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 20 zonegroup default 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.121+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.122+0000 7fac7c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.122+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.122+0000 7fac7c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.122+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.122+0000 7fac7c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.122+0000 7fac7c440800 20 started sync module instance, tier type = 2024-09-12T00:26:50.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.122+0000 7fac7c440800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:50.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.132+0000 7fac7c440800 20 add_watcher() i=0 2024-09-12T00:26:50.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.132+0000 7fac7c440800 20 add_watcher() i=1 2024-09-12T00:26:50.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.132+0000 7fac7c440800 20 add_watcher() i=2 2024-09-12T00:26:50.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.132+0000 7fac7c440800 20 add_watcher() i=3 2024-09-12T00:26:50.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.132+0000 7fac7c440800 20 add_watcher() i=4 2024-09-12T00:26:50.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.132+0000 7fac7c440800 20 add_watcher() i=5 2024-09-12T00:26:50.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.132+0000 7fac7c440800 20 add_watcher() i=6 2024-09-12T00:26:50.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.133+0000 7fac7c440800 20 add_watcher() i=7 2024-09-12T00:26:50.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.133+0000 7fac7c440800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.134+0000 7fab2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.135+0000 7fac7c440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.135+0000 7fac7c440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.135+0000 7fac7c440800 5 note: GC not initialized 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.135+0000 7fab2a7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.135+0000 7fac7c440800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.135+0000 7fac7c440800 20 Filter name: none 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.135+0000 7faa9bfff640 20 reqs_thread_entry: start 2024-09-12T00:26:50.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.135+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.136+0000 7fac7c440800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:50.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.136+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.136+0000 7fac7c440800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:50.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.136+0000 7fac7c440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:50.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.136+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.137+0000 7fac7c440800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:26:50.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.137+0000 7fac7c440800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.137+0000 7fac7c440800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:26:50.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.137+0000 7fac7c440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:50.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.139+0000 7fab2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.141+0000 7fac7c440800 20 remove_watcher() i=0 2024-09-12T00:26:50.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.141+0000 7fac7c440800 2 removed watcher, disabling cache 2024-09-12T00:26:50.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.142+0000 7fac7c440800 20 remove_watcher() i=1 2024-09-12T00:26:50.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.143+0000 7fac7c440800 20 remove_watcher() i=2 2024-09-12T00:26:50.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.144+0000 7fac7c440800 20 remove_watcher() i=3 2024-09-12T00:26:50.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.145+0000 7fac7c440800 20 remove_watcher() i=4 2024-09-12T00:26:50.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.146+0000 7fac7c440800 20 remove_watcher() i=5 2024-09-12T00:26:50.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.147+0000 7fac7c440800 20 remove_watcher() i=6 2024-09-12T00:26:50.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:50.148+0000 7fac7c440800 20 remove_watcher() i=7 2024-09-12T00:26:50.157 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:50.158 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:50.158 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-block-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:26:50.158 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:50.160 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.160 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.182 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.182 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.370 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.370 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.506 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:26:50.506 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:50.507 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.507 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.557 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.557 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.614 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.614 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.651 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.651 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.685 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.685 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.720 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.720 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.754 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.754 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.789 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.789 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.823 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.823 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.857 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.857 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.892 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.892 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.926 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.926 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.960 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:50.994 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.029 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.063 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.098 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:51.098 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.132 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:51.132 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.167 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:51.167 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.204 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:51.204 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.234 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:51.235 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.268 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:51.268 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:51.305 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:26:51.334 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:51.334 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:51.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.374+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.376+0000 7f49adc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.376+0000 7f49adc15800 20 realm 2024-09-12T00:26:51.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.376+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.377+0000 7f49adc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.377+0000 7f49adc15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:51.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.377+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.377+0000 7f49adc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.377+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.378+0000 7f49adc15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:51.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.378+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.379+0000 7f49adc15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:51.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.379+0000 7f49adc15800 20 searching for the correct realm 2024-09-12T00:26:51.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.381+0000 7f49a9b93640 0 -- 172.21.15.33:0/1674694529 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x555ddbfbe130 msgr2=0x555ddbfc05f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:51.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.385+0000 7f49a9392640 0 -- 172.21.15.33:0/1674694529 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f49a00b8c60 msgr2=0x7f49a00ae5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:51.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:51.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 zone default found 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 4 Realm: () 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 zonegroup default 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.390+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.391+0000 7f49adc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.391+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.391+0000 7f49adc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.391+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.391+0000 7f49adc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.391+0000 7f49adc15800 20 started sync module instance, tier type = 2024-09-12T00:26:51.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.391+0000 7f49adc15800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:51.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.400+0000 7f49adc15800 20 add_watcher() i=0 2024-09-12T00:26:51.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.400+0000 7f49adc15800 20 add_watcher() i=1 2024-09-12T00:26:51.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.400+0000 7f49adc15800 20 add_watcher() i=2 2024-09-12T00:26:51.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.400+0000 7f49adc15800 20 add_watcher() i=3 2024-09-12T00:26:51.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.400+0000 7f49adc15800 20 add_watcher() i=4 2024-09-12T00:26:51.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.400+0000 7f49adc15800 20 add_watcher() i=5 2024-09-12T00:26:51.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.400+0000 7f49adc15800 20 add_watcher() i=6 2024-09-12T00:26:51.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.401+0000 7f49adc15800 20 add_watcher() i=7 2024-09-12T00:26:51.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.401+0000 7f49adc15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:51.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.403+0000 7f485ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.403+0000 7f49adc15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.403+0000 7f49adc15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.403+0000 7f49adc15800 5 note: GC not initialized 2024-09-12T00:26:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.404+0000 7f485efe5640 20 reqs_thread_entry: start 2024-09-12T00:26:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.404+0000 7f49adc15800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.404+0000 7f49adc15800 20 Filter name: none 2024-09-12T00:26:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.404+0000 7f485cfe1640 20 reqs_thread_entry: start 2024-09-12T00:26:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.404+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.405+0000 7f49adc15800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.405+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.406+0000 7f49adc15800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:51.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.406+0000 7f49adc15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:51.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.406+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.406+0000 7f49adc15800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:51.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.406+0000 7f49adc15800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.407+0000 7f49adc15800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:51.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.407+0000 7f49adc15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:51.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.408+0000 7f485ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:51.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.411+0000 7f49adc15800 20 remove_watcher() i=0 2024-09-12T00:26:51.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.411+0000 7f49adc15800 2 removed watcher, disabling cache 2024-09-12T00:26:51.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.412+0000 7f49adc15800 20 remove_watcher() i=1 2024-09-12T00:26:51.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.413+0000 7f49adc15800 20 remove_watcher() i=2 2024-09-12T00:26:51.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.414+0000 7f49adc15800 20 remove_watcher() i=3 2024-09-12T00:26:51.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.415+0000 7f49adc15800 20 remove_watcher() i=4 2024-09-12T00:26:51.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.416+0000 7f49adc15800 20 remove_watcher() i=5 2024-09-12T00:26:51.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.417+0000 7f49adc15800 20 remove_watcher() i=6 2024-09-12T00:26:51.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.418+0000 7f49adc15800 20 remove_watcher() i=7 2024-09-12T00:26:51.427 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:51.428 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:51.428 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-commit-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:51.428 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:51.429 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:26:51.463 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:51.464 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:51.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.505+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.507+0000 7f3795e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.507+0000 7f3795e87800 20 realm 2024-09-12T00:26:51.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.507+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.507+0000 7f3795e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.507+0000 7f3795e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:51.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.507+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.507+0000 7f3795e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.507+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.508+0000 7f3795e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:51.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.508+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.509+0000 7f3795e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:51.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.509+0000 7f3795e87800 20 searching for the correct realm 2024-09-12T00:26:51.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.511+0000 7f3793971640 0 -- 172.21.15.33:0/868430468 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f378c022040 msgr2=0x7f378c065e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:51.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.515+0000 7f3793971640 0 -- 172.21.15.33:0/868430468 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f37880b93a0 msgr2=0x7f37880639d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:51.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:51.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:51.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:51.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:51.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:51.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:51.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.519+0000 7f3795e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 zone default found 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 4 Realm: () 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 zonegroup default 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.520+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.521+0000 7f3795e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.521+0000 7f3795e87800 20 started sync module instance, tier type = 2024-09-12T00:26:51.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.521+0000 7f3795e87800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:51.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.529+0000 7f3795e87800 20 add_watcher() i=0 2024-09-12T00:26:51.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.529+0000 7f3795e87800 20 add_watcher() i=1 2024-09-12T00:26:51.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.529+0000 7f3795e87800 20 add_watcher() i=2 2024-09-12T00:26:51.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.529+0000 7f3795e87800 20 add_watcher() i=3 2024-09-12T00:26:51.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.529+0000 7f3795e87800 20 add_watcher() i=4 2024-09-12T00:26:51.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.529+0000 7f3795e87800 20 add_watcher() i=5 2024-09-12T00:26:51.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.530+0000 7f3795e87800 20 add_watcher() i=6 2024-09-12T00:26:51.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.530+0000 7f3795e87800 20 add_watcher() i=7 2024-09-12T00:26:51.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.530+0000 7f3795e87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:51.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.532+0000 7f3649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:51.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f3795e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:51.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f3795e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:51.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f3795e87800 5 note: GC not initialized 2024-09-12T00:26:51.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f3648fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:51.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f3795e87800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f3795e87800 20 Filter name: none 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f35c27fc640 20 reqs_thread_entry: start 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f3795e87800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.533+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 : miss 2024-09-12T00:26:51.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:51.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:51.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:51.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:51.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:51.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.534+0000 7f3795e87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 2024-09-12T00:26:51.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.539+0000 7f3795e87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:51.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.539+0000 7f3795e87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:51.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.539+0000 7f3795e87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:51.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.539+0000 7f3795e87800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31, ofs0, ns] 2024-09-12T00:26:51.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.540+0000 7f3672ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 94582194002304 notifier 7191 bl.length()=1015 2024-09-12T00:26:51.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.540+0000 7f3672ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:51.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.540+0000 7f3672ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:51.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.540+0000 7f3672ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:51.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.541+0000 7f3795e87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_sources= new_sources= 2024-09-12T00:26:51.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.541+0000 7f3795e87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential sources added=[] removed=[] 2024-09-12T00:26:51.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.541+0000 7f3795e87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_dests= new_dests= 2024-09-12T00:26:51.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.541+0000 7f3795e87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential dests added=[] removed=[] 2024-09-12T00:26:51.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.0 2024-09-12T00:26:51.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.0 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.1 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.1 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.2 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.2 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.3 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.3 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.4 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.4 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.5 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.5 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.6 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.6 2024-09-12T00:26:51.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.7 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.7 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.8 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.8 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.9 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.9 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.10 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.10 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.11 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1.11 2024-09-12T00:26:51.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.0 2024-09-12T00:26:51.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.546+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1 2024-09-12T00:26:51.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.547+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2 2024-09-12T00:26:51.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.547+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.3 2024-09-12T00:26:51.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.548+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.4 2024-09-12T00:26:51.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.548+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.5 2024-09-12T00:26:51.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.549+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.6 2024-09-12T00:26:51.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.550+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.7 2024-09-12T00:26:51.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.550+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.8 2024-09-12T00:26:51.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.551+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.9 2024-09-12T00:26:51.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.551+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.10 2024-09-12T00:26:51.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.554+0000 7f3795e87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:51.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.554+0000 7f3795e87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 2024-09-12T00:26:51.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.555+0000 7f3795e87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:51.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.555+0000 7f3795e87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:51.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.555+0000 7f3795e87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:51.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.555+0000 7f3795e87800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31, ofs0, ns] 2024-09-12T00:26:51.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.556+0000 7f36727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 94582194002304 notifier 7191 bl.length()=1015 2024-09-12T00:26:51.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.556+0000 7f36727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:51.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.556+0000 7f36727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:51.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.556+0000 7f36727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:51.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.557+0000 7f3795e87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_sources= new_sources= 2024-09-12T00:26:51.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.557+0000 7f3795e87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential sources added=[] removed=[] 2024-09-12T00:26:51.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.557+0000 7f3795e87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_dests= new_dests= 2024-09-12T00:26:51.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.557+0000 7f3795e87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential dests added=[] removed=[] 2024-09-12T00:26:51.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.559+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.0 2024-09-12T00:26:51.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.560+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1 2024-09-12T00:26:51.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.560+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2 2024-09-12T00:26:51.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.560+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.3 2024-09-12T00:26:51.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.561+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.4 2024-09-12T00:26:51.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.561+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.5 2024-09-12T00:26:51.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.561+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.6 2024-09-12T00:26:51.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.562+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.7 2024-09-12T00:26:51.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.562+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.8 2024-09-12T00:26:51.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.562+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.9 2024-09-12T00:26:51.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.563+0000 7f3795e87800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.10 2024-09-12T00:26:51.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.563+0000 7f3795e87800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:26:51.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.563+0000 7f3795e87800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:26:51.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.567+0000 7f3649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:51.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.569+0000 7f3795e87800 20 remove_watcher() i=0 2024-09-12T00:26:51.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.569+0000 7f3795e87800 2 removed watcher, disabling cache 2024-09-12T00:26:51.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.570+0000 7f3795e87800 20 remove_watcher() i=1 2024-09-12T00:26:51.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.571+0000 7f3795e87800 20 remove_watcher() i=2 2024-09-12T00:26:51.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.572+0000 7f3795e87800 20 remove_watcher() i=3 2024-09-12T00:26:51.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.573+0000 7f3795e87800 20 remove_watcher() i=4 2024-09-12T00:26:51.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.574+0000 7f3795e87800 20 remove_watcher() i=5 2024-09-12T00:26:51.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.575+0000 7f3795e87800 20 remove_watcher() i=6 2024-09-12T00:26:51.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.576+0000 7f3795e87800 20 remove_watcher() i=7 2024-09-12T00:26:51.588 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:26:51.617 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:51.617 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:51.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.658+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.660+0000 7f809bb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.660+0000 7f809bb1f800 20 realm 2024-09-12T00:26:51.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.660+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.660+0000 7f809bb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.660+0000 7f809bb1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:51.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.660+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.660+0000 7f809bb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:51.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.660+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.661+0000 7f809bb1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:51.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.661+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:51.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.662+0000 7f809bb1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:51.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.662+0000 7f809bb1f800 20 searching for the correct realm 2024-09-12T00:26:51.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.663+0000 7f808f0a8640 0 -- 172.21.15.33:0/1269448377 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f8088081060 msgr2=0x7f80880dc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:51.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:51.869+0000 7f80978a9640 0 -- 172.21.15.33:0/1269448377 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f80800668f0 msgr2=0x7f808006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:52.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.076+0000 7f809bb1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:52.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.076+0000 7f809bb1f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:52.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.076+0000 7f809bb1f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:52.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.076+0000 7f809bb1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:52.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.076+0000 7f809bb1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:52.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.076+0000 7f809bb1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:52.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.076+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:52.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 20 zone default found 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 4 Realm: () 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 20 zonegroup default 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.077+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.078+0000 7f809bb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.078+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.078+0000 7f809bb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.078+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.078+0000 7f809bb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.078+0000 7f809bb1f800 20 started sync module instance, tier type = 2024-09-12T00:26:52.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.078+0000 7f809bb1f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:52.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.089+0000 7f809bb1f800 20 add_watcher() i=0 2024-09-12T00:26:52.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.089+0000 7f809bb1f800 20 add_watcher() i=1 2024-09-12T00:26:52.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.089+0000 7f809bb1f800 20 add_watcher() i=2 2024-09-12T00:26:52.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.089+0000 7f809bb1f800 20 add_watcher() i=3 2024-09-12T00:26:52.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.089+0000 7f809bb1f800 20 add_watcher() i=4 2024-09-12T00:26:52.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.089+0000 7f809bb1f800 20 add_watcher() i=5 2024-09-12T00:26:52.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.089+0000 7f809bb1f800 20 add_watcher() i=6 2024-09-12T00:26:52.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.090+0000 7f809bb1f800 20 add_watcher() i=7 2024-09-12T00:26:52.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.090+0000 7f809bb1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:52.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.091+0000 7f7f4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:52.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.092+0000 7f809bb1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:52.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.092+0000 7f809bb1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:52.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.092+0000 7f809bb1f800 5 note: GC not initialized 2024-09-12T00:26:52.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.092+0000 7f7f4cfe1640 20 reqs_thread_entry: start 2024-09-12T00:26:52.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.092+0000 7f809bb1f800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:52.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.092+0000 7f809bb1f800 20 Filter name: none 2024-09-12T00:26:52.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.092+0000 7f7ec67fc640 20 reqs_thread_entry: start 2024-09-12T00:26:52.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.092+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.093+0000 7f809bb1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:52.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.093+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.093+0000 7f809bb1f800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:26:52.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.093+0000 7f809bb1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:52.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.093+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.094+0000 7f809bb1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:52.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.094+0000 7f809bb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.094+0000 7f809bb1f800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:26:52.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.094+0000 7f809bb1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:52.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.096+0000 7f7f4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:52.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.098+0000 7f809bb1f800 20 remove_watcher() i=0 2024-09-12T00:26:52.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.098+0000 7f809bb1f800 2 removed watcher, disabling cache 2024-09-12T00:26:52.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.099+0000 7f809bb1f800 20 remove_watcher() i=1 2024-09-12T00:26:52.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.100+0000 7f809bb1f800 20 remove_watcher() i=2 2024-09-12T00:26:52.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.102+0000 7f809bb1f800 20 remove_watcher() i=3 2024-09-12T00:26:52.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.103+0000 7f809bb1f800 20 remove_watcher() i=4 2024-09-12T00:26:52.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.104+0000 7f809bb1f800 20 remove_watcher() i=5 2024-09-12T00:26:52.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.105+0000 7f809bb1f800 20 remove_watcher() i=6 2024-09-12T00:26:52.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.106+0000 7f809bb1f800 20 remove_watcher() i=7 2024-09-12T00:26:52.116 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:52.116 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:52.116 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-commit-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:52.116 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:52.118 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:52.118 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:52.148 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:52.148 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:52.207 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:26:52.240 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:52.240 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:52.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.281+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.282+0000 7f8252319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.282+0000 7f8252319800 20 realm 2024-09-12T00:26:52.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.282+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.282+0000 7f8252319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.282+0000 7f8252319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:52.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.282+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.283+0000 7f8252319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.283+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.283+0000 7f8252319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:52.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.283+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.284+0000 7f8252319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:52.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.284+0000 7f8252319800 20 searching for the correct realm 2024-09-12T00:26:52.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.287+0000 7f824fe0a640 0 -- 172.21.15.33:0/367514555 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f824802e020 msgr2=0x7f824800a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:52.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.291+0000 7f824fe0a640 0 -- 172.21.15.33:0/367514555 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f8238064430 msgr2=0x7f8238064890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:52.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:52.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 zone default found 2024-09-12T00:26:52.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 4 Realm: () 2024-09-12T00:26:52.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:52.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:52.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:52.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.498+0000 7f8252319800 20 zonegroup default 2024-09-12T00:26:52.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.499+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.499+0000 7f8252319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.499+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.499+0000 7f8252319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.499+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.500+0000 7f8252319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.500+0000 7f8252319800 20 started sync module instance, tier type = 2024-09-12T00:26:52.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.500+0000 7f8252319800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:52.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.509+0000 7f8252319800 20 add_watcher() i=0 2024-09-12T00:26:52.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.509+0000 7f8252319800 20 add_watcher() i=1 2024-09-12T00:26:52.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.509+0000 7f8252319800 20 add_watcher() i=2 2024-09-12T00:26:52.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.509+0000 7f8252319800 20 add_watcher() i=3 2024-09-12T00:26:52.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.509+0000 7f8252319800 20 add_watcher() i=4 2024-09-12T00:26:52.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.509+0000 7f8252319800 20 add_watcher() i=5 2024-09-12T00:26:52.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.509+0000 7f8252319800 20 add_watcher() i=6 2024-09-12T00:26:52.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.510+0000 7f8252319800 20 add_watcher() i=7 2024-09-12T00:26:52.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.510+0000 7f8252319800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.511+0000 7f8105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.511+0000 7f8252319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.511+0000 7f8252319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.511+0000 7f8252319800 5 note: GC not initialized 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f8104fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f8252319800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f8252319800 20 Filter name: none 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f807e7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f8252319800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:26:52.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f8252319800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:52.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f8252319800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:26:52.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.512+0000 7f8252319800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:26:52.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.513+0000 7f8252319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 : miss 2024-09-12T00:26:52.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.513+0000 7f8252319800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.513+0000 7f8252319800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:26:52.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.513+0000 7f8252319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:52.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.513+0000 7f8252319800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:52.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.513+0000 7f8252319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:52.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.513+0000 7f8252319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:52.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.513+0000 7f8252319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 2024-09-12T00:26:52.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.514+0000 7f8252319800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:26:52.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.523+0000 7f8252319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:52.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.523+0000 7f8252319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:52.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.523+0000 7f8252319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:52.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.523+0000 7f8252319800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31, ofs0, ns] 2024-09-12T00:26:52.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.524+0000 7f812e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366255 cookie 94561850255712 notifier 6782 bl.length()=1015 2024-09-12T00:26:52.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.524+0000 7f812e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:52.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.524+0000 7f812e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:52.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.524+0000 7f812e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:52.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.526+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_sources= new_sources= 2024-09-12T00:26:52.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.526+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential sources added=[] removed=[] 2024-09-12T00:26:52.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.526+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_dests= new_dests= 2024-09-12T00:26:52.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.526+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential dests added=[] removed=[] 2024-09-12T00:26:52.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.530+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.0 2024-09-12T00:26:52.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.0 2024-09-12T00:26:52.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.1 2024-09-12T00:26:52.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.1 2024-09-12T00:26:52.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.2 2024-09-12T00:26:52.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.2 2024-09-12T00:26:52.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.3 2024-09-12T00:26:52.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.3 2024-09-12T00:26:52.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.4 2024-09-12T00:26:52.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.4 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.5 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.5 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.6 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.6 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.7 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.7 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.8 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.8 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.9 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.9 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.10 2024-09-12T00:26:52.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.10 2024-09-12T00:26:52.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.11 2024-09-12T00:26:52.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2.11 2024-09-12T00:26:52.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.0 2024-09-12T00:26:52.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1 2024-09-12T00:26:52.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.531+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2 2024-09-12T00:26:52.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.532+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.3 2024-09-12T00:26:52.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.533+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.4 2024-09-12T00:26:52.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.533+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.5 2024-09-12T00:26:52.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.534+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.6 2024-09-12T00:26:52.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.534+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.7 2024-09-12T00:26:52.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.535+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.8 2024-09-12T00:26:52.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.535+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.9 2024-09-12T00:26:52.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.536+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.10 2024-09-12T00:26:52.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.539+0000 7f8252319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:52.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.539+0000 7f8252319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 2024-09-12T00:26:52.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.542+0000 7f8252319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:52.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.542+0000 7f8252319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:52.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.542+0000 7f8252319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:52.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.542+0000 7f8252319800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31, ofs0, ns] 2024-09-12T00:26:52.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.542+0000 7f812e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366256 cookie 94561850255712 notifier 6782 bl.length()=1015 2024-09-12T00:26:52.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.542+0000 7f812e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:52.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.542+0000 7f812e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:52.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.542+0000 7f812e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:52.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.545+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_sources= new_sources= 2024-09-12T00:26:52.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.545+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential sources added=[] removed=[] 2024-09-12T00:26:52.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.545+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_dests= new_dests= 2024-09-12T00:26:52.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.545+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential dests added=[] removed=[] 2024-09-12T00:26:52.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.547+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.0 2024-09-12T00:26:52.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.548+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.1 2024-09-12T00:26:52.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.548+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.2 2024-09-12T00:26:52.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.548+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.3 2024-09-12T00:26:52.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.549+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.4 2024-09-12T00:26:52.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.549+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.5 2024-09-12T00:26:52.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.549+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.6 2024-09-12T00:26:52.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.549+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.7 2024-09-12T00:26:52.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.550+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.8 2024-09-12T00:26:52.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.550+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.9 2024-09-12T00:26:52.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.551+0000 7f8252319800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31.10 2024-09-12T00:26:52.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.551+0000 7f8252319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:52.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.551+0000 7f8252319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 2024-09-12T00:26:52.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.552+0000 7f8252319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:52.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.552+0000 7f8252319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:52.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.552+0000 7f8252319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:52.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.552+0000 7f8252319800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31, ofs0, ns] 2024-09-12T00:26:52.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.552+0000 7f812effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366257 cookie 94561850255712 notifier 6782 bl.length()=983 2024-09-12T00:26:52.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.553+0000 7f812effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 info.flags=0x17 2024-09-12T00:26:52.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.553+0000 7f812effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 to cache LRU end 2024-09-12T00:26:52.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.553+0000 7f812effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:52.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.554+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_sources= new_sources= 2024-09-12T00:26:52.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.554+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential sources added=[] removed=[] 2024-09-12T00:26:52.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.554+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): orig_dests= new_dests= 2024-09-12T00:26:52.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.554+0000 7f8252319800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31]): potential dests added=[] removed=[] 2024-09-12T00:26:52.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.556+0000 7f8252319800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:26:52.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.558+0000 7f8105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:52.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.560+0000 7f8252319800 20 remove_watcher() i=0 2024-09-12T00:26:52.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.560+0000 7f8252319800 2 removed watcher, disabling cache 2024-09-12T00:26:52.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.561+0000 7f8252319800 20 remove_watcher() i=1 2024-09-12T00:26:52.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.562+0000 7f8252319800 20 remove_watcher() i=2 2024-09-12T00:26:52.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.563+0000 7f8252319800 20 remove_watcher() i=3 2024-09-12T00:26:52.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.565+0000 7f8252319800 20 remove_watcher() i=4 2024-09-12T00:26:52.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.566+0000 7f8252319800 20 remove_watcher() i=5 2024-09-12T00:26:52.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.566+0000 7f8252319800 20 remove_watcher() i=6 2024-09-12T00:26:52.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.567+0000 7f8252319800 20 remove_watcher() i=7 2024-09-12T00:26:52.579 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:26:52.608 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:52.608 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:52.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.651+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.653+0000 7f307f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.653+0000 7f307f12e800 20 realm 2024-09-12T00:26:52.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.653+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.653+0000 7f307f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.653+0000 7f307f12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:52.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.653+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.653+0000 7f307f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.653+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.654+0000 7f307f12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:52.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.654+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.655+0000 7f307f12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:52.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.655+0000 7f307f12e800 20 searching for the correct realm 2024-09-12T00:26:52.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.658+0000 7f307b565640 0 -- 172.21.15.33:0/3688925674 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f307001d940 msgr2=0x7f307003f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:52.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.865+0000 7f307ad64640 0 -- 172.21.15.33:0/3688925674 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x55ac2c1564b0 msgr2=0x55ac2c1588a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:52.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.867+0000 7f307f12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:52.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.867+0000 7f307f12e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.867+0000 7f307f12e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.867+0000 7f307f12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.867+0000 7f307f12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.867+0000 7f307f12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.867+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:52.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:52.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 zone default found 2024-09-12T00:26:52.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 4 Realm: () 2024-09-12T00:26:52.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 zonegroup default 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.868+0000 7f307f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.869+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.869+0000 7f307f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.869+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.869+0000 7f307f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.869+0000 7f307f12e800 20 started sync module instance, tier type = 2024-09-12T00:26:52.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.869+0000 7f307f12e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:52.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.878+0000 7f307f12e800 20 add_watcher() i=0 2024-09-12T00:26:52.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.878+0000 7f307f12e800 20 add_watcher() i=1 2024-09-12T00:26:52.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.878+0000 7f307f12e800 20 add_watcher() i=2 2024-09-12T00:26:52.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.878+0000 7f307f12e800 20 add_watcher() i=3 2024-09-12T00:26:52.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.878+0000 7f307f12e800 20 add_watcher() i=4 2024-09-12T00:26:52.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.878+0000 7f307f12e800 20 add_watcher() i=5 2024-09-12T00:26:52.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.878+0000 7f307f12e800 20 add_watcher() i=6 2024-09-12T00:26:52.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.879+0000 7f307f12e800 20 add_watcher() i=7 2024-09-12T00:26:52.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.879+0000 7f307f12e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:52.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.881+0000 7f2f317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:52.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.881+0000 7f307f12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:52.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.881+0000 7f307f12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:52.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.881+0000 7f307f12e800 5 note: GC not initialized 2024-09-12T00:26:52.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.882+0000 7f2eabfff640 20 reqs_thread_entry: start 2024-09-12T00:26:52.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.882+0000 7f307f12e800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:52.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.882+0000 7f307f12e800 20 Filter name: none 2024-09-12T00:26:52.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.882+0000 7f2ea9ffb640 20 reqs_thread_entry: start 2024-09-12T00:26:52.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.882+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.882+0000 7f307f12e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:52.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.882+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.883+0000 7f307f12e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:52.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.883+0000 7f307f12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:52.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.883+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.884+0000 7f307f12e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:52.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.884+0000 7f307f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.884+0000 7f307f12e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:52.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.884+0000 7f307f12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:52.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.886+0000 7f2f317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:52.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.888+0000 7f307f12e800 20 remove_watcher() i=0 2024-09-12T00:26:52.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.888+0000 7f307f12e800 2 removed watcher, disabling cache 2024-09-12T00:26:52.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.889+0000 7f307f12e800 20 remove_watcher() i=1 2024-09-12T00:26:52.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.890+0000 7f307f12e800 20 remove_watcher() i=2 2024-09-12T00:26:52.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.891+0000 7f307f12e800 20 remove_watcher() i=3 2024-09-12T00:26:52.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.893+0000 7f307f12e800 20 remove_watcher() i=4 2024-09-12T00:26:52.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.894+0000 7f307f12e800 20 remove_watcher() i=5 2024-09-12T00:26:52.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.895+0000 7f307f12e800 20 remove_watcher() i=6 2024-09-12T00:26:52.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:52.896+0000 7f307f12e800 20 remove_watcher() i=7 2024-09-12T00:26:52.905 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:52.905 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:52.906 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-commit-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:26:52.906 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:52.907 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:52.908 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:52.929 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:52.929 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.116 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.116 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.252 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:26:53.252 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:53.256 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.256 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.303 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.303 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.363 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.363 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.396 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.396 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.430 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.430 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.464 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.465 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.499 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.499 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.535 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.535 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.568 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.568 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.602 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.602 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.636 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.636 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.672 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.672 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.706 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.706 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.738 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.738 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.771 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.771 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.805 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.805 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.840 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.840 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.874 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.874 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.908 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.908 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.941 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.941 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:53.975 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.975 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:54.009 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:54.009 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:54.044 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:26:54.077 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:54.077 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:54.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.115+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.117+0000 7f0f5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.117+0000 7f0f5260e800 20 realm 2024-09-12T00:26:54.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.117+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.118+0000 7f0f5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.118+0000 7f0f5260e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:54.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.118+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.118+0000 7f0f5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.118+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.119+0000 7f0f5260e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:54.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.119+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.120+0000 7f0f5260e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:54.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.120+0000 7f0f5260e800 20 searching for the correct realm 2024-09-12T00:26:54.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.122+0000 7f0f4d458640 0 -- 172.21.15.33:0/1087616847 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f0f4004e020 msgr2=0x7f0f40087920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:54.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.125+0000 7f0f4dc59640 0 -- 172.21.15.33:0/1087616847 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f0f44071890 msgr2=0x7f0f4406f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:54.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.333+0000 7f0f5260e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:54.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.333+0000 7f0f5260e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:54.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.333+0000 7f0f5260e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:54.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.333+0000 7f0f5260e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:54.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.333+0000 7f0f5260e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:54.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.333+0000 7f0f5260e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:54.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.333+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:54.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:54.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 20 zone default found 2024-09-12T00:26:54.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 4 Realm: () 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 20 zonegroup default 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.334+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.335+0000 7f0f5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.335+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.335+0000 7f0f5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.335+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.335+0000 7f0f5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.335+0000 7f0f5260e800 20 started sync module instance, tier type = 2024-09-12T00:26:54.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.335+0000 7f0f5260e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:54.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 20 add_watcher() i=0 2024-09-12T00:26:54.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 20 add_watcher() i=1 2024-09-12T00:26:54.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 20 add_watcher() i=2 2024-09-12T00:26:54.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 20 add_watcher() i=3 2024-09-12T00:26:54.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 20 add_watcher() i=4 2024-09-12T00:26:54.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 20 add_watcher() i=5 2024-09-12T00:26:54.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 20 add_watcher() i=6 2024-09-12T00:26:54.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 20 add_watcher() i=7 2024-09-12T00:26:54.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.345+0000 7f0f5260e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:54.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.347+0000 7f0dff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:54.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.347+0000 7f0f5260e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:54.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.347+0000 7f0f5260e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:54.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.348+0000 7f0f5260e800 5 note: GC not initialized 2024-09-12T00:26:54.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.348+0000 7f0dfe7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:54.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.348+0000 7f0f5260e800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:54.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.348+0000 7f0f5260e800 20 Filter name: none 2024-09-12T00:26:54.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.348+0000 7f0d73fff640 20 reqs_thread_entry: start 2024-09-12T00:26:54.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.348+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.349+0000 7f0f5260e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:54.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.349+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.350+0000 7f0f5260e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:54.350 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.350+0000 7f0f5260e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:54.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.350+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.351+0000 7f0f5260e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:54.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.351+0000 7f0f5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.351+0000 7f0f5260e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:54.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.351+0000 7f0f5260e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:54.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.353+0000 7f0dff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:54.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.355+0000 7f0f5260e800 20 remove_watcher() i=0 2024-09-12T00:26:54.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.355+0000 7f0f5260e800 2 removed watcher, disabling cache 2024-09-12T00:26:54.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.356+0000 7f0f5260e800 20 remove_watcher() i=1 2024-09-12T00:26:54.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.357+0000 7f0f5260e800 20 remove_watcher() i=2 2024-09-12T00:26:54.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.358+0000 7f0f5260e800 20 remove_watcher() i=3 2024-09-12T00:26:54.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.359+0000 7f0f5260e800 20 remove_watcher() i=4 2024-09-12T00:26:54.359 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.360+0000 7f0f5260e800 20 remove_watcher() i=5 2024-09-12T00:26:54.360 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.361+0000 7f0f5260e800 20 remove_watcher() i=6 2024-09-12T00:26:54.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.362+0000 7f0f5260e800 20 remove_watcher() i=7 2024-09-12T00:26:54.372 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:54.372 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:54.372 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-commit-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:54.372 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:54.373 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:26:54.411 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:54.411 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:54.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.644+0000 7f36cf419640 0 --2- 172.21.15.33:0/4069289316 >> [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] conn(0x55d820b54290 0x55d820b52680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:26:54.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.653+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.655+0000 7f36d3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.655+0000 7f36d3f2f800 20 realm 2024-09-12T00:26:54.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.655+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.655+0000 7f36d3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.655+0000 7f36d3f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:54.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.655+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.655+0000 7f36d3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.655+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.656+0000 7f36d3f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:54.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.656+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.657+0000 7f36d3f2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:54.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.657+0000 7f36d3f2f800 20 searching for the correct realm 2024-09-12T00:26:54.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.659+0000 7f36cf419640 0 -- 172.21.15.33:0/1479862293 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f36c0013030 msgr2=0x7f36c00543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:54.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:54.866+0000 7f36cfc1a640 0 -- 172.21.15.33:0/1479862293 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f36c4049930 msgr2=0x7f36c4037410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:55.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.074+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 20 zone default found 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 4 Realm: () 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 20 zonegroup default 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.075+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.076+0000 7f36d3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.076+0000 7f36d3f2f800 20 started sync module instance, tier type = 2024-09-12T00:26:55.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.076+0000 7f36d3f2f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:55.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.087+0000 7f36d3f2f800 20 add_watcher() i=0 2024-09-12T00:26:55.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.087+0000 7f36d3f2f800 20 add_watcher() i=1 2024-09-12T00:26:55.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.087+0000 7f36d3f2f800 20 add_watcher() i=2 2024-09-12T00:26:55.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.087+0000 7f36d3f2f800 20 add_watcher() i=3 2024-09-12T00:26:55.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.087+0000 7f36d3f2f800 20 add_watcher() i=4 2024-09-12T00:26:55.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.087+0000 7f36d3f2f800 20 add_watcher() i=5 2024-09-12T00:26:55.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.087+0000 7f36d3f2f800 20 add_watcher() i=6 2024-09-12T00:26:55.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.088+0000 7f36d3f2f800 20 add_watcher() i=7 2024-09-12T00:26:55.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.088+0000 7f36d3f2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:55.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.090+0000 7f3585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:55.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.090+0000 7f36d3f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:55.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.090+0000 7f36d3f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:55.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.090+0000 7f36d3f2f800 5 note: GC not initialized 2024-09-12T00:26:55.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.090+0000 7f3584fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:55.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.090+0000 7f36d3f2f800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:55.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.090+0000 7f36d3f2f800 20 Filter name: none 2024-09-12T00:26:55.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.091+0000 7f34fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:55.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.091+0000 7f36d3f2f800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:26:55.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.091+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.091+0000 7f36d3f2f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.091+0000 7f36d3f2f800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.091+0000 7f36d3f2f800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.091+0000 7f36d3f2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 : miss 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.091+0000 7f36d3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.092+0000 7f36d3f2f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.092+0000 7f36d3f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 info.flags=0x17 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.092+0000 7f36d3f2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 to cache LRU end 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.092+0000 7f36d3f2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.092+0000 7f36d3f2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:55.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.092+0000 7f36d3f2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 2024-09-12T00:26:55.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.101+0000 7f36d3f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 info.flags=0x17 2024-09-12T00:26:55.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.101+0000 7f36d3f2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 to cache LRU end 2024-09-12T00:26:55.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.101+0000 7f36d3f2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:55.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.101+0000 7f36d3f2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32, ofs0, ns] 2024-09-12T00:26:55.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.102+0000 7f35aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94386750535392 notifier 6833 bl.length()=1015 2024-09-12T00:26:55.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.102+0000 7f35aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 info.flags=0x17 2024-09-12T00:26:55.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.102+0000 7f35aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 to cache LRU end 2024-09-12T00:26:55.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.102+0000 7f35aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:55.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.104+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): orig_sources= new_sources= 2024-09-12T00:26:55.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.104+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): potential sources added=[] removed=[] 2024-09-12T00:26:55.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.104+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): orig_dests= new_dests= 2024-09-12T00:26:55.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.104+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): potential dests added=[] removed=[] 2024-09-12T00:26:55.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.0 2024-09-12T00:26:55.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.0 2024-09-12T00:26:55.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.1 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.1 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.2 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.2 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.3 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.3 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.4 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.4 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.5 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.5 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.6 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.6 2024-09-12T00:26:55.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.7 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.7 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.8 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.8 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.9 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.9 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.10 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.10 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.11 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1.11 2024-09-12T00:26:55.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.0 2024-09-12T00:26:55.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.110+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1 2024-09-12T00:26:55.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.111+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.2 2024-09-12T00:26:55.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.111+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.3 2024-09-12T00:26:55.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.112+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.4 2024-09-12T00:26:55.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.112+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.5 2024-09-12T00:26:55.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.113+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.6 2024-09-12T00:26:55.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.113+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.7 2024-09-12T00:26:55.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.114+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.8 2024-09-12T00:26:55.113 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.115+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.9 2024-09-12T00:26:55.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.115+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.10 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.118+0000 7f36d3f2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.118+0000 7f36d3f2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 2024-09-12T00:26:55.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.120+0000 7f36d3f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 info.flags=0x17 2024-09-12T00:26:55.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.120+0000 7f36d3f2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 to cache LRU end 2024-09-12T00:26:55.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.120+0000 7f36d3f2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:55.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.120+0000 7f36d3f2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32, ofs0, ns] 2024-09-12T00:26:55.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.120+0000 7f35aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94386750535392 notifier 6833 bl.length()=1015 2024-09-12T00:26:55.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.120+0000 7f35aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 info.flags=0x17 2024-09-12T00:26:55.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.120+0000 7f35aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 to cache LRU end 2024-09-12T00:26:55.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.120+0000 7f35aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:55.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.122+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): orig_sources= new_sources= 2024-09-12T00:26:55.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.122+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): potential sources added=[] removed=[] 2024-09-12T00:26:55.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.122+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): orig_dests= new_dests= 2024-09-12T00:26:55.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.122+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): potential dests added=[] removed=[] 2024-09-12T00:26:55.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.124+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.0 2024-09-12T00:26:55.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.125+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.1 2024-09-12T00:26:55.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.125+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.2 2024-09-12T00:26:55.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.125+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.3 2024-09-12T00:26:55.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.126+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.4 2024-09-12T00:26:55.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.126+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.5 2024-09-12T00:26:55.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.127+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.6 2024-09-12T00:26:55.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.127+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.7 2024-09-12T00:26:55.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.128+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.8 2024-09-12T00:26:55.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.128+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.9 2024-09-12T00:26:55.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.128+0000 7f36d3f2f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32.10 2024-09-12T00:26:55.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.129+0000 7f36d3f2f800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:26:55.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.129+0000 7f36d3f2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:55.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.129+0000 7f36d3f2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 2024-09-12T00:26:55.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.131+0000 7f36d3f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 info.flags=0x17 2024-09-12T00:26:55.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.131+0000 7f36d3f2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 to cache LRU end 2024-09-12T00:26:55.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.131+0000 7f36d3f2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:55.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.131+0000 7f36d3f2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32, ofs0, ns] 2024-09-12T00:26:55.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.131+0000 7f35ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366264 cookie 94386750535392 notifier 6833 bl.length()=983 2024-09-12T00:26:55.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.131+0000 7f35ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 info.flags=0x17 2024-09-12T00:26:55.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.131+0000 7f35ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 to cache LRU end 2024-09-12T00:26:55.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.131+0000 7f35ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:55.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.133+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): orig_sources= new_sources= 2024-09-12T00:26:55.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.133+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): potential sources added=[] removed=[] 2024-09-12T00:26:55.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.133+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): orig_dests= new_dests= 2024-09-12T00:26:55.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.133+0000 7f36d3f2f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32]): potential dests added=[] removed=[] 2024-09-12T00:26:55.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.135+0000 7f36d3f2f800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:26:55.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.137+0000 7f3585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:55.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.139+0000 7f36d3f2f800 20 remove_watcher() i=0 2024-09-12T00:26:55.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.139+0000 7f36d3f2f800 2 removed watcher, disabling cache 2024-09-12T00:26:55.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.140+0000 7f36d3f2f800 20 remove_watcher() i=1 2024-09-12T00:26:55.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.142+0000 7f36d3f2f800 20 remove_watcher() i=2 2024-09-12T00:26:55.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.143+0000 7f36d3f2f800 20 remove_watcher() i=3 2024-09-12T00:26:55.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.144+0000 7f36d3f2f800 20 remove_watcher() i=4 2024-09-12T00:26:55.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.145+0000 7f36d3f2f800 20 remove_watcher() i=5 2024-09-12T00:26:55.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.146+0000 7f36d3f2f800 20 remove_watcher() i=6 2024-09-12T00:26:55.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.147+0000 7f36d3f2f800 20 remove_watcher() i=7 2024-09-12T00:26:55.159 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:26:55.189 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:55.189 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:55.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.230+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.232+0000 7f5a4d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.232+0000 7f5a4d542800 20 realm 2024-09-12T00:26:55.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.232+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.232+0000 7f5a4d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.232+0000 7f5a4d542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:55.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.232+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.233+0000 7f5a4d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.233+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.234+0000 7f5a4d542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:55.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.234+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.235+0000 7f5a4d542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:55.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.235+0000 7f5a4d542800 20 searching for the correct realm 2024-09-12T00:26:55.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.238+0000 7f5a49a87640 0 -- 172.21.15.33:0/150491505 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x561b45f8a7a0 msgr2=0x561b45f8cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:55.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.241+0000 7f5a48a85640 0 -- 172.21.15.33:0/150491505 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x561b45f92250 msgr2=0x561b45f94640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.245+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:55.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 zone default found 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 4 Realm: () 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 zonegroup default 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.246+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.247+0000 7f5a4d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.247+0000 7f5a4d542800 20 started sync module instance, tier type = 2024-09-12T00:26:55.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.247+0000 7f5a4d542800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:55.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.255+0000 7f5a4d542800 20 add_watcher() i=0 2024-09-12T00:26:55.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.255+0000 7f5a4d542800 20 add_watcher() i=1 2024-09-12T00:26:55.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.255+0000 7f5a4d542800 20 add_watcher() i=2 2024-09-12T00:26:55.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.255+0000 7f5a4d542800 20 add_watcher() i=3 2024-09-12T00:26:55.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.255+0000 7f5a4d542800 20 add_watcher() i=4 2024-09-12T00:26:55.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.255+0000 7f5a4d542800 20 add_watcher() i=5 2024-09-12T00:26:55.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.255+0000 7f5a4d542800 20 add_watcher() i=6 2024-09-12T00:26:55.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.256+0000 7f5a4d542800 20 add_watcher() i=7 2024-09-12T00:26:55.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.256+0000 7f5a4d542800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:55.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.258+0000 7f58fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:55.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.258+0000 7f5a4d542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:55.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.258+0000 7f5a4d542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:55.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.259+0000 7f5a4d542800 5 note: GC not initialized 2024-09-12T00:26:55.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.259+0000 7f58fefe5640 20 reqs_thread_entry: start 2024-09-12T00:26:55.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.259+0000 7f5a4d542800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:55.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.259+0000 7f5a4d542800 20 Filter name: none 2024-09-12T00:26:55.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.259+0000 7f58fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:26:55.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.259+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.260+0000 7f5a4d542800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:55.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.260+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.260+0000 7f5a4d542800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:55.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.260+0000 7f5a4d542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:55.259 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.260+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.261+0000 7f5a4d542800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:55.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.261+0000 7f5a4d542800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.261+0000 7f5a4d542800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:55.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.261+0000 7f5a4d542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:55.261 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.263+0000 7f58fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:55.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.265+0000 7f5a4d542800 20 remove_watcher() i=0 2024-09-12T00:26:55.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.265+0000 7f5a4d542800 2 removed watcher, disabling cache 2024-09-12T00:26:55.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.266+0000 7f5a4d542800 20 remove_watcher() i=1 2024-09-12T00:26:55.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.267+0000 7f5a4d542800 20 remove_watcher() i=2 2024-09-12T00:26:55.266 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.268+0000 7f5a4d542800 20 remove_watcher() i=3 2024-09-12T00:26:55.267 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.269+0000 7f5a4d542800 20 remove_watcher() i=4 2024-09-12T00:26:55.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.270+0000 7f5a4d542800 20 remove_watcher() i=5 2024-09-12T00:26:55.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.271+0000 7f5a4d542800 20 remove_watcher() i=6 2024-09-12T00:26:55.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:55.272+0000 7f5a4d542800 20 remove_watcher() i=7 2024-09-12T00:26:55.281 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:55.281 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:55.281 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-commit-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:26:55.282 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:55.284 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.284 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.305 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.305 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.505 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.505 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.641 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:26:55.642 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:55.643 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.643 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.693 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.693 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.750 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.750 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.788 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.788 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.822 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.822 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.855 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.855 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.888 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.888 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.921 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.921 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.955 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.955 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:55.989 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.989 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.024 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.024 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.058 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.058 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.091 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.091 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.128 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.128 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.162 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.162 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.196 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.197 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.231 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.231 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.265 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.265 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.300 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.300 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.334 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.334 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.368 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.368 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.403 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.403 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:26:56.437 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:26:56.466 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:56.466 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:56.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.507+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.509+0000 7fc3d9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.509+0000 7fc3d9213800 20 realm 2024-09-12T00:26:56.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.509+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.510+0000 7fc3d9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.510+0000 7fc3d9213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:56.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.510+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.510+0000 7fc3d9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.510+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.511+0000 7fc3d9213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.509 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.511+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.511+0000 7fc3d9213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:56.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.511+0000 7fc3d9213800 20 searching for the correct realm 2024-09-12T00:26:56.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.512+0000 7fc3d4922640 0 -- 172.21.15.33:0/859997698 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fc3cc029040 msgr2=0x7fc3cc0199e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:56.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.717+0000 7fc3d4121640 0 -- 172.21.15.33:0/859997698 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fc3bc002340 msgr2=0x7fc3c4061360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:56.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:56.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:56.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:56.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:56.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:56.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.723+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 20 zone default found 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 4 Realm: () 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 20 zonegroup default 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.724+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.725+0000 7fc3d9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.725+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.725+0000 7fc3d9213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.725+0000 7fc3d9213800 20 started sync module instance, tier type = 2024-09-12T00:26:56.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.725+0000 7fc3d9213800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:56.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.734+0000 7fc3d9213800 20 add_watcher() i=0 2024-09-12T00:26:56.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.734+0000 7fc3d9213800 20 add_watcher() i=1 2024-09-12T00:26:56.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.734+0000 7fc3d9213800 20 add_watcher() i=2 2024-09-12T00:26:56.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.734+0000 7fc3d9213800 20 add_watcher() i=3 2024-09-12T00:26:56.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.734+0000 7fc3d9213800 20 add_watcher() i=4 2024-09-12T00:26:56.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.734+0000 7fc3d9213800 20 add_watcher() i=5 2024-09-12T00:26:56.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.734+0000 7fc3d9213800 20 add_watcher() i=6 2024-09-12T00:26:56.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.735+0000 7fc3d9213800 20 add_watcher() i=7 2024-09-12T00:26:56.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.735+0000 7fc3d9213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:56.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.737+0000 7fc28b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:56.736 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.737+0000 7fc3d9213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:56.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.737+0000 7fc3d9213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:56.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.738+0000 7fc3d9213800 5 note: GC not initialized 2024-09-12T00:26:56.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.738+0000 7fc28a7e4640 20 reqs_thread_entry: start 2024-09-12T00:26:56.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.738+0000 7fc3d9213800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:56.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.738+0000 7fc3d9213800 20 Filter name: none 2024-09-12T00:26:56.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.738+0000 7fc283fff640 20 reqs_thread_entry: start 2024-09-12T00:26:56.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.738+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.739+0000 7fc3d9213800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:56.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.739+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.739+0000 7fc3d9213800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:56.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.739+0000 7fc3d9213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:56.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.739+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.740+0000 7fc3d9213800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:56.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.740+0000 7fc3d9213800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.740+0000 7fc3d9213800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:56.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.740+0000 7fc3d9213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:56.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.742+0000 7fc28b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:56.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.744+0000 7fc3d9213800 20 remove_watcher() i=0 2024-09-12T00:26:56.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.744+0000 7fc3d9213800 2 removed watcher, disabling cache 2024-09-12T00:26:56.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.745+0000 7fc3d9213800 20 remove_watcher() i=1 2024-09-12T00:26:56.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.746+0000 7fc3d9213800 20 remove_watcher() i=2 2024-09-12T00:26:56.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.747+0000 7fc3d9213800 20 remove_watcher() i=3 2024-09-12T00:26:56.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.748+0000 7fc3d9213800 20 remove_watcher() i=4 2024-09-12T00:26:56.747 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.749+0000 7fc3d9213800 20 remove_watcher() i=5 2024-09-12T00:26:56.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.750+0000 7fc3d9213800 20 remove_watcher() i=6 2024-09-12T00:26:56.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.751+0000 7fc3d9213800 20 remove_watcher() i=7 2024-09-12T00:26:56.760 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.760 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:56.760 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-commit-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:56.760 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.761 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:26:56.797 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:56.797 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:56.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.838+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.840+0000 7f7e23687800 20 realm 2024-09-12T00:26:56.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.840+0000 7f7e23687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:56.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.841+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.841+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.842+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:56.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.842+0000 7f7e23687800 20 searching for the correct realm 2024-09-12T00:26:56.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.845+0000 7f7e21171640 0 -- 172.21.15.33:0/2465018263 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f7e1c017020 msgr2=0x7f7e1c00f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.848+0000 7f7e21171640 0 -- 172.21.15.33:0/2465018263 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f7e180b90c0 msgr2=0x7f7e180b15f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 zone default found 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 4 Realm: () 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 zonegroup default 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.854+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.854+0000 7f7e23687800 20 started sync module instance, tier type = 2024-09-12T00:26:56.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.854+0000 7f7e23687800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:56.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=0 2024-09-12T00:26:56.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=1 2024-09-12T00:26:56.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=2 2024-09-12T00:26:56.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=3 2024-09-12T00:26:56.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=4 2024-09-12T00:26:56.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=5 2024-09-12T00:26:56.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=6 2024-09-12T00:26:56.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.864+0000 7f7e23687800 20 add_watcher() i=7 2024-09-12T00:26:56.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.864+0000 7f7e23687800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:56.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.865+0000 7f7cd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:56.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7e23687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:56.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7e23687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:56.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7e23687800 5 note: GC not initialized 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7cd67e4640 20 reqs_thread_entry: start 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7e23687800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7e23687800 20 Filter name: none 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7c47fff640 20 reqs_thread_entry: start 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.866+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : miss 2024-09-12T00:26:56.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:56.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:56.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.867+0000 7f7e23687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:26:56.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.872+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.872+0000 7f7e23687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.872+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.872+0000 7f7e23687800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:26:56.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94729501316144 notifier 6884 bl.length()=1015 2024-09-12T00:26:56.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:26:56.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:26:56.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:26:56.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:26:56.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.0 2024-09-12T00:26:56.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.0 2024-09-12T00:26:56.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.1 2024-09-12T00:26:56.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.1 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.2 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.2 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.3 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.3 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.4 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.4 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.5 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.5 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.6 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.6 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.7 2024-09-12T00:26:56.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.7 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.8 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.8 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.9 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.9 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.10 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.10 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.11 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.11 2024-09-12T00:26:56.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.0 2024-09-12T00:26:56.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1 2024-09-12T00:26:56.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.2 2024-09-12T00:26:56.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.3 2024-09-12T00:26:56.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.4 2024-09-12T00:26:56.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.881+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.5 2024-09-12T00:26:56.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.881+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.6 2024-09-12T00:26:56.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.882+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.7 2024-09-12T00:26:56.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.882+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.8 2024-09-12T00:26:56.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.883+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.9 2024-09-12T00:26:56.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.884+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.10 2024-09-12T00:26:56.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.887+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:56.886 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.887+0000 7f7e23687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:26:56.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.889+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.889+0000 7f7e23687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.889+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.887 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.889+0000 7f7e23687800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:26:56.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94729501316144 notifier 6884 bl.length()=1015 2024-09-12T00:26:56.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:26:56.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:26:56.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:26:56.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:26:56.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.0 2024-09-12T00:26:56.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1 2024-09-12T00:26:56.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.2 2024-09-12T00:26:56.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.3 2024-09-12T00:26:56.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.4 2024-09-12T00:26:56.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.5 2024-09-12T00:26:56.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.895+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.6 2024-09-12T00:26:56.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.895+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.7 2024-09-12T00:26:56.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.8 2024-09-12T00:26:56.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.9 2024-09-12T00:26:56.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.10 2024-09-12T00:26:56.895 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7e23687800 time 2024-09-12T00:26:56.898119+0000 2024-09-12T00:26:56.895 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:26:56.914 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:56.914 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7e26b8c71a] 2024-09-12T00:26:56.914 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7e26b8c8d8] 2024-09-12T00:26:56.914 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ec148641] 2024-09-12T00:26:56.914 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ec158637] 2024-09-12T00:26:56.914 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:26:56.914 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f7e25829590] 2024-09-12T00:26:56.914 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f7e23687800 thread_name:radosgw-admin 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.897+0000 7f7e23687800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7e23687800 time 2024-09-12T00:26:56.898119+0000 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7e26b8c71a] 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7e26b8c8d8] 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ec148641] 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ec158637] 2024-09-12T00:26:56.915 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f7e25829590] 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7e2583e6f0] 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7e2588b99c] 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7e26b8c774] 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7e26b8c8d8] 2024-09-12T00:26:56.916 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ec148641] 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ec158637] 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f7e25829590] 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.898+0000 7f7e23687800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f7e23687800 thread_name:radosgw-admin 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7e2583e6f0] 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7e2588b99c] 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:26:56.917 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7e26b8c774] 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7e26b8c8d8] 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ec148641] 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ec158637] 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f7e25829590] 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.918 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): get_auth_request con 0x5627ee222280 auth_method 0 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): get_auth_request con 0x5627ee2ad450 auth_method 0 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.919 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): handle_auth_done global_id 6875 payload 824 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient: _finish_hunting 0 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:26:56.822+0000 7f7e21171640 1 monclient: found mon.noname-c 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: dump: 2024-09-12T00:26:56.920 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: _finish_auth 0 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: _check_auth_tickets 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:56.921 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: dump: 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:26:56.823+0000 7f7e23687800 5 monclient: authenticate success, global_id 6875 2024-09-12T00:26:56.922 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:26:56.823+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:26:56.823+0000 7f7d0f606640 4 set_mon_vals no callback set 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:26:56.823+0000 7f7e23687800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:26:56.823+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:26:56.823+0000 7f7e23687800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:26:56.823+0000 7f7e23687800 1 librados: init done 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:26:56.825+0000 7f7d0de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:26:56.825+0000 7f7d0de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:26:56.825+0000 7f7d0de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:26:56.825+0000 7f7e20970640 10 monclient: get_auth_request con 0x7f7d08076470 auth_method 0 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:26:56.825+0000 7f7e21972640 10 monclient: get_auth_request con 0x5627ee392b20 auth_method 0 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:26:56.826+0000 7f7e21171640 10 monclient: get_auth_request con 0x5627ee3b5650 auth_method 0 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:26:56.827+0000 7f7e20970640 10 monclient: get_auth_request con 0x5627ee3b9df0 auth_method 0 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:26:56.828+0000 7f7e23687800 10 monclient: build_initial_monmap 2024-09-12T00:26:56.923 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:26:56.828+0000 7f7e23687800 1 build_initial for_mkfs: 0 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:26:56.828+0000 7f7e23687800 10 monclient: monmap: 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:56.924 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding auth protocol: cephx 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding auth protocol: cephx 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding auth protocol: cephx 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:56.925 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:26:56.829+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 asok(0x5627ee149630) register_command objecter_requests cmddesc objecter_requests hook 0x5627ee3c2500 EEXIST 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient: init 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding auth protocol: cephx 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding auth protocol: cephx 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding auth protocol: cephx 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:56.926 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:26:56.829+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:26:56.829+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 asok(0x5627ee149630) register_command rotate-key cmddesc rotate-key hook 0x5627ee3bd370 EEXIST 2024-09-12T00:26:56.927 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:56.928 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:26:56.928 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-a con 0x5627ee3e61f0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:56.928 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-c con 0x5627ee3e84c0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:56.928 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-b con 0x5627ee3e49c0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:56.929 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.929 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.929 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.929 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:56.929 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): authenticate will time out at 2236.394960s 2024-09-12T00:26:56.930 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): get_auth_request con 0x5627ee3e84c0 auth_method 0 2024-09-12T00:26:56.930 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.930 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.930 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.930 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): get_auth_request con 0x5627ee3e61f0 auth_method 0 2024-09-12T00:26:56.931 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.931 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.931 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.932 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): get_auth_request con 0x5627ee3e49c0 auth_method 0 2024-09-12T00:26:56.932 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.932 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.934 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.934 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.934 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): handle_auth_done global_id 7335 payload 824 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient: _finish_hunting 0 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:26:56.830+0000 7f7e21171640 1 monclient: found mon.noname-a 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:56.937 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:56.937 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: dump: 2024-09-12T00:26:56.937 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:56.937 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:56.937 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.938 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.938 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:56.938 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.938 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:56.938 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:56.939 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:56.939 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.939 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: _finish_auth 0 2024-09-12T00:26:56.939 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:26:56.940 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:26:56.830+0000 7f7e23687800 5 monclient: authenticate success, global_id 7335 2024-09-12T00:26:56.940 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:26:56.830+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:56.940 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:26:56.830+0000 7f7e23687800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:56.940 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:56.941 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:56.941 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:56.941 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: dump: 2024-09-12T00:26:56.941 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:56.941 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:56.942 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.942 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.942 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:56.942 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.942 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:56.942 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:26:56.830+0000 7f7e22173640 4 set_mon_vals no callback set 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:26:56.830+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:26:56.830+0000 7f7e23687800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:26:56.832+0000 7f7d06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:26:56.832+0000 7f7d06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:26:56.832+0000 7f7d06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:56.943 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:26:56.832+0000 7f7e20970640 10 monclient: get_auth_request con 0x7f7cfc076520 auth_method 0 2024-09-12T00:26:56.944 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:26:56.832+0000 7f7e23687800 10 monclient: get_monmap_and_config 2024-09-12T00:26:56.944 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:26:56.832+0000 7f7e23687800 10 monclient: build_initial_monmap 2024-09-12T00:26:56.944 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:26:56.832+0000 7f7e23687800 1 build_initial for_mkfs: 0 2024-09-12T00:26:56.944 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:26:56.832+0000 7f7e23687800 10 monclient: monmap: 2024-09-12T00:26:56.944 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:56.944 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:56.944 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:56.945 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:56.945 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:56.945 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.945 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:56.945 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:56.945 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:56.945 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.945 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding auth protocol: cephx 2024-09-12T00:26:56.946 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding auth protocol: cephx 2024-09-12T00:26:56.946 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding auth protocol: cephx 2024-09-12T00:26:56.946 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:56.946 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:56.946 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:56.948 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:56.948 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:56.949 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:56.949 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:56.949 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:56.949 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:56.949 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:56.949 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:56.949 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:56.949 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:26:56.833+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient: init 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding auth protocol: cephx 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding auth protocol: cephx 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding auth protocol: cephx 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:56.951 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:56.951 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:56.951 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:56.951 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:56.951 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:56.951 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:56.951 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:26:56.833+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:26:56.833+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 asok(0x5627ee149630) register_command rotate-key cmddesc rotate-key hook 0x7ffdb1d83868 EEXIST 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-a con 0x5627ee43a740 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-c con 0x5627ee42b090 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-b con 0x5627ee435b70 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): authenticate will time out at 2236.398921s 2024-09-12T00:26:56.953 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): get_auth_request con 0x5627ee42b090 auth_method 0 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): get_auth_request con 0x5627ee43a740 auth_method 0 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:26:56.834+0000 7f7e21972640 10 monclient(hunting): get_auth_request con 0x5627ee435b70 auth_method 0 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:26:56.834+0000 7f7e21972640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:26:56.834+0000 7f7e21972640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:26:56.834+0000 7f7e21972640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): handle_auth_done global_id 7338 payload 274 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient: _finish_hunting 0 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:26:56.834+0000 7f7e21171640 1 monclient: found mon.noname-a 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: dump: 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: _finish_auth 0 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:26:56.834+0000 7f7e23687800 5 monclient: authenticate success, global_id 7338 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:26:56.834+0000 7f7e23687800 10 monclient: get_monmap_and_config success 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:26:56.834+0000 7f7e23687800 4 set_mon_vals no callback set 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: dump: 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:56.959 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:56.959 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.959 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:26:56.835+0000 7f7e23687800 10 monclient: shutdown 2024-09-12T00:26:56.959 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:26:56.835+0000 7f7e23687800 10 monclient: build_initial_monmap 2024-09-12T00:26:56.959 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 build_initial for_mkfs: 0 2024-09-12T00:26:56.959 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:26:56.835+0000 7f7e23687800 10 monclient: monmap: 2024-09-12T00:26:56.959 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding auth protocol: cephx 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding auth protocol: cephx 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding auth protocol: cephx 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:26:56.835+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 librados: starting msgr at 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 librados: starting objecter 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 asok(0x5627ee149630) register_command objecter_requests cmddesc objecter_requests hook 0x5627ee4070e0 EEXIST 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 librados: setting wanted keys 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 librados: calling monclient init 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:26:56.835+0000 7f7e23687800 10 monclient: init 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding auth protocol: cephx 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding auth protocol: cephx 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding auth protocol: cephx 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:26:56.835+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:26:56.836+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:26:56.836+0000 7f7e23687800 5 asok(0x5627ee149630) register_command rotate-key cmddesc rotate-key hook 0x5627ee3fe0e8 EEXIST 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-b con 0x5627ee42b090 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-c con 0x5627ee435b70 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-a con 0x5627ee43a740 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): authenticate will time out at 2236.401275s 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): get_auth_request con 0x5627ee435b70 auth_method 0 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): get_auth_request con 0x5627ee43a740 auth_method 0 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): handle_auth_done global_id 6884 payload 824 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient: _finish_hunting 0 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:26:56.836+0000 7f7e20970640 1 monclient: found mon.noname-c 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:26:56.836+0000 7f7e21171640 10 monclient: get_auth_request con 0x5627ee42b090 auth_method 0 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: dump: 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:56.967 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: dump: 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:26:56.836+0000 7f7e23687800 5 monclient: authenticate success, global_id 6884 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:26:56.836+0000 7f7d04ff9640 4 set_mon_vals no callback set 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:26:56.837+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:26:56.837+0000 7f7e23687800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:26:56.837+0000 7f7e23687800 1 librados: init done 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:26:56.837+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cr dump hook 0x7f7e14096fb8 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:26:56.838+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:26:56.839+0000 7f7cf2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:26:56.839+0000 7f7cf2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:26:56.839+0000 7f7cf2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:26:56.839+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7cec076470 auth_method 0 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:26:56.840+0000 7f7e21972640 10 monclient: get_auth_request con 0x5627ee454880 auth_method 0 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 realm 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:26:56.840+0000 7f7e23687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:26:56.841+0000 7f7e21171640 10 monclient: get_auth_request con 0x5627ee458a80 auth_method 0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:26:56.841+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:26:56.841+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:26:56.841+0000 7f7e20970640 10 monclient: get_auth_request con 0x5627ee45c300 auth_method 0 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:26:56.842+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:26:56.842+0000 7f7e23687800 20 searching for the correct realm 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:26:56.842+0000 7f7e21972640 10 monclient: get_auth_request con 0x5627ee461080 auth_method 0 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:26:56.843+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7e1c017020 auth_method 0 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:26:56.844+0000 7f7e20970640 10 monclient: get_auth_request con 0x7f7e14040070 auth_method 0 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:26:56.845+0000 7f7e21171640 0 -- 172.21.15.33:0/2465018263 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f7e1c017020 msgr2=0x7f7e1c00f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:26:56.845+0000 7f7cf2ffd640 1 client.6884.objecter ms_handle_reset 0x7f7e1c017020 session 0x7f7e1c00ad20 osd.7 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:26:56.845+0000 7f7cf2ffd640 10 monclient: _renew_subs 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:26:56.845+0000 7f7cf2ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:26:56.845+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7cec086ba0 auth_method 0 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:26:56.846+0000 7f7e21972640 10 monclient: get_auth_request con 0x7f7e18090060 auth_method 0 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:26:56.848+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7e180b90c0 auth_method 0 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:26:56.848+0000 7f7e21171640 0 -- 172.21.15.33:0/2465018263 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f7e180b90c0 msgr2=0x7f7e180b15f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:26:56.848+0000 7f7cf2ffd640 1 client.6884.objecter ms_handle_reset 0x7f7e180b90c0 session 0x7f7e18005040 osd.0 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:26:56.848+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7e1c017020 auth_method 0 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 zone default found 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:26:56.853+0000 7f7e23687800 4 Realm: () 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:26:56.853+0000 7f7e23687800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:26:56.853+0000 7f7e23687800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:26:56.853+0000 7f7e23687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 zonegroup default 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:26:56.854+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:26:56.854+0000 7f7e23687800 20 started sync module instance, tier type = 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:26:56.854+0000 7f7e23687800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=0 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=1 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=2 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=3 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=4 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=5 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=6 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:26:56.864+0000 7f7e23687800 20 add_watcher() i=7 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:26:56.864+0000 7f7e23687800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding auth protocol: cephx 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding auth protocol: cephx 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding auth protocol: cephx 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:26:56.865+0000 7f7cd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:26:56.866+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:56.979 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cache list hook 0x5627ee4315b0 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cache inspect hook 0x5627ee4315b0 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cache erase hook 0x5627ee4315b0 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cache zap hook 0x5627ee4315b0 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 note: GC not initialized 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:26:56.866+0000 7f7cd67e4640 20 reqs_thread_entry: start 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command sync trace show hook 0x7f7e14065070 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command sync trace history hook 0x7f7e14065070 2024-09-12T00:26:56.980 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command sync trace active hook 0x7f7e14065070 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command sync trace active_short hook 0x7f7e14065070 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 Filter name: none 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:26:56.866+0000 7f7c47fff640 20 reqs_thread_entry: start 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:26:56.866+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : miss 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.981 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:26:56.872+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:26:56.872+0000 7f7e23687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:26:56.872+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.982 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:26:56.872+0000 7f7e23687800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94729501316144 notifier 6884 bl.length()=1015 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.0 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.0 2024-09-12T00:26:56.983 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.1 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.1 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.2 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.2 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.3 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.3 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.4 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.4 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.5 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.5 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.6 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.6 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.7 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.7 2024-09-12T00:26:56.984 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.8 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.8 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.9 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.9 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.10 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.10 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.11 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.11 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.0 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.2 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.3 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.4 2024-09-12T00:26:56.985 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:26:56.881+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.5 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:26:56.881+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.6 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:26:56.882+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.7 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:26:56.882+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.8 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:26:56.883+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.9 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:26:56.884+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.10 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:26:56.887+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:26:56.887+0000 7f7e23687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:26:56.889+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:26:56.889+0000 7f7e23687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:26:56.889+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:26:56.889+0000 7f7e23687800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94729501316144 notifier 6884 bl.length()=1015 2024-09-12T00:26:56.986 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.0 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.2 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.3 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.4 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.5 2024-09-12T00:26:56.987 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:26:56.895+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.6 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:26:56.895+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.7 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.8 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.9 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.10 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:26:56.897+0000 7f7e23687800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7e23687800 time 2024-09-12T00:26:56.898119+0000 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7e26b8c71a] 2024-09-12T00:26:56.988 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7e26b8c8d8] 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ec148641] 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ec158637] 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f7e25829590] 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:26:56.898+0000 7f7e23687800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f7e23687800 thread_name:radosgw-admin 2024-09-12T00:26:56.989 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7e2583e6f0] 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7e2588b99c] 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7e26b8c774] 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7e26b8c8d8] 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ec148641] 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ec158637] 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f7e25829590] 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:26:56.992 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:26:56.992 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:26:56.992 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:26:56.994 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:26:56.995 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:26:56.996 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:26:56.997 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:26:56.998 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:26:56.999 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7c47fff640 / http_manager 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7cd67e4640 / http_manager 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7cd77e6640 / rgw_dt_lg_renew 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7cf2ffd640 / ms_dispatch 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7cf3fff640 / io_context_pool 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7d04ff9640 / io_context_pool 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7d06ffd640 / ms_dispatch 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7d0de03640 / ms_dispatch 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7d0f606640 / io_context_pool 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e20970640 / msgr-worker-2 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e21171640 / msgr-worker-1 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e21972640 / msgr-worker-0 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e22173640 / io_context_pool 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e23687800 / radosgw-admin 2024-09-12T00:26:57.000 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.121596.log 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): get_auth_request con 0x5627ee222280 auth_method 0 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.001 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.002 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.002 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): get_auth_request con 0x5627ee2ad450 auth_method 0 2024-09-12T00:26:57.002 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.002 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.002 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.002 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:26:56.822+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:26:56.822+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient(hunting): handle_auth_done global_id 6875 payload 824 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient: _finish_hunting 0 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:26:56.822+0000 7f7e21171640 1 monclient: found mon.noname-c 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:26:56.822+0000 7f7e21171640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:26:57.003 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: dump: 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: _finish_auth 0 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: _check_auth_tickets 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:26:56.823+0000 7f7d0de03640 10 monclient: dump: 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:26:56.823+0000 7f7e23687800 5 monclient: authenticate success, global_id 6875 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:26:56.823+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:26:56.823+0000 7f7d0f606640 4 set_mon_vals no callback set 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:26:56.823+0000 7f7e23687800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:26:56.823+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:26:56.823+0000 7f7e23687800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:26:56.823+0000 7f7e23687800 1 librados: init done 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:26:56.825+0000 7f7d0de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:26:56.825+0000 7f7d0de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:26:56.825+0000 7f7d0de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:26:56.825+0000 7f7e20970640 10 monclient: get_auth_request con 0x7f7d08076470 auth_method 0 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:26:56.825+0000 7f7e21972640 10 monclient: get_auth_request con 0x5627ee392b20 auth_method 0 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:26:56.826+0000 7f7e21171640 10 monclient: get_auth_request con 0x5627ee3b5650 auth_method 0 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:26:56.827+0000 7f7e20970640 10 monclient: get_auth_request con 0x5627ee3b9df0 auth_method 0 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:26:56.828+0000 7f7e23687800 10 monclient: build_initial_monmap 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:26:56.828+0000 7f7e23687800 1 build_initial for_mkfs: 0 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:26:56.828+0000 7f7e23687800 10 monclient: monmap: 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:57.007 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding auth protocol: cephx 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding auth protocol: cephx 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding auth protocol: cephx 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: crc 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:26:56.828+0000 7f7e23687800 5 AuthRegistry(0x5627ee3beb50) adding con mode: secure 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:26:56.829+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 asok(0x5627ee149630) register_command objecter_requests cmddesc objecter_requests hook 0x5627ee3c2500 EEXIST 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient: init 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding auth protocol: cephx 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding auth protocol: cephx 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding auth protocol: cephx 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: crc 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 AuthRegistry(0x5627ee3bd228) adding con mode: secure 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:26:56.829+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:26:56.829+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:26:56.829+0000 7f7e23687800 5 asok(0x5627ee149630) register_command rotate-key cmddesc rotate-key hook 0x5627ee3bd370 EEXIST 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:57.011 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:26:57.012 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-a con 0x5627ee3e61f0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:57.012 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-c con 0x5627ee3e84c0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:57.012 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-b con 0x5627ee3e49c0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:57.012 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.012 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.012 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.012 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:26:56.829+0000 7f7e23687800 10 monclient(hunting): authenticate will time out at 2236.394960s 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): get_auth_request con 0x5627ee3e84c0 auth_method 0 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): get_auth_request con 0x5627ee3e61f0 auth_method 0 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): get_auth_request con 0x5627ee3e49c0 auth_method 0 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:26:56.830+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.014 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:26:56.830+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient(hunting): handle_auth_done global_id 7335 payload 824 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient: _finish_hunting 0 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:26:56.830+0000 7f7e21171640 1 monclient: found mon.noname-a 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:26:56.830+0000 7f7e21171640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: dump: 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: _finish_auth 0 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:26:56.830+0000 7f7e23687800 5 monclient: authenticate success, global_id 7335 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:26:56.830+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:26:56.830+0000 7f7e23687800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:26:56.830+0000 7f7d06ffd640 10 monclient: dump: 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:26:56.830+0000 7f7e22173640 4 set_mon_vals no callback set 2024-09-12T00:26:57.017 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:26:56.830+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:26:56.830+0000 7f7e23687800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:26:56.832+0000 7f7d06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:26:56.832+0000 7f7d06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:26:56.832+0000 7f7d06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:26:56.832+0000 7f7e20970640 10 monclient: get_auth_request con 0x7f7cfc076520 auth_method 0 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:26:56.832+0000 7f7e23687800 10 monclient: get_monmap_and_config 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:26:56.832+0000 7f7e23687800 10 monclient: build_initial_monmap 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:26:56.832+0000 7f7e23687800 1 build_initial for_mkfs: 0 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:26:56.832+0000 7f7e23687800 10 monclient: monmap: 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:57.018 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding auth protocol: cephx 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding auth protocol: cephx 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding auth protocol: cephx 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:57.019 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: crc 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:26:56.832+0000 7f7e23687800 5 AuthRegistry(0x5627ee406120) adding con mode: secure 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:26:56.833+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient: init 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding auth protocol: cephx 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding auth protocol: cephx 2024-09-12T00:26:57.020 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding auth protocol: cephx 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:57.021 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: crc 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83720) adding con mode: secure 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:26:56.833+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:26:56.833+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:26:56.833+0000 7f7e23687800 5 asok(0x5627ee149630) register_command rotate-key cmddesc rotate-key hook 0x7ffdb1d83868 EEXIST 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-a con 0x5627ee43a740 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-c con 0x5627ee42b090 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-b con 0x5627ee435b70 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.022 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.023 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.023 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:57.023 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:26:56.833+0000 7f7e23687800 10 monclient(hunting): authenticate will time out at 2236.398921s 2024-09-12T00:26:57.023 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): get_auth_request con 0x5627ee42b090 auth_method 0 2024-09-12T00:26:57.023 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.023 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.023 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.023 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): get_auth_request con 0x5627ee43a740 auth_method 0 2024-09-12T00:26:57.024 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.024 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.024 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.024 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.024 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.024 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:26:56.834+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.025 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.025 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.025 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.025 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:26:56.834+0000 7f7e21972640 10 monclient(hunting): get_auth_request con 0x5627ee435b70 auth_method 0 2024-09-12T00:26:57.025 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:26:56.834+0000 7f7e21972640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.025 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:26:56.834+0000 7f7e21972640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.026 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:26:56.834+0000 7f7e21972640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.026 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient(hunting): handle_auth_done global_id 7338 payload 274 2024-09-12T00:26:57.026 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient: _finish_hunting 0 2024-09-12T00:26:57.026 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:26:56.834+0000 7f7e21171640 1 monclient: found mon.noname-a 2024-09-12T00:26:57.026 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:26:56.834+0000 7f7e21171640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:26:57.027 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:57.027 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:26:57.028 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: dump: 2024-09-12T00:26:57.028 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:57.028 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:57.028 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.028 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.028 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:57.029 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.029 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:57.029 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:57.029 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:57.029 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.030 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: _finish_auth 0 2024-09-12T00:26:57.030 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:26:57.030 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:57.030 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:26:56.834+0000 7f7e23687800 5 monclient: authenticate success, global_id 7338 2024-09-12T00:26:57.030 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:26:56.834+0000 7f7e23687800 10 monclient: get_monmap_and_config success 2024-09-12T00:26:57.030 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:26:56.834+0000 7f7e23687800 4 set_mon_vals no callback set 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:26:56.834+0000 7f7d04ff9640 10 monclient: dump: 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:57.031 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:26:56.835+0000 7f7e23687800 10 monclient: shutdown 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:26:56.835+0000 7f7e23687800 10 monclient: build_initial_monmap 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 build_initial for_mkfs: 0 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:26:56.835+0000 7f7e23687800 10 monclient: monmap: 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:26:57.032 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding auth protocol: cephx 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding auth protocol: cephx 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding auth protocol: cephx 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:57.033 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: crc 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee42b580) adding con mode: secure 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:26:56.835+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 librados: starting msgr at 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 librados: starting objecter 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 asok(0x5627ee149630) register_command objecter_requests cmddesc objecter_requests hook 0x5627ee4070e0 EEXIST 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 librados: setting wanted keys 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:26:56.835+0000 7f7e23687800 1 librados: calling monclient init 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:26:56.835+0000 7f7e23687800 10 monclient: init 2024-09-12T00:26:57.034 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding auth protocol: cephx 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding auth protocol: cephx 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding auth protocol: cephx 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: crc 2024-09-12T00:26:57.035 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:26:56.835+0000 7f7e23687800 5 AuthRegistry(0x5627ee3fdfa0) adding con mode: secure 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:26:56.835+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:26:56.836+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:26:56.836+0000 7f7e23687800 5 asok(0x5627ee149630) register_command rotate-key cmddesc rotate-key hook 0x5627ee3fe0e8 EEXIST 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient: _reopen_session rank -1 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-b con 0x5627ee42b090 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-c con 0x5627ee435b70 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): picked mon.noname-a con 0x5627ee43a740 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): start opening mon connection 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): _renew_subs 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient(hunting): authenticate will time out at 2236.401275s 2024-09-12T00:26:57.036 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): get_auth_request con 0x5627ee435b70 auth_method 0 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): get_auth_request con 0x5627ee43a740 auth_method 0 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:26:56.836+0000 7f7e21972640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:26:57.037 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient(hunting): handle_auth_done global_id 6884 payload 824 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient: _finish_hunting 0 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:26:56.836+0000 7f7e20970640 1 monclient: found mon.noname-c 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:26:56.836+0000 7f7e20970640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:26:56.836+0000 7f7e21171640 10 monclient: get_auth_request con 0x5627ee42b090 auth_method 0 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: dump: 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:57.038 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:26:56.836+0000 7f7cf2ffd640 10 monclient: dump: 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:26:57.039 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:26:56.836+0000 7f7e23687800 5 monclient: authenticate success, global_id 6884 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:26:56.836+0000 7f7e23687800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:26:56.836+0000 7f7d04ff9640 4 set_mon_vals no callback set 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:26:56.837+0000 7f7e23687800 10 monclient: _renew_subs 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:26:56.837+0000 7f7e23687800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:57.040 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:26:56.837+0000 7f7e23687800 1 librados: init done 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:26:56.837+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cr dump hook 0x7f7e14096fb8 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:26:56.838+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:26:56.839+0000 7f7cf2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:26:56.839+0000 7f7cf2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:26:56.839+0000 7f7cf2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:26:56.839+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7cec076470 auth_method 0 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:26:56.840+0000 7f7e21972640 10 monclient: get_auth_request con 0x5627ee454880 auth_method 0 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.041 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 realm 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:26:56.840+0000 7f7e23687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:26:56.840+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:26:56.841+0000 7f7e21171640 10 monclient: get_auth_request con 0x5627ee458a80 auth_method 0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:26:56.841+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:26:56.841+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:26:56.841+0000 7f7e20970640 10 monclient: get_auth_request con 0x5627ee45c300 auth_method 0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:26:56.842+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:26:56.842+0000 7f7e23687800 20 searching for the correct realm 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:26:56.842+0000 7f7e21972640 10 monclient: get_auth_request con 0x5627ee461080 auth_method 0 2024-09-12T00:26:57.042 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:26:56.843+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7e1c017020 auth_method 0 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:26:56.844+0000 7f7e20970640 10 monclient: get_auth_request con 0x7f7e14040070 auth_method 0 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:26:56.845+0000 7f7e21171640 0 -- 172.21.15.33:0/2465018263 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f7e1c017020 msgr2=0x7f7e1c00f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:26:56.845+0000 7f7cf2ffd640 1 client.6884.objecter ms_handle_reset 0x7f7e1c017020 session 0x7f7e1c00ad20 osd.7 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:26:56.845+0000 7f7cf2ffd640 10 monclient: _renew_subs 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:26:56.845+0000 7f7cf2ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:26:56.845+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7cec086ba0 auth_method 0 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:26:56.846+0000 7f7e21972640 10 monclient: get_auth_request con 0x7f7e18090060 auth_method 0 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:26:56.848+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7e180b90c0 auth_method 0 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:26:56.848+0000 7f7e21171640 0 -- 172.21.15.33:0/2465018263 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f7e180b90c0 msgr2=0x7f7e180b15f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:26:56.848+0000 7f7cf2ffd640 1 client.6884.objecter ms_handle_reset 0x7f7e180b90c0 session 0x7f7e18005040 osd.0 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:26:56.848+0000 7f7e21171640 10 monclient: get_auth_request con 0x7f7e1c017020 auth_method 0 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:57.043 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:26:56.852+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 zone default found 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:26:56.853+0000 7f7e23687800 4 Realm: () 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:26:56.853+0000 7f7e23687800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:57.044 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:26:56.853+0000 7f7e23687800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:26:56.853+0000 7f7e23687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 zonegroup default 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:26:56.853+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:26:56.854+0000 7f7e23687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:26:56.854+0000 7f7e23687800 20 started sync module instance, tier type = 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:26:56.854+0000 7f7e23687800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=0 2024-09-12T00:26:57.045 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=1 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=2 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=3 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=4 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=5 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:26:56.863+0000 7f7e23687800 20 add_watcher() i=6 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:26:56.864+0000 7f7e23687800 20 add_watcher() i=7 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:26:56.864+0000 7f7e23687800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding auth protocol: cephx 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding auth protocol: cephx 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding auth protocol: cephx 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:57.046 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: crc 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:26:56.865+0000 7f7e23687800 5 AuthRegistry(0x7ffdb1d83c00) adding con mode: secure 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:26:56.865+0000 7f7cd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:26:56.866+0000 7f7e23687800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:57.047 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cache list hook 0x5627ee4315b0 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cache inspect hook 0x5627ee4315b0 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cache erase hook 0x5627ee4315b0 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command cache zap hook 0x5627ee4315b0 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 note: GC not initialized 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:26:56.866+0000 7f7cd67e4640 20 reqs_thread_entry: start 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command sync trace show hook 0x7f7e14065070 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command sync trace history hook 0x7f7e14065070 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command sync trace active hook 0x7f7e14065070 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:26:56.866+0000 7f7e23687800 5 asok(0x5627ee149630) register_command sync trace active_short hook 0x7f7e14065070 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 Filter name: none 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:26:56.866+0000 7f7c47fff640 20 reqs_thread_entry: start 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:26:56.866+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:26:57.048 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:26:56.866+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : miss 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:26:56.867+0000 7f7e23687800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:26:56.867+0000 7f7e23687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:26:56.872+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:57.049 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:26:56.872+0000 7f7e23687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:26:56.872+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:26:56.872+0000 7f7e23687800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94729501316144 notifier 6884 bl.length()=1015 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:26:56.872+0000 7f7cf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:26:56.874+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.0 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.0 2024-09-12T00:26:57.050 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.1 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.1 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.2 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.2 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.3 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.3 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.4 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.4 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.5 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.5 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.6 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.6 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.7 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.7 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.8 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.8 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.9 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.9 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.10 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.10 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:26:56.879+0000 7f7e23687800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.11 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.11 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.0 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:26:56.879+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1 2024-09-12T00:26:57.052 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.2 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.3 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:26:56.880+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.4 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:26:56.881+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.5 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:26:56.881+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.6 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:26:56.882+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.7 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:26:56.882+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.8 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:26:56.883+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.9 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:26:56.884+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.10 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:26:56.887+0000 7f7e23687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:26:56.887+0000 7f7e23687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:26:56.889+0000 7f7e23687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:26:56.889+0000 7f7e23687800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:57.053 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:26:56.889+0000 7f7e23687800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:26:56.889+0000 7f7e23687800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94729501316144 notifier 6884 bl.length()=1015 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:26:56.889+0000 7f7d04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:26:56.891+0000 7f7e23687800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.0 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:26:56.893+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.2 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.3 2024-09-12T00:26:57.054 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.4 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:26:56.894+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.5 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:26:56.895+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.6 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:26:56.895+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.7 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.8 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.9 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:26:56.896+0000 7f7e23687800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.10 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:26:56.897+0000 7f7e23687800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7e23687800 time 2024-09-12T00:26:56.898119+0000 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7e26b8c71a] 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7e26b8c8d8] 2024-09-12T00:26:57.055 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ec148641] 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ec158637] 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f7e25829590] 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:26:56.898+0000 7f7e23687800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f7e23687800 thread_name:radosgw-admin 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7e2583e6f0] 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7e2588b99c] 2024-09-12T00:26:57.056 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7e26b8c774] 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7e26b8c8d8] 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ec148641] 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ec158637] 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f7e25829590] 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:26:57.057 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:26:57.058 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:26:57.059 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:26:57.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:26:57.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:26:57.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:26:57.063 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7c47fff640 / http_manager 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7cd67e4640 / http_manager 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7cd77e6640 / rgw_dt_lg_renew 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7cf2ffd640 / ms_dispatch 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7cf3fff640 / io_context_pool 2024-09-12T00:26:57.064 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7d04ff9640 / io_context_pool 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7d06ffd640 / ms_dispatch 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7d0de03640 / ms_dispatch 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7d0f606640 / io_context_pool 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e20970640 / msgr-worker-2 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e21171640 / msgr-worker-1 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e21972640 / msgr-worker-0 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e22173640 / io_context_pool 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: 7f7e23687800 / radosgw-admin 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:26:56.899505Z_fec19976-b028-4ac0-9398-c989650827cc/log 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:26:57.065 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.977+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.979+0000 7f64d832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.979+0000 7f64d832c800 20 realm 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.979+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.979+0000 7f64d832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.979+0000 7f64d832c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.979+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.979+0000 7f64d832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.979+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.980+0000 7f64d832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.980+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.981+0000 7f64d832c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.981+0000 7f64d832c800 20 searching for the correct realm 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.985+0000 7f64d473f640 0 -- 172.21.15.33:0/1490363952 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x560f2b923f50 msgr2=0x560f2b926370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.988+0000 7f64d373d640 0 -- 172.21.15.33:0/1490363952 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x560f2b92b970 msgr2=0x560f2b92dd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.992+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 zone default found 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 4 Realm: () 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 zonegroup default 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 started sync module instance, tier type = 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:56.993+0000 7f64d832c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.003+0000 7f64d832c800 20 add_watcher() i=0 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.003+0000 7f64d832c800 20 add_watcher() i=1 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.003+0000 7f64d832c800 20 add_watcher() i=2 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.003+0000 7f64d832c800 20 add_watcher() i=3 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.003+0000 7f64d832c800 20 add_watcher() i=4 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.003+0000 7f64d832c800 20 add_watcher() i=5 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.003+0000 7f64d832c800 20 add_watcher() i=6 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.004+0000 7f64d832c800 20 add_watcher() i=7 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.004+0000 7f64d832c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.005+0000 7f6389fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.006+0000 7f64d832c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.006+0000 7f64d832c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.006+0000 7f64d832c800 5 note: GC not initialized 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.006+0000 7f6388fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.006+0000 7f64d832c800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.006+0000 7f64d832c800 20 Filter name: none 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.006+0000 7f63027fc640 20 reqs_thread_entry: start 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.006+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.007+0000 7f64d832c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.007+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.007+0000 7f64d832c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.007+0000 7f64d832c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.007+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.008+0000 7f64d832c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.008+0000 7f64d832c800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.008+0000 7f64d832c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.008+0000 7f64d832c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.010+0000 7f6389fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.012+0000 7f64d832c800 20 remove_watcher() i=0 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.012+0000 7f64d832c800 2 removed watcher, disabling cache 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.013+0000 7f64d832c800 20 remove_watcher() i=1 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.014+0000 7f64d832c800 20 remove_watcher() i=2 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.015+0000 7f64d832c800 20 remove_watcher() i=3 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.017+0000 7f64d832c800 20 remove_watcher() i=4 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.018+0000 7f64d832c800 20 remove_watcher() i=5 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.019+0000 7f64d832c800 20 remove_watcher() i=6 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:26:57.020+0000 7f64d832c800 20 remove_watcher() i=7 2024-09-12T00:26:57.076 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.077 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:26:57.077 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-commit-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:26:57.077 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:26:57.077 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.077 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:27.195 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:27.196 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:27.255 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:27:27.288 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:27.288 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:27.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.331+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.333+0000 7f39d6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.333+0000 7f39d6898800 20 realm 2024-09-12T00:27:27.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.333+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.333+0000 7f39d6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.333+0000 7f39d6898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:27.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.333+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.334+0000 7f39d6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.334+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.335+0000 7f39d6898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:27.333 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.335+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.336+0000 7f39d6898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:27.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.336+0000 7f39d6898800 20 searching for the correct realm 2024-09-12T00:27:27.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.339+0000 7f39d4b83640 0 -- 172.21.15.33:0/1132188288 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55a9adf20d90 msgr2=0x55a9adf23250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:27.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.342+0000 7f39d4382640 0 -- 172.21.15.33:0/1132188288 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f39c8064950 msgr2=0x7f39c807e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.347 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.347+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 20 zone default found 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 4 Realm: () 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:27.348 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 20 zonegroup default 2024-09-12T00:27:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.348+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.349+0000 7f39d6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.349+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.349+0000 7f39d6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.349+0000 7f39d6898800 20 started sync module instance, tier type = 2024-09-12T00:27:27.349 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.349+0000 7f39d6898800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:27.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.359+0000 7f39d6898800 20 add_watcher() i=0 2024-09-12T00:27:27.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.359+0000 7f39d6898800 20 add_watcher() i=1 2024-09-12T00:27:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.359+0000 7f39d6898800 20 add_watcher() i=2 2024-09-12T00:27:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.359+0000 7f39d6898800 20 add_watcher() i=3 2024-09-12T00:27:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.359+0000 7f39d6898800 20 add_watcher() i=4 2024-09-12T00:27:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.359+0000 7f39d6898800 20 add_watcher() i=5 2024-09-12T00:27:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.359+0000 7f39d6898800 20 add_watcher() i=6 2024-09-12T00:27:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.360+0000 7f39d6898800 20 add_watcher() i=7 2024-09-12T00:27:27.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.360+0000 7f39d6898800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:27.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.362+0000 7f388afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:27.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.362+0000 7f39d6898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:27.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.362+0000 7f39d6898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:27.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.362+0000 7f39d6898800 5 note: GC not initialized 2024-09-12T00:27:27.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.362+0000 7f3889fdb640 20 reqs_thread_entry: start 2024-09-12T00:27:27.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.362+0000 7f39d6898800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:27.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.362+0000 7f39d6898800 20 Filter name: none 2024-09-12T00:27:27.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.362+0000 7f37fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:27.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.363+0000 7f39d6898800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:27:27.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.363+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.363+0000 7f39d6898800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:27:27.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.363+0000 7f39d6898800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.363+0000 7f39d6898800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.363+0000 7f39d6898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : miss 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.363+0000 7f39d6898800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.364+0000 7f39d6898800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.364+0000 7f39d6898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.364+0000 7f39d6898800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.364+0000 7f39d6898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.364+0000 7f39d6898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:27.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.364+0000 7f39d6898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:27:27.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.369+0000 7f39d6898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:27:27.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.369+0000 7f39d6898800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:27:27.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.369+0000 7f39d6898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:27.368 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.369+0000 7f39d6898800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:27:27.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.370+0000 7f38ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94187256183008 notifier 6914 bl.length()=1015 2024-09-12T00:27:27.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.370+0000 7f38ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:27:27.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.370+0000 7f38ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:27:27.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.370+0000 7f38ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:27.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.371+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:27:27.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.371+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:27:27.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.371+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:27:27.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.371+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.0 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.0 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.1 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.1 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.2 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.2 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.3 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.3 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.4 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.4 2024-09-12T00:27:27.376 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.5 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.5 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.6 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.6 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.7 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.7 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.8 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.8 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.9 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.9 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.10 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.10 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.11 2024-09-12T00:27:27.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1.11 2024-09-12T00:27:27.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.0 2024-09-12T00:27:27.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.377+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1 2024-09-12T00:27:27.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.378+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.2 2024-09-12T00:27:27.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.378+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.3 2024-09-12T00:27:27.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.379+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.4 2024-09-12T00:27:27.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.379+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.5 2024-09-12T00:27:27.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.380+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.6 2024-09-12T00:27:27.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.380+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.7 2024-09-12T00:27:27.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.381+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.8 2024-09-12T00:27:27.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.382+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.9 2024-09-12T00:27:27.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.382+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.10 2024-09-12T00:27:27.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.385+0000 7f39d6898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:27:27.384 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.385+0000 7f39d6898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:27:27.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.387+0000 7f39d6898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:27:27.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.387+0000 7f39d6898800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:27:27.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.387+0000 7f39d6898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:27.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.387+0000 7f39d6898800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:27:27.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.387+0000 7f38ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94187256183008 notifier 6914 bl.length()=1015 2024-09-12T00:27:27.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.387+0000 7f38ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:27:27.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.387+0000 7f38ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:27:27.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.387+0000 7f38ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:27.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.389+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:27:27.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.389+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:27:27.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.389+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:27:27.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.389+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:27:27.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.391+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.0 2024-09-12T00:27:27.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.391+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.1 2024-09-12T00:27:27.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.392+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.2 2024-09-12T00:27:27.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.392+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.3 2024-09-12T00:27:27.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.393+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.4 2024-09-12T00:27:27.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.393+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.5 2024-09-12T00:27:27.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.393+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.6 2024-09-12T00:27:27.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.393+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.7 2024-09-12T00:27:27.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.394+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.8 2024-09-12T00:27:27.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.394+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.9 2024-09-12T00:27:27.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.395+0000 7f39d6898800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33.10 2024-09-12T00:27:27.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.395+0000 7f39d6898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:27:27.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.395+0000 7f39d6898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 2024-09-12T00:27:27.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.396+0000 7f39d6898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:27:27.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.396+0000 7f39d6898800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:27:27.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.396+0000 7f39d6898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:27.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.396+0000 7f39d6898800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33, ofs0, ns] 2024-09-12T00:27:27.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.397+0000 7f38ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 94187256183008 notifier 6914 bl.length()=983 2024-09-12T00:27:27.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.397+0000 7f38ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 info.flags=0x17 2024-09-12T00:27:27.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.397+0000 7f38ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 to cache LRU end 2024-09-12T00:27:27.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.397+0000 7f38ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:27.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.398+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_sources= new_sources= 2024-09-12T00:27:27.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.398+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential sources added=[] removed=[] 2024-09-12T00:27:27.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.398+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): orig_dests= new_dests= 2024-09-12T00:27:27.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.398+0000 7f39d6898800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33]): potential dests added=[] removed=[] 2024-09-12T00:27:27.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.401+0000 7f39d6898800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:27:27.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.403+0000 7f388afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:27.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.405+0000 7f39d6898800 20 remove_watcher() i=0 2024-09-12T00:27:27.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.405+0000 7f39d6898800 2 removed watcher, disabling cache 2024-09-12T00:27:27.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.406+0000 7f39d6898800 20 remove_watcher() i=1 2024-09-12T00:27:27.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.407+0000 7f39d6898800 20 remove_watcher() i=2 2024-09-12T00:27:27.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.408+0000 7f39d6898800 20 remove_watcher() i=3 2024-09-12T00:27:27.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.409+0000 7f39d6898800 20 remove_watcher() i=4 2024-09-12T00:27:27.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.410+0000 7f39d6898800 20 remove_watcher() i=5 2024-09-12T00:27:27.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.411+0000 7f39d6898800 20 remove_watcher() i=6 2024-09-12T00:27:27.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.412+0000 7f39d6898800 20 remove_watcher() i=7 2024-09-12T00:27:27.423 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:27:27.453 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:27.453 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:27.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.494+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.495+0000 7f7ad4f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.496+0000 7f7ad4f3d800 20 realm 2024-09-12T00:27:27.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.496+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.496+0000 7f7ad4f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.496+0000 7f7ad4f3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:27.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.496+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.496+0000 7f7ad4f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.496+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.497+0000 7f7ad4f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:27.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.497+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.498+0000 7f7ad4f3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:27.496 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.498+0000 7f7ad4f3d800 20 searching for the correct realm 2024-09-12T00:27:27.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.500+0000 7f7ad0c2a640 0 -- 172.21.15.33:0/1886370366 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f7ac806a070 msgr2=0x7f7ac80a3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:27.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.503+0000 7f7ad0c2a640 0 -- 172.21.15.33:0/1886370366 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f7ac40a61d0 msgr2=0x7f7ac4083040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:27.709 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.710+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.710 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 20 zone default found 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 4 Realm: () 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 20 zonegroup default 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.711+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.712+0000 7f7ad4f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:27.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.712+0000 7f7ad4f3d800 20 started sync module instance, tier type = 2024-09-12T00:27:27.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.712+0000 7f7ad4f3d800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:27.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.722+0000 7f7ad4f3d800 20 add_watcher() i=0 2024-09-12T00:27:27.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.722+0000 7f7ad4f3d800 20 add_watcher() i=1 2024-09-12T00:27:27.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.722+0000 7f7ad4f3d800 20 add_watcher() i=2 2024-09-12T00:27:27.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.722+0000 7f7ad4f3d800 20 add_watcher() i=3 2024-09-12T00:27:27.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.722+0000 7f7ad4f3d800 20 add_watcher() i=4 2024-09-12T00:27:27.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.722+0000 7f7ad4f3d800 20 add_watcher() i=5 2024-09-12T00:27:27.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.722+0000 7f7ad4f3d800 20 add_watcher() i=6 2024-09-12T00:27:27.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.723+0000 7f7ad4f3d800 20 add_watcher() i=7 2024-09-12T00:27:27.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.723+0000 7f7ad4f3d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:27.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.725+0000 7f79877de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:27.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.725+0000 7f7ad4f3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:27.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.725+0000 7f7ad4f3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:27.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.725+0000 7f7ad4f3d800 5 note: GC not initialized 2024-09-12T00:27:27.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.725+0000 7f79867dc640 20 reqs_thread_entry: start 2024-09-12T00:27:27.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.725+0000 7f7ad4f3d800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:27.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.725+0000 7f7ad4f3d800 20 Filter name: none 2024-09-12T00:27:27.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.726+0000 7f78f7fff640 20 reqs_thread_entry: start 2024-09-12T00:27:27.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.726+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.726+0000 7f7ad4f3d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:27:27.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.726+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.727+0000 7f7ad4f3d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:27:27.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.727+0000 7f7ad4f3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:27.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.727+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.727+0000 7f7ad4f3d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:27:27.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.727+0000 7f7ad4f3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:27.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.728+0000 7f7ad4f3d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:27:27.726 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.728+0000 7f7ad4f3d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:27.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.730+0000 7f79877de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:27.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.732+0000 7f7ad4f3d800 20 remove_watcher() i=0 2024-09-12T00:27:27.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.732+0000 7f7ad4f3d800 2 removed watcher, disabling cache 2024-09-12T00:27:27.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.733+0000 7f7ad4f3d800 20 remove_watcher() i=1 2024-09-12T00:27:27.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.734+0000 7f7ad4f3d800 20 remove_watcher() i=2 2024-09-12T00:27:27.734 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.735+0000 7f7ad4f3d800 20 remove_watcher() i=3 2024-09-12T00:27:27.735 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.737+0000 7f7ad4f3d800 20 remove_watcher() i=4 2024-09-12T00:27:27.736 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.738+0000 7f7ad4f3d800 20 remove_watcher() i=5 2024-09-12T00:27:27.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.739+0000 7f7ad4f3d800 20 remove_watcher() i=6 2024-09-12T00:27:27.738 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:27.740+0000 7f7ad4f3d800 20 remove_watcher() i=7 2024-09-12T00:27:27.749 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:27.750 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:27:27.750 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-commit-target-layout id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:27:27.750 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:27.752 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:27.752 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:27.773 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:27.773 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:27.962 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:27.962 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.098 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:27:28.098 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:28.100 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.100 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.149 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.149 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.207 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.207 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.245 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.245 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.279 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.279 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.313 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.313 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.382 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.383 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.417 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.417 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.454 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.454 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.523 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.523 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.556 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.556 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.591 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.591 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.626 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.626 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.659 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.659 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.694 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.694 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.727 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.727 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.762 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.762 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.797 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.797 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.833 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.833 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.868 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.868 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.902 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:28.902 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:28.937 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:27:28.966 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:28.966 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:29.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.006+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.008+0000 7efd8b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.008+0000 7efd8b811800 20 realm 2024-09-12T00:27:29.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.008+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.008+0000 7efd8b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.008+0000 7efd8b811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:29.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.008+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.009+0000 7efd8b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.009+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.009+0000 7efd8b811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:29.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.009+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.010+0000 7efd8b811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:29.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.010+0000 7efd8b811800 20 searching for the correct realm 2024-09-12T00:27:29.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.013+0000 7efd86747640 0 -- 172.21.15.33:0/2343789220 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x559eef11ddd0 msgr2=0x559eef1201c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:29.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.016+0000 7efd86f48640 0 -- 172.21.15.33:0/2343789220 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7efd7c0881e0 msgr2=0x7efd7c048a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:29.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:29.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:29.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:29.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:29.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:29.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:29.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:29.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.222+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:29.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 20 zone default found 2024-09-12T00:27:29.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 4 Realm: () 2024-09-12T00:27:29.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:29.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:29.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:29.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 20 zonegroup default 2024-09-12T00:27:29.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.223+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.224+0000 7efd8b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.224+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.224+0000 7efd8b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.224+0000 7efd8b811800 20 started sync module instance, tier type = 2024-09-12T00:27:29.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.224+0000 7efd8b811800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:29.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.233+0000 7efd8b811800 20 add_watcher() i=0 2024-09-12T00:27:29.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.233+0000 7efd8b811800 20 add_watcher() i=1 2024-09-12T00:27:29.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.233+0000 7efd8b811800 20 add_watcher() i=2 2024-09-12T00:27:29.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.233+0000 7efd8b811800 20 add_watcher() i=3 2024-09-12T00:27:29.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.233+0000 7efd8b811800 20 add_watcher() i=4 2024-09-12T00:27:29.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.233+0000 7efd8b811800 20 add_watcher() i=5 2024-09-12T00:27:29.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.233+0000 7efd8b811800 20 add_watcher() i=6 2024-09-12T00:27:29.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.234+0000 7efd8b811800 20 add_watcher() i=7 2024-09-12T00:27:29.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.234+0000 7efd8b811800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:29.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.235+0000 7efc3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:29.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.236+0000 7efd8b811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:29.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.236+0000 7efd8b811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:29.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.236+0000 7efd8b811800 5 note: GC not initialized 2024-09-12T00:27:29.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.236+0000 7efbb7fff640 20 reqs_thread_entry: start 2024-09-12T00:27:29.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.236+0000 7efd8b811800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:29.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.236+0000 7efd8b811800 20 Filter name: none 2024-09-12T00:27:29.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.236+0000 7efbb5ffb640 20 reqs_thread_entry: start 2024-09-12T00:27:29.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.236+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.237+0000 7efd8b811800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:29.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.237+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.237+0000 7efd8b811800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:29.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.237+0000 7efd8b811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:29.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.237+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.238+0000 7efd8b811800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:29.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.238+0000 7efd8b811800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.238+0000 7efd8b811800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:29.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.238+0000 7efd8b811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:29.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.240+0000 7efc3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:29.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.242+0000 7efd8b811800 20 remove_watcher() i=0 2024-09-12T00:27:29.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.242+0000 7efd8b811800 2 removed watcher, disabling cache 2024-09-12T00:27:29.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.243+0000 7efd8b811800 20 remove_watcher() i=1 2024-09-12T00:27:29.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.244+0000 7efd8b811800 20 remove_watcher() i=2 2024-09-12T00:27:29.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.245+0000 7efd8b811800 20 remove_watcher() i=3 2024-09-12T00:27:29.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.246+0000 7efd8b811800 20 remove_watcher() i=4 2024-09-12T00:27:29.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.247+0000 7efd8b811800 20 remove_watcher() i=5 2024-09-12T00:27:29.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.248+0000 7efd8b811800 20 remove_watcher() i=6 2024-09-12T00:27:29.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.249+0000 7efd8b811800 20 remove_watcher() i=7 2024-09-12T00:27:29.259 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:29.259 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:27:29.259 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-do-reshard id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:27:29.259 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:29.261 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:27:29.296 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:29.296 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:29.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.337+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.338+0000 7f1a2a696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.338+0000 7f1a2a696800 20 realm 2024-09-12T00:27:29.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.338+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.338+0000 7f1a2a696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.338+0000 7f1a2a696800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:29.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.338+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.338+0000 7f1a2a696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.338+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.339+0000 7f1a2a696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:29.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.339+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.340+0000 7f1a2a696800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:29.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.340+0000 7f1a2a696800 20 searching for the correct realm 2024-09-12T00:27:29.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.343+0000 7f1a28981640 0 -- 172.21.15.33:0/1900249955 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f1a1c01a040 msgr2=0x7f1a1c067200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:29.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.549+0000 7f1a28180640 0 -- 172.21.15.33:0/1900249955 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x560d8db5a2a0 msgr2=0x560d8db5c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:29.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.552+0000 7f1a2a696800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:29.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.552+0000 7f1a2a696800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:29.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.552+0000 7f1a2a696800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:29.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.552+0000 7f1a2a696800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:29.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.552+0000 7f1a2a696800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:29.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.552+0000 7f1a2a696800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:29.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.552+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:29.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:29.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 20 zone default found 2024-09-12T00:27:29.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 4 Realm: () 2024-09-12T00:27:29.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 20 zonegroup default 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.553+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.554+0000 7f1a2a696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.554+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.554+0000 7f1a2a696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.554+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.554+0000 7f1a2a696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.554+0000 7f1a2a696800 20 started sync module instance, tier type = 2024-09-12T00:27:29.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.554+0000 7f1a2a696800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:29.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.563+0000 7f1a2a696800 20 add_watcher() i=0 2024-09-12T00:27:29.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.563+0000 7f1a2a696800 20 add_watcher() i=1 2024-09-12T00:27:29.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.563+0000 7f1a2a696800 20 add_watcher() i=2 2024-09-12T00:27:29.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.563+0000 7f1a2a696800 20 add_watcher() i=3 2024-09-12T00:27:29.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.563+0000 7f1a2a696800 20 add_watcher() i=4 2024-09-12T00:27:29.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.563+0000 7f1a2a696800 20 add_watcher() i=5 2024-09-12T00:27:29.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.563+0000 7f1a2a696800 20 add_watcher() i=6 2024-09-12T00:27:29.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.564+0000 7f1a2a696800 20 add_watcher() i=7 2024-09-12T00:27:29.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.564+0000 7f1a2a696800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:29.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.566+0000 7f18defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:29.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.566+0000 7f1a2a696800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:29.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.566+0000 7f1a2a696800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:29.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.566+0000 7f1a2a696800 5 note: GC not initialized 2024-09-12T00:27:29.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.566+0000 7f18ddfdb640 20 reqs_thread_entry: start 2024-09-12T00:27:29.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.566+0000 7f1a2a696800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.566+0000 7f1a2a696800 20 Filter name: none 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f184f7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 : miss 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 20 rados->read ofs=0 len=0 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:29.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:29.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:29.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:29.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.567+0000 7f1a2a696800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 2024-09-12T00:27:29.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.577+0000 7f1a2a696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:29.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.577+0000 7f1a2a696800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:29.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.577+0000 7f1a2a696800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:29.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.577+0000 7f1a2a696800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34, ofs0, ns] 2024-09-12T00:27:29.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.578+0000 7f18feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366269 cookie 94616212112416 notifier 6962 bl.length()=995 2024-09-12T00:27:29.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.578+0000 7f18feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:29.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.578+0000 7f18feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:29.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.578+0000 7f18feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:29.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.579+0000 7f1a2a696800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_sources= new_sources= 2024-09-12T00:27:29.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.580+0000 7f1a2a696800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential sources added=[] removed=[] 2024-09-12T00:27:29.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.580+0000 7f1a2a696800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_dests= new_dests= 2024-09-12T00:27:29.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.580+0000 7f1a2a696800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential dests added=[] removed=[] 2024-09-12T00:27:29.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.584+0000 7f1a2a696800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:27:29.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.591+0000 7f1a2a696800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:27:29.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.591+0000 7f1a2a696800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 2024-09-12T00:27:29.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.592+0000 7f1a2a696800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:29.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.592+0000 7f1a2a696800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:29.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.592+0000 7f1a2a696800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:29.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.592+0000 7f1a2a696800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34, ofs0, ns] 2024-09-12T00:27:29.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.593+0000 7f18feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366270 cookie 94616212112416 notifier 6962 bl.length()=963 2024-09-12T00:27:29.592 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.593+0000 7f18feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:29.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.593+0000 7f18feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:29.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.593+0000 7f18feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:29.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.595+0000 7f1a2a696800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_sources= new_sources= 2024-09-12T00:27:29.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.595+0000 7f1a2a696800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential sources added=[] removed=[] 2024-09-12T00:27:29.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.595+0000 7f1a2a696800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_dests= new_dests= 2024-09-12T00:27:29.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.595+0000 7f1a2a696800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential dests added=[] removed=[] 2024-09-12T00:27:29.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.595+0000 7f1a2a696800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:27:29.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.596+0000 7f18defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:29.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.599+0000 7f1a2a696800 20 remove_watcher() i=0 2024-09-12T00:27:29.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.599+0000 7f1a2a696800 2 removed watcher, disabling cache 2024-09-12T00:27:29.598 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.600+0000 7f1a2a696800 20 remove_watcher() i=1 2024-09-12T00:27:29.599 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.601+0000 7f1a2a696800 20 remove_watcher() i=2 2024-09-12T00:27:29.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.601+0000 7f1a2a696800 20 remove_watcher() i=3 2024-09-12T00:27:29.601 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.603+0000 7f1a2a696800 20 remove_watcher() i=4 2024-09-12T00:27:29.602 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.604+0000 7f1a2a696800 20 remove_watcher() i=5 2024-09-12T00:27:29.603 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.605+0000 7f1a2a696800 20 remove_watcher() i=6 2024-09-12T00:27:29.604 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:29.606+0000 7f1a2a696800 20 remove_watcher() i=7 2024-09-12T00:27:29.617 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:27:29.647 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:29.647 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:30.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.093+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.096+0000 7feb56d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.094 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.096+0000 7feb56d26800 20 realm 2024-09-12T00:27:30.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.096+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.096+0000 7feb56d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.096+0000 7feb56d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:30.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.096+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.096+0000 7feb56d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.096+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.097+0000 7feb56d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:30.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.097+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.098+0000 7feb56d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:30.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.098+0000 7feb56d26800 20 searching for the correct realm 2024-09-12T00:27:30.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.099+0000 7feb52a6f640 0 -- 172.21.15.33:0/61614176 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7feb4c061da0 msgr2=0x7feb4c060810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:30.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.306+0000 7feb5226e640 0 -- 172.21.15.33:0/61614176 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7feb44046070 msgr2=0x7feb4400d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:30.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.314+0000 7feb56d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:30.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.314+0000 7feb56d26800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:30.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.314+0000 7feb56d26800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:30.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.314+0000 7feb56d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:30.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.314+0000 7feb56d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:30.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.314+0000 7feb56d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:30.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.314+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 20 zone default found 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 4 Realm: () 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:30.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 20 zonegroup default 2024-09-12T00:27:30.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.315+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.316+0000 7feb56d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.316+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.316+0000 7feb56d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.316+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.316+0000 7feb56d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.316+0000 7feb56d26800 20 started sync module instance, tier type = 2024-09-12T00:27:30.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.316+0000 7feb56d26800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:30.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.327+0000 7feb56d26800 20 add_watcher() i=0 2024-09-12T00:27:30.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.327+0000 7feb56d26800 20 add_watcher() i=1 2024-09-12T00:27:30.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.327+0000 7feb56d26800 20 add_watcher() i=2 2024-09-12T00:27:30.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.327+0000 7feb56d26800 20 add_watcher() i=3 2024-09-12T00:27:30.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.327+0000 7feb56d26800 20 add_watcher() i=4 2024-09-12T00:27:30.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.327+0000 7feb56d26800 20 add_watcher() i=5 2024-09-12T00:27:30.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.327+0000 7feb56d26800 20 add_watcher() i=6 2024-09-12T00:27:30.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.328+0000 7feb56d26800 20 add_watcher() i=7 2024-09-12T00:27:30.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.328+0000 7feb56d26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:30.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.330+0000 7fea097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:30.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.331+0000 7feb56d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:30.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.331+0000 7feb56d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:30.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.331+0000 7feb56d26800 5 note: GC not initialized 2024-09-12T00:27:30.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.331+0000 7fe983fff640 20 reqs_thread_entry: start 2024-09-12T00:27:30.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.331+0000 7feb56d26800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:30.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.331+0000 7feb56d26800 20 Filter name: none 2024-09-12T00:27:30.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.331+0000 7fe981ffb640 20 reqs_thread_entry: start 2024-09-12T00:27:30.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.331+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.332+0000 7feb56d26800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:30.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.332+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.332+0000 7feb56d26800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:30.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.332+0000 7feb56d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:30.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.332+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.333+0000 7feb56d26800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:30.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.333+0000 7feb56d26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.333+0000 7feb56d26800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:30.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.333+0000 7feb56d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:30.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.335+0000 7fea097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:30.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.337+0000 7feb56d26800 20 remove_watcher() i=0 2024-09-12T00:27:30.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.337+0000 7feb56d26800 2 removed watcher, disabling cache 2024-09-12T00:27:30.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.339+0000 7feb56d26800 20 remove_watcher() i=1 2024-09-12T00:27:30.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.340+0000 7feb56d26800 20 remove_watcher() i=2 2024-09-12T00:27:30.339 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.341+0000 7feb56d26800 20 remove_watcher() i=3 2024-09-12T00:27:30.341 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.342+0000 7feb56d26800 20 remove_watcher() i=4 2024-09-12T00:27:30.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.343+0000 7feb56d26800 20 remove_watcher() i=5 2024-09-12T00:27:30.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.345+0000 7feb56d26800 20 remove_watcher() i=6 2024-09-12T00:27:30.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.346+0000 7feb56d26800 20 remove_watcher() i=7 2024-09-12T00:27:30.358 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:30.359 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:27:30.359 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-do-reshard id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:27:30.359 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:30.360 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:30.360 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:30.392 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:30.392 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:30.451 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:27:30.483 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:30.484 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:30.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.525+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.527+0000 7fd2e300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.527+0000 7fd2e300e800 20 realm 2024-09-12T00:27:30.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.527+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.527+0000 7fd2e300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.527+0000 7fd2e300e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:30.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.527+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.528+0000 7fd2e300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.528+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.528+0000 7fd2e300e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:30.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.528+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.529+0000 7fd2e300e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:30.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.529+0000 7fd2e300e800 20 searching for the correct realm 2024-09-12T00:27:30.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.532+0000 7fd2de659640 0 -- 172.21.15.33:0/3342274384 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd2d8061040 msgr2=0x7fd2d80a43d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:30.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.536+0000 7fd2de659640 0 -- 172.21.15.33:0/3342274384 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd2d40722a0 msgr2=0x7fd2d409f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:30.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:30.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:30.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:30.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:30.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:30.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:30.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.743+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 zone default found 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 4 Realm: () 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 zonegroup default 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.744 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.744+0000 7fd2e300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.745+0000 7fd2e300e800 20 started sync module instance, tier type = 2024-09-12T00:27:30.745 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.745+0000 7fd2e300e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:30.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.754+0000 7fd2e300e800 20 add_watcher() i=0 2024-09-12T00:27:30.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.754+0000 7fd2e300e800 20 add_watcher() i=1 2024-09-12T00:27:30.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.754+0000 7fd2e300e800 20 add_watcher() i=2 2024-09-12T00:27:30.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.754+0000 7fd2e300e800 20 add_watcher() i=3 2024-09-12T00:27:30.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.754+0000 7fd2e300e800 20 add_watcher() i=4 2024-09-12T00:27:30.753 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.754+0000 7fd2e300e800 20 add_watcher() i=5 2024-09-12T00:27:30.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.755+0000 7fd2e300e800 20 add_watcher() i=6 2024-09-12T00:27:30.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.756+0000 7fd2e300e800 20 add_watcher() i=7 2024-09-12T00:27:30.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.756+0000 7fd2e300e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:30.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.757+0000 7fd194fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:30.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd2e300e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:30.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd2e300e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:30.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd2e300e800 5 note: GC not initialized 2024-09-12T00:27:30.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd10f7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:30.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd2e300e800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:30.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd2e300e800 20 Filter name: none 2024-09-12T00:27:30.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd10d7fa640 20 reqs_thread_entry: start 2024-09-12T00:27:30.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd2e300e800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:27:30.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.758+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:30.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:27:30.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:27:30.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 : miss 2024-09-12T00:27:30.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:30.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:30.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:30.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:30.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:30.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.759+0000 7fd2e300e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 2024-09-12T00:27:30.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.764+0000 7fd2e300e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:30.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.764+0000 7fd2e300e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:30.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.764+0000 7fd2e300e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:30.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.764+0000 7fd2e300e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34, ofs0, ns] 2024-09-12T00:27:30.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.765+0000 7fd1c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366271 cookie 94612767258784 notifier 6995 bl.length()=995 2024-09-12T00:27:30.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.765+0000 7fd1c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:30.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.765+0000 7fd1c1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:30.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.765+0000 7fd1c1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:30.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.767+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_sources= new_sources= 2024-09-12T00:27:30.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.767+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential sources added=[] removed=[] 2024-09-12T00:27:30.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.767+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_dests= new_dests= 2024-09-12T00:27:30.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.767+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential dests added=[] removed=[] 2024-09-12T00:27:30.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.0 2024-09-12T00:27:30.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.0 2024-09-12T00:27:30.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.1 2024-09-12T00:27:30.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.1 2024-09-12T00:27:30.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.2 2024-09-12T00:27:30.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.2 2024-09-12T00:27:30.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.3 2024-09-12T00:27:30.770 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.3 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.4 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.4 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.5 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.5 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.6 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.6 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.7 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.7 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.8 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.8 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.9 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.9 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.10 2024-09-12T00:27:30.771 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.10 2024-09-12T00:27:30.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.11 2024-09-12T00:27:30.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1.11 2024-09-12T00:27:30.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.771+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.0 2024-09-12T00:27:30.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.772+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1 2024-09-12T00:27:30.772 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.772+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.2 2024-09-12T00:27:30.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.772+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.3 2024-09-12T00:27:30.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.773+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.4 2024-09-12T00:27:30.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.774+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.5 2024-09-12T00:27:30.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.774+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.6 2024-09-12T00:27:30.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.775+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.7 2024-09-12T00:27:30.773 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.775+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.8 2024-09-12T00:27:30.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.776+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.9 2024-09-12T00:27:30.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.776+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.10 2024-09-12T00:27:30.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.779+0000 7fd2e300e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:27:30.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.779+0000 7fd2e300e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 2024-09-12T00:27:30.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.781+0000 7fd2e300e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:30.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.781+0000 7fd2e300e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:30.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.781+0000 7fd2e300e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:30.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.781+0000 7fd2e300e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34, ofs0, ns] 2024-09-12T00:27:30.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.781+0000 7fd1c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366272 cookie 94612767258784 notifier 6995 bl.length()=995 2024-09-12T00:27:30.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.781+0000 7fd1c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:30.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.781+0000 7fd1c17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:30.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.781+0000 7fd1c17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:30.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.783+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_sources= new_sources= 2024-09-12T00:27:30.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.783+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential sources added=[] removed=[] 2024-09-12T00:27:30.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.783+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_dests= new_dests= 2024-09-12T00:27:30.782 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.783+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential dests added=[] removed=[] 2024-09-12T00:27:30.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.785+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.0 2024-09-12T00:27:30.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.785+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.1 2024-09-12T00:27:30.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.786+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.2 2024-09-12T00:27:30.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.786+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.3 2024-09-12T00:27:30.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.786+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.4 2024-09-12T00:27:30.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.787+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.5 2024-09-12T00:27:30.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.787+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.6 2024-09-12T00:27:30.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.787+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.7 2024-09-12T00:27:30.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.788+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.8 2024-09-12T00:27:30.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.788+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.9 2024-09-12T00:27:30.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.788+0000 7fd2e300e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34.10 2024-09-12T00:27:30.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.789+0000 7fd2e300e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:27:30.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.789+0000 7fd2e300e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 2024-09-12T00:27:30.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.790+0000 7fd2e300e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:30.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.790+0000 7fd2e300e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:30.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.790+0000 7fd2e300e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:30.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.790+0000 7fd2e300e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34, ofs0, ns] 2024-09-12T00:27:30.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.790+0000 7fd1c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366273 cookie 94612767258784 notifier 6995 bl.length()=963 2024-09-12T00:27:30.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.790+0000 7fd1c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 info.flags=0x17 2024-09-12T00:27:30.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.790+0000 7fd1c17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 to cache LRU end 2024-09-12T00:27:30.790 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.790+0000 7fd1c17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:30.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.792+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_sources= new_sources= 2024-09-12T00:27:30.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.792+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential sources added=[] removed=[] 2024-09-12T00:27:30.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.792+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): orig_dests= new_dests= 2024-09-12T00:27:30.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.792+0000 7fd2e300e800 20 handle_bi_update(): bucket=:error-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34]): potential dests added=[] removed=[] 2024-09-12T00:27:30.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.794+0000 7fd2e300e800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:27:30.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.796+0000 7fd194fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:30.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.798+0000 7fd2e300e800 20 remove_watcher() i=0 2024-09-12T00:27:30.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.798+0000 7fd2e300e800 2 removed watcher, disabling cache 2024-09-12T00:27:30.798 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.799+0000 7fd2e300e800 20 remove_watcher() i=1 2024-09-12T00:27:30.799 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.800+0000 7fd2e300e800 20 remove_watcher() i=2 2024-09-12T00:27:30.800 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.801+0000 7fd2e300e800 20 remove_watcher() i=3 2024-09-12T00:27:30.801 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.802+0000 7fd2e300e800 20 remove_watcher() i=4 2024-09-12T00:27:30.802 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.803+0000 7fd2e300e800 20 remove_watcher() i=5 2024-09-12T00:27:30.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.804+0000 7fd2e300e800 20 remove_watcher() i=6 2024-09-12T00:27:30.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.805+0000 7fd2e300e800 20 remove_watcher() i=7 2024-09-12T00:27:30.816 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:27:30.846 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:30.846 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:30.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.887+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.889+0000 7fa3faf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.889+0000 7fa3faf26800 20 realm 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.889+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.889+0000 7fa3faf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.889+0000 7fa3faf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.889+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.889+0000 7fa3faf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.889+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.890+0000 7fa3faf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:30.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.890+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.891+0000 7fa3faf26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:30.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.891+0000 7fa3faf26800 20 searching for the correct realm 2024-09-12T00:27:30.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.894+0000 7fa3f73da640 0 -- 172.21.15.33:0/2731134363 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x555e792746c0 msgr2=0x555e79276af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:30.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.897+0000 7fa3f6bd9640 0 -- 172.21.15.33:0/2731134363 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa3ec0b3900 msgr2=0x7fa3ec0d9a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:30.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:30.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:30.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:30.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:30.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:30.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:30.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.901+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:30.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:30.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 zone default found 2024-09-12T00:27:30.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 4 Realm: () 2024-09-12T00:27:30.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 zonegroup default 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.902+0000 7fa3faf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.903+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.903+0000 7fa3faf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.903+0000 7fa3faf26800 20 started sync module instance, tier type = 2024-09-12T00:27:30.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.903+0000 7fa3faf26800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:30.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.913+0000 7fa3faf26800 20 add_watcher() i=0 2024-09-12T00:27:30.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.913+0000 7fa3faf26800 20 add_watcher() i=1 2024-09-12T00:27:30.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.913+0000 7fa3faf26800 20 add_watcher() i=2 2024-09-12T00:27:30.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.913+0000 7fa3faf26800 20 add_watcher() i=3 2024-09-12T00:27:30.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.913+0000 7fa3faf26800 20 add_watcher() i=4 2024-09-12T00:27:30.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.913+0000 7fa3faf26800 20 add_watcher() i=5 2024-09-12T00:27:30.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.913+0000 7fa3faf26800 20 add_watcher() i=6 2024-09-12T00:27:30.912 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.914+0000 7fa3faf26800 20 add_watcher() i=7 2024-09-12T00:27:30.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.914+0000 7fa3faf26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:30.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.915+0000 7fa2ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:30.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.916+0000 7fa3faf26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:30.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.916+0000 7fa3faf26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:30.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.916+0000 7fa3faf26800 5 note: GC not initialized 2024-09-12T00:27:30.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.916+0000 7fa227fff640 20 reqs_thread_entry: start 2024-09-12T00:27:30.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.916+0000 7fa3faf26800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:30.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.916+0000 7fa3faf26800 20 Filter name: none 2024-09-12T00:27:30.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.916+0000 7fa225ffb640 20 reqs_thread_entry: start 2024-09-12T00:27:30.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.916+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.917+0000 7fa3faf26800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:30.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.917+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.917+0000 7fa3faf26800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:30.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.917+0000 7fa3faf26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:30.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.917+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.917+0000 7fa3faf26800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:30.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.917+0000 7fa3faf26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:30.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.918+0000 7fa3faf26800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:30.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.918+0000 7fa3faf26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:30.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.920+0000 7fa2ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:30.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.922+0000 7fa3faf26800 20 remove_watcher() i=0 2024-09-12T00:27:30.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.922+0000 7fa3faf26800 2 removed watcher, disabling cache 2024-09-12T00:27:30.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.923+0000 7fa3faf26800 20 remove_watcher() i=1 2024-09-12T00:27:30.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.923+0000 7fa3faf26800 20 remove_watcher() i=2 2024-09-12T00:27:30.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.924+0000 7fa3faf26800 20 remove_watcher() i=3 2024-09-12T00:27:30.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.926+0000 7fa3faf26800 20 remove_watcher() i=4 2024-09-12T00:27:30.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.927+0000 7fa3faf26800 20 remove_watcher() i=5 2024-09-12T00:27:30.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.927+0000 7fa3faf26800 20 remove_watcher() i=6 2024-09-12T00:27:30.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:30.928+0000 7fa3faf26800 20 remove_watcher() i=7 2024-09-12T00:27:30.941 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:30.941 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:27:30.941 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-do-reshard id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:27:30.941 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:30.941 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:30.942 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:30.959 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:30.960 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.177 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.177 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.311 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:27:31.311 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:31.312 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.312 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.364 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.364 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.421 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.422 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.458 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.458 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.491 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.492 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.525 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.526 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.559 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.559 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.593 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.593 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.627 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.627 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.662 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.663 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.696 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.697 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.731 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.731 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.764 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.765 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.799 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.799 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.833 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.834 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.867 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.867 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.902 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.902 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.936 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.936 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:31.970 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:31.970 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:32.007 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:32.007 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:32.041 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:32.041 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:32.074 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:32.075 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:32.108 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:27:32.138 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:32.138 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:32.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.179+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.181+0000 7f9dcbdad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.181+0000 7f9dcbdad800 20 realm 2024-09-12T00:27:32.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.181+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.181+0000 7f9dcbdad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.181+0000 7f9dcbdad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:32.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.181+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.182+0000 7f9dcbdad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.182+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.182+0000 7f9dcbdad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.182+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.183+0000 7f9dcbdad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:32.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.183+0000 7f9dcbdad800 20 searching for the correct realm 2024-09-12T00:27:32.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.186+0000 7f9dca098640 0 -- 172.21.15.33:0/74502461 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55a27377fd50 msgr2=0x55a273782210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.190+0000 7f9dc9897640 0 -- 172.21.15.33:0/74502461 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f9db40dabd0 msgr2=0x7f9db406b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.194+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:32.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 20 zone default found 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 4 Realm: () 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 20 zonegroup default 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.195+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.196+0000 7f9dcbdad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.196+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.196+0000 7f9dcbdad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.196+0000 7f9dcbdad800 20 started sync module instance, tier type = 2024-09-12T00:27:32.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.196+0000 7f9dcbdad800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:32.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.205+0000 7f9dcbdad800 20 add_watcher() i=0 2024-09-12T00:27:32.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.205+0000 7f9dcbdad800 20 add_watcher() i=1 2024-09-12T00:27:32.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.205+0000 7f9dcbdad800 20 add_watcher() i=2 2024-09-12T00:27:32.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.205+0000 7f9dcbdad800 20 add_watcher() i=3 2024-09-12T00:27:32.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.205+0000 7f9dcbdad800 20 add_watcher() i=4 2024-09-12T00:27:32.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.205+0000 7f9dcbdad800 20 add_watcher() i=5 2024-09-12T00:27:32.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.205+0000 7f9dcbdad800 20 add_watcher() i=6 2024-09-12T00:27:32.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.206+0000 7f9dcbdad800 20 add_watcher() i=7 2024-09-12T00:27:32.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.206+0000 7f9dcbdad800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:32.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.208+0000 7f9c7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:32.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.208+0000 7f9dcbdad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:32.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.208+0000 7f9dcbdad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:32.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.208+0000 7f9dcbdad800 5 note: GC not initialized 2024-09-12T00:27:32.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.208+0000 7f9c7a7fc640 20 reqs_thread_entry: start 2024-09-12T00:27:32.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.209+0000 7f9dcbdad800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:32.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.209+0000 7f9dcbdad800 20 Filter name: none 2024-09-12T00:27:32.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.209+0000 7f9beffff640 20 reqs_thread_entry: start 2024-09-12T00:27:32.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.209+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.209+0000 7f9dcbdad800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:32.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.209+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.210+0000 7f9dcbdad800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:32.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.210+0000 7f9dcbdad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:32.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.210+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.210+0000 7f9dcbdad800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:32.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.210+0000 7f9dcbdad800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.211+0000 7f9dcbdad800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:32.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.211+0000 7f9dcbdad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:32.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.212+0000 7f9c7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:32.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.215+0000 7f9dcbdad800 20 remove_watcher() i=0 2024-09-12T00:27:32.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.215+0000 7f9dcbdad800 2 removed watcher, disabling cache 2024-09-12T00:27:32.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.216+0000 7f9dcbdad800 20 remove_watcher() i=1 2024-09-12T00:27:32.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.217+0000 7f9dcbdad800 20 remove_watcher() i=2 2024-09-12T00:27:32.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.219+0000 7f9dcbdad800 20 remove_watcher() i=3 2024-09-12T00:27:32.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.220+0000 7f9dcbdad800 20 remove_watcher() i=4 2024-09-12T00:27:32.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.221+0000 7f9dcbdad800 20 remove_watcher() i=5 2024-09-12T00:27:32.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.222+0000 7f9dcbdad800 20 remove_watcher() i=6 2024-09-12T00:27:32.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.223+0000 7f9dcbdad800 20 remove_watcher() i=7 2024-09-12T00:27:32.233 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.233 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:27:32.233 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-do-reshard id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:27:32.233 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.235 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:27:32.269 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:32.270 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:32.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.312+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 realm 2024-09-12T00:27:32.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.314+0000 7fd88bf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:32.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:32.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 searching for the correct realm 2024-09-12T00:27:32.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.318+0000 7fd887b61640 0 -- 172.21.15.33:0/2098408052 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd88007fac0 msgr2=0x7fd880063b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.321+0000 7fd887b61640 0 -- 172.21.15.33:0/2098408052 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd87c027040 msgr2=0x7fd87c08f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:32.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:32.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:32.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:32.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:32.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:32.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 zone default found 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 Realm: () 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 zonegroup default 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 started sync module instance, tier type = 2024-09-12T00:27:32.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:32.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=0 2024-09-12T00:27:32.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=1 2024-09-12T00:27:32.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=2 2024-09-12T00:27:32.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=3 2024-09-12T00:27:32.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=4 2024-09-12T00:27:32.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=5 2024-09-12T00:27:32.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=6 2024-09-12T00:27:32.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.541+0000 7fd88bf2c800 20 add_watcher() i=7 2024-09-12T00:27:32.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.541+0000 7fd88bf2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:32.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.543+0000 7fd73dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 note: GC not initialized 2024-09-12T00:27:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.543+0000 7fd73cfe1640 20 reqs_thread_entry: start 2024-09-12T00:27:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 Filter name: none 2024-09-12T00:27:32.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.544+0000 7fd6b67fc640 20 reqs_thread_entry: start 2024-09-12T00:27:32.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:27:32.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:32.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:27:32.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:27:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 : miss 2024-09-12T00:27:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.545+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 2024-09-12T00:27:32.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35, ofs0, ns] 2024-09-12T00:27:32.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 93879187543136 notifier 7043 bl.length()=995 2024-09-12T00:27:32.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_sources= new_sources= 2024-09-12T00:27:32.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential sources added=[] removed=[] 2024-09-12T00:27:32.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_dests= new_dests= 2024-09-12T00:27:32.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential dests added=[] removed=[] 2024-09-12T00:27:32.557 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd88bf2c800 time 2024-09-12T00:27:32.559786+0000 2024-09-12T00:27:32.557 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd88d58c71a] 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd88d58c8d8] 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561f116b641] 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5561f117b38a] 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd88c229590] 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.559+0000 7fd88bf2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd88bf2c800 time 2024-09-12T00:27:32.559786+0000 2024-09-12T00:27:32.558 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd88d58c71a] 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd88d58c8d8] 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561f116b641] 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5561f117b38a] 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd88c229590] 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:27:32.559 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fd88bf2c800 thread_name:radosgw-admin 2024-09-12T00:27:32.573 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:27:32.573 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd88c23e6f0] 2024-09-12T00:27:32.573 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd88c28b99c] 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd88d58c774] 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd88d58c8d8] 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561f116b641] 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5561f117b38a] 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd88c229590] 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.560+0000 7fd88bf2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:27:32.574 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fd88bf2c800 thread_name:radosgw-admin 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd88c23e6f0] 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd88c28b99c] 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd88d58c774] 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd88d58c8d8] 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561f116b641] 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5561f117b38a] 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd88c229590] 2024-09-12T00:27:32.575 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: dump: 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.576 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:27:32.293+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7518 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:27:32.293+0000 7fd88bf2c800 10 monclient: get_monmap_and_config success 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:27:32.293+0000 7fd88bf2c800 4 set_mon_vals no callback set 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: dump: 2024-09-12T00:27:32.577 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 10 monclient: shutdown 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 asok(0x5561f36e3630) unregister_commands rotate-key 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 10 monclient: build_initial_monmap 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 1 build_initial for_mkfs: 0 2024-09-12T00:27:32.578 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 10 monclient: monmap: 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding auth protocol: cephx 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding auth protocol: cephx 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding auth protocol: cephx 2024-09-12T00:27:32.579 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.580 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 1 librados: starting msgr at 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 1 librados: starting objecter 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command objecter_requests hook 0x5561f3933e20 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 1 librados: setting wanted keys 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 1 librados: calling monclient init 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient: init 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding auth protocol: cephx 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding auth protocol: cephx 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding auth protocol: cephx 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command rotate-key hook 0x5561f3902988 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-a con 0x5561f37bc220 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:27:32.582 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-c con 0x5561f3845f90 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-b con 0x5561f3846390 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): authenticate will time out at 2271.860658s 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): get_auth_request con 0x5561f37bc220 auth_method 0 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): get_auth_request con 0x5561f3845f90 auth_method 0 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:27:32.295+0000 7fd888362640 10 monclient(hunting): get_auth_request con 0x5561f3846390 auth_method 0 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:27:32.296+0000 7fd888362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:27:32.296+0000 7fd888362640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:27:32.296+0000 7fd888362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:27:32.296+0000 7fd887b61640 10 monclient(hunting): handle_auth_done global_id 7521 payload 824 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:27:32.296+0000 7fd887b61640 10 monclient: _finish_hunting 0 2024-09-12T00:27:32.584 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:27:32.296+0000 7fd887b61640 1 monclient: found mon.noname-a 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:27:32.296+0000 7fd887b61640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: dump: 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.585 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: dump: 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.586 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7521 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:27:32.296+0000 7fd775e0b640 4 set_mon_vals no callback set 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 1 librados: init done 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:27:32.298+0000 7fd76ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:27:32.298+0000 7fd76ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:27:32.298+0000 7fd76ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:27:32.298+0000 7fd887360640 10 monclient: get_auth_request con 0x7fd770076470 auth_method 0 2024-09-12T00:27:32.587 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:27:32.298+0000 7fd888362640 10 monclient: get_auth_request con 0x5561f394c4f0 auth_method 0 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:27:32.299+0000 7fd887b61640 10 monclient: get_auth_request con 0x5561f394f330 auth_method 0 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:27:32.300+0000 7fd887360640 10 monclient: get_auth_request con 0x5561f39539d0 auth_method 0 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 10 monclient: build_initial_monmap 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 1 build_initial for_mkfs: 0 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 10 monclient: monmap: 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:27:32.588 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding auth protocol: cephx 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding auth protocol: cephx 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding auth protocol: cephx 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.589 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command objecter_requests cmddesc objecter_requests hook 0x5561f395c110 EEXIST 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 10 monclient: init 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding auth protocol: cephx 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding auth protocol: cephx 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding auth protocol: cephx 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.590 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command rotate-key cmddesc rotate-key hook 0x5561f3956ec0 EEXIST 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-b con 0x5561f397fe00 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:27:32.591 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-c con 0x5561f39820d0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-a con 0x5561f397e5d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): authenticate will time out at 2271.868124s 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): get_auth_request con 0x5561f397e5d0 auth_method 0 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): get_auth_request con 0x5561f39820d0 auth_method 0 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.592 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:27:32.303+0000 7fd887b61640 10 monclient(hunting): get_auth_request con 0x5561f397fe00 auth_method 0 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:27:32.303+0000 7fd887b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:27:32.303+0000 7fd887b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:27:32.303+0000 7fd887b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): handle_auth_done global_id 7524 payload 824 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient: _finish_hunting 0 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:27:32.303+0000 7fd888362640 1 monclient: found mon.noname-a 2024-09-12T00:27:32.593 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: dump: 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.594 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: dump: 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.595 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7524 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:27:32.303+0000 7fd888b63640 4 set_mon_vals no callback set 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:27:32.305+0000 7fd76d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:27:32.305+0000 7fd76d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:27:32.305+0000 7fd76d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.596 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:27:32.306+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd760076380 auth_method 0 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 10 monclient: get_monmap_and_config 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 10 monclient: build_initial_monmap 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 1 build_initial for_mkfs: 0 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 10 monclient: monmap: 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:27:32.598 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.598 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding auth protocol: cephx 2024-09-12T00:27:32.598 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding auth protocol: cephx 2024-09-12T00:27:32.598 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding auth protocol: cephx 2024-09-12T00:27:32.598 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 10 monclient: init 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding auth protocol: cephx 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding auth protocol: cephx 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding auth protocol: cephx 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.601 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command rotate-key cmddesc rotate-key hook 0x7ffccb47fbb8 EEXIST 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-b con 0x5561f39a3e30 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-a con 0x5561f39ce850 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-c con 0x5561f39cfc70 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.602 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): authenticate will time out at 2271.872305s 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): get_auth_request con 0x5561f39cfc70 auth_method 0 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): get_auth_request con 0x5561f39ce850 auth_method 0 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.603 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): handle_auth_done global_id 7040 payload 274 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient: _finish_hunting 0 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:27:32.307+0000 7fd888362640 1 monclient: found mon.noname-c 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: dump: 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.604 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.605 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: dump: 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7040 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient: get_monmap_and_config success 2024-09-12T00:27:32.606 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 4 set_mon_vals no callback set 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 10 monclient: shutdown 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 10 monclient: build_initial_monmap 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 1 build_initial for_mkfs: 0 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 10 monclient: monmap: 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:27:32.607 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding auth protocol: cephx 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding auth protocol: cephx 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding auth protocol: cephx 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.608 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 1 librados: starting msgr at 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 1 librados: starting objecter 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command objecter_requests cmddesc objecter_requests hook 0x5561f397f1e0 EEXIST 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 1 librados: setting wanted keys 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 1 librados: calling monclient init 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient: init 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding auth protocol: cephx 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding auth protocol: cephx 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding auth protocol: cephx 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.609 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command rotate-key cmddesc rotate-key hook 0x5561f3997cf8 EEXIST 2024-09-12T00:27:32.610 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-b con 0x5561f39a3e30 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-c con 0x5561f39ce850 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-a con 0x5561f39cfc70 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): authenticate will time out at 2271.874764s 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): get_auth_request con 0x5561f39ce850 auth_method 0 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.611 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): get_auth_request con 0x5561f39cfc70 auth_method 0 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:27:32.310+0000 7fd887b61640 10 monclient(hunting): get_auth_request con 0x5561f39a3e30 auth_method 0 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:27:32.310+0000 7fd887b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:27:32.310+0000 7fd887b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:27:32.310+0000 7fd887b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.612 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:27:32.310+0000 7fd887360640 10 monclient(hunting): handle_auth_done global_id 7043 payload 824 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:27:32.310+0000 7fd887360640 10 monclient: _finish_hunting 0 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:27:32.310+0000 7fd887360640 1 monclient: found mon.noname-c 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:27:32.310+0000 7fd887360640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: dump: 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: dump: 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.614 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7043 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:27:32.310+0000 7fd766ffd640 4 set_mon_vals no callback set 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 1 librados: init done 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cr dump hook 0x5561f39c5718 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:27:32.312+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:27:32.312+0000 7fd7657fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:27:32.312+0000 7fd7657fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:27:32.312+0000 7fd7657fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:27:32.312+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd7500764a0 auth_method 0 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:27:32.313+0000 7fd888362640 10 monclient: get_auth_request con 0x5561f39ef030 auth_method 0 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 realm 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:32.616 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:27:32.314+0000 7fd887b61640 10 monclient: get_auth_request con 0x5561f39f3240 auth_method 0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:27:32.315+0000 7fd887360640 10 monclient: get_auth_request con 0x5561f39f6aa0 auth_method 0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 searching for the correct realm 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:27:32.316+0000 7fd888362640 10 monclient: get_auth_request con 0x5561f39fb820 auth_method 0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:27:32.316+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd88007fac0 auth_method 0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:27:32.317+0000 7fd887360640 10 monclient: get_auth_request con 0x7fd87806b020 auth_method 0 2024-09-12T00:27:32.617 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:27:32.318+0000 7fd887b61640 0 -- 172.21.15.33:0/2098408052 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd88007fac0 msgr2=0x7fd880063b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:27:32.318+0000 7fd7657fa640 1 client.7043.objecter ms_handle_reset 0x7fd88007fac0 session 0x7fd880099040 osd.7 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:27:32.318+0000 7fd7657fa640 10 monclient: _renew_subs 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:27:32.318+0000 7fd7657fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:27:32.318+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd750086c50 auth_method 0 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:27:32.319+0000 7fd888362640 10 monclient: get_auth_request con 0x7fd87c040070 auth_method 0 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:27:32.321+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd87c027040 auth_method 0 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:27:32.321+0000 7fd887b61640 0 -- 172.21.15.33:0/2098408052 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd87c027040 msgr2=0x7fd87c08f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:27:32.522+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd87c027040 auth_method 0 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:32.618 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 zone default found 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 Realm: () 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 zonegroup default 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.619 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 started sync module instance, tier type = 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=0 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=1 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=2 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=3 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=4 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=5 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=6 2024-09-12T00:27:32.620 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:27:32.541+0000 7fd88bf2c800 20 add_watcher() i=7 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:27:32.541+0000 7fd88bf2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding auth protocol: cephx 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding auth protocol: cephx 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding auth protocol: cephx 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.621 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:27:32.543+0000 7fd73dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cache list hook 0x5561f39c7660 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cache inspect hook 0x5561f39c7660 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cache erase hook 0x5561f39c7660 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cache zap hook 0x5561f39c7660 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 note: GC not initialized 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:27:32.543+0000 7fd73cfe1640 20 reqs_thread_entry: start 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command sync trace show hook 0x7fd880009aa0 2024-09-12T00:27:32.622 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command sync trace history hook 0x7fd880009aa0 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command sync trace active hook 0x7fd880009aa0 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command sync trace active_short hook 0x7fd880009aa0 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 Filter name: none 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:27:32.544+0000 7fd6b67fc640 20 reqs_thread_entry: start 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 : miss 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.623 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35, ofs0, ns] 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 93879187543136 notifier 7043 bl.length()=995 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.624 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_sources= new_sources= 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential sources added=[] removed=[] 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_dests= new_dests= 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential dests added=[] removed=[] 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:27:32.559+0000 7fd88bf2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd88bf2c800 time 2024-09-12T00:27:32.559786+0000 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd88d58c71a] 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd88d58c8d8] 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561f116b641] 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5561f117b38a] 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:27:32.625 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd88c229590] 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:27:32.560+0000 7fd88bf2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fd88bf2c800 thread_name:radosgw-admin 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd88c23e6f0] 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd88c28b99c] 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd88d58c774] 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd88d58c8d8] 2024-09-12T00:27:32.626 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561f116b641] 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5561f117b38a] 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd88c229590] 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:27:32.627 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:27:32.628 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:27:32.630 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:27:32.631 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:27:32.633 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd6b67fc640 / http_manager 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd73cfe1640 / http_manager 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd73dfe3640 / rgw_dt_lg_renew 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd7657fa640 / ms_dispatch 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd766ffd640 / io_context_pool 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd76d7fa640 / ms_dispatch 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd76ffff640 / ms_dispatch 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd775e0b640 / io_context_pool 2024-09-12T00:27:32.634 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd887360640 / msgr-worker-2 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd887b61640 / msgr-worker-1 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd888362640 / msgr-worker-0 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd888b63640 / io_context_pool 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd88bf2c800 / radosgw-admin 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.127486.log 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: dump: 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.635 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:27:32.293+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7518 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:27:32.293+0000 7fd88bf2c800 10 monclient: get_monmap_and_config success 2024-09-12T00:27:32.636 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:27:32.293+0000 7fd88bf2c800 4 set_mon_vals no callback set 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:27:32.293+0000 7fd775e0b640 10 monclient: dump: 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.637 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 10 monclient: shutdown 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 asok(0x5561f36e3630) unregister_commands rotate-key 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 10 monclient: build_initial_monmap 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 1 build_initial for_mkfs: 0 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 10 monclient: monmap: 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:27:32.638 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding auth protocol: cephx 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding auth protocol: cephx 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding auth protocol: cephx 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: crc 2024-09-12T00:27:32.639 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39083a0) adding con mode: secure 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 1 librados: starting msgr at 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:27:32.294+0000 7fd88bf2c800 1 librados: starting objecter 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command objecter_requests hook 0x5561f3933e20 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 1 librados: setting wanted keys 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 1 librados: calling monclient init 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient: init 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding auth protocol: cephx 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding auth protocol: cephx 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding auth protocol: cephx 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.640 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: crc 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3902840) adding con mode: secure 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command rotate-key hook 0x5561f3902988 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:27:32.641 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-a con 0x5561f37bc220 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-c con 0x5561f3845f90 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-b con 0x5561f3846390 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:27:32.295+0000 7fd88bf2c800 10 monclient(hunting): authenticate will time out at 2271.860658s 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): get_auth_request con 0x5561f37bc220 auth_method 0 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): get_auth_request con 0x5561f3845f90 auth_method 0 2024-09-12T00:27:32.642 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:27:32.295+0000 7fd887b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:27:32.295+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:27:32.295+0000 7fd888362640 10 monclient(hunting): get_auth_request con 0x5561f3846390 auth_method 0 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:27:32.296+0000 7fd888362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:27:32.296+0000 7fd888362640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:27:32.296+0000 7fd888362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:27:32.296+0000 7fd887b61640 10 monclient(hunting): handle_auth_done global_id 7521 payload 824 2024-09-12T00:27:32.643 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:27:32.296+0000 7fd887b61640 10 monclient: _finish_hunting 0 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:27:32.296+0000 7fd887b61640 1 monclient: found mon.noname-a 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:27:32.296+0000 7fd887b61640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: dump: 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.644 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:27:32.296+0000 7fd76ffff640 10 monclient: dump: 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.645 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7521 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:27:32.296+0000 7fd775e0b640 4 set_mon_vals no callback set 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:27:32.296+0000 7fd88bf2c800 1 librados: init done 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:27:32.298+0000 7fd76ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:27:32.298+0000 7fd76ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:27:32.298+0000 7fd76ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.646 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:27:32.298+0000 7fd887360640 10 monclient: get_auth_request con 0x7fd770076470 auth_method 0 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:27:32.298+0000 7fd888362640 10 monclient: get_auth_request con 0x5561f394c4f0 auth_method 0 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:27:32.299+0000 7fd887b61640 10 monclient: get_auth_request con 0x5561f394f330 auth_method 0 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:27:32.300+0000 7fd887360640 10 monclient: get_auth_request con 0x5561f39539d0 auth_method 0 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 10 monclient: build_initial_monmap 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 1 build_initial for_mkfs: 0 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 10 monclient: monmap: 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:27:32.647 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding auth protocol: cephx 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding auth protocol: cephx 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding auth protocol: cephx 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.648 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: crc 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39586f0) adding con mode: secure 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command objecter_requests cmddesc objecter_requests hook 0x5561f395c110 EEXIST 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 10 monclient: init 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding auth protocol: cephx 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding auth protocol: cephx 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding auth protocol: cephx 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: crc 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3956d78) adding con mode: secure 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:27:32.302+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command rotate-key cmddesc rotate-key hook 0x5561f3956ec0 EEXIST 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:27:32.650 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-b con 0x5561f397fe00 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-c con 0x5561f39820d0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-a con 0x5561f397e5d0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient(hunting): authenticate will time out at 2271.868124s 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): get_auth_request con 0x5561f397e5d0 auth_method 0 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): get_auth_request con 0x5561f39820d0 auth_method 0 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.651 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:27:32.303+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:27:32.303+0000 7fd887b61640 10 monclient(hunting): get_auth_request con 0x5561f397fe00 auth_method 0 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:27:32.303+0000 7fd887b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:27:32.303+0000 7fd887b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:27:32.303+0000 7fd887b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient(hunting): handle_auth_done global_id 7524 payload 824 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient: _finish_hunting 0 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:27:32.303+0000 7fd888362640 1 monclient: found mon.noname-a 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:27:32.303+0000 7fd888362640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: dump: 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.653 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:27:32.303+0000 7fd76d7fa640 10 monclient: dump: 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.654 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7524 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:27:32.303+0000 7fd888b63640 4 set_mon_vals no callback set 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:27:32.303+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:27:32.305+0000 7fd76d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:27:32.305+0000 7fd76d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:27:32.305+0000 7fd76d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:27:32.306+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd760076380 auth_method 0 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 10 monclient: get_monmap_and_config 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 10 monclient: build_initial_monmap 2024-09-12T00:27:32.655 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 1 build_initial for_mkfs: 0 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 10 monclient: monmap: 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:27:32.656 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding auth protocol: cephx 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding auth protocol: cephx 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding auth protocol: cephx 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.657 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: crc 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x5561f399fc90) adding con mode: secure 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 10 monclient: init 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding auth protocol: cephx 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding auth protocol: cephx 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding auth protocol: cephx 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.658 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: crc 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:27:32.306+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47fa70) adding con mode: secure 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command rotate-key cmddesc rotate-key hook 0x7ffccb47fbb8 EEXIST 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-b con 0x5561f39a3e30 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:27:32.659 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-a con 0x5561f39ce850 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-c con 0x5561f39cfc70 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient(hunting): authenticate will time out at 2271.872305s 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): get_auth_request con 0x5561f39cfc70 auth_method 0 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): get_auth_request con 0x5561f39ce850 auth_method 0 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.660 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:27:32.307+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient(hunting): handle_auth_done global_id 7040 payload 274 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient: _finish_hunting 0 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:27:32.307+0000 7fd888362640 1 monclient: found mon.noname-c 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:27:32.307+0000 7fd888362640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:27:32.661 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: dump: 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.662 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:27:32.307+0000 7fd766ffd640 10 monclient: dump: 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.663 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7040 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 10 monclient: get_monmap_and_config success 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:27:32.307+0000 7fd88bf2c800 4 set_mon_vals no callback set 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 10 monclient: shutdown 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 10 monclient: build_initial_monmap 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 1 build_initial for_mkfs: 0 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 10 monclient: monmap: 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:27:32.664 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding auth protocol: cephx 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding auth protocol: cephx 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding auth protocol: cephx 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.665 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: crc 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:27:32.308+0000 7fd88bf2c800 5 AuthRegistry(0x5561f39a49c0) adding con mode: secure 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 1 librados: starting msgr at 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 1 librados: starting objecter 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command objecter_requests cmddesc objecter_requests hook 0x5561f397f1e0 EEXIST 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 1 librados: setting wanted keys 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 1 librados: calling monclient init 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient: init 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding auth protocol: cephx 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding auth protocol: cephx 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding auth protocol: cephx 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: crc 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 AuthRegistry(0x5561f3997bb0) adding con mode: secure 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.667 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command rotate-key cmddesc rotate-key hook 0x5561f3997cf8 EEXIST 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-b con 0x5561f39a3e30 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-c con 0x5561f39ce850 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): picked mon.noname-a con 0x5561f39cfc70 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:27:32.309+0000 7fd88bf2c800 10 monclient(hunting): authenticate will time out at 2271.874764s 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): get_auth_request con 0x5561f39ce850 auth_method 0 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.668 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): get_auth_request con 0x5561f39cfc70 auth_method 0 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:27:32.309+0000 7fd887360640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:27:32.309+0000 7fd888362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:27:32.310+0000 7fd887b61640 10 monclient(hunting): get_auth_request con 0x5561f39a3e30 auth_method 0 2024-09-12T00:27:32.669 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:27:32.310+0000 7fd887b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:27:32.310+0000 7fd887b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:27:32.310+0000 7fd887b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:27:32.310+0000 7fd887360640 10 monclient(hunting): handle_auth_done global_id 7043 payload 824 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:27:32.310+0000 7fd887360640 10 monclient: _finish_hunting 0 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:27:32.310+0000 7fd887360640 1 monclient: found mon.noname-c 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:27:32.310+0000 7fd887360640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: dump: 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.670 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: _finish_auth 0 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: _check_auth_tickets 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:27:32.310+0000 7fd7657fa640 10 monclient: dump: 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:27:32.671 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 5 monclient: authenticate success, global_id 7043 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:27:32.310+0000 7fd766ffd640 4 set_mon_vals no callback set 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 10 monclient: _renew_subs 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 1 librados: init done 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:27:32.310+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cr dump hook 0x5561f39c5718 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:27:32.312+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:27:32.312+0000 7fd7657fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:27:32.312+0000 7fd7657fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:27:32.312+0000 7fd7657fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:27:32.312+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd7500764a0 auth_method 0 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:27:32.313+0000 7fd888362640 10 monclient: get_auth_request con 0x5561f39ef030 auth_method 0 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 realm 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:27:32.313+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.673 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:27:32.314+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:27:32.314+0000 7fd887b61640 10 monclient: get_auth_request con 0x5561f39f3240 auth_method 0 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:27:32.315+0000 7fd887360640 10 monclient: get_auth_request con 0x5561f39f6aa0 auth_method 0 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:27:32.315+0000 7fd88bf2c800 20 searching for the correct realm 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:27:32.316+0000 7fd888362640 10 monclient: get_auth_request con 0x5561f39fb820 auth_method 0 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:27:32.316+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd88007fac0 auth_method 0 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:27:32.317+0000 7fd887360640 10 monclient: get_auth_request con 0x7fd87806b020 auth_method 0 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:27:32.318+0000 7fd887b61640 0 -- 172.21.15.33:0/2098408052 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd88007fac0 msgr2=0x7fd880063b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:27:32.318+0000 7fd7657fa640 1 client.7043.objecter ms_handle_reset 0x7fd88007fac0 session 0x7fd880099040 osd.7 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:27:32.318+0000 7fd7657fa640 10 monclient: _renew_subs 2024-09-12T00:27:32.674 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:27:32.318+0000 7fd7657fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:27:32.318+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd750086c50 auth_method 0 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:27:32.319+0000 7fd888362640 10 monclient: get_auth_request con 0x7fd87c040070 auth_method 0 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:27:32.321+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd87c027040 auth_method 0 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:27:32.321+0000 7fd887b61640 0 -- 172.21.15.33:0/2098408052 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd87c027040 msgr2=0x7fd87c08f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:27:32.522+0000 7fd887b61640 10 monclient: get_auth_request con 0x7fd87c027040 auth_method 0 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.675 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:27:32.527+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 zone default found 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 Realm: () 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 zonegroup default 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:27:32.528+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.676 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 started sync module instance, tier type = 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:27:32.529+0000 7fd88bf2c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=0 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=1 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=2 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=3 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=4 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=5 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:27:32.540+0000 7fd88bf2c800 20 add_watcher() i=6 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:27:32.541+0000 7fd88bf2c800 20 add_watcher() i=7 2024-09-12T00:27:32.677 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:27:32.541+0000 7fd88bf2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding auth protocol: cephx 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding auth protocol: cephx 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding auth protocol: cephx 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.678 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: crc 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 AuthRegistry(0x7ffccb47ff50) adding con mode: secure 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:27:32.543+0000 7fd73dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cache list hook 0x5561f39c7660 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cache inspect hook 0x5561f39c7660 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cache erase hook 0x5561f39c7660 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command cache zap hook 0x5561f39c7660 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 note: GC not initialized 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:27:32.543+0000 7fd73cfe1640 20 reqs_thread_entry: start 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command sync trace show hook 0x7fd880009aa0 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command sync trace history hook 0x7fd880009aa0 2024-09-12T00:27:32.679 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command sync trace active hook 0x7fd880009aa0 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 5 asok(0x5561f36e3630) register_command sync trace active_short hook 0x7fd880009aa0 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:27:32.543+0000 7fd88bf2c800 20 Filter name: none 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:27:32.544+0000 7fd6b67fc640 20 reqs_thread_entry: start 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 : miss 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:27:32.544+0000 7fd88bf2c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:27:32.680 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:27:32.545+0000 7fd88bf2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:27:32.550+0000 7fd88bf2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35, ofs0, ns] 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 93879187543136 notifier 7043 bl.length()=995 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:27:32.550+0000 7fd766ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:32.681 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_sources= new_sources= 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential sources added=[] removed=[] 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_dests= new_dests= 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:27:32.552+0000 7fd88bf2c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential dests added=[] removed=[] 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:27:32.559+0000 7fd88bf2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd88bf2c800 time 2024-09-12T00:27:32.559786+0000 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd88d58c71a] 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd88d58c8d8] 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561f116b641] 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5561f117b38a] 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd88c229590] 2024-09-12T00:27:32.682 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:27:32.560+0000 7fd88bf2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fd88bf2c800 thread_name:radosgw-admin 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd88c23e6f0] 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd88c28b99c] 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd88d58c774] 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd88d58c8d8] 2024-09-12T00:27:32.683 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561f116b641] 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5561f117b38a] 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd88c229590] 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:27:32.684 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:27:32.685 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:27:32.687 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:27:32.688 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:27:32.690 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd6b67fc640 / http_manager 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd73cfe1640 / http_manager 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd73dfe3640 / rgw_dt_lg_renew 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd7657fa640 / ms_dispatch 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd766ffd640 / io_context_pool 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd76d7fa640 / ms_dispatch 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd76ffff640 / ms_dispatch 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd775e0b640 / io_context_pool 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd887360640 / msgr-worker-2 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd887b61640 / msgr-worker-1 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd888362640 / msgr-worker-0 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd888b63640 / io_context_pool 2024-09-12T00:27:32.691 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd88bf2c800 / radosgw-admin 2024-09-12T00:27:32.692 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:27:32.692 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:27:32.692 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:27:32.561345Z_aad6c365-efa4-4055-95f5-21a0a68fb451/log 2024-09-12T00:27:32.692 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:27:32.692 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.639+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.641+0000 7f22fe126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.641+0000 7f22fe126800 20 realm 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.641+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.641+0000 7f22fe126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.641+0000 7f22fe126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:32.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.641+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.641+0000 7f22fe126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.641+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.642+0000 7f22fe126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.642+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.643+0000 7f22fe126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.643+0000 7f22fe126800 20 searching for the correct realm 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.646+0000 7f22fa670640 0 -- 172.21.15.33:0/4059266035 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55676943bbf0 msgr2=0x55676943e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.649+0000 7f22f9e6f640 0 -- 172.21.15.33:0/4059266035 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f22f00a2870 msgr2=0x7f22f00dc0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:32.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.654+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 zone default found 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 4 Realm: () 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 zonegroup default 2024-09-12T00:27:32.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 started sync module instance, tier type = 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.655+0000 7f22fe126800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.664+0000 7f22fe126800 20 add_watcher() i=0 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.664+0000 7f22fe126800 20 add_watcher() i=1 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.664+0000 7f22fe126800 20 add_watcher() i=2 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.664+0000 7f22fe126800 20 add_watcher() i=3 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.664+0000 7f22fe126800 20 add_watcher() i=4 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.664+0000 7f22fe126800 20 add_watcher() i=5 2024-09-12T00:27:32.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.664+0000 7f22fe126800 20 add_watcher() i=6 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.665+0000 7f22fe126800 20 add_watcher() i=7 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.665+0000 7f22fe126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f21affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f22fe126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f22fe126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f22fe126800 5 note: GC not initialized 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f21aefe5640 20 reqs_thread_entry: start 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f22fe126800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f22fe126800 20 Filter name: none 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f21acfe1640 20 reqs_thread_entry: start 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.667+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.668+0000 7f22fe126800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:32.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.668+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.668+0000 7f22fe126800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.668+0000 7f22fe126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.668+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.669+0000 7f22fe126800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.669+0000 7f22fe126800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.669+0000 7f22fe126800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.669+0000 7f22fe126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.671+0000 7f21affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.673+0000 7f22fe126800 20 remove_watcher() i=0 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.673+0000 7f22fe126800 2 removed watcher, disabling cache 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.673+0000 7f22fe126800 20 remove_watcher() i=1 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.675+0000 7f22fe126800 20 remove_watcher() i=2 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.676+0000 7f22fe126800 20 remove_watcher() i=3 2024-09-12T00:27:32.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.676+0000 7f22fe126800 20 remove_watcher() i=4 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.677+0000 7f22fe126800 20 remove_watcher() i=5 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.678+0000 7f22fe126800 20 remove_watcher() i=6 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.679+0000 7f22fe126800 20 remove_watcher() i=7 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-do-reshard id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:32.703 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:32.721 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:32.721 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:27:32.779 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:27:32.812 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:32.812 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:32.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.853+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.855+0000 7f0d97d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.855+0000 7f0d97d3d800 20 realm 2024-09-12T00:27:32.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.855+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.855+0000 7f0d97d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.855+0000 7f0d97d3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:32.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.855+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.855+0000 7f0d97d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:32.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.855+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.856+0000 7f0d97d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:32.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.856+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:32.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.857+0000 7f0d97d3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:32.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.857+0000 7f0d97d3d800 20 searching for the correct realm 2024-09-12T00:27:32.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:32.858+0000 7f0d93229640 0 -- 172.21.15.33:0/25461225 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f0d84025020 msgr2=0x7f0d84061ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:33.062 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.064+0000 7f0d93a2a640 0 -- 172.21.15.33:0/25461225 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f0d8804f910 msgr2=0x7f0d880353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:33.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:33.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:27:33.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:27:33.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:33.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:33.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:33.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:33.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:33.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.271+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 20 zone default found 2024-09-12T00:27:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 4 Realm: () 2024-09-12T00:27:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:27:33.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:27:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 20 zonegroup default 2024-09-12T00:27:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.272+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.273+0000 7f0d97d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.273+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:33.272 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.273+0000 7f0d97d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:33.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.273+0000 7f0d97d3d800 20 started sync module instance, tier type = 2024-09-12T00:27:33.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.273+0000 7f0d97d3d800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:27:33.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.282+0000 7f0d97d3d800 20 add_watcher() i=0 2024-09-12T00:27:33.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.282+0000 7f0d97d3d800 20 add_watcher() i=1 2024-09-12T00:27:33.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.282+0000 7f0d97d3d800 20 add_watcher() i=2 2024-09-12T00:27:33.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.282+0000 7f0d97d3d800 20 add_watcher() i=3 2024-09-12T00:27:33.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.282+0000 7f0d97d3d800 20 add_watcher() i=4 2024-09-12T00:27:33.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.282+0000 7f0d97d3d800 20 add_watcher() i=5 2024-09-12T00:27:33.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.282+0000 7f0d97d3d800 20 add_watcher() i=6 2024-09-12T00:27:33.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.283+0000 7f0d97d3d800 20 add_watcher() i=7 2024-09-12T00:27:33.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.283+0000 7f0d97d3d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:33.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.285+0000 7f0c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0d97d3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0d97d3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0d97d3d800 5 note: GC not initialized 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0c48fe1640 20 reqs_thread_entry: start 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0d97d3d800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0d97d3d800 20 Filter name: none 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0bc27fc640 20 reqs_thread_entry: start 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0d97d3d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.286+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 : miss 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:27:33.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:27:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.287+0000 7f0d97d3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 2024-09-12T00:27:33.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.288+0000 7f0d97d3d800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to be held by another RGW process; skipping for now 2024-09-12T00:27:33.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.289+0000 7f0c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:33.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.291+0000 7f0d97d3d800 20 remove_watcher() i=0 2024-09-12T00:27:33.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.291+0000 7f0d97d3d800 2 removed watcher, disabling cache 2024-09-12T00:27:33.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.293+0000 7f0d97d3d800 20 remove_watcher() i=1 2024-09-12T00:27:33.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.294+0000 7f0d97d3d800 20 remove_watcher() i=2 2024-09-12T00:27:33.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.295+0000 7f0d97d3d800 20 remove_watcher() i=3 2024-09-12T00:27:33.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.296+0000 7f0d97d3d800 20 remove_watcher() i=4 2024-09-12T00:27:33.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.297+0000 7f0d97d3d800 20 remove_watcher() i=5 2024-09-12T00:27:33.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.298+0000 7f0d97d3d800 20 remove_watcher() i=6 2024-09-12T00:27:33.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:27:33.299+0000 7f0d97d3d800 20 remove_watcher() i=7 2024-09-12T00:27:33.310 INFO:tasks.workunit.client.0.smithi033.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:28:03.340 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:28:03.377 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:03.377 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:03.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.425+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.426+0000 7f3081323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.426+0000 7f3081323800 20 realm 2024-09-12T00:28:03.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.426+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.427+0000 7f3081323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.427+0000 7f3081323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:03.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.427+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.427+0000 7f3081323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.427+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.428+0000 7f3081323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:03.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.428+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.429+0000 7f3081323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:03.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.429+0000 7f3081323800 20 searching for the correct realm 2024-09-12T00:28:03.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.433+0000 7f307d814640 0 -- 172.21.15.33:0/3581347056 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x555b7164e690 msgr2=0x555b71650b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:03.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.437+0000 7f307d013640 0 -- 172.21.15.33:0/3581347056 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f306806c410 msgr2=0x7f306806c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:03.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:03.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.442+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 20 zone default found 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 4 Realm: () 2024-09-12T00:28:03.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:03.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:03.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:03.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 20 zonegroup default 2024-09-12T00:28:03.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.443+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.444+0000 7f3081323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.444+0000 7f3081323800 20 started sync module instance, tier type = 2024-09-12T00:28:03.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.444+0000 7f3081323800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:03.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.454+0000 7f3081323800 20 add_watcher() i=0 2024-09-12T00:28:03.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.454+0000 7f3081323800 20 add_watcher() i=1 2024-09-12T00:28:03.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.454+0000 7f3081323800 20 add_watcher() i=2 2024-09-12T00:28:03.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.454+0000 7f3081323800 20 add_watcher() i=3 2024-09-12T00:28:03.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.454+0000 7f3081323800 20 add_watcher() i=4 2024-09-12T00:28:03.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.454+0000 7f3081323800 20 add_watcher() i=5 2024-09-12T00:28:03.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.454+0000 7f3081323800 20 add_watcher() i=6 2024-09-12T00:28:03.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.455+0000 7f3081323800 20 add_watcher() i=7 2024-09-12T00:28:03.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.455+0000 7f3081323800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:03.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.456+0000 7f2f337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f3081323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f3081323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f3081323800 5 note: GC not initialized 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f2f327e4640 20 reqs_thread_entry: start 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f3081323800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f3081323800 20 Filter name: none 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f2ea3fff640 20 reqs_thread_entry: start 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f3081323800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:28:03.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.457+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:28:03.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:28:03.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:28:03.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 : miss 2024-09-12T00:28:03.457 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:28:03.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:28:03.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:28:03.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:03.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:03.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.458+0000 7f3081323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 2024-09-12T00:28:03.458 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.460+0000 7f3081323800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:28:03.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.466+0000 7f3081323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:28:03.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.466+0000 7f3081323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:28:03.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.466+0000 7f3081323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:03.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.466+0000 7f3081323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35, ofs0, ns] 2024-09-12T00:28:03.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.467+0000 7f2f60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 93851232892432 notifier 7094 bl.length()=995 2024-09-12T00:28:03.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.467+0000 7f2f60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:28:03.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.467+0000 7f2f60ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:28:03.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.467+0000 7f2f60ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:03.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.469+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_sources= new_sources= 2024-09-12T00:28:03.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.469+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential sources added=[] removed=[] 2024-09-12T00:28:03.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.469+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_dests= new_dests= 2024-09-12T00:28:03.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.469+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential dests added=[] removed=[] 2024-09-12T00:28:03.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.0 2024-09-12T00:28:03.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.0 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.1 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.1 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.2 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.2 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.3 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.3 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.4 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.4 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.5 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.5 2024-09-12T00:28:03.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.6 2024-09-12T00:28:03.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.6 2024-09-12T00:28:03.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.7 2024-09-12T00:28:03.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.7 2024-09-12T00:28:03.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.8 2024-09-12T00:28:03.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.8 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.9 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.9 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.10 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.10 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.11 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2.11 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.474+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.0 2024-09-12T00:28:03.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.475+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.1 2024-09-12T00:28:03.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.475+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2 2024-09-12T00:28:03.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.476+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.3 2024-09-12T00:28:03.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.476+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.4 2024-09-12T00:28:03.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.477+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.5 2024-09-12T00:28:03.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.477+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.6 2024-09-12T00:28:03.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.478+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.7 2024-09-12T00:28:03.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.478+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.8 2024-09-12T00:28:03.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.479+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.9 2024-09-12T00:28:03.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.480+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.10 2024-09-12T00:28:03.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.483+0000 7f3081323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:03.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.483+0000 7f3081323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 2024-09-12T00:28:03.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.485+0000 7f3081323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:28:03.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.485+0000 7f3081323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:28:03.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.485+0000 7f3081323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:03.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.485+0000 7f3081323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35, ofs0, ns] 2024-09-12T00:28:03.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.485+0000 7f2f4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 93851232892432 notifier 7094 bl.length()=995 2024-09-12T00:28:03.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.485+0000 7f2f4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:28:03.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.485+0000 7f2f4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:28:03.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.485+0000 7f2f4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:03.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.486+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_sources= new_sources= 2024-09-12T00:28:03.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.486+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential sources added=[] removed=[] 2024-09-12T00:28:03.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.486+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_dests= new_dests= 2024-09-12T00:28:03.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.486+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential dests added=[] removed=[] 2024-09-12T00:28:03.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.489+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.0 2024-09-12T00:28:03.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.489+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.1 2024-09-12T00:28:03.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.490+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.2 2024-09-12T00:28:03.488 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.490+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.3 2024-09-12T00:28:03.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.490+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.4 2024-09-12T00:28:03.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.490+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.5 2024-09-12T00:28:03.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.491+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.6 2024-09-12T00:28:03.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.491+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.7 2024-09-12T00:28:03.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.491+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.8 2024-09-12T00:28:03.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.492+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.9 2024-09-12T00:28:03.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.492+0000 7f3081323800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35.10 2024-09-12T00:28:03.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.493+0000 7f3081323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:03.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.493+0000 7f3081323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 2024-09-12T00:28:03.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.494+0000 7f3081323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:28:03.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.494+0000 7f3081323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:28:03.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.494+0000 7f3081323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:03.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.494+0000 7f3081323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35, ofs0, ns] 2024-09-12T00:28:03.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.494+0000 7f2f60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 93851232892432 notifier 7094 bl.length()=963 2024-09-12T00:28:03.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.494+0000 7f2f60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 info.flags=0x17 2024-09-12T00:28:03.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.494+0000 7f2f60ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 to cache LRU end 2024-09-12T00:28:03.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.494+0000 7f2f60ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:03.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.496+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_sources= new_sources= 2024-09-12T00:28:03.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.496+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential sources added=[] removed=[] 2024-09-12T00:28:03.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.496+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): orig_dests= new_dests= 2024-09-12T00:28:03.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.496+0000 7f3081323800 20 handle_bi_update(): bucket=:abort-at-do-reshard[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35]): potential dests added=[] removed=[] 2024-09-12T00:28:03.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.499+0000 7f3081323800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:28:03.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.500+0000 7f2f337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:03.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.503+0000 7f3081323800 20 remove_watcher() i=0 2024-09-12T00:28:03.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.503+0000 7f3081323800 2 removed watcher, disabling cache 2024-09-12T00:28:03.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.504+0000 7f3081323800 20 remove_watcher() i=1 2024-09-12T00:28:03.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.505+0000 7f3081323800 20 remove_watcher() i=2 2024-09-12T00:28:03.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.506+0000 7f3081323800 20 remove_watcher() i=3 2024-09-12T00:28:03.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.507+0000 7f3081323800 20 remove_watcher() i=4 2024-09-12T00:28:03.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.508+0000 7f3081323800 20 remove_watcher() i=5 2024-09-12T00:28:03.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.509+0000 7f3081323800 20 remove_watcher() i=6 2024-09-12T00:28:03.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.510+0000 7f3081323800 20 remove_watcher() i=7 2024-09-12T00:28:03.521 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:28:03.550 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:03.551 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:03.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.592+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.594+0000 7fd25c6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.594+0000 7fd25c6bb800 20 realm 2024-09-12T00:28:03.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.594+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.595+0000 7fd25c6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.595+0000 7fd25c6bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.595+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.595+0000 7fd25c6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.595+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.596+0000 7fd25c6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:03.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.596+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:03.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.597+0000 7fd25c6bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:03.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.597+0000 7fd25c6bb800 20 searching for the correct realm 2024-09-12T00:28:03.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.599+0000 7fd2599a4640 0 -- 172.21.15.33:0/4194660796 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fd24c0b02d0 msgr2=0x7fd24c078820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:03.804 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:03.805+0000 7fd25a1a5640 0 -- 172.21.15.33:0/4194660796 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd25006cc50 msgr2=0x7fd250075040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:04.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:04.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:04.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:04.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:04.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:04.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:04.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:04.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.013+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 20 zone default found 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 4 Realm: () 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 20 zonegroup default 2024-09-12T00:28:04.014 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:04.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.014+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.015+0000 7fd25c6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:04.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.015+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.015+0000 7fd25c6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:04.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.015+0000 7fd25c6bb800 20 started sync module instance, tier type = 2024-09-12T00:28:04.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.015+0000 7fd25c6bb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:04.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.026+0000 7fd25c6bb800 20 add_watcher() i=0 2024-09-12T00:28:04.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.026+0000 7fd25c6bb800 20 add_watcher() i=1 2024-09-12T00:28:04.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.026+0000 7fd25c6bb800 20 add_watcher() i=2 2024-09-12T00:28:04.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.026+0000 7fd25c6bb800 20 add_watcher() i=3 2024-09-12T00:28:04.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.026+0000 7fd25c6bb800 20 add_watcher() i=4 2024-09-12T00:28:04.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.026+0000 7fd25c6bb800 20 add_watcher() i=5 2024-09-12T00:28:04.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.026+0000 7fd25c6bb800 20 add_watcher() i=6 2024-09-12T00:28:04.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.027+0000 7fd25c6bb800 20 add_watcher() i=7 2024-09-12T00:28:04.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.027+0000 7fd25c6bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:04.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.029+0000 7fd110fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:04.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.029+0000 7fd25c6bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:04.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.029+0000 7fd25c6bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:04.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.029+0000 7fd25c6bb800 5 note: GC not initialized 2024-09-12T00:28:04.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.030+0000 7fd08b7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:04.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.030+0000 7fd25c6bb800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:04.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.030+0000 7fd25c6bb800 20 Filter name: none 2024-09-12T00:28:04.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.030+0000 7fd0897fa640 20 reqs_thread_entry: start 2024-09-12T00:28:04.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.030+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.030+0000 7fd25c6bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:28:04.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.030+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.031+0000 7fd25c6bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:28:04.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.031+0000 7fd25c6bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:04.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.031+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.032+0000 7fd25c6bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:28:04.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.032+0000 7fd25c6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:28:04.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.032+0000 7fd25c6bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:28:04.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.032+0000 7fd25c6bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:04.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.034+0000 7fd110fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:04.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.037+0000 7fd25c6bb800 20 remove_watcher() i=0 2024-09-12T00:28:04.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.037+0000 7fd25c6bb800 2 removed watcher, disabling cache 2024-09-12T00:28:04.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.038+0000 7fd25c6bb800 20 remove_watcher() i=1 2024-09-12T00:28:04.038 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.040+0000 7fd25c6bb800 20 remove_watcher() i=2 2024-09-12T00:28:04.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.041+0000 7fd25c6bb800 20 remove_watcher() i=3 2024-09-12T00:28:04.041 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.042+0000 7fd25c6bb800 20 remove_watcher() i=4 2024-09-12T00:28:04.042 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.043+0000 7fd25c6bb800 20 remove_watcher() i=5 2024-09-12T00:28:04.043 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.044+0000 7fd25c6bb800 20 remove_watcher() i=6 2024-09-12T00:28:04.044 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:04.046+0000 7fd25c6bb800 20 remove_watcher() i=7 2024-09-12T00:28:04.056 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:04.057 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:04.057 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-do-reshard id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:28:04.057 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:04.058 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.059 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.080 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.081 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.269 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.269 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.407 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:28:04.407 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:04.408 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.408 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.457 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.457 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.514 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.514 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.552 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.552 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.586 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.587 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.620 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.620 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.654 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.655 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.688 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.688 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.722 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.722 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.757 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.757 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.791 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.791 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.827 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.827 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.861 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.861 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.893 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.893 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.928 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.928 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.964 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.964 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:04.998 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:04.998 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:05.036 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:05.036 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:05.070 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:05.070 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:05.104 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:05.105 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:05.138 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:05.139 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:05.172 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:05.172 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:05.205 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:28:05.234 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:05.234 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:05.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.275+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.277+0000 7fdfd6930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.277+0000 7fdfd6930800 20 realm 2024-09-12T00:28:05.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.277+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.277+0000 7fdfd6930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.277+0000 7fdfd6930800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:05.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.277+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.278+0000 7fdfd6930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.278+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.278+0000 7fdfd6930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:05.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.278+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.279+0000 7fdfd6930800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:05.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.279+0000 7fdfd6930800 20 searching for the correct realm 2024-09-12T00:28:05.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.282+0000 7fdfd26b0640 0 -- 172.21.15.33:0/680915769 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fdfcc018070 msgr2=0x7fdfcc00f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:05.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.285+0000 7fdfd26b0640 0 -- 172.21.15.33:0/680915769 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fdfc802a070 msgr2=0x7fdfc8050980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:05.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:05.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:05.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:05.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:05.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:05.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:05.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.491+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 20 zone default found 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 4 Realm: () 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 20 zonegroup default 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.492+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.493+0000 7fdfd6930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.493+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.493+0000 7fdfd6930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.493+0000 7fdfd6930800 20 started sync module instance, tier type = 2024-09-12T00:28:05.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.493+0000 7fdfd6930800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:05.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.502+0000 7fdfd6930800 20 add_watcher() i=0 2024-09-12T00:28:05.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.502+0000 7fdfd6930800 20 add_watcher() i=1 2024-09-12T00:28:05.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.502+0000 7fdfd6930800 20 add_watcher() i=2 2024-09-12T00:28:05.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.502+0000 7fdfd6930800 20 add_watcher() i=3 2024-09-12T00:28:05.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.502+0000 7fdfd6930800 20 add_watcher() i=4 2024-09-12T00:28:05.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.502+0000 7fdfd6930800 20 add_watcher() i=5 2024-09-12T00:28:05.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.502+0000 7fdfd6930800 20 add_watcher() i=6 2024-09-12T00:28:05.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.503+0000 7fdfd6930800 20 add_watcher() i=7 2024-09-12T00:28:05.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.503+0000 7fdfd6930800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:05.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.505+0000 7fde88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:05.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.505+0000 7fdfd6930800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:05.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.505+0000 7fdfd6930800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:05.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.505+0000 7fdfd6930800 5 note: GC not initialized 2024-09-12T00:28:05.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.505+0000 7fde037fe640 20 reqs_thread_entry: start 2024-09-12T00:28:05.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.505+0000 7fdfd6930800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:05.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.505+0000 7fdfd6930800 20 Filter name: none 2024-09-12T00:28:05.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.505+0000 7fde017fa640 20 reqs_thread_entry: start 2024-09-12T00:28:05.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.506+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.506+0000 7fdfd6930800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:05.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.506+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.507+0000 7fdfd6930800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:05.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.507+0000 7fdfd6930800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:05.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.507+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.507+0000 7fdfd6930800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:05.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.507+0000 7fdfd6930800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.508+0000 7fdfd6930800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:05.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.508+0000 7fdfd6930800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:05.508 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.509+0000 7fde88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.512+0000 7fdfd6930800 20 remove_watcher() i=0 2024-09-12T00:28:05.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.512+0000 7fdfd6930800 2 removed watcher, disabling cache 2024-09-12T00:28:05.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.513+0000 7fdfd6930800 20 remove_watcher() i=1 2024-09-12T00:28:05.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.514+0000 7fdfd6930800 20 remove_watcher() i=2 2024-09-12T00:28:05.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.515+0000 7fdfd6930800 20 remove_watcher() i=3 2024-09-12T00:28:05.514 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.516+0000 7fdfd6930800 20 remove_watcher() i=4 2024-09-12T00:28:05.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.517+0000 7fdfd6930800 20 remove_watcher() i=5 2024-09-12T00:28:05.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.518+0000 7fdfd6930800 20 remove_watcher() i=6 2024-09-12T00:28:05.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.519+0000 7fdfd6930800 20 remove_watcher() i=7 2024-09-12T00:28:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:05.529 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:05.529 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-logrecord-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:05.529 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:05.530 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:28:05.565 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:05.565 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:05.605 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.606+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.608+0000 7f21a31ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.608+0000 7f21a31ad800 20 realm 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.608+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.608+0000 7f21a31ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.608+0000 7f21a31ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.608+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.608+0000 7f21a31ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.607 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.608+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.609+0000 7f21a31ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:05.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.609+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.610+0000 7f21a31ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:05.608 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.610+0000 7f21a31ad800 20 searching for the correct realm 2024-09-12T00:28:05.610 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.612+0000 7f219bfff640 0 -- 172.21.15.33:0/2291376335 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5588ad613020 msgr2=0x5588ad615430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:05.614 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.616+0000 7f21a0c97640 0 -- 172.21.15.33:0/2291376335 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f218c04f800 msgr2=0x7f218c01b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:05.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.822+0000 7f21a31ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.822+0000 7f21a31ad800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.822+0000 7f21a31ad800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.822+0000 7f21a31ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.822+0000 7f21a31ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.822+0000 7f21a31ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.822+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:05.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 20 zone default found 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 4 Realm: () 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 20 zonegroup default 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.823+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.824+0000 7f21a31ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.824+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.824+0000 7f21a31ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.824+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.824+0000 7f21a31ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.824+0000 7f21a31ad800 20 started sync module instance, tier type = 2024-09-12T00:28:05.825 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.824+0000 7f21a31ad800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:05.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.834+0000 7f21a31ad800 20 add_watcher() i=0 2024-09-12T00:28:05.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.834+0000 7f21a31ad800 20 add_watcher() i=1 2024-09-12T00:28:05.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.834+0000 7f21a31ad800 20 add_watcher() i=2 2024-09-12T00:28:05.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.834+0000 7f21a31ad800 20 add_watcher() i=3 2024-09-12T00:28:05.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.834+0000 7f21a31ad800 20 add_watcher() i=4 2024-09-12T00:28:05.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.834+0000 7f21a31ad800 20 add_watcher() i=5 2024-09-12T00:28:05.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.834+0000 7f21a31ad800 20 add_watcher() i=6 2024-09-12T00:28:05.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.835+0000 7f21a31ad800 20 add_watcher() i=7 2024-09-12T00:28:05.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.835+0000 7f21a31ad800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:05.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.837+0000 7f2056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:05.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.837+0000 7f21a31ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:05.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.837+0000 7f21a31ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:05.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.837+0000 7f21a31ad800 5 note: GC not initialized 2024-09-12T00:28:05.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.837+0000 7f2055fe3640 20 reqs_thread_entry: start 2024-09-12T00:28:05.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.838+0000 7f21a31ad800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:05.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.838+0000 7f21a31ad800 20 Filter name: none 2024-09-12T00:28:05.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.838+0000 7f1fc77fe640 20 reqs_thread_entry: start 2024-09-12T00:28:05.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.838+0000 7f21a31ad800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:28:05.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.838+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:05.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:28:05.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:28:05.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 : miss 2024-09-12T00:28:05.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:05.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:05.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:05.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:05.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:05.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.839+0000 7f21a31ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 2024-09-12T00:28:05.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.844+0000 7f21a31ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:05.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.844+0000 7f21a31ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:05.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.844+0000 7f21a31ad800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:05.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.844+0000 7f21a31ad800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36, ofs0, ns] 2024-09-12T00:28:05.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.845+0000 7f2077fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94045512774656 notifier 7145 bl.length()=1007 2024-09-12T00:28:05.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.845+0000 7f2077fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:05.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.845+0000 7f2077fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:05.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.845+0000 7f2077fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:05.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.846+0000 7f21a31ad800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_sources= new_sources= 2024-09-12T00:28:05.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.847+0000 7f21a31ad800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential sources added=[] removed=[] 2024-09-12T00:28:05.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.847+0000 7f21a31ad800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_dests= new_dests= 2024-09-12T00:28:05.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.847+0000 7f21a31ad800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential dests added=[] removed=[] 2024-09-12T00:28:05.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.849+0000 7f21a31ad800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:28:05.848 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.849+0000 7f21a31ad800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:28:05.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.853+0000 7f21a31ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:05.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.853+0000 7f21a31ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 2024-09-12T00:28:05.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.855+0000 7f21a31ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:05.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.855+0000 7f21a31ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:05.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.855+0000 7f21a31ad800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:05.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.855+0000 7f21a31ad800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36, ofs0, ns] 2024-09-12T00:28:05.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.855+0000 7f2077fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94045512774656 notifier 7145 bl.length()=975 2024-09-12T00:28:05.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.855+0000 7f2077fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:05.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.855+0000 7f2077fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:05.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.855+0000 7f2077fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:05.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.857+0000 7f21a31ad800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_sources= new_sources= 2024-09-12T00:28:05.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.857+0000 7f21a31ad800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential sources added=[] removed=[] 2024-09-12T00:28:05.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.857+0000 7f21a31ad800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_dests= new_dests= 2024-09-12T00:28:05.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.857+0000 7f21a31ad800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential dests added=[] removed=[] 2024-09-12T00:28:05.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.859+0000 7f2056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:05.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.861+0000 7f21a31ad800 20 remove_watcher() i=0 2024-09-12T00:28:05.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.861+0000 7f21a31ad800 2 removed watcher, disabling cache 2024-09-12T00:28:05.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.862+0000 7f21a31ad800 20 remove_watcher() i=1 2024-09-12T00:28:05.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.863+0000 7f21a31ad800 20 remove_watcher() i=2 2024-09-12T00:28:05.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.864+0000 7f21a31ad800 20 remove_watcher() i=3 2024-09-12T00:28:05.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.865+0000 7f21a31ad800 20 remove_watcher() i=4 2024-09-12T00:28:05.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.866+0000 7f21a31ad800 20 remove_watcher() i=5 2024-09-12T00:28:05.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.867+0000 7f21a31ad800 20 remove_watcher() i=6 2024-09-12T00:28:05.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.868+0000 7f21a31ad800 20 remove_watcher() i=7 2024-09-12T00:28:05.880 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:28:05.909 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:05.909 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:05.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.949+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.951+0000 7f1f0fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.951+0000 7f1f0fa10800 20 realm 2024-09-12T00:28:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.951+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.951+0000 7f1f0fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.951+0000 7f1f0fa10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.951+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.951+0000 7f1f0fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.951+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.952+0000 7f1f0fa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.952+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.953+0000 7f1f0fa10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:05.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.953+0000 7f1f0fa10800 20 searching for the correct realm 2024-09-12T00:28:05.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.956+0000 7f1f0b9bd640 0 -- 172.21.15.33:0/3784302448 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5595b335edb0 msgr2=0x5595b3361270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:05.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.959+0000 7f1f0b1bc640 0 -- 172.21.15.33:0/3784302448 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f1f0003a070 msgr2=0x7f1f00047410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:05.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.963+0000 7f1f0fa10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:05.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.963+0000 7f1f0fa10800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:05.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.963+0000 7f1f0fa10800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:05.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.963+0000 7f1f0fa10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:05.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.963+0000 7f1f0fa10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:05.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.963+0000 7f1f0fa10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:05.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.963+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.963 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:05.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:05.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 zone default found 2024-09-12T00:28:05.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 4 Realm: () 2024-09-12T00:28:05.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:05.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:05.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 zonegroup default 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.964+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.965+0000 7f1f0fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.965+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.965+0000 7f1f0fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.965+0000 7f1f0fa10800 20 started sync module instance, tier type = 2024-09-12T00:28:05.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.965+0000 7f1f0fa10800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:05.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.974+0000 7f1f0fa10800 20 add_watcher() i=0 2024-09-12T00:28:05.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.974+0000 7f1f0fa10800 20 add_watcher() i=1 2024-09-12T00:28:05.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.974+0000 7f1f0fa10800 20 add_watcher() i=2 2024-09-12T00:28:05.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.974+0000 7f1f0fa10800 20 add_watcher() i=3 2024-09-12T00:28:05.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.974+0000 7f1f0fa10800 20 add_watcher() i=4 2024-09-12T00:28:05.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.974+0000 7f1f0fa10800 20 add_watcher() i=5 2024-09-12T00:28:05.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.974+0000 7f1f0fa10800 20 add_watcher() i=6 2024-09-12T00:28:05.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.975+0000 7f1f0fa10800 20 add_watcher() i=7 2024-09-12T00:28:05.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.975+0000 7f1f0fa10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:05.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.976+0000 7f1dc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:05.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.977+0000 7f1f0fa10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:05.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.977+0000 7f1f0fa10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:05.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.977+0000 7f1f0fa10800 5 note: GC not initialized 2024-09-12T00:28:05.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.977+0000 7f1dc0fe1640 20 reqs_thread_entry: start 2024-09-12T00:28:05.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.977+0000 7f1f0fa10800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:05.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.977+0000 7f1f0fa10800 20 Filter name: none 2024-09-12T00:28:05.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.977+0000 7f1d3a7fc640 20 reqs_thread_entry: start 2024-09-12T00:28:05.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.977+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.978+0000 7f1f0fa10800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:05.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.978+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.979+0000 7f1f0fa10800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:05.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.979+0000 7f1f0fa10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:05.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.979+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.979+0000 7f1f0fa10800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:05.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.979+0000 7f1f0fa10800 20 rados->read ofs=0 len=0 2024-09-12T00:28:05.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.979+0000 7f1f0fa10800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:05.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.979+0000 7f1f0fa10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:05.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.981+0000 7f1dc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:05.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.983+0000 7f1f0fa10800 20 remove_watcher() i=0 2024-09-12T00:28:05.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.983+0000 7f1f0fa10800 2 removed watcher, disabling cache 2024-09-12T00:28:05.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.985+0000 7f1f0fa10800 20 remove_watcher() i=1 2024-09-12T00:28:05.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.986+0000 7f1f0fa10800 20 remove_watcher() i=2 2024-09-12T00:28:05.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.987+0000 7f1f0fa10800 20 remove_watcher() i=3 2024-09-12T00:28:05.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.988+0000 7f1f0fa10800 20 remove_watcher() i=4 2024-09-12T00:28:05.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.988+0000 7f1f0fa10800 20 remove_watcher() i=5 2024-09-12T00:28:05.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.989+0000 7f1f0fa10800 20 remove_watcher() i=6 2024-09-12T00:28:05.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:05.990+0000 7f1f0fa10800 20 remove_watcher() i=7 2024-09-12T00:28:06.000 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:06.000 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:06.000 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-logrecord-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:06.000 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:06.002 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:06.002 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:06.033 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:06.033 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:06.090 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:28:06.123 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:06.123 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:06.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.164+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.166+0000 7f5a04213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.166+0000 7f5a04213800 20 realm 2024-09-12T00:28:06.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.166+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.166+0000 7f5a04213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.166+0000 7f5a04213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:06.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.166+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.166+0000 7f5a04213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.166+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.167+0000 7f5a04213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:06.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.167+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.168+0000 7f5a04213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:06.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.168+0000 7f5a04213800 20 searching for the correct realm 2024-09-12T00:28:06.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.172+0000 7f5a00149640 0 -- 172.21.15.33:0/415196217 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f59f400b040 msgr2=0x7f59f4017920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:06.377 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.378+0000 7f59ff948640 0 -- 172.21.15.33:0/415196217 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x5618acd76e50 msgr2=0x5618acd79240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:06.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:06.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:06.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:06.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:06.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:06.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:06.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.380 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.381+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 zone default found 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 4 Realm: () 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 zonegroup default 2024-09-12T00:28:06.382 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 started sync module instance, tier type = 2024-09-12T00:28:06.383 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.382+0000 7f5a04213800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:06.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.391+0000 7f5a04213800 20 add_watcher() i=0 2024-09-12T00:28:06.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.391+0000 7f5a04213800 20 add_watcher() i=1 2024-09-12T00:28:06.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.391+0000 7f5a04213800 20 add_watcher() i=2 2024-09-12T00:28:06.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.391+0000 7f5a04213800 20 add_watcher() i=3 2024-09-12T00:28:06.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.391+0000 7f5a04213800 20 add_watcher() i=4 2024-09-12T00:28:06.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.391+0000 7f5a04213800 20 add_watcher() i=5 2024-09-12T00:28:06.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.391+0000 7f5a04213800 20 add_watcher() i=6 2024-09-12T00:28:06.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.392+0000 7f5a04213800 20 add_watcher() i=7 2024-09-12T00:28:06.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.392+0000 7f5a04213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:06.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.394+0000 7f58b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:06.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.394+0000 7f5a04213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:06.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.394+0000 7f5a04213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:06.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.394+0000 7f5a04213800 5 note: GC not initialized 2024-09-12T00:28:06.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.394+0000 7f58b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:28:06.393 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.394+0000 7f5a04213800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:06.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.394+0000 7f5a04213800 20 Filter name: none 2024-09-12T00:28:06.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f582e7fc640 20 reqs_thread_entry: start 2024-09-12T00:28:06.394 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 : miss 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:06.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.395+0000 7f5a04213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 2024-09-12T00:28:06.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.400+0000 7f5a04213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:06.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.400+0000 7f5a04213800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:06.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.400+0000 7f5a04213800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:06.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.400+0000 7f5a04213800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36, ofs0, ns] 2024-09-12T00:28:06.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.401+0000 7f58de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94663979067296 notifier 7677 bl.length()=1007 2024-09-12T00:28:06.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.401+0000 7f58de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:06.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.401+0000 7f58de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:06.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.401+0000 7f58de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:06.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.402+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_sources= new_sources= 2024-09-12T00:28:06.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.402+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential sources added=[] removed=[] 2024-09-12T00:28:06.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.402+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_dests= new_dests= 2024-09-12T00:28:06.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.402+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential dests added=[] removed=[] 2024-09-12T00:28:06.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.0 2024-09-12T00:28:06.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.0 2024-09-12T00:28:06.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.1 2024-09-12T00:28:06.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.1 2024-09-12T00:28:06.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.2 2024-09-12T00:28:06.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.2 2024-09-12T00:28:06.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.3 2024-09-12T00:28:06.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.3 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.4 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.4 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.5 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.5 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.6 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.6 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.7 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.7 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.8 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.8 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.9 2024-09-12T00:28:06.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.9 2024-09-12T00:28:06.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.10 2024-09-12T00:28:06.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.10 2024-09-12T00:28:06.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.11 2024-09-12T00:28:06.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1.11 2024-09-12T00:28:06.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.407+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.0 2024-09-12T00:28:06.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.408+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1 2024-09-12T00:28:06.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.408+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.2 2024-09-12T00:28:06.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.409+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.3 2024-09-12T00:28:06.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.409+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.4 2024-09-12T00:28:06.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.410+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.5 2024-09-12T00:28:06.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.411+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.6 2024-09-12T00:28:06.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.411+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.7 2024-09-12T00:28:06.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.411+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.8 2024-09-12T00:28:06.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.412+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.9 2024-09-12T00:28:06.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.413+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.10 2024-09-12T00:28:06.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.415+0000 7f5a04213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:06.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.415+0000 7f5a04213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 2024-09-12T00:28:06.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.416+0000 7f5a04213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:06.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.416+0000 7f5a04213800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:06.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.416+0000 7f5a04213800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:06.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.416+0000 7f5a04213800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36, ofs0, ns] 2024-09-12T00:28:06.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.417+0000 7f58deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94663979067296 notifier 7677 bl.length()=1007 2024-09-12T00:28:06.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.417+0000 7f58deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:06.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.417+0000 7f58deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:06.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.417+0000 7f58deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:06.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.418+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_sources= new_sources= 2024-09-12T00:28:06.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.418+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential sources added=[] removed=[] 2024-09-12T00:28:06.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.418+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_dests= new_dests= 2024-09-12T00:28:06.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.418+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential dests added=[] removed=[] 2024-09-12T00:28:06.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.420+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.0 2024-09-12T00:28:06.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.421+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.1 2024-09-12T00:28:06.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.421+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.2 2024-09-12T00:28:06.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.421+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.3 2024-09-12T00:28:06.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.422+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.4 2024-09-12T00:28:06.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.422+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.5 2024-09-12T00:28:06.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.422+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.6 2024-09-12T00:28:06.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.423+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.7 2024-09-12T00:28:06.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.423+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.8 2024-09-12T00:28:06.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.423+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.9 2024-09-12T00:28:06.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.424+0000 7f5a04213800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36.10 2024-09-12T00:28:06.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.424+0000 7f5a04213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:06.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.424+0000 7f5a04213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 2024-09-12T00:28:06.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.426+0000 7f5a04213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:06.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.426+0000 7f5a04213800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:06.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.426+0000 7f5a04213800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:06.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.426+0000 7f5a04213800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36, ofs0, ns] 2024-09-12T00:28:06.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.426+0000 7f58de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366188 cookie 94663979067296 notifier 7677 bl.length()=975 2024-09-12T00:28:06.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.426+0000 7f58de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 info.flags=0x17 2024-09-12T00:28:06.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.426+0000 7f58de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 to cache LRU end 2024-09-12T00:28:06.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.426+0000 7f58de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:06.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.427+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_sources= new_sources= 2024-09-12T00:28:06.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.427+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential sources added=[] removed=[] 2024-09-12T00:28:06.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.427+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): orig_dests= new_dests= 2024-09-12T00:28:06.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.427+0000 7f5a04213800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36]): potential dests added=[] removed=[] 2024-09-12T00:28:06.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.431+0000 7f5a04213800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:28:06.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.433+0000 7f58b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:06.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.435+0000 7f5a04213800 20 remove_watcher() i=0 2024-09-12T00:28:06.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.435+0000 7f5a04213800 2 removed watcher, disabling cache 2024-09-12T00:28:06.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.437+0000 7f5a04213800 20 remove_watcher() i=1 2024-09-12T00:28:06.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.438+0000 7f5a04213800 20 remove_watcher() i=2 2024-09-12T00:28:06.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.439+0000 7f5a04213800 20 remove_watcher() i=3 2024-09-12T00:28:06.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.440+0000 7f5a04213800 20 remove_watcher() i=4 2024-09-12T00:28:06.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.441+0000 7f5a04213800 20 remove_watcher() i=5 2024-09-12T00:28:06.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.442+0000 7f5a04213800 20 remove_watcher() i=6 2024-09-12T00:28:06.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.442+0000 7f5a04213800 20 remove_watcher() i=7 2024-09-12T00:28:06.453 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:28:06.483 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:06.483 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:06.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.524+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.526+0000 7f0fe8525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.526+0000 7f0fe8525800 20 realm 2024-09-12T00:28:06.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.526+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.526+0000 7f0fe8525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.526+0000 7f0fe8525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:06.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.526+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.526+0000 7f0fe8525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.526+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.527+0000 7f0fe8525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:06.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.527+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.528+0000 7f0fe8525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:06.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.528+0000 7f0fe8525800 20 searching for the correct realm 2024-09-12T00:28:06.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.530+0000 7f0fe49af640 0 -- 172.21.15.33:0/3492390478 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55a7e301deb0 msgr2=0x55a7e3020370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:06.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.534+0000 7f0fe41ae640 0 -- 172.21.15.33:0/3492390478 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f0fd8096920 msgr2=0x7f0fd8081400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:06.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:06.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:06.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:06.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:06.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:06.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:06.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.538 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.538+0000 7f0fe8525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 zone default found 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 4 Realm: () 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 zonegroup default 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:06.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 started sync module instance, tier type = 2024-09-12T00:28:06.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.539+0000 7f0fe8525800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:06.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.549+0000 7f0fe8525800 20 add_watcher() i=0 2024-09-12T00:28:06.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.549+0000 7f0fe8525800 20 add_watcher() i=1 2024-09-12T00:28:06.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.549+0000 7f0fe8525800 20 add_watcher() i=2 2024-09-12T00:28:06.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.549+0000 7f0fe8525800 20 add_watcher() i=3 2024-09-12T00:28:06.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.549+0000 7f0fe8525800 20 add_watcher() i=4 2024-09-12T00:28:06.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.549+0000 7f0fe8525800 20 add_watcher() i=5 2024-09-12T00:28:06.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.549+0000 7f0fe8525800 20 add_watcher() i=6 2024-09-12T00:28:06.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.550+0000 7f0fe8525800 20 add_watcher() i=7 2024-09-12T00:28:06.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.550+0000 7f0fe8525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:06.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.552+0000 7f0e9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:06.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.552+0000 7f0fe8525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:06.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.552+0000 7f0fe8525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:06.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.552+0000 7f0fe8525800 5 note: GC not initialized 2024-09-12T00:28:06.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.552+0000 7f0e99fdb640 20 reqs_thread_entry: start 2024-09-12T00:28:06.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.552+0000 7f0fe8525800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:06.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.552+0000 7f0fe8525800 20 Filter name: none 2024-09-12T00:28:06.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.552+0000 7f0e0b7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:06.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.553+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.553+0000 7f0fe8525800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:06.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.553+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.554+0000 7f0fe8525800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:06.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.554+0000 7f0fe8525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:06.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.554+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.554+0000 7f0fe8525800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:06.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.554+0000 7f0fe8525800 20 rados->read ofs=0 len=0 2024-09-12T00:28:06.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.554+0000 7f0fe8525800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:06.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.554+0000 7f0fe8525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:06.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.556+0000 7f0e9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:06.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.558+0000 7f0fe8525800 20 remove_watcher() i=0 2024-09-12T00:28:06.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.558+0000 7f0fe8525800 2 removed watcher, disabling cache 2024-09-12T00:28:06.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.559+0000 7f0fe8525800 20 remove_watcher() i=1 2024-09-12T00:28:06.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.560+0000 7f0fe8525800 20 remove_watcher() i=2 2024-09-12T00:28:06.559 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.561+0000 7f0fe8525800 20 remove_watcher() i=3 2024-09-12T00:28:06.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.562+0000 7f0fe8525800 20 remove_watcher() i=4 2024-09-12T00:28:06.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.563+0000 7f0fe8525800 20 remove_watcher() i=5 2024-09-12T00:28:06.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.564+0000 7f0fe8525800 20 remove_watcher() i=6 2024-09-12T00:28:06.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:06.565+0000 7f0fe8525800 20 remove_watcher() i=7 2024-09-12T00:28:06.575 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:06.575 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:06.575 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-logrecord-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:28:06.575 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:06.577 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:06.577 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:06.598 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:06.598 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:06.784 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:06.784 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:06.919 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:28:06.919 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:06.920 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:06.920 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:06.970 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:06.970 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.027 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.027 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.064 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.064 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.099 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.099 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.134 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.135 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.167 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.168 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.201 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.201 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.236 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.236 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.272 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.272 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.307 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.307 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.343 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.343 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.377 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.378 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.412 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.412 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.445 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.445 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.479 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.479 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.513 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.513 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.546 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.546 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.586 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.586 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.619 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.619 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.653 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.653 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.686 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:07.687 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:07.721 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:28:07.750 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:07.750 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:07.790 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.791+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:07.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.793+0000 7fdf29010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:07.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.793+0000 7fdf29010800 20 realm 2024-09-12T00:28:07.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.793+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:07.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.793+0000 7fdf29010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:07.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.793+0000 7fdf29010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:07.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.793+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:07.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.793+0000 7fdf29010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:07.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.793+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:07.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.794+0000 7fdf29010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:07.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.794+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:07.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.795+0000 7fdf29010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:07.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.795+0000 7fdf29010800 20 searching for the correct realm 2024-09-12T00:28:07.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.797+0000 7fdf23f79640 0 -- 172.21.15.33:0/126686055 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55b5ccff0d90 msgr2=0x55b5ccff3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:07.799 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:07.801+0000 7fdf2477a640 0 -- 172.21.15.33:0/126686055 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fdf1807b910 msgr2=0x7fdf180e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.008+0000 7fdf29010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.008+0000 7fdf29010800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.008+0000 7fdf29010800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.008+0000 7fdf29010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.008+0000 7fdf29010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.008+0000 7fdf29010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.008+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 20 zone default found 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 4 Realm: () 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 20 zonegroup default 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.009+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.010+0000 7fdf29010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.010+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.010+0000 7fdf29010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.010+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.010+0000 7fdf29010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.010+0000 7fdf29010800 20 started sync module instance, tier type = 2024-09-12T00:28:08.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.010+0000 7fdf29010800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:08.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.019+0000 7fdf29010800 20 add_watcher() i=0 2024-09-12T00:28:08.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.019+0000 7fdf29010800 20 add_watcher() i=1 2024-09-12T00:28:08.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.019+0000 7fdf29010800 20 add_watcher() i=2 2024-09-12T00:28:08.018 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.019+0000 7fdf29010800 20 add_watcher() i=3 2024-09-12T00:28:08.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.019+0000 7fdf29010800 20 add_watcher() i=4 2024-09-12T00:28:08.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.019+0000 7fdf29010800 20 add_watcher() i=5 2024-09-12T00:28:08.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.019+0000 7fdf29010800 20 add_watcher() i=6 2024-09-12T00:28:08.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.020+0000 7fdf29010800 20 add_watcher() i=7 2024-09-12T00:28:08.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.020+0000 7fdf29010800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:08.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.022+0000 7fdddafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.021 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.022+0000 7fdf29010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:08.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.022+0000 7fdf29010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:08.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.022+0000 7fdf29010800 5 note: GC not initialized 2024-09-12T00:28:08.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.023+0000 7fddd9fdb640 20 reqs_thread_entry: start 2024-09-12T00:28:08.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.023+0000 7fdf29010800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:08.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.023+0000 7fdf29010800 20 Filter name: none 2024-09-12T00:28:08.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.023+0000 7fdd4b7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:08.022 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.023+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.024+0000 7fdf29010800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:08.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.024+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.024+0000 7fdf29010800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:08.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.024+0000 7fdf29010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:08.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.024+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.025+0000 7fdf29010800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:08.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.025+0000 7fdf29010800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.025+0000 7fdf29010800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:08.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.025+0000 7fdf29010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:08.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.027+0000 7fdddafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.029+0000 7fdf29010800 20 remove_watcher() i=0 2024-09-12T00:28:08.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.029+0000 7fdf29010800 2 removed watcher, disabling cache 2024-09-12T00:28:08.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.030+0000 7fdf29010800 20 remove_watcher() i=1 2024-09-12T00:28:08.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.031+0000 7fdf29010800 20 remove_watcher() i=2 2024-09-12T00:28:08.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.032+0000 7fdf29010800 20 remove_watcher() i=3 2024-09-12T00:28:08.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.033+0000 7fdf29010800 20 remove_watcher() i=4 2024-09-12T00:28:08.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.034+0000 7fdf29010800 20 remove_watcher() i=5 2024-09-12T00:28:08.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.035+0000 7fdf29010800 20 remove_watcher() i=6 2024-09-12T00:28:08.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.036+0000 7fdf29010800 20 remove_watcher() i=7 2024-09-12T00:28:08.046 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.046 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:08.046 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-logrecord-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:08.046 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.047 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:28:08.084 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:08.084 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:08.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.125+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.125 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.127+0000 7f49f4936800 20 realm 2024-09-12T00:28:08.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.127+0000 7f49f4936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:08.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.128+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.128+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.129+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:08.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.129+0000 7f49f4936800 20 searching for the correct realm 2024-09-12T00:28:08.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.131+0000 7f49efeb6640 0 -- 172.21.15.33:0/427799938 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f49e00b5380 msgr2=0x7f49e00b5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.135+0000 7f49f06b7640 0 -- 172.21.15.33:0/427799938 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f49e402d420 msgr2=0x7f49e402d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:08.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:08.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:08.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:08.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:08.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 20 zone default found 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 4 Realm: () 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 20 zonegroup default 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.344+0000 7f49f4936800 20 started sync module instance, tier type = 2024-09-12T00:28:08.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.344+0000 7f49f4936800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:08.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=0 2024-09-12T00:28:08.351 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=1 2024-09-12T00:28:08.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=2 2024-09-12T00:28:08.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=3 2024-09-12T00:28:08.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=4 2024-09-12T00:28:08.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=5 2024-09-12T00:28:08.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=6 2024-09-12T00:28:08.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.354+0000 7f49f4936800 20 add_watcher() i=7 2024-09-12T00:28:08.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.354+0000 7f49f4936800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:08.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f48a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f49f4936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:08.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f49f4936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:08.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f49f4936800 5 note: GC not initialized 2024-09-12T00:28:08.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f48a57e2640 20 reqs_thread_entry: start 2024-09-12T00:28:08.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f49f4936800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:08.355 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f49f4936800 20 Filter name: none 2024-09-12T00:28:08.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f4816ffd640 20 reqs_thread_entry: start 2024-09-12T00:28:08.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f49f4936800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:28:08.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.356+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:08.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:28:08.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:28:08.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 : miss 2024-09-12T00:28:08.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:08.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:08.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.357+0000 7f49f4936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 2024-09-12T00:28:08.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.362+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.362+0000 7f49f4936800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.362+0000 7f49f4936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.362+0000 7f49f4936800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37, ofs0, ns] 2024-09-12T00:28:08.361 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 93881712501040 notifier 7226 bl.length()=1007 2024-09-12T00:28:08.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.362 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_sources= new_sources= 2024-09-12T00:28:08.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential sources added=[] removed=[] 2024-09-12T00:28:08.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_dests= new_dests= 2024-09-12T00:28:08.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential dests added=[] removed=[] 2024-09-12T00:28:08.366 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f49f4936800 time 2024-09-12T00:28:08.368907+0000 2024-09-12T00:28:08.366 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:28:08.367 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:08.367 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f49f618c71a] 2024-09-12T00:28:08.367 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f49f618c8d8] 2024-09-12T00:28:08.367 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556288659641] 2024-09-12T00:28:08.367 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd8854c) [0x556288b6c54c] 2024-09-12T00:28:08.367 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55628866931d] 2024-09-12T00:28:08.368 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:28:08.368 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f49f4e29590] 2024-09-12T00:28:08.368 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:28:08.369 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:28:08.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.368+0000 7f49f4936800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f49f4936800 time 2024-09-12T00:28:08.368907+0000 2024-09-12T00:28:08.370 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:28:08.370 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.370 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:08.370 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f49f618c71a] 2024-09-12T00:28:08.370 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f49f618c8d8] 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556288659641] 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd8854c) [0x556288b6c54c] 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55628866931d] 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f49f4e29590] 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:28:08.371 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f49f4936800 thread_name:radosgw-admin 2024-09-12T00:28:08.393 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:08.393 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f49f4e3e6f0] 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f49f4e8b99c] 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f49f618c774] 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f49f618c8d8] 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556288659641] 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd8854c) [0x556288b6c54c] 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55628866931d] 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f49f4e29590] 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:28:08.394 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.369+0000 7f49f4936800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f49f4936800 thread_name:radosgw-admin 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f49f4e3e6f0] 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f49f4e8b99c] 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f49f618c774] 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f49f618c8d8] 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556288659641] 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd8854c) [0x556288b6c54c] 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55628866931d] 2024-09-12T00:28:08.395 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f49f4e29590] 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:28:08.107+0000 7f48de60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:28:08.107+0000 7f48de60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:28:08.107+0000 7f48de60c640 10 monclient: dump: 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.396 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:28:08.108+0000 7f49f4936800 10 monclient: shutdown 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 asok(0x556289edd630) unregister_commands rotate-key 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:28:08.108+0000 7f49f4936800 10 monclient: build_initial_monmap 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 build_initial for_mkfs: 0 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:28:08.108+0000 7f49f4936800 10 monclient: monmap: 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:08.397 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding auth protocol: cephx 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding auth protocol: cephx 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding auth protocol: cephx 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.398 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:28:08.108+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 librados: starting msgr at 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 librados: starting objecter 2024-09-12T00:28:08.399 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 asok(0x556289edd630) register_command objecter_requests hook 0x55628a048460 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 librados: setting wanted keys 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 librados: calling monclient init 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:28:08.108+0000 7f49f4936800 10 monclient: init 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding auth protocol: cephx 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding auth protocol: cephx 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding auth protocol: cephx 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.400 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:28:08.109+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:28:08.109+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:28:08.109+0000 7f49f4936800 5 asok(0x556289edd630) register_command rotate-key hook 0x55628a0fe088 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-a con 0x556289fb7340 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-b con 0x55628a040e70 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:08.401 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-c con 0x55628a0412a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): authenticate will time out at 2307.674431s 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request con 0x55628a0412a0 auth_method 0 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): get_auth_request con 0x556289fb7340 auth_method 0 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.402 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): get_auth_request con 0x55628a040e70 auth_method 0 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.403 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_done global_id 7217 payload 824 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient: _finish_hunting 0 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 1 monclient: found mon.noname-c 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: dump: 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.404 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: _finish_auth 0 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: _check_auth_tickets 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: dump: 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.405 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:28:08.110+0000 7f49f4936800 5 monclient: authenticate success, global_id 7217 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:28:08.110+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:28:08.110+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:28:08.110+0000 7f48de60c640 4 set_mon_vals no callback set 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:28:08.110+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:28:08.110+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.406 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:28:08.110+0000 7f49f4936800 1 librados: init done 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:28:08.112+0000 7f48dce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:28:08.112+0000 7f48dce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:28:08.112+0000 7f48dce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:28:08.112+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f48d8076470 auth_method 0 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:28:08.112+0000 7f49efeb6640 10 monclient: get_auth_request con 0x55628a131800 auth_method 0 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:28:08.113+0000 7f49f06b7640 10 monclient: get_auth_request con 0x55628a149370 auth_method 0 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:28:08.114+0000 7f49efeb6640 10 monclient: get_auth_request con 0x55628a14d6d0 auth_method 0 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:28:08.115+0000 7f49f4936800 10 monclient: build_initial_monmap 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:28:08.115+0000 7f49f4936800 1 build_initial for_mkfs: 0 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:28:08.115+0000 7f49f4936800 10 monclient: monmap: 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:08.407 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding auth protocol: cephx 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding auth protocol: cephx 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding auth protocol: cephx 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.408 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:28:08.116+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 asok(0x556289edd630) register_command objecter_requests cmddesc objecter_requests hook 0x55628a1559b0 EEXIST 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient: init 2024-09-12T00:28:08.409 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding auth protocol: cephx 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding auth protocol: cephx 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding auth protocol: cephx 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.410 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:28:08.116+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:28:08.116+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 asok(0x556289edd630) register_command rotate-key cmddesc rotate-key hook 0x55628a150ce0 EEXIST 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-c con 0x55628a179cd0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-b con 0x55628a17a0b0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-a con 0x55628a1789e0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:08.411 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient(hunting): authenticate will time out at 2307.682013s 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): get_auth_request con 0x55628a179cd0 auth_method 0 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.412 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request con 0x55628a1789e0 auth_method 0 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): get_auth_request con 0x55628a17a0b0 auth_method 0 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.413 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): handle_auth_done global_id 7220 payload 824 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient: _finish_hunting 0 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:28:08.117+0000 7f49f06b7640 1 monclient: found mon.noname-c 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: dump: 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.414 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:28:08.117+0000 7f49f4936800 5 monclient: authenticate success, global_id 7220 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:08.415 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: dump: 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:28:08.117+0000 7f49f16b9640 4 set_mon_vals no callback set 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.416 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:28:08.119+0000 7f48d5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:28:08.119+0000 7f48d5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:28:08.119+0000 7f48d5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:28:08.119+0000 7f49efeb6640 10 monclient: get_auth_request con 0x7f48c8076380 auth_method 0 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:28:08.119+0000 7f49f4936800 10 monclient: get_monmap_and_config 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:28:08.119+0000 7f49f4936800 10 monclient: build_initial_monmap 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:28:08.119+0000 7f49f4936800 1 build_initial for_mkfs: 0 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:28:08.119+0000 7f49f4936800 10 monclient: monmap: 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:08.417 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding auth protocol: cephx 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding auth protocol: cephx 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding auth protocol: cephx 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.418 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:28:08.120+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient: init 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding auth protocol: cephx 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding auth protocol: cephx 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding auth protocol: cephx 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.419 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:28:08.120+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:28:08.120+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 asok(0x556289edd630) register_command rotate-key cmddesc rotate-key hook 0x7ffe8f3b3768 EEXIST 2024-09-12T00:28:08.420 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-a con 0x55628a1ce230 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-c con 0x55628a19f240 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-b con 0x55628a1c9710 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): authenticate will time out at 2307.685932s 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): get_auth_request con 0x55628a1ce230 auth_method 0 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.421 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): get_auth_request con 0x55628a19f240 auth_method 0 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): handle_auth_done global_id 7737 payload 274 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient: _finish_hunting 0 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:28:08.121+0000 7f49f06b7640 1 monclient: found mon.noname-a 2024-09-12T00:28:08.422 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: dump: 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.423 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: _finish_auth 0 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: dump: 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.424 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:28:08.121+0000 7f49f4936800 5 monclient: authenticate success, global_id 7737 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:28:08.121+0000 7f49f4936800 10 monclient: get_monmap_and_config success 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:28:08.121+0000 7f49f4936800 4 set_mon_vals no callback set 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:28:08.122+0000 7f49f4936800 10 monclient: shutdown 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:28:08.122+0000 7f49f4936800 10 monclient: build_initial_monmap 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 build_initial for_mkfs: 0 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:28:08.122+0000 7f49f4936800 10 monclient: monmap: 2024-09-12T00:28:08.425 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding auth protocol: cephx 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding auth protocol: cephx 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding auth protocol: cephx 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.426 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:28:08.122+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 librados: starting msgr at 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 librados: starting objecter 2024-09-12T00:28:08.427 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 asok(0x556289edd630) register_command objecter_requests cmddesc objecter_requests hook 0x55628a1ce950 EEXIST 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 librados: setting wanted keys 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 librados: calling monclient init 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:28:08.122+0000 7f49f4936800 10 monclient: init 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding auth protocol: cephx 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding auth protocol: cephx 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding auth protocol: cephx 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.428 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:28:08.122+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:28:08.123+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:28:08.123+0000 7f49f4936800 5 asok(0x556289edd630) register_command rotate-key cmddesc rotate-key hook 0x55628a18e6d8 EEXIST 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-b con 0x55628a19f240 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:08.429 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-a con 0x55628a1c9710 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-c con 0x55628a1ce230 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): authenticate will time out at 2307.688234s 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): get_auth_request con 0x55628a1c9710 auth_method 0 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request con 0x55628a1ce230 auth_method 0 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.430 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): get_auth_request con 0x55628a19f240 auth_method 0 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.431 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_done global_id 7226 payload 824 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient: _finish_hunting 0 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 1 monclient: found mon.noname-c 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: dump: 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.432 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: _finish_auth 0 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: _check_auth_tickets 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:28:08.123+0000 7f49f4936800 5 monclient: authenticate success, global_id 7226 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:08.433 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: dump: 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:28:08.123+0000 7f48cf7fe640 4 set_mon_vals no callback set 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:28:08.124+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:28:08.124+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.434 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:28:08.124+0000 7f49f4936800 1 librados: init done 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:28:08.124+0000 7f49f4936800 5 asok(0x556289edd630) register_command cr dump hook 0x55628a1ba068 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:28:08.125+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:28:08.126+0000 7f48cdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:28:08.126+0000 7f48cdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:28:08.126+0000 7f48cdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:28:08.126+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f48c0076470 auth_method 0 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:28:08.126+0000 7f49efeb6640 10 monclient: get_auth_request con 0x55628a1e8730 auth_method 0 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 realm 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:28:08.127+0000 7f49f4936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.435 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:28:08.127+0000 7f49f06b7640 10 monclient: get_auth_request con 0x55628a1ec9c0 auth_method 0 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:28:08.128+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:28:08.128+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:28:08.128+0000 7f49efeb6640 10 monclient: get_auth_request con 0x55628a1f0220 auth_method 0 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:28:08.129+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:28:08.129+0000 7f49f4936800 20 searching for the correct realm 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:28:08.129+0000 7f49f0eb8640 10 monclient: get_auth_request con 0x55628a1f4d10 auth_method 0 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:28:08.130+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f49e802a030 auth_method 0 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:28:08.131+0000 7f49efeb6640 10 monclient: get_auth_request con 0x7f49e00b5380 auth_method 0 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:28:08.131+0000 7f49efeb6640 0 -- 172.21.15.33:0/427799938 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f49e00b5380 msgr2=0x7f49e00b5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:28:08.131+0000 7f48cdffb640 1 client.7226.objecter ms_handle_reset 0x7f49e00b5380 session 0x7f49e00c9040 osd.2 2024-09-12T00:28:08.436 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:28:08.131+0000 7f48cdffb640 10 monclient: _renew_subs 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:28:08.131+0000 7f48cdffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:28:08.131+0000 7f49efeb6640 10 monclient: get_auth_request con 0x7f48c0086ba0 auth_method 0 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:28:08.132+0000 7f49f0eb8640 10 monclient: get_auth_request con 0x7f49e402d040 auth_method 0 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:28:08.135+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f49e402d420 auth_method 0 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:28:08.135+0000 7f49f06b7640 0 -- 172.21.15.33:0/427799938 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f49e402d420 msgr2=0x7f49e402d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:28:08.336+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f49e402d420 auth_method 0 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.437 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 zone default found 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:28:08.343+0000 7f49f4936800 4 Realm: () 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:28:08.343+0000 7f49f4936800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:28:08.343+0000 7f49f4936800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:28:08.343+0000 7f49f4936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 zonegroup default 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.438 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.439 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.439 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.439 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.439 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.439 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 started sync module instance, tier type = 2024-09-12T00:28:08.439 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=0 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=1 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=2 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=3 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=4 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=5 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=6 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:28:08.354+0000 7f49f4936800 20 add_watcher() i=7 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:28:08.354+0000 7f49f4936800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding auth protocol: cephx 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding auth protocol: cephx 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding auth protocol: cephx 2024-09-12T00:28:08.440 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:28:08.356+0000 7f48a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:28:08.356+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.441 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command cache list hook 0x55628a1bf960 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command cache inspect hook 0x55628a1bf960 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command cache erase hook 0x55628a1bf960 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command cache zap hook 0x55628a1bf960 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 note: GC not initialized 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:28:08.356+0000 7f48a57e2640 20 reqs_thread_entry: start 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command sync trace show hook 0x7f49e0078070 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command sync trace history hook 0x7f49e0078070 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command sync trace active hook 0x7f49e0078070 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command sync trace active_short hook 0x7f49e0078070 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:08.442 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 Filter name: none 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:28:08.356+0000 7f4816ffd640 20 reqs_thread_entry: start 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:28:08.356+0000 7f49f4936800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 : miss 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.443 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:28:08.362+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:28:08.362+0000 7f49f4936800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:28:08.362+0000 7f49f4936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:28:08.362+0000 7f49f4936800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37, ofs0, ns] 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 93881712501040 notifier 7226 bl.length()=1007 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_sources= new_sources= 2024-09-12T00:28:08.444 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential sources added=[] removed=[] 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_dests= new_dests= 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential dests added=[] removed=[] 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:28:08.368+0000 7f49f4936800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f49f4936800 time 2024-09-12T00:28:08.368907+0000 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f49f618c71a] 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f49f618c8d8] 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556288659641] 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd8854c) [0x556288b6c54c] 2024-09-12T00:28:08.445 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55628866931d] 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f49f4e29590] 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:28:08.369+0000 7f49f4936800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f49f4936800 thread_name:radosgw-admin 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f49f4e3e6f0] 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f49f4e8b99c] 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:28:08.446 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f49f618c774] 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f49f618c8d8] 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556288659641] 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd8854c) [0x556288b6c54c] 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55628866931d] 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f49f4e29590] 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:28:08.447 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:28:08.448 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:28:08.449 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:28:08.450 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:28:08.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:28:08.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:28:08.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:28:08.454 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f4816ffd640 / http_manager 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48a57e2640 / http_manager 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48a67e4640 / rgw_dt_lg_renew 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48cdffb640 / ms_dispatch 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48cf7fe640 / io_context_pool 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48d5ffb640 / ms_dispatch 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48dce09640 / ms_dispatch 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48de60c640 / io_context_pool 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49efeb6640 / msgr-worker-2 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49f06b7640 / msgr-worker-1 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49f0eb8640 / msgr-worker-0 2024-09-12T00:28:08.455 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49f16b9640 / io_context_pool 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49f4936800 / radosgw-admin 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.133965.log 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:28:08.107+0000 7f48de60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:28:08.107+0000 7f48de60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:28:08.107+0000 7f48de60c640 10 monclient: dump: 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.456 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:28:08.108+0000 7f49f4936800 10 monclient: shutdown 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 asok(0x556289edd630) unregister_commands rotate-key 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:28:08.108+0000 7f49f4936800 10 monclient: build_initial_monmap 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 build_initial for_mkfs: 0 2024-09-12T00:28:08.457 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:28:08.108+0000 7f49f4936800 10 monclient: monmap: 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding auth protocol: cephx 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding auth protocol: cephx 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding auth protocol: cephx 2024-09-12T00:28:08.458 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: crc 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a103a60) adding con mode: secure 2024-09-12T00:28:08.459 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:28:08.108+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 librados: starting msgr at 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 librados: starting objecter 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 asok(0x556289edd630) register_command objecter_requests hook 0x55628a048460 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 librados: setting wanted keys 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:28:08.108+0000 7f49f4936800 1 librados: calling monclient init 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:28:08.108+0000 7f49f4936800 10 monclient: init 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding auth protocol: cephx 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding auth protocol: cephx 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding auth protocol: cephx 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.460 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: crc 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:28:08.108+0000 7f49f4936800 5 AuthRegistry(0x55628a0fdf40) adding con mode: secure 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:28:08.109+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:28:08.109+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.461 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:28:08.109+0000 7f49f4936800 5 asok(0x556289edd630) register_command rotate-key hook 0x55628a0fe088 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-a con 0x556289fb7340 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-b con 0x55628a040e70 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-c con 0x55628a0412a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:28:08.109+0000 7f49f4936800 10 monclient(hunting): authenticate will time out at 2307.674431s 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request con 0x55628a0412a0 auth_method 0 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.462 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): get_auth_request con 0x556289fb7340 auth_method 0 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): get_auth_request con 0x55628a040e70 auth_method 0 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.463 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:28:08.109+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:28:08.109+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_done global_id 7217 payload 824 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient: _finish_hunting 0 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 1 monclient: found mon.noname-c 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:28:08.109+0000 7f49f0eb8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: dump: 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.464 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: _finish_auth 0 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: _check_auth_tickets 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.465 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:08.466 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:28:08.110+0000 7f48dce09640 10 monclient: dump: 2024-09-12T00:28:08.466 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.466 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.466 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.466 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.466 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.466 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.466 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:28:08.110+0000 7f49f4936800 5 monclient: authenticate success, global_id 7217 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:28:08.110+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:28:08.110+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:28:08.110+0000 7f48de60c640 4 set_mon_vals no callback set 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:28:08.110+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:28:08.110+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.467 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:28:08.110+0000 7f49f4936800 1 librados: init done 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:28:08.112+0000 7f48dce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:28:08.112+0000 7f48dce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:28:08.112+0000 7f48dce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:28:08.112+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f48d8076470 auth_method 0 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:28:08.112+0000 7f49efeb6640 10 monclient: get_auth_request con 0x55628a131800 auth_method 0 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:28:08.113+0000 7f49f06b7640 10 monclient: get_auth_request con 0x55628a149370 auth_method 0 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:28:08.114+0000 7f49efeb6640 10 monclient: get_auth_request con 0x55628a14d6d0 auth_method 0 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:28:08.115+0000 7f49f4936800 10 monclient: build_initial_monmap 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:28:08.115+0000 7f49f4936800 1 build_initial for_mkfs: 0 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:28:08.115+0000 7f49f4936800 10 monclient: monmap: 2024-09-12T00:28:08.468 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:08.469 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:08.469 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:08.469 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:08.469 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:08.469 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.469 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:08.469 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:08.469 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding auth protocol: cephx 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding auth protocol: cephx 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding auth protocol: cephx 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.470 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: crc 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:28:08.115+0000 7f49f4936800 5 AuthRegistry(0x55628a1524c0) adding con mode: secure 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:28:08.116+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 asok(0x556289edd630) register_command objecter_requests cmddesc objecter_requests hook 0x55628a1559b0 EEXIST 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient: init 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding auth protocol: cephx 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding auth protocol: cephx 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding auth protocol: cephx 2024-09-12T00:28:08.471 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: crc 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 AuthRegistry(0x55628a150b98) adding con mode: secure 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:28:08.116+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.472 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:28:08.116+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.473 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:28:08.116+0000 7f49f4936800 5 asok(0x556289edd630) register_command rotate-key cmddesc rotate-key hook 0x55628a150ce0 EEXIST 2024-09-12T00:28:08.473 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:08.473 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:28:08.473 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-c con 0x55628a179cd0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:08.473 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-b con 0x55628a17a0b0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:08.473 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-a con 0x55628a1789e0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:08.473 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.473 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:28:08.116+0000 7f49f4936800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient(hunting): authenticate will time out at 2307.682013s 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): get_auth_request con 0x55628a179cd0 auth_method 0 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request con 0x55628a1789e0 auth_method 0 2024-09-12T00:28:08.474 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:28:08.117+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): get_auth_request con 0x55628a17a0b0 auth_method 0 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.475 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:28:08.117+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient(hunting): handle_auth_done global_id 7220 payload 824 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient: _finish_hunting 0 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:28:08.117+0000 7f49f06b7640 1 monclient: found mon.noname-c 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:28:08.117+0000 7f49f06b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: dump: 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.476 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:28:08.117+0000 7f49f4936800 5 monclient: authenticate success, global_id 7220 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.477 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:28:08.117+0000 7f48d5ffb640 10 monclient: dump: 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.478 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:28:08.117+0000 7f49f16b9640 4 set_mon_vals no callback set 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:28:08.117+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:28:08.119+0000 7f48d5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:28:08.119+0000 7f48d5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:28:08.119+0000 7f48d5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:28:08.119+0000 7f49efeb6640 10 monclient: get_auth_request con 0x7f48c8076380 auth_method 0 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:28:08.119+0000 7f49f4936800 10 monclient: get_monmap_and_config 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:28:08.119+0000 7f49f4936800 10 monclient: build_initial_monmap 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:28:08.119+0000 7f49f4936800 1 build_initial for_mkfs: 0 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:28:08.119+0000 7f49f4936800 10 monclient: monmap: 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:08.479 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding auth protocol: cephx 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding auth protocol: cephx 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding auth protocol: cephx 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.480 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: crc 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:28:08.119+0000 7f49f4936800 5 AuthRegistry(0x55628a199bd0) adding con mode: secure 2024-09-12T00:28:08.481 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:28:08.120+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient: init 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding auth protocol: cephx 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding auth protocol: cephx 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding auth protocol: cephx 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.482 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: crc 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3620) adding con mode: secure 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:28:08.120+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:28:08.120+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:28:08.120+0000 7f49f4936800 5 asok(0x556289edd630) register_command rotate-key cmddesc rotate-key hook 0x7ffe8f3b3768 EEXIST 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-a con 0x55628a1ce230 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-c con 0x55628a19f240 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-b con 0x55628a1c9710 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.483 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:28:08.120+0000 7f49f4936800 10 monclient(hunting): authenticate will time out at 2307.685932s 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): get_auth_request con 0x55628a1ce230 auth_method 0 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): get_auth_request con 0x55628a19f240 auth_method 0 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.484 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:28:08.121+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient(hunting): handle_auth_done global_id 7737 payload 274 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient: _finish_hunting 0 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:28:08.121+0000 7f49f06b7640 1 monclient: found mon.noname-a 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:28:08.121+0000 7f49f06b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: dump: 2024-09-12T00:28:08.485 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: _finish_auth 0 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:08.486 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:28:08.121+0000 7f48cf7fe640 10 monclient: dump: 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.487 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:28:08.121+0000 7f49f4936800 5 monclient: authenticate success, global_id 7737 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:28:08.121+0000 7f49f4936800 10 monclient: get_monmap_and_config success 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:28:08.121+0000 7f49f4936800 4 set_mon_vals no callback set 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:28:08.122+0000 7f49f4936800 10 monclient: shutdown 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:28:08.122+0000 7f49f4936800 10 monclient: build_initial_monmap 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 build_initial for_mkfs: 0 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:28:08.122+0000 7f49f4936800 10 monclient: monmap: 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.488 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding auth protocol: cephx 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding auth protocol: cephx 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding auth protocol: cephx 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.489 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: crc 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a1bfe60) adding con mode: secure 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:28:08.122+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 librados: starting msgr at 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 librados: starting objecter 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 asok(0x556289edd630) register_command objecter_requests cmddesc objecter_requests hook 0x55628a1ce950 EEXIST 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 librados: setting wanted keys 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:28:08.122+0000 7f49f4936800 1 librados: calling monclient init 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:28:08.122+0000 7f49f4936800 10 monclient: init 2024-09-12T00:28:08.490 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding auth protocol: cephx 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding auth protocol: cephx 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding auth protocol: cephx 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: crc 2024-09-12T00:28:08.491 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:28:08.122+0000 7f49f4936800 5 AuthRegistry(0x55628a18e590) adding con mode: secure 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:28:08.122+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:28:08.123+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:28:08.123+0000 7f49f4936800 5 asok(0x556289edd630) register_command rotate-key cmddesc rotate-key hook 0x55628a18e6d8 EEXIST 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-b con 0x55628a19f240 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-a con 0x55628a1c9710 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): picked mon.noname-c con 0x55628a1ce230 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:08.492 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient(hunting): authenticate will time out at 2307.688234s 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): get_auth_request con 0x55628a1c9710 auth_method 0 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request con 0x55628a1ce230 auth_method 0 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.493 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.494 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:28:08.123+0000 7f49efeb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.494 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.494 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.494 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.494 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): get_auth_request con 0x55628a19f240 auth_method 0 2024-09-12T00:28:08.494 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:08.494 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:08.494 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:28:08.123+0000 7f49f06b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient(hunting): handle_auth_done global_id 7226 payload 824 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient: _finish_hunting 0 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 1 monclient: found mon.noname-c 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:28:08.123+0000 7f49f0eb8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: dump: 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.495 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.496 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.496 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.496 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.496 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.496 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.496 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.496 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.496 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.497 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: _finish_auth 0 2024-09-12T00:28:08.497 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: _check_auth_tickets 2024-09-12T00:28:08.497 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:28:08.123+0000 7f49f4936800 5 monclient: authenticate success, global_id 7226 2024-09-12T00:28:08.497 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.497 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:28:08.123+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:28:08.123+0000 7f48cdffb640 10 monclient: dump: 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:08.498 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:28:08.123+0000 7f48cf7fe640 4 set_mon_vals no callback set 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:28:08.124+0000 7f49f4936800 10 monclient: _renew_subs 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:28:08.124+0000 7f49f4936800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:28:08.124+0000 7f49f4936800 1 librados: init done 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:28:08.124+0000 7f49f4936800 5 asok(0x556289edd630) register_command cr dump hook 0x55628a1ba068 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:28:08.125+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:28:08.126+0000 7f48cdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:28:08.126+0000 7f48cdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:28:08.126+0000 7f48cdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:28:08.126+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f48c0076470 auth_method 0 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:28:08.126+0000 7f49efeb6640 10 monclient: get_auth_request con 0x55628a1e8730 auth_method 0 2024-09-12T00:28:08.499 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 realm 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:28:08.127+0000 7f49f4936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:28:08.127+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:28:08.127+0000 7f49f06b7640 10 monclient: get_auth_request con 0x55628a1ec9c0 auth_method 0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:28:08.128+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:28:08.128+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:28:08.128+0000 7f49efeb6640 10 monclient: get_auth_request con 0x55628a1f0220 auth_method 0 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:28:08.129+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:08.500 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:28:08.129+0000 7f49f4936800 20 searching for the correct realm 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:28:08.129+0000 7f49f0eb8640 10 monclient: get_auth_request con 0x55628a1f4d10 auth_method 0 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:28:08.130+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f49e802a030 auth_method 0 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:28:08.131+0000 7f49efeb6640 10 monclient: get_auth_request con 0x7f49e00b5380 auth_method 0 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:28:08.131+0000 7f49efeb6640 0 -- 172.21.15.33:0/427799938 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f49e00b5380 msgr2=0x7f49e00b5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:28:08.131+0000 7f48cdffb640 1 client.7226.objecter ms_handle_reset 0x7f49e00b5380 session 0x7f49e00c9040 osd.2 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:28:08.131+0000 7f48cdffb640 10 monclient: _renew_subs 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:28:08.131+0000 7f48cdffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:28:08.131+0000 7f49efeb6640 10 monclient: get_auth_request con 0x7f48c0086ba0 auth_method 0 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:28:08.132+0000 7f49f0eb8640 10 monclient: get_auth_request con 0x7f49e402d040 auth_method 0 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:28:08.135+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f49e402d420 auth_method 0 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:28:08.135+0000 7f49f06b7640 0 -- 172.21.15.33:0/427799938 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f49e402d420 msgr2=0x7f49e402d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.501 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:28:08.336+0000 7f49f06b7640 10 monclient: get_auth_request con 0x7f49e402d420 auth_method 0 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:28:08.342+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:08.502 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 zone default found 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:28:08.343+0000 7f49f4936800 4 Realm: () 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:28:08.343+0000 7f49f4936800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:28:08.343+0000 7f49f4936800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:28:08.343+0000 7f49f4936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 zonegroup default 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:28:08.343+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 started sync module instance, tier type = 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:28:08.344+0000 7f49f4936800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:08.503 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=0 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=1 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=2 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=3 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=4 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=5 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:28:08.353+0000 7f49f4936800 20 add_watcher() i=6 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:28:08.354+0000 7f49f4936800 20 add_watcher() i=7 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:28:08.354+0000 7f49f4936800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding auth protocol: cephx 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding auth protocol: cephx 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding auth protocol: cephx 2024-09-12T00:28:08.504 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: crc 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:28:08.356+0000 7f48a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 AuthRegistry(0x7ffe8f3b3b00) adding con mode: secure 2024-09-12T00:28:08.505 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:28:08.356+0000 7f49f4936800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command cache list hook 0x55628a1bf960 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command cache inspect hook 0x55628a1bf960 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command cache erase hook 0x55628a1bf960 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command cache zap hook 0x55628a1bf960 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 note: GC not initialized 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:28:08.356+0000 7f48a57e2640 20 reqs_thread_entry: start 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command sync trace show hook 0x7f49e0078070 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command sync trace history hook 0x7f49e0078070 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command sync trace active hook 0x7f49e0078070 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:28:08.356+0000 7f49f4936800 5 asok(0x556289edd630) register_command sync trace active_short hook 0x7f49e0078070 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:08.506 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 Filter name: none 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:28:08.356+0000 7f4816ffd640 20 reqs_thread_entry: start 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:28:08.356+0000 7f49f4936800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:28:08.356+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 : miss 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:28:08.357+0000 7f49f4936800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:08.507 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:28:08.357+0000 7f49f4936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:28:08.362+0000 7f49f4936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:28:08.362+0000 7f49f4936800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:28:08.362+0000 7f49f4936800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:28:08.362+0000 7f49f4936800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37, ofs0, ns] 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 93881712501040 notifier 7226 bl.length()=1007 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:28:08.363+0000 7f48cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_sources= new_sources= 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential sources added=[] removed=[] 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_dests= new_dests= 2024-09-12T00:28:08.508 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:28:08.364+0000 7f49f4936800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential dests added=[] removed=[] 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:28:08.368+0000 7f49f4936800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f49f4936800 time 2024-09-12T00:28:08.368907+0000 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f49f618c71a] 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f49f618c8d8] 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556288659641] 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd8854c) [0x556288b6c54c] 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55628866931d] 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f49f4e29590] 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:28:08.509 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:28:08.369+0000 7f49f4936800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f49f4936800 thread_name:radosgw-admin 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f49f4e3e6f0] 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f49f4e8b99c] 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f49f618c774] 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f49f618c8d8] 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556288659641] 2024-09-12T00:28:08.510 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd8854c) [0x556288b6c54c] 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55628866931d] 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f49f4e29590] 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:28:08.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:28:08.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:28:08.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:28:08.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:28:08.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:28:08.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:28:08.517 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f4816ffd640 / http_manager 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48a57e2640 / http_manager 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48a67e4640 / rgw_dt_lg_renew 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48cdffb640 / ms_dispatch 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48cf7fe640 / io_context_pool 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48d5ffb640 / ms_dispatch 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48dce09640 / ms_dispatch 2024-09-12T00:28:08.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f48de60c640 / io_context_pool 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49efeb6640 / msgr-worker-2 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49f06b7640 / msgr-worker-1 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49f0eb8640 / msgr-worker-0 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49f16b9640 / io_context_pool 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr: 7f49f4936800 / radosgw-admin 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:28:08.370586Z_525c093a-65b6-4e08-adc6-a5c6a8e99257/log 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:28:08.519 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:28:08.524 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:08.524 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:08.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.447+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.449+0000 7ff0a9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.449+0000 7ff0a9f28800 20 realm 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.449+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.450+0000 7ff0a9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.450+0000 7ff0a9f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.450+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.450+0000 7ff0a9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.450+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.451+0000 7ff0a9f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.451+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.451+0000 7ff0a9f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.451+0000 7ff0a9f28800 20 searching for the correct realm 2024-09-12T00:28:08.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.454+0000 7ff0a644c640 0 -- 172.21.15.33:0/3104364347 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x563d6214fb40 msgr2=0x563d62152000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.458+0000 7ff0a5c4b640 0 -- 172.21.15.33:0/3104364347 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7ff09c084420 msgr2=0x7ff09c084880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.462+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 20 zone default found 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 4 Realm: () 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 20 zonegroup default 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.463+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.464+0000 7ff0a9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.464+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.464+0000 7ff0a9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.464+0000 7ff0a9f28800 20 started sync module instance, tier type = 2024-09-12T00:28:08.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.464+0000 7ff0a9f28800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.472+0000 7ff0a9f28800 20 add_watcher() i=0 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.472+0000 7ff0a9f28800 20 add_watcher() i=1 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.472+0000 7ff0a9f28800 20 add_watcher() i=2 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.472+0000 7ff0a9f28800 20 add_watcher() i=3 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.472+0000 7ff0a9f28800 20 add_watcher() i=4 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.472+0000 7ff0a9f28800 20 add_watcher() i=5 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.473+0000 7ff0a9f28800 20 add_watcher() i=6 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.473+0000 7ff0a9f28800 20 add_watcher() i=7 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.473+0000 7ff0a9f28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.475+0000 7fef577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.476+0000 7ff0a9f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.476+0000 7ff0a9f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:08.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.476+0000 7ff0a9f28800 5 note: GC not initialized 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.476+0000 7fef567fc640 20 reqs_thread_entry: start 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.476+0000 7ff0a9f28800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.476+0000 7ff0a9f28800 20 Filter name: none 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.476+0000 7feec7fff640 20 reqs_thread_entry: start 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.476+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.477+0000 7ff0a9f28800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.477+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.477+0000 7ff0a9f28800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.477+0000 7ff0a9f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.477+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.478+0000 7ff0a9f28800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.478+0000 7ff0a9f28800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.478+0000 7ff0a9f28800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:28:08.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.478+0000 7ff0a9f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.480+0000 7fef577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.482+0000 7ff0a9f28800 20 remove_watcher() i=0 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.482+0000 7ff0a9f28800 2 removed watcher, disabling cache 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.483+0000 7ff0a9f28800 20 remove_watcher() i=1 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.484+0000 7ff0a9f28800 20 remove_watcher() i=2 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.485+0000 7ff0a9f28800 20 remove_watcher() i=3 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.486+0000 7ff0a9f28800 20 remove_watcher() i=4 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.487+0000 7ff0a9f28800 20 remove_watcher() i=5 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.488+0000 7ff0a9f28800 20 remove_watcher() i=6 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.489+0000 7ff0a9f28800 20 remove_watcher() i=7 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-logrecord-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:08.530 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:08.531 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:08.531 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:08.531 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:08.531 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:08.591 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:28:08.623 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:08.623 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:08.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.664+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.665+0000 7fcbb3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.665+0000 7fcbb3f2f800 20 realm 2024-09-12T00:28:08.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.665+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.666+0000 7fcbb3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.666+0000 7fcbb3f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:08.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.666+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.666+0000 7fcbb3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.666+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.667+0000 7fcbb3f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.667+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.668+0000 7fcbb3f2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:08.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.668+0000 7fcbb3f2f800 20 searching for the correct realm 2024-09-12T00:28:08.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.671+0000 7fcbb0477640 0 -- 172.21.15.33:0/2581257051 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55f5ea6a76c0 msgr2=0x55f5ea6a9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.672 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.674+0000 7fcbafc76640 0 -- 172.21.15.33:0/2581257051 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fcba4047aa0 msgr2=0x7fcba402b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:08.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.678+0000 7fcbb3f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:08.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.678+0000 7fcbb3f2f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:08.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.678+0000 7fcbb3f2f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:08.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.678+0000 7fcbb3f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:08.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.678+0000 7fcbb3f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:08.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.678+0000 7fcbb3f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:08.677 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.678+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.678 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 zone default found 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 4 Realm: () 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 zonegroup default 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.679+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.680+0000 7fcbb3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.680+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.680+0000 7fcbb3f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:08.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.680+0000 7fcbb3f2f800 20 started sync module instance, tier type = 2024-09-12T00:28:08.680 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.680+0000 7fcbb3f2f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:08.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.689+0000 7fcbb3f2f800 20 add_watcher() i=0 2024-09-12T00:28:08.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.689+0000 7fcbb3f2f800 20 add_watcher() i=1 2024-09-12T00:28:08.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.689+0000 7fcbb3f2f800 20 add_watcher() i=2 2024-09-12T00:28:08.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.689+0000 7fcbb3f2f800 20 add_watcher() i=3 2024-09-12T00:28:08.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.689+0000 7fcbb3f2f800 20 add_watcher() i=4 2024-09-12T00:28:08.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.689+0000 7fcbb3f2f800 20 add_watcher() i=5 2024-09-12T00:28:08.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.689+0000 7fcbb3f2f800 20 add_watcher() i=6 2024-09-12T00:28:08.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.690+0000 7fcbb3f2f800 20 add_watcher() i=7 2024-09-12T00:28:08.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.690+0000 7fcbb3f2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:08.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.692+0000 7fca65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.692+0000 7fcbb3f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:08.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.692+0000 7fcbb3f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:08.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.692+0000 7fcbb3f2f800 5 note: GC not initialized 2024-09-12T00:28:08.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fca64fe1640 20 reqs_thread_entry: start 2024-09-12T00:28:08.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:08.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 20 Filter name: none 2024-09-12T00:28:08.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fc9de7fc640 20 reqs_thread_entry: start 2024-09-12T00:28:08.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:28:08.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 : miss 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.693+0000 7fcbb3f2f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.694+0000 7fcbb3f2f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.694+0000 7fcbb3f2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.694+0000 7fcbb3f2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.694+0000 7fcbb3f2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.694+0000 7fcbb3f2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:08.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.694+0000 7fcbb3f2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 2024-09-12T00:28:08.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.695+0000 7fcbb3f2f800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to be held by another RGW process; skipping for now 2024-09-12T00:28:08.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.696+0000 7fca65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:08.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.699+0000 7fcbb3f2f800 20 remove_watcher() i=0 2024-09-12T00:28:08.697 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.699+0000 7fcbb3f2f800 2 removed watcher, disabling cache 2024-09-12T00:28:08.698 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.700+0000 7fcbb3f2f800 20 remove_watcher() i=1 2024-09-12T00:28:08.699 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.701+0000 7fcbb3f2f800 20 remove_watcher() i=2 2024-09-12T00:28:08.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.702+0000 7fcbb3f2f800 20 remove_watcher() i=3 2024-09-12T00:28:08.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.703+0000 7fcbb3f2f800 20 remove_watcher() i=4 2024-09-12T00:28:08.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.704+0000 7fcbb3f2f800 20 remove_watcher() i=5 2024-09-12T00:28:08.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.705+0000 7fcbb3f2f800 20 remove_watcher() i=6 2024-09-12T00:28:08.704 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:08.706+0000 7fcbb3f2f800 20 remove_watcher() i=7 2024-09-12T00:28:08.715 INFO:tasks.workunit.client.0.smithi033.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:28:38.732 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:28:38.768 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:38.769 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:38.815 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.816+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.818+0000 7f5d61a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.818+0000 7f5d61a17800 20 realm 2024-09-12T00:28:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.818+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.818+0000 7f5d61a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.818+0000 7f5d61a17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.818+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.818+0000 7f5d61a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:38.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.818+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:38.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.819+0000 7f5d61a17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:38.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.819+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:38.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.820+0000 7f5d61a17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:38.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.820+0000 7f5d61a17800 20 searching for the correct realm 2024-09-12T00:28:38.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.823+0000 7f5d5c9e6640 0 -- 172.21.15.33:0/1983843406 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55726c85d460 msgr2=0x55726c85f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:38.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:38.828+0000 7f5d5d1e7640 0 -- 172.21.15.33:0/1983843406 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f5d540b62a0 msgr2=0x7f5d540cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:39.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:39.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:39.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.035+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:39.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 20 zone default found 2024-09-12T00:28:39.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 4 Realm: () 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 20 zonegroup default 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.036+0000 7f5d61a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.037+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.037+0000 7f5d61a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.037+0000 7f5d61a17800 20 started sync module instance, tier type = 2024-09-12T00:28:39.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.037+0000 7f5d61a17800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.047+0000 7f5d61a17800 20 add_watcher() i=0 2024-09-12T00:28:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.047+0000 7f5d61a17800 20 add_watcher() i=1 2024-09-12T00:28:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.047+0000 7f5d61a17800 20 add_watcher() i=2 2024-09-12T00:28:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.047+0000 7f5d61a17800 20 add_watcher() i=3 2024-09-12T00:28:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.047+0000 7f5d61a17800 20 add_watcher() i=4 2024-09-12T00:28:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.047+0000 7f5d61a17800 20 add_watcher() i=5 2024-09-12T00:28:39.046 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.048+0000 7f5d61a17800 20 add_watcher() i=6 2024-09-12T00:28:39.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.048+0000 7f5d61a17800 20 add_watcher() i=7 2024-09-12T00:28:39.047 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.048+0000 7f5d61a17800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:39.050 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.051+0000 7f5c137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.052+0000 7f5d61a17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.052+0000 7f5d61a17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.052+0000 7f5d61a17800 5 note: GC not initialized 2024-09-12T00:28:39.051 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.052+0000 7f5c127e4640 20 reqs_thread_entry: start 2024-09-12T00:28:39.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.052+0000 7f5d61a17800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:39.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.052+0000 7f5d61a17800 20 Filter name: none 2024-09-12T00:28:39.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.053+0000 7f5b83fff640 20 reqs_thread_entry: start 2024-09-12T00:28:39.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.053+0000 7f5d61a17800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:28:39.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.053+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.053+0000 7f5d61a17800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.053+0000 7f5d61a17800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.053+0000 7f5d61a17800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.053+0000 7f5d61a17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 : miss 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.053+0000 7f5d61a17800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.054+0000 7f5d61a17800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.054+0000 7f5d61a17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.054+0000 7f5d61a17800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.054+0000 7f5d61a17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.054+0000 7f5d61a17800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:39.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.054+0000 7f5d61a17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 2024-09-12T00:28:39.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.055+0000 7f5d61a17800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:28:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.064+0000 7f5d61a17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.064+0000 7f5d61a17800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.064+0000 7f5d61a17800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.064+0000 7f5d61a17800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37, ofs0, ns] 2024-09-12T00:28:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.064+0000 7f5c40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 93949935392016 notifier 7280 bl.length()=1007 2024-09-12T00:28:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.065+0000 7f5c40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.065+0000 7f5c40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:39.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.065+0000 7f5c40ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.066+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_sources= new_sources= 2024-09-12T00:28:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.066+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential sources added=[] removed=[] 2024-09-12T00:28:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.066+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_dests= new_dests= 2024-09-12T00:28:39.065 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.066+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential dests added=[] removed=[] 2024-09-12T00:28:39.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.0 2024-09-12T00:28:39.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.0 2024-09-12T00:28:39.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.1 2024-09-12T00:28:39.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.1 2024-09-12T00:28:39.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.2 2024-09-12T00:28:39.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.2 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.3 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.3 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.4 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.4 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.5 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.5 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.6 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.6 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.7 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.7 2024-09-12T00:28:39.071 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.8 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.8 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.9 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.9 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.10 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.10 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.11 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2.11 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.071+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.0 2024-09-12T00:28:39.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.072+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.1 2024-09-12T00:28:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.072+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2 2024-09-12T00:28:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.073+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.3 2024-09-12T00:28:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.073+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.4 2024-09-12T00:28:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.074+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.5 2024-09-12T00:28:39.073 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.074+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.6 2024-09-12T00:28:39.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.075+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.7 2024-09-12T00:28:39.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.076+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.8 2024-09-12T00:28:39.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.077+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.9 2024-09-12T00:28:39.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.077+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.10 2024-09-12T00:28:39.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.080+0000 7f5d61a17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:39.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.080+0000 7f5d61a17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 2024-09-12T00:28:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.082+0000 7f5d61a17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.082+0000 7f5d61a17800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.082+0000 7f5d61a17800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:39.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.082+0000 7f5d61a17800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37, ofs0, ns] 2024-09-12T00:28:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.082+0000 7f5c40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 93949935392016 notifier 7280 bl.length()=1007 2024-09-12T00:28:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.082+0000 7f5c40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.082+0000 7f5c40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:39.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.082+0000 7f5c40ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:39.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.084+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_sources= new_sources= 2024-09-12T00:28:39.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.084+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential sources added=[] removed=[] 2024-09-12T00:28:39.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.084+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_dests= new_dests= 2024-09-12T00:28:39.082 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.084+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential dests added=[] removed=[] 2024-09-12T00:28:39.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.086+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.0 2024-09-12T00:28:39.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.087+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.1 2024-09-12T00:28:39.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.087+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.2 2024-09-12T00:28:39.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.087+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.3 2024-09-12T00:28:39.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.088+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.4 2024-09-12T00:28:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.088+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.5 2024-09-12T00:28:39.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.089+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.6 2024-09-12T00:28:39.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.089+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.7 2024-09-12T00:28:39.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.090+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.8 2024-09-12T00:28:39.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.090+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.9 2024-09-12T00:28:39.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.091+0000 7f5d61a17800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37.10 2024-09-12T00:28:39.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.091+0000 7f5d61a17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:39.090 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.091+0000 7f5d61a17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 2024-09-12T00:28:39.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.093+0000 7f5d61a17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:39.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.093+0000 7f5d61a17800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:39.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.093+0000 7f5d61a17800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:39.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.093+0000 7f5d61a17800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37, ofs0, ns] 2024-09-12T00:28:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.093+0000 7f5c2ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 93949935392016 notifier 7280 bl.length()=975 2024-09-12T00:28:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.093+0000 7f5c2ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 info.flags=0x17 2024-09-12T00:28:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.093+0000 7f5c2ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 to cache LRU end 2024-09-12T00:28:39.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.093+0000 7f5c2ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:39.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.095+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_sources= new_sources= 2024-09-12T00:28:39.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.095+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential sources added=[] removed=[] 2024-09-12T00:28:39.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.095+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): orig_dests= new_dests= 2024-09-12T00:28:39.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.095+0000 7f5d61a17800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37]): potential dests added=[] removed=[] 2024-09-12T00:28:39.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.099+0000 7f5d61a17800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:28:39.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.101+0000 7f5c137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.103+0000 7f5d61a17800 20 remove_watcher() i=0 2024-09-12T00:28:39.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.103+0000 7f5d61a17800 2 removed watcher, disabling cache 2024-09-12T00:28:39.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.105+0000 7f5d61a17800 20 remove_watcher() i=1 2024-09-12T00:28:39.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.106+0000 7f5d61a17800 20 remove_watcher() i=2 2024-09-12T00:28:39.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.107+0000 7f5d61a17800 20 remove_watcher() i=3 2024-09-12T00:28:39.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.108+0000 7f5d61a17800 20 remove_watcher() i=4 2024-09-12T00:28:39.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.109+0000 7f5d61a17800 20 remove_watcher() i=5 2024-09-12T00:28:39.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.110+0000 7f5d61a17800 20 remove_watcher() i=6 2024-09-12T00:28:39.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.111+0000 7f5d61a17800 20 remove_watcher() i=7 2024-09-12T00:28:39.122 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:28:39.153 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:39.153 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:39.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.193+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.195+0000 7f0614e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.195+0000 7f0614e14800 20 realm 2024-09-12T00:28:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.195+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.195+0000 7f0614e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.195+0000 7f0614e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.195+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.196+0000 7f0614e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.196+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.197+0000 7f0614e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:39.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.197+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.197+0000 7f0614e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:39.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.197+0000 7f0614e14800 20 searching for the correct realm 2024-09-12T00:28:39.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.201+0000 7f060fcca640 0 -- 172.21.15.33:0/43028142 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5577b35fb710 msgr2=0x5577b35fdb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:39.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.205+0000 7f060fcca640 0 -- 172.21.15.33:0/43028142 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x7f04d8086ba0 msgr2=0x7f04d8088fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:39.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:39.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:39.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:39.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:39.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:39.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:39.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:39.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.209+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:39.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 20 zone default found 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 4 Realm: () 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 20 zonegroup default 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.210+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.211+0000 7f0614e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.211+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.211+0000 7f0614e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:39.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.211+0000 7f0614e14800 20 started sync module instance, tier type = 2024-09-12T00:28:39.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.211+0000 7f0614e14800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:39.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.220+0000 7f0614e14800 20 add_watcher() i=0 2024-09-12T00:28:39.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.220+0000 7f0614e14800 20 add_watcher() i=1 2024-09-12T00:28:39.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.220+0000 7f0614e14800 20 add_watcher() i=2 2024-09-12T00:28:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.220+0000 7f0614e14800 20 add_watcher() i=3 2024-09-12T00:28:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.220+0000 7f0614e14800 20 add_watcher() i=4 2024-09-12T00:28:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.220+0000 7f0614e14800 20 add_watcher() i=5 2024-09-12T00:28:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.220+0000 7f0614e14800 20 add_watcher() i=6 2024-09-12T00:28:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.221+0000 7f0614e14800 20 add_watcher() i=7 2024-09-12T00:28:39.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.221+0000 7f0614e14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:39.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.222+0000 7f04c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.222+0000 7f0614e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.222+0000 7f0614e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.222+0000 7f0614e14800 5 note: GC not initialized 2024-09-12T00:28:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.223+0000 7f04c5fdb640 20 reqs_thread_entry: start 2024-09-12T00:28:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.223+0000 7f0614e14800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.223+0000 7f0614e14800 20 Filter name: none 2024-09-12T00:28:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.223+0000 7f04377fe640 20 reqs_thread_entry: start 2024-09-12T00:28:39.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.223+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.224+0000 7f0614e14800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.224+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.224+0000 7f0614e14800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.224+0000 7f0614e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:39.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.224+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.225+0000 7f0614e14800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:28:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.225+0000 7f0614e14800 20 rados->read ofs=0 len=0 2024-09-12T00:28:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.225+0000 7f0614e14800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:28:39.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.225+0000 7f0614e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:39.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.227+0000 7f04c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:39.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.229+0000 7f0614e14800 20 remove_watcher() i=0 2024-09-12T00:28:39.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.229+0000 7f0614e14800 2 removed watcher, disabling cache 2024-09-12T00:28:39.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.230+0000 7f0614e14800 20 remove_watcher() i=1 2024-09-12T00:28:39.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.231+0000 7f0614e14800 20 remove_watcher() i=2 2024-09-12T00:28:39.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.232+0000 7f0614e14800 20 remove_watcher() i=3 2024-09-12T00:28:39.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.233+0000 7f0614e14800 20 remove_watcher() i=4 2024-09-12T00:28:39.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.234+0000 7f0614e14800 20 remove_watcher() i=5 2024-09-12T00:28:39.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.235+0000 7f0614e14800 20 remove_watcher() i=6 2024-09-12T00:28:39.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:39.236+0000 7f0614e14800 20 remove_watcher() i=7 2024-09-12T00:28:39.246 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:39.246 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:39.246 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-logrecord-writes id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:28:39.247 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:39.248 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.248 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.266 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.267 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.460 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.461 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.597 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:28:39.598 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:39.599 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.599 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.648 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.648 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.705 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.705 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.742 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.742 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.776 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.776 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.810 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.810 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.844 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.845 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.878 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.878 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.912 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.913 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.946 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.947 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:39.980 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:39.980 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.015 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.015 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.049 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.049 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.085 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.085 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.119 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.119 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.153 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.153 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.187 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.187 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.222 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.222 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.258 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.258 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.292 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.292 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.326 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.327 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.360 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:40.361 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:40.395 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:28:40.424 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:40.424 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:40.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.465+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.467+0000 7f1372d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.467+0000 7f1372d23800 20 realm 2024-09-12T00:28:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.467+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.467+0000 7f1372d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.467+0000 7f1372d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.467+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.467+0000 7f1372d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.467+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.468+0000 7f1372d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:40.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.468+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.469+0000 7f1372d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:40.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.469+0000 7f1372d23800 20 searching for the correct realm 2024-09-12T00:28:40.470 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.472+0000 7f136f20d640 0 -- 172.21.15.33:0/2606143900 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x5620fabafdf0 msgr2=0x5620fabb2290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:40.474 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.475+0000 7f136e20b640 0 -- 172.21.15.33:0/2606143900 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5620fabb78d0 msgr2=0x5620fabb9cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.479+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 20 zone default found 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 4 Realm: () 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 20 zonegroup default 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.480+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.481+0000 7f1372d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.481+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.481+0000 7f1372d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.481+0000 7f1372d23800 20 started sync module instance, tier type = 2024-09-12T00:28:40.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.481+0000 7f1372d23800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:40.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.490+0000 7f1372d23800 20 add_watcher() i=0 2024-09-12T00:28:40.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.490+0000 7f1372d23800 20 add_watcher() i=1 2024-09-12T00:28:40.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.490+0000 7f1372d23800 20 add_watcher() i=2 2024-09-12T00:28:40.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.490+0000 7f1372d23800 20 add_watcher() i=3 2024-09-12T00:28:40.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.490+0000 7f1372d23800 20 add_watcher() i=4 2024-09-12T00:28:40.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.490+0000 7f1372d23800 20 add_watcher() i=5 2024-09-12T00:28:40.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.490+0000 7f1372d23800 20 add_watcher() i=6 2024-09-12T00:28:40.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.491+0000 7f1372d23800 20 add_watcher() i=7 2024-09-12T00:28:40.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.491+0000 7f1372d23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:40.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.492+0000 7f12257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:40.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.492+0000 7f1372d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:40.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.492+0000 7f1372d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:40.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.492+0000 7f1372d23800 5 note: GC not initialized 2024-09-12T00:28:40.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.493+0000 7f119ffff640 20 reqs_thread_entry: start 2024-09-12T00:28:40.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.493+0000 7f1372d23800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:40.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.493+0000 7f1372d23800 20 Filter name: none 2024-09-12T00:28:40.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.493+0000 7f119dffb640 20 reqs_thread_entry: start 2024-09-12T00:28:40.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.493+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.494+0000 7f1372d23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:40.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.494+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.494+0000 7f1372d23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.494+0000 7f1372d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.494+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.494+0000 7f1372d23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.494+0000 7f1372d23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.495+0000 7f1372d23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:40.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.495+0000 7f1372d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:40.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.496+0000 7f12257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:40.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.498+0000 7f1372d23800 20 remove_watcher() i=0 2024-09-12T00:28:40.497 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.498+0000 7f1372d23800 2 removed watcher, disabling cache 2024-09-12T00:28:40.498 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.499+0000 7f1372d23800 20 remove_watcher() i=1 2024-09-12T00:28:40.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.500+0000 7f1372d23800 20 remove_watcher() i=2 2024-09-12T00:28:40.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.501+0000 7f1372d23800 20 remove_watcher() i=3 2024-09-12T00:28:40.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.502+0000 7f1372d23800 20 remove_watcher() i=4 2024-09-12T00:28:40.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.503+0000 7f1372d23800 20 remove_watcher() i=5 2024-09-12T00:28:40.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.504+0000 7f1372d23800 20 remove_watcher() i=6 2024-09-12T00:28:40.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.505+0000 7f1372d23800 20 remove_watcher() i=7 2024-09-12T00:28:40.515 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:40.515 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:40.516 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-change-reshard-state id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:40.516 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:40.517 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:28:40.551 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:40.551 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:40.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.592+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.594+0000 7fc5c2f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.594+0000 7fc5c2f40800 20 realm 2024-09-12T00:28:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.594+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.594+0000 7fc5c2f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.594+0000 7fc5c2f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.594+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.594+0000 7fc5c2f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.593 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.594+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.595+0000 7fc5c2f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:40.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.595+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.594 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.596+0000 7fc5c2f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:40.595 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.596+0000 7fc5c2f40800 20 searching for the correct realm 2024-09-12T00:28:40.597 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.598+0000 7fc5be4ec640 0 -- 172.21.15.33:0/2274929536 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55ec272e9370 msgr2=0x55ec272eb760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:40.600 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.602+0000 7fc5beced640 0 -- 172.21.15.33:0/2274929536 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fc5b4055040 msgr2=0x7fc5b4046940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:40.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:40.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:40.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:40.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:40.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:40.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:40.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.807+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:40.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:40.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 20 zone default found 2024-09-12T00:28:40.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 4 Realm: () 2024-09-12T00:28:40.808 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 20 zonegroup default 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.808+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.809+0000 7fc5c2f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.809+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.809+0000 7fc5c2f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.809+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.810+0000 7fc5c2f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.810+0000 7fc5c2f40800 20 started sync module instance, tier type = 2024-09-12T00:28:40.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.810+0000 7fc5c2f40800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.819+0000 7fc5c2f40800 20 add_watcher() i=0 2024-09-12T00:28:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.819+0000 7fc5c2f40800 20 add_watcher() i=1 2024-09-12T00:28:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.819+0000 7fc5c2f40800 20 add_watcher() i=2 2024-09-12T00:28:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.819+0000 7fc5c2f40800 20 add_watcher() i=3 2024-09-12T00:28:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.819+0000 7fc5c2f40800 20 add_watcher() i=4 2024-09-12T00:28:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.819+0000 7fc5c2f40800 20 add_watcher() i=5 2024-09-12T00:28:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.819+0000 7fc5c2f40800 20 add_watcher() i=6 2024-09-12T00:28:40.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.820+0000 7fc5c2f40800 20 add_watcher() i=7 2024-09-12T00:28:40.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.820+0000 7fc5c2f40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:40.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.821+0000 7fc4757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc5c2f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc5c2f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc5c2f40800 5 note: GC not initialized 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc3effff640 20 reqs_thread_entry: start 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc5c2f40800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc5c2f40800 20 Filter name: none 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc3edffb640 20 reqs_thread_entry: start 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc5c2f40800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:28:40.821 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.822+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:40.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:28:40.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:28:40.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 : miss 2024-09-12T00:28:40.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.822 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:40.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:40.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:40.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:40.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:40.823 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.823+0000 7fc5c2f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 2024-09-12T00:28:40.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.829+0000 7fc5c2f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:40.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.829+0000 7fc5c2f40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:40.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.829+0000 7fc5c2f40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:40.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.829+0000 7fc5c2f40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38, ofs0, ns] 2024-09-12T00:28:40.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.829+0000 7fc4a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366191 cookie 94472758057696 notifier 7851 bl.length()=1015 2024-09-12T00:28:40.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.829+0000 7fc4a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:40.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.829+0000 7fc4a1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:40.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.829+0000 7fc4a1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:40.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.831+0000 7fc5c2f40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_sources= new_sources= 2024-09-12T00:28:40.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.831+0000 7fc5c2f40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential sources added=[] removed=[] 2024-09-12T00:28:40.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.831+0000 7fc5c2f40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_dests= new_dests= 2024-09-12T00:28:40.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.831+0000 7fc5c2f40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential dests added=[] removed=[] 2024-09-12T00:28:40.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.0 2024-09-12T00:28:40.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.0 2024-09-12T00:28:40.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.1 2024-09-12T00:28:40.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.1 2024-09-12T00:28:40.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.2 2024-09-12T00:28:40.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.2 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.3 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.3 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.4 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.4 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.5 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.5 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.6 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.6 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.7 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.7 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.8 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.8 2024-09-12T00:28:40.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.9 2024-09-12T00:28:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.9 2024-09-12T00:28:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.10 2024-09-12T00:28:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.10 2024-09-12T00:28:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.11 2024-09-12T00:28:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.11 2024-09-12T00:28:40.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.837+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.0 2024-09-12T00:28:40.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.838+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1 2024-09-12T00:28:40.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.838+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.2 2024-09-12T00:28:40.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.839+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.3 2024-09-12T00:28:40.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.840+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.4 2024-09-12T00:28:40.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.840+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.5 2024-09-12T00:28:40.839 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.841+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.6 2024-09-12T00:28:40.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.842+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.7 2024-09-12T00:28:40.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.842+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.8 2024-09-12T00:28:40.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.843+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.9 2024-09-12T00:28:40.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.844+0000 7fc5c2f40800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.10 2024-09-12T00:28:40.845 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.847+0000 7fc5c2f40800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:28:40.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.847+0000 7fc5c2f40800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:28:40.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.859+0000 7fc5c2f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:40.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.859+0000 7fc5c2f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 2024-09-12T00:28:40.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.860+0000 7fc5c2f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:40.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.860+0000 7fc5c2f40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:40.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.860+0000 7fc5c2f40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:40.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.860+0000 7fc5c2f40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38, ofs0, ns] 2024-09-12T00:28:40.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.860+0000 7fc4a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94472758057696 notifier 7851 bl.length()=983 2024-09-12T00:28:40.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.860+0000 7fc4a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:40.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.860+0000 7fc4a1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:40.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.860+0000 7fc4a1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:40.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.862+0000 7fc5c2f40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_sources= new_sources= 2024-09-12T00:28:40.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.862+0000 7fc5c2f40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential sources added=[] removed=[] 2024-09-12T00:28:40.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.862+0000 7fc5c2f40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_dests= new_dests= 2024-09-12T00:28:40.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.862+0000 7fc5c2f40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential dests added=[] removed=[] 2024-09-12T00:28:40.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.862+0000 7fc5c2f40800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:28:40.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.864+0000 7fc4757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:40.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.866+0000 7fc5c2f40800 20 remove_watcher() i=0 2024-09-12T00:28:40.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.866+0000 7fc5c2f40800 2 removed watcher, disabling cache 2024-09-12T00:28:40.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.868+0000 7fc5c2f40800 20 remove_watcher() i=1 2024-09-12T00:28:40.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.869+0000 7fc5c2f40800 20 remove_watcher() i=2 2024-09-12T00:28:40.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.870+0000 7fc5c2f40800 20 remove_watcher() i=3 2024-09-12T00:28:40.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.871+0000 7fc5c2f40800 20 remove_watcher() i=4 2024-09-12T00:28:40.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.872+0000 7fc5c2f40800 20 remove_watcher() i=5 2024-09-12T00:28:40.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.873+0000 7fc5c2f40800 20 remove_watcher() i=6 2024-09-12T00:28:40.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.873+0000 7fc5c2f40800 20 remove_watcher() i=7 2024-09-12T00:28:40.885 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:28:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:40.914 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:40.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.954+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.956+0000 7f6476f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.956+0000 7f6476f40800 20 realm 2024-09-12T00:28:40.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.956+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.957+0000 7f6476f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.957+0000 7f6476f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:40.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.957+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.957+0000 7f6476f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.957+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.958+0000 7f6476f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:40.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.958+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.959+0000 7f6476f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:40.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.959+0000 7f6476f40800 20 searching for the correct realm 2024-09-12T00:28:40.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.962+0000 7f6472485640 0 -- 172.21.15.33:0/3273614669 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5621ac8a6a30 msgr2=0x5621ac8a8e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:40.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.965+0000 7f6473487640 0 -- 172.21.15.33:0/3273614669 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f6468094040 msgr2=0x7f646800d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:40.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:40.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:40.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:40.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:40.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:40.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:40.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 zone default found 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 4 Realm: () 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 zonegroup default 2024-09-12T00:28:40.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.969+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.970+0000 7f6476f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.970+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.970+0000 7f6476f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.970+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.970+0000 7f6476f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:40.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.970+0000 7f6476f40800 20 started sync module instance, tier type = 2024-09-12T00:28:40.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.970+0000 7f6476f40800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:40.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.979+0000 7f6476f40800 20 add_watcher() i=0 2024-09-12T00:28:40.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.979+0000 7f6476f40800 20 add_watcher() i=1 2024-09-12T00:28:40.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.979+0000 7f6476f40800 20 add_watcher() i=2 2024-09-12T00:28:40.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.979+0000 7f6476f40800 20 add_watcher() i=3 2024-09-12T00:28:40.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.979+0000 7f6476f40800 20 add_watcher() i=4 2024-09-12T00:28:40.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.979+0000 7f6476f40800 20 add_watcher() i=5 2024-09-12T00:28:40.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.979+0000 7f6476f40800 20 add_watcher() i=6 2024-09-12T00:28:40.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.980+0000 7f6476f40800 20 add_watcher() i=7 2024-09-12T00:28:40.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.980+0000 7f6476f40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:40.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f63297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:40.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f6476f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:40.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f6476f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:40.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f6476f40800 5 note: GC not initialized 2024-09-12T00:28:40.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f62a3fff640 20 reqs_thread_entry: start 2024-09-12T00:28:40.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f6476f40800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:40.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f6476f40800 20 Filter name: none 2024-09-12T00:28:40.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f62a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:28:40.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.982+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.983+0000 7f6476f40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:40.982 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.983+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.983+0000 7f6476f40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:40.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.983+0000 7f6476f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:40.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.983+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.984+0000 7f6476f40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:40.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.984+0000 7f6476f40800 20 rados->read ofs=0 len=0 2024-09-12T00:28:40.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.984+0000 7f6476f40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:40.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.984+0000 7f6476f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:40.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.986+0000 7f63297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:40.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.988+0000 7f6476f40800 20 remove_watcher() i=0 2024-09-12T00:28:40.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.988+0000 7f6476f40800 2 removed watcher, disabling cache 2024-09-12T00:28:40.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.989+0000 7f6476f40800 20 remove_watcher() i=1 2024-09-12T00:28:40.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.990+0000 7f6476f40800 20 remove_watcher() i=2 2024-09-12T00:28:40.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.991+0000 7f6476f40800 20 remove_watcher() i=3 2024-09-12T00:28:40.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.992+0000 7f6476f40800 20 remove_watcher() i=4 2024-09-12T00:28:40.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.993+0000 7f6476f40800 20 remove_watcher() i=5 2024-09-12T00:28:40.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.994+0000 7f6476f40800 20 remove_watcher() i=6 2024-09-12T00:28:40.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:40.995+0000 7f6476f40800 20 remove_watcher() i=7 2024-09-12T00:28:41.004 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:41.004 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:41.004 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-change-reshard-state id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:41.005 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:41.006 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:41.006 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:41.037 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:41.037 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:41.095 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:28:41.128 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:41.128 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:41.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.169+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.170+0000 7f77eb742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.170+0000 7f77eb742800 20 realm 2024-09-12T00:28:41.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.170+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.171+0000 7f77eb742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.171+0000 7f77eb742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:41.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.171+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.171+0000 7f77eb742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.171+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.172+0000 7f77eb742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:41.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.172+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.172+0000 7f77eb742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:41.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.172+0000 7f77eb742800 20 searching for the correct realm 2024-09-12T00:28:41.174 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.175+0000 7f77e7486640 0 -- 172.21.15.33:0/4143991683 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f77e0061040 msgr2=0x7f77e0055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:41.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.179+0000 7f77e7486640 0 -- 172.21.15.33:0/4143991683 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f77d0008070 msgr2=0x7f77d0081780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.183+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 20 zone default found 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 4 Realm: () 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 20 zonegroup default 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.184+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.185+0000 7f77eb742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.185+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.185+0000 7f77eb742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.185+0000 7f77eb742800 20 started sync module instance, tier type = 2024-09-12T00:28:41.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.185+0000 7f77eb742800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:41.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.194+0000 7f77eb742800 20 add_watcher() i=0 2024-09-12T00:28:41.192 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.194+0000 7f77eb742800 20 add_watcher() i=1 2024-09-12T00:28:41.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.194+0000 7f77eb742800 20 add_watcher() i=2 2024-09-12T00:28:41.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.194+0000 7f77eb742800 20 add_watcher() i=3 2024-09-12T00:28:41.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.194+0000 7f77eb742800 20 add_watcher() i=4 2024-09-12T00:28:41.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.194+0000 7f77eb742800 20 add_watcher() i=5 2024-09-12T00:28:41.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.194+0000 7f77eb742800 20 add_watcher() i=6 2024-09-12T00:28:41.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.195+0000 7f77eb742800 20 add_watcher() i=7 2024-09-12T00:28:41.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.195+0000 7f77eb742800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:41.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.196+0000 7f769dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f77eb742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f77eb742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f77eb742800 5 note: GC not initialized 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f769cfe1640 20 reqs_thread_entry: start 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f77eb742800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f77eb742800 20 Filter name: none 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f76167fc640 20 reqs_thread_entry: start 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f77eb742800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:28:41.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.197+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.198+0000 7f77eb742800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:41.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.198+0000 7f77eb742800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:28:41.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.198+0000 7f77eb742800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:28:41.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.198+0000 7f77eb742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 : miss 2024-09-12T00:28:41.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.198+0000 7f77eb742800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.199+0000 7f77eb742800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:41.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.199+0000 7f77eb742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:41.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.199+0000 7f77eb742800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:41.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.199+0000 7f77eb742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:41.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.199+0000 7f77eb742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:41.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.199+0000 7f77eb742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 2024-09-12T00:28:41.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.203+0000 7f77eb742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:41.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.203+0000 7f77eb742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:41.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.203+0000 7f77eb742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:41.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.203+0000 7f77eb742800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38, ofs0, ns] 2024-09-12T00:28:41.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.204+0000 7f76ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 93842461895056 notifier 7887 bl.length()=1015 2024-09-12T00:28:41.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.204+0000 7f76ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:41.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.204+0000 7f76ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:41.203 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.204+0000 7f76ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:41.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.205+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_sources= new_sources= 2024-09-12T00:28:41.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.205+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential sources added=[] removed=[] 2024-09-12T00:28:41.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.205+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_dests= new_dests= 2024-09-12T00:28:41.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.205+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential dests added=[] removed=[] 2024-09-12T00:28:41.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.0 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.0 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.1 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.1 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.2 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.2 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.3 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.3 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.4 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.4 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.5 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.5 2024-09-12T00:28:41.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.6 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.6 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.7 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.7 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.8 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.8 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.9 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.9 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.10 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.10 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.11 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1.11 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.0 2024-09-12T00:28:41.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.211+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1 2024-09-12T00:28:41.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.212+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.2 2024-09-12T00:28:41.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.212+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.3 2024-09-12T00:28:41.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.213+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.4 2024-09-12T00:28:41.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.214+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.5 2024-09-12T00:28:41.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.214+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.6 2024-09-12T00:28:41.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.215+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.7 2024-09-12T00:28:41.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.215+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.8 2024-09-12T00:28:41.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.216+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.9 2024-09-12T00:28:41.215 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.216+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.10 2024-09-12T00:28:41.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.219+0000 7f77eb742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:41.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.219+0000 7f77eb742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 2024-09-12T00:28:41.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.221+0000 7f77eb742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:41.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.221+0000 7f77eb742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:41.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.221+0000 7f77eb742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:41.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.221+0000 7f77eb742800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38, ofs0, ns] 2024-09-12T00:28:41.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.221+0000 7f76ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366194 cookie 93842461895056 notifier 7887 bl.length()=1015 2024-09-12T00:28:41.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.221+0000 7f76ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:41.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.221+0000 7f76ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:41.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.221+0000 7f76ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:41.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.222+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_sources= new_sources= 2024-09-12T00:28:41.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.222+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential sources added=[] removed=[] 2024-09-12T00:28:41.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.222+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_dests= new_dests= 2024-09-12T00:28:41.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.222+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential dests added=[] removed=[] 2024-09-12T00:28:41.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.225+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.0 2024-09-12T00:28:41.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.225+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.1 2024-09-12T00:28:41.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.225+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.2 2024-09-12T00:28:41.224 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.226+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.3 2024-09-12T00:28:41.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.226+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.4 2024-09-12T00:28:41.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.226+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.5 2024-09-12T00:28:41.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.227+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.6 2024-09-12T00:28:41.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.227+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.7 2024-09-12T00:28:41.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.227+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.8 2024-09-12T00:28:41.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.228+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.9 2024-09-12T00:28:41.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.228+0000 7f77eb742800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38.10 2024-09-12T00:28:41.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.229+0000 7f77eb742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:41.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.229+0000 7f77eb742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 2024-09-12T00:28:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.230+0000 7f77eb742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.230+0000 7f77eb742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.230+0000 7f77eb742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.230+0000 7f77eb742800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38, ofs0, ns] 2024-09-12T00:28:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.230+0000 7f76caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366195 cookie 93842461895056 notifier 7887 bl.length()=983 2024-09-12T00:28:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.230+0000 7f76caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 info.flags=0x17 2024-09-12T00:28:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.230+0000 7f76caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 to cache LRU end 2024-09-12T00:28:41.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.230+0000 7f76caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:41.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.232+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_sources= new_sources= 2024-09-12T00:28:41.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.232+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential sources added=[] removed=[] 2024-09-12T00:28:41.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.232+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): orig_dests= new_dests= 2024-09-12T00:28:41.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.232+0000 7f77eb742800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38]): potential dests added=[] removed=[] 2024-09-12T00:28:41.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.234+0000 7f77eb742800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:28:41.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.236+0000 7f769dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:41.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.238+0000 7f77eb742800 20 remove_watcher() i=0 2024-09-12T00:28:41.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.238+0000 7f77eb742800 2 removed watcher, disabling cache 2024-09-12T00:28:41.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.240+0000 7f77eb742800 20 remove_watcher() i=1 2024-09-12T00:28:41.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.241+0000 7f77eb742800 20 remove_watcher() i=2 2024-09-12T00:28:41.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.242+0000 7f77eb742800 20 remove_watcher() i=3 2024-09-12T00:28:41.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.243+0000 7f77eb742800 20 remove_watcher() i=4 2024-09-12T00:28:41.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.244+0000 7f77eb742800 20 remove_watcher() i=5 2024-09-12T00:28:41.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.245+0000 7f77eb742800 20 remove_watcher() i=6 2024-09-12T00:28:41.244 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.246+0000 7f77eb742800 20 remove_watcher() i=7 2024-09-12T00:28:41.256 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:28:41.286 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:41.286 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:41.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.326+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.328+0000 7effda00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.328+0000 7effda00e800 20 realm 2024-09-12T00:28:41.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.328+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.328+0000 7effda00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.328+0000 7effda00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:41.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.328+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.328+0000 7effda00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.328+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.329+0000 7effda00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:41.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.329+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.330+0000 7effda00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:41.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.330+0000 7effda00e800 20 searching for the correct realm 2024-09-12T00:28:41.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.333+0000 7effd5e5a640 0 -- 172.21.15.33:0/168213027 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7effcc013030 msgr2=0x7effcc038b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:41.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.539+0000 7effd5659640 0 -- 172.21.15.33:0/168213027 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x56114ddebc20 msgr2=0x56114ddee010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:41.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:41.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:41.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.542+0000 7effda00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:41.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 20 zone default found 2024-09-12T00:28:41.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 4 Realm: () 2024-09-12T00:28:41.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 20 zonegroup default 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.543+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.544+0000 7effda00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.544+0000 7effda00e800 20 started sync module instance, tier type = 2024-09-12T00:28:41.543 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.544+0000 7effda00e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:41.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.552+0000 7effda00e800 20 add_watcher() i=0 2024-09-12T00:28:41.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.552+0000 7effda00e800 20 add_watcher() i=1 2024-09-12T00:28:41.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.552+0000 7effda00e800 20 add_watcher() i=2 2024-09-12T00:28:41.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.552+0000 7effda00e800 20 add_watcher() i=3 2024-09-12T00:28:41.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.552+0000 7effda00e800 20 add_watcher() i=4 2024-09-12T00:28:41.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.552+0000 7effda00e800 20 add_watcher() i=5 2024-09-12T00:28:41.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.552+0000 7effda00e800 20 add_watcher() i=6 2024-09-12T00:28:41.551 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.553+0000 7effda00e800 20 add_watcher() i=7 2024-09-12T00:28:41.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.553+0000 7effda00e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:41.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.555+0000 7efe8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:41.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.555+0000 7effda00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:41.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.555+0000 7effda00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:41.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.555+0000 7effda00e800 5 note: GC not initialized 2024-09-12T00:28:41.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.555+0000 7efe8a7e4640 20 reqs_thread_entry: start 2024-09-12T00:28:41.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.556+0000 7effda00e800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:41.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.556+0000 7effda00e800 20 Filter name: none 2024-09-12T00:28:41.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.556+0000 7efdfbfff640 20 reqs_thread_entry: start 2024-09-12T00:28:41.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.556+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.556+0000 7effda00e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:41.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.556+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.557+0000 7effda00e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:41.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.557+0000 7effda00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:41.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.557+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.557+0000 7effda00e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:41.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.557+0000 7effda00e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:41.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.558+0000 7effda00e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:41.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.558+0000 7effda00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:41.558 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.559+0000 7efe8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:41.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.562+0000 7effda00e800 20 remove_watcher() i=0 2024-09-12T00:28:41.560 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.562+0000 7effda00e800 2 removed watcher, disabling cache 2024-09-12T00:28:41.561 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.563+0000 7effda00e800 20 remove_watcher() i=1 2024-09-12T00:28:41.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.564+0000 7effda00e800 20 remove_watcher() i=2 2024-09-12T00:28:41.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.565+0000 7effda00e800 20 remove_watcher() i=3 2024-09-12T00:28:41.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.566+0000 7effda00e800 20 remove_watcher() i=4 2024-09-12T00:28:41.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.567+0000 7effda00e800 20 remove_watcher() i=5 2024-09-12T00:28:41.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.568+0000 7effda00e800 20 remove_watcher() i=6 2024-09-12T00:28:41.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:41.569+0000 7effda00e800 20 remove_watcher() i=7 2024-09-12T00:28:41.578 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:41.578 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:41.578 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-change-reshard-state id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:28:41.579 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:41.581 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:41.581 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:41.602 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:41.602 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:41.794 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:41.794 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:41.930 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:28:41.931 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:41.931 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:41.931 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:41.980 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:41.980 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.037 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.037 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.070 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.070 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.106 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.106 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.140 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.140 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.175 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.176 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.208 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.208 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.241 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.242 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.276 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.276 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.311 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.311 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.345 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.345 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.384 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.385 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.417 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.417 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.453 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.453 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.486 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.487 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.520 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.520 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.555 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.556 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.592 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.593 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.629 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.629 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.664 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.664 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.699 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:42.699 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:42.734 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:28:42.764 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:42.764 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:42.803 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.804+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.806+0000 7f0c6131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.806+0000 7f0c6131f800 20 realm 2024-09-12T00:28:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.806+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.806+0000 7f0c6131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.806+0000 7f0c6131f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.806+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.806+0000 7f0c6131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.805 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.806+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.807+0000 7f0c6131f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:42.806 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.807+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.808+0000 7f0c6131f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:42.807 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.808+0000 7f0c6131f800 20 searching for the correct realm 2024-09-12T00:28:42.809 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.811+0000 7f0c5d8a3640 0 -- 172.21.15.33:0/3226547459 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55a763e12420 msgr2=0x55a763e148b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:42.812 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.814+0000 7f0c5d0a2640 0 -- 172.21.15.33:0/3226547459 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f0c48048400 msgr2=0x7f0c48048880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:42.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:42.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:42.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:42.817 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:42.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:42.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:42.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.818 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:42.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:42.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 zone default found 2024-09-12T00:28:42.819 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 4 Realm: () 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 zonegroup default 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.819+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.820+0000 7f0c6131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.820+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.820+0000 7f0c6131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.820+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.820+0000 7f0c6131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.820+0000 7f0c6131f800 20 started sync module instance, tier type = 2024-09-12T00:28:42.820 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.820+0000 7f0c6131f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:42.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.829+0000 7f0c6131f800 20 add_watcher() i=0 2024-09-12T00:28:42.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.829+0000 7f0c6131f800 20 add_watcher() i=1 2024-09-12T00:28:42.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.829+0000 7f0c6131f800 20 add_watcher() i=2 2024-09-12T00:28:42.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.829+0000 7f0c6131f800 20 add_watcher() i=3 2024-09-12T00:28:42.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.829+0000 7f0c6131f800 20 add_watcher() i=4 2024-09-12T00:28:42.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.829+0000 7f0c6131f800 20 add_watcher() i=5 2024-09-12T00:28:42.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.829+0000 7f0c6131f800 20 add_watcher() i=6 2024-09-12T00:28:42.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.830+0000 7f0c6131f800 20 add_watcher() i=7 2024-09-12T00:28:42.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.830+0000 7f0c6131f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:42.830 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.831+0000 7f0b137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.832+0000 7f0c6131f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.832+0000 7f0c6131f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.832+0000 7f0c6131f800 5 note: GC not initialized 2024-09-12T00:28:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.832+0000 7f0b127e4640 20 reqs_thread_entry: start 2024-09-12T00:28:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.832+0000 7f0c6131f800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.832+0000 7f0c6131f800 20 Filter name: none 2024-09-12T00:28:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.832+0000 7f0a83fff640 20 reqs_thread_entry: start 2024-09-12T00:28:42.831 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.832+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.833+0000 7f0c6131f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:42.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.833+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.834+0000 7f0c6131f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:42.832 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.834+0000 7f0c6131f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:42.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.834+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.834+0000 7f0c6131f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:42.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.834+0000 7f0c6131f800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.835+0000 7f0c6131f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:42.833 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.835+0000 7f0c6131f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:42.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.837+0000 7f0b137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:42.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.839+0000 7f0c6131f800 20 remove_watcher() i=0 2024-09-12T00:28:42.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.839+0000 7f0c6131f800 2 removed watcher, disabling cache 2024-09-12T00:28:42.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.840+0000 7f0c6131f800 20 remove_watcher() i=1 2024-09-12T00:28:42.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.841+0000 7f0c6131f800 20 remove_watcher() i=2 2024-09-12T00:28:42.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.842+0000 7f0c6131f800 20 remove_watcher() i=3 2024-09-12T00:28:42.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.843+0000 7f0c6131f800 20 remove_watcher() i=4 2024-09-12T00:28:42.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.844+0000 7f0c6131f800 20 remove_watcher() i=5 2024-09-12T00:28:42.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.844+0000 7f0c6131f800 20 remove_watcher() i=6 2024-09-12T00:28:42.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.845+0000 7f0c6131f800 20 remove_watcher() i=7 2024-09-12T00:28:42.855 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:42.855 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:42.855 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-change-reshard-state id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:42.855 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:42.856 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:28:42.893 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:42.893 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:42.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.935+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.936+0000 7fb29152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.936+0000 7fb29152e800 20 realm 2024-09-12T00:28:42.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.936+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.937+0000 7fb29152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.937+0000 7fb29152e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:42.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.937+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.937+0000 7fb29152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:42.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.937+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.938+0000 7fb29152e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:42.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.938+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:42.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.939+0000 7fb29152e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:42.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.939+0000 7fb29152e800 20 searching for the correct realm 2024-09-12T00:28:42.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:42.942+0000 7fb28d965640 0 -- 172.21.15.33:0/4239366680 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fb284068a50 msgr2=0x7fb28405c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:43.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.149+0000 7fb28d164640 0 -- 172.21.15.33:0/4239366680 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x55d10ef53af0 msgr2=0x55d10ef55ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:43.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.152+0000 7fb29152e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 zone default found 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 4 Realm: () 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 zonegroup default 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 started sync module instance, tier type = 2024-09-12T00:28:43.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.153+0000 7fb29152e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:43.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.163+0000 7fb29152e800 20 add_watcher() i=0 2024-09-12T00:28:43.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.163+0000 7fb29152e800 20 add_watcher() i=1 2024-09-12T00:28:43.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.163+0000 7fb29152e800 20 add_watcher() i=2 2024-09-12T00:28:43.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.163+0000 7fb29152e800 20 add_watcher() i=3 2024-09-12T00:28:43.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.163+0000 7fb29152e800 20 add_watcher() i=4 2024-09-12T00:28:43.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.163+0000 7fb29152e800 20 add_watcher() i=5 2024-09-12T00:28:43.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.163+0000 7fb29152e800 20 add_watcher() i=6 2024-09-12T00:28:43.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.164+0000 7fb29152e800 20 add_watcher() i=7 2024-09-12T00:28:43.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.164+0000 7fb29152e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:43.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.165+0000 7fb143fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:43.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb29152e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:43.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb29152e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:43.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb29152e800 5 note: GC not initialized 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb142fe5640 20 reqs_thread_entry: start 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb29152e800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb29152e800 20 Filter name: none 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb140fe1640 20 reqs_thread_entry: start 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb29152e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.166+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 : miss 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:43.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 info.flags=0x17 2024-09-12T00:28:43.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 to cache LRU end 2024-09-12T00:28:43.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:43.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:43.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.167+0000 7fb29152e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 2024-09-12T00:28:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.172+0000 7fb29152e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 info.flags=0x17 2024-09-12T00:28:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.172+0000 7fb29152e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 to cache LRU end 2024-09-12T00:28:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.172+0000 7fb29152e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.172+0000 7fb29152e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39, ofs0, ns] 2024-09-12T00:28:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.172+0000 7fb15ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366198 cookie 94356387544064 notifier 7944 bl.length()=1015 2024-09-12T00:28:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.172+0000 7fb15ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 info.flags=0x17 2024-09-12T00:28:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.172+0000 7fb15ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 to cache LRU end 2024-09-12T00:28:43.171 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.172+0000 7fb15ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:43.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.174+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): orig_sources= new_sources= 2024-09-12T00:28:43.172 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.174+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): potential sources added=[] removed=[] 2024-09-12T00:28:43.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.174+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): orig_dests= new_dests= 2024-09-12T00:28:43.173 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.174+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): potential dests added=[] removed=[] 2024-09-12T00:28:43.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.178+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.0 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.178+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.0 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.178+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.1 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.178+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.1 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.178+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.2 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.178+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.2 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.3 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.3 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.4 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.4 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.5 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.5 2024-09-12T00:28:43.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.6 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.6 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.7 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.7 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.8 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.8 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.9 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.9 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.10 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.10 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.11 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1.11 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.0 2024-09-12T00:28:43.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.179+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1 2024-09-12T00:28:43.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.180+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.2 2024-09-12T00:28:43.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.180+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.3 2024-09-12T00:28:43.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.181+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.4 2024-09-12T00:28:43.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.181+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.5 2024-09-12T00:28:43.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.182+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.6 2024-09-12T00:28:43.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.182+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.7 2024-09-12T00:28:43.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.183+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.8 2024-09-12T00:28:43.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.184+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.9 2024-09-12T00:28:43.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.184+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.10 2024-09-12T00:28:43.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.187+0000 7fb29152e800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:28:43.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.187+0000 7fb29152e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:43.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.187+0000 7fb29152e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 2024-09-12T00:28:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.188+0000 7fb29152e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 info.flags=0x17 2024-09-12T00:28:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.188+0000 7fb29152e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 to cache LRU end 2024-09-12T00:28:43.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.188+0000 7fb29152e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.188+0000 7fb29152e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39, ofs0, ns] 2024-09-12T00:28:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.189+0000 7fb15ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366199 cookie 94356387544064 notifier 7944 bl.length()=1015 2024-09-12T00:28:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.189+0000 7fb15ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 info.flags=0x17 2024-09-12T00:28:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.189+0000 7fb15ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 to cache LRU end 2024-09-12T00:28:43.188 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.189+0000 7fb15ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:43.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.190+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): orig_sources= new_sources= 2024-09-12T00:28:43.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.190+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): potential sources added=[] removed=[] 2024-09-12T00:28:43.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.190+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): orig_dests= new_dests= 2024-09-12T00:28:43.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.190+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): potential dests added=[] removed=[] 2024-09-12T00:28:43.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.194+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.0 2024-09-12T00:28:43.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.195+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.1 2024-09-12T00:28:43.194 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.195+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.2 2024-09-12T00:28:43.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.195+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.3 2024-09-12T00:28:43.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.196+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.4 2024-09-12T00:28:43.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.196+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.5 2024-09-12T00:28:43.195 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.196+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.6 2024-09-12T00:28:43.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.197+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.7 2024-09-12T00:28:43.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.197+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.8 2024-09-12T00:28:43.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.197+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.9 2024-09-12T00:28:43.196 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.198+0000 7fb29152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39.10 2024-09-12T00:28:43.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.198+0000 7fb29152e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:28:43.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.198+0000 7fb29152e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 2024-09-12T00:28:43.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.199+0000 7fb29152e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 info.flags=0x17 2024-09-12T00:28:43.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.199+0000 7fb29152e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 to cache LRU end 2024-09-12T00:28:43.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.199+0000 7fb29152e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:43.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.199+0000 7fb29152e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39, ofs0, ns] 2024-09-12T00:28:43.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.200+0000 7fb15ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366200 cookie 94356387544064 notifier 7944 bl.length()=983 2024-09-12T00:28:43.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.200+0000 7fb15ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 info.flags=0x17 2024-09-12T00:28:43.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.200+0000 7fb15ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 to cache LRU end 2024-09-12T00:28:43.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.200+0000 7fb15ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:43.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.201+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): orig_sources= new_sources= 2024-09-12T00:28:43.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.201+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): potential sources added=[] removed=[] 2024-09-12T00:28:43.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.201+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): orig_dests= new_dests= 2024-09-12T00:28:43.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.201+0000 7fb29152e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39]): potential dests added=[] removed=[] 2024-09-12T00:28:43.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.204+0000 7fb29152e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:28:43.206 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.207+0000 7fb143fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:43.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.209+0000 7fb29152e800 20 remove_watcher() i=0 2024-09-12T00:28:43.208 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.209+0000 7fb29152e800 2 removed watcher, disabling cache 2024-09-12T00:28:43.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.210+0000 7fb29152e800 20 remove_watcher() i=1 2024-09-12T00:28:43.210 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.211+0000 7fb29152e800 20 remove_watcher() i=2 2024-09-12T00:28:43.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.212+0000 7fb29152e800 20 remove_watcher() i=3 2024-09-12T00:28:43.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.213+0000 7fb29152e800 20 remove_watcher() i=4 2024-09-12T00:28:43.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.214+0000 7fb29152e800 20 remove_watcher() i=5 2024-09-12T00:28:43.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.215+0000 7fb29152e800 20 remove_watcher() i=6 2024-09-12T00:28:43.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.216+0000 7fb29152e800 20 remove_watcher() i=7 2024-09-12T00:28:43.227 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:28:43.257 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:43.257 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:43.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.297+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.500+0000 7f4dbf52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.500+0000 7f4dbf52c800 20 realm 2024-09-12T00:28:43.499 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.500+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.500+0000 7f4dbf52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.500+0000 7f4dbf52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:43.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.500+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.501+0000 7f4dbf52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.501+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.502+0000 7f4dbf52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:43.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.502+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.502+0000 7f4dbf52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:43.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.502+0000 7f4dbf52c800 20 searching for the correct realm 2024-09-12T00:28:43.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.505+0000 7f4dbb2ad640 0 -- 172.21.15.33:0/1636245898 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f4db4061040 msgr2=0x7f4db40a7a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:43.507 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.509+0000 7f4dbb2ad640 0 -- 172.21.15.33:0/1636245898 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f4db0093370 msgr2=0x7f4db00637d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:43.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.715+0000 7f4dbf52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:43.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.715+0000 7f4dbf52c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:43.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.715+0000 7f4dbf52c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:43.714 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.715+0000 7f4dbf52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:43.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.715+0000 7f4dbf52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:43.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.715+0000 7f4dbf52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:43.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.715+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:43.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:43.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 20 zone default found 2024-09-12T00:28:43.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 4 Realm: () 2024-09-12T00:28:43.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:43.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 20 zonegroup default 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.716+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.717+0000 7f4dbf52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.717+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.717+0000 7f4dbf52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.717+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.717+0000 7f4dbf52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.717+0000 7f4dbf52c800 20 started sync module instance, tier type = 2024-09-12T00:28:43.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.717+0000 7f4dbf52c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.932+0000 7f4dbf52c800 20 add_watcher() i=0 2024-09-12T00:28:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.932+0000 7f4dbf52c800 20 add_watcher() i=1 2024-09-12T00:28:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.932+0000 7f4dbf52c800 20 add_watcher() i=2 2024-09-12T00:28:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.932+0000 7f4dbf52c800 20 add_watcher() i=3 2024-09-12T00:28:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.932+0000 7f4dbf52c800 20 add_watcher() i=4 2024-09-12T00:28:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.932+0000 7f4dbf52c800 20 add_watcher() i=5 2024-09-12T00:28:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.932+0000 7f4dbf52c800 20 add_watcher() i=6 2024-09-12T00:28:43.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.933+0000 7f4dbf52c800 20 add_watcher() i=7 2024-09-12T00:28:43.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.933+0000 7f4dbf52c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:43.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.935+0000 7f4c71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.935+0000 7f4dbf52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.935+0000 7f4dbf52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.935+0000 7f4dbf52c800 5 note: GC not initialized 2024-09-12T00:28:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.936+0000 7f4c70fe1640 20 reqs_thread_entry: start 2024-09-12T00:28:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.936+0000 7f4dbf52c800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.936+0000 7f4dbf52c800 20 Filter name: none 2024-09-12T00:28:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.936+0000 7f4bea7fc640 20 reqs_thread_entry: start 2024-09-12T00:28:43.935 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.936+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.937+0000 7f4dbf52c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.937+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.938+0000 7f4dbf52c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:43.936 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.938+0000 7f4dbf52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:43.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.938+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.938+0000 7f4dbf52c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:43.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.938+0000 7f4dbf52c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:43.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.939+0000 7f4dbf52c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:43.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.939+0000 7f4dbf52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:43.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.941+0000 7f4c71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:43.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.943+0000 7f4dbf52c800 20 remove_watcher() i=0 2024-09-12T00:28:43.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.943+0000 7f4dbf52c800 2 removed watcher, disabling cache 2024-09-12T00:28:43.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.945+0000 7f4dbf52c800 20 remove_watcher() i=1 2024-09-12T00:28:43.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.946+0000 7f4dbf52c800 20 remove_watcher() i=2 2024-09-12T00:28:43.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.947+0000 7f4dbf52c800 20 remove_watcher() i=3 2024-09-12T00:28:43.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.949+0000 7f4dbf52c800 20 remove_watcher() i=4 2024-09-12T00:28:43.948 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.950+0000 7f4dbf52c800 20 remove_watcher() i=5 2024-09-12T00:28:43.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.951+0000 7f4dbf52c800 20 remove_watcher() i=6 2024-09-12T00:28:43.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:43.952+0000 7f4dbf52c800 20 remove_watcher() i=7 2024-09-12T00:28:43.964 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:43.964 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:43.965 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: error-at-change-reshard-state id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:28:43.965 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:43.967 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:43.967 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:43.989 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:43.989 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.191 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.192 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.336 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:28:44.336 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:44.337 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.337 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.391 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.391 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.448 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.448 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.485 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.486 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.519 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.519 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.552 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.552 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.586 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.586 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.620 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.620 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.655 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.655 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.690 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.690 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.724 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.724 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.756 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.757 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.791 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.791 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.824 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.824 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.859 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.860 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.892 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.892 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.927 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.927 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.961 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.961 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:44.994 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:44.994 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:45.027 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:45.027 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:45.060 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:45.060 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:45.094 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:45.094 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:45.129 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:28:45.158 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:45.158 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:45.198 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.199+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.200+0000 7efd2cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.200+0000 7efd2cb23800 20 realm 2024-09-12T00:28:45.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.200+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.200+0000 7efd2cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.200+0000 7efd2cb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:45.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.200+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.201+0000 7efd2cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.201+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.201+0000 7efd2cb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.201+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.202+0000 7efd2cb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:45.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.202+0000 7efd2cb23800 20 searching for the correct realm 2024-09-12T00:28:45.204 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.205+0000 7efd2900d640 0 -- 172.21.15.33:0/829360660 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5567ca0919f0 msgr2=0x5567ca093e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.207 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.208+0000 7efd2880c640 0 -- 172.21.15.33:0/829360660 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7efd1c01a040 msgr2=0x7efd1c04a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.212+0000 7efd2cb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:45.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.212+0000 7efd2cb23800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:45.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.212+0000 7efd2cb23800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:45.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.212+0000 7efd2cb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:45.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.212+0000 7efd2cb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:45.211 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.212+0000 7efd2cb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:45.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.212+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.212 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 zone default found 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 4 Realm: () 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 zonegroup default 2024-09-12T00:28:45.213 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.213+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.214+0000 7efd2cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.214+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.214+0000 7efd2cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.214+0000 7efd2cb23800 20 started sync module instance, tier type = 2024-09-12T00:28:45.214 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.214+0000 7efd2cb23800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:45.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.223+0000 7efd2cb23800 20 add_watcher() i=0 2024-09-12T00:28:45.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.223+0000 7efd2cb23800 20 add_watcher() i=1 2024-09-12T00:28:45.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.223+0000 7efd2cb23800 20 add_watcher() i=2 2024-09-12T00:28:45.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.223+0000 7efd2cb23800 20 add_watcher() i=3 2024-09-12T00:28:45.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.223+0000 7efd2cb23800 20 add_watcher() i=4 2024-09-12T00:28:45.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.223+0000 7efd2cb23800 20 add_watcher() i=5 2024-09-12T00:28:45.222 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.223+0000 7efd2cb23800 20 add_watcher() i=6 2024-09-12T00:28:45.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.224+0000 7efd2cb23800 20 add_watcher() i=7 2024-09-12T00:28:45.223 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.224+0000 7efd2cb23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:45.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.226+0000 7efbdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:45.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.226+0000 7efd2cb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:45.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.226+0000 7efd2cb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:45.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.226+0000 7efd2cb23800 5 note: GC not initialized 2024-09-12T00:28:45.225 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.226+0000 7efbde7e4640 20 reqs_thread_entry: start 2024-09-12T00:28:45.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.227+0000 7efd2cb23800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:45.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.227+0000 7efd2cb23800 20 Filter name: none 2024-09-12T00:28:45.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.227+0000 7efbd77fe640 20 reqs_thread_entry: start 2024-09-12T00:28:45.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.227+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.226 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.228+0000 7efd2cb23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:45.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.228+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.229+0000 7efd2cb23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:45.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.229+0000 7efd2cb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:45.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.229+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.229+0000 7efd2cb23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:45.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.229+0000 7efd2cb23800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.229+0000 7efd2cb23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:45.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.229+0000 7efd2cb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:45.230 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.231+0000 7efbdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:45.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.233+0000 7efd2cb23800 20 remove_watcher() i=0 2024-09-12T00:28:45.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.233+0000 7efd2cb23800 2 removed watcher, disabling cache 2024-09-12T00:28:45.233 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.234+0000 7efd2cb23800 20 remove_watcher() i=1 2024-09-12T00:28:45.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.235+0000 7efd2cb23800 20 remove_watcher() i=2 2024-09-12T00:28:45.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.236+0000 7efd2cb23800 20 remove_watcher() i=3 2024-09-12T00:28:45.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.237+0000 7efd2cb23800 20 remove_watcher() i=4 2024-09-12T00:28:45.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.239+0000 7efd2cb23800 20 remove_watcher() i=5 2024-09-12T00:28:45.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.239+0000 7efd2cb23800 20 remove_watcher() i=6 2024-09-12T00:28:45.239 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.240+0000 7efd2cb23800 20 remove_watcher() i=7 2024-09-12T00:28:45.250 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.250 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:45.251 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-change-reshard-state id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:45.251 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.252 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:28:45.287 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:45.287 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:45.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.329+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.330+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.330+0000 7f33de92c800 20 realm 2024-09-12T00:28:45.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.330+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.331+0000 7f33de92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:45.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.332+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.332+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.333+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:45.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.333+0000 7f33de92c800 20 searching for the correct realm 2024-09-12T00:28:45.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.336+0000 7f33dae50640 0 -- 172.21.15.33:0/3332903883 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x560925f059a0 msgr2=0x560925f07dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.339+0000 7f33d9e4e640 0 -- 172.21.15.33:0/3332903883 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x560925f0d3e0 msgr2=0x560925f0f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:45.343 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:45.344 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 zone default found 2024-09-12T00:28:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 4 Realm: () 2024-09-12T00:28:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 zonegroup default 2024-09-12T00:28:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.345 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 started sync module instance, tier type = 2024-09-12T00:28:45.346 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.344+0000 7f33de92c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:45.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=0 2024-09-12T00:28:45.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=1 2024-09-12T00:28:45.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=2 2024-09-12T00:28:45.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=3 2024-09-12T00:28:45.352 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=4 2024-09-12T00:28:45.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=5 2024-09-12T00:28:45.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=6 2024-09-12T00:28:45.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.354+0000 7f33de92c800 20 add_watcher() i=7 2024-09-12T00:28:45.353 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.354+0000 7f33de92c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:45.354 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.356+0000 7f3290fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:45.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.356+0000 7f33de92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:45.356 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.356+0000 7f33de92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.356+0000 7f33de92c800 5 note: GC not initialized 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f320b7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 20 Filter name: none 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f32097fa640 20 reqs_thread_entry: start 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:45.357 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 : miss 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.358+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.358+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.358+0000 7f33de92c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.358+0000 7f33de92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.358+0000 7f33de92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.358 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.358+0000 7f33de92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 2024-09-12T00:28:45.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.364+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.364+0000 7f33de92c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.364+0000 7f33de92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.364+0000 7f33de92c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40, ofs0, ns] 2024-09-12T00:28:45.363 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94597291266336 notifier 7995 bl.length()=1015 2024-09-12T00:28:45.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.364 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_sources= new_sources= 2024-09-12T00:28:45.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential sources added=[] removed=[] 2024-09-12T00:28:45.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_dests= new_dests= 2024-09-12T00:28:45.365 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential dests added=[] removed=[] 2024-09-12T00:28:45.369 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.0 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.0 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.1 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.1 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.2 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.2 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.3 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.3 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.4 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.4 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.5 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.5 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.6 2024-09-12T00:28:45.370 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.6 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.7 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.7 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.8 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.8 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.9 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.9 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.10 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.10 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.11 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.11 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.0 2024-09-12T00:28:45.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1 2024-09-12T00:28:45.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.372+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2 2024-09-12T00:28:45.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.372+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.3 2024-09-12T00:28:45.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.4 2024-09-12T00:28:45.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.5 2024-09-12T00:28:45.372 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.6 2024-09-12T00:28:45.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.374+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.7 2024-09-12T00:28:45.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.8 2024-09-12T00:28:45.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.9 2024-09-12T00:28:45.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.10 2024-09-12T00:28:45.377 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f33de92c800 time 2024-09-12T00:28:45.379756+0000 2024-09-12T00:28:45.377 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f33e018c71a] 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f33e018c8d8] 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5609247d1641] 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5609247e051b] 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5609247e13e4] 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f33dee29590] 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:28:45.378 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f33de92c800 thread_name:radosgw-admin 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.379+0000 7f33de92c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f33de92c800 time 2024-09-12T00:28:45.379756+0000 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f33e018c71a] 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f33e018c8d8] 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5609247d1641] 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5609247e051b] 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5609247e13e4] 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:28:45.379 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f33dee29590] 2024-09-12T00:28:45.380 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:28:45.380 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:28:45.380 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f33dee3e6f0] 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f33dee8b99c] 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f33e018c774] 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f33e018c8d8] 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5609247d1641] 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5609247e051b] 2024-09-12T00:28:45.399 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5609247e13e4] 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f33dee29590] 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.380+0000 7f33de92c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f33de92c800 thread_name:radosgw-admin 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f33dee3e6f0] 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f33dee8b99c] 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f33e018c774] 2024-09-12T00:28:45.400 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f33e018c8d8] 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5609247d1641] 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5609247e051b] 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5609247e13e4] 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f33dee29590] 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:28:45.311+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:28:45.311+0000 7f33de92c800 1 librados: starting msgr at 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:28:45.311+0000 7f33de92c800 1 librados: starting objecter 2024-09-12T00:28:45.401 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 asok(0x560925bfa630) register_command objecter_requests hook 0x560925e4c570 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:28:45.312+0000 7f33de92c800 1 librados: setting wanted keys 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:28:45.312+0000 7f33de92c800 1 librados: calling monclient init 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient: init 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding auth protocol: cephx 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding auth protocol: cephx 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding auth protocol: cephx 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.402 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:28:45.312+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:28:45.312+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 asok(0x560925bfa630) register_command rotate-key hook 0x560925e1b3e8 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-a con 0x560925cc8b10 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-b con 0x560925cd3280 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-c con 0x560925d5e450 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.403 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): authenticate will time out at 2344.877743s 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): get_auth_request con 0x560925cc8b10 auth_method 0 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): get_auth_request con 0x560925d5e450 auth_method 0 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.404 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:28:45.313+0000 7f33da64f640 10 monclient(hunting): handle_auth_done global_id 7986 payload 824 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:28:45.313+0000 7f33da64f640 10 monclient: _finish_hunting 0 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:28:45.313+0000 7f33da64f640 1 monclient: found mon.noname-a 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:28:45.313+0000 7f33da64f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:28:45.313+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x560925cd3280 auth_method 0 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:28:45.405 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: dump: 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: _finish_auth 0 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: _check_auth_tickets 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.406 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: dump: 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:28:45.313+0000 7f33de92c800 5 monclient: authenticate success, global_id 7986 2024-09-12T00:28:45.407 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:28:45.313+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:28:45.313+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:28:45.313+0000 7f32c8608640 4 set_mon_vals no callback set 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:28:45.313+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:28:45.313+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:28:45.313+0000 7f33de92c800 1 librados: init done 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:28:45.315+0000 7f32c6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:28:45.315+0000 7f32c6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:28:45.315+0000 7f32c6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:28:45.315+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x7f32c0076470 auth_method 0 2024-09-12T00:28:45.408 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:28:45.316+0000 7f33dae50640 10 monclient: get_auth_request con 0x560925e597e0 auth_method 0 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:28:45.317+0000 7f33da64f640 10 monclient: get_auth_request con 0x560925e669e0 auth_method 0 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:28:45.317+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x560925e6ae70 auth_method 0 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:28:45.319+0000 7f33de92c800 10 monclient: build_initial_monmap 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:28:45.319+0000 7f33de92c800 1 build_initial for_mkfs: 0 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:28:45.319+0000 7f33de92c800 10 monclient: monmap: 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.409 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding auth protocol: cephx 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding auth protocol: cephx 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding auth protocol: cephx 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.410 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:28:45.319+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 asok(0x560925bfa630) register_command objecter_requests cmddesc objecter_requests hook 0x560925e736e0 EEXIST 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:28:45.319+0000 7f33de92c800 10 monclient: init 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding auth protocol: cephx 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding auth protocol: cephx 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding auth protocol: cephx 2024-09-12T00:28:45.411 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:28:45.320+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.412 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:28:45.320+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:28:45.320+0000 7f33de92c800 5 asok(0x560925bfa630) register_command rotate-key cmddesc rotate-key hook 0x560925e6e520 EEXIST 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-b con 0x560925e973d0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-c con 0x560925e996a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-a con 0x560925e95ba0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): authenticate will time out at 2344.885395s 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request con 0x560925e996a0 auth_method 0 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.413 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): get_auth_request con 0x560925e95ba0 auth_method 0 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): handle_auth_done global_id 7989 payload 824 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient: _finish_hunting 0 2024-09-12T00:28:45.414 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:28:45.320+0000 7f33dae50640 1 monclient: found mon.noname-a 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: dump: 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.415 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: _finish_auth 0 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: _check_auth_tickets 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: dump: 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.416 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:28:45.321+0000 7f33de92c800 5 monclient: authenticate success, global_id 7989 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:28:45.321+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:28:45.321+0000 7f33db651640 4 set_mon_vals no callback set 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:28:45.321+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:28:45.321+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:28:45.321+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:28:45.323+0000 7f32bffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:28:45.323+0000 7f32bffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:28:45.323+0000 7f32bffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:28:45.323+0000 7f33da64f640 10 monclient: get_auth_request con 0x7f32b4076380 auth_method 0 2024-09-12T00:28:45.417 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:28:45.323+0000 7f33de92c800 10 monclient: get_monmap_and_config 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:28:45.323+0000 7f33de92c800 10 monclient: build_initial_monmap 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:28:45.323+0000 7f33de92c800 1 build_initial for_mkfs: 0 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:28:45.323+0000 7f33de92c800 10 monclient: monmap: 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:45.418 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding auth protocol: cephx 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding auth protocol: cephx 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding auth protocol: cephx 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.419 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:28:45.323+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient: init 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding auth protocol: cephx 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding auth protocol: cephx 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding auth protocol: cephx 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.420 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:28:45.324+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:28:45.324+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 asok(0x560925bfa630) register_command rotate-key cmddesc rotate-key hook 0x7ffcc954cac8 EEXIST 2024-09-12T00:28:45.421 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-c con 0x560925eeb860 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-a con 0x560925ee5e00 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-b con 0x560925ebb6a0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:45.422 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): authenticate will time out at 2344.889596s 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): get_auth_request con 0x560925eeb860 auth_method 0 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request con 0x560925ee5e00 auth_method 0 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.423 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): handle_auth_done global_id 7457 payload 274 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient: _finish_hunting 0 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:28:45.324+0000 7f33da64f640 1 monclient: found mon.noname-c 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: dump: 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.424 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: _finish_auth 0 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: _check_auth_tickets 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: dump: 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.425 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 monclient: authenticate success, global_id 7457 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:28:45.325+0000 7f33de92c800 10 monclient: get_monmap_and_config success 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:28:45.325+0000 7f33de92c800 4 set_mon_vals no callback set 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:28:45.325+0000 7f33de92c800 10 monclient: shutdown 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:28:45.325+0000 7f33de92c800 10 monclient: build_initial_monmap 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:28:45.325+0000 7f33de92c800 1 build_initial for_mkfs: 0 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:28:45.325+0000 7f33de92c800 10 monclient: monmap: 2024-09-12T00:28:45.426 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding auth protocol: cephx 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding auth protocol: cephx 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding auth protocol: cephx 2024-09-12T00:28:45.427 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:28:45.326+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:28:45.326+0000 7f33de92c800 1 librados: starting msgr at 2024-09-12T00:28:45.428 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:28:45.326+0000 7f33de92c800 1 librados: starting objecter 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 asok(0x560925bfa630) register_command objecter_requests cmddesc objecter_requests hook 0x560925e9a490 EEXIST 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:28:45.326+0000 7f33de92c800 1 librados: setting wanted keys 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:28:45.326+0000 7f33de92c800 1 librados: calling monclient init 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient: init 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding auth protocol: cephx 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding auth protocol: cephx 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding auth protocol: cephx 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.429 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:28:45.326+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:28:45.326+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 asok(0x560925bfa630) register_command rotate-key cmddesc rotate-key hook 0x560925eaf2c8 EEXIST 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-a con 0x560925ebb6a0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-c con 0x560925ee5e00 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:45.430 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-b con 0x560925eeb860 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): authenticate will time out at 2344.891917s 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): get_auth_request con 0x560925ebb6a0 auth_method 0 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request con 0x560925ee5e00 auth_method 0 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.431 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): get_auth_request con 0x560925eeb860 auth_method 0 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): handle_auth_done global_id 7995 payload 824 2024-09-12T00:28:45.432 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient: _finish_hunting 0 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:28:45.327+0000 7f33da64f640 1 monclient: found mon.noname-a 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: dump: 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.433 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: _finish_auth 0 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: _check_auth_tickets 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: dump: 2024-09-12T00:28:45.434 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:28:45.327+0000 7f33de92c800 5 monclient: authenticate success, global_id 7995 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:28:45.327+0000 7f32bdffb640 4 set_mon_vals no callback set 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:28:45.327+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:28:45.327+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.435 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:28:45.327+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:28:45.327+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:28:45.327+0000 7f33de92c800 1 librados: init done 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:28:45.327+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cr dump hook 0x560925ef58f8 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:28:45.329+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:28:45.329+0000 7f32abfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:28:45.329+0000 7f32abfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:28:45.329+0000 7f32abfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:28:45.330+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x7f32a4076470 auth_method 0 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:28:45.330+0000 7f33dae50640 10 monclient: get_auth_request con 0x560925f059a0 auth_method 0 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:28:45.330+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:28:45.330+0000 7f33de92c800 20 realm 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:28:45.330+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.436 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:28:45.331+0000 7f33de92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:28:45.331+0000 7f33da64f640 10 monclient: get_auth_request con 0x560925f09cc0 auth_method 0 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:28:45.332+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:28:45.332+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:28:45.332+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x560925f0d3e0 auth_method 0 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:28:45.333+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:28:45.333+0000 7f33de92c800 20 searching for the correct realm 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:28:45.333+0000 7f33dae50640 10 monclient: get_auth_request con 0x560925f121a0 auth_method 0 2024-09-12T00:28:45.437 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:28:45.334+0000 7f33da64f640 10 monclient: get_auth_request con 0x7f33d402b060 auth_method 0 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:28:45.334+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x7f33cc0b9020 auth_method 0 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:28:45.336+0000 7f33dae50640 0 -- 172.21.15.33:0/3332903883 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x560925f059a0 msgr2=0x560925f07dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:28:45.336+0000 7f32abfff640 1 client.7995.objecter ms_handle_reset 0x560925f059a0 session 0x560925f05320 osd.1 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:28:45.336+0000 7f32abfff640 10 monclient: _renew_subs 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:28:45.336+0000 7f32abfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:28:45.336+0000 7f33dae50640 10 monclient: get_auth_request con 0x7f32a4086c20 auth_method 0 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:28:45.336+0000 7f33dae50640 10 monclient: get_auth_request con 0x7f33d0042040 auth_method 0 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:28:45.338+0000 7f33da64f640 10 monclient: get_auth_request con 0x7f33d00363f0 auth_method 0 2024-09-12T00:28:45.438 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:28:45.339+0000 7f33d9e4e640 0 -- 172.21.15.33:0/3332903883 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x560925f0d3e0 msgr2=0x560925f0f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:28:45.339+0000 7f32abfff640 1 client.7995.objecter ms_handle_reset 0x560925f0d3e0 session 0x560925f09560 osd.4 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:28:45.339+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x560925f059a0 auth_method 0 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.439 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 zone default found 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:28:45.344+0000 7f33de92c800 4 Realm: () 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:28:45.344+0000 7f33de92c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:28:45.344+0000 7f33de92c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:28:45.344+0000 7f33de92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 zonegroup default 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.440 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 started sync module instance, tier type = 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=0 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=1 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=2 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=3 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=4 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=5 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=6 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:28:45.354+0000 7f33de92c800 20 add_watcher() i=7 2024-09-12T00:28:45.441 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:28:45.354+0000 7f33de92c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding auth protocol: cephx 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding auth protocol: cephx 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding auth protocol: cephx 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.442 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:28:45.356+0000 7f3290fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:28:45.356+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:28:45.356+0000 7f33de92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:28:45.356+0000 7f33de92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cache list hook 0x560925ee2620 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cache inspect hook 0x560925ee2620 2024-09-12T00:28:45.443 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cache erase hook 0x560925ee2620 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cache zap hook 0x560925ee2620 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 note: GC not initialized 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:28:45.357+0000 7f320b7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:28:45.357+0000 7f33de92c800 5 asok(0x560925bfa630) register_command sync trace show hook 0x7f33cc0a9f20 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:28:45.357+0000 7f33de92c800 5 asok(0x560925bfa630) register_command sync trace history hook 0x7f33cc0a9f20 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:28:45.357+0000 7f33de92c800 5 asok(0x560925bfa630) register_command sync trace active hook 0x7f33cc0a9f20 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:28:45.357+0000 7f33de92c800 5 asok(0x560925bfa630) register_command sync trace active_short hook 0x7f33cc0a9f20 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 Filter name: none 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:28:45.357+0000 7f32097fa640 20 reqs_thread_entry: start 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.444 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:28:45.357+0000 7f33de92c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 : miss 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:28:45.358+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:28:45.364+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:28:45.364+0000 7f33de92c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.445 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:28:45.364+0000 7f33de92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:28:45.364+0000 7f33de92c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40, ofs0, ns] 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94597291266336 notifier 7995 bl.length()=1015 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_sources= new_sources= 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential sources added=[] removed=[] 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_dests= new_dests= 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential dests added=[] removed=[] 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.0 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.0 2024-09-12T00:28:45.446 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.1 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.1 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.2 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.2 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.3 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.3 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.4 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.4 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.5 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.5 2024-09-12T00:28:45.447 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.6 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.6 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.7 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.7 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.8 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.8 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.9 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.9 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.10 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.10 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.11 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.11 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.0 2024-09-12T00:28:45.448 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:28:45.372+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:28:45.372+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.3 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.4 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.5 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.6 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:28:45.374+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.7 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.8 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.9 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.10 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:28:45.379+0000 7f33de92c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f33de92c800 time 2024-09-12T00:28:45.379756+0000 2024-09-12T00:28:45.449 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f33e018c71a] 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f33e018c8d8] 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5609247d1641] 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5609247e051b] 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5609247e13e4] 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f33dee29590] 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.450 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:28:45.380+0000 7f33de92c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f33de92c800 thread_name:radosgw-admin 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f33dee3e6f0] 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f33dee8b99c] 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f33e018c774] 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f33e018c8d8] 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5609247d1641] 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5609247e051b] 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5609247e13e4] 2024-09-12T00:28:45.451 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f33dee29590] 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:28:45.452 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:28:45.453 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:28:45.454 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:28:45.455 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:28:45.456 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:28:45.457 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:28:45.458 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32097fa640 / http_manager 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f320b7fe640 / http_manager 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f3290fe1640 / rgw_dt_lg_renew 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32abfff640 / ms_dispatch 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32bd7fa640 / io_context_pool 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32bdffb640 / io_context_pool 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32bffff640 / ms_dispatch 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32c6e05640 / ms_dispatch 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32c8608640 / io_context_pool 2024-09-12T00:28:45.459 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33d9e4e640 / msgr-worker-2 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33da64f640 / msgr-worker-1 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33dae50640 / msgr-worker-0 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33db651640 / io_context_pool 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33de92c800 / radosgw-admin 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.142211.log 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:28:45.311+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:28:45.311+0000 7f33de92c800 1 librados: starting msgr at 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:28:45.311+0000 7f33de92c800 1 librados: starting objecter 2024-09-12T00:28:45.460 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 asok(0x560925bfa630) register_command objecter_requests hook 0x560925e4c570 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:28:45.312+0000 7f33de92c800 1 librados: setting wanted keys 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:28:45.312+0000 7f33de92c800 1 librados: calling monclient init 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient: init 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding auth protocol: cephx 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding auth protocol: cephx 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding auth protocol: cephx 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.461 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: crc 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 AuthRegistry(0x560925e1b2a0) adding con mode: secure 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:28:45.312+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:28:45.312+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:28:45.312+0000 7f33de92c800 5 asok(0x560925bfa630) register_command rotate-key hook 0x560925e1b3e8 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-a con 0x560925cc8b10 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-b con 0x560925cd3280 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-c con 0x560925d5e450 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.462 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:28:45.312+0000 7f33de92c800 10 monclient(hunting): authenticate will time out at 2344.877743s 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): get_auth_request con 0x560925cc8b10 auth_method 0 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): get_auth_request con 0x560925d5e450 auth_method 0 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.463 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:28:45.312+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:28:45.312+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:28:45.313+0000 7f33da64f640 10 monclient(hunting): handle_auth_done global_id 7986 payload 824 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:28:45.313+0000 7f33da64f640 10 monclient: _finish_hunting 0 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:28:45.313+0000 7f33da64f640 1 monclient: found mon.noname-a 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:28:45.313+0000 7f33da64f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:28:45.313+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x560925cd3280 auth_method 0 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:28:45.464 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: dump: 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: _finish_auth 0 2024-09-12T00:28:45.465 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: _check_auth_tickets 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:28:45.313+0000 7f32c6e05640 10 monclient: dump: 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.466 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:28:45.313+0000 7f33de92c800 5 monclient: authenticate success, global_id 7986 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:28:45.313+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:28:45.313+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:28:45.313+0000 7f32c8608640 4 set_mon_vals no callback set 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:28:45.313+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:28:45.313+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:28:45.313+0000 7f33de92c800 1 librados: init done 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:28:45.315+0000 7f32c6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:28:45.315+0000 7f32c6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:28:45.315+0000 7f32c6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:28:45.315+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x7f32c0076470 auth_method 0 2024-09-12T00:28:45.467 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:28:45.316+0000 7f33dae50640 10 monclient: get_auth_request con 0x560925e597e0 auth_method 0 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:28:45.317+0000 7f33da64f640 10 monclient: get_auth_request con 0x560925e669e0 auth_method 0 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:28:45.317+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x560925e6ae70 auth_method 0 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:28:45.319+0000 7f33de92c800 10 monclient: build_initial_monmap 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:28:45.319+0000 7f33de92c800 1 build_initial for_mkfs: 0 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:28:45.319+0000 7f33de92c800 10 monclient: monmap: 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:45.468 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding auth protocol: cephx 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding auth protocol: cephx 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding auth protocol: cephx 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.469 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: crc 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6fc70) adding con mode: secure 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:28:45.319+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 asok(0x560925bfa630) register_command objecter_requests cmddesc objecter_requests hook 0x560925e736e0 EEXIST 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:28:45.319+0000 7f33de92c800 10 monclient: init 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding auth protocol: cephx 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding auth protocol: cephx 2024-09-12T00:28:45.470 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding auth protocol: cephx 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: crc 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:28:45.319+0000 7f33de92c800 5 AuthRegistry(0x560925e6e3d8) adding con mode: secure 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:28:45.320+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.471 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:28:45.320+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:28:45.320+0000 7f33de92c800 5 asok(0x560925bfa630) register_command rotate-key cmddesc rotate-key hook 0x560925e6e520 EEXIST 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-b con 0x560925e973d0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-c con 0x560925e996a0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-a con 0x560925e95ba0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:28:45.320+0000 7f33de92c800 10 monclient(hunting): authenticate will time out at 2344.885395s 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request con 0x560925e996a0 auth_method 0 2024-09-12T00:28:45.472 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): get_auth_request con 0x560925e95ba0 auth_method 0 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:28:45.320+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.473 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient(hunting): handle_auth_done global_id 7989 payload 824 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient: _finish_hunting 0 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:28:45.320+0000 7f33dae50640 1 monclient: found mon.noname-a 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:28:45.320+0000 7f33dae50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: dump: 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.474 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: _finish_auth 0 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: _check_auth_tickets 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:28:45.321+0000 7f32bffff640 10 monclient: dump: 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.475 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:28:45.321+0000 7f33de92c800 5 monclient: authenticate success, global_id 7989 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:28:45.321+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:28:45.321+0000 7f33db651640 4 set_mon_vals no callback set 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:28:45.321+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:28:45.321+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:28:45.321+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:28:45.323+0000 7f32bffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:28:45.323+0000 7f32bffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.476 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:28:45.323+0000 7f32bffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:28:45.323+0000 7f33da64f640 10 monclient: get_auth_request con 0x7f32b4076380 auth_method 0 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:28:45.323+0000 7f33de92c800 10 monclient: get_monmap_and_config 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:28:45.323+0000 7f33de92c800 10 monclient: build_initial_monmap 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:28:45.323+0000 7f33de92c800 1 build_initial for_mkfs: 0 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:28:45.323+0000 7f33de92c800 10 monclient: monmap: 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:45.477 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding auth protocol: cephx 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding auth protocol: cephx 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding auth protocol: cephx 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.478 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: crc 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:28:45.323+0000 7f33de92c800 5 AuthRegistry(0x560925eb72a0) adding con mode: secure 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:28:45.323+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient: init 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding auth protocol: cephx 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding auth protocol: cephx 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding auth protocol: cephx 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.479 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: crc 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954c980) adding con mode: secure 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:28:45.324+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:28:45.324+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:28:45.324+0000 7f33de92c800 5 asok(0x560925bfa630) register_command rotate-key cmddesc rotate-key hook 0x7ffcc954cac8 EEXIST 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-c con 0x560925eeb860 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-a con 0x560925ee5e00 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-b con 0x560925ebb6a0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:45.480 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:28:45.324+0000 7f33de92c800 10 monclient(hunting): authenticate will time out at 2344.889596s 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): get_auth_request con 0x560925eeb860 auth_method 0 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request con 0x560925ee5e00 auth_method 0 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.481 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:28:45.324+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient(hunting): handle_auth_done global_id 7457 payload 274 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient: _finish_hunting 0 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:28:45.324+0000 7f33da64f640 1 monclient: found mon.noname-c 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:28:45.324+0000 7f33da64f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: dump: 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.482 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: _finish_auth 0 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: _check_auth_tickets 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:28:45.325+0000 7f32bdffb640 10 monclient: dump: 2024-09-12T00:28:45.483 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 monclient: authenticate success, global_id 7457 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:28:45.325+0000 7f33de92c800 10 monclient: get_monmap_and_config success 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:28:45.325+0000 7f33de92c800 4 set_mon_vals no callback set 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:28:45.325+0000 7f33de92c800 10 monclient: shutdown 2024-09-12T00:28:45.484 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:28:45.325+0000 7f33de92c800 10 monclient: build_initial_monmap 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:28:45.325+0000 7f33de92c800 1 build_initial for_mkfs: 0 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:28:45.325+0000 7f33de92c800 10 monclient: monmap: 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding auth protocol: cephx 2024-09-12T00:28:45.485 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding auth protocol: cephx 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding auth protocol: cephx 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: crc 2024-09-12T00:28:45.486 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:28:45.325+0000 7f33de92c800 5 AuthRegistry(0x560925ee6dc0) adding con mode: secure 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:28:45.326+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:28:45.326+0000 7f33de92c800 1 librados: starting msgr at 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:28:45.326+0000 7f33de92c800 1 librados: starting objecter 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 asok(0x560925bfa630) register_command objecter_requests cmddesc objecter_requests hook 0x560925e9a490 EEXIST 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:28:45.326+0000 7f33de92c800 1 librados: setting wanted keys 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:28:45.326+0000 7f33de92c800 1 librados: calling monclient init 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient: init 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding auth protocol: cephx 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding auth protocol: cephx 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding auth protocol: cephx 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.487 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: crc 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 AuthRegistry(0x560925eaf180) adding con mode: secure 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:28:45.326+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:28:45.326+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:28:45.326+0000 7f33de92c800 5 asok(0x560925bfa630) register_command rotate-key cmddesc rotate-key hook 0x560925eaf2c8 EEXIST 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient: _reopen_session rank -1 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:28:45.488 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-a con 0x560925ebb6a0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-c con 0x560925ee5e00 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): picked mon.noname-b con 0x560925eeb860 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): _renew_subs 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:28:45.326+0000 7f33de92c800 10 monclient(hunting): authenticate will time out at 2344.891917s 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): get_auth_request con 0x560925ebb6a0 auth_method 0 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.489 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request con 0x560925ee5e00 auth_method 0 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:28:45.327+0000 7f33d9e4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): get_auth_request con 0x560925eeb860 auth_method 0 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:28:45.490 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:28:45.327+0000 7f33dae50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient(hunting): handle_auth_done global_id 7995 payload 824 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient: _finish_hunting 0 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:28:45.327+0000 7f33da64f640 1 monclient: found mon.noname-a 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:28:45.327+0000 7f33da64f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: dump: 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.491 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: _finish_auth 0 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: _check_auth_tickets 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:28:45.327+0000 7f32abfff640 10 monclient: dump: 2024-09-12T00:28:45.492 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:28:45.327+0000 7f33de92c800 5 monclient: authenticate success, global_id 7995 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:28:45.327+0000 7f32bdffb640 4 set_mon_vals no callback set 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:28:45.327+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.493 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:28:45.327+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.496 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:28:45.327+0000 7f33de92c800 10 monclient: _renew_subs 2024-09-12T00:28:45.496 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:28:45.327+0000 7f33de92c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.496 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:28:45.327+0000 7f33de92c800 1 librados: init done 2024-09-12T00:28:45.496 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:28:45.327+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cr dump hook 0x560925ef58f8 2024-09-12T00:28:45.496 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:28:45.329+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:28:45.329+0000 7f32abfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:28:45.329+0000 7f32abfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:28:45.329+0000 7f32abfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:28:45.330+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x7f32a4076470 auth_method 0 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:28:45.330+0000 7f33dae50640 10 monclient: get_auth_request con 0x560925f059a0 auth_method 0 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:28:45.330+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:28:45.330+0000 7f33de92c800 20 realm 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:28:45.330+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:28:45.331+0000 7f33de92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.497 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:28:45.331+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:28:45.331+0000 7f33da64f640 10 monclient: get_auth_request con 0x560925f09cc0 auth_method 0 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:28:45.332+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:28:45.332+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:28:45.332+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x560925f0d3e0 auth_method 0 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:28:45.333+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:28:45.333+0000 7f33de92c800 20 searching for the correct realm 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:28:45.333+0000 7f33dae50640 10 monclient: get_auth_request con 0x560925f121a0 auth_method 0 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:28:45.334+0000 7f33da64f640 10 monclient: get_auth_request con 0x7f33d402b060 auth_method 0 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:28:45.334+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x7f33cc0b9020 auth_method 0 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:28:45.336+0000 7f33dae50640 0 -- 172.21.15.33:0/3332903883 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x560925f059a0 msgr2=0x560925f07dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:28:45.336+0000 7f32abfff640 1 client.7995.objecter ms_handle_reset 0x560925f059a0 session 0x560925f05320 osd.1 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:28:45.336+0000 7f32abfff640 10 monclient: _renew_subs 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:28:45.336+0000 7f32abfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:28:45.498 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:28:45.336+0000 7f33dae50640 10 monclient: get_auth_request con 0x7f32a4086c20 auth_method 0 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:28:45.336+0000 7f33dae50640 10 monclient: get_auth_request con 0x7f33d0042040 auth_method 0 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:28:45.338+0000 7f33da64f640 10 monclient: get_auth_request con 0x7f33d00363f0 auth_method 0 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:28:45.339+0000 7f33d9e4e640 0 -- 172.21.15.33:0/3332903883 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x560925f0d3e0 msgr2=0x560925f0f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:28:45.339+0000 7f32abfff640 1 client.7995.objecter ms_handle_reset 0x560925f0d3e0 session 0x560925f09560 osd.4 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:28:45.339+0000 7f33d9e4e640 10 monclient: get_auth_request con 0x560925f059a0 auth_method 0 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.499 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:28:45.343+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 zone default found 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:28:45.344+0000 7f33de92c800 4 Realm: () 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:28:45.344+0000 7f33de92c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:28:45.344+0000 7f33de92c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:28:45.344+0000 7f33de92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 zonegroup default 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.500 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 started sync module instance, tier type = 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:28:45.344+0000 7f33de92c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=0 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=1 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=2 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=3 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=4 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=5 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:28:45.353+0000 7f33de92c800 20 add_watcher() i=6 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:28:45.354+0000 7f33de92c800 20 add_watcher() i=7 2024-09-12T00:28:45.501 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:28:45.354+0000 7f33de92c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding auth protocol: cephx 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding auth protocol: cephx 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding auth protocol: cephx 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.502 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: crc 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 AuthRegistry(0x7ffcc954ce60) adding con mode: secure 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:28:45.356+0000 7f3290fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:28:45.356+0000 7f33de92c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:28:45.356+0000 7f33de92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:28:45.356+0000 7f33de92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cache list hook 0x560925ee2620 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cache inspect hook 0x560925ee2620 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cache erase hook 0x560925ee2620 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 asok(0x560925bfa630) register_command cache zap hook 0x560925ee2620 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:28:45.356+0000 7f33de92c800 5 note: GC not initialized 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:28:45.357+0000 7f320b7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:28:45.357+0000 7f33de92c800 5 asok(0x560925bfa630) register_command sync trace show hook 0x7f33cc0a9f20 2024-09-12T00:28:45.503 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:28:45.357+0000 7f33de92c800 5 asok(0x560925bfa630) register_command sync trace history hook 0x7f33cc0a9f20 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:28:45.357+0000 7f33de92c800 5 asok(0x560925bfa630) register_command sync trace active hook 0x7f33cc0a9f20 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:28:45.357+0000 7f33de92c800 5 asok(0x560925bfa630) register_command sync trace active_short hook 0x7f33cc0a9f20 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 Filter name: none 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:28:45.357+0000 7f32097fa640 20 reqs_thread_entry: start 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:28:45.357+0000 7f33de92c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:28:45.357+0000 7f33de92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 : miss 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:28:45.357+0000 7f33de92c800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:28:45.358+0000 7f33de92c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:28:45.504 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:28:45.358+0000 7f33de92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:28:45.364+0000 7f33de92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:28:45.364+0000 7f33de92c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:28:45.364+0000 7f33de92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:28:45.364+0000 7f33de92c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40, ofs0, ns] 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94597291266336 notifier 7995 bl.length()=1015 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:28:45.365+0000 7f32bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:45.505 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_sources= new_sources= 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential sources added=[] removed=[] 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_dests= new_dests= 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:28:45.366+0000 7f33de92c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential dests added=[] removed=[] 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.0 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.0 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.1 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.1 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.2 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.2 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.3 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.3 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.4 2024-09-12T00:28:45.506 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.4 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.5 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.5 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.6 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.6 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.7 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.7 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.8 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.8 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.9 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.9 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.10 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.10 2024-09-12T00:28:45.507 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:28:45.371+0000 7f33de92c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.11 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1.11 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.0 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:28:45.371+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:28:45.372+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:28:45.372+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.3 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.4 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.5 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:28:45.373+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.6 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:28:45.374+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.7 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.8 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.9 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:28:45.375+0000 7f33de92c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.10 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:28:45.379+0000 7f33de92c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f33de92c800 time 2024-09-12T00:28:45.379756+0000 2024-09-12T00:28:45.508 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f33e018c71a] 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f33e018c8d8] 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5609247d1641] 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5609247e051b] 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5609247e13e4] 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f33dee29590] 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:28:45.380+0000 7f33de92c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:28:45.509 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f33de92c800 thread_name:radosgw-admin 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f33dee3e6f0] 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f33dee8b99c] 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f33e018c774] 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f33e018c8d8] 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5609247d1641] 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5609247e051b] 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5609247e13e4] 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:28:45.510 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f33dee29590] 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:28:45.511 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:28:45.512 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:28:45.513 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:28:45.514 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:28:45.515 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:28:45.516 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:28:45.517 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32097fa640 / http_manager 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f320b7fe640 / http_manager 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f3290fe1640 / rgw_dt_lg_renew 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32abfff640 / ms_dispatch 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32bd7fa640 / io_context_pool 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32bdffb640 / io_context_pool 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32bffff640 / ms_dispatch 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32c6e05640 / ms_dispatch 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f32c8608640 / io_context_pool 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33d9e4e640 / msgr-worker-2 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33da64f640 / msgr-worker-1 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33dae50640 / msgr-worker-0 2024-09-12T00:28:45.518 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33db651640 / io_context_pool 2024-09-12T00:28:45.519 INFO:tasks.workunit.client.0.smithi033.stderr: 7f33de92c800 / radosgw-admin 2024-09-12T00:28:45.519 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:28:45.519 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:28:45.519 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:28:45.381394Z_aa9fbfbc-d8d2-4af6-9f5f-7983d633d176/log 2024-09-12T00:28:45.519 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:28:45.519 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:28:45.519 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:45.520 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:45.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.660+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.662+0000 7fbacda1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.662+0000 7fbacda1d800 20 realm 2024-09-12T00:28:45.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.662+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.662+0000 7fbacda1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.662+0000 7fbacda1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:45.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.662+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.662+0000 7fbacda1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.662+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.663+0000 7fbacda1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.663+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.664+0000 7fbacda1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:45.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.664+0000 7fbacda1d800 20 searching for the correct realm 2024-09-12T00:28:45.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.667+0000 7fbac89ea640 0 -- 172.21.15.33:0/3091461359 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55d274dec1d0 msgr2=0x55d274dee5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.670+0000 7fbac91eb640 0 -- 172.21.15.33:0/3091461359 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fbac0063070 msgr2=0x7fbac0091960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:45.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:45.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:45.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:45.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:45.877 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:45.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:45.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.877+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:45.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:45.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 20 zone default found 2024-09-12T00:28:45.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 4 Realm: () 2024-09-12T00:28:45.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:45.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:45.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 20 zonegroup default 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.878+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.879+0000 7fbacda1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.879+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.879+0000 7fbacda1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.879+0000 7fbacda1d800 20 started sync module instance, tier type = 2024-09-12T00:28:45.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.879+0000 7fbacda1d800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:45.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.889+0000 7fbacda1d800 20 add_watcher() i=0 2024-09-12T00:28:45.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.889+0000 7fbacda1d800 20 add_watcher() i=1 2024-09-12T00:28:45.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.889+0000 7fbacda1d800 20 add_watcher() i=2 2024-09-12T00:28:45.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.889+0000 7fbacda1d800 20 add_watcher() i=3 2024-09-12T00:28:45.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.889+0000 7fbacda1d800 20 add_watcher() i=4 2024-09-12T00:28:45.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.889+0000 7fbacda1d800 20 add_watcher() i=5 2024-09-12T00:28:45.889 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.889+0000 7fbacda1d800 20 add_watcher() i=6 2024-09-12T00:28:45.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.890+0000 7fbacda1d800 20 add_watcher() i=7 2024-09-12T00:28:45.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.890+0000 7fbacda1d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:45.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.892+0000 7fb97f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:45.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.892+0000 7fbacda1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:45.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.892+0000 7fbacda1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:45.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.893+0000 7fbacda1d800 5 note: GC not initialized 2024-09-12T00:28:45.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.893+0000 7fb97e7e4640 20 reqs_thread_entry: start 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.893+0000 7fbacda1d800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.893+0000 7fbacda1d800 20 Filter name: none 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.893+0000 7fb8effff640 20 reqs_thread_entry: start 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.893+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.893+0000 7fbacda1d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.894+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.894+0000 7fbacda1d800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.894+0000 7fbacda1d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:45.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.894+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.894+0000 7fbacda1d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:45.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.894+0000 7fbacda1d800 20 rados->read ofs=0 len=0 2024-09-12T00:28:45.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.895+0000 7fbacda1d800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:28:45.895 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.895+0000 7fbacda1d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:28:45.896 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.897+0000 7fb97f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:45.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.899+0000 7fbacda1d800 20 remove_watcher() i=0 2024-09-12T00:28:45.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.899+0000 7fbacda1d800 2 removed watcher, disabling cache 2024-09-12T00:28:45.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.900+0000 7fbacda1d800 20 remove_watcher() i=1 2024-09-12T00:28:45.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.902+0000 7fbacda1d800 20 remove_watcher() i=2 2024-09-12T00:28:45.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.903+0000 7fbacda1d800 20 remove_watcher() i=3 2024-09-12T00:28:45.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.904+0000 7fbacda1d800 20 remove_watcher() i=4 2024-09-12T00:28:45.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.905+0000 7fbacda1d800 20 remove_watcher() i=5 2024-09-12T00:28:45.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.906+0000 7fbacda1d800 20 remove_watcher() i=6 2024-09-12T00:28:45.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:45.907+0000 7fbacda1d800 20 remove_watcher() i=7 2024-09-12T00:28:45.919 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.919 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:28:45.919 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-change-reshard-state id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:28:45.919 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:28:45.921 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:45.921 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:45.952 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:28:45.952 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:28:46.010 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:28:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:46.045 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:46.086 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.086+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.087+0000 7f2c1c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:46.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.087+0000 7f2c1c728800 20 realm 2024-09-12T00:28:46.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.087+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.087+0000 7f2c1c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:46.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.087+0000 7f2c1c728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:46.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.087+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.087 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.088+0000 7f2c1c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:46.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.088+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.088 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.089+0000 7f2c1c728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:46.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.089+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.090+0000 7f2c1c728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:46.089 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.090+0000 7f2c1c728800 20 searching for the correct realm 2024-09-12T00:28:46.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.092+0000 7f2c18c4c640 0 -- 172.21.15.33:0/2943727578 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55cc09775150 msgr2=0x55cc09777610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:46.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.096+0000 7f2c1844b640 0 -- 172.21.15.33:0/2943727578 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f2c0c07a070 msgr2=0x7f2c0c086130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:46.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:46.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:28:46.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:28:46.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:46.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:46.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:46.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:46.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.303+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 20 zone default found 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 4 Realm: () 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 20 zonegroup default 2024-09-12T00:28:46.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:46.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.304+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.305+0000 7f2c1c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:46.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.305+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.305+0000 7f2c1c728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:46.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.305+0000 7f2c1c728800 20 started sync module instance, tier type = 2024-09-12T00:28:46.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.305+0000 7f2c1c728800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:28:46.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.314+0000 7f2c1c728800 20 add_watcher() i=0 2024-09-12T00:28:46.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.314+0000 7f2c1c728800 20 add_watcher() i=1 2024-09-12T00:28:46.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.314+0000 7f2c1c728800 20 add_watcher() i=2 2024-09-12T00:28:46.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.314+0000 7f2c1c728800 20 add_watcher() i=3 2024-09-12T00:28:46.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.314+0000 7f2c1c728800 20 add_watcher() i=4 2024-09-12T00:28:46.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.314+0000 7f2c1c728800 20 add_watcher() i=5 2024-09-12T00:28:46.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.314+0000 7f2c1c728800 20 add_watcher() i=6 2024-09-12T00:28:46.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.315+0000 7f2c1c728800 20 add_watcher() i=7 2024-09-12T00:28:46.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.315+0000 7f2c1c728800 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:46.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.317+0000 7f2acefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:46.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.317+0000 7f2c1c728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:46.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.317+0000 7f2c1c728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:46.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.317+0000 7f2c1c728800 5 note: GC not initialized 2024-09-12T00:28:46.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.317+0000 7f2acdfdb640 20 reqs_thread_entry: start 2024-09-12T00:28:46.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.317+0000 7f2c1c728800 20 init_complete bucket index max shards: 11 2024-09-12T00:28:46.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.317+0000 7f2c1c728800 20 Filter name: none 2024-09-12T00:28:46.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2a3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:46.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:28:46.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 : miss 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 20 rados->read ofs=0 len=0 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:28:46.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.318+0000 7f2c1c728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 2024-09-12T00:28:46.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.320+0000 7f2c1c728800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to be held by another RGW process; skipping for now 2024-09-12T00:28:46.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.321+0000 7f2acefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:46.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.323+0000 7f2c1c728800 20 remove_watcher() i=0 2024-09-12T00:28:46.322 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.323+0000 7f2c1c728800 2 removed watcher, disabling cache 2024-09-12T00:28:46.323 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.324+0000 7f2c1c728800 20 remove_watcher() i=1 2024-09-12T00:28:46.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.325+0000 7f2c1c728800 20 remove_watcher() i=2 2024-09-12T00:28:46.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.327+0000 7f2c1c728800 20 remove_watcher() i=3 2024-09-12T00:28:46.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.328+0000 7f2c1c728800 20 remove_watcher() i=4 2024-09-12T00:28:46.328 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.329+0000 7f2c1c728800 20 remove_watcher() i=5 2024-09-12T00:28:46.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.330+0000 7f2c1c728800 20 remove_watcher() i=6 2024-09-12T00:28:46.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:28:46.330+0000 7f2c1c728800 20 remove_watcher() i=7 2024-09-12T00:28:46.341 INFO:tasks.workunit.client.0.smithi033.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:29:16.365 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:29:16.401 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:16.401 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:16.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.450+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.451+0000 7f6f4500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.451+0000 7f6f4500e800 20 realm 2024-09-12T00:29:16.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.451+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.450 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.452+0000 7f6f4500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.452+0000 7f6f4500e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:16.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.452+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.452+0000 7f6f4500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.451 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.452+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.453+0000 7f6f4500e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:16.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.453+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.454+0000 7f6f4500e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:16.453 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.454+0000 7f6f4500e800 20 searching for the correct realm 2024-09-12T00:29:16.456 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.457+0000 7f6f3ff6a640 0 -- 172.21.15.33:0/569562658 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x55e83f396e30 msgr2=0x55e83f399270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:16.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.461+0000 7f6f3ff6a640 0 -- 172.21.15.33:0/569562658 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55e83f39e880 msgr2=0x55e83f3a0c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.465 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.466 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.466+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 20 zone default found 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 4 Realm: () 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 20 zonegroup default 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.467+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.467 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.468+0000 7f6f4500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.468+0000 7f6f4500e800 20 started sync module instance, tier type = 2024-09-12T00:29:16.468 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.468+0000 7f6f4500e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:16.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.478+0000 7f6f4500e800 20 add_watcher() i=0 2024-09-12T00:29:16.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.478+0000 7f6f4500e800 20 add_watcher() i=1 2024-09-12T00:29:16.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.478+0000 7f6f4500e800 20 add_watcher() i=2 2024-09-12T00:29:16.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.478+0000 7f6f4500e800 20 add_watcher() i=3 2024-09-12T00:29:16.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.478+0000 7f6f4500e800 20 add_watcher() i=4 2024-09-12T00:29:16.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.478+0000 7f6f4500e800 20 add_watcher() i=5 2024-09-12T00:29:16.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.478+0000 7f6f4500e800 20 add_watcher() i=6 2024-09-12T00:29:16.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.479+0000 7f6f4500e800 20 add_watcher() i=7 2024-09-12T00:29:16.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.479+0000 7f6f4500e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:16.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.481+0000 7f6df6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:16.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.481+0000 7f6f4500e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:16.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.481+0000 7f6f4500e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:16.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.481+0000 7f6f4500e800 5 note: GC not initialized 2024-09-12T00:29:16.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.481+0000 7f6df5fdb640 20 reqs_thread_entry: start 2024-09-12T00:29:16.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.481+0000 7f6f4500e800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:16.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.481+0000 7f6f4500e800 20 Filter name: none 2024-09-12T00:29:16.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6d677fe640 20 reqs_thread_entry: start 2024-09-12T00:29:16.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:29:16.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 : miss 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:29:16.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.482+0000 7f6f4500e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 2024-09-12T00:29:16.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.485+0000 7f6f4500e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:29:16.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.492+0000 7f6f4500e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:29:16.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.492+0000 7f6f4500e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:29:16.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.492+0000 7f6f4500e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:29:16.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.492+0000 7f6f4500e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40, ofs0, ns] 2024-09-12T00:29:16.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.493+0000 7f6e16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94455981571520 notifier 8052 bl.length()=1015 2024-09-12T00:29:16.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.493+0000 7f6e16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:29:16.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.493+0000 7f6e16ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:29:16.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.493+0000 7f6e16ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:29:16.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.494+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_sources= new_sources= 2024-09-12T00:29:16.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.494+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential sources added=[] removed=[] 2024-09-12T00:29:16.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.494+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_dests= new_dests= 2024-09-12T00:29:16.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.494+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential dests added=[] removed=[] 2024-09-12T00:29:16.500 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.0 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.0 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.1 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.1 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.2 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.2 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.3 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.3 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.4 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.4 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.5 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.5 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.6 2024-09-12T00:29:16.501 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.6 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.7 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.7 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.8 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.8 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.9 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.9 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.10 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.10 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.11 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2.11 2024-09-12T00:29:16.502 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.0 2024-09-12T00:29:16.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.502+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1 2024-09-12T00:29:16.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.503+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2 2024-09-12T00:29:16.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.504+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.3 2024-09-12T00:29:16.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.504+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.4 2024-09-12T00:29:16.503 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.505+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.5 2024-09-12T00:29:16.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.505+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.6 2024-09-12T00:29:16.504 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.506+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.7 2024-09-12T00:29:16.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.507+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.8 2024-09-12T00:29:16.505 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.507+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.9 2024-09-12T00:29:16.506 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.507+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.10 2024-09-12T00:29:16.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.511+0000 7f6f4500e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:16.510 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.511+0000 7f6f4500e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 2024-09-12T00:29:16.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.512+0000 7f6f4500e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:29:16.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.512+0000 7f6f4500e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:29:16.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.512+0000 7f6f4500e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:29:16.511 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.512+0000 7f6f4500e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40, ofs0, ns] 2024-09-12T00:29:16.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.513+0000 7f6e16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366194 cookie 94455981571520 notifier 8052 bl.length()=1015 2024-09-12T00:29:16.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.513+0000 7f6e16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:29:16.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.513+0000 7f6e16ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:29:16.512 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.513+0000 7f6e16ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:29:16.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.514+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_sources= new_sources= 2024-09-12T00:29:16.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.514+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential sources added=[] removed=[] 2024-09-12T00:29:16.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.514+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_dests= new_dests= 2024-09-12T00:29:16.513 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.514+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential dests added=[] removed=[] 2024-09-12T00:29:16.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.517+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.0 2024-09-12T00:29:16.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.517+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.1 2024-09-12T00:29:16.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.518+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.2 2024-09-12T00:29:16.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.518+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.3 2024-09-12T00:29:16.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.518+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.4 2024-09-12T00:29:16.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.519+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.5 2024-09-12T00:29:16.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.519+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.6 2024-09-12T00:29:16.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.519+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.7 2024-09-12T00:29:16.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.520+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.8 2024-09-12T00:29:16.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.520+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.9 2024-09-12T00:29:16.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.520+0000 7f6f4500e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40.10 2024-09-12T00:29:16.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.521+0000 7f6f4500e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:16.519 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.521+0000 7f6f4500e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 2024-09-12T00:29:16.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.522+0000 7f6f4500e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:29:16.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.522+0000 7f6f4500e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:29:16.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.522+0000 7f6f4500e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:29:16.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.522+0000 7f6f4500e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40, ofs0, ns] 2024-09-12T00:29:16.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.522+0000 7f6e177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366195 cookie 94455981571520 notifier 8052 bl.length()=983 2024-09-12T00:29:16.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.522+0000 7f6e177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 info.flags=0x17 2024-09-12T00:29:16.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.522+0000 7f6e177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 to cache LRU end 2024-09-12T00:29:16.521 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.522+0000 7f6e177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:29:16.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.524+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_sources= new_sources= 2024-09-12T00:29:16.522 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.524+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential sources added=[] removed=[] 2024-09-12T00:29:16.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.524+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): orig_dests= new_dests= 2024-09-12T00:29:16.523 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.524+0000 7f6f4500e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40]): potential dests added=[] removed=[] 2024-09-12T00:29:16.525 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.527+0000 7f6f4500e800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:29:16.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.529+0000 7f6df6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:16.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.531+0000 7f6f4500e800 20 remove_watcher() i=0 2024-09-12T00:29:16.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.531+0000 7f6f4500e800 2 removed watcher, disabling cache 2024-09-12T00:29:16.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.532+0000 7f6f4500e800 20 remove_watcher() i=1 2024-09-12T00:29:16.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.533+0000 7f6f4500e800 20 remove_watcher() i=2 2024-09-12T00:29:16.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.534+0000 7f6f4500e800 20 remove_watcher() i=3 2024-09-12T00:29:16.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.535+0000 7f6f4500e800 20 remove_watcher() i=4 2024-09-12T00:29:16.535 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.536+0000 7f6f4500e800 20 remove_watcher() i=5 2024-09-12T00:29:16.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.538+0000 7f6f4500e800 20 remove_watcher() i=6 2024-09-12T00:29:16.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.539+0000 7f6f4500e800 20 remove_watcher() i=7 2024-09-12T00:29:16.550 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:29:16.579 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:16.579 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:16.619 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.620+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.622+0000 7f1bec00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.622+0000 7f1bec00f800 20 realm 2024-09-12T00:29:16.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.622+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.622+0000 7f1bec00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.622+0000 7f1bec00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:16.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.622+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.622+0000 7f1bec00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.622+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.623+0000 7f1bec00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:16.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.623+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.624+0000 7f1bec00f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:16.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.624+0000 7f1bec00f800 20 searching for the correct realm 2024-09-12T00:29:16.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.627+0000 7f1bea2fa640 0 -- 172.21.15.33:0/309634295 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55b1902352a0 msgr2=0x55b1902376d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:16.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.630+0000 7f1be9af9640 0 -- 172.21.15.33:0/309634295 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f1bd40c6a80 msgr2=0x7f1bd40b39b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:16.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.634+0000 7f1bec00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:16.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.634+0000 7f1bec00f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:16.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.634+0000 7f1bec00f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:16.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.634+0000 7f1bec00f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:16.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.634+0000 7f1bec00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:16.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.634+0000 7f1bec00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:16.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.634+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.634 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 zone default found 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 4 Realm: () 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 zonegroup default 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.635+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.636+0000 7f1bec00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.636+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.636+0000 7f1bec00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:16.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.636+0000 7f1bec00f800 20 started sync module instance, tier type = 2024-09-12T00:29:16.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.636+0000 7f1bec00f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:16.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.646+0000 7f1bec00f800 20 add_watcher() i=0 2024-09-12T00:29:16.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.646+0000 7f1bec00f800 20 add_watcher() i=1 2024-09-12T00:29:16.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.646+0000 7f1bec00f800 20 add_watcher() i=2 2024-09-12T00:29:16.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.646+0000 7f1bec00f800 20 add_watcher() i=3 2024-09-12T00:29:16.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.646+0000 7f1bec00f800 20 add_watcher() i=4 2024-09-12T00:29:16.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.646+0000 7f1bec00f800 20 add_watcher() i=5 2024-09-12T00:29:16.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.646+0000 7f1bec00f800 20 add_watcher() i=6 2024-09-12T00:29:16.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.647+0000 7f1bec00f800 20 add_watcher() i=7 2024-09-12T00:29:16.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.647+0000 7f1bec00f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:16.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.648+0000 7f1a9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:16.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.649+0000 7f1bec00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:16.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.649+0000 7f1bec00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:16.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.649+0000 7f1bec00f800 5 note: GC not initialized 2024-09-12T00:29:16.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.649+0000 7f1a9a7fc640 20 reqs_thread_entry: start 2024-09-12T00:29:16.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.649+0000 7f1bec00f800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:16.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.649+0000 7f1bec00f800 20 Filter name: none 2024-09-12T00:29:16.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.649+0000 7f1a0bfff640 20 reqs_thread_entry: start 2024-09-12T00:29:16.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.649+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.650+0000 7f1bec00f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:29:16.649 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.650+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.650+0000 7f1bec00f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:29:16.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.650+0000 7f1bec00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:16.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.650+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.651+0000 7f1bec00f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:29:16.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.651+0000 7f1bec00f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:16.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.651+0000 7f1bec00f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:29:16.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.651+0000 7f1bec00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:16.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.653+0000 7f1a9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:16.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.655+0000 7f1bec00f800 20 remove_watcher() i=0 2024-09-12T00:29:16.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.655+0000 7f1bec00f800 2 removed watcher, disabling cache 2024-09-12T00:29:16.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.656+0000 7f1bec00f800 20 remove_watcher() i=1 2024-09-12T00:29:16.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.657+0000 7f1bec00f800 20 remove_watcher() i=2 2024-09-12T00:29:16.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.658+0000 7f1bec00f800 20 remove_watcher() i=3 2024-09-12T00:29:16.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.659+0000 7f1bec00f800 20 remove_watcher() i=4 2024-09-12T00:29:16.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.660+0000 7f1bec00f800 20 remove_watcher() i=5 2024-09-12T00:29:16.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.661+0000 7f1bec00f800 20 remove_watcher() i=6 2024-09-12T00:29:16.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:16.662+0000 7f1bec00f800 20 remove_watcher() i=7 2024-09-12T00:29:16.672 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:16.672 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:29:16.672 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: abort-at-change-reshard-state id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:29:16.672 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:16.674 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:29:16.674 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:29:16.696 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:29:16.696 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:29:16.881 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:29:16.881 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:29:17.026 INFO:tasks.workunit.client.0.smithi033.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:29:17.027 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:17.056 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:17.057 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:17.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.098+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.099+0000 7f2e0ad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.099+0000 7f2e0ad39800 20 realm 2024-09-12T00:29:17.098 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.099+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.100+0000 7f2e0ad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.100+0000 7f2e0ad39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:17.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.100+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.100+0000 7f2e0ad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.100+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.101+0000 7f2e0ad39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:17.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.101+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.101+0000 7f2e0ad39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:17.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.101+0000 7f2e0ad39800 20 searching for the correct realm 2024-09-12T00:29:17.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.104+0000 7f2e069c7640 0 -- 172.21.15.33:0/3206505818 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f2e00065ba0 msgr2=0x7f2e00064610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:17.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.309+0000 7f2e069c7640 0 -- 172.21.15.33:0/3206505818 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f2dfc059030 msgr2=0x7f2dfc058900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:17.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:17.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:17.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:17.515 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:17.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:17.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:17.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.516+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:17.516 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:17.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 20 zone default found 2024-09-12T00:29:17.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 4 Realm: () 2024-09-12T00:29:17.517 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 20 zonegroup default 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.517+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.518+0000 7f2e0ad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.518+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.518+0000 7f2e0ad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.518+0000 7f2e0ad39800 20 started sync module instance, tier type = 2024-09-12T00:29:17.518 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.518+0000 7f2e0ad39800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:17.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.528+0000 7f2e0ad39800 20 add_watcher() i=0 2024-09-12T00:29:17.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.528+0000 7f2e0ad39800 20 add_watcher() i=1 2024-09-12T00:29:17.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.528+0000 7f2e0ad39800 20 add_watcher() i=2 2024-09-12T00:29:17.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.528+0000 7f2e0ad39800 20 add_watcher() i=3 2024-09-12T00:29:17.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.528+0000 7f2e0ad39800 20 add_watcher() i=4 2024-09-12T00:29:17.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.528+0000 7f2e0ad39800 20 add_watcher() i=5 2024-09-12T00:29:17.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.529+0000 7f2e0ad39800 20 add_watcher() i=6 2024-09-12T00:29:17.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.529+0000 7f2e0ad39800 20 add_watcher() i=7 2024-09-12T00:29:17.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.529+0000 7f2e0ad39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:17.529 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.530+0000 7f2cbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:17.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.531+0000 7f2e0ad39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:17.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.531+0000 7f2e0ad39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:17.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.531+0000 7f2e0ad39800 5 note: GC not initialized 2024-09-12T00:29:17.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.531+0000 7f2c37fff640 20 reqs_thread_entry: start 2024-09-12T00:29:17.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.531+0000 7f2e0ad39800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:17.530 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.531+0000 7f2e0ad39800 20 Filter name: none 2024-09-12T00:29:17.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.531+0000 7f2c35ffb640 20 reqs_thread_entry: start 2024-09-12T00:29:17.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.531+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.532+0000 7f2e0ad39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:17.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.532+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.533+0000 7f2e0ad39800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:17.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.533+0000 7f2e0ad39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:17.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.533+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.533+0000 7f2e0ad39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:17.532 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.533+0000 7f2e0ad39800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.534+0000 7f2e0ad39800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:17.533 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.534+0000 7f2e0ad39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:17.534 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.536+0000 7f2cbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:17.536 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.538+0000 7f2e0ad39800 20 remove_watcher() i=0 2024-09-12T00:29:17.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.538+0000 7f2e0ad39800 2 removed watcher, disabling cache 2024-09-12T00:29:17.537 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.539+0000 7f2e0ad39800 20 remove_watcher() i=1 2024-09-12T00:29:17.539 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.540+0000 7f2e0ad39800 20 remove_watcher() i=2 2024-09-12T00:29:17.540 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.541+0000 7f2e0ad39800 20 remove_watcher() i=3 2024-09-12T00:29:17.541 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.542+0000 7f2e0ad39800 20 remove_watcher() i=4 2024-09-12T00:29:17.542 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.544+0000 7f2e0ad39800 20 remove_watcher() i=5 2024-09-12T00:29:17.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.545+0000 7f2e0ad39800 20 remove_watcher() i=6 2024-09-12T00:29:17.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.546+0000 7f2e0ad39800 20 remove_watcher() i=7 2024-09-12T00:29:17.556 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:17.556 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:29:17.556 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: a-bucket id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:29:17.556 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:17.557 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:17.588 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:17.588 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:17.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.630+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.632+0000 7fdc00525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.632+0000 7fdc00525800 20 realm 2024-09-12T00:29:17.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.632+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.632+0000 7fdc00525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.632+0000 7fdc00525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:17.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.632+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.633+0000 7fdc00525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.633+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.633+0000 7fdc00525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:17.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.633+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.634+0000 7fdc00525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:17.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.634+0000 7fdc00525800 20 searching for the correct realm 2024-09-12T00:29:17.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.638+0000 7fdbfb932640 0 -- 172.21.15.33:0/1093903194 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5613a93765c0 msgr2=0x5613a93789b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:17.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.642+0000 7fdbfc934640 0 -- 172.21.15.33:0/1093903194 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fdbf0017020 msgr2=0x7fdbf005f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:17.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:17.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:17.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:17.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:17.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:17.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:17.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.645 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.645+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:17.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:17.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 zone default found 2024-09-12T00:29:17.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 4 Realm: () 2024-09-12T00:29:17.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 zonegroup default 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.646+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.647+0000 7fdc00525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.647+0000 7fdc00525800 20 started sync module instance, tier type = 2024-09-12T00:29:17.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.647+0000 7fdc00525800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:17.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.657+0000 7fdc00525800 20 add_watcher() i=0 2024-09-12T00:29:17.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.657+0000 7fdc00525800 20 add_watcher() i=1 2024-09-12T00:29:17.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.657+0000 7fdc00525800 20 add_watcher() i=2 2024-09-12T00:29:17.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.657+0000 7fdc00525800 20 add_watcher() i=3 2024-09-12T00:29:17.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.657+0000 7fdc00525800 20 add_watcher() i=4 2024-09-12T00:29:17.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.657+0000 7fdc00525800 20 add_watcher() i=5 2024-09-12T00:29:17.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.657+0000 7fdc00525800 20 add_watcher() i=6 2024-09-12T00:29:17.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.658+0000 7fdc00525800 20 add_watcher() i=7 2024-09-12T00:29:17.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.658+0000 7fdc00525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:17.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.659+0000 7fdab2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:17.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.660+0000 7fdc00525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:17.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.660+0000 7fdc00525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:17.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.660+0000 7fdc00525800 5 note: GC not initialized 2024-09-12T00:29:17.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.660+0000 7fdab1fdb640 20 reqs_thread_entry: start 2024-09-12T00:29:17.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.660+0000 7fdc00525800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:17.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.660+0000 7fdc00525800 20 Filter name: none 2024-09-12T00:29:17.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.660+0000 7fda237fe640 20 reqs_thread_entry: start 2024-09-12T00:29:17.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.660+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.661+0000 7fdc00525800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:17.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.661+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.661+0000 7fdc00525800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:17.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.661+0000 7fdc00525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:17.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.661+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.662+0000 7fdc00525800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:17.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.662+0000 7fdc00525800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.662+0000 7fdc00525800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:17.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.662+0000 7fdc00525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:17.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.664+0000 7fdab2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:17.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.666+0000 7fdc00525800 20 remove_watcher() i=0 2024-09-12T00:29:17.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.666+0000 7fdc00525800 2 removed watcher, disabling cache 2024-09-12T00:29:17.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.667+0000 7fdc00525800 20 remove_watcher() i=1 2024-09-12T00:29:17.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.668+0000 7fdc00525800 20 remove_watcher() i=2 2024-09-12T00:29:17.667 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.669+0000 7fdc00525800 20 remove_watcher() i=3 2024-09-12T00:29:17.668 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.670+0000 7fdc00525800 20 remove_watcher() i=4 2024-09-12T00:29:17.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.670+0000 7fdc00525800 20 remove_watcher() i=5 2024-09-12T00:29:17.670 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.671+0000 7fdc00525800 20 remove_watcher() i=6 2024-09-12T00:29:17.671 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.672+0000 7fdc00525800 20 remove_watcher() i=7 2024-09-12T00:29:17.683 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:29:17.718 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:17.718 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:17.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.759+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.761+0000 7fd5db737800 20 realm 2024-09-12T00:29:17.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.761+0000 7fd5db737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:17.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.760 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.762+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:17.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.762+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.763+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:17.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.763+0000 7fd5db737800 20 searching for the correct realm 2024-09-12T00:29:17.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.764+0000 7fd5d7421640 0 -- 172.21.15.33:0/207101822 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd5c4003c80 msgr2=0x7fd5d0025420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:17.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.969+0000 7fd5cec20640 0 -- 172.21.15.33:0/207101822 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fd5c8026070 msgr2=0x7fd5c805e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:17.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:17.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:17.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:17.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:17.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:17.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:17.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.974 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 20 zone default found 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 4 Realm: () 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:17.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 20 zonegroup default 2024-09-12T00:29:17.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:17.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.977+0000 7fd5db737800 20 started sync module instance, tier type = 2024-09-12T00:29:17.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.977+0000 7fd5db737800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:17.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=0 2024-09-12T00:29:17.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=1 2024-09-12T00:29:17.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=2 2024-09-12T00:29:17.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=3 2024-09-12T00:29:17.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=4 2024-09-12T00:29:17.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=5 2024-09-12T00:29:17.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=6 2024-09-12T00:29:17.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.987+0000 7fd5db737800 20 add_watcher() i=7 2024-09-12T00:29:17.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.987+0000 7fd5db737800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:17.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.989+0000 7fd48dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:17.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.989+0000 7fd5db737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:17.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.989+0000 7fd5db737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:17.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.989+0000 7fd5db737800 5 note: GC not initialized 2024-09-12T00:29:17.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd48cfe1640 20 reqs_thread_entry: start 2024-09-12T00:29:17.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:17.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 20 Filter name: none 2024-09-12T00:29:17.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd4067fc640 20 reqs_thread_entry: start 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.991+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.991+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.991+0000 7fd5db737800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.991+0000 7fd5db737800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.991+0000 7fd5db737800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:17.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.991+0000 7fd5db737800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:17.994 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.996+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:17.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.996+0000 7fd5db737800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:17.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.996+0000 7fd5db737800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:17.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.996+0000 7fd5db737800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:29:17.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366202 cookie 94646625073152 notifier 7577 bl.length()=911 2024-09-12T00:29:17.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:17.995 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:17.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:17.996 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:29:17.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:29:17.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:29:17.997 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.1 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.1 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.2 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.2 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.3 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.3 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.4 2024-09-12T00:29:18.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.4 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.5 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.5 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.6 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.6 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.7 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.7 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.8 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.8 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.9 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.9 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.10 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.10 2024-09-12T00:29:18.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.11 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.11 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.12 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.12 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.13 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.13 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:18.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:18.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.004+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:18.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.004+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:18.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.004+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:18.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.004+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:18.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.005+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:18.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.005+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:18.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.005+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:18.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.005+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:18.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.006+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:18.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.006+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:18.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.006+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:18.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.006+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:18.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.008+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:18.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.008+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:18.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.008+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:18.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.008+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:18.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.009+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:18.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.009+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:18.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.009+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:18.008 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.009+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:18.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.010+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:18.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.010+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:18.011 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5db737800 time 2024-09-12T00:29:18.013745+0000 2024-09-12T00:29:18.011 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:18.012 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:18.012 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5dcd8c71a] 2024-09-12T00:29:18.012 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd5dcd8c8d8] 2024-09-12T00:29:18.012 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5614a0be2641] 2024-09-12T00:29:18.012 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5614a0bf151b] 2024-09-12T00:29:18.012 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5614a0bf23e4] 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd5dba29590] 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.013+0000 7fd5db737800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5db737800 time 2024-09-12T00:29:18.013745+0000 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5dcd8c71a] 2024-09-12T00:29:18.013 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd5dcd8c8d8] 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5614a0be2641] 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5614a0bf151b] 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5614a0bf23e4] 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd5dba29590] 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:29:18.014 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fd5db737800 thread_name:radosgw-admin 2024-09-12T00:29:18.031 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:18.031 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5dba3e6f0] 2024-09-12T00:29:18.031 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5dba8b99c] 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5dcd8c774] 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd5dcd8c8d8] 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5614a0be2641] 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5614a0bf151b] 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5614a0bf23e4] 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd5dba29590] 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:29:18.032 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.014+0000 7fd5db737800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fd5db737800 thread_name:radosgw-admin 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5dba3e6f0] 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5dba8b99c] 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5dcd8c774] 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd5dcd8c8d8] 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5614a0be2641] 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5614a0bf151b] 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5614a0bf23e4] 2024-09-12T00:29:18.033 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd5dba29590] 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-a con 0x5614a267dc90 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-b con 0x7fd5c40030f0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): authenticate will time out at 2377.308502s 2024-09-12T00:29:18.034 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): get_auth_request con 0x5614a267d310 auth_method 0 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): get_auth_request con 0x5614a267dc90 auth_method 0 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request con 0x7fd5c40030f0 auth_method 0 2024-09-12T00:29:18.035 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): handle_auth_done global_id 7568 payload 824 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient: _finish_hunting 0 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:29:17.743+0000 7fd5d7421640 1 monclient: found mon.noname-c 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: dump: 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.036 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: _finish_auth 0 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: _check_auth_tickets 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: dump: 2024-09-12T00:29:18.037 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:29:17.744+0000 7fd5db737800 5 monclient: authenticate success, global_id 7568 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:29:17.744+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:29:17.744+0000 7fd4c560a640 4 set_mon_vals no callback set 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:29:17.744+0000 7fd5db737800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.038 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:29:17.744+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:29:17.744+0000 7fd5db737800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:29:17.744+0000 7fd5db737800 1 librados: init done 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:29:17.746+0000 7fd4c3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:29:17.746+0000 7fd4c3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:29:17.746+0000 7fd4c3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:29:17.746+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd4bc076470 auth_method 0 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:29:17.747+0000 7fd5d7c22640 10 monclient: get_auth_request con 0x5614a26abfb0 auth_method 0 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:29:17.747+0000 7fd5d7421640 10 monclient: get_auth_request con 0x5614a26c2ad0 auth_method 0 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:29:17.748+0000 7fd5cec20640 10 monclient: get_auth_request con 0x5614a26c6e30 auth_method 0 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:29:17.749+0000 7fd5db737800 10 monclient: build_initial_monmap 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:29:17.749+0000 7fd5db737800 1 build_initial for_mkfs: 0 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:29:17.749+0000 7fd5db737800 10 monclient: monmap: 2024-09-12T00:29:18.039 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding auth protocol: cephx 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding auth protocol: cephx 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding auth protocol: cephx 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.040 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:29:17.750+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 asok(0x5614a2454630) register_command objecter_requests cmddesc objecter_requests hook 0x5614a26cf6b0 EEXIST 2024-09-12T00:29:18.041 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient: init 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding auth protocol: cephx 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding auth protocol: cephx 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding auth protocol: cephx 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.042 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:29:17.750+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:29:17.750+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 asok(0x5614a2454630) register_command rotate-key cmddesc rotate-key hook 0x5614a26ca4c0 EEXIST 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-b con 0x5614a26f33a0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-c con 0x5614a26f5670 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-a con 0x5614a26f1b70 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.043 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): authenticate will time out at 2377.316029s 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): get_auth_request con 0x5614a26f5670 auth_method 0 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request con 0x5614a26f1b70 auth_method 0 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): get_auth_request con 0x5614a26f33a0 auth_method 0 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.044 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): handle_auth_done global_id 7021 payload 824 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient: _finish_hunting 0 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:29:17.751+0000 7fd5d7421640 1 monclient: found mon.noname-b 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.162:3300/0 2024-09-12T00:29:18.045 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: dump: 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.046 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: _finish_auth 0 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: _check_auth_tickets 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:29:17.751+0000 7fd5db737800 5 monclient: authenticate success, global_id 7021 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.162:3300/0 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:29:17.751+0000 7fd5d8423640 4 set_mon_vals no callback set 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: dump: 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.047 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.162:3300/0 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:29:17.753+0000 7fd4c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:29:17.753+0000 7fd4c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:29:17.753+0000 7fd4c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:29:17.753+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd4b0076380 auth_method 0 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:29:17.754+0000 7fd5db737800 10 monclient: get_monmap_and_config 2024-09-12T00:29:18.048 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:29:17.754+0000 7fd5db737800 10 monclient: build_initial_monmap 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:29:17.754+0000 7fd5db737800 1 build_initial for_mkfs: 0 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:29:17.754+0000 7fd5db737800 10 monclient: monmap: 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.049 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding auth protocol: cephx 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding auth protocol: cephx 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding auth protocol: cephx 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.050 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:29:17.754+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:29:17.754+0000 7fd5db737800 10 monclient: init 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding auth protocol: cephx 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding auth protocol: cephx 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding auth protocol: cephx 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.051 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:29:17.754+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:29:17.754+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 asok(0x5614a2454630) register_command rotate-key cmddesc rotate-key hook 0x7ffdb5c5bb08 EEXIST 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:29:18.052 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-b con 0x5614a2747250 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-a con 0x5614a2737ba0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-c con 0x5614a2742680 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): authenticate will time out at 2377.320082s 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): get_auth_request con 0x5614a2737ba0 auth_method 0 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request con 0x5614a2742680 auth_method 0 2024-09-12T00:29:18.053 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:29:17.755+0000 7fd5d7421640 10 monclient(hunting): get_auth_request con 0x5614a2747250 auth_method 0 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:29:17.755+0000 7fd5d7421640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:29:17.755+0000 7fd5d7421640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:29:17.755+0000 7fd5d7421640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.054 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_done global_id 7574 payload 274 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient: _finish_hunting 0 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 1 monclient: found mon.noname-c 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: dump: 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.055 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: _finish_auth 0 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: _check_auth_tickets 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: dump: 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.056 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:29:17.755+0000 7fd5db737800 5 monclient: authenticate success, global_id 7574 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient: get_monmap_and_config success 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:29:17.755+0000 7fd5db737800 4 set_mon_vals no callback set 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:29:17.756+0000 7fd5db737800 10 monclient: shutdown 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:29:17.756+0000 7fd5db737800 10 monclient: build_initial_monmap 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 build_initial for_mkfs: 0 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:29:17.756+0000 7fd5db737800 10 monclient: monmap: 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:18.057 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding auth protocol: cephx 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding auth protocol: cephx 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding auth protocol: cephx 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.058 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:29:17.756+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 librados: starting msgr at 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 librados: starting objecter 2024-09-12T00:29:18.059 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 asok(0x5614a2454630) register_command objecter_requests cmddesc objecter_requests hook 0x5614a27186e0 EEXIST 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 librados: setting wanted keys 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 librados: calling monclient init 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:29:17.756+0000 7fd5db737800 10 monclient: init 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding auth protocol: cephx 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding auth protocol: cephx 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding auth protocol: cephx 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.060 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:29:17.757+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:29:17.757+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:29:17.757+0000 7fd5db737800 5 asok(0x5614a2454630) register_command rotate-key cmddesc rotate-key hook 0x5614a270b298 EEXIST 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-c con 0x5614a2737ba0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-b con 0x5614a2742680 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-a con 0x5614a2747250 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:18.061 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): authenticate will time out at 2377.322370s 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): get_auth_request con 0x5614a2737ba0 auth_method 0 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.062 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request con 0x5614a2747250 auth_method 0 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): handle_auth_done global_id 7577 payload 824 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient: _finish_hunting 0 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:29:17.757+0000 7fd5d7421640 1 monclient: found mon.noname-c 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.063 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: dump: 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.064 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: _finish_auth 0 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: _check_auth_tickets 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: dump: 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.065 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:29:17.757+0000 7fd5db737800 5 monclient: authenticate success, global_id 7577 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:29:17.757+0000 7fd4baffd640 4 set_mon_vals no callback set 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:29:17.758+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:29:17.758+0000 7fd5db737800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:29:17.758+0000 7fd5db737800 1 librados: init done 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:29:17.758+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cr dump hook 0x5614a27412c8 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:29:17.759+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:29:17.760+0000 7fd4b97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:18.066 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:29:17.760+0000 7fd4b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:29:17.760+0000 7fd4b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:29:17.760+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd4a0076470 auth_method 0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:29:17.760+0000 7fd5d7c22640 10 monclient: get_auth_request con 0x5614a2760e10 auth_method 0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 realm 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:29:17.761+0000 7fd5db737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:29:17.762+0000 7fd5d7421640 10 monclient: get_auth_request con 0x5614a2765160 auth_method 0 2024-09-12T00:29:18.067 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:29:17.762+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:29:17.762+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:29:17.763+0000 7fd5cec20640 10 monclient: get_auth_request con 0x5614a2768860 auth_method 0 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:29:17.763+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:29:17.763+0000 7fd5db737800 20 searching for the correct realm 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:29:17.763+0000 7fd5d7c22640 10 monclient: get_auth_request con 0x5614a276d640 auth_method 0 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:29:17.764+0000 7fd5d7421640 0 -- 172.21.15.33:0/207101822 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd5c4003c80 msgr2=0x7fd5d0025420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:29:17.764+0000 7fd5d7421640 10 monclient: get_auth_request con 0x7fd5c4003c80 auth_method 0 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:29:17.965+0000 7fd5d7421640 10 monclient: get_auth_request con 0x7fd5c4003c80 auth_method 0 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:29:17.966+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd5c8026070 auth_method 0 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:29:17.968+0000 7fd5d7c22640 10 monclient: get_auth_request con 0x7fd5c0091040 auth_method 0 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:29:17.969+0000 7fd5cec20640 0 -- 172.21.15.33:0/207101822 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fd5c8026070 msgr2=0x7fd5c805e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:18.068 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:29:17.969+0000 7fd4b97fa640 1 client.7577.objecter ms_handle_reset 0x7fd5c8026070 session 0x7fd5c8005040 osd.2 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:29:17.969+0000 7fd4b97fa640 10 monclient: _renew_subs 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:29:17.969+0000 7fd4b97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:29:17.969+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd4a0086c80 auth_method 0 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:29:17.970+0000 7fd5d7421640 10 monclient: get_auth_request con 0x7fd5c00a4040 auth_method 0 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.069 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 zone default found 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:29:17.976+0000 7fd5db737800 4 Realm: () 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:29:17.976+0000 7fd5db737800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:29:17.976+0000 7fd5db737800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:18.070 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:29:17.976+0000 7fd5db737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 zonegroup default 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 started sync module instance, tier type = 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=0 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=1 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=2 2024-09-12T00:29:18.071 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=3 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=4 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=5 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=6 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:29:17.987+0000 7fd5db737800 20 add_watcher() i=7 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:29:17.987+0000 7fd5db737800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding auth protocol: cephx 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding auth protocol: cephx 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding auth protocol: cephx 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.072 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:29:17.989+0000 7fd48dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:29:17.989+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:29:17.989+0000 7fd5db737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:29:17.989+0000 7fd5db737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:18.073 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cache list hook 0x5614a273b860 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cache inspect hook 0x5614a273b860 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cache erase hook 0x5614a273b860 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cache zap hook 0x5614a273b860 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 note: GC not initialized 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:29:17.990+0000 7fd48cfe1640 20 reqs_thread_entry: start 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:29:17.990+0000 7fd5db737800 5 asok(0x5614a2454630) register_command sync trace show hook 0x7fd5d000ace0 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:29:17.990+0000 7fd5db737800 5 asok(0x5614a2454630) register_command sync trace history hook 0x7fd5d000ace0 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:29:17.990+0000 7fd5db737800 5 asok(0x5614a2454630) register_command sync trace active hook 0x7fd5d000ace0 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:29:17.990+0000 7fd5db737800 5 asok(0x5614a2454630) register_command sync trace active_short hook 0x7fd5d000ace0 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 Filter name: none 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:29:17.990+0000 7fd4067fc640 20 reqs_thread_entry: start 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:18.074 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:29:17.990+0000 7fd5db737800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:29:17.991+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:29:17.996+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:18.075 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:29:17.996+0000 7fd5db737800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:29:17.996+0000 7fd5db737800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:29:17.996+0000 7fd5db737800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366202 cookie 94646625073152 notifier 7577 bl.length()=911 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.1 2024-09-12T00:29:18.076 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.1 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.2 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.2 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.3 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.3 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.4 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.4 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.5 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.5 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.6 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.6 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.7 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.7 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.8 2024-09-12T00:29:18.077 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.8 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.9 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.9 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.10 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.10 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.11 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.11 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.12 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.12 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.13 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.13 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:18.078 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:29:18.004+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:29:18.004+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:29:18.004+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:29:18.004+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:29:18.005+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:29:18.005+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:29:18.005+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:29:18.005+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:29:18.006+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:29:18.006+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:29:18.006+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:18.079 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:29:18.006+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:29:18.008+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:29:18.008+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:29:18.008+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:29:18.008+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:29:18.009+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:29:18.009+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:29:18.009+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:29:18.009+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:29:18.010+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:29:18.010+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:29:18.013+0000 7fd5db737800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5db737800 time 2024-09-12T00:29:18.013745+0000 2024-09-12T00:29:18.080 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5dcd8c71a] 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd5dcd8c8d8] 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5614a0be2641] 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5614a0bf151b] 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5614a0bf23e4] 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd5dba29590] 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:29:18.014+0000 7fd5db737800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:18.081 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fd5db737800 thread_name:radosgw-admin 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5dba3e6f0] 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5dba8b99c] 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5dcd8c774] 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd5dcd8c8d8] 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5614a0be2641] 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5614a0bf151b] 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5614a0bf23e4] 2024-09-12T00:29:18.082 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd5dba29590] 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:29:18.083 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:29:18.084 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:29:18.085 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:29:18.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:29:18.087 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:29:18.088 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4067fc640 / http_manager 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd48cfe1640 / http_manager 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd48dfe3640 / rgw_dt_lg_renew 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4b97fa640 / ms_dispatch 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4baffd640 / io_context_pool 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4c1602640 / ms_dispatch 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4c3e07640 / ms_dispatch 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4c560a640 / io_context_pool 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5cec20640 / msgr-worker-2 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5d7421640 / msgr-worker-1 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5d7c22640 / msgr-worker-0 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5d8423640 / io_context_pool 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5db737800 / radosgw-admin 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.146334.log 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-a con 0x5614a267dc90 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-b con 0x7fd5c40030f0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.091 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:29:17.743+0000 7fd5db737800 10 monclient(hunting): authenticate will time out at 2377.308502s 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): get_auth_request con 0x5614a267d310 auth_method 0 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): get_auth_request con 0x5614a267dc90 auth_method 0 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.092 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:29:17.743+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request con 0x7fd5c40030f0 auth_method 0 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:29:17.743+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient(hunting): handle_auth_done global_id 7568 payload 824 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient: _finish_hunting 0 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:29:17.743+0000 7fd5d7421640 1 monclient: found mon.noname-c 2024-09-12T00:29:18.093 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:29:17.743+0000 7fd5d7421640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: dump: 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.094 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: _finish_auth 0 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: _check_auth_tickets 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:29:17.744+0000 7fd4c3e07640 10 monclient: dump: 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.095 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:29:17.744+0000 7fd5db737800 5 monclient: authenticate success, global_id 7568 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:29:17.744+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:29:17.744+0000 7fd4c560a640 4 set_mon_vals no callback set 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:29:17.744+0000 7fd5db737800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:29:17.744+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:29:17.744+0000 7fd5db737800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:29:17.744+0000 7fd5db737800 1 librados: init done 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:29:17.746+0000 7fd4c3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:18.096 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:29:17.746+0000 7fd4c3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:29:17.746+0000 7fd4c3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:29:17.746+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd4bc076470 auth_method 0 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:29:17.747+0000 7fd5d7c22640 10 monclient: get_auth_request con 0x5614a26abfb0 auth_method 0 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:29:17.747+0000 7fd5d7421640 10 monclient: get_auth_request con 0x5614a26c2ad0 auth_method 0 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:29:17.748+0000 7fd5cec20640 10 monclient: get_auth_request con 0x5614a26c6e30 auth_method 0 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:29:17.749+0000 7fd5db737800 10 monclient: build_initial_monmap 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:29:17.749+0000 7fd5db737800 1 build_initial for_mkfs: 0 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:29:17.749+0000 7fd5db737800 10 monclient: monmap: 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:18.097 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding auth protocol: cephx 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding auth protocol: cephx 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding auth protocol: cephx 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.098 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: crc 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:29:17.749+0000 7fd5db737800 5 AuthRegistry(0x5614a26cbd50) adding con mode: secure 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:29:17.750+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 asok(0x5614a2454630) register_command objecter_requests cmddesc objecter_requests hook 0x5614a26cf6b0 EEXIST 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient: init 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding auth protocol: cephx 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding auth protocol: cephx 2024-09-12T00:29:18.099 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding auth protocol: cephx 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: crc 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 AuthRegistry(0x5614a26ca378) adding con mode: secure 2024-09-12T00:29:18.100 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:29:17.750+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:29:17.750+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:29:17.750+0000 7fd5db737800 5 asok(0x5614a2454630) register_command rotate-key cmddesc rotate-key hook 0x5614a26ca4c0 EEXIST 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-b con 0x5614a26f33a0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:29:17.750+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-c con 0x5614a26f5670 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-a con 0x5614a26f1b70 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient(hunting): authenticate will time out at 2377.316029s 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): get_auth_request con 0x5614a26f5670 auth_method 0 2024-09-12T00:29:18.101 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request con 0x5614a26f1b70 auth_method 0 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): get_auth_request con 0x5614a26f33a0 auth_method 0 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.102 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:29:17.751+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:29:17.751+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient(hunting): handle_auth_done global_id 7021 payload 824 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient: _finish_hunting 0 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:29:17.751+0000 7fd5d7421640 1 monclient: found mon.noname-b 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:29:17.751+0000 7fd5d7421640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.162:3300/0 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: dump: 2024-09-12T00:29:18.103 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: _finish_auth 0 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: _check_auth_tickets 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:29:17.751+0000 7fd5db737800 5 monclient: authenticate success, global_id 7021 2024-09-12T00:29:18.104 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.162:3300/0 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:29:17.751+0000 7fd5d8423640 4 set_mon_vals no callback set 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:29:17.751+0000 7fd4c1602640 10 monclient: dump: 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.105 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:29:17.751+0000 7fd5db737800 10 monclient: _send_mon_message to mon.b at v2:172.21.15.162:3300/0 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:29:17.753+0000 7fd4c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:29:17.753+0000 7fd4c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:29:17.753+0000 7fd4c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:29:17.753+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd4b0076380 auth_method 0 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:29:17.754+0000 7fd5db737800 10 monclient: get_monmap_and_config 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:29:17.754+0000 7fd5db737800 10 monclient: build_initial_monmap 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:29:17.754+0000 7fd5db737800 1 build_initial for_mkfs: 0 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:29:17.754+0000 7fd5db737800 10 monclient: monmap: 2024-09-12T00:29:18.106 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding auth protocol: cephx 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding auth protocol: cephx 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding auth protocol: cephx 2024-09-12T00:29:18.107 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: crc 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x5614a2712c50) adding con mode: secure 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:29:17.754+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:29:17.754+0000 7fd5db737800 10 monclient: init 2024-09-12T00:29:18.108 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding auth protocol: cephx 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding auth protocol: cephx 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding auth protocol: cephx 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.109 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: crc 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5b9c0) adding con mode: secure 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:29:17.754+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:29:17.754+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:29:17.754+0000 7fd5db737800 5 asok(0x5614a2454630) register_command rotate-key cmddesc rotate-key hook 0x7ffdb5c5bb08 EEXIST 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-b con 0x5614a2747250 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-a con 0x5614a2737ba0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-c con 0x5614a2742680 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.110 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient(hunting): authenticate will time out at 2377.320082s 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): get_auth_request con 0x5614a2737ba0 auth_method 0 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request con 0x5614a2742680 auth_method 0 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:29:17.755+0000 7fd5cec20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.111 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:29:17.755+0000 7fd5d7421640 10 monclient(hunting): get_auth_request con 0x5614a2747250 auth_method 0 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:29:17.755+0000 7fd5d7421640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:29:17.755+0000 7fd5d7421640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:29:17.755+0000 7fd5d7421640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_done global_id 7574 payload 274 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient: _finish_hunting 0 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 1 monclient: found mon.noname-c 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:29:17.755+0000 7fd5d7c22640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.112 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: dump: 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: _finish_auth 0 2024-09-12T00:29:18.113 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: _check_auth_tickets 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:29:17.755+0000 7fd4baffd640 10 monclient: dump: 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.114 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:29:17.755+0000 7fd5db737800 5 monclient: authenticate success, global_id 7574 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:29:17.755+0000 7fd5db737800 10 monclient: get_monmap_and_config success 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:29:17.755+0000 7fd5db737800 4 set_mon_vals no callback set 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:29:17.756+0000 7fd5db737800 10 monclient: shutdown 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:29:17.756+0000 7fd5db737800 10 monclient: build_initial_monmap 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 build_initial for_mkfs: 0 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:29:17.756+0000 7fd5db737800 10 monclient: monmap: 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:18.115 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding auth protocol: cephx 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding auth protocol: cephx 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding auth protocol: cephx 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.116 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: crc 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a2738090) adding con mode: secure 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:29:17.756+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 librados: starting msgr at 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 librados: starting objecter 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 asok(0x5614a2454630) register_command objecter_requests cmddesc objecter_requests hook 0x5614a27186e0 EEXIST 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 librados: setting wanted keys 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:29:17.756+0000 7fd5db737800 1 librados: calling monclient init 2024-09-12T00:29:18.117 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:29:17.756+0000 7fd5db737800 10 monclient: init 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding auth protocol: cephx 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding auth protocol: cephx 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding auth protocol: cephx 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.118 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: crc 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:29:17.756+0000 7fd5db737800 5 AuthRegistry(0x5614a270b150) adding con mode: secure 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:29:17.757+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:29:17.757+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:29:17.757+0000 7fd5db737800 5 asok(0x5614a2454630) register_command rotate-key cmddesc rotate-key hook 0x5614a270b298 EEXIST 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-c con 0x5614a2737ba0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-b con 0x5614a2742680 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): picked mon.noname-a con 0x5614a2747250 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:18.119 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient(hunting): authenticate will time out at 2377.322370s 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): get_auth_request con 0x5614a2737ba0 auth_method 0 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request con 0x5614a2747250 auth_method 0 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:18.120 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:29:17.757+0000 7fd5d7c22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient(hunting): handle_auth_done global_id 7577 payload 824 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient: _finish_hunting 0 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:29:17.757+0000 7fd5d7421640 1 monclient: found mon.noname-c 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:29:17.757+0000 7fd5d7421640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: dump: 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.121 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: _finish_auth 0 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: _check_auth_tickets 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:29:17.757+0000 7fd4b97fa640 10 monclient: dump: 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:18.122 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:29:17.757+0000 7fd5db737800 5 monclient: authenticate success, global_id 7577 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:29:17.757+0000 7fd4baffd640 4 set_mon_vals no callback set 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:29:17.757+0000 7fd5db737800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:29:17.758+0000 7fd5db737800 10 monclient: _renew_subs 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:29:17.758+0000 7fd5db737800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.123 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:29:17.758+0000 7fd5db737800 1 librados: init done 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:29:17.758+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cr dump hook 0x5614a27412c8 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:29:17.759+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:29:17.760+0000 7fd4b97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:29:17.760+0000 7fd4b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:29:17.760+0000 7fd4b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:29:17.760+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd4a0076470 auth_method 0 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:29:17.760+0000 7fd5d7c22640 10 monclient: get_auth_request con 0x5614a2760e10 auth_method 0 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 realm 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:29:17.761+0000 7fd5db737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:18.124 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:29:17.761+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:29:17.762+0000 7fd5d7421640 10 monclient: get_auth_request con 0x5614a2765160 auth_method 0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:29:17.762+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:29:17.762+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:29:17.763+0000 7fd5cec20640 10 monclient: get_auth_request con 0x5614a2768860 auth_method 0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:29:17.763+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:29:17.763+0000 7fd5db737800 20 searching for the correct realm 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:29:17.763+0000 7fd5d7c22640 10 monclient: get_auth_request con 0x5614a276d640 auth_method 0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:29:17.764+0000 7fd5d7421640 0 -- 172.21.15.33:0/207101822 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fd5c4003c80 msgr2=0x7fd5d0025420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:29:17.764+0000 7fd5d7421640 10 monclient: get_auth_request con 0x7fd5c4003c80 auth_method 0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:29:17.965+0000 7fd5d7421640 10 monclient: get_auth_request con 0x7fd5c4003c80 auth_method 0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:29:17.966+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd5c8026070 auth_method 0 2024-09-12T00:29:18.125 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:29:17.968+0000 7fd5d7c22640 10 monclient: get_auth_request con 0x7fd5c0091040 auth_method 0 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:29:17.969+0000 7fd5cec20640 0 -- 172.21.15.33:0/207101822 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fd5c8026070 msgr2=0x7fd5c805e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:29:17.969+0000 7fd4b97fa640 1 client.7577.objecter ms_handle_reset 0x7fd5c8026070 session 0x7fd5c8005040 osd.2 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:29:17.969+0000 7fd4b97fa640 10 monclient: _renew_subs 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:29:17.969+0000 7fd4b97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:29:17.969+0000 7fd5cec20640 10 monclient: get_auth_request con 0x7fd4a0086c80 auth_method 0 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:29:17.970+0000 7fd5d7421640 10 monclient: get_auth_request con 0x7fd5c00a4040 auth_method 0 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:18.126 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:29:17.975+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 zone default found 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:29:17.976+0000 7fd5db737800 4 Realm: () 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:29:17.976+0000 7fd5db737800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:29:17.976+0000 7fd5db737800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:29:17.976+0000 7fd5db737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 zonegroup default 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:29:17.976+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.127 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 started sync module instance, tier type = 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:29:17.977+0000 7fd5db737800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=0 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=1 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=2 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=3 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=4 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=5 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:29:17.986+0000 7fd5db737800 20 add_watcher() i=6 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:29:17.987+0000 7fd5db737800 20 add_watcher() i=7 2024-09-12T00:29:18.128 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:29:17.987+0000 7fd5db737800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding auth protocol: cephx 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding auth protocol: cephx 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding auth protocol: cephx 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.129 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: crc 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 AuthRegistry(0x7ffdb5c5bea0) adding con mode: secure 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:29:17.989+0000 7fd48dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:29:17.989+0000 7fd5db737800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:29:17.989+0000 7fd5db737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:29:17.989+0000 7fd5db737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cache list hook 0x5614a273b860 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cache inspect hook 0x5614a273b860 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cache erase hook 0x5614a273b860 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 asok(0x5614a2454630) register_command cache zap hook 0x5614a273b860 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:29:17.989+0000 7fd5db737800 5 note: GC not initialized 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:29:17.990+0000 7fd48cfe1640 20 reqs_thread_entry: start 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:29:17.990+0000 7fd5db737800 5 asok(0x5614a2454630) register_command sync trace show hook 0x7fd5d000ace0 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:29:17.990+0000 7fd5db737800 5 asok(0x5614a2454630) register_command sync trace history hook 0x7fd5d000ace0 2024-09-12T00:29:18.130 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:29:17.990+0000 7fd5db737800 5 asok(0x5614a2454630) register_command sync trace active hook 0x7fd5d000ace0 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:29:17.990+0000 7fd5db737800 5 asok(0x5614a2454630) register_command sync trace active_short hook 0x7fd5d000ace0 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 Filter name: none 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:29:17.990+0000 7fd4067fc640 20 reqs_thread_entry: start 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:29:17.990+0000 7fd5db737800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:29:17.990+0000 7fd5db737800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:29:17.990+0000 7fd5db737800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:29:17.991+0000 7fd5db737800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:18.131 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:29:17.991+0000 7fd5db737800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:29:17.996+0000 7fd5db737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:29:17.996+0000 7fd5db737800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:29:17.996+0000 7fd5db737800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:29:17.996+0000 7fd5db737800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366202 cookie 94646625073152 notifier 7577 bl.length()=911 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:29:17.996+0000 7fd4baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:29:18.132 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:29:17.998+0000 7fd5db737800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.1 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.1 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.2 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.2 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.3 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.3 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.4 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.4 2024-09-12T00:29:18.133 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.5 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.5 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.6 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.6 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.7 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.7 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.8 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.8 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.9 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.9 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.10 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.10 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.11 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.11 2024-09-12T00:29:18.134 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.12 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.12 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.13 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.13 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:29:18.003+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:29:18.003+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:29:18.004+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:29:18.004+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:29:18.004+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:29:18.004+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:29:18.005+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:29:18.005+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:18.135 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:29:18.005+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:29:18.005+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:29:18.006+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:29:18.006+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:29:18.006+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:29:18.006+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:29:18.008+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:29:18.008+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:29:18.008+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:29:18.008+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:29:18.009+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:29:18.009+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:29:18.009+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:18.136 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:29:18.009+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:29:18.010+0000 7fd5db737800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:29:18.010+0000 7fd5db737800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:29:18.013+0000 7fd5db737800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5db737800 time 2024-09-12T00:29:18.013745+0000 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5dcd8c71a] 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd5dcd8c8d8] 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5614a0be2641] 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5614a0bf151b] 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5614a0bf23e4] 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:29:18.137 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd5dba29590] 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:29:18.014+0000 7fd5db737800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fd5db737800 thread_name:radosgw-admin 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5dba3e6f0] 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5dba8b99c] 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5dcd8c774] 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd5dcd8c8d8] 2024-09-12T00:29:18.138 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5614a0be2641] 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5614a0bf151b] 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5614a0bf23e4] 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd5dba29590] 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:29:18.139 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:29:18.140 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:29:18.143 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:29:18.144 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:29:18.145 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4067fc640 / http_manager 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd48cfe1640 / http_manager 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd48dfe3640 / rgw_dt_lg_renew 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4b97fa640 / ms_dispatch 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4baffd640 / io_context_pool 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4c1602640 / ms_dispatch 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4c3e07640 / ms_dispatch 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd4c560a640 / io_context_pool 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5cec20640 / msgr-worker-2 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5d7421640 / msgr-worker-1 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5d7c22640 / msgr-worker-0 2024-09-12T00:29:18.146 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5d8423640 / io_context_pool 2024-09-12T00:29:18.147 INFO:tasks.workunit.client.0.smithi033.stderr: 7fd5db737800 / radosgw-admin 2024-09-12T00:29:18.147 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:29:18.147 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:29:18.147 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:29:18.015411Z_51c11151-5f22-418f-808a-5c62f0659685/log 2024-09-12T00:29:18.147 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:29:18.147 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:18.152 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:18.152 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.094+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.096+0000 7f221ef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.096+0000 7f221ef35800 20 realm 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.096+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.096+0000 7f221ef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.096+0000 7f221ef35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.096+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.096+0000 7f221ef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.096+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.097+0000 7f221ef35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.097+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.098+0000 7f221ef35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:18.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.098+0000 7f221ef35800 20 searching for the correct realm 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.101+0000 7f221b4e5640 0 -- 172.21.15.33:0/4117507210 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x555951f247c0 msgr2=0x555951f26c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.104+0000 7f221ace4640 0 -- 172.21.15.33:0/4117507210 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f2210009040 msgr2=0x7f2210055450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:18.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.109+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 zone default found 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 4 Realm: () 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 zonegroup default 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 started sync module instance, tier type = 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.110+0000 7f221ef35800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.121+0000 7f221ef35800 20 add_watcher() i=0 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.121+0000 7f221ef35800 20 add_watcher() i=1 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.121+0000 7f221ef35800 20 add_watcher() i=2 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.121+0000 7f221ef35800 20 add_watcher() i=3 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.121+0000 7f221ef35800 20 add_watcher() i=4 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.121+0000 7f221ef35800 20 add_watcher() i=5 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.121+0000 7f221ef35800 20 add_watcher() i=6 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.122+0000 7f221ef35800 20 add_watcher() i=7 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.122+0000 7f221ef35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.123+0000 7f20d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:18.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.124+0000 7f221ef35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.124+0000 7f221ef35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.124+0000 7f221ef35800 5 note: GC not initialized 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.124+0000 7f204bfff640 20 reqs_thread_entry: start 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.124+0000 7f221ef35800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.124+0000 7f221ef35800 20 Filter name: none 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.124+0000 7f2049ffb640 20 reqs_thread_entry: start 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.124+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.125+0000 7f221ef35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.125+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.125+0000 7f221ef35800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.125+0000 7f221ef35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.125+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.126+0000 7f221ef35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:18.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.126+0000 7f221ef35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.126+0000 7f221ef35800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.126+0000 7f221ef35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.128+0000 7f20d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.131+0000 7f221ef35800 20 remove_watcher() i=0 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.131+0000 7f221ef35800 2 removed watcher, disabling cache 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.132+0000 7f221ef35800 20 remove_watcher() i=1 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.133+0000 7f221ef35800 20 remove_watcher() i=2 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.134+0000 7f221ef35800 20 remove_watcher() i=3 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.136+0000 7f221ef35800 20 remove_watcher() i=4 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.137+0000 7f221ef35800 20 remove_watcher() i=5 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.138+0000 7f221ef35800 20 remove_watcher() i=6 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.139+0000 7f221ef35800 20 remove_watcher() i=7 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:29:18.158 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:29:18.185 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:29:18.214 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:18.215 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:18.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.255+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.257+0000 7f5b16142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.257+0000 7f5b16142800 20 realm 2024-09-12T00:29:18.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.257+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.255 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.257+0000 7f5b16142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.257+0000 7f5b16142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:18.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.257+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.257+0000 7f5b16142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.257+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.258+0000 7f5b16142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:18.256 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.258+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.259+0000 7f5b16142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:18.257 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.259+0000 7f5b16142800 20 searching for the correct realm 2024-09-12T00:29:18.260 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.261+0000 7f5b1268e640 0 -- 172.21.15.33:0/3225269859 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55c3ab596880 msgr2=0x55c3ab598d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:18.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.265+0000 7f5b11e8d640 0 -- 172.21.15.33:0/3225269859 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f5b0808e960 msgr2=0x7f5b08079420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:18.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:18.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:18.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:18.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:18.268 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:18.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:18.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.269+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:18.269 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:18.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 20 zone default found 2024-09-12T00:29:18.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 4 Realm: () 2024-09-12T00:29:18.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:18.270 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 20 zonegroup default 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.270+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.271+0000 7f5b16142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.271+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.271+0000 7f5b16142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.271+0000 7f5b16142800 20 started sync module instance, tier type = 2024-09-12T00:29:18.271 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.271+0000 7f5b16142800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:18.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.280+0000 7f5b16142800 20 add_watcher() i=0 2024-09-12T00:29:18.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.280+0000 7f5b16142800 20 add_watcher() i=1 2024-09-12T00:29:18.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.280+0000 7f5b16142800 20 add_watcher() i=2 2024-09-12T00:29:18.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.280+0000 7f5b16142800 20 add_watcher() i=3 2024-09-12T00:29:18.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.280+0000 7f5b16142800 20 add_watcher() i=4 2024-09-12T00:29:18.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.280+0000 7f5b16142800 20 add_watcher() i=5 2024-09-12T00:29:18.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.280+0000 7f5b16142800 20 add_watcher() i=6 2024-09-12T00:29:18.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.281+0000 7f5b16142800 20 add_watcher() i=7 2024-09-12T00:29:18.280 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.281+0000 7f5b16142800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:18.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.282+0000 7f59c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:18.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f5b16142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:18.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f5b16142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:18.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f5b16142800 5 note: GC not initialized 2024-09-12T00:29:18.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f59c27fc640 20 reqs_thread_entry: start 2024-09-12T00:29:18.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f5b16142800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:18.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f5b16142800 20 Filter name: none 2024-09-12T00:29:18.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f5937fff640 20 reqs_thread_entry: start 2024-09-12T00:29:18.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f5b16142800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:18.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.283+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 20 rados->read ofs=0 len=0 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:18.284 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:18.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:18.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:18.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.284+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:18.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.285+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:18.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.285+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:18.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.285+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:18.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.285+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:18.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.286+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:18.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.286+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:18.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.286+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:18.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.286+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:18.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.287+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:18.286 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.287+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:18.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.287+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:18.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.287+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:18.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.287+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:18.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.287+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:18.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.288+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:18.287 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.288+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:18.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.288+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:18.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.288+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:18.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.288+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:18.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.289+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:18.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.289+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:18.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.289+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:18.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.289+0000 7f5b16142800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:18.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.289+0000 7f5b16142800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:18.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.290+0000 7f59c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:18.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.294+0000 7f5b16142800 20 remove_watcher() i=0 2024-09-12T00:29:18.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.294+0000 7f5b16142800 2 removed watcher, disabling cache 2024-09-12T00:29:18.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.295+0000 7f5b16142800 20 remove_watcher() i=1 2024-09-12T00:29:18.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.296+0000 7f5b16142800 20 remove_watcher() i=2 2024-09-12T00:29:18.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.297+0000 7f5b16142800 20 remove_watcher() i=3 2024-09-12T00:29:18.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.298+0000 7f5b16142800 20 remove_watcher() i=4 2024-09-12T00:29:18.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.298+0000 7f5b16142800 20 remove_watcher() i=5 2024-09-12T00:29:18.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.299+0000 7f5b16142800 20 remove_watcher() i=6 2024-09-12T00:29:18.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:18.300+0000 7f5b16142800 20 remove_watcher() i=7 2024-09-12T00:29:48.321 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:48.354 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:48.354 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:48.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.400+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.402+0000 7fa30c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.402+0000 7fa30c810800 20 realm 2024-09-12T00:29:48.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.402+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.402+0000 7fa30c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.402+0000 7fa30c810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:48.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.402+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.402+0000 7fa30c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.402+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.403+0000 7fa30c810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:48.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.403+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.404+0000 7fa30c810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:48.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.404+0000 7fa30c810800 20 searching for the correct realm 2024-09-12T00:29:48.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.408+0000 7fa30877b640 0 -- 172.21.15.33:0/3499995019 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55830573f050 msgr2=0x558305741510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:48.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.411+0000 7fa307f7a640 0 -- 172.21.15.33:0/3499995019 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa2f00383f0 msgr2=0x7fa2f0038850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.417+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 20 zone default found 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 4 Realm: () 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 20 zonegroup default 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.418+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.419+0000 7fa30c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.419+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.419+0000 7fa30c810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.419+0000 7fa30c810800 20 started sync module instance, tier type = 2024-09-12T00:29:48.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.419+0000 7fa30c810800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:48.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.429+0000 7fa30c810800 20 add_watcher() i=0 2024-09-12T00:29:48.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.429+0000 7fa30c810800 20 add_watcher() i=1 2024-09-12T00:29:48.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.429+0000 7fa30c810800 20 add_watcher() i=2 2024-09-12T00:29:48.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.429+0000 7fa30c810800 20 add_watcher() i=3 2024-09-12T00:29:48.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.429+0000 7fa30c810800 20 add_watcher() i=4 2024-09-12T00:29:48.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.429+0000 7fa30c810800 20 add_watcher() i=5 2024-09-12T00:29:48.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.429+0000 7fa30c810800 20 add_watcher() i=6 2024-09-12T00:29:48.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.430+0000 7fa30c810800 20 add_watcher() i=7 2024-09-12T00:29:48.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.430+0000 7fa30c810800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:48.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.432+0000 7fa1bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:48.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.432+0000 7fa30c810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:48.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.432+0000 7fa30c810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:48.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.432+0000 7fa30c810800 5 note: GC not initialized 2024-09-12T00:29:48.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.433+0000 7fa1bcfe1640 20 reqs_thread_entry: start 2024-09-12T00:29:48.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.433+0000 7fa30c810800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:48.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.433+0000 7fa30c810800 20 Filter name: none 2024-09-12T00:29:48.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.433+0000 7fa1367fc640 20 reqs_thread_entry: start 2024-09-12T00:29:48.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.433+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.434+0000 7fa30c810800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:48.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.434+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.434+0000 7fa30c810800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:29:48.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.434+0000 7fa30c810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:48.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.434+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.435+0000 7fa30c810800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:48.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.435+0000 7fa30c810800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.435+0000 7fa30c810800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:29:48.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.435+0000 7fa30c810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:48.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.437+0000 7fa1bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:48.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.439+0000 7fa30c810800 20 remove_watcher() i=0 2024-09-12T00:29:48.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.439+0000 7fa30c810800 2 removed watcher, disabling cache 2024-09-12T00:29:48.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.440+0000 7fa30c810800 20 remove_watcher() i=1 2024-09-12T00:29:48.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.441+0000 7fa30c810800 20 remove_watcher() i=2 2024-09-12T00:29:48.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.442+0000 7fa30c810800 20 remove_watcher() i=3 2024-09-12T00:29:48.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.444+0000 7fa30c810800 20 remove_watcher() i=4 2024-09-12T00:29:48.443 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.445+0000 7fa30c810800 20 remove_watcher() i=5 2024-09-12T00:29:48.444 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.446+0000 7fa30c810800 20 remove_watcher() i=6 2024-09-12T00:29:48.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.447+0000 7fa30c810800 20 remove_watcher() i=7 2024-09-12T00:29:48.460 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:29:48.460 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:29:48.549 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:29:48.578 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:48.578 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:48.618 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.619+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.620 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.621+0000 7f3f17b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.621+0000 7f3f17b1f800 20 realm 2024-09-12T00:29:48.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.621+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.621+0000 7f3f17b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.621+0000 7f3f17b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:48.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.621+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.621 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.621+0000 7f3f17b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.621+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.622+0000 7f3f17b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:48.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.622+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.623+0000 7f3f17b1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:48.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.623+0000 7f3f17b1f800 20 searching for the correct realm 2024-09-12T00:29:48.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.626+0000 7f3f140a3640 0 -- 172.21.15.33:0/1169090048 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55c2d440bc10 msgr2=0x55c2d440e0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:48.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.629+0000 7f3f138a2640 0 -- 172.21.15.33:0/1169090048 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f3f080a7440 msgr2=0x7f3f080a78c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:48.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.836+0000 7f3f17b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:48.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.836+0000 7f3f17b1f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:48.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.836+0000 7f3f17b1f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:48.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.836+0000 7f3f17b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:48.835 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.836+0000 7f3f17b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:48.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.836+0000 7f3f17b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:48.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.836+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.836 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:48.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:48.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 20 zone default found 2024-09-12T00:29:48.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 4 Realm: () 2024-09-12T00:29:48.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:48.837 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 20 zonegroup default 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.837+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.838+0000 7f3f17b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.838+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.838+0000 7f3f17b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.838+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.838+0000 7f3f17b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.838+0000 7f3f17b1f800 20 started sync module instance, tier type = 2024-09-12T00:29:48.838 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.838+0000 7f3f17b1f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:48.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.847+0000 7f3f17b1f800 20 add_watcher() i=0 2024-09-12T00:29:48.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.847+0000 7f3f17b1f800 20 add_watcher() i=1 2024-09-12T00:29:48.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.847+0000 7f3f17b1f800 20 add_watcher() i=2 2024-09-12T00:29:48.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.847+0000 7f3f17b1f800 20 add_watcher() i=3 2024-09-12T00:29:48.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.847+0000 7f3f17b1f800 20 add_watcher() i=4 2024-09-12T00:29:48.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.847+0000 7f3f17b1f800 20 add_watcher() i=5 2024-09-12T00:29:48.846 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.847+0000 7f3f17b1f800 20 add_watcher() i=6 2024-09-12T00:29:48.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.848+0000 7f3f17b1f800 20 add_watcher() i=7 2024-09-12T00:29:48.847 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.848+0000 7f3f17b1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:48.849 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.850+0000 7f3dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:48.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3f17b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:48.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3f17b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:48.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3f17b1f800 5 note: GC not initialized 2024-09-12T00:29:48.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3dc8fe1640 20 reqs_thread_entry: start 2024-09-12T00:29:48.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3f17b1f800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:48.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3f17b1f800 20 Filter name: none 2024-09-12T00:29:48.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3d427fc640 20 reqs_thread_entry: start 2024-09-12T00:29:48.850 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3f17b1f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:48.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.851+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.852+0000 7f3f17b1f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.852+0000 7f3f17b1f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.852+0000 7f3f17b1f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.852+0000 7f3f17b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.852+0000 7f3f17b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:48.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:48.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:48.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.853+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:48.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.854+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:48.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.854+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:48.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.854+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:48.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.854+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:48.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.855+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:48.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.855+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:48.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.855+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:48.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.855+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:48.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.855+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:48.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.855+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:48.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.856+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:48.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.856+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:48.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.856+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:48.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.856+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:48.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.856+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:48.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.856+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:48.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.857+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:48.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.857+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:48.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.857+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:48.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.857+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:48.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.857+0000 7f3f17b1f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:48.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.857+0000 7f3f17b1f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:48.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.859+0000 7f3dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:48.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.861+0000 7f3f17b1f800 20 remove_watcher() i=0 2024-09-12T00:29:48.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.861+0000 7f3f17b1f800 2 removed watcher, disabling cache 2024-09-12T00:29:48.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.862+0000 7f3f17b1f800 20 remove_watcher() i=1 2024-09-12T00:29:48.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.863+0000 7f3f17b1f800 20 remove_watcher() i=2 2024-09-12T00:29:48.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.864+0000 7f3f17b1f800 20 remove_watcher() i=3 2024-09-12T00:29:48.864 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.866+0000 7f3f17b1f800 20 remove_watcher() i=4 2024-09-12T00:29:48.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.867+0000 7f3f17b1f800 20 remove_watcher() i=5 2024-09-12T00:29:48.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.867+0000 7f3f17b1f800 20 remove_watcher() i=6 2024-09-12T00:29:48.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.868+0000 7f3f17b1f800 20 remove_watcher() i=7 2024-09-12T00:29:48.880 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:48.909 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:48.909 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:48.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.950+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.952 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.952+0000 7f221b535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.952+0000 7f221b535800 20 realm 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.952+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.952+0000 7f221b535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.952+0000 7f221b535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.952+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.952+0000 7f221b535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.952+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.953+0000 7f221b535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.953+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.954+0000 7f221b535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:48.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.954+0000 7f221b535800 20 searching for the correct realm 2024-09-12T00:29:48.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.956+0000 7f22172e4640 0 -- 172.21.15.33:0/824625144 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f2210061040 msgr2=0x7f22100a7c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:48.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:48.960+0000 7f22172e4640 0 -- 172.21.15.33:0/824625144 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f220c069370 msgr2=0x7f220c0618a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.167+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 20 zone default found 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 4 Realm: () 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 20 zonegroup default 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.168+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.169+0000 7f221b535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.169+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.169+0000 7f221b535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.169+0000 7f221b535800 20 started sync module instance, tier type = 2024-09-12T00:29:49.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.169+0000 7f221b535800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:49.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 20 add_watcher() i=0 2024-09-12T00:29:49.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 20 add_watcher() i=1 2024-09-12T00:29:49.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 20 add_watcher() i=2 2024-09-12T00:29:49.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 20 add_watcher() i=3 2024-09-12T00:29:49.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 20 add_watcher() i=4 2024-09-12T00:29:49.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 20 add_watcher() i=5 2024-09-12T00:29:49.177 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 20 add_watcher() i=6 2024-09-12T00:29:49.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 20 add_watcher() i=7 2024-09-12T00:29:49.178 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.179+0000 7f221b535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:49.179 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.181+0000 7f20cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.180 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.181+0000 7f221b535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:49.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.181+0000 7f221b535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:49.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.181+0000 7f221b535800 5 note: GC not initialized 2024-09-12T00:29:49.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.182+0000 7f20ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:29:49.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.182+0000 7f221b535800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:49.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.182+0000 7f221b535800 20 Filter name: none 2024-09-12T00:29:49.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.182+0000 7f20467fc640 20 reqs_thread_entry: start 2024-09-12T00:29:49.181 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.182+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.182+0000 7f221b535800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.182+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.183+0000 7f221b535800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:49.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.183+0000 7f221b535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:49.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.183+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.183+0000 7f221b535800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.183+0000 7f221b535800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.184+0000 7f221b535800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:49.183 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.184+0000 7f221b535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:49.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.186+0000 7f20cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.188+0000 7f221b535800 20 remove_watcher() i=0 2024-09-12T00:29:49.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.188+0000 7f221b535800 2 removed watcher, disabling cache 2024-09-12T00:29:49.187 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.189+0000 7f221b535800 20 remove_watcher() i=1 2024-09-12T00:29:49.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.190+0000 7f221b535800 20 remove_watcher() i=2 2024-09-12T00:29:49.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.191+0000 7f221b535800 20 remove_watcher() i=3 2024-09-12T00:29:49.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.192+0000 7f221b535800 20 remove_watcher() i=4 2024-09-12T00:29:49.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.193+0000 7f221b535800 20 remove_watcher() i=5 2024-09-12T00:29:49.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.194+0000 7f221b535800 20 remove_watcher() i=6 2024-09-12T00:29:49.193 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.195+0000 7f221b535800 20 remove_watcher() i=7 2024-09-12T00:29:49.205 INFO:tasks.workunit.client.0.smithi033.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:29:49.207 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:49.236 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:49.236 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:49.275 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.277+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.279+0000 7f76ac530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.279+0000 7f76ac530800 20 realm 2024-09-12T00:29:49.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.279+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.279+0000 7f76ac530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.279+0000 7f76ac530800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:49.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.279+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.279+0000 7f76ac530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.279+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.280+0000 7f76ac530800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.280+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.281+0000 7f76ac530800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:49.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.281+0000 7f76ac530800 20 searching for the correct realm 2024-09-12T00:29:49.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.284+0000 7f76a82b0640 0 -- 172.21.15.33:0/4115480887 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f76a0017040 msgr2=0x7f76a00a49f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.285 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.287+0000 7f76a82b0640 0 -- 172.21.15.33:0/4115480887 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f769c04c190 msgr2=0x7f769c07a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:49.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:49.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:49.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:49.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:49.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:49.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.292+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:49.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 20 zone default found 2024-09-12T00:29:49.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 4 Realm: () 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 20 zonegroup default 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.293+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.294+0000 7f76ac530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.294+0000 7f76ac530800 20 started sync module instance, tier type = 2024-09-12T00:29:49.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.294+0000 7f76ac530800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:49.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.303+0000 7f76ac530800 20 add_watcher() i=0 2024-09-12T00:29:49.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.303+0000 7f76ac530800 20 add_watcher() i=1 2024-09-12T00:29:49.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.303+0000 7f76ac530800 20 add_watcher() i=2 2024-09-12T00:29:49.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.303+0000 7f76ac530800 20 add_watcher() i=3 2024-09-12T00:29:49.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.303+0000 7f76ac530800 20 add_watcher() i=4 2024-09-12T00:29:49.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.303+0000 7f76ac530800 20 add_watcher() i=5 2024-09-12T00:29:49.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.303+0000 7f76ac530800 20 add_watcher() i=6 2024-09-12T00:29:49.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.304+0000 7f76ac530800 20 add_watcher() i=7 2024-09-12T00:29:49.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.304+0000 7f76ac530800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:49.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.305+0000 7f755efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.306+0000 7f76ac530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:49.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.306+0000 7f76ac530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:49.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.306+0000 7f76ac530800 5 note: GC not initialized 2024-09-12T00:29:49.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.306+0000 7f755dfdb640 20 reqs_thread_entry: start 2024-09-12T00:29:49.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.306+0000 7f76ac530800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:49.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.306+0000 7f76ac530800 20 Filter name: none 2024-09-12T00:29:49.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.306+0000 7f74cf7fe640 20 reqs_thread_entry: start 2024-09-12T00:29:49.305 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.306+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.307+0000 7f76ac530800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.307+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.307+0000 7f76ac530800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:49.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.307+0000 7f76ac530800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:49.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.307+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.307+0000 7f76ac530800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.307+0000 7f76ac530800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.308+0000 7f76ac530800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:49.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.308+0000 7f76ac530800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:49.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.310+0000 7f755efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.312+0000 7f76ac530800 20 remove_watcher() i=0 2024-09-12T00:29:49.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.312+0000 7f76ac530800 2 removed watcher, disabling cache 2024-09-12T00:29:49.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.313+0000 7f76ac530800 20 remove_watcher() i=1 2024-09-12T00:29:49.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.314+0000 7f76ac530800 20 remove_watcher() i=2 2024-09-12T00:29:49.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.315+0000 7f76ac530800 20 remove_watcher() i=3 2024-09-12T00:29:49.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.316+0000 7f76ac530800 20 remove_watcher() i=4 2024-09-12T00:29:49.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.317+0000 7f76ac530800 20 remove_watcher() i=5 2024-09-12T00:29:49.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.318+0000 7f76ac530800 20 remove_watcher() i=6 2024-09-12T00:29:49.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.319+0000 7f76ac530800 20 remove_watcher() i=7 2024-09-12T00:29:49.328 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.328 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:29:49.328 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: a-bucket id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T00:29:49.329 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.330 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:29:49.365 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:49.365 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:49.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.406+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 realm 2024-09-12T00:29:49.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.408+0000 7fcfa3f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:49.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.410+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:49.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.410+0000 7fcfa3f46800 20 searching for the correct realm 2024-09-12T00:29:49.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.412+0000 7fcfa122f640 0 -- 172.21.15.33:0/2511704835 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fcf9406c060 msgr2=0x7fcf9404d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.416+0000 7fcfa1a30640 0 -- 172.21.15.33:0/2511704835 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fcf9806c990 msgr2=0x7fcf9806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:49.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:49.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:49.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:49.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:49.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:49.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.622 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 zone default found 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 Realm: () 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 zonegroup default 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.623 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 started sync module instance, tier type = 2024-09-12T00:29:49.624 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:49.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=0 2024-09-12T00:29:49.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=1 2024-09-12T00:29:49.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=2 2024-09-12T00:29:49.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=3 2024-09-12T00:29:49.632 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=4 2024-09-12T00:29:49.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=5 2024-09-12T00:29:49.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=6 2024-09-12T00:29:49.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=7 2024-09-12T00:29:49.633 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.634+0000 7fcfa3f46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:49.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.636+0000 7fce53fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 note: GC not initialized 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fce52ffd640 20 reqs_thread_entry: start 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 Filter name: none 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fce50ff9640 20 reqs_thread_entry: start 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fcfa3f46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:49.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:49.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:49.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:49.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:49.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:49.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:49.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:29:49.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 93992451175584 notifier 8259 bl.length()=911 2024-09-12T00:29:49.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.643 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:29:49.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:29:49.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:29:49.644 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:29:49.649 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcfa3f46800 time 2024-09-12T00:29:49.652088+0000 2024-09-12T00:29:49.649 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:49.650 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:49.650 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcfa758c71a] 2024-09-12T00:29:49.650 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcfa758c8d8] 2024-09-12T00:29:49.650 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c518e8641] 2024-09-12T00:29:49.650 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557c518f838a] 2024-09-12T00:29:49.650 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fcfa6229590] 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.651+0000 7fcfa3f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcfa3f46800 time 2024-09-12T00:29:49.652088+0000 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcfa758c71a] 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcfa758c8d8] 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c518e8641] 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557c518f838a] 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fcfa6229590] 2024-09-12T00:29:49.651 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:29:49.652 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:29:49.652 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.652 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:29:49.652 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fcfa3f46800 thread_name:radosgw-admin 2024-09-12T00:29:49.668 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:49.668 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcfa623e6f0] 2024-09-12T00:29:49.668 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcfa628b99c] 2024-09-12T00:29:49.668 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:29:49.668 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:29:49.668 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcfa758c774] 2024-09-12T00:29:49.668 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcfa758c8d8] 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c518e8641] 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557c518f838a] 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fcfa6229590] 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.652+0000 7fcfa3f46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fcfa3f46800 thread_name:radosgw-admin 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcfa623e6f0] 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcfa628b99c] 2024-09-12T00:29:49.669 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcfa758c774] 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcfa758c8d8] 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c518e8641] 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557c518f838a] 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fcfa6229590] 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:29:49.670 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:29:49.389+0000 7fce8fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:29:49.389+0000 7fce8fe07640 10 monclient: dump: 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 10 monclient: shutdown 2024-09-12T00:29:49.671 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 asok(0x557c5277e630) unregister_commands rotate-key 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 10 monclient: build_initial_monmap 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 1 build_initial for_mkfs: 0 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 10 monclient: monmap: 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.672 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding auth protocol: cephx 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding auth protocol: cephx 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding auth protocol: cephx 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.673 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 1 librados: starting msgr at 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 1 librados: starting objecter 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command objecter_requests hook 0x557c529a08c0 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 1 librados: setting wanted keys 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 1 librados: calling monclient init 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient: init 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding auth protocol: cephx 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding auth protocol: cephx 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding auth protocol: cephx 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.674 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command rotate-key hook 0x557c5299da18 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:49.675 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-a con 0x557c52857220 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-b con 0x557c528e0f90 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-c con 0x557c528e1390 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): authenticate will time out at 2408.955812s 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request con 0x557c52857220 auth_method 0 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.676 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:29:49.390+0000 7fcfa2231640 10 monclient(hunting): get_auth_request con 0x557c528e1390 auth_method 0 2024-09-12T00:29:49.677 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:29:49.390+0000 7fcfa2231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.677 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:29:49.390+0000 7fcfa2231640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.677 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:29:49.390+0000 7fcfa2231640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.677 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.677 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.677 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.677 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:29:49.391+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:29:49.391+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:29:49.391+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:29:49.391+0000 7fcfa122f640 10 monclient(hunting): get_auth_request con 0x557c528e0f90 auth_method 0 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:29:49.391+0000 7fcfa122f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:29:49.391+0000 7fcfa122f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:29:49.391+0000 7fcfa122f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_done global_id 8250 payload 824 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 10 monclient: _finish_hunting 0 2024-09-12T00:29:49.678 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 1 monclient: found mon.noname-a 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: dump: 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.679 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: _finish_auth 0 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: _check_auth_tickets 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: dump: 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.680 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 5 monclient: authenticate success, global_id 8250 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:29:49.391+0000 7fce8fe07640 4 set_mon_vals no callback set 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 1 librados: init done 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:29:49.393+0000 7fce8e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:49.681 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:29:49.393+0000 7fce8e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:29:49.393+0000 7fce8e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:29:49.393+0000 7fcfa122f640 10 monclient: get_auth_request con 0x7fce88076470 auth_method 0 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:29:49.394+0000 7fcfa2231640 10 monclient: get_auth_request con 0x557c529e92f0 auth_method 0 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:29:49.395+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x557c529ec4d0 auth_method 0 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:29:49.395+0000 7fcfa122f640 10 monclient: get_auth_request con 0x557c529f0ba0 auth_method 0 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 10 monclient: build_initial_monmap 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 1 build_initial for_mkfs: 0 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 10 monclient: monmap: 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:49.682 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding auth protocol: cephx 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding auth protocol: cephx 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding auth protocol: cephx 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.683 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command objecter_requests cmddesc objecter_requests hook 0x557c529f8d80 EEXIST 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 10 monclient: init 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding auth protocol: cephx 2024-09-12T00:29:49.684 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding auth protocol: cephx 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding auth protocol: cephx 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.685 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command rotate-key cmddesc rotate-key hook 0x557c529f4090 EEXIST 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-a con 0x557c52a1d0a0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-c con 0x557c52a1d480 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-b con 0x557c52a1bdb0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): authenticate will time out at 2408.963493s 2024-09-12T00:29:49.686 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): get_auth_request con 0x557c52a1d480 auth_method 0 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request con 0x557c52a1d0a0 auth_method 0 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): get_auth_request con 0x557c52a1bdb0 auth_method 0 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.687 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient: _finish_hunting 0 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 1 monclient: found mon.noname-a 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:49.688 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: dump: 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: _finish_auth 0 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: _check_auth_tickets 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:49.689 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: dump: 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.690 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 5 monclient: authenticate success, global_id 8253 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:29:49.399+0000 7fcfa2a32640 4 set_mon_vals no callback set 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:29:49.400+0000 7fce877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:29:49.400+0000 7fce877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:29:49.400+0000 7fce877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:29:49.401+0000 7fcfa122f640 10 monclient: get_auth_request con 0x7fce7c076380 auth_method 0 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 10 monclient: get_monmap_and_config 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 10 monclient: build_initial_monmap 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 1 build_initial for_mkfs: 0 2024-09-12T00:29:49.691 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 10 monclient: monmap: 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding auth protocol: cephx 2024-09-12T00:29:49.692 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding auth protocol: cephx 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding auth protocol: cephx 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.693 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 10 monclient: init 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding auth protocol: cephx 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding auth protocol: cephx 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding auth protocol: cephx 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.694 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command rotate-key cmddesc rotate-key hook 0x7ffc7f62d458 EEXIST 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-c con 0x557c52a71540 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-a con 0x557c52a42490 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-b con 0x557c52a6cde0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.695 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): authenticate will time out at 2408.967306s 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request con 0x557c52a71540 auth_method 0 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): get_auth_request con 0x557c52a42490 auth_method 0 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.696 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:29:49.402+0000 7fcfa2231640 10 monclient(hunting): get_auth_request con 0x557c52a6cde0 auth_method 0 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:29:49.402+0000 7fcfa2231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:29:49.402+0000 7fcfa2231640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:29:49.402+0000 7fcfa2231640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_done global_id 7691 payload 274 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient: _finish_hunting 0 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 1 monclient: found mon.noname-c 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.697 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: dump: 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: _finish_auth 0 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: _check_auth_tickets 2024-09-12T00:29:49.698 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 5 monclient: authenticate success, global_id 7691 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient: get_monmap_and_config success 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 4 set_mon_vals no callback set 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: dump: 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.699 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 10 monclient: shutdown 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 10 monclient: build_initial_monmap 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 build_initial for_mkfs: 0 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 10 monclient: monmap: 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.700 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding auth protocol: cephx 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding auth protocol: cephx 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding auth protocol: cephx 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.701 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 librados: starting msgr at 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 librados: starting objecter 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command objecter_requests cmddesc objecter_requests hook 0x557c52a71210 EEXIST 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 librados: setting wanted keys 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 librados: calling monclient init 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 10 monclient: init 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding auth protocol: cephx 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding auth protocol: cephx 2024-09-12T00:29:49.702 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding auth protocol: cephx 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.703 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command rotate-key cmddesc rotate-key hook 0x557c52a31aa8 EEXIST 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-b con 0x557c52a42490 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-a con 0x557c52a6cde0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-c con 0x557c52a71540 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.704 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): authenticate will time out at 2408.969513s 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): get_auth_request con 0x557c52a6cde0 auth_method 0 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): get_auth_request con 0x557c52a71540 auth_method 0 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request con 0x557c52a42490 auth_method 0 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.705 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient: _finish_hunting 0 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:29:49.404+0000 7fcfa122f640 1 monclient: found mon.noname-a 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.706 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: dump: 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: _finish_auth 0 2024-09-12T00:29:49.707 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: _check_auth_tickets 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: dump: 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.708 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 5 monclient: authenticate success, global_id 8259 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:29:49.405+0000 7fce857fa640 4 set_mon_vals no callback set 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 1 librados: init done 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cr dump hook 0x557c52a622c8 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:29:49.406+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:29:49.407+0000 7fce737fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:29:49.407+0000 7fce737fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.709 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:29:49.407+0000 7fce737fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:29:49.407+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x7fce6c076470 auth_method 0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:29:49.408+0000 7fcfa2231640 10 monclient: get_auth_request con 0x557c52a8b620 auth_method 0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 realm 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:29:49.409+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x557c52a8f790 auth_method 0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.710 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:29:49.410+0000 7fcfa122f640 10 monclient: get_auth_request con 0x557c52a92ff0 auth_method 0 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:29:49.410+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:29:49.410+0000 7fcfa3f46800 20 searching for the correct realm 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:29:49.410+0000 7fcfa2231640 10 monclient: get_auth_request con 0x557c52a97d70 auth_method 0 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:29:49.411+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x7fcf9c01f040 auth_method 0 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:29:49.412+0000 7fcfa122f640 10 monclient: get_auth_request con 0x7fcf9406c060 auth_method 0 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:29:49.412+0000 7fcfa122f640 0 -- 172.21.15.33:0/2511704835 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fcf9406c060 msgr2=0x7fcf9404d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:29:49.412+0000 7fce737fe640 1 client.8259.objecter ms_handle_reset 0x7fcf9406c060 session 0x7fcf94097040 osd.2 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:29:49.412+0000 7fce737fe640 10 monclient: _renew_subs 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:29:49.412+0000 7fce737fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:29:49.412+0000 7fcfa122f640 10 monclient: get_auth_request con 0x7fce6c086c20 auth_method 0 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:29:49.414+0000 7fcfa2231640 10 monclient: get_auth_request con 0x7fcf98041020 auth_method 0 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:29:49.416+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x7fcf9806c990 auth_method 0 2024-09-12T00:29:49.711 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:29:49.416+0000 7fcfa1a30640 0 -- 172.21.15.33:0/2511704835 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fcf9806c990 msgr2=0x7fcf9806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:29:49.617+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x7fcf9806c990 auth_method 0 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 zone default found 2024-09-12T00:29:49.712 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 Realm: () 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 zonegroup default 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 started sync module instance, tier type = 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=0 2024-09-12T00:29:49.713 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=1 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=2 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=3 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=4 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=5 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=6 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=7 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding auth protocol: cephx 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding auth protocol: cephx 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding auth protocol: cephx 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.714 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:29:49.636+0000 7fce53fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:49.715 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cache list hook 0x557c52a3faf0 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cache inspect hook 0x557c52a3faf0 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cache erase hook 0x557c52a3faf0 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cache zap hook 0x557c52a3faf0 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 note: GC not initialized 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:29:49.637+0000 7fce52ffd640 20 reqs_thread_entry: start 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command sync trace show hook 0x7fcf940bc070 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command sync trace history hook 0x7fcf940bc070 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command sync trace active hook 0x7fcf940bc070 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command sync trace active_short hook 0x7fcf940bc070 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 Filter name: none 2024-09-12T00:29:49.716 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:29:49.637+0000 7fce50ff9640 20 reqs_thread_entry: start 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.717 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 93992451175584 notifier 8259 bl.length()=911 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:29:49.718 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:29:49.651+0000 7fcfa3f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcfa3f46800 time 2024-09-12T00:29:49.652088+0000 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcfa758c71a] 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcfa758c8d8] 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c518e8641] 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557c518f838a] 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fcfa6229590] 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.719 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:29:49.652+0000 7fcfa3f46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fcfa3f46800 thread_name:radosgw-admin 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcfa623e6f0] 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcfa628b99c] 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcfa758c774] 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcfa758c8d8] 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c518e8641] 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557c518f838a] 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fcfa6229590] 2024-09-12T00:29:49.720 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:29:49.721 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:29:49.722 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:29:49.723 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:29:49.724 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:29:49.725 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:29:49.726 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:29:49.727 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce50ff9640 / http_manager 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce52ffd640 / http_manager 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce53fff640 / rgw_dt_lg_renew 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce737fe640 / ms_dispatch 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce84ff9640 / io_context_pool 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce857fa640 / io_context_pool 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce877fe640 / ms_dispatch 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce8e604640 / ms_dispatch 2024-09-12T00:29:49.728 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce8fe07640 / io_context_pool 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa122f640 / msgr-worker-2 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa1a30640 / msgr-worker-1 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa2231640 / msgr-worker-0 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa2a32640 / io_context_pool 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa3f46800 / radosgw-admin 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.150458.log 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:29:49.389+0000 7fce8fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:29:49.389+0000 7fce8fe07640 10 monclient: dump: 2024-09-12T00:29:49.729 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 10 monclient: shutdown 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 asok(0x557c5277e630) unregister_commands rotate-key 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 10 monclient: build_initial_monmap 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 1 build_initial for_mkfs: 0 2024-09-12T00:29:49.730 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 10 monclient: monmap: 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding auth protocol: cephx 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding auth protocol: cephx 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding auth protocol: cephx 2024-09-12T00:29:49.731 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: crc 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:29:49.389+0000 7fcfa3f46800 5 AuthRegistry(0x557c529a3390) adding con mode: secure 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.732 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 1 librados: starting msgr at 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 1 librados: starting objecter 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command objecter_requests hook 0x557c529a08c0 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 1 librados: setting wanted keys 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 1 librados: calling monclient init 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient: init 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding auth protocol: cephx 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding auth protocol: cephx 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding auth protocol: cephx 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.733 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: crc 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 AuthRegistry(0x557c5299d8d0) adding con mode: secure 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command rotate-key hook 0x557c5299da18 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-a con 0x557c52857220 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:49.734 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-b con 0x557c528e0f90 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-c con 0x557c528e1390 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:29:49.390+0000 7fcfa3f46800 10 monclient(hunting): authenticate will time out at 2408.955812s 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request con 0x557c52857220 auth_method 0 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:29:49.390+0000 7fcfa2231640 10 monclient(hunting): get_auth_request con 0x557c528e1390 auth_method 0 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:29:49.390+0000 7fcfa2231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:29:49.390+0000 7fcfa2231640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.735 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:29:49.390+0000 7fcfa2231640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:29:49.390+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:29:49.391+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:29:49.391+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:29:49.391+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:29:49.391+0000 7fcfa122f640 10 monclient(hunting): get_auth_request con 0x557c528e0f90 auth_method 0 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:29:49.391+0000 7fcfa122f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:29:49.391+0000 7fcfa122f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:29:49.391+0000 7fcfa122f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_done global_id 8250 payload 824 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 10 monclient: _finish_hunting 0 2024-09-12T00:29:49.736 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 1 monclient: found mon.noname-a 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:29:49.391+0000 7fcfa1a30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: dump: 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.737 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: _finish_auth 0 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: _check_auth_tickets 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:29:49.391+0000 7fce8e604640 10 monclient: dump: 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.738 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 5 monclient: authenticate success, global_id 8250 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:29:49.391+0000 7fce8fe07640 4 set_mon_vals no callback set 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:29:49.391+0000 7fcfa3f46800 1 librados: init done 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:29:49.393+0000 7fce8e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:29:49.393+0000 7fce8e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:29:49.393+0000 7fce8e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:29:49.393+0000 7fcfa122f640 10 monclient: get_auth_request con 0x7fce88076470 auth_method 0 2024-09-12T00:29:49.739 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:29:49.394+0000 7fcfa2231640 10 monclient: get_auth_request con 0x557c529e92f0 auth_method 0 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:29:49.395+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x557c529ec4d0 auth_method 0 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:29:49.395+0000 7fcfa122f640 10 monclient: get_auth_request con 0x557c529f0ba0 auth_method 0 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 10 monclient: build_initial_monmap 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 1 build_initial for_mkfs: 0 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 10 monclient: monmap: 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:49.740 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding auth protocol: cephx 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding auth protocol: cephx 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding auth protocol: cephx 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.741 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: crc 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f5870) adding con mode: secure 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command objecter_requests cmddesc objecter_requests hook 0x557c529f8d80 EEXIST 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 10 monclient: init 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding auth protocol: cephx 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding auth protocol: cephx 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding auth protocol: cephx 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.742 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: crc 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:29:49.397+0000 7fcfa3f46800 5 AuthRegistry(0x557c529f3f48) adding con mode: secure 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command rotate-key cmddesc rotate-key hook 0x557c529f4090 EEXIST 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-a con 0x557c52a1d0a0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-c con 0x557c52a1d480 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:49.743 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-b con 0x557c52a1bdb0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:29:49.398+0000 7fcfa3f46800 10 monclient(hunting): authenticate will time out at 2408.963493s 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): get_auth_request con 0x557c52a1d480 auth_method 0 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request con 0x557c52a1d0a0 auth_method 0 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.744 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): get_auth_request con 0x557c52a1bdb0 auth_method 0 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:29:49.398+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:29:49.398+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.745 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient: _finish_hunting 0 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 1 monclient: found mon.noname-a 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:29:49.398+0000 7fcfa1a30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: dump: 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.746 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: _finish_auth 0 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: _check_auth_tickets 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:29:49.399+0000 7fce877fe640 10 monclient: dump: 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.747 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 5 monclient: authenticate success, global_id 8253 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:29:49.399+0000 7fcfa2a32640 4 set_mon_vals no callback set 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:29:49.399+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:29:49.400+0000 7fce877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:29:49.400+0000 7fce877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.748 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:29:49.400+0000 7fce877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:29:49.401+0000 7fcfa122f640 10 monclient: get_auth_request con 0x7fce7c076380 auth_method 0 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 10 monclient: get_monmap_and_config 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 10 monclient: build_initial_monmap 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 1 build_initial for_mkfs: 0 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 10 monclient: monmap: 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:49.749 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding auth protocol: cephx 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding auth protocol: cephx 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding auth protocol: cephx 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.750 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: crc 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a3ce80) adding con mode: secure 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 10 monclient: init 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding auth protocol: cephx 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding auth protocol: cephx 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding auth protocol: cephx 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.751 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: crc 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:29:49.401+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d310) adding con mode: secure 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command rotate-key cmddesc rotate-key hook 0x7ffc7f62d458 EEXIST 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-c con 0x557c52a71540 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:49.752 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-a con 0x557c52a42490 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-b con 0x557c52a6cde0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient(hunting): authenticate will time out at 2408.967306s 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request con 0x557c52a71540 auth_method 0 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): get_auth_request con 0x557c52a42490 auth_method 0 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.753 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:29:49.402+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:29:49.402+0000 7fcfa2231640 10 monclient(hunting): get_auth_request con 0x557c52a6cde0 auth_method 0 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:29:49.402+0000 7fcfa2231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:29:49.402+0000 7fcfa2231640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:29:49.402+0000 7fcfa2231640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_done global_id 7691 payload 274 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient: _finish_hunting 0 2024-09-12T00:29:49.754 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 1 monclient: found mon.noname-c 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:29:49.402+0000 7fcfa1a30640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: dump: 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.755 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: _finish_auth 0 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: _check_auth_tickets 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 5 monclient: authenticate success, global_id 7691 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 10 monclient: get_monmap_and_config success 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:29:49.402+0000 7fcfa3f46800 4 set_mon_vals no callback set 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:29:49.402+0000 7fce857fa640 10 monclient: dump: 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.756 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 10 monclient: shutdown 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 10 monclient: build_initial_monmap 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 build_initial for_mkfs: 0 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 10 monclient: monmap: 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:49.757 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding auth protocol: cephx 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding auth protocol: cephx 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding auth protocol: cephx 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.758 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: crc 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a63110) adding con mode: secure 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 librados: starting msgr at 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 librados: starting objecter 2024-09-12T00:29:49.759 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command objecter_requests cmddesc objecter_requests hook 0x557c52a71210 EEXIST 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 librados: setting wanted keys 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 1 librados: calling monclient init 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 10 monclient: init 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding auth protocol: cephx 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding auth protocol: cephx 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding auth protocol: cephx 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:29:49.403+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.760 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: crc 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 AuthRegistry(0x557c52a31960) adding con mode: secure 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command rotate-key cmddesc rotate-key hook 0x557c52a31aa8 EEXIST 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:29:49.761 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-b con 0x557c52a42490 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-a con 0x557c52a6cde0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): picked mon.noname-c con 0x557c52a71540 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:29:49.404+0000 7fcfa3f46800 10 monclient(hunting): authenticate will time out at 2408.969513s 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): get_auth_request con 0x557c52a6cde0 auth_method 0 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): get_auth_request con 0x557c52a71540 auth_method 0 2024-09-12T00:29:49.762 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request con 0x557c52a42490 auth_method 0 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:29:49.404+0000 7fcfa2231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:49.763 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:29:49.404+0000 7fcfa1a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient: _finish_hunting 0 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:29:49.404+0000 7fcfa122f640 1 monclient: found mon.noname-a 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:29:49.404+0000 7fcfa122f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: dump: 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.764 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: _finish_auth 0 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: _check_auth_tickets 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:29:49.405+0000 7fce737fe640 10 monclient: dump: 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:29:49.765 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 5 monclient: authenticate success, global_id 8259 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:29:49.405+0000 7fce857fa640 4 set_mon_vals no callback set 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 10 monclient: _renew_subs 2024-09-12T00:29:49.766 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 1 librados: init done 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:29:49.405+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cr dump hook 0x557c52a622c8 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:29:49.406+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:29:49.407+0000 7fce737fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:29:49.407+0000 7fce737fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:29:49.407+0000 7fce737fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:29:49.407+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x7fce6c076470 auth_method 0 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:29:49.408+0000 7fcfa2231640 10 monclient: get_auth_request con 0x557c52a8b620 auth_method 0 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 realm 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.767 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:29:49.408+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:29:49.409+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x557c52a8f790 auth_method 0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:29:49.409+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:29:49.410+0000 7fcfa122f640 10 monclient: get_auth_request con 0x557c52a92ff0 auth_method 0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:29:49.410+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:29:49.410+0000 7fcfa3f46800 20 searching for the correct realm 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:29:49.410+0000 7fcfa2231640 10 monclient: get_auth_request con 0x557c52a97d70 auth_method 0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:29:49.411+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x7fcf9c01f040 auth_method 0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:29:49.412+0000 7fcfa122f640 10 monclient: get_auth_request con 0x7fcf9406c060 auth_method 0 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:29:49.412+0000 7fcfa122f640 0 -- 172.21.15.33:0/2511704835 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fcf9406c060 msgr2=0x7fcf9404d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.768 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:29:49.412+0000 7fce737fe640 1 client.8259.objecter ms_handle_reset 0x7fcf9406c060 session 0x7fcf94097040 osd.2 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:29:49.412+0000 7fce737fe640 10 monclient: _renew_subs 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:29:49.412+0000 7fce737fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:29:49.412+0000 7fcfa122f640 10 monclient: get_auth_request con 0x7fce6c086c20 auth_method 0 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:29:49.414+0000 7fcfa2231640 10 monclient: get_auth_request con 0x7fcf98041020 auth_method 0 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:29:49.416+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x7fcf9806c990 auth_method 0 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:29:49.416+0000 7fcfa1a30640 0 -- 172.21.15.33:0/2511704835 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fcf9806c990 msgr2=0x7fcf9806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:29:49.617+0000 7fcfa1a30640 10 monclient: get_auth_request con 0x7fcf9806c990 auth_method 0 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:49.769 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:29:49.622+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 zone default found 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 Realm: () 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 zonegroup default 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.770 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:29:49.623+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 started sync module instance, tier type = 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:29:49.624+0000 7fcfa3f46800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=0 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=1 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=2 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=3 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=4 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=5 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=6 2024-09-12T00:29:49.771 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 20 add_watcher() i=7 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:29:49.634+0000 7fcfa3f46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding auth protocol: cephx 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding auth protocol: cephx 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding auth protocol: cephx 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.772 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:29:49.636+0000 7fce53fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: crc 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:29:49.636+0000 7fcfa3f46800 5 AuthRegistry(0x7ffc7f62d7f0) adding con mode: secure 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cache list hook 0x557c52a3faf0 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cache inspect hook 0x557c52a3faf0 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cache erase hook 0x557c52a3faf0 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command cache zap hook 0x557c52a3faf0 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 note: GC not initialized 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:29:49.637+0000 7fce52ffd640 20 reqs_thread_entry: start 2024-09-12T00:29:49.773 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command sync trace show hook 0x7fcf940bc070 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command sync trace history hook 0x7fcf940bc070 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command sync trace active hook 0x7fcf940bc070 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 5 asok(0x557c5277e630) register_command sync trace active_short hook 0x7fcf940bc070 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 Filter name: none 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:29:49.637+0000 7fce50ff9640 20 reqs_thread_entry: start 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:29:49.637+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.774 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:29:49.638+0000 7fcfa3f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:29:49.643+0000 7fcfa3f46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 93992451175584 notifier 8259 bl.length()=911 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.775 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:29:49.644+0000 7fce84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:29:49.645+0000 7fcfa3f46800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:29:49.651+0000 7fcfa3f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcfa3f46800 time 2024-09-12T00:29:49.652088+0000 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcfa758c71a] 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcfa758c8d8] 2024-09-12T00:29:49.776 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c518e8641] 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557c518f838a] 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fcfa6229590] 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:29:49.652+0000 7fcfa3f46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fcfa3f46800 thread_name:radosgw-admin 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcfa623e6f0] 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcfa628b99c] 2024-09-12T00:29:49.777 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcfa758c774] 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcfa758c8d8] 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c518e8641] 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557c518f838a] 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fcfa6229590] 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:29:49.778 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:29:49.779 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:29:49.780 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:29:49.781 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:29:49.782 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:29:49.783 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:29:49.784 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce50ff9640 / http_manager 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce52ffd640 / http_manager 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce53fff640 / rgw_dt_lg_renew 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce737fe640 / ms_dispatch 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce84ff9640 / io_context_pool 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce857fa640 / io_context_pool 2024-09-12T00:29:49.785 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce877fe640 / ms_dispatch 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce8e604640 / ms_dispatch 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: 7fce8fe07640 / io_context_pool 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa122f640 / msgr-worker-2 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa1a30640 / msgr-worker-1 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa2231640 / msgr-worker-0 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa2a32640 / io_context_pool 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: 7fcfa3f46800 / radosgw-admin 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:29:49.653489Z_de1730b2-e1e5-4085-b13f-2a4ce62e3eb3/log 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:29:49.786 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:49.791 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:49.791 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:49.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.730+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.791 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.732+0000 7fb053536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.732+0000 7fb053536800 20 realm 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.732+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.732+0000 7fb053536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.732+0000 7fb053536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.732+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.732+0000 7fb053536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.732+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.733+0000 7fb053536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.733+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.734+0000 7fb053536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.734+0000 7fb053536800 20 searching for the correct realm 2024-09-12T00:29:49.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.737+0000 7fb04f2b7640 0 -- 172.21.15.33:0/3383124218 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fb048081070 msgr2=0x7fb0480911e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.740+0000 7fb04f2b7640 0 -- 172.21.15.33:0/3383124218 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fb0440a69d0 msgr2=0x7fb0440dc8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.745+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:49.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 20 zone default found 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 4 Realm: () 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 20 zonegroup default 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.746+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.747+0000 7fb053536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.747+0000 7fb053536800 20 started sync module instance, tier type = 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.747+0000 7fb053536800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:49.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.755+0000 7fb053536800 20 add_watcher() i=0 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.755+0000 7fb053536800 20 add_watcher() i=1 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.755+0000 7fb053536800 20 add_watcher() i=2 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.755+0000 7fb053536800 20 add_watcher() i=3 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.755+0000 7fb053536800 20 add_watcher() i=4 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.755+0000 7fb053536800 20 add_watcher() i=5 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.755+0000 7fb053536800 20 add_watcher() i=6 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.757+0000 7fb053536800 20 add_watcher() i=7 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.757+0000 7fb053536800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.758+0000 7faf05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.758+0000 7fb053536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.759+0000 7fb053536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.759+0000 7fb053536800 5 note: GC not initialized 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.759+0000 7faf04fe1640 20 reqs_thread_entry: start 2024-09-12T00:29:49.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.759+0000 7fb053536800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.759+0000 7fb053536800 20 Filter name: none 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.759+0000 7fae7e7fc640 20 reqs_thread_entry: start 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.759+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.760+0000 7fb053536800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.760+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.760+0000 7fb053536800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.760+0000 7fb053536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.760+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.761+0000 7fb053536800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.761+0000 7fb053536800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.761+0000 7fb053536800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.762+0000 7fb053536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.763+0000 7faf05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.796 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.765+0000 7fb053536800 20 remove_watcher() i=0 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.765+0000 7fb053536800 2 removed watcher, disabling cache 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.767+0000 7fb053536800 20 remove_watcher() i=1 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.768+0000 7fb053536800 20 remove_watcher() i=2 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.769+0000 7fb053536800 20 remove_watcher() i=3 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.770+0000 7fb053536800 20 remove_watcher() i=4 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.771+0000 7fb053536800 20 remove_watcher() i=5 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.772+0000 7fb053536800 20 remove_watcher() i=6 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.773+0000 7fb053536800 20 remove_watcher() i=7 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:29:49.797 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:29:49.819 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:29:49.848 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:49.849 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:49.888 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.890+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.891+0000 7f3ca000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.891+0000 7f3ca000f800 20 realm 2024-09-12T00:29:49.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.891+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.891+0000 7f3ca000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.891+0000 7f3ca000f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:49.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.891+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.891+0000 7f3ca000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.891+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.892+0000 7f3ca000f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.892+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.893+0000 7f3ca000f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:49.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.893+0000 7f3ca000f800 20 searching for the correct realm 2024-09-12T00:29:49.894 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.896+0000 7f3c9e301640 0 -- 172.21.15.33:0/2865831257 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55b695b63af0 msgr2=0x55b695b65fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.899+0000 7f3c9db00640 0 -- 172.21.15.33:0/2865831257 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f3c940d8bc0 msgr2=0x7f3c940e7a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.904+0000 7f3ca000f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:49.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.904+0000 7f3ca000f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:29:49.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.904+0000 7f3ca000f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:29:49.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.904+0000 7f3ca000f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:49.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.904+0000 7f3ca000f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:49.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.904+0000 7f3ca000f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:49.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.904+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:49.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 zone default found 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 4 Realm: () 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 zonegroup default 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.905+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.906+0000 7f3ca000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.906+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.906+0000 7f3ca000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.906+0000 7f3ca000f800 20 started sync module instance, tier type = 2024-09-12T00:29:49.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.906+0000 7f3ca000f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:29:49.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.915+0000 7f3ca000f800 20 add_watcher() i=0 2024-09-12T00:29:49.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.915+0000 7f3ca000f800 20 add_watcher() i=1 2024-09-12T00:29:49.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.915+0000 7f3ca000f800 20 add_watcher() i=2 2024-09-12T00:29:49.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.915+0000 7f3ca000f800 20 add_watcher() i=3 2024-09-12T00:29:49.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.915+0000 7f3ca000f800 20 add_watcher() i=4 2024-09-12T00:29:49.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.915+0000 7f3ca000f800 20 add_watcher() i=5 2024-09-12T00:29:49.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.915+0000 7f3ca000f800 20 add_watcher() i=6 2024-09-12T00:29:49.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.915+0000 7f3ca000f800 20 add_watcher() i=7 2024-09-12T00:29:49.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.916+0000 7f3ca000f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:49.916 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.917+0000 7f3b4ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.917+0000 7f3ca000f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.917+0000 7f3ca000f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.918+0000 7f3ca000f800 5 note: GC not initialized 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.918+0000 7f3b4effd640 20 reqs_thread_entry: start 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.918+0000 7f3ca000f800 20 init_complete bucket index max shards: 11 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.918+0000 7f3ca000f800 20 Filter name: none 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.918+0000 7f3b4cff9640 20 reqs_thread_entry: start 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.918+0000 7f3ca000f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:49.917 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.918+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:29:49.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:49.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.919+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.920+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.920+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.920+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:49.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.920+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:29:49.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.920+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:49.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.920+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:29:49.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.921+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:49.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.921+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:29:49.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.921+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:49.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.921+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:29:49.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.921+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:49.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.921+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:29:49.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.922+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:49.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.922+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:29:49.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.922+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:49.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.922+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:29:49.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.922+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:49.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.922+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:29:49.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.923+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:49.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.923+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:29:49.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.923+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:49.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.923+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:29:49.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.924+0000 7f3ca000f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:49.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.924+0000 7f3ca000f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:29:49.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.925+0000 7f3b4ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.928+0000 7f3ca000f800 20 remove_watcher() i=0 2024-09-12T00:29:49.926 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.928+0000 7f3ca000f800 2 removed watcher, disabling cache 2024-09-12T00:29:49.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.929+0000 7f3ca000f800 20 remove_watcher() i=1 2024-09-12T00:29:49.928 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.930+0000 7f3ca000f800 20 remove_watcher() i=2 2024-09-12T00:29:49.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.931+0000 7f3ca000f800 20 remove_watcher() i=3 2024-09-12T00:29:49.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.932+0000 7f3ca000f800 20 remove_watcher() i=4 2024-09-12T00:29:49.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.933+0000 7f3ca000f800 20 remove_watcher() i=5 2024-09-12T00:29:49.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.934+0000 7f3ca000f800 20 remove_watcher() i=6 2024-09-12T00:29:49.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:29:49.935+0000 7f3ca000f800 20 remove_watcher() i=7 2024-09-12T00:30:19.948 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:30:19.987 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:19.988 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:20.033 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.035+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.034 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 realm 2024-09-12T00:30:20.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.036+0000 7fc5d68bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:20.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.035 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.037+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:20.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.037+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.036 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.038+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:20.037 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.038+0000 7fc5d68bb800 20 searching for the correct realm 2024-09-12T00:30:20.040 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.042+0000 7fc5d4ba6640 0 -- 172.21.15.33:0/777422816 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x562392728bd0 msgr2=0x56239272b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:20.045 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.047+0000 7fc5d3ba4640 0 -- 172.21.15.33:0/777422816 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x562392728bd0 msgr2=0x7fc49c08b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:20.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:20.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:20.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:20.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:20.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:20.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:20.052 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.053 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:20.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:20.054 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 zone default found 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 Realm: () 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 zonegroup default 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.055 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 started sync module instance, tier type = 2024-09-12T00:30:20.056 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:20.063 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=0 2024-09-12T00:30:20.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=1 2024-09-12T00:30:20.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=2 2024-09-12T00:30:20.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=3 2024-09-12T00:30:20.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=4 2024-09-12T00:30:20.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=5 2024-09-12T00:30:20.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=6 2024-09-12T00:30:20.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.066+0000 7fc5d68bb800 20 add_watcher() i=7 2024-09-12T00:30:20.064 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.066+0000 7fc5d68bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:20.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.067+0000 7fc48afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:20.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:20.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:20.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 note: GC not initialized 2024-09-12T00:30:20.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc489fdb640 20 reqs_thread_entry: start 2024-09-12T00:30:20.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:20.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 Filter name: none 2024-09-12T00:30:20.067 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc3fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:20.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc5d68bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:30:20.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.069+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:20.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:30:20.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.069+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.070+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:30:20.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.071+0000 7fc5d68bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:30:20.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:30:20.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94710780845296 notifier 7745 bl.length()=911 2024-09-12T00:30:20.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:30:20.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:30:20.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:30:20.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5d68bb800 time 2024-09-12T00:30:20.086317+0000 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5d9d8c71a] 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc5d9d8c8d8] 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562390f8e641] 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd8854c) [0x5623914a154c] 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562390f9e31d] 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5d8a29590] 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.086+0000 7fc5d68bb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5d68bb800 time 2024-09-12T00:30:20.086317+0000 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5d9d8c71a] 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc5d9d8c8d8] 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562390f8e641] 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd8854c) [0x5623914a154c] 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562390f9e31d] 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5d8a29590] 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fc5d68bb800 thread_name:radosgw-admin 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5d8a3e6f0] 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5d8a8b99c] 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5d9d8c774] 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc5d9d8c8d8] 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562390f8e641] 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd8854c) [0x5623914a154c] 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562390f9e31d] 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5d8a29590] 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.087+0000 7fc5d68bb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fc5d68bb800 thread_name:radosgw-admin 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5d8a3e6f0] 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5d8a8b99c] 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5d9d8c774] 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc5d9d8c8d8] 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562390f8e641] 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd8854c) [0x5623914a154c] 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562390f9e31d] 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5d8a29590] 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 4 set_mon_vals no callback set 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 10 monclient: shutdown 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 asok(0x56239240f630) unregister_commands rotate-key 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 10 monclient: build_initial_monmap 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 1 build_initial for_mkfs: 0 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 10 monclient: monmap: 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding auth protocol: cephx 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding auth protocol: cephx 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding auth protocol: cephx 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 1 librados: starting msgr at 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 1 librados: starting objecter 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command objecter_requests hook 0x562392633b40 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 1 librados: setting wanted keys 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 1 librados: calling monclient init 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 10 monclient: init 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding auth protocol: cephx 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding auth protocol: cephx 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding auth protocol: cephx 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command rotate-key hook 0x562392632108 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-a con 0x5623924deec0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-b con 0x5623924dff50 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-c con 0x562392575720 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): authenticate will time out at 2439.582059s 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request con 0x5623924deec0 auth_method 0 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request con 0x562392575720 auth_method 0 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:30:20.017+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request con 0x5623924dff50 auth_method 0 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:30:20.017+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:30:20.017+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:30:20.017+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_done global_id 8307 payload 824 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient: _finish_hunting 0 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 1 monclient: found mon.noname-a 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:30:20.017+0000 7fc4c0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: dump: 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.115 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: _finish_auth 0 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: dump: 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.116 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 5 monclient: authenticate success, global_id 8307 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:30:20.018+0000 7fc4c260c640 4 set_mon_vals no callback set 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 1 librados: init done 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:30:20.020+0000 7fc4c0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:30:20.020+0000 7fc4c0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.117 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:30:20.020+0000 7fc4c0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:30:20.020+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x7fc4bc0764c0 auth_method 0 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:30:20.020+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x562392674270 auth_method 0 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:30:20.021+0000 7fc5d43a5640 10 monclient: get_auth_request con 0x56239267d6b0 auth_method 0 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:30:20.022+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x562392681b20 auth_method 0 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 10 monclient: build_initial_monmap 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 1 build_initial for_mkfs: 0 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 10 monclient: monmap: 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.118 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding auth protocol: cephx 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding auth protocol: cephx 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding auth protocol: cephx 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.119 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command objecter_requests cmddesc objecter_requests hook 0x562392689eb0 EEXIST 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 10 monclient: init 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding auth protocol: cephx 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding auth protocol: cephx 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding auth protocol: cephx 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.120 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command rotate-key cmddesc rotate-key hook 0x5623926851a0 EEXIST 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:20.121 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-c con 0x5623926ae1d0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-b con 0x5623926ae5b0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-a con 0x5623926acee0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): authenticate will time out at 2439.590404s 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request con 0x5623926acee0 auth_method 0 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request con 0x5623926ae1d0 auth_method 0 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.122 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request con 0x5623926ae5b0 auth_method 0 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.123 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient: _finish_hunting 0 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 1 monclient: found mon.noname-c 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: dump: 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.124 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: dump: 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.125 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 5 monclient: authenticate success, global_id 7739 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:30:20.026+0000 7fc5d53a7640 4 set_mon_vals no callback set 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:30:20.028+0000 7fc4b9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:30:20.028+0000 7fc4b9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:30:20.028+0000 7fc4b9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:30:20.028+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x7fc4ac076380 auth_method 0 2024-09-12T00:30:20.126 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 10 monclient: get_monmap_and_config 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 10 monclient: build_initial_monmap 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 1 build_initial for_mkfs: 0 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 10 monclient: monmap: 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.127 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding auth protocol: cephx 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding auth protocol: cephx 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding auth protocol: cephx 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.128 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient: init 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding auth protocol: cephx 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding auth protocol: cephx 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding auth protocol: cephx 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.129 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command rotate-key cmddesc rotate-key hook 0x7ffcf8181778 EEXIST 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-c con 0x5623927026b0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-b con 0x5623926d24c0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-a con 0x5623926fda70 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.130 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): authenticate will time out at 2439.594713s 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request con 0x5623927026b0 auth_method 0 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request con 0x5623926fda70 auth_method 0 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.131 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.132 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.132 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.132 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:30:20.030+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request con 0x5623926d24c0 auth_method 0 2024-09-12T00:30:20.132 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:30:20.030+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.132 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:30:20.030+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.132 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:30:20.030+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.132 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:30:20.030+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_done global_id 7742 payload 274 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:30:20.030+0000 7fc5d43a5640 10 monclient: _finish_hunting 0 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:30:20.030+0000 7fc5d43a5640 1 monclient: found mon.noname-c 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:30:20.030+0000 7fc5d43a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: dump: 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.133 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: _finish_auth 0 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: dump: 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.134 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:30:20.030+0000 7fc5d68bb800 5 monclient: authenticate success, global_id 7742 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:30:20.030+0000 7fc5d68bb800 10 monclient: get_monmap_and_config success 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:30:20.030+0000 7fc5d68bb800 4 set_mon_vals no callback set 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:30:20.030+0000 7fc5d68bb800 10 monclient: shutdown 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 10 monclient: build_initial_monmap 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 build_initial for_mkfs: 0 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 10 monclient: monmap: 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:20.135 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding auth protocol: cephx 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding auth protocol: cephx 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding auth protocol: cephx 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.136 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 librados: starting msgr at 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 librados: starting objecter 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command objecter_requests cmddesc objecter_requests hook 0x5623926ff870 EEXIST 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 librados: setting wanted keys 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 librados: calling monclient init 2024-09-12T00:30:20.137 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 10 monclient: init 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding auth protocol: cephx 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding auth protocol: cephx 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding auth protocol: cephx 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.138 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command rotate-key cmddesc rotate-key hook 0x5623926c2bd8 EEXIST 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-c con 0x5623926d24c0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-b con 0x5623926fda70 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-a con 0x5623927026b0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.139 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): authenticate will time out at 2439.597254s 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request con 0x5623926d24c0 auth_method 0 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request con 0x5623927026b0 auth_method 0 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.140 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:30:20.032+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request con 0x5623926fda70 auth_method 0 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:30:20.032+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:30:20.032+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:30:20.032+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_done global_id 7745 payload 824 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient: _finish_hunting 0 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 1 monclient: found mon.noname-c 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: dump: 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.141 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: dump: 2024-09-12T00:30:20.142 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 5 monclient: authenticate success, global_id 7745 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:30:20.032+0000 7fc4ab7fe640 4 set_mon_vals no callback set 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.143 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 1 librados: init done 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cr dump hook 0x5623926f4288 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:30:20.034+0000 7fc4a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:30:20.034+0000 7fc4a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:30:20.034+0000 7fc4a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:30:20.035+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:30:20.035+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x7fc49c0764a0 auth_method 0 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:30:20.035+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x56239271c3c0 auth_method 0 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 realm 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.144 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:30:20.036+0000 7fc5d43a5640 10 monclient: get_auth_request con 0x5623927205b0 auth_method 0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:30:20.037+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:30:20.037+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:30:20.037+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x562392723e10 auth_method 0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:30:20.038+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:30:20.038+0000 7fc5d68bb800 20 searching for the correct realm 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:30:20.038+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x562392728bd0 auth_method 0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:30:20.039+0000 7fc5d43a5640 10 monclient: get_auth_request con 0x7fc5cc032040 auth_method 0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:30:20.040+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x7fc5c4074130 auth_method 0 2024-09-12T00:30:20.145 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:30:20.042+0000 7fc5d4ba6640 0 -- 172.21.15.33:0/777422816 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x562392728bd0 msgr2=0x56239272b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:30:20.042+0000 7fc4a9ffb640 1 client.7745.objecter ms_handle_reset 0x562392728bd0 session 0x562392728550 osd.3 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:30:20.042+0000 7fc4a9ffb640 10 monclient: _renew_subs 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:30:20.042+0000 7fc4a9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:30:20.042+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x7fc49c086c50 auth_method 0 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:30:20.044+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x7fc5c808bbf0 auth_method 0 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:30:20.046+0000 7fc4a9ffb640 1 client.7745.objecter ms_handle_reset 0x562392723e10 session 0x56239271f940 osd.4 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:30:20.046+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x562392728bd0 auth_method 0 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:30:20.047+0000 7fc5d3ba4640 0 -- 172.21.15.33:0/777422816 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x562392728bd0 msgr2=0x7fc49c08b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:30:20.047+0000 7fc4a9ffb640 1 client.7745.objecter ms_handle_reset 0x562392728bd0 session 0x56239271f940 osd.4 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:30:20.047+0000 7fc5d43a5640 10 monclient: get_auth_request con 0x7fc5c8096c30 auth_method 0 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:30:20.047+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x562392723e10 auth_method 0 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:20.146 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 zone default found 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 Realm: () 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:20.147 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 zonegroup default 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 started sync module instance, tier type = 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=0 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=1 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=2 2024-09-12T00:30:20.148 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=3 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=4 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=5 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=6 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:30:20.066+0000 7fc5d68bb800 20 add_watcher() i=7 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:30:20.066+0000 7fc5d68bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding auth protocol: cephx 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding auth protocol: cephx 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding auth protocol: cephx 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.149 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:30:20.067+0000 7fc48afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cache list hook 0x5623926f0ed0 2024-09-12T00:30:20.150 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cache inspect hook 0x5623926f0ed0 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cache erase hook 0x5623926f0ed0 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cache zap hook 0x5623926f0ed0 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 note: GC not initialized 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:30:20.068+0000 7fc489fdb640 20 reqs_thread_entry: start 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command sync trace show hook 0x7fc5c4084070 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command sync trace history hook 0x7fc5c4084070 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command sync trace active hook 0x7fc5c4084070 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command sync trace active_short hook 0x7fc5c4084070 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 Filter name: none 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:30:20.068+0000 7fc3fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.151 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:30:20.071+0000 7fc5d68bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.152 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94710780845296 notifier 7745 bl.length()=911 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:30:20.086+0000 7fc5d68bb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5d68bb800 time 2024-09-12T00:30:20.086317+0000 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.153 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5d9d8c71a] 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc5d9d8c8d8] 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562390f8e641] 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd8854c) [0x5623914a154c] 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562390f9e31d] 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5d8a29590] 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:30:20.087+0000 7fc5d68bb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fc5d68bb800 thread_name:radosgw-admin 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.154 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5d8a3e6f0] 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5d8a8b99c] 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5d9d8c774] 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc5d9d8c8d8] 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562390f8e641] 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd8854c) [0x5623914a154c] 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562390f9e31d] 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5d8a29590] 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:20.155 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:30:20.156 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:30:20.157 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:30:20.158 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:30:20.159 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:30:20.160 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:30:20.161 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:30:20.162 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc3fb7fe640 / http_manager 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc489fdb640 / http_manager 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc48afdd640 / rgw_dt_lg_renew 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4a9ffb640 / ms_dispatch 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4ab7fe640 / io_context_pool 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4b9ffb640 / ms_dispatch 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4c0e09640 / ms_dispatch 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4c260c640 / io_context_pool 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d3ba4640 / msgr-worker-2 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d43a5640 / msgr-worker-1 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d4ba6640 / msgr-worker-0 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d53a7640 / io_context_pool 2024-09-12T00:30:20.163 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d68bb800 / radosgw-admin 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.152230.log 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 4 set_mon_vals no callback set 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 10 monclient: shutdown 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 asok(0x56239240f630) unregister_commands rotate-key 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 10 monclient: build_initial_monmap 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 1 build_initial for_mkfs: 0 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 10 monclient: monmap: 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:20.164 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding auth protocol: cephx 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding auth protocol: cephx 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding auth protocol: cephx 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.165 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: crc 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:30:20.015+0000 7fc5d68bb800 5 AuthRegistry(0x5623926342c0) adding con mode: secure 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 1 librados: starting msgr at 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 1 librados: starting objecter 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command objecter_requests hook 0x562392633b40 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 1 librados: setting wanted keys 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 1 librados: calling monclient init 2024-09-12T00:30:20.166 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 10 monclient: init 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding auth protocol: cephx 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding auth protocol: cephx 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding auth protocol: cephx 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: crc 2024-09-12T00:30:20.167 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 AuthRegistry(0x562392631fc0) adding con mode: secure 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command rotate-key hook 0x562392632108 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:30:20.016+0000 7fc5d68bb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-a con 0x5623924deec0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-b con 0x5623924dff50 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-c con 0x562392575720 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:20.168 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:30:20.017+0000 7fc5d68bb800 10 monclient(hunting): authenticate will time out at 2439.582059s 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request con 0x5623924deec0 auth_method 0 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request con 0x562392575720 auth_method 0 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.169 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:30:20.017+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:30:20.017+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request con 0x5623924dff50 auth_method 0 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:30:20.017+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:30:20.017+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:30:20.017+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_done global_id 8307 payload 824 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient: _finish_hunting 0 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 1 monclient: found mon.noname-a 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:30:20.017+0000 7fc5d43a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:30:20.017+0000 7fc4c0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: dump: 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.170 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: _finish_auth 0 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:30:20.018+0000 7fc4c0e09640 10 monclient: dump: 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.171 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 5 monclient: authenticate success, global_id 8307 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:30:20.018+0000 7fc4c260c640 4 set_mon_vals no callback set 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.172 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:30:20.018+0000 7fc5d68bb800 1 librados: init done 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:30:20.020+0000 7fc4c0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:30:20.020+0000 7fc4c0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:30:20.020+0000 7fc4c0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:30:20.020+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x7fc4bc0764c0 auth_method 0 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:30:20.020+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x562392674270 auth_method 0 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:30:20.021+0000 7fc5d43a5640 10 monclient: get_auth_request con 0x56239267d6b0 auth_method 0 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:30:20.022+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x562392681b20 auth_method 0 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 10 monclient: build_initial_monmap 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 1 build_initial for_mkfs: 0 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 10 monclient: monmap: 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:20.173 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding auth protocol: cephx 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding auth protocol: cephx 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding auth protocol: cephx 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.174 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: crc 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392686a30) adding con mode: secure 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command objecter_requests cmddesc objecter_requests hook 0x562392689eb0 EEXIST 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 10 monclient: init 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding auth protocol: cephx 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding auth protocol: cephx 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding auth protocol: cephx 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.175 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: crc 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:30:20.024+0000 7fc5d68bb800 5 AuthRegistry(0x562392685058) adding con mode: secure 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.176 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command rotate-key cmddesc rotate-key hook 0x5623926851a0 EEXIST 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-c con 0x5623926ae1d0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-b con 0x5623926ae5b0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-a con 0x5623926acee0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:30:20.025+0000 7fc5d68bb800 10 monclient(hunting): authenticate will time out at 2439.590404s 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request con 0x5623926acee0 auth_method 0 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.177 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request con 0x5623926ae1d0 auth_method 0 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request con 0x5623926ae5b0 auth_method 0 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:30:20.025+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.178 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:30:20.025+0000 7fc5d3ba4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient: _finish_hunting 0 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 1 monclient: found mon.noname-c 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:30:20.025+0000 7fc5d43a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: dump: 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.179 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:30:20.026+0000 7fc4b9ffb640 10 monclient: dump: 2024-09-12T00:30:20.180 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 5 monclient: authenticate success, global_id 7739 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:30:20.026+0000 7fc5d53a7640 4 set_mon_vals no callback set 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.181 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:30:20.026+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:30:20.028+0000 7fc4b9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:30:20.028+0000 7fc4b9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:30:20.028+0000 7fc4b9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:30:20.028+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x7fc4ac076380 auth_method 0 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 10 monclient: get_monmap_and_config 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 10 monclient: build_initial_monmap 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 1 build_initial for_mkfs: 0 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 10 monclient: monmap: 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:20.182 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding auth protocol: cephx 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding auth protocol: cephx 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding auth protocol: cephx 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.183 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: crc 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:30:20.028+0000 7fc5d68bb800 5 AuthRegistry(0x5623926ce010) adding con mode: secure 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient: init 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding auth protocol: cephx 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding auth protocol: cephx 2024-09-12T00:30:20.184 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding auth protocol: cephx 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: crc 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181630) adding con mode: secure 2024-09-12T00:30:20.185 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command rotate-key cmddesc rotate-key hook 0x7ffcf8181778 EEXIST 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-c con 0x5623927026b0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-b con 0x5623926d24c0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-a con 0x5623926fda70 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:30:20.029+0000 7fc5d68bb800 10 monclient(hunting): authenticate will time out at 2439.594713s 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request con 0x5623927026b0 auth_method 0 2024-09-12T00:30:20.186 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request con 0x5623926fda70 auth_method 0 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:30:20.029+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:30:20.029+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:30:20.030+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request con 0x5623926d24c0 auth_method 0 2024-09-12T00:30:20.187 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:30:20.030+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:30:20.030+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:30:20.030+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:30:20.030+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_done global_id 7742 payload 274 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:30:20.030+0000 7fc5d43a5640 10 monclient: _finish_hunting 0 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:30:20.030+0000 7fc5d43a5640 1 monclient: found mon.noname-c 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:30:20.030+0000 7fc5d43a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: dump: 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.188 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: _finish_auth 0 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:30:20.030+0000 7fc4ab7fe640 10 monclient: dump: 2024-09-12T00:30:20.189 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:30:20.030+0000 7fc5d68bb800 5 monclient: authenticate success, global_id 7742 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:30:20.030+0000 7fc5d68bb800 10 monclient: get_monmap_and_config success 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:30:20.030+0000 7fc5d68bb800 4 set_mon_vals no callback set 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:30:20.030+0000 7fc5d68bb800 10 monclient: shutdown 2024-09-12T00:30:20.190 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 10 monclient: build_initial_monmap 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 build_initial for_mkfs: 0 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 10 monclient: monmap: 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding auth protocol: cephx 2024-09-12T00:30:20.191 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding auth protocol: cephx 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding auth protocol: cephx 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: crc 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926d3300) adding con mode: secure 2024-09-12T00:30:20.192 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 librados: starting msgr at 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 librados: starting objecter 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command objecter_requests cmddesc objecter_requests hook 0x5623926ff870 EEXIST 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 librados: setting wanted keys 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 1 librados: calling monclient init 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 10 monclient: init 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding auth protocol: cephx 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding auth protocol: cephx 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding auth protocol: cephx 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.193 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: crc 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 5 AuthRegistry(0x5623926c2a90) adding con mode: secure 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:30:20.031+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command rotate-key cmddesc rotate-key hook 0x5623926c2bd8 EEXIST 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-c con 0x5623926d24c0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:20.194 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-b con 0x5623926fda70 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): picked mon.noname-a con 0x5623927026b0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:30:20.032+0000 7fc5d68bb800 10 monclient(hunting): authenticate will time out at 2439.597254s 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request con 0x5623926d24c0 auth_method 0 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request con 0x5623927026b0 auth_method 0 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.195 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:30:20.032+0000 7fc5d4ba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:30:20.032+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request con 0x5623926fda70 auth_method 0 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:30:20.032+0000 7fc5d3ba4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:30:20.032+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:30:20.032+0000 7fc5d3ba4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient(hunting): handle_auth_done global_id 7745 payload 824 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient: _finish_hunting 0 2024-09-12T00:30:20.196 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 1 monclient: found mon.noname-c 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:30:20.032+0000 7fc5d43a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: dump: 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.197 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:30:20.032+0000 7fc4a9ffb640 10 monclient: dump: 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:20.198 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 5 monclient: authenticate success, global_id 7745 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:30:20.032+0000 7fc4ab7fe640 4 set_mon_vals no callback set 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 10 monclient: _renew_subs 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 1 librados: init done 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:30:20.033+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cr dump hook 0x5623926f4288 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:30:20.034+0000 7fc4a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:30:20.034+0000 7fc4a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:30:20.034+0000 7fc4a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:20.199 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:30:20.035+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:30:20.035+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x7fc49c0764a0 auth_method 0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:30:20.035+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x56239271c3c0 auth_method 0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 realm 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:30:20.036+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:30:20.036+0000 7fc5d43a5640 10 monclient: get_auth_request con 0x5623927205b0 auth_method 0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:30:20.037+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:30:20.037+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.200 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:30:20.037+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x562392723e10 auth_method 0 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:30:20.038+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:30:20.038+0000 7fc5d68bb800 20 searching for the correct realm 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:30:20.038+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x562392728bd0 auth_method 0 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:30:20.039+0000 7fc5d43a5640 10 monclient: get_auth_request con 0x7fc5cc032040 auth_method 0 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:30:20.040+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x7fc5c4074130 auth_method 0 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:30:20.042+0000 7fc5d4ba6640 0 -- 172.21.15.33:0/777422816 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x562392728bd0 msgr2=0x56239272b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:30:20.042+0000 7fc4a9ffb640 1 client.7745.objecter ms_handle_reset 0x562392728bd0 session 0x562392728550 osd.3 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:30:20.042+0000 7fc4a9ffb640 10 monclient: _renew_subs 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:30:20.042+0000 7fc4a9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:30:20.042+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x7fc49c086c50 auth_method 0 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:30:20.044+0000 7fc5d4ba6640 10 monclient: get_auth_request con 0x7fc5c808bbf0 auth_method 0 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:30:20.046+0000 7fc4a9ffb640 1 client.7745.objecter ms_handle_reset 0x562392723e10 session 0x56239271f940 osd.4 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:30:20.046+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x562392728bd0 auth_method 0 2024-09-12T00:30:20.201 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:30:20.047+0000 7fc5d3ba4640 0 -- 172.21.15.33:0/777422816 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x562392728bd0 msgr2=0x7fc49c08b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:30:20.047+0000 7fc4a9ffb640 1 client.7745.objecter ms_handle_reset 0x562392728bd0 session 0x56239271f940 osd.4 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:30:20.047+0000 7fc5d43a5640 10 monclient: get_auth_request con 0x7fc5c8096c30 auth_method 0 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:30:20.047+0000 7fc5d3ba4640 10 monclient: get_auth_request con 0x562392723e10 auth_method 0 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:30:20.053+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.202 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 zone default found 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 Realm: () 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 zonegroup default 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:30:20.054+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.203 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 started sync module instance, tier type = 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:30:20.055+0000 7fc5d68bb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=0 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=1 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=2 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=3 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=4 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=5 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:30:20.065+0000 7fc5d68bb800 20 add_watcher() i=6 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:30:20.066+0000 7fc5d68bb800 20 add_watcher() i=7 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:30:20.066+0000 7fc5d68bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding auth protocol: cephx 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding auth protocol: cephx 2024-09-12T00:30:20.204 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding auth protocol: cephx 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:30:20.067+0000 7fc48afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: crc 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:30:20.067+0000 7fc5d68bb800 5 AuthRegistry(0x7ffcf8181b10) adding con mode: secure 2024-09-12T00:30:20.205 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cache list hook 0x5623926f0ed0 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cache inspect hook 0x5623926f0ed0 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cache erase hook 0x5623926f0ed0 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command cache zap hook 0x5623926f0ed0 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 note: GC not initialized 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:30:20.068+0000 7fc489fdb640 20 reqs_thread_entry: start 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command sync trace show hook 0x7fc5c4084070 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command sync trace history hook 0x7fc5c4084070 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command sync trace active hook 0x7fc5c4084070 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 5 asok(0x56239240f630) register_command sync trace active_short hook 0x7fc5c4084070 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:20.206 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 Filter name: none 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:30:20.068+0000 7fc3fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:30:20.068+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:30:20.069+0000 7fc5d68bb800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:30:20.070+0000 7fc5d68bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:30:20.207 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:30:20.071+0000 7fc5d68bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:30:20.079+0000 7fc5d68bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94710780845296 notifier 7745 bl.length()=911 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:30:20.079+0000 7fc4ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:30:20.081+0000 7fc5d68bb800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:30:20.208 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:30:20.086+0000 7fc5d68bb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5d68bb800 time 2024-09-12T00:30:20.086317+0000 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5d9d8c71a] 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc5d9d8c8d8] 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562390f8e641] 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 4: radosgw-admin(+0xd8854c) [0x5623914a154c] 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562390f9e31d] 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 6: main() 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5d8a29590] 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 8: __libc_start_main() 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 9: _start() 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.209 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:30:20.087+0000 7fc5d68bb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7fc5d68bb800 thread_name:radosgw-admin 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5d8a3e6f0] 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5d8a8b99c] 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5d9d8c774] 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc5d9d8c8d8] 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562390f8e641] 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 8: radosgw-admin(+0xd8854c) [0x5623914a154c] 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562390f9e31d] 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 10: main() 2024-09-12T00:30:20.210 INFO:tasks.workunit.client.0.smithi033.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5d8a29590] 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 12: __libc_start_main() 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 13: _start() 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:30:20.211 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:30:20.212 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:30:20.213 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:30:20.214 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:30:20.215 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:30:20.216 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc3fb7fe640 / http_manager 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc489fdb640 / http_manager 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc48afdd640 / rgw_dt_lg_renew 2024-09-12T00:30:20.217 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4a9ffb640 / ms_dispatch 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4ab7fe640 / io_context_pool 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4b9ffb640 / ms_dispatch 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4c0e09640 / ms_dispatch 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc4c260c640 / io_context_pool 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d3ba4640 / msgr-worker-2 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d43a5640 / msgr-worker-1 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d4ba6640 / msgr-worker-0 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d53a7640 / io_context_pool 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: 7fc5d68bb800 / radosgw-admin 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:30:20.088121Z_7f57fa59-826d-4868-b8bc-637502086bc9/log 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:30:20.218 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.170+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.172+0000 7f8d6452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.172+0000 7f8d6452e800 20 realm 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.172+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.172+0000 7f8d6452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.172+0000 7f8d6452e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.172+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.172+0000 7f8d6452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.172+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.173+0000 7f8d6452e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:20.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.173+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.174+0000 7f8d6452e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:20.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.174+0000 7f8d6452e800 20 searching for the correct realm 2024-09-12T00:30:20.221 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.178+0000 7f8d6096c640 0 -- 172.21.15.33:0/2187319401 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f8d54044060 msgr2=0x7f8d5406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:20.386 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.387+0000 7f8d6016b640 0 -- 172.21.15.33:0/2187319401 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x55e24f2e11e0 msgr2=0x55e24f2e3610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.390+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 20 zone default found 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 4 Realm: () 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 20 zonegroup default 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.391+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.392+0000 7f8d6452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.392+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.392+0000 7f8d6452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:20.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.392+0000 7f8d6452e800 20 started sync module instance, tier type = 2024-09-12T00:30:20.392 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.392+0000 7f8d6452e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:20.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.401+0000 7f8d6452e800 20 add_watcher() i=0 2024-09-12T00:30:20.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.401+0000 7f8d6452e800 20 add_watcher() i=1 2024-09-12T00:30:20.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.401+0000 7f8d6452e800 20 add_watcher() i=2 2024-09-12T00:30:20.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.401+0000 7f8d6452e800 20 add_watcher() i=3 2024-09-12T00:30:20.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.401+0000 7f8d6452e800 20 add_watcher() i=4 2024-09-12T00:30:20.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.401+0000 7f8d6452e800 20 add_watcher() i=5 2024-09-12T00:30:20.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.401+0000 7f8d6452e800 20 add_watcher() i=6 2024-09-12T00:30:20.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.402+0000 7f8d6452e800 20 add_watcher() i=7 2024-09-12T00:30:20.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.402+0000 7f8d6452e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:20.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.404+0000 7f8c16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:20.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.404+0000 7f8d6452e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:20.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.404+0000 7f8d6452e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:20.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.404+0000 7f8d6452e800 5 note: GC not initialized 2024-09-12T00:30:20.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8c15fdb640 20 reqs_thread_entry: start 2024-09-12T00:30:20.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:20.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 20 Filter name: none 2024-09-12T00:30:20.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8b877fe640 20 reqs_thread_entry: start 2024-09-12T00:30:20.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:30:20.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:20.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:30:20.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:30:20.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:30:20.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.405+0000 7f8d6452e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:20.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:30:20.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.406+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:30:20.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.407+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:30:20.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.407+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:30:20.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.407+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:30:20.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.407+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:30:20.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.408+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:30:20.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.408+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:30:20.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.408+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:30:20.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.408+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:30:20.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.409+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:30:20.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.409+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:30:20.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.409+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:30:20.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.409+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:30:20.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.410+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:30:20.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.410+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:30:20.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.410+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:30:20.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.410+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:30:20.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.410+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:30:20.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.410+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:30:20.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.411+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:30:20.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.411+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:30:20.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.411+0000 7f8d6452e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:30:20.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.411+0000 7f8d6452e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:30:20.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.412+0000 7f8c16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:20.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.415+0000 7f8d6452e800 20 remove_watcher() i=0 2024-09-12T00:30:20.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.415+0000 7f8d6452e800 2 removed watcher, disabling cache 2024-09-12T00:30:20.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.416+0000 7f8d6452e800 20 remove_watcher() i=1 2024-09-12T00:30:20.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.417+0000 7f8d6452e800 20 remove_watcher() i=2 2024-09-12T00:30:20.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.419+0000 7f8d6452e800 20 remove_watcher() i=3 2024-09-12T00:30:20.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.420+0000 7f8d6452e800 20 remove_watcher() i=4 2024-09-12T00:30:20.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.421+0000 7f8d6452e800 20 remove_watcher() i=5 2024-09-12T00:30:20.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.422+0000 7f8d6452e800 20 remove_watcher() i=6 2024-09-12T00:30:20.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:20.423+0000 7f8d6452e800 20 remove_watcher() i=7 2024-09-12T00:30:20.433 INFO:tasks.workunit.client.0.smithi033.stderr: test: duplicated entries can be purged manually 2024-09-12T00:30:50.465 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:30:50.498 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:50.499 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:50.544 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.546+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.546 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.548+0000 7f16cc725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.548+0000 7f16cc725800 20 realm 2024-09-12T00:30:50.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.548+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.548+0000 7f16cc725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.548+0000 7f16cc725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:50.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.548+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.548+0000 7f16cc725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.548+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.549+0000 7f16cc725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:50.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.549+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.550+0000 7f16cc725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:50.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.550+0000 7f16cc725800 20 searching for the correct realm 2024-09-12T00:30:50.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.554+0000 7f16c8b34640 0 -- 172.21.15.33:0/2670492019 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5639c2fbbd30 msgr2=0x5639c2fbe1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:50.557 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.558+0000 7f16c8333640 0 -- 172.21.15.33:0/2670492019 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f16b004e190 msgr2=0x7f16b00e2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:50.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:50.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:50.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:50.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:50.562 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:50.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:50.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.563+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:50.563 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:50.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 20 zone default found 2024-09-12T00:30:50.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 4 Realm: () 2024-09-12T00:30:50.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:50.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:50.564 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 20 zonegroup default 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.564+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.565+0000 7f16cc725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.565+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.565+0000 7f16cc725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.565+0000 7f16cc725800 20 started sync module instance, tier type = 2024-09-12T00:30:50.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.565+0000 7f16cc725800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:50.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.575+0000 7f16cc725800 20 add_watcher() i=0 2024-09-12T00:30:50.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.575+0000 7f16cc725800 20 add_watcher() i=1 2024-09-12T00:30:50.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.575+0000 7f16cc725800 20 add_watcher() i=2 2024-09-12T00:30:50.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.575+0000 7f16cc725800 20 add_watcher() i=3 2024-09-12T00:30:50.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.575+0000 7f16cc725800 20 add_watcher() i=4 2024-09-12T00:30:50.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.575+0000 7f16cc725800 20 add_watcher() i=5 2024-09-12T00:30:50.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.575+0000 7f16cc725800 20 add_watcher() i=6 2024-09-12T00:30:50.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.576+0000 7f16cc725800 20 add_watcher() i=7 2024-09-12T00:30:50.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.576+0000 7f16cc725800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:50.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.577+0000 7f157efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:50.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.578+0000 7f16cc725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:50.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.578+0000 7f16cc725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:50.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.578+0000 7f16cc725800 5 note: GC not initialized 2024-09-12T00:30:50.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.578+0000 7f157dfdb640 20 reqs_thread_entry: start 2024-09-12T00:30:50.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.578+0000 7f16cc725800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:50.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.578+0000 7f16cc725800 20 Filter name: none 2024-09-12T00:30:50.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.578+0000 7f14ef7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:50.577 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.578+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.579+0000 7f16cc725800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:50.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.579+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.579+0000 7f16cc725800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:50.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.579+0000 7f16cc725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:50.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.579+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.580+0000 7f16cc725800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:50.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.580+0000 7f16cc725800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.580+0000 7f16cc725800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:50.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.580+0000 7f16cc725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:50.581 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.582+0000 7f157efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:50.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.584+0000 7f16cc725800 20 remove_watcher() i=0 2024-09-12T00:30:50.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.584+0000 7f16cc725800 2 removed watcher, disabling cache 2024-09-12T00:30:50.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.586+0000 7f16cc725800 20 remove_watcher() i=1 2024-09-12T00:30:50.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.587+0000 7f16cc725800 20 remove_watcher() i=2 2024-09-12T00:30:50.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.588+0000 7f16cc725800 20 remove_watcher() i=3 2024-09-12T00:30:50.588 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.590+0000 7f16cc725800 20 remove_watcher() i=4 2024-09-12T00:30:50.589 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.591+0000 7f16cc725800 20 remove_watcher() i=5 2024-09-12T00:30:50.590 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.592+0000 7f16cc725800 20 remove_watcher() i=6 2024-09-12T00:30:50.591 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.593+0000 7f16cc725800 20 remove_watcher() i=7 2024-09-12T00:30:50.603 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.603 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:30:50.603 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: a-bucket id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T00:30:50.603 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.604 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:30:50.639 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:50.639 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:50.679 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.681+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.682+0000 7f914de87800 20 realm 2024-09-12T00:30:50.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.682+0000 7f914de87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:50.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.681 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.683+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:50.682 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.683+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.684+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:50.683 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.684+0000 7f914de87800 20 searching for the correct realm 2024-09-12T00:30:50.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.689+0000 7f914c172640 0 -- 172.21.15.33:0/147096207 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f914006d070 msgr2=0x7f9140085410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:50.893 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.895+0000 7f914b971640 0 -- 172.21.15.33:0/147096207 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x562080710660 msgr2=0x562080712a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:50.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:50.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:50.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:50.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:50.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:50.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:50.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.898+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:50.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:50.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 20 zone default found 2024-09-12T00:30:50.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 4 Realm: () 2024-09-12T00:30:50.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 20 zonegroup default 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.900+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.900+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.900+0000 7f914de87800 20 started sync module instance, tier type = 2024-09-12T00:30:50.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.900+0000 7f914de87800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:50.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=0 2024-09-12T00:30:50.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=1 2024-09-12T00:30:50.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=2 2024-09-12T00:30:50.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=3 2024-09-12T00:30:50.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=4 2024-09-12T00:30:50.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=5 2024-09-12T00:30:50.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=6 2024-09-12T00:30:50.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.911+0000 7f914de87800 20 add_watcher() i=7 2024-09-12T00:30:50.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.911+0000 7f914de87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:50.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.913+0000 7f9001fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.913+0000 7f914de87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.913+0000 7f914de87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.913+0000 7f914de87800 5 note: GC not initialized 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.913+0000 7f9000fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 20 Filter name: none 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f8f7a7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:30:50.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:50.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:30:50.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:30:50.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:30:50.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.914+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.915+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:50.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.915+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:50.914 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.915+0000 7f914de87800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:50.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.915+0000 7f914de87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:50.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.915+0000 7f914de87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:50.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.915+0000 7f914de87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:30:50.915 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.916+0000 7f914de87800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:30:50.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.924+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:50.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.924+0000 7f914de87800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:50.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.924+0000 7f914de87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:50.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.924+0000 7f914de87800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:30:50.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94697593899008 notifier 7793 bl.length()=911 2024-09-12T00:30:50.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:50.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:50.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:50.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:30:50.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:30:50.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:30:50.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:30:50.932 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f914de87800 time 2024-09-12T00:30:50.935153+0000 2024-09-12T00:30:50.932 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:50.933 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:50.933 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f915138c71a] 2024-09-12T00:30:50.933 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f915138c8d8] 2024-09-12T00:30:50.933 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56207eb00641] 2024-09-12T00:30:50.933 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56207eb1038a] 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9150029590] 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.935+0000 7f914de87800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f914de87800 time 2024-09-12T00:30:50.935153+0000 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f915138c71a] 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f915138c8d8] 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56207eb00641] 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56207eb1038a] 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:30:50.935 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9150029590] 2024-09-12T00:30:50.935 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:30:50.935 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:30:50.935 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.935 INFO:tasks.workunit.client.0.smithi033.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:30:50.935 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f914de87800 thread_name:radosgw-admin 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f915003e6f0] 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f915008b99c] 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f915138c774] 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f915138c8d8] 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56207eb00641] 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56207eb1038a] 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:30:50.952 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9150029590] 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:50.935+0000 7f914de87800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f914de87800 thread_name:radosgw-admin 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f915003e6f0] 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f915008b99c] 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f915138c774] 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f915138c8d8] 2024-09-12T00:30:50.953 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56207eb00641] 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56207eb1038a] 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9150029590] 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:30:50.662+0000 7f914b170640 10 monclient(hunting): handle_auth_done global_id 8364 payload 274 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:30:50.662+0000 7f914b170640 10 monclient: _finish_hunting 0 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:30:50.662+0000 7f914b170640 1 monclient: found mon.noname-a 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:30:50.662+0000 7f914b170640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:30:50.662+0000 7f914c172640 10 monclient: get_auth_request con 0x56208056b750 auth_method 0 2024-09-12T00:30:50.954 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: dump: 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: _finish_auth 0 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:30:50.955 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:30:50.663+0000 7f914de87800 5 monclient: authenticate success, global_id 8364 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:30:50.663+0000 7f914de87800 10 monclient: get_monmap_and_config success 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:30:50.663+0000 7f914de87800 4 set_mon_vals no callback set 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: dump: 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.956 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:30:50.663+0000 7f914de87800 10 monclient: shutdown 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:30:50.663+0000 7f914de87800 5 asok(0x562080401630) unregister_commands rotate-key 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:30:50.663+0000 7f914de87800 10 monclient: build_initial_monmap 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:30:50.663+0000 7f914de87800 1 build_initial for_mkfs: 0 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:30:50.663+0000 7f914de87800 10 monclient: monmap: 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:50.957 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding auth protocol: cephx 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding auth protocol: cephx 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding auth protocol: cephx 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:50.958 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:30:50.664+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:30:50.664+0000 7f914de87800 1 librados: starting msgr at 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:30:50.664+0000 7f914de87800 1 librados: starting objecter 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:30:50.664+0000 7f914de87800 5 asok(0x562080401630) register_command objecter_requests hook 0x562080650e40 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:30:50.664+0000 7f914de87800 1 librados: setting wanted keys 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:30:50.664+0000 7f914de87800 1 librados: calling monclient init 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient: init 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding auth protocol: cephx 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding auth protocol: cephx 2024-09-12T00:30:50.959 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding auth protocol: cephx 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:30:50.664+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.960 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:30:50.664+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:30:50.664+0000 7f914de87800 5 asok(0x562080401630) register_command rotate-key hook 0x562080622168 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): picked mon.noname-a con 0x5620804cfb10 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): picked mon.noname-c con 0x5620804da280 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): picked mon.noname-b con 0x56208056b750 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): authenticate will time out at 2470.229892s 2024-09-12T00:30:50.961 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:30:50.664+0000 7f914b971640 10 monclient(hunting): get_auth_request con 0x5620804cfb10 auth_method 0 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:30:50.664+0000 7f914b971640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:30:50.664+0000 7f914b971640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:30:50.664+0000 7f914b971640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:30:50.664+0000 7f914b170640 10 monclient(hunting): get_auth_request con 0x5620804da280 auth_method 0 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.962 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient(hunting): handle_auth_done global_id 8367 payload 824 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient: _finish_hunting 0 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:30:50.665+0000 7f914b971640 1 monclient: found mon.noname-a 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: dump: 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.963 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: _finish_auth 0 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: _check_auth_tickets 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: dump: 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.964 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:30:50.665+0000 7f914de87800 5 monclient: authenticate success, global_id 8367 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:30:50.665+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:30:50.665+0000 7f914de87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:30:50.665+0000 7f9039e0b640 4 set_mon_vals no callback set 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:30:50.665+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:30:50.665+0000 7f914de87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:30:50.665+0000 7f914de87800 1 librados: init done 2024-09-12T00:30:50.965 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:30:50.667+0000 7f9033fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:30:50.667+0000 7f9033fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:30:50.667+0000 7f9033fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:30:50.667+0000 7f914b170640 10 monclient: get_auth_request con 0x7f90340764a0 auth_method 0 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:30:50.668+0000 7f914c172640 10 monclient: get_auth_request con 0x56208064a810 auth_method 0 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:30:50.668+0000 7f914b971640 10 monclient: get_auth_request con 0x56208066d8d0 auth_method 0 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:30:50.669+0000 7f914b170640 10 monclient: get_auth_request con 0x562080671c30 auth_method 0 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:30:50.671+0000 7f914de87800 10 monclient: build_initial_monmap 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:30:50.671+0000 7f914de87800 1 build_initial for_mkfs: 0 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:30:50.671+0000 7f914de87800 10 monclient: monmap: 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:50.966 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding auth protocol: cephx 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding auth protocol: cephx 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding auth protocol: cephx 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:50.967 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:30:50.671+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:30:50.672+0000 7f914de87800 5 asok(0x562080401630) register_command objecter_requests cmddesc objecter_requests hook 0x56208067a3f0 EEXIST 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient: init 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding auth protocol: cephx 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding auth protocol: cephx 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding auth protocol: cephx 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:50.968 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:30:50.672+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:30:50.672+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:30:50.672+0000 7f914de87800 5 asok(0x562080401630) register_command rotate-key cmddesc rotate-key hook 0x562080675200 EEXIST 2024-09-12T00:30:50.969 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): picked mon.noname-a con 0x56208069e0e0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): picked mon.noname-b con 0x5620806a03b0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): picked mon.noname-c con 0x56208069c8b0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): authenticate will time out at 2470.237684s 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): get_auth_request con 0x56208069e0e0 auth_method 0 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.970 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): get_auth_request con 0x56208069c8b0 auth_method 0 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:30:50.672+0000 7f914b170640 10 monclient(hunting): get_auth_request con 0x5620806a03b0 auth_method 0 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:30:50.672+0000 7f914b170640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:30:50.672+0000 7f914b170640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:30:50.672+0000 7f914b170640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.971 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:30:50.673+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:30:50.673+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:30:50.673+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:30:50.673+0000 7f914b971640 10 monclient(hunting): handle_auth_done global_id 8370 payload 824 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:30:50.673+0000 7f914b971640 10 monclient: _finish_hunting 0 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:30:50.673+0000 7f914b971640 1 monclient: found mon.noname-a 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:30:50.673+0000 7f914b971640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: dump: 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.972 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: _finish_auth 0 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: _check_auth_tickets 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:50.973 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: dump: 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:30:50.673+0000 7f914de87800 5 monclient: authenticate success, global_id 8370 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:30:50.673+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:30:50.673+0000 7f914de87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:50.974 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:30:50.673+0000 7f914c973640 4 set_mon_vals no callback set 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:30:50.673+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:30:50.673+0000 7f914de87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:30:50.675+0000 7f90317fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:30:50.675+0000 7f90317fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:30:50.675+0000 7f90317fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:30:50.675+0000 7f914b170640 10 monclient: get_auth_request con 0x7f9024076380 auth_method 0 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:30:50.675+0000 7f914de87800 10 monclient: get_monmap_and_config 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:30:50.675+0000 7f914de87800 10 monclient: build_initial_monmap 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:30:50.675+0000 7f914de87800 1 build_initial for_mkfs: 0 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:30:50.675+0000 7f914de87800 10 monclient: monmap: 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:50.975 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding auth protocol: cephx 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding auth protocol: cephx 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding auth protocol: cephx 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:50.976 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:30:50.675+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:30:50.675+0000 7f914de87800 10 monclient: init 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding auth protocol: cephx 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding auth protocol: cephx 2024-09-12T00:30:50.977 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding auth protocol: cephx 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:30:50.676+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:30:50.676+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.978 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:30:50.676+0000 7f914de87800 5 asok(0x562080401630) register_command rotate-key cmddesc rotate-key hook 0x7ffe74329768 EEXIST 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): picked mon.noname-b con 0x5620806f2600 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): picked mon.noname-a con 0x5620806ecba0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): picked mon.noname-c con 0x5620806c2440 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): authenticate will time out at 2470.241402s 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): get_auth_request con 0x5620806ecba0 auth_method 0 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.979 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): get_auth_request con 0x5620806c2440 auth_method 0 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): handle_auth_done global_id 8373 payload 274 2024-09-12T00:30:50.980 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient: _finish_hunting 0 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:30:50.676+0000 7f914b170640 1 monclient: found mon.noname-a 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: dump: 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.981 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: _finish_auth 0 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: _check_auth_tickets 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: dump: 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.982 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:30:50.677+0000 7f914de87800 5 monclient: authenticate success, global_id 8373 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:30:50.677+0000 7f914de87800 10 monclient: get_monmap_and_config success 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:30:50.677+0000 7f914de87800 4 set_mon_vals no callback set 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:30:50.677+0000 7f914de87800 10 monclient: shutdown 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:30:50.677+0000 7f914de87800 10 monclient: build_initial_monmap 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:30:50.677+0000 7f914de87800 1 build_initial for_mkfs: 0 2024-09-12T00:30:50.983 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:30:50.677+0000 7f914de87800 10 monclient: monmap: 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding auth protocol: cephx 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding auth protocol: cephx 2024-09-12T00:30:50.984 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding auth protocol: cephx 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:30:50.677+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.985 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:30:50.678+0000 7f914de87800 1 librados: starting msgr at 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:30:50.678+0000 7f914de87800 1 librados: starting objecter 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:30:50.678+0000 7f914de87800 5 asok(0x562080401630) register_command objecter_requests cmddesc objecter_requests hook 0x5620806c2fb0 EEXIST 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:30:50.678+0000 7f914de87800 1 librados: setting wanted keys 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:30:50.678+0000 7f914de87800 1 librados: calling monclient init 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient: init 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding auth protocol: cephx 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding auth protocol: cephx 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding auth protocol: cephx 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:50.986 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:30:50.678+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:30:50.678+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:30:50.678+0000 7f914de87800 5 asok(0x562080401630) register_command rotate-key cmddesc rotate-key hook 0x5620806b5fd8 EEXIST 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): picked mon.noname-c con 0x5620806c2440 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): picked mon.noname-b con 0x5620806ecba0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): picked mon.noname-a con 0x5620806f2600 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.987 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): authenticate will time out at 2470.243747s 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): get_auth_request con 0x5620806c2440 auth_method 0 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): get_auth_request con 0x5620806f2600 auth_method 0 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:30:50.679+0000 7f914b971640 10 monclient(hunting): handle_auth_done global_id 7793 payload 824 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:30:50.679+0000 7f914b971640 10 monclient: _finish_hunting 0 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:30:50.679+0000 7f914b971640 1 monclient: found mon.noname-c 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:30:50.679+0000 7f914b971640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: dump: 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: _finish_auth 0 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: _check_auth_tickets 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: dump: 2024-09-12T00:30:50.990 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:30:50.679+0000 7f914de87800 5 monclient: authenticate success, global_id 7793 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:30:50.679+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:30:50.679+0000 7f902affd640 4 set_mon_vals no callback set 2024-09-12T00:30:50.991 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:30:50.679+0000 7f914de87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:30:50.679+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:30:50.679+0000 7f914de87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:30:50.679+0000 7f914de87800 1 librados: init done 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:30:50.679+0000 7f914de87800 5 asok(0x562080401630) register_command cr dump hook 0x5620806e4578 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:30:50.681+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:30:50.681+0000 7f90297fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:30:50.681+0000 7f90297fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:30:50.681+0000 7f90297fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:30:50.681+0000 7f914b170640 10 monclient: get_auth_request con 0x7f90140764a0 auth_method 0 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:30:50.681+0000 7f914c172640 10 monclient: get_auth_request con 0x56208070c2e0 auth_method 0 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:30:50.682+0000 7f914de87800 20 realm 2024-09-12T00:30:50.992 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:30:50.682+0000 7f914de87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:30:50.683+0000 7f914b971640 10 monclient: get_auth_request con 0x562080710660 auth_method 0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:30:50.683+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:30:50.683+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:30:50.684+0000 7f914b170640 10 monclient: get_auth_request con 0x562080713d80 auth_method 0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:30:50.684+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:30:50.684+0000 7f914de87800 20 searching for the correct realm 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:30:50.684+0000 7f914c172640 10 monclient: get_auth_request con 0x562080718a80 auth_method 0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:30:50.686+0000 7f914b971640 10 monclient: get_auth_request con 0x7f9144018400 auth_method 0 2024-09-12T00:30:50.993 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:30:50.687+0000 7f914b170640 10 monclient: get_auth_request con 0x7f913c018070 auth_method 0 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:30:50.689+0000 7f914c172640 0 -- 172.21.15.33:0/147096207 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f914006d070 msgr2=0x7f9140085410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:30:50.890+0000 7f914c172640 10 monclient: get_auth_request con 0x7f914006d070 auth_method 0 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:30:50.892+0000 7f914b971640 10 monclient: get_auth_request con 0x7f91400a3bf0 auth_method 0 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:30:50.895+0000 7f914b971640 0 -- 172.21.15.33:0/147096207 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x562080710660 msgr2=0x562080712a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:30:50.895+0000 7f90297fa640 1 client.7793.objecter ms_handle_reset 0x562080710660 session 0x56208070f4b0 osd.5 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:30:50.895+0000 7f90297fa640 10 monclient: _renew_subs 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:30:50.895+0000 7f90297fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:30:50.895+0000 7f914b971640 10 monclient: get_auth_request con 0x7f9014086c50 auth_method 0 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:50.994 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:30:50.898+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:30:50.899+0000 7f914de87800 20 zone default found 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:30:50.899+0000 7f914de87800 4 Realm: () 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:30:50.899+0000 7f914de87800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:30:50.899+0000 7f914de87800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:30:50.899+0000 7f914de87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:50.995 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:30:50.899+0000 7f914de87800 20 zonegroup default 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:30:50.900+0000 7f914de87800 20 started sync module instance, tier type = 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:30:50.900+0000 7f914de87800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=0 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=1 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=2 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=3 2024-09-12T00:30:50.996 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=4 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=5 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=6 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:30:50.911+0000 7f914de87800 20 add_watcher() i=7 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:30:50.911+0000 7f914de87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding auth protocol: cephx 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding auth protocol: cephx 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding auth protocol: cephx 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:50.997 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:30:50.913+0000 7f9001fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:30:50.913+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:30:50.913+0000 7f914de87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:30:50.913+0000 7f914de87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:30:50.913+0000 7f914de87800 5 asok(0x562080401630) register_command cache list hook 0x5620806e8d00 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:30:50.913+0000 7f914de87800 5 asok(0x562080401630) register_command cache inspect hook 0x5620806e8d00 2024-09-12T00:30:50.998 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:30:50.913+0000 7f914de87800 5 asok(0x562080401630) register_command cache erase hook 0x5620806e8d00 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:30:50.913+0000 7f914de87800 5 asok(0x562080401630) register_command cache zap hook 0x5620806e8d00 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:30:50.913+0000 7f914de87800 5 note: GC not initialized 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:30:50.913+0000 7f9000fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:30:50.914+0000 7f914de87800 5 asok(0x562080401630) register_command sync trace show hook 0x7f9140078930 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:30:50.914+0000 7f914de87800 5 asok(0x562080401630) register_command sync trace history hook 0x7f9140078930 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:30:50.914+0000 7f914de87800 5 asok(0x562080401630) register_command sync trace active hook 0x7f9140078930 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:30:50.914+0000 7f914de87800 5 asok(0x562080401630) register_command sync trace active_short hook 0x7f9140078930 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:30:50.914+0000 7f914de87800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:30:50.914+0000 7f914de87800 20 Filter name: none 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:30:50.914+0000 7f8f7a7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:30:50.914+0000 7f914de87800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:30:50.914+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:30:50.914+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:50.999 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:30:50.914+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:30:50.914+0000 7f914de87800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:30:50.914+0000 7f914de87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:30:50.914+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:30:50.915+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:30:50.915+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:30:50.915+0000 7f914de87800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:30:50.915+0000 7f914de87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:30:50.915+0000 7f914de87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:30:50.915+0000 7f914de87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:30:50.916+0000 7f914de87800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:30:50.924+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:51.000 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:30:50.924+0000 7f914de87800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:30:50.924+0000 7f914de87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:30:50.924+0000 7f914de87800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94697593899008 notifier 7793 bl.length()=911 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:30:50.935+0000 7f914de87800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f914de87800 time 2024-09-12T00:30:50.935153+0000 2024-09-12T00:30:51.001 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f915138c71a] 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f915138c8d8] 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56207eb00641] 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56207eb1038a] 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9150029590] 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:30:50.935+0000 7f914de87800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f914de87800 thread_name:radosgw-admin 2024-09-12T00:30:51.002 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f915003e6f0] 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f915008b99c] 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f915138c774] 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f915138c8d8] 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56207eb00641] 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56207eb1038a] 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9150029590] 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:30:51.003 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:30:51.004 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:30:51.005 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:30:51.006 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:30:51.007 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:30:51.008 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:30:51.009 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:30:51.010 INFO:tasks.workunit.client.0.smithi033.stderr: 7f8f7a7fc640 / http_manager 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9000fe1640 / http_manager 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9001fe3640 / rgw_dt_lg_renew 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f90297fa640 / ms_dispatch 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f902affd640 / io_context_pool 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f90317fa640 / ms_dispatch 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9033fff640 / ms_dispatch 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9039e0b640 / io_context_pool 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914b170640 / msgr-worker-2 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914b971640 / msgr-worker-1 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914c172640 / msgr-worker-0 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914c973640 / io_context_pool 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914de87800 / radosgw-admin 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:30:51.011 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/log/ceph/ceph-client.admin.153997.log 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr:--- begin dump of recent events --- 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr: -499> 2024-09-12T00:30:50.662+0000 7f914b170640 10 monclient(hunting): handle_auth_done global_id 8364 payload 274 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr: -498> 2024-09-12T00:30:50.662+0000 7f914b170640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr: -497> 2024-09-12T00:30:50.662+0000 7f914b170640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr: -496> 2024-09-12T00:30:50.662+0000 7f914b170640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr: -495> 2024-09-12T00:30:50.662+0000 7f914c172640 10 monclient: get_auth_request con 0x56208056b750 auth_method 0 2024-09-12T00:30:51.012 INFO:tasks.workunit.client.0.smithi033.stderr: -494> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr: -493> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr: -492> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: dump: 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr: -491> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.013 INFO:tasks.workunit.client.0.smithi033.stderr: -490> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr: -489> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr: -488> 2024-09-12T00:30:50.663+0000 7f914de87800 5 monclient: authenticate success, global_id 8364 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr: -487> 2024-09-12T00:30:50.663+0000 7f914de87800 10 monclient: get_monmap_and_config success 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr: -486> 2024-09-12T00:30:50.663+0000 7f914de87800 4 set_mon_vals no callback set 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr: -485> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr: -484> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr: -483> 2024-09-12T00:30:50.663+0000 7f9039e0b640 10 monclient: dump: 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.014 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr: -482> 2024-09-12T00:30:50.663+0000 7f914de87800 10 monclient: shutdown 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr: -481> 2024-09-12T00:30:50.663+0000 7f914de87800 5 asok(0x562080401630) unregister_commands rotate-key 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr: -480> 2024-09-12T00:30:50.663+0000 7f914de87800 10 monclient: build_initial_monmap 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr: -479> 2024-09-12T00:30:50.663+0000 7f914de87800 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr: -478> 2024-09-12T00:30:50.663+0000 7f914de87800 10 monclient: monmap: 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.015 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -477> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding auth protocol: cephx 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -476> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding auth protocol: cephx 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -475> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding auth protocol: cephx 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -474> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -473> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -472> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -471> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -470> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -469> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:51.016 INFO:tasks.workunit.client.0.smithi033.stderr: -468> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -467> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -466> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -465> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -464> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: crc 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -463> 2024-09-12T00:30:50.663+0000 7f914de87800 5 AuthRegistry(0x562080625620) adding con mode: secure 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -462> 2024-09-12T00:30:50.664+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -461> 2024-09-12T00:30:50.664+0000 7f914de87800 1 librados: starting msgr at 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -460> 2024-09-12T00:30:50.664+0000 7f914de87800 1 librados: starting objecter 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -459> 2024-09-12T00:30:50.664+0000 7f914de87800 5 asok(0x562080401630) register_command objecter_requests hook 0x562080650e40 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -458> 2024-09-12T00:30:50.664+0000 7f914de87800 1 librados: setting wanted keys 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -457> 2024-09-12T00:30:50.664+0000 7f914de87800 1 librados: calling monclient init 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -456> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient: init 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -455> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding auth protocol: cephx 2024-09-12T00:30:51.017 INFO:tasks.workunit.client.0.smithi033.stderr: -454> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding auth protocol: cephx 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -453> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding auth protocol: cephx 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -452> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -451> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -450> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -449> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -448> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -447> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -446> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -445> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -444> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -443> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -442> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: crc 2024-09-12T00:30:51.018 INFO:tasks.workunit.client.0.smithi033.stderr: -441> 2024-09-12T00:30:50.664+0000 7f914de87800 5 AuthRegistry(0x562080622020) adding con mode: secure 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -440> 2024-09-12T00:30:50.664+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -439> 2024-09-12T00:30:50.664+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -438> 2024-09-12T00:30:50.664+0000 7f914de87800 5 asok(0x562080401630) register_command rotate-key hook 0x562080622168 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -437> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -436> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -435> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): picked mon.noname-a con 0x5620804cfb10 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -434> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): picked mon.noname-c con 0x5620804da280 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -433> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): picked mon.noname-b con 0x56208056b750 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -432> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -431> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -430> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -429> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.019 INFO:tasks.workunit.client.0.smithi033.stderr: -428> 2024-09-12T00:30:50.664+0000 7f914de87800 10 monclient(hunting): authenticate will time out at 2470.229892s 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -427> 2024-09-12T00:30:50.664+0000 7f914b971640 10 monclient(hunting): get_auth_request con 0x5620804cfb10 auth_method 0 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -426> 2024-09-12T00:30:50.664+0000 7f914b971640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -425> 2024-09-12T00:30:50.664+0000 7f914b971640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -424> 2024-09-12T00:30:50.664+0000 7f914b971640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -423> 2024-09-12T00:30:50.664+0000 7f914b170640 10 monclient(hunting): get_auth_request con 0x5620804da280 auth_method 0 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -422> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -421> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -420> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -419> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -418> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -417> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -416> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.020 INFO:tasks.workunit.client.0.smithi033.stderr: -415> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr: -414> 2024-09-12T00:30:50.665+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr: -413> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient(hunting): handle_auth_done global_id 8367 payload 824 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr: -412> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr: -411> 2024-09-12T00:30:50.665+0000 7f914b971640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr: -410> 2024-09-12T00:30:50.665+0000 7f914b971640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr: -409> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr: -408> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr: -407> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: dump: 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.021 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr: -406> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr: -405> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr: -404> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr: -403> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr: -402> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr: -401> 2024-09-12T00:30:50.665+0000 7f9033fff640 10 monclient: dump: 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.022 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr: -400> 2024-09-12T00:30:50.665+0000 7f914de87800 5 monclient: authenticate success, global_id 8367 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr: -399> 2024-09-12T00:30:50.665+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr: -398> 2024-09-12T00:30:50.665+0000 7f914de87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr: -397> 2024-09-12T00:30:50.665+0000 7f9039e0b640 4 set_mon_vals no callback set 2024-09-12T00:30:51.023 INFO:tasks.workunit.client.0.smithi033.stderr: -396> 2024-09-12T00:30:50.665+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -395> 2024-09-12T00:30:50.665+0000 7f914de87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -394> 2024-09-12T00:30:50.665+0000 7f914de87800 1 librados: init done 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -393> 2024-09-12T00:30:50.667+0000 7f9033fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -392> 2024-09-12T00:30:50.667+0000 7f9033fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -391> 2024-09-12T00:30:50.667+0000 7f9033fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -390> 2024-09-12T00:30:50.667+0000 7f914b170640 10 monclient: get_auth_request con 0x7f90340764a0 auth_method 0 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -389> 2024-09-12T00:30:50.668+0000 7f914c172640 10 monclient: get_auth_request con 0x56208064a810 auth_method 0 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -388> 2024-09-12T00:30:50.668+0000 7f914b971640 10 monclient: get_auth_request con 0x56208066d8d0 auth_method 0 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -387> 2024-09-12T00:30:50.669+0000 7f914b170640 10 monclient: get_auth_request con 0x562080671c30 auth_method 0 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -386> 2024-09-12T00:30:50.671+0000 7f914de87800 10 monclient: build_initial_monmap 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -385> 2024-09-12T00:30:50.671+0000 7f914de87800 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr: -384> 2024-09-12T00:30:50.671+0000 7f914de87800 10 monclient: monmap: 2024-09-12T00:30:51.024 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr: -383> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding auth protocol: cephx 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr: -382> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding auth protocol: cephx 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr: -381> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding auth protocol: cephx 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr: -380> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:51.025 INFO:tasks.workunit.client.0.smithi033.stderr: -379> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -378> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -377> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -376> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -375> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -374> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -373> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -372> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -371> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -370> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: crc 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -369> 2024-09-12T00:30:50.671+0000 7f914de87800 5 AuthRegistry(0x5620806769e0) adding con mode: secure 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -368> 2024-09-12T00:30:50.671+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -367> 2024-09-12T00:30:50.672+0000 7f914de87800 5 asok(0x562080401630) register_command objecter_requests cmddesc objecter_requests hook 0x56208067a3f0 EEXIST 2024-09-12T00:30:51.026 INFO:tasks.workunit.client.0.smithi033.stderr: -366> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient: init 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -365> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding auth protocol: cephx 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -364> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding auth protocol: cephx 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -363> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding auth protocol: cephx 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -362> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -361> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -360> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -359> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -358> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -357> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -356> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -355> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:51.027 INFO:tasks.workunit.client.0.smithi033.stderr: -354> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -353> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -352> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: crc 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -351> 2024-09-12T00:30:50.672+0000 7f914de87800 5 AuthRegistry(0x5620806750b8) adding con mode: secure 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -350> 2024-09-12T00:30:50.672+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -349> 2024-09-12T00:30:50.672+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -348> 2024-09-12T00:30:50.672+0000 7f914de87800 5 asok(0x562080401630) register_command rotate-key cmddesc rotate-key hook 0x562080675200 EEXIST 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -347> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -346> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -345> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): picked mon.noname-a con 0x56208069e0e0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -344> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): picked mon.noname-b con 0x5620806a03b0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -343> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): picked mon.noname-c con 0x56208069c8b0 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -342> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.028 INFO:tasks.workunit.client.0.smithi033.stderr: -341> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -340> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -339> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -338> 2024-09-12T00:30:50.672+0000 7f914de87800 10 monclient(hunting): authenticate will time out at 2470.237684s 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -337> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): get_auth_request con 0x56208069e0e0 auth_method 0 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -336> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -335> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -334> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -333> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): get_auth_request con 0x56208069c8b0 auth_method 0 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -332> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -331> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -330> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -329> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.029 INFO:tasks.workunit.client.0.smithi033.stderr: -328> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -327> 2024-09-12T00:30:50.672+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -326> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -325> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -324> 2024-09-12T00:30:50.672+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -323> 2024-09-12T00:30:50.672+0000 7f914b170640 10 monclient(hunting): get_auth_request con 0x5620806a03b0 auth_method 0 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -322> 2024-09-12T00:30:50.672+0000 7f914b170640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -321> 2024-09-12T00:30:50.672+0000 7f914b170640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -320> 2024-09-12T00:30:50.672+0000 7f914b170640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -319> 2024-09-12T00:30:50.673+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -318> 2024-09-12T00:30:50.673+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -317> 2024-09-12T00:30:50.673+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -316> 2024-09-12T00:30:50.673+0000 7f914b971640 10 monclient(hunting): handle_auth_done global_id 8370 payload 824 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -315> 2024-09-12T00:30:50.673+0000 7f914b971640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -314> 2024-09-12T00:30:50.673+0000 7f914b971640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.030 INFO:tasks.workunit.client.0.smithi033.stderr: -313> 2024-09-12T00:30:50.673+0000 7f914b971640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr: -312> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr: -311> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr: -310> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: dump: 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr: -309> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr: -308> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.031 INFO:tasks.workunit.client.0.smithi033.stderr: -307> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr: -306> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr: -305> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr: -304> 2024-09-12T00:30:50.673+0000 7f90317fa640 10 monclient: dump: 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -303> 2024-09-12T00:30:50.673+0000 7f914de87800 5 monclient: authenticate success, global_id 8370 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -302> 2024-09-12T00:30:50.673+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -301> 2024-09-12T00:30:50.673+0000 7f914de87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -300> 2024-09-12T00:30:50.673+0000 7f914c973640 4 set_mon_vals no callback set 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -299> 2024-09-12T00:30:50.673+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -298> 2024-09-12T00:30:50.673+0000 7f914de87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.33:3300/0 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -297> 2024-09-12T00:30:50.675+0000 7f90317fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -296> 2024-09-12T00:30:50.675+0000 7f90317fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -295> 2024-09-12T00:30:50.675+0000 7f90317fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -294> 2024-09-12T00:30:50.675+0000 7f914b170640 10 monclient: get_auth_request con 0x7f9024076380 auth_method 0 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -293> 2024-09-12T00:30:50.675+0000 7f914de87800 10 monclient: get_monmap_and_config 2024-09-12T00:30:51.033 INFO:tasks.workunit.client.0.smithi033.stderr: -292> 2024-09-12T00:30:50.675+0000 7f914de87800 10 monclient: build_initial_monmap 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr: -291> 2024-09-12T00:30:50.675+0000 7f914de87800 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr: -290> 2024-09-12T00:30:50.675+0000 7f914de87800 10 monclient: monmap: 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.034 INFO:tasks.workunit.client.0.smithi033.stderr: -289> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding auth protocol: cephx 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -288> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding auth protocol: cephx 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -287> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding auth protocol: cephx 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -286> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -285> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -284> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -283> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -282> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -281> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -280> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -279> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -278> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi033.stderr: -277> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -276> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: crc 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -275> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x5620806be020) adding con mode: secure 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -274> 2024-09-12T00:30:50.675+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -273> 2024-09-12T00:30:50.675+0000 7f914de87800 10 monclient: init 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -272> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding auth protocol: cephx 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -271> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding auth protocol: cephx 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -270> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding auth protocol: cephx 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -269> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -268> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -267> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -266> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi033.stderr: -265> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -264> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -263> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -262> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -261> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -260> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -259> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: crc 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -258> 2024-09-12T00:30:50.675+0000 7f914de87800 5 AuthRegistry(0x7ffe74329620) adding con mode: secure 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -257> 2024-09-12T00:30:50.676+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -256> 2024-09-12T00:30:50.676+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -255> 2024-09-12T00:30:50.676+0000 7f914de87800 5 asok(0x562080401630) register_command rotate-key cmddesc rotate-key hook 0x7ffe74329768 EEXIST 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -254> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -253> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi033.stderr: -252> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): picked mon.noname-b con 0x5620806f2600 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -251> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): picked mon.noname-a con 0x5620806ecba0 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -250> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): picked mon.noname-c con 0x5620806c2440 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -249> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -248> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -247> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -246> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -245> 2024-09-12T00:30:50.676+0000 7f914de87800 10 monclient(hunting): authenticate will time out at 2470.241402s 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -244> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): get_auth_request con 0x5620806ecba0 auth_method 0 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -243> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -242> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -241> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -240> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): get_auth_request con 0x5620806c2440 auth_method 0 2024-09-12T00:30:51.038 INFO:tasks.workunit.client.0.smithi033.stderr: -239> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -238> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -237> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -236> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -235> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -234> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -233> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -232> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -231> 2024-09-12T00:30:50.676+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -230> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient(hunting): handle_auth_done global_id 8373 payload 274 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -229> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -228> 2024-09-12T00:30:50.676+0000 7f914b170640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -227> 2024-09-12T00:30:50.676+0000 7f914b170640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.33:3300/0 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -226> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.039 INFO:tasks.workunit.client.0.smithi033.stderr: -225> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr: -224> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: dump: 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.040 INFO:tasks.workunit.client.0.smithi033.stderr: -223> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr: -222> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr: -221> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr: -220> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr: -219> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr: -218> 2024-09-12T00:30:50.677+0000 7f902affd640 10 monclient: dump: 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.041 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr: -217> 2024-09-12T00:30:50.677+0000 7f914de87800 5 monclient: authenticate success, global_id 8373 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr: -216> 2024-09-12T00:30:50.677+0000 7f914de87800 10 monclient: get_monmap_and_config success 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr: -215> 2024-09-12T00:30:50.677+0000 7f914de87800 4 set_mon_vals no callback set 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr: -214> 2024-09-12T00:30:50.677+0000 7f914de87800 10 monclient: shutdown 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr: -213> 2024-09-12T00:30:50.677+0000 7f914de87800 10 monclient: build_initial_monmap 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr: -212> 2024-09-12T00:30:50.677+0000 7f914de87800 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr: -211> 2024-09-12T00:30:50.677+0000 7f914de87800 10 monclient: monmap: 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 0 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 0.000000 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr:created 0.000000 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.noname-a 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.noname-c 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -210> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding auth protocol: cephx 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -209> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding auth protocol: cephx 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -208> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding auth protocol: cephx 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -207> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -206> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -205> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -204> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -203> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -202> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:51.043 INFO:tasks.workunit.client.0.smithi033.stderr: -201> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -200> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -199> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -198> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -197> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: crc 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -196> 2024-09-12T00:30:50.677+0000 7f914de87800 5 AuthRegistry(0x5620806e4a70) adding con mode: secure 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -195> 2024-09-12T00:30:50.677+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -194> 2024-09-12T00:30:50.678+0000 7f914de87800 1 librados: starting msgr at 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -193> 2024-09-12T00:30:50.678+0000 7f914de87800 1 librados: starting objecter 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -192> 2024-09-12T00:30:50.678+0000 7f914de87800 5 asok(0x562080401630) register_command objecter_requests cmddesc objecter_requests hook 0x5620806c2fb0 EEXIST 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -191> 2024-09-12T00:30:50.678+0000 7f914de87800 1 librados: setting wanted keys 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -190> 2024-09-12T00:30:50.678+0000 7f914de87800 1 librados: calling monclient init 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -189> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient: init 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -188> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding auth protocol: cephx 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -187> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding auth protocol: cephx 2024-09-12T00:30:51.044 INFO:tasks.workunit.client.0.smithi033.stderr: -186> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding auth protocol: cephx 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -185> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -184> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -183> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -182> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -181> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -180> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -179> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -178> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -177> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -176> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -175> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: crc 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -174> 2024-09-12T00:30:50.678+0000 7f914de87800 5 AuthRegistry(0x5620806b5e90) adding con mode: secure 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -173> 2024-09-12T00:30:50.678+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.045 INFO:tasks.workunit.client.0.smithi033.stderr: -172> 2024-09-12T00:30:50.678+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -171> 2024-09-12T00:30:50.678+0000 7f914de87800 5 asok(0x562080401630) register_command rotate-key cmddesc rotate-key hook 0x5620806b5fd8 EEXIST 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -170> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -169> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -168> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): picked mon.noname-c con 0x5620806c2440 addr [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -167> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): picked mon.noname-b con 0x5620806ecba0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -166> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): picked mon.noname-a con 0x5620806f2600 addr [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -165> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -164> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -163> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -162> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -161> 2024-09-12T00:30:50.678+0000 7f914de87800 10 monclient(hunting): authenticate will time out at 2470.243747s 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -160> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): get_auth_request con 0x5620806c2440 auth_method 0 2024-09-12T00:30:51.046 INFO:tasks.workunit.client.0.smithi033.stderr: -159> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -158> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -157> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -156> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): get_auth_request con 0x5620806f2600 auth_method 0 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -155> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -154> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -153> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -152> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -151> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -150> 2024-09-12T00:30:50.678+0000 7f914b971640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -149> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -148> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -147> 2024-09-12T00:30:50.678+0000 7f914c172640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -146> 2024-09-12T00:30:50.679+0000 7f914b971640 10 monclient(hunting): handle_auth_done global_id 7793 payload 824 2024-09-12T00:30:51.047 INFO:tasks.workunit.client.0.smithi033.stderr: -145> 2024-09-12T00:30:50.679+0000 7f914b971640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr: -144> 2024-09-12T00:30:50.679+0000 7f914b971640 1 monclient: found mon.noname-c 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr: -143> 2024-09-12T00:30:50.679+0000 7f914b971640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.33:3301/0 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr: -142> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr: -141> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr: -140> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: dump: 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.048 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr: -139> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr: -138> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr: -137> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr: -136> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr: -135> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr: -134> 2024-09-12T00:30:50.679+0000 7f90297fa640 10 monclient: dump: 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr:epoch 1 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr:fsid 69d022f9-3312-45e8-ade0-937e32c87c81 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr:last_changed 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr:created 2024-09-12T00:01:34.774371+0000 2024-09-12T00:30:51.049 INFO:tasks.workunit.client.0.smithi033.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr:election_strategy: 1 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr:2: [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon.c 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: -133> 2024-09-12T00:30:50.679+0000 7f914de87800 5 monclient: authenticate success, global_id 7793 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: -132> 2024-09-12T00:30:50.679+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: -131> 2024-09-12T00:30:50.679+0000 7f902affd640 4 set_mon_vals no callback set 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: -130> 2024-09-12T00:30:50.679+0000 7f914de87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: -129> 2024-09-12T00:30:50.679+0000 7f914de87800 10 monclient: _renew_subs 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: -128> 2024-09-12T00:30:50.679+0000 7f914de87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: -127> 2024-09-12T00:30:50.679+0000 7f914de87800 1 librados: init done 2024-09-12T00:30:51.050 INFO:tasks.workunit.client.0.smithi033.stderr: -126> 2024-09-12T00:30:50.679+0000 7f914de87800 5 asok(0x562080401630) register_command cr dump hook 0x5620806e4578 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -125> 2024-09-12T00:30:50.681+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -124> 2024-09-12T00:30:50.681+0000 7f90297fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -123> 2024-09-12T00:30:50.681+0000 7f90297fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -122> 2024-09-12T00:30:50.681+0000 7f90297fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.33:6832/1036841236,v1:172.21.15.33:6833/1036841236] 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -121> 2024-09-12T00:30:50.681+0000 7f914b170640 10 monclient: get_auth_request con 0x7f90140764a0 auth_method 0 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -120> 2024-09-12T00:30:50.681+0000 7f914c172640 10 monclient: get_auth_request con 0x56208070c2e0 auth_method 0 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -119> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -118> 2024-09-12T00:30:50.682+0000 7f914de87800 20 realm 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -117> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -116> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -115> 2024-09-12T00:30:50.682+0000 7f914de87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:51.051 INFO:tasks.workunit.client.0.smithi033.stderr: -114> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -113> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -112> 2024-09-12T00:30:50.682+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -111> 2024-09-12T00:30:50.683+0000 7f914b971640 10 monclient: get_auth_request con 0x562080710660 auth_method 0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -110> 2024-09-12T00:30:50.683+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -109> 2024-09-12T00:30:50.683+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -108> 2024-09-12T00:30:50.684+0000 7f914b170640 10 monclient: get_auth_request con 0x562080713d80 auth_method 0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -107> 2024-09-12T00:30:50.684+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -106> 2024-09-12T00:30:50.684+0000 7f914de87800 20 searching for the correct realm 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -105> 2024-09-12T00:30:50.684+0000 7f914c172640 10 monclient: get_auth_request con 0x562080718a80 auth_method 0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -104> 2024-09-12T00:30:50.686+0000 7f914b971640 10 monclient: get_auth_request con 0x7f9144018400 auth_method 0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -103> 2024-09-12T00:30:50.687+0000 7f914b170640 10 monclient: get_auth_request con 0x7f913c018070 auth_method 0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -102> 2024-09-12T00:30:50.689+0000 7f914c172640 0 -- 172.21.15.33:0/147096207 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f914006d070 msgr2=0x7f9140085410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -101> 2024-09-12T00:30:50.890+0000 7f914c172640 10 monclient: get_auth_request con 0x7f914006d070 auth_method 0 2024-09-12T00:30:51.052 INFO:tasks.workunit.client.0.smithi033.stderr: -100> 2024-09-12T00:30:50.892+0000 7f914b971640 10 monclient: get_auth_request con 0x7f91400a3bf0 auth_method 0 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -99> 2024-09-12T00:30:50.895+0000 7f914b971640 0 -- 172.21.15.33:0/147096207 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x562080710660 msgr2=0x562080712a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -98> 2024-09-12T00:30:50.895+0000 7f90297fa640 1 client.7793.objecter ms_handle_reset 0x562080710660 session 0x56208070f4b0 osd.5 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -97> 2024-09-12T00:30:50.895+0000 7f90297fa640 10 monclient: _renew_subs 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -96> 2024-09-12T00:30:50.895+0000 7f90297fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.33:3301/0 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -95> 2024-09-12T00:30:50.895+0000 7f914b971640 10 monclient: get_auth_request con 0x7f9014086c50 auth_method 0 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -94> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -93> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -92> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -91> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -90> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -89> 2024-09-12T00:30:50.898+0000 7f914de87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -88> 2024-09-12T00:30:50.898+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.053 INFO:tasks.workunit.client.0.smithi033.stderr: -87> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -86> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -85> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -84> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -83> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -82> 2024-09-12T00:30:50.899+0000 7f914de87800 20 zone default found 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -81> 2024-09-12T00:30:50.899+0000 7f914de87800 4 Realm: () 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -80> 2024-09-12T00:30:50.899+0000 7f914de87800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -79> 2024-09-12T00:30:50.899+0000 7f914de87800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -78> 2024-09-12T00:30:50.899+0000 7f914de87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -77> 2024-09-12T00:30:50.899+0000 7f914de87800 20 zonegroup default 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -76> 2024-09-12T00:30:50.899+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -75> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -74> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.054 INFO:tasks.workunit.client.0.smithi033.stderr: -73> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -72> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -71> 2024-09-12T00:30:50.900+0000 7f914de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -70> 2024-09-12T00:30:50.900+0000 7f914de87800 20 started sync module instance, tier type = 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -69> 2024-09-12T00:30:50.900+0000 7f914de87800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -68> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=0 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -67> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=1 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -66> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=2 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -65> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=3 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -64> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=4 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -63> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=5 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -62> 2024-09-12T00:30:50.910+0000 7f914de87800 20 add_watcher() i=6 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -61> 2024-09-12T00:30:50.911+0000 7f914de87800 20 add_watcher() i=7 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -60> 2024-09-12T00:30:50.911+0000 7f914de87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -59> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding auth protocol: cephx 2024-09-12T00:30:51.055 INFO:tasks.workunit.client.0.smithi033.stderr: -58> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding auth protocol: cephx 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -57> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding auth protocol: cephx 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -56> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -55> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -54> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -53> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -52> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -51> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -50> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -49> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -48> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -47> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -46> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: crc 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -45> 2024-09-12T00:30:50.913+0000 7f914de87800 5 AuthRegistry(0x7ffe74329b00) adding con mode: secure 2024-09-12T00:30:51.056 INFO:tasks.workunit.client.0.smithi033.stderr: -44> 2024-09-12T00:30:50.913+0000 7f9001fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -43> 2024-09-12T00:30:50.913+0000 7f914de87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -42> 2024-09-12T00:30:50.913+0000 7f914de87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -41> 2024-09-12T00:30:50.913+0000 7f914de87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -40> 2024-09-12T00:30:50.913+0000 7f914de87800 5 asok(0x562080401630) register_command cache list hook 0x5620806e8d00 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -39> 2024-09-12T00:30:50.913+0000 7f914de87800 5 asok(0x562080401630) register_command cache inspect hook 0x5620806e8d00 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -38> 2024-09-12T00:30:50.913+0000 7f914de87800 5 asok(0x562080401630) register_command cache erase hook 0x5620806e8d00 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -37> 2024-09-12T00:30:50.913+0000 7f914de87800 5 asok(0x562080401630) register_command cache zap hook 0x5620806e8d00 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -36> 2024-09-12T00:30:50.913+0000 7f914de87800 5 note: GC not initialized 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -35> 2024-09-12T00:30:50.913+0000 7f9000fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -34> 2024-09-12T00:30:50.914+0000 7f914de87800 5 asok(0x562080401630) register_command sync trace show hook 0x7f9140078930 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -33> 2024-09-12T00:30:50.914+0000 7f914de87800 5 asok(0x562080401630) register_command sync trace history hook 0x7f9140078930 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -32> 2024-09-12T00:30:50.914+0000 7f914de87800 5 asok(0x562080401630) register_command sync trace active hook 0x7f9140078930 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -31> 2024-09-12T00:30:50.914+0000 7f914de87800 5 asok(0x562080401630) register_command sync trace active_short hook 0x7f9140078930 2024-09-12T00:30:51.057 INFO:tasks.workunit.client.0.smithi033.stderr: -30> 2024-09-12T00:30:50.914+0000 7f914de87800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -29> 2024-09-12T00:30:50.914+0000 7f914de87800 20 Filter name: none 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -28> 2024-09-12T00:30:50.914+0000 7f8f7a7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -27> 2024-09-12T00:30:50.914+0000 7f914de87800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -26> 2024-09-12T00:30:50.914+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -25> 2024-09-12T00:30:50.914+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -24> 2024-09-12T00:30:50.914+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -23> 2024-09-12T00:30:50.914+0000 7f914de87800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -22> 2024-09-12T00:30:50.914+0000 7f914de87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -21> 2024-09-12T00:30:50.914+0000 7f914de87800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -20> 2024-09-12T00:30:50.915+0000 7f914de87800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -19> 2024-09-12T00:30:50.915+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -18> 2024-09-12T00:30:50.915+0000 7f914de87800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -17> 2024-09-12T00:30:50.915+0000 7f914de87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -16> 2024-09-12T00:30:50.915+0000 7f914de87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:51.058 INFO:tasks.workunit.client.0.smithi033.stderr: -15> 2024-09-12T00:30:50.915+0000 7f914de87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -14> 2024-09-12T00:30:50.916+0000 7f914de87800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -13> 2024-09-12T00:30:50.924+0000 7f914de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -12> 2024-09-12T00:30:50.924+0000 7f914de87800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -11> 2024-09-12T00:30:50.924+0000 7f914de87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -10> 2024-09-12T00:30:50.924+0000 7f914de87800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -9> 2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94697593899008 notifier 7793 bl.length()=911 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -8> 2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -7> 2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -6> 2024-09-12T00:30:50.924+0000 7f902affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -5> 2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -4> 2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -3> 2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -2> 2024-09-12T00:30:50.926+0000 7f914de87800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:30:51.059 INFO:tasks.workunit.client.0.smithi033.stderr: -1> 2024-09-12T00:30:50.935+0000 7f914de87800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f914de87800 time 2024-09-12T00:30:50.935153+0000 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f915138c71a] 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f915138c8d8] 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56207eb00641] 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56207eb1038a] 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 5: main() 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9150029590] 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 7: __libc_start_main() 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 8: _start() 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 0> 2024-09-12T00:30:50.935+0000 7f914de87800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: in thread 7f914de87800 thread_name:radosgw-admin 2024-09-12T00:30:51.060 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f915003e6f0] 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f915008b99c] 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 3: raise() 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 4: abort() 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f915138c774] 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f915138c8d8] 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56207eb00641] 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56207eb1038a] 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 9: main() 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9150029590] 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 11: __libc_start_main() 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: 12: _start() 2024-09-12T00:30:51.061 INFO:tasks.workunit.client.0.smithi033.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr:--- logging levels --- 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 none 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 lockdep 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 context 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 crush 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_balancer 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_locker 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_log_expire 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mds_migrator 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 3/ 5 mds_quiesce 2024-09-12T00:30:51.062 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 buffer 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 timer 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 filer 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 striper 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 1 objecter 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rados 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_mirror 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_replay 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 rbd_pwl 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 journaler 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objectcacher 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 client 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 osd 2024-09-12T00:30:51.063 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 optracker 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 objclass 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 filestore 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 journal 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 ms 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mon 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 0/10 monc 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 paxos 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 tp 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 auth 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 crypto 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 finisher 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 reserver 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 heartbeatmap 2024-09-12T00:30:51.064 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 perfcounter 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_sync 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_datacache 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_access 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_flight 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 20/20 rgw_notification 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 javaclient 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 asok 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 1 throttle 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 0 refs 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 compressor 2024-09-12T00:30:51.065 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluestore 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 bluefs 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 3 bdev 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 kstore 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 4/ 5 rocksdb 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 fuse 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 2/ 5 mgr 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mgrc 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 dpdk 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 eventtrace 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 prioritycache 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 test 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cephsqlite 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore 2024-09-12T00:30:51.066 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_onode 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_odata 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_omap 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_tm 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_t 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_epm 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_lba 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_cache 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_journal 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_device 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 seastore_backref 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 alienstore 2024-09-12T00:30:51.067 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 mclock 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 cyanstore 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 ceph_exporter 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 memstore 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 1/ 5 trace 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 0/ 5 ceph_dedup 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: -2/-2 (syslog threshold) 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 99/99 (stderr threshold) 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 7f8f7a7fc640 / http_manager 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9000fe1640 / http_manager 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9001fe3640 / rgw_dt_lg_renew 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 7f90297fa640 / ms_dispatch 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 7f902affd640 / io_context_pool 2024-09-12T00:30:51.068 INFO:tasks.workunit.client.0.smithi033.stderr: 7f90317fa640 / ms_dispatch 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9033fff640 / ms_dispatch 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: 7f9039e0b640 / io_context_pool 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914b170640 / msgr-worker-2 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914b971640 / msgr-worker-1 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914c172640 / msgr-worker-0 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914c973640 / io_context_pool 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: 7f914de87800 / radosgw-admin 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: max_recent 500 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: max_new 1000 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:30:50.936591Z_b7213853-68ca-41ab-9b04-16f8907edf97/log 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr:--- end dump of recent events --- 2024-09-12T00:30:51.069 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:30:51.074 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:51.074 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:51.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.014+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.016+0000 7f85fc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.016+0000 7f85fc142800 20 realm 2024-09-12T00:30:51.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.016+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.074 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.017+0000 7f85fc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.017+0000 7f85fc142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.017+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.017+0000 7f85fc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.017+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.018+0000 7f85fc142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.018+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.019+0000 7f85fc142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.019+0000 7f85fc142800 20 searching for the correct realm 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.022+0000 7f85f86ee640 0 -- 172.21.15.33:0/36039849 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55eca08ed280 msgr2=0x55eca08ef740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.025+0000 7f85f7eed640 0 -- 172.21.15.33:0/36039849 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f85ec08f0d0 msgr2=0x7f85ec00e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:51.075 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 zone default found 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 4 Realm: () 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:51.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 zonegroup default 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.030+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.031+0000 7f85fc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.031+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.031+0000 7f85fc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.031+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.031+0000 7f85fc142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.031+0000 7f85fc142800 20 started sync module instance, tier type = 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.031+0000 7f85fc142800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.041+0000 7f85fc142800 20 add_watcher() i=0 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.041+0000 7f85fc142800 20 add_watcher() i=1 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.041+0000 7f85fc142800 20 add_watcher() i=2 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.041+0000 7f85fc142800 20 add_watcher() i=3 2024-09-12T00:30:51.077 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.041+0000 7f85fc142800 20 add_watcher() i=4 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.041+0000 7f85fc142800 20 add_watcher() i=5 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.041+0000 7f85fc142800 20 add_watcher() i=6 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.042+0000 7f85fc142800 20 add_watcher() i=7 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.042+0000 7f85fc142800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.043+0000 7f84adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.044+0000 7f85fc142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.044+0000 7f85fc142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.044+0000 7f85fc142800 5 note: GC not initialized 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.044+0000 7f84acfe1640 20 reqs_thread_entry: start 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.044+0000 7f85fc142800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.044+0000 7f85fc142800 20 Filter name: none 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.044+0000 7f84267fc640 20 reqs_thread_entry: start 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.044+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.045+0000 7f85fc142800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.045+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.078 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.046+0000 7f85fc142800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.046+0000 7f85fc142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.046+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.046+0000 7f85fc142800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.046+0000 7f85fc142800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.046+0000 7f85fc142800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.046+0000 7f85fc142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.048+0000 7f84adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.051+0000 7f85fc142800 20 remove_watcher() i=0 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.051+0000 7f85fc142800 2 removed watcher, disabling cache 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.052+0000 7f85fc142800 20 remove_watcher() i=1 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.053+0000 7f85fc142800 20 remove_watcher() i=2 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.054+0000 7f85fc142800 20 remove_watcher() i=3 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.055+0000 7f85fc142800 20 remove_watcher() i=4 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.056+0000 7f85fc142800 20 remove_watcher() i=5 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.057+0000 7f85fc142800 20 remove_watcher() i=6 2024-09-12T00:30:51.079 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.065+0000 7f85fc142800 20 remove_watcher() i=7 2024-09-12T00:30:51.080 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:30:51.080 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:30:51.113 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:30:51.142 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:51.142 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:51.182 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.184+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.185+0000 7fcb6152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.185+0000 7fcb6152e800 20 realm 2024-09-12T00:30:51.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.185+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.185+0000 7fcb6152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.185+0000 7fcb6152e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:51.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.185+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.185+0000 7fcb6152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.184 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.185+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.186+0000 7fcb6152e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.185 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.186+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.187+0000 7fcb6152e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:51.186 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.187+0000 7fcb6152e800 20 searching for the correct realm 2024-09-12T00:30:51.189 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.191+0000 7fcb5dade640 0 -- 172.21.15.33:0/1285568998 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fcb54098350 msgr2=0x7fcb54082690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.399+0000 7fcb5d2dd640 0 -- 172.21.15.33:0/1285568998 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x555bc294ff60 msgr2=0x555bc2952390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.402+0000 7fcb6152e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.402+0000 7fcb6152e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.402+0000 7fcb6152e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.402+0000 7fcb6152e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.402+0000 7fcb6152e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.402+0000 7fcb6152e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.402+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 20 zone default found 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 4 Realm: () 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 20 zonegroup default 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.403+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.404+0000 7fcb6152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.404+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.404+0000 7fcb6152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.404+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.404+0000 7fcb6152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.404+0000 7fcb6152e800 20 started sync module instance, tier type = 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.404+0000 7fcb6152e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.415+0000 7fcb6152e800 20 add_watcher() i=0 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.415+0000 7fcb6152e800 20 add_watcher() i=1 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.415+0000 7fcb6152e800 20 add_watcher() i=2 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.415+0000 7fcb6152e800 20 add_watcher() i=3 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.415+0000 7fcb6152e800 20 add_watcher() i=4 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.415+0000 7fcb6152e800 20 add_watcher() i=5 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.415+0000 7fcb6152e800 20 add_watcher() i=6 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.416+0000 7fcb6152e800 20 add_watcher() i=7 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.416+0000 7fcb6152e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:51.416 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.417+0000 7fca137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fcb6152e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fcb6152e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fcb6152e800 5 note: GC not initialized 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fca127e4640 20 reqs_thread_entry: start 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fcb6152e800 20 init_complete bucket index max shards: 11 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fcb6152e800 20 Filter name: none 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fc983fff640 20 reqs_thread_entry: start 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fcb6152e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.418+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.419+0000 7fcb6152e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.420+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.420+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.420+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.420+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.420+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.420+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.421+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.421+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.421+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.421+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.422+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.422+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.422+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.422+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.423+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.423+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.423+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.423+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.424+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.424+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.424+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.424+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.425+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.425+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.425+0000 7fcb6152e800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.425+0000 7fcb6152e800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.426+0000 7fca137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.429+0000 7fcb6152e800 20 remove_watcher() i=0 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.429+0000 7fcb6152e800 2 removed watcher, disabling cache 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.430+0000 7fcb6152e800 20 remove_watcher() i=1 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.431+0000 7fcb6152e800 20 remove_watcher() i=2 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.432+0000 7fcb6152e800 20 remove_watcher() i=3 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.433+0000 7fcb6152e800 20 remove_watcher() i=4 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.434+0000 7fcb6152e800 20 remove_watcher() i=5 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.435+0000 7fcb6152e800 20 remove_watcher() i=6 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:30:51.437+0000 7fcb6152e800 20 remove_watcher() i=7 2024-09-12T00:31:21.467 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:31:21.501 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:21.501 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:21.545 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.546+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.548+0000 7ffa3e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.548+0000 7ffa3e610800 20 realm 2024-09-12T00:31:21.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.548+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.548+0000 7ffa3e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.548+0000 7ffa3e610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:21.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.548+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.548+0000 7ffa3e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.547 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.548+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.549+0000 7ffa3e610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:21.548 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.549+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.550+0000 7ffa3e610800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:21.549 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.550+0000 7ffa3e610800 20 searching for the correct realm 2024-09-12T00:31:21.552 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.553+0000 7ffa39dbc640 0 -- 172.21.15.33:0/669703869 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7ffa34031040 msgr2=0x7ffa3400e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:21.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.557+0000 7ffa39dbc640 0 -- 172.21.15.33:0/669703869 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7ffa3007c070 msgr2=0x7ffa300e55d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:21.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.764+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:21.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 20 zone default found 2024-09-12T00:31:21.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 4 Realm: () 2024-09-12T00:31:21.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:21.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:21.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:21.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 20 zonegroup default 2024-09-12T00:31:21.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.765+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.766+0000 7ffa3e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.766+0000 7ffa3e610800 20 started sync module instance, tier type = 2024-09-12T00:31:21.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.766+0000 7ffa3e610800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:21.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.776+0000 7ffa3e610800 20 add_watcher() i=0 2024-09-12T00:31:21.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.776+0000 7ffa3e610800 20 add_watcher() i=1 2024-09-12T00:31:21.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.776+0000 7ffa3e610800 20 add_watcher() i=2 2024-09-12T00:31:21.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.776+0000 7ffa3e610800 20 add_watcher() i=3 2024-09-12T00:31:21.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.776+0000 7ffa3e610800 20 add_watcher() i=4 2024-09-12T00:31:21.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.776+0000 7ffa3e610800 20 add_watcher() i=5 2024-09-12T00:31:21.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.776+0000 7ffa3e610800 20 add_watcher() i=6 2024-09-12T00:31:21.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.777+0000 7ffa3e610800 20 add_watcher() i=7 2024-09-12T00:31:21.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.777+0000 7ffa3e610800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:21.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.779+0000 7ff8ebfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:21.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.779+0000 7ffa3e610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:21.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.779+0000 7ffa3e610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:21.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.780+0000 7ffa3e610800 5 note: GC not initialized 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.780+0000 7ff8eaffd640 20 reqs_thread_entry: start 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.780+0000 7ffa3e610800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.780+0000 7ffa3e610800 20 Filter name: none 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.780+0000 7ff8e8ff9640 20 reqs_thread_entry: start 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.780+0000 7ffa3e610800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.780+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:31:21.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:31:21.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:21.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:21.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:21.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:21.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.781+0000 7ffa3e610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:31:21.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.786+0000 7ff8ebfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:21.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.788+0000 7ffa3e610800 20 remove_watcher() i=0 2024-09-12T00:31:21.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.788+0000 7ffa3e610800 2 removed watcher, disabling cache 2024-09-12T00:31:21.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.790+0000 7ffa3e610800 20 remove_watcher() i=1 2024-09-12T00:31:21.789 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.791+0000 7ffa3e610800 20 remove_watcher() i=2 2024-09-12T00:31:21.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.792+0000 7ffa3e610800 20 remove_watcher() i=3 2024-09-12T00:31:21.792 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.793+0000 7ffa3e610800 20 remove_watcher() i=4 2024-09-12T00:31:21.793 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.794+0000 7ffa3e610800 20 remove_watcher() i=5 2024-09-12T00:31:21.794 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.795+0000 7ffa3e610800 20 remove_watcher() i=6 2024-09-12T00:31:21.795 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.796+0000 7ffa3e610800 20 remove_watcher() i=7 2024-09-12T00:31:21.808 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:31:21.838 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:21.838 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:21.878 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.880+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.881+0000 7fbf0762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.881+0000 7fbf0762f800 20 realm 2024-09-12T00:31:21.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.881+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.882+0000 7fbf0762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.882+0000 7fbf0762f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:21.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.882+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.882+0000 7fbf0762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:21.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.882+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.883+0000 7fbf0762f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:21.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.883+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:21.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.884+0000 7fbf0762f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:21.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.884+0000 7fbf0762f800 20 searching for the correct realm 2024-09-12T00:31:21.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:21.886+0000 7fbf0218a640 0 -- 172.21.15.33:0/3563822619 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fbef406f450 msgr2=0x7fbef406f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:22.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.092+0000 7fbf0298b640 0 -- 172.21.15.33:0/3563822619 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fbef80833d0 msgr2=0x7fbef8078a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.298+0000 7fbf0762f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.298+0000 7fbf0762f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.298+0000 7fbf0762f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.298+0000 7fbf0762f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.298+0000 7fbf0762f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.298+0000 7fbf0762f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:22.298 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.299+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.299+0000 7fbf0762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.299+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.299+0000 7fbf0762f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:22.299 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.299+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:22.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 20 zone default found 2024-09-12T00:31:22.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 4 Realm: () 2024-09-12T00:31:22.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:22.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:22.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:22.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 20 zonegroup default 2024-09-12T00:31:22.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.300+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.301+0000 7fbf0762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.301+0000 7fbf0762f800 20 started sync module instance, tier type = 2024-09-12T00:31:22.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.301+0000 7fbf0762f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:22.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.311+0000 7fbf0762f800 20 add_watcher() i=0 2024-09-12T00:31:22.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.311+0000 7fbf0762f800 20 add_watcher() i=1 2024-09-12T00:31:22.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.311+0000 7fbf0762f800 20 add_watcher() i=2 2024-09-12T00:31:22.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.311+0000 7fbf0762f800 20 add_watcher() i=3 2024-09-12T00:31:22.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.311+0000 7fbf0762f800 20 add_watcher() i=4 2024-09-12T00:31:22.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.311+0000 7fbf0762f800 20 add_watcher() i=5 2024-09-12T00:31:22.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.311+0000 7fbf0762f800 20 add_watcher() i=6 2024-09-12T00:31:22.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.313+0000 7fbf0762f800 20 add_watcher() i=7 2024-09-12T00:31:22.311 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.313+0000 7fbf0762f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:22.313 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.314+0000 7fbdb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbf0762f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbf0762f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbf0762f800 5 note: GC not initialized 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbd33fff640 20 reqs_thread_entry: start 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbf0762f800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbf0762f800 20 Filter name: none 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbd31ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbf0762f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:31:22.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.315+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.316+0000 7fbf0762f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:22.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.316+0000 7fbf0762f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.316+0000 7fbf0762f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.316+0000 7fbf0762f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.316+0000 7fbf0762f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.316+0000 7fbf0762f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:31:22.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:31:22.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:31:22.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.317+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:31:22.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.318+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:31:22.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.318+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:31:22.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.318+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:31:22.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.318+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:31:22.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.319+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:31:22.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.319+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:31:22.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.319+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:31:22.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.319+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:31:22.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.319+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:31:22.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.319+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:31:22.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.320+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:31:22.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.320+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:31:22.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.320+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:31:22.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.320+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:31:22.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.321+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:31:22.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.321+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:31:22.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.321+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:31:22.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.321+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:31:22.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.322+0000 7fbf0762f800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:31:22.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.322+0000 7fbf0762f800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:31:22.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.323+0000 7fbdb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:22.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.325+0000 7fbf0762f800 20 remove_watcher() i=0 2024-09-12T00:31:22.324 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.325+0000 7fbf0762f800 2 removed watcher, disabling cache 2024-09-12T00:31:22.325 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.327+0000 7fbf0762f800 20 remove_watcher() i=1 2024-09-12T00:31:22.326 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.328+0000 7fbf0762f800 20 remove_watcher() i=2 2024-09-12T00:31:22.327 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.329+0000 7fbf0762f800 20 remove_watcher() i=3 2024-09-12T00:31:22.329 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.330+0000 7fbf0762f800 20 remove_watcher() i=4 2024-09-12T00:31:22.330 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.331+0000 7fbf0762f800 20 remove_watcher() i=5 2024-09-12T00:31:22.331 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.332+0000 7fbf0762f800 20 remove_watcher() i=6 2024-09-12T00:31:22.332 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.333+0000 7fbf0762f800 20 remove_watcher() i=7 2024-09-12T00:31:22.343 INFO:tasks.workunit.client.0.smithi033.stderr:check reshard logrecord successfully 2024-09-12T00:31:22.343 INFO:tasks.workunit.client.0.smithi033.stderr: test: reshard versioned bucket 2024-09-12T00:31:22.345 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:31:22.375 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:22.375 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:22.415 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.417+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.419+0000 7fc56ae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.419+0000 7fc56ae40800 20 realm 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.419+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.419+0000 7fc56ae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.419+0000 7fc56ae40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.419+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.419+0000 7fc56ae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.419+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.420+0000 7fc56ae40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:22.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.420+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.421+0000 7fc56ae40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:22.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.421+0000 7fc56ae40800 20 searching for the correct realm 2024-09-12T00:31:22.422 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.424+0000 7fc56892a640 0 -- 172.21.15.33:0/1320486618 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fc5600663c0 msgr2=0x7fc56006bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:22.426 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.428+0000 7fc56892a640 0 -- 172.21.15.33:0/1320486618 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fc55c0943f0 msgr2=0x7fc55c094870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.636 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.636+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 20 zone default found 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 4 Realm: () 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 20 zonegroup default 2024-09-12T00:31:22.637 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.637+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.638+0000 7fc56ae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.638+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.638+0000 7fc56ae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.638+0000 7fc56ae40800 20 started sync module instance, tier type = 2024-09-12T00:31:22.638 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.638+0000 7fc56ae40800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:22.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.648+0000 7fc56ae40800 20 add_watcher() i=0 2024-09-12T00:31:22.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.648+0000 7fc56ae40800 20 add_watcher() i=1 2024-09-12T00:31:22.646 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.648+0000 7fc56ae40800 20 add_watcher() i=2 2024-09-12T00:31:22.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.648+0000 7fc56ae40800 20 add_watcher() i=3 2024-09-12T00:31:22.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.648+0000 7fc56ae40800 20 add_watcher() i=4 2024-09-12T00:31:22.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.648+0000 7fc56ae40800 20 add_watcher() i=5 2024-09-12T00:31:22.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.648+0000 7fc56ae40800 20 add_watcher() i=6 2024-09-12T00:31:22.647 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.649+0000 7fc56ae40800 20 add_watcher() i=7 2024-09-12T00:31:22.648 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.649+0000 7fc56ae40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:22.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.651+0000 7fc41efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:22.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.652+0000 7fc56ae40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:22.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.652+0000 7fc56ae40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:22.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.652+0000 7fc56ae40800 5 note: GC not initialized 2024-09-12T00:31:22.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.652+0000 7fc41dfe3640 20 reqs_thread_entry: start 2024-09-12T00:31:22.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.652+0000 7fc56ae40800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:22.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.652+0000 7fc56ae40800 20 Filter name: none 2024-09-12T00:31:22.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.652+0000 7fc38f7fe640 20 reqs_thread_entry: start 2024-09-12T00:31:22.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.652+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.653+0000 7fc56ae40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:22.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.653+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.652 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.654+0000 7fc56ae40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.654+0000 7fc56ae40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.654+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.654+0000 7fc56ae40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.654+0000 7fc56ae40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.654+0000 7fc56ae40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.654+0000 7fc56ae40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:22.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.656+0000 7fc41efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:22.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.658+0000 7fc56ae40800 20 remove_watcher() i=0 2024-09-12T00:31:22.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.658+0000 7fc56ae40800 2 removed watcher, disabling cache 2024-09-12T00:31:22.658 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.660+0000 7fc56ae40800 20 remove_watcher() i=1 2024-09-12T00:31:22.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.661+0000 7fc56ae40800 20 remove_watcher() i=2 2024-09-12T00:31:22.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.662+0000 7fc56ae40800 20 remove_watcher() i=3 2024-09-12T00:31:22.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.663+0000 7fc56ae40800 20 remove_watcher() i=4 2024-09-12T00:31:22.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.664+0000 7fc56ae40800 20 remove_watcher() i=5 2024-09-12T00:31:22.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.665+0000 7fc56ae40800 20 remove_watcher() i=6 2024-09-12T00:31:22.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.666+0000 7fc56ae40800 20 remove_watcher() i=7 2024-09-12T00:31:22.677 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:22.677 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:31:22.677 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: myver id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:31:22.677 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:22.679 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T00:31:22.711 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:22.711 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:22.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.753+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.755+0000 7fbda312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.755+0000 7fbda312a800 20 realm 2024-09-12T00:31:22.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.755+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.755+0000 7fbda312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.755+0000 7fbda312a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:22.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.755+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.755+0000 7fbda312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.755+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.757+0000 7fbda312a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:22.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.757+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.757+0000 7fbda312a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:22.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.758+0000 7fbda312a800 20 searching for the correct realm 2024-09-12T00:31:22.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.760+0000 7fbd9e6ac640 0 -- 172.21.15.33:0/3701293506 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x563962ecdc40 msgr2=0x563962ed0030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:22.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.764+0000 7fbd9eead640 0 -- 172.21.15.33:0/3701293506 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fbd9401f070 msgr2=0x7fbd940930d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:22.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:22.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:22.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:22.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:22.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:22.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:22.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.970 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.970+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:22.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:22.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 20 zone default found 2024-09-12T00:31:22.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 4 Realm: () 2024-09-12T00:31:22.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:22.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 20 zonegroup default 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.971+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.972+0000 7fbda312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.972+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.972+0000 7fbda312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.972+0000 7fbda312a800 20 started sync module instance, tier type = 2024-09-12T00:31:22.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.972+0000 7fbda312a800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.982+0000 7fbda312a800 20 add_watcher() i=0 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.982+0000 7fbda312a800 20 add_watcher() i=1 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.982+0000 7fbda312a800 20 add_watcher() i=2 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.982+0000 7fbda312a800 20 add_watcher() i=3 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.982+0000 7fbda312a800 20 add_watcher() i=4 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.982+0000 7fbda312a800 20 add_watcher() i=5 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.982+0000 7fbda312a800 20 add_watcher() i=6 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.983+0000 7fbda312a800 20 add_watcher() i=7 2024-09-12T00:31:22.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.983+0000 7fbda312a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:22.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.985+0000 7fbc557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:22.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.985+0000 7fbda312a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:22.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.985+0000 7fbda312a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:22.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.985+0000 7fbda312a800 5 note: GC not initialized 2024-09-12T00:31:22.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.985+0000 7fbbcffff640 20 reqs_thread_entry: start 2024-09-12T00:31:22.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.985+0000 7fbda312a800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:22.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.985+0000 7fbda312a800 20 Filter name: none 2024-09-12T00:31:22.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.986+0000 7fbbcdffb640 20 reqs_thread_entry: start 2024-09-12T00:31:22.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.986+0000 7fbda312a800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:31:22.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.986+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.986+0000 7fbda312a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:22.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.986+0000 7fbda312a800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.986+0000 7fbda312a800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.986+0000 7fbda312a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : miss 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.986+0000 7fbda312a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.987+0000 7fbda312a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.987+0000 7fbda312a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.987+0000 7fbda312a800 10 adding default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.987+0000 7fbda312a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.987+0000 7fbda312a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:22.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.987+0000 7fbda312a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:22.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.992+0000 7fbda312a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:22.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.992+0000 7fbda312a800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:22.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.992+0000 7fbda312a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:22.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.992+0000 7fbda312a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:22.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.993+0000 7fbc81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94804472822480 notifier 8493 bl.length()=905 2024-09-12T00:31:22.991 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.993+0000 7fbc81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:22.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.993+0000 7fbc81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:22.992 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.993+0000 7fbc81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:22.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.995+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:22.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.995+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:22.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.995+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:22.993 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.995+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.0 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.0 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.1 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.1 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.2 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.2 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.3 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.3 2024-09-12T00:31:22.998 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.4 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.4 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.5 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.5 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.6 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.6 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.7 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.7 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.8 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.8 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.9 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.9 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.10 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.10 2024-09-12T00:31:22.999 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.11 2024-09-12T00:31:23.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.11 2024-09-12T00:31:23.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.0 2024-09-12T00:31:23.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:22.999+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1 2024-09-12T00:31:23.000 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.000+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2 2024-09-12T00:31:23.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.000+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3 2024-09-12T00:31:23.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.001+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.4 2024-09-12T00:31:23.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.001+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.5 2024-09-12T00:31:23.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.002+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.6 2024-09-12T00:31:23.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.003+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.7 2024-09-12T00:31:23.001 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.003+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.8 2024-09-12T00:31:23.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.003+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.9 2024-09-12T00:31:23.002 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.004+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.10 2024-09-12T00:31:23.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.005+0000 7fbda312a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:23.003 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.005+0000 7fbda312a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:23.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.006+0000 7fbda312a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:23.004 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.006+0000 7fbda312a800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:23.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.006+0000 7fbda312a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:23.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.006+0000 7fbda312a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:23.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.006+0000 7fbc827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 94804472822480 notifier 8493 bl.length()=905 2024-09-12T00:31:23.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.006+0000 7fbc827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:23.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.006+0000 7fbc827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:23.005 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.006+0000 7fbc827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:23.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.008+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:23.006 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.008+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:23.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.008+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:23.007 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.008+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:23.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.011+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.0 2024-09-12T00:31:23.009 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.011+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1 2024-09-12T00:31:23.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.011+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2 2024-09-12T00:31:23.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.012+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3 2024-09-12T00:31:23.010 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.012+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.4 2024-09-12T00:31:23.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.012+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.5 2024-09-12T00:31:23.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.013+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.6 2024-09-12T00:31:23.011 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.013+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.7 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.013+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.8 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.014+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.9 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.014+0000 7fbda312a800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.10 2024-09-12T00:31:23.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.014+0000 7fbda312a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:23.013 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.014+0000 7fbda312a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:23.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.016+0000 7fbda312a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:23.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.016+0000 7fbda312a800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:23.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.016+0000 7fbda312a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:23.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.016+0000 7fbda312a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:23.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.016+0000 7fbc81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94804472822480 notifier 8493 bl.length()=873 2024-09-12T00:31:23.015 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.016+0000 7fbc81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:23.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.016+0000 7fbc81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:23.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.016+0000 7fbc81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:23.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.018+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:23.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.018+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:23.016 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.018+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:23.017 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.018+0000 7fbda312a800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:23.019 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.020+0000 7fbda312a800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T00:31:23.020 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.022+0000 7fbc557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.024+0000 7fbda312a800 20 remove_watcher() i=0 2024-09-12T00:31:23.023 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.024+0000 7fbda312a800 2 removed watcher, disabling cache 2024-09-12T00:31:23.024 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.026+0000 7fbda312a800 20 remove_watcher() i=1 2024-09-12T00:31:23.025 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.027+0000 7fbda312a800 20 remove_watcher() i=2 2024-09-12T00:31:23.027 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.028+0000 7fbda312a800 20 remove_watcher() i=3 2024-09-12T00:31:23.028 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.029+0000 7fbda312a800 20 remove_watcher() i=4 2024-09-12T00:31:23.029 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.030+0000 7fbda312a800 20 remove_watcher() i=5 2024-09-12T00:31:23.030 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.031+0000 7fbda312a800 20 remove_watcher() i=6 2024-09-12T00:31:23.031 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.032+0000 7fbda312a800 20 remove_watcher() i=7 2024-09-12T00:31:23.043 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:31:23.073 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:23.073 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:23.112 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.113+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.115+0000 7ff09fd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.115+0000 7ff09fd25800 20 realm 2024-09-12T00:31:23.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.115+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.115+0000 7ff09fd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.115+0000 7ff09fd25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:23.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.115+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.116+0000 7ff09fd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.116+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.117+0000 7ff09fd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.117+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.117+0000 7ff09fd25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:23.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.117+0000 7ff09fd25800 20 searching for the correct realm 2024-09-12T00:31:23.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.121+0000 7ff09c134640 0 -- 172.21.15.33:0/3350963263 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x561529683c80 msgr2=0x561529686140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:23.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.124+0000 7ff09b933640 0 -- 172.21.15.33:0/3350963263 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7ff0840db820 msgr2=0x7ff0840a2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:23.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.128+0000 7ff09fd25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:23.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.128+0000 7ff09fd25800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:23.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.128+0000 7ff09fd25800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:23.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.128+0000 7ff09fd25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:23.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.128+0000 7ff09fd25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:23.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.128+0000 7ff09fd25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:23.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.128+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.128 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 20 zone default found 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 4 Realm: () 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:23.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 20 zonegroup default 2024-09-12T00:31:23.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.129+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.130+0000 7ff09fd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.130+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.130+0000 7ff09fd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.130+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.130+0000 7ff09fd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.130+0000 7ff09fd25800 20 started sync module instance, tier type = 2024-09-12T00:31:23.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.130+0000 7ff09fd25800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:23.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.139+0000 7ff09fd25800 20 add_watcher() i=0 2024-09-12T00:31:23.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.139+0000 7ff09fd25800 20 add_watcher() i=1 2024-09-12T00:31:23.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.139+0000 7ff09fd25800 20 add_watcher() i=2 2024-09-12T00:31:23.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.139+0000 7ff09fd25800 20 add_watcher() i=3 2024-09-12T00:31:23.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.139+0000 7ff09fd25800 20 add_watcher() i=4 2024-09-12T00:31:23.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.139+0000 7ff09fd25800 20 add_watcher() i=5 2024-09-12T00:31:23.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.139+0000 7ff09fd25800 20 add_watcher() i=6 2024-09-12T00:31:23.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.140+0000 7ff09fd25800 20 add_watcher() i=7 2024-09-12T00:31:23.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.140+0000 7ff09fd25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:23.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.142+0000 7fef51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.142+0000 7ff09fd25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:23.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.142+0000 7ff09fd25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:23.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.142+0000 7ff09fd25800 5 note: GC not initialized 2024-09-12T00:31:23.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.143+0000 7fef50fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:23.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.143+0000 7ff09fd25800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:23.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.143+0000 7ff09fd25800 20 Filter name: none 2024-09-12T00:31:23.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.143+0000 7feeca7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:23.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.143+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.143+0000 7ff09fd25800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:23.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.143+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.144+0000 7ff09fd25800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:23.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.144+0000 7ff09fd25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.144+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.144+0000 7ff09fd25800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:23.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.144+0000 7ff09fd25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.145+0000 7ff09fd25800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:23.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.145+0000 7ff09fd25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.146+0000 7fef51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.149+0000 7ff09fd25800 20 remove_watcher() i=0 2024-09-12T00:31:23.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.149+0000 7ff09fd25800 2 removed watcher, disabling cache 2024-09-12T00:31:23.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.150+0000 7ff09fd25800 20 remove_watcher() i=1 2024-09-12T00:31:23.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.151+0000 7ff09fd25800 20 remove_watcher() i=2 2024-09-12T00:31:23.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.152+0000 7ff09fd25800 20 remove_watcher() i=3 2024-09-12T00:31:23.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.153+0000 7ff09fd25800 20 remove_watcher() i=4 2024-09-12T00:31:23.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.154+0000 7ff09fd25800 20 remove_watcher() i=5 2024-09-12T00:31:23.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.155+0000 7ff09fd25800 20 remove_watcher() i=6 2024-09-12T00:31:23.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.156+0000 7ff09fd25800 20 remove_watcher() i=7 2024-09-12T00:31:23.166 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:23.166 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:31:23.166 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: myver id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:31:23.166 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:23.168 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:23.168 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:23.190 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:23.190 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:23.246 INFO:tasks.workunit.client.0.smithi033.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:31:23.248 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:23.248 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:23.328 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:23.328 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:23.556 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:31:23.585 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:23.586 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:23.625 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.626+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.628+0000 7f4036b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.628+0000 7f4036b23800 20 realm 2024-09-12T00:31:23.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.628+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.628+0000 7f4036b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.628+0000 7f4036b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:23.627 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.628+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.628+0000 7f4036b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.628+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.629+0000 7f4036b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.628 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.629+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.630+0000 7f4036b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:23.629 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.630+0000 7f4036b23800 20 searching for the correct realm 2024-09-12T00:31:23.631 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.633+0000 7f403300d640 0 -- 172.21.15.33:0/371304299 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55bfdcb059c0 msgr2=0x55bfdcb07e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:23.635 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.636+0000 7f403280c640 0 -- 172.21.15.33:0/371304299 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f402804e3f0 msgr2=0x7f402804e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:23.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:23.639 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:23.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:23.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:23.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:23.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:23.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.640 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.641+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.641 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 zone default found 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 4 Realm: () 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 zonegroup default 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 started sync module instance, tier type = 2024-09-12T00:31:23.642 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.642+0000 7f4036b23800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:23.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.651+0000 7f4036b23800 20 add_watcher() i=0 2024-09-12T00:31:23.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.651+0000 7f4036b23800 20 add_watcher() i=1 2024-09-12T00:31:23.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.651+0000 7f4036b23800 20 add_watcher() i=2 2024-09-12T00:31:23.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.651+0000 7f4036b23800 20 add_watcher() i=3 2024-09-12T00:31:23.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.651+0000 7f4036b23800 20 add_watcher() i=4 2024-09-12T00:31:23.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.651+0000 7f4036b23800 20 add_watcher() i=5 2024-09-12T00:31:23.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.651+0000 7f4036b23800 20 add_watcher() i=6 2024-09-12T00:31:23.650 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.652+0000 7f4036b23800 20 add_watcher() i=7 2024-09-12T00:31:23.651 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.652+0000 7f4036b23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:23.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f3ee97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f4036b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:23.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f4036b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:23.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f4036b23800 5 note: GC not initialized 2024-09-12T00:31:23.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f3e63fff640 20 reqs_thread_entry: start 2024-09-12T00:31:23.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f4036b23800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:23.653 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f4036b23800 20 Filter name: none 2024-09-12T00:31:23.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f3e61ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:23.654 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.654+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.655+0000 7f4036b23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:23.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.655+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.656+0000 7f4036b23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:23.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.656+0000 7f4036b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.656+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.656+0000 7f4036b23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:23.655 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.656+0000 7f4036b23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.657+0000 7f4036b23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:23.656 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.657+0000 7f4036b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.657 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.658+0000 7f3ee97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.660+0000 7f4036b23800 20 remove_watcher() i=0 2024-09-12T00:31:23.659 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.660+0000 7f4036b23800 2 removed watcher, disabling cache 2024-09-12T00:31:23.660 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.662+0000 7f4036b23800 20 remove_watcher() i=1 2024-09-12T00:31:23.661 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.663+0000 7f4036b23800 20 remove_watcher() i=2 2024-09-12T00:31:23.662 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.664+0000 7f4036b23800 20 remove_watcher() i=3 2024-09-12T00:31:23.663 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.665+0000 7f4036b23800 20 remove_watcher() i=4 2024-09-12T00:31:23.664 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.666+0000 7f4036b23800 20 remove_watcher() i=5 2024-09-12T00:31:23.665 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.667+0000 7f4036b23800 20 remove_watcher() i=6 2024-09-12T00:31:23.666 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.668+0000 7f4036b23800 20 remove_watcher() i=7 2024-09-12T00:31:23.677 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:23.677 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:31:23.678 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: a-bucket id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T00:31:23.678 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:23.679 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:31:23.708 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:23.709 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:23.748 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.749+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.749 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.751+0000 7fbc34e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.751+0000 7fbc34e1b800 20 realm 2024-09-12T00:31:23.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.751+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.751+0000 7fbc34e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.751+0000 7fbc34e1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:23.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.751+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.751+0000 7fbc34e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.751+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.752+0000 7fbc34e1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.752+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.753+0000 7fbc34e1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:23.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.753+0000 7fbc34e1b800 20 searching for the correct realm 2024-09-12T00:31:23.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.755+0000 7fbc2fdea640 0 -- 172.21.15.33:0/1125420885 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55e820852c70 msgr2=0x55e820855060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:23.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.759+0000 7fbc305eb640 0 -- 172.21.15.33:0/1125420885 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fbc24092220 msgr2=0x7fbc2406d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:23.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.965+0000 7fbc34e1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:23.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.965+0000 7fbc34e1b800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:23.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.965+0000 7fbc34e1b800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:23.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.965+0000 7fbc34e1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:23.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.965+0000 7fbc34e1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:23.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.965+0000 7fbc34e1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:23.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.965+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.965 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:23.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 20 zone default found 2024-09-12T00:31:23.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 4 Realm: () 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 20 zonegroup default 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.966+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.967+0000 7fbc34e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.967+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.967+0000 7fbc34e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.967+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.967+0000 7fbc34e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.967+0000 7fbc34e1b800 20 started sync module instance, tier type = 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.967+0000 7fbc34e1b800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.977+0000 7fbc34e1b800 20 add_watcher() i=0 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.977+0000 7fbc34e1b800 20 add_watcher() i=1 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.977+0000 7fbc34e1b800 20 add_watcher() i=2 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.977+0000 7fbc34e1b800 20 add_watcher() i=3 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.977+0000 7fbc34e1b800 20 add_watcher() i=4 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.977+0000 7fbc34e1b800 20 add_watcher() i=5 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.977+0000 7fbc34e1b800 20 add_watcher() i=6 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.978+0000 7fbc34e1b800 20 add_watcher() i=7 2024-09-12T00:31:23.976 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.978+0000 7fbc34e1b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:23.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.980+0000 7fbae6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.980+0000 7fbc34e1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:23.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.980+0000 7fbc34e1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:23.979 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.980+0000 7fbc34e1b800 5 note: GC not initialized 2024-09-12T00:31:23.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.980+0000 7fbae5fdb640 20 reqs_thread_entry: start 2024-09-12T00:31:23.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.980+0000 7fbc34e1b800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:23.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.980+0000 7fbc34e1b800 20 Filter name: none 2024-09-12T00:31:23.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.981+0000 7fba577fe640 20 reqs_thread_entry: start 2024-09-12T00:31:23.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.981+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.981+0000 7fbc34e1b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:23.980 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.981+0000 7fbc34e1b800 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.982+0000 7fbc34e1b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:23.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.982+0000 7fbc34e1b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.981 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.982+0000 7fbae6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.985+0000 7fbc34e1b800 20 remove_watcher() i=0 2024-09-12T00:31:23.983 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.985+0000 7fbc34e1b800 2 removed watcher, disabling cache 2024-09-12T00:31:23.984 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.986+0000 7fbc34e1b800 20 remove_watcher() i=1 2024-09-12T00:31:23.985 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.987+0000 7fbc34e1b800 20 remove_watcher() i=2 2024-09-12T00:31:23.986 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.988+0000 7fbc34e1b800 20 remove_watcher() i=3 2024-09-12T00:31:23.987 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.989+0000 7fbc34e1b800 20 remove_watcher() i=4 2024-09-12T00:31:23.988 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.990+0000 7fbc34e1b800 20 remove_watcher() i=5 2024-09-12T00:31:23.989 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.991+0000 7fbc34e1b800 20 remove_watcher() i=6 2024-09-12T00:31:23.990 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:23.992+0000 7fbc34e1b800 20 remove_watcher() i=7 2024-09-12T00:31:24.003 INFO:tasks.workunit.client.0.smithi033.stderr:rados -p default.rgw.buckets.index setomapval .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:31:24.030 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:24.030 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:24.047 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:31:24.075 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:24.076 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:24.116 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.117+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.119+0000 7f62e3240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.119+0000 7f62e3240800 20 realm 2024-09-12T00:31:24.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.119+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.119+0000 7f62e3240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.119+0000 7f62e3240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:24.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.119+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.119+0000 7f62e3240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.119+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.120+0000 7f62e3240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.120+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.121+0000 7f62e3240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:24.120 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.121+0000 7f62e3240800 20 searching for the correct realm 2024-09-12T00:31:24.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.124+0000 7f62e152b640 0 -- 172.21.15.33:0/3294813043 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55d077e59390 msgr2=0x55d077e5b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.128+0000 7f62e0d2a640 0 -- 172.21.15.33:0/3294813043 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f62cc048920 msgr2=0x7f62cc08b240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.132+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 zone default found 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 4 Realm: () 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 zonegroup default 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 started sync module instance, tier type = 2024-09-12T00:31:24.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.133+0000 7f62e3240800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:24.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.143+0000 7f62e3240800 20 add_watcher() i=0 2024-09-12T00:31:24.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.143+0000 7f62e3240800 20 add_watcher() i=1 2024-09-12T00:31:24.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.143+0000 7f62e3240800 20 add_watcher() i=2 2024-09-12T00:31:24.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.143+0000 7f62e3240800 20 add_watcher() i=3 2024-09-12T00:31:24.141 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.143+0000 7f62e3240800 20 add_watcher() i=4 2024-09-12T00:31:24.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.143+0000 7f62e3240800 20 add_watcher() i=5 2024-09-12T00:31:24.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.143+0000 7f62e3240800 20 add_watcher() i=6 2024-09-12T00:31:24.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.144+0000 7f62e3240800 20 add_watcher() i=7 2024-09-12T00:31:24.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.144+0000 7f62e3240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:24.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.145+0000 7f6196fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.145+0000 7f62e3240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:24.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.145+0000 7f62e3240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:24.144 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.145+0000 7f62e3240800 5 note: GC not initialized 2024-09-12T00:31:24.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.145+0000 7f6195fe3640 20 reqs_thread_entry: start 2024-09-12T00:31:24.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.146+0000 7f62e3240800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:24.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.146+0000 7f62e3240800 20 Filter name: none 2024-09-12T00:31:24.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.146+0000 7f61077fe640 20 reqs_thread_entry: start 2024-09-12T00:31:24.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.146+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.146+0000 7f62e3240800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:24.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.146+0000 7f62e3240800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:24.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:24.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:31:24.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 20 INFO: main: starting shard=0 2024-09-12T00:31:24.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:31:24.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:31:24.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:31:24.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 20 INFO: main: starting shard=1 2024-09-12T00:31:24.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:31:24.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.147+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:31:24.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.148+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.148+0000 7f62e3240800 20 INFO: main: starting shard=2 2024-09-12T00:31:24.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.148+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:31:24.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.148+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:31:24.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.149+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.149+0000 7f62e3240800 20 INFO: main: starting shard=3 2024-09-12T00:31:24.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.149+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:31:24.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.149+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:31:24.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.149+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.149+0000 7f62e3240800 20 INFO: main: starting shard=4 2024-09-12T00:31:24.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.149+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:31:24.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.149+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:31:24.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.150+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.150+0000 7f62e3240800 20 INFO: main: starting shard=5 2024-09-12T00:31:24.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.150+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:31:24.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.150+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:31:24.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.150+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.150+0000 7f62e3240800 20 INFO: main: starting shard=6 2024-09-12T00:31:24.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.150+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:31:24.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.150+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:31:24.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.151+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.151+0000 7f62e3240800 20 INFO: main: starting shard=7 2024-09-12T00:31:24.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.151+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:31:24.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.151+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:31:24.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.152+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.152+0000 7f62e3240800 20 INFO: main: starting shard=8 2024-09-12T00:31:24.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.152+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:31:24.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.152+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:31:24.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.152+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.152+0000 7f62e3240800 20 INFO: main: starting shard=9 2024-09-12T00:31:24.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.152+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:31:24.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.152+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.153+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.153+0000 7f62e3240800 20 INFO: main: starting shard=10 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.153+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.153+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.153+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.153+0000 7f62e3240800 20 INFO: main: starting shard=11 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.153+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.153+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:31:24.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.154+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.154+0000 7f62e3240800 20 INFO: main: starting shard=12 2024-09-12T00:31:24.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.154+0000 7f62e3240800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:31:24.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.154+0000 7f62e3240800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:31:24.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.155+0000 7f62e3240800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.155+0000 7f62e3240800 20 INFO: main: done 2024-09-12T00:31:24.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.156+0000 7f6196fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.158+0000 7f62e3240800 20 remove_watcher() i=0 2024-09-12T00:31:24.156 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.158+0000 7f62e3240800 2 removed watcher, disabling cache 2024-09-12T00:31:24.157 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.159+0000 7f62e3240800 20 remove_watcher() i=1 2024-09-12T00:31:24.158 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.160+0000 7f62e3240800 20 remove_watcher() i=2 2024-09-12T00:31:24.160 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.161+0000 7f62e3240800 20 remove_watcher() i=3 2024-09-12T00:31:24.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.162+0000 7f62e3240800 20 remove_watcher() i=4 2024-09-12T00:31:24.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.163+0000 7f62e3240800 20 remove_watcher() i=5 2024-09-12T00:31:24.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.164+0000 7f62e3240800 20 remove_watcher() i=6 2024-09-12T00:31:24.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.165+0000 7f62e3240800 20 remove_watcher() i=7 2024-09-12T00:31:24.176 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:31:24.209 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:24.209 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:24.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.249+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.251+0000 7f3adce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.251+0000 7f3adce20800 20 realm 2024-09-12T00:31:24.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.251+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.251+0000 7f3adce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.251+0000 7f3adce20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:24.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.251+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.251+0000 7f3adce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.251+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.252+0000 7f3adce20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.252+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.253+0000 7f3adce20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:24.252 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.253+0000 7f3adce20800 20 searching for the correct realm 2024-09-12T00:31:24.254 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.255+0000 7f3adb112640 0 -- 172.21.15.33:0/2328325486 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x558475f2d160 msgr2=0x558475f2f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:24.258 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.259+0000 7f3ada911640 0 -- 172.21.15.33:0/2328325486 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f3ad000cc20 msgr2=0x7f3ad0089040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:24.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:24.262 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:24.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:24.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:24.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:24.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.263 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:24.264 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.264+0000 7f3adce20800 20 zone default found 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 4 Realm: () 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 zonegroup default 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 started sync module instance, tier type = 2024-09-12T00:31:24.265 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.265+0000 7f3adce20800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:24.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.274+0000 7f3adce20800 20 add_watcher() i=0 2024-09-12T00:31:24.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.274+0000 7f3adce20800 20 add_watcher() i=1 2024-09-12T00:31:24.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.274+0000 7f3adce20800 20 add_watcher() i=2 2024-09-12T00:31:24.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.274+0000 7f3adce20800 20 add_watcher() i=3 2024-09-12T00:31:24.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.274+0000 7f3adce20800 20 add_watcher() i=4 2024-09-12T00:31:24.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.274+0000 7f3adce20800 20 add_watcher() i=5 2024-09-12T00:31:24.273 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.274+0000 7f3adce20800 20 add_watcher() i=6 2024-09-12T00:31:24.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.275+0000 7f3adce20800 20 add_watcher() i=7 2024-09-12T00:31:24.274 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.275+0000 7f3adce20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:24.276 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.277+0000 7f39917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.277+0000 7f3adce20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.277+0000 7f3adce20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.277+0000 7f3adce20800 5 note: GC not initialized 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.278+0000 7f390bfff640 20 reqs_thread_entry: start 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.278+0000 7f3adce20800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.278+0000 7f3adce20800 20 Filter name: none 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.278+0000 7f3909ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.278+0000 7f3adce20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:31:24.277 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.278+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:24.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:31:24.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:31:24.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : miss 2024-09-12T00:31:24.278 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:24.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:24.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:24.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:24.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.279 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.279+0000 7f3adce20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:31:24.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.282+0000 7f3adce20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:24.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.282+0000 7f3adce20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:24.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.282+0000 7f3adce20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.281 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.282+0000 7f3adce20800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:31:24.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.283+0000 7f39bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94027402919504 notifier 7988 bl.length()=911 2024-09-12T00:31:24.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.283+0000 7f39bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:24.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.283+0000 7f39bdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:24.282 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.283+0000 7f39bdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.284+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:31:24.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.284+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:31:24.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.284+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:31:24.283 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.284+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:31:24.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.289+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:31:24.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.289+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:31:24.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.289+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:31:24.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.289+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:31:24.288 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.290+0000 7f3adce20800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:31:24.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.290+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:31:24.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.290+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:31:24.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.290+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:31:24.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.290+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:31:24.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.290+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:31:24.289 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.290+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:31:24.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.291+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:31:24.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.291+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:31:24.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.291+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:31:24.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.291+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:31:24.290 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.292+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:31:24.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.292+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:31:24.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.292+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:31:24.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.292+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:31:24.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.293+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:31:24.291 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.293+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:31:24.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.293+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:31:24.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.293+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:31:24.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.294+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:31:24.292 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.294+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:31:24.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.294+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:31:24.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.294+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:31:24.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.295+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:31:24.293 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.295+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:31:24.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.295+0000 7f3adce20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:24.294 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.295+0000 7f3adce20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:31:24.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.297+0000 7f3adce20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:24.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.297+0000 7f3adce20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:24.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.297+0000 7f3adce20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.295 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.297+0000 7f3adce20800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:31:24.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.297+0000 7f39be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 94027402919504 notifier 7988 bl.length()=911 2024-09-12T00:31:24.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.297+0000 7f39be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:24.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.297+0000 7f39be7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:24.296 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.297+0000 7f39be7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.299+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:31:24.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.299+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:31:24.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.299+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:31:24.297 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.299+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:31:24.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.301+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:31:24.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.301+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.0 2024-09-12T00:31:24.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.301+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:31:24.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.301+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.1 2024-09-12T00:31:24.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.302+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:31:24.300 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.302+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.2 2024-09-12T00:31:24.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.302+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:31:24.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.302+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.3 2024-09-12T00:31:24.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.302+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:31:24.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.302+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.4 2024-09-12T00:31:24.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.303+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:31:24.301 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.303+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.5 2024-09-12T00:31:24.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.303+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:31:24.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.303+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.6 2024-09-12T00:31:24.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.303+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:31:24.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.303+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.7 2024-09-12T00:31:24.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.304+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:31:24.302 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.304+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.8 2024-09-12T00:31:24.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.304+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:31:24.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.304+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.9 2024-09-12T00:31:24.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.305+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:31:24.303 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.305+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.10 2024-09-12T00:31:24.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.305+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:31:24.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.305+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.11 2024-09-12T00:31:24.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.305+0000 7f3adce20800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:31:24.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.305+0000 7f3adce20800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.2.12 2024-09-12T00:31:24.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.306+0000 7f3adce20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:24.304 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.306+0000 7f3adce20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 2024-09-12T00:31:24.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.307+0000 7f3adce20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:24.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.307+0000 7f3adce20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:24.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.307+0000 7f3adce20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.307+0000 7f3adce20800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18, ofs0, ns] 2024-09-12T00:31:24.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.307+0000 7f39bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 94027402919504 notifier 7988 bl.length()=879 2024-09-12T00:31:24.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.307+0000 7f39bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 info.flags=0x17 2024-09-12T00:31:24.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.307+0000 7f39bdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18 to cache LRU end 2024-09-12T00:31:24.306 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.307+0000 7f39bdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.309+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_sources= new_sources= 2024-09-12T00:31:24.307 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.309+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential sources added=[] removed=[] 2024-09-12T00:31:24.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.309+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): orig_dests= new_dests= 2024-09-12T00:31:24.308 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.309+0000 7f3adce20800 20 handle_bi_update(): bucket=:a-bucket[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18]): potential dests added=[] removed=[] 2024-09-12T00:31:24.310 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.311+0000 7f3adce20800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T00:31:24.312 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.313+0000 7f39917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.316+0000 7f3adce20800 20 remove_watcher() i=0 2024-09-12T00:31:24.314 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.316+0000 7f3adce20800 2 removed watcher, disabling cache 2024-09-12T00:31:24.315 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.317+0000 7f3adce20800 20 remove_watcher() i=1 2024-09-12T00:31:24.316 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.318+0000 7f3adce20800 20 remove_watcher() i=2 2024-09-12T00:31:24.317 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.319+0000 7f3adce20800 20 remove_watcher() i=3 2024-09-12T00:31:24.318 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.320+0000 7f3adce20800 20 remove_watcher() i=4 2024-09-12T00:31:24.319 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.321+0000 7f3adce20800 20 remove_watcher() i=5 2024-09-12T00:31:24.320 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.322+0000 7f3adce20800 20 remove_watcher() i=6 2024-09-12T00:31:24.321 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.323+0000 7f3adce20800 20 remove_watcher() i=7 2024-09-12T00:31:24.333 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:31:24.363 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:24.363 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:24.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.404+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.406+0000 7fdbd3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.406+0000 7fdbd3326800 20 realm 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.406+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.407+0000 7fdbd3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.407+0000 7fdbd3326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.407+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.407+0000 7fdbd3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.407+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.408+0000 7fdbd3326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.408+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.409+0000 7fdbd3326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:24.408 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.409+0000 7fdbd3326800 20 searching for the correct realm 2024-09-12T00:31:24.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.412+0000 7fdbce708640 0 -- 172.21.15.33:0/176553069 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x563d2c75b390 msgr2=0x563d2c75d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.414 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.415+0000 7fdbcf70a640 0 -- 172.21.15.33:0/176553069 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fdbc4023040 msgr2=0x7fdbc403b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.418 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.419 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 zone default found 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 4 Realm: () 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 zonegroup default 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.419+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.420+0000 7fdbd3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.420+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.420+0000 7fdbd3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.420+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.420 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.420+0000 7fdbd3326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.420+0000 7fdbd3326800 20 started sync module instance, tier type = 2024-09-12T00:31:24.421 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.420+0000 7fdbd3326800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:24.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.429+0000 7fdbd3326800 20 add_watcher() i=0 2024-09-12T00:31:24.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.429+0000 7fdbd3326800 20 add_watcher() i=1 2024-09-12T00:31:24.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.429+0000 7fdbd3326800 20 add_watcher() i=2 2024-09-12T00:31:24.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.429+0000 7fdbd3326800 20 add_watcher() i=3 2024-09-12T00:31:24.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.429+0000 7fdbd3326800 20 add_watcher() i=4 2024-09-12T00:31:24.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.429+0000 7fdbd3326800 20 add_watcher() i=5 2024-09-12T00:31:24.428 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.429+0000 7fdbd3326800 20 add_watcher() i=6 2024-09-12T00:31:24.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.430+0000 7fdbd3326800 20 add_watcher() i=7 2024-09-12T00:31:24.429 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.430+0000 7fdbd3326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:24.430 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.431+0000 7fda857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.432+0000 7fdbd3326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:24.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.432+0000 7fdbd3326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:24.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.432+0000 7fdbd3326800 5 note: GC not initialized 2024-09-12T00:31:24.431 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.432+0000 7fd9fffff640 20 reqs_thread_entry: start 2024-09-12T00:31:24.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.432+0000 7fdbd3326800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:24.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.432+0000 7fdbd3326800 20 Filter name: none 2024-09-12T00:31:24.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.432+0000 7fd9fdffb640 20 reqs_thread_entry: start 2024-09-12T00:31:24.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.432+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.433+0000 7fdbd3326800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:24.432 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.433+0000 7fdbd3326800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.433+0000 7fdbd3326800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:24.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.433+0000 7fdbd3326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:24.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.433+0000 7fdbd3326800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:31:24.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.433+0000 7fdbd3326800 20 INFO: main: starting shard=0 2024-09-12T00:31:24.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.433+0000 7fdbd3326800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:31:24.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.433+0000 7fdbd3326800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18.3.0 2024-09-12T00:31:24.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.434+0000 7fdbd3326800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:24.433 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.434+0000 7fdbd3326800 20 INFO: main: done 2024-09-12T00:31:24.434 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.435+0000 7fda857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.437+0000 7fdbd3326800 20 remove_watcher() i=0 2024-09-12T00:31:24.435 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.437+0000 7fdbd3326800 2 removed watcher, disabling cache 2024-09-12T00:31:24.436 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.438+0000 7fdbd3326800 20 remove_watcher() i=1 2024-09-12T00:31:24.437 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.439+0000 7fdbd3326800 20 remove_watcher() i=2 2024-09-12T00:31:24.438 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.440+0000 7fdbd3326800 20 remove_watcher() i=3 2024-09-12T00:31:24.439 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.441+0000 7fdbd3326800 20 remove_watcher() i=4 2024-09-12T00:31:24.440 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.442+0000 7fdbd3326800 20 remove_watcher() i=5 2024-09-12T00:31:24.441 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.443+0000 7fdbd3326800 20 remove_watcher() i=6 2024-09-12T00:31:24.442 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.444+0000 7fdbd3326800 20 remove_watcher() i=7 2024-09-12T00:31:24.454 INFO:tasks.workunit.client.0.smithi033.stderr: test: PUT succeeds during reshard 2024-09-12T00:31:24.455 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:31:24.485 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:24.485 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:24.524 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.525+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.527+0000 7fb7aac15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.527+0000 7fb7aac15800 20 realm 2024-09-12T00:31:24.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.527+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.527+0000 7fb7aac15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.527+0000 7fb7aac15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:24.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.527+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.526 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.527+0000 7fb7aac15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.527+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.528+0000 7fb7aac15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.528+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.527 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.529+0000 7fb7aac15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:24.528 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.529+0000 7fb7aac15800 20 searching for the correct realm 2024-09-12T00:31:24.531 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.532+0000 7fb7a6b93640 0 -- 172.21.15.33:0/278657580 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fb79c0a5db0 msgr2=0x7fb79c0a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.737 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.738+0000 7fb7a6392640 0 -- 172.21.15.33:0/278657580 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x5575fdf736a0 msgr2=0x5575fdf75a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.740 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.741+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 20 zone default found 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 4 Realm: () 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 20 zonegroup default 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.742+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.743+0000 7fb7aac15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.743+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.743+0000 7fb7aac15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.743+0000 7fb7aac15800 20 started sync module instance, tier type = 2024-09-12T00:31:24.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.743+0000 7fb7aac15800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:24.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.753+0000 7fb7aac15800 20 add_watcher() i=0 2024-09-12T00:31:24.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.753+0000 7fb7aac15800 20 add_watcher() i=1 2024-09-12T00:31:24.751 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.753+0000 7fb7aac15800 20 add_watcher() i=2 2024-09-12T00:31:24.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.753+0000 7fb7aac15800 20 add_watcher() i=3 2024-09-12T00:31:24.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.753+0000 7fb7aac15800 20 add_watcher() i=4 2024-09-12T00:31:24.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.753+0000 7fb7aac15800 20 add_watcher() i=5 2024-09-12T00:31:24.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.753+0000 7fb7aac15800 20 add_watcher() i=6 2024-09-12T00:31:24.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.754+0000 7fb7aac15800 20 add_watcher() i=7 2024-09-12T00:31:24.752 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.754+0000 7fb7aac15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:24.754 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.756+0000 7fb65cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.756+0000 7fb7aac15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:24.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.756+0000 7fb7aac15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:24.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.756+0000 7fb7aac15800 5 note: GC not initialized 2024-09-12T00:31:24.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.756+0000 7fb5d77fe640 20 reqs_thread_entry: start 2024-09-12T00:31:24.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.756+0000 7fb7aac15800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:24.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.756+0000 7fb7aac15800 20 Filter name: none 2024-09-12T00:31:24.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.757+0000 7fb5d57fa640 20 reqs_thread_entry: start 2024-09-12T00:31:24.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.757+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.757+0000 7fb7aac15800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:24.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.757+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.758+0000 7fb7aac15800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:24.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.758+0000 7fb7aac15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:24.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.758+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.758+0000 7fb7aac15800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:24.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.758+0000 7fb7aac15800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.758+0000 7fb7aac15800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:24.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.759+0000 7fb7aac15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:24.759 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.760+0000 7fb65cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.763+0000 7fb7aac15800 20 remove_watcher() i=0 2024-09-12T00:31:24.761 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.763+0000 7fb7aac15800 2 removed watcher, disabling cache 2024-09-12T00:31:24.762 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.764+0000 7fb7aac15800 20 remove_watcher() i=1 2024-09-12T00:31:24.763 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.765+0000 7fb7aac15800 20 remove_watcher() i=2 2024-09-12T00:31:24.764 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.766+0000 7fb7aac15800 20 remove_watcher() i=3 2024-09-12T00:31:24.765 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.767+0000 7fb7aac15800 20 remove_watcher() i=4 2024-09-12T00:31:24.766 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.768+0000 7fb7aac15800 20 remove_watcher() i=5 2024-09-12T00:31:24.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.769+0000 7fb7aac15800 20 remove_watcher() i=6 2024-09-12T00:31:24.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.770+0000 7fb7aac15800 20 remove_watcher() i=7 2024-09-12T00:31:24.779 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:24.780 INFO:tasks.workunit.client.0.smithi033.stderr:BUCKET_STATS: 2024-09-12T00:31:24.780 INFO:tasks.workunit.client.0.smithi033.stderr:bucket: myver id: 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:31:24.780 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:24.781 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T00:31:24.815 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:24.816 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:24.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.856+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.858+0000 7faffab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.858+0000 7faffab42800 20 realm 2024-09-12T00:31:24.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.858+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.858+0000 7faffab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.858+0000 7faffab42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:24.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.858+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.858+0000 7faffab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.858+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.859+0000 7faffab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.859+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.860+0000 7faffab42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:24.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.860+0000 7faffab42800 20 searching for the correct realm 2024-09-12T00:31:24.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.863+0000 7fafeffff640 0 -- 172.21.15.33:0/3888011819 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55863128a2e0 msgr2=0x55863128c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.865 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.867+0000 7faff7087640 0 -- 172.21.15.33:0/3888011819 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fafe0076040 msgr2=0x7fafe0081400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.870 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.870+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 zone default found 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 4 Realm: () 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 zonegroup default 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.871+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.872+0000 7faffab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.872+0000 7faffab42800 20 started sync module instance, tier type = 2024-09-12T00:31:24.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.872+0000 7faffab42800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:24.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.880+0000 7faffab42800 20 add_watcher() i=0 2024-09-12T00:31:24.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.880+0000 7faffab42800 20 add_watcher() i=1 2024-09-12T00:31:24.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.880+0000 7faffab42800 20 add_watcher() i=2 2024-09-12T00:31:24.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.880+0000 7faffab42800 20 add_watcher() i=3 2024-09-12T00:31:24.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.880+0000 7faffab42800 20 add_watcher() i=4 2024-09-12T00:31:24.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.880+0000 7faffab42800 20 add_watcher() i=5 2024-09-12T00:31:24.879 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.880+0000 7faffab42800 20 add_watcher() i=6 2024-09-12T00:31:24.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.881+0000 7faffab42800 20 add_watcher() i=7 2024-09-12T00:31:24.880 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.881+0000 7faffab42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:24.881 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.883+0000 7faead7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.883+0000 7faffab42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:24.882 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.883+0000 7faffab42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:24.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.883+0000 7faffab42800 5 note: GC not initialized 2024-09-12T00:31:24.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.883+0000 7fae27fff640 20 reqs_thread_entry: start 2024-09-12T00:31:24.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:24.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 20 Filter name: none 2024-09-12T00:31:24.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7fae25ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:24.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:31:24.883 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:24.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:31:24.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:31:24.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : miss 2024-09-12T00:31:24.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.884+0000 7faffab42800 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.885+0000 7faffab42800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:24.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.885+0000 7faffab42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:24.884 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.885+0000 7faffab42800 10 adding default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:24.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.885+0000 7faffab42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:24.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.885+0000 7faffab42800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.885 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.885+0000 7faffab42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:24.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.891+0000 7faffab42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:24.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.891+0000 7faffab42800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:24.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.891+0000 7faffab42800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.891+0000 7faffab42800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:24.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.891+0000 7faed9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94034838729904 notifier 8655 bl.length()=905 2024-09-12T00:31:24.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.891+0000 7faed9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:24.890 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.891+0000 7faed9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:24.891 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.891+0000 7faed9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:24.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.893+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:24.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.893+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:24.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.893+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:24.892 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.893+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:24.897 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:24.899+0000 7faffab42800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:31:25.786 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:25.786 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:25.848 INFO:tasks.workunit.client.0.smithi033.stderr:put object successful 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:29.898 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:29.899 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:29.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:29.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:29.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:29.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:29.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:29.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.0 2024-09-12T00:31:29.900 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.899+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.0 2024-09-12T00:31:29.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.900+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.1 2024-09-12T00:31:29.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.900+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.1 2024-09-12T00:31:29.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.900+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.2 2024-09-12T00:31:29.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.900+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.2 2024-09-12T00:31:29.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.901+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.3 2024-09-12T00:31:29.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.901+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.3 2024-09-12T00:31:29.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.902+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.4 2024-09-12T00:31:29.901 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.902+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.4 2024-09-12T00:31:29.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.903+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.5 2024-09-12T00:31:29.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.903+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.5 2024-09-12T00:31:29.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.903+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.6 2024-09-12T00:31:29.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.903+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.6 2024-09-12T00:31:29.902 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.904+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.7 2024-09-12T00:31:29.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.904+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.7 2024-09-12T00:31:29.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.905+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.8 2024-09-12T00:31:29.903 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.905+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.8 2024-09-12T00:31:29.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.906+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.9 2024-09-12T00:31:29.904 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.906+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.9 2024-09-12T00:31:29.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.907+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.10 2024-09-12T00:31:29.905 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.907+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.10 2024-09-12T00:31:29.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.907+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.11 2024-09-12T00:31:29.906 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.907+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.11 2024-09-12T00:31:29.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.910+0000 7faffab42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:29.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.910+0000 7faffab42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:29.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.912+0000 7faffab42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:29.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.912+0000 7faffab42800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:29.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.912+0000 7faffab42800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:29.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.912+0000 7faffab42800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:29.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.912+0000 7faeda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94034838729904 notifier 8655 bl.length()=905 2024-09-12T00:31:29.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.912+0000 7faeda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:29.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.912+0000 7faeda7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:29.911 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.912+0000 7faeda7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:29.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.914+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:29.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.914+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:29.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.914+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:29.913 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.914+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:29.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.919+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.0 2024-09-12T00:31:29.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.919+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.0 2024-09-12T00:31:29.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.920+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.1 2024-09-12T00:31:29.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.920+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.1 2024-09-12T00:31:29.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.921+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.2 2024-09-12T00:31:29.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.921+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.2 2024-09-12T00:31:29.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.921+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.3 2024-09-12T00:31:29.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.921+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.3 2024-09-12T00:31:29.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.921+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.4 2024-09-12T00:31:29.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.921+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.4 2024-09-12T00:31:29.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.922+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.5 2024-09-12T00:31:29.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.922+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.5 2024-09-12T00:31:29.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.922+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.6 2024-09-12T00:31:29.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.922+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.6 2024-09-12T00:31:29.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.923+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.7 2024-09-12T00:31:29.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.923+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.7 2024-09-12T00:31:29.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.923+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.8 2024-09-12T00:31:29.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.923+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.8 2024-09-12T00:31:29.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.924+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.9 2024-09-12T00:31:29.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.924+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.9 2024-09-12T00:31:29.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.924+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.10 2024-09-12T00:31:29.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.924+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.10 2024-09-12T00:31:29.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.925+0000 7faffab42800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.11 2024-09-12T00:31:29.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.925+0000 7faffab42800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.1.11 2024-09-12T00:31:29.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.926+0000 7faffab42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:29.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.926+0000 7faffab42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:29.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.928+0000 7faffab42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:29.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.928+0000 7faffab42800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:29.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.928+0000 7faffab42800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:29.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.928+0000 7faffab42800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:29.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.929+0000 7faed9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 94034838729904 notifier 8655 bl.length()=873 2024-09-12T00:31:29.927 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.929+0000 7faed9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:29.928 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.929+0000 7faed9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:29.928 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.929+0000 7faed9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:29.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.930+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:29.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.930+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:29.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.930+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:29.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.930+0000 7faffab42800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:29.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.933+0000 7faffab42800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T00:31:29.934 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.936+0000 7faead7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:29.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.938+0000 7faffab42800 20 remove_watcher() i=0 2024-09-12T00:31:29.937 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.938+0000 7faffab42800 2 removed watcher, disabling cache 2024-09-12T00:31:29.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.940+0000 7faffab42800 20 remove_watcher() i=1 2024-09-12T00:31:29.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.941+0000 7faffab42800 20 remove_watcher() i=2 2024-09-12T00:31:29.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.942+0000 7faffab42800 20 remove_watcher() i=3 2024-09-12T00:31:29.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.944+0000 7faffab42800 20 remove_watcher() i=4 2024-09-12T00:31:29.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.945+0000 7faffab42800 20 remove_watcher() i=5 2024-09-12T00:31:29.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.946+0000 7faffab42800 20 remove_watcher() i=6 2024-09-12T00:31:29.946 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:29.948+0000 7faffab42800 20 remove_watcher() i=7 2024-09-12T00:31:30.853 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:31:30.853 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T00:31:30.858 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:30.858 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:30.898 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:30.898 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:30.960 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:30.961 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:31.015 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:31.015 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:31.039 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:31.040 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:31.089 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:31.090 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:31.114 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:31.114 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:31.164 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:31.165 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:31.190 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:31:31.598 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:31:33.031 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:33.032 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:33.117 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:31:33.119 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:31:33.153 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:33.153 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:33.197 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.198+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.200+0000 7f291b020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.200+0000 7f291b020800 20 realm 2024-09-12T00:31:33.199 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.200+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.201+0000 7f291b020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.201+0000 7f291b020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:33.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.201+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.201+0000 7f291b020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.200 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.201+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.202+0000 7f291b020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:33.201 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.202+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.203+0000 7f291b020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:33.202 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.203+0000 7f291b020800 20 searching for the correct realm 2024-09-12T00:31:33.205 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.206+0000 7f2918310640 0 -- 172.21.15.33:0/2660977429 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x556b6d0d9b10 msgr2=0x556b6d0dbfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:33.209 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.211+0000 7f2918b11640 0 -- 172.21.15.33:0/2660977429 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f290c045410 msgr2=0x7f290c045890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:33.216 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:33.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:33.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:33.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:33.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:33.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:33.217 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:33.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.216+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:33.218 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 20 zone default found 2024-09-12T00:31:33.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 4 Realm: () 2024-09-12T00:31:33.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:33.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:33.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:33.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 20 zonegroup default 2024-09-12T00:31:33.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.219 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.217+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.218+0000 7f291b020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.218+0000 7f291b020800 20 started sync module instance, tier type = 2024-09-12T00:31:33.220 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.218+0000 7f291b020800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:33.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.228+0000 7f291b020800 20 add_watcher() i=0 2024-09-12T00:31:33.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.228+0000 7f291b020800 20 add_watcher() i=1 2024-09-12T00:31:33.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.228+0000 7f291b020800 20 add_watcher() i=2 2024-09-12T00:31:33.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.228+0000 7f291b020800 20 add_watcher() i=3 2024-09-12T00:31:33.227 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.228+0000 7f291b020800 20 add_watcher() i=4 2024-09-12T00:31:33.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.228+0000 7f291b020800 20 add_watcher() i=5 2024-09-12T00:31:33.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.228+0000 7f291b020800 20 add_watcher() i=6 2024-09-12T00:31:33.228 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.229+0000 7f291b020800 20 add_watcher() i=7 2024-09-12T00:31:33.229 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.229+0000 7f291b020800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:33.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.230+0000 7f27cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:33.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.231+0000 7f291b020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:33.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.231+0000 7f291b020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:33.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.231+0000 7f291b020800 5 note: GC not initialized 2024-09-12T00:31:33.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.231+0000 7f27cdfe3640 20 reqs_thread_entry: start 2024-09-12T00:31:33.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.231+0000 7f291b020800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:33.231 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.231+0000 7f291b020800 20 Filter name: none 2024-09-12T00:31:33.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.231+0000 7f273f7fe640 20 reqs_thread_entry: start 2024-09-12T00:31:33.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.231+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.232+0000 7f291b020800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:33.232 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.232+0000 7f291b020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:33.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:33.234 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:31:33.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 20 INFO: main: starting shard=0 2024-09-12T00:31:33.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:33.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:33.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 20 INFO: main: starting shard=1 2024-09-12T00:31:33.235 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:33.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.233+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:33.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.234+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.234+0000 7f291b020800 20 INFO: main: starting shard=2 2024-09-12T00:31:33.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.234+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:33.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.234+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:33.236 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.235+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.235+0000 7f291b020800 20 INFO: main: starting shard=3 2024-09-12T00:31:33.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.235+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:33.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.235+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:33.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.235+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.235+0000 7f291b020800 20 INFO: main: starting shard=4 2024-09-12T00:31:33.237 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.235+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:33.238 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.235+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:33.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.236+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.240 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.236+0000 7f291b020800 20 INFO: main: starting shard=5 2024-09-12T00:31:33.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.236+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:33.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.236+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:33.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.237+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:31:33.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.237+0000 7f291b020800 20 INFO: main: starting shard=6 2024-09-12T00:31:33.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.237+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:33.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.237+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:33.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.238+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.241 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.238+0000 7f291b020800 20 INFO: main: starting shard=7 2024-09-12T00:31:33.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.238+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:33.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.238+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:33.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.238+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.238+0000 7f291b020800 20 INFO: main: starting shard=8 2024-09-12T00:31:33.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.238+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:33.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.238+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:33.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.239+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.242 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.239+0000 7f291b020800 20 INFO: main: starting shard=9 2024-09-12T00:31:33.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.239+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:33.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.239+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:33.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.239+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.239+0000 7f291b020800 20 INFO: main: starting shard=10 2024-09-12T00:31:33.243 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.239+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:33.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.239+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:33.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.240+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.240+0000 7f291b020800 20 INFO: main: starting shard=11 2024-09-12T00:31:33.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.240+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:33.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.240+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:33.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.240+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.245 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.240+0000 7f291b020800 20 INFO: main: starting shard=12 2024-09-12T00:31:33.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.240+0000 7f291b020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:33.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.240+0000 7f291b020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:33.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.241+0000 7f291b020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.241+0000 7f291b020800 20 INFO: main: done 2024-09-12T00:31:33.246 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.242+0000 7f27cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:33.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.244+0000 7f291b020800 20 remove_watcher() i=0 2024-09-12T00:31:33.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.244+0000 7f291b020800 2 removed watcher, disabling cache 2024-09-12T00:31:33.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.246+0000 7f291b020800 20 remove_watcher() i=1 2024-09-12T00:31:33.247 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.247+0000 7f291b020800 20 remove_watcher() i=2 2024-09-12T00:31:33.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.248+0000 7f291b020800 20 remove_watcher() i=3 2024-09-12T00:31:33.248 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.250+0000 7f291b020800 20 remove_watcher() i=4 2024-09-12T00:31:33.249 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.250+0000 7f291b020800 20 remove_watcher() i=5 2024-09-12T00:31:33.250 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.251+0000 7f291b020800 20 remove_watcher() i=6 2024-09-12T00:31:33.251 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.253+0000 7f291b020800 20 remove_watcher() i=7 2024-09-12T00:31:33.266 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:33.266 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:33.290 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:33.291 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:33.372 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:31:33.373 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:31:33.405 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:33.405 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:33.445 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.446+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.448+0000 7fd7aa739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.448+0000 7fd7aa739800 20 realm 2024-09-12T00:31:33.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.448+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.448+0000 7fd7aa739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.448+0000 7fd7aa739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:33.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.448+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.448+0000 7fd7aa739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.447 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.448+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.449+0000 7fd7aa739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:33.448 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.449+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.450+0000 7fd7aa739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:33.449 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.450+0000 7fd7aa739800 20 searching for the correct realm 2024-09-12T00:31:33.452 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.453+0000 7fd7a6bc8640 0 -- 172.21.15.33:0/2458210468 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x561b50002f40 msgr2=0x561b50005400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:33.455 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.457+0000 7fd7a63c7640 0 -- 172.21.15.33:0/2458210468 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fd79c08b230 msgr2=0x7fd79c061670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:33.460 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:33.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:33.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:33.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:33.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:33.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:33.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.461 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:33.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.462+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:33.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 20 zone default found 2024-09-12T00:31:33.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 4 Realm: () 2024-09-12T00:31:33.462 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 20 zonegroup default 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.463+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.464+0000 7fd7aa739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.464+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.463 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.464+0000 7fd7aa739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.464+0000 7fd7aa739800 20 started sync module instance, tier type = 2024-09-12T00:31:33.464 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.464+0000 7fd7aa739800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:33.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.473+0000 7fd7aa739800 20 add_watcher() i=0 2024-09-12T00:31:33.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.473+0000 7fd7aa739800 20 add_watcher() i=1 2024-09-12T00:31:33.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.473+0000 7fd7aa739800 20 add_watcher() i=2 2024-09-12T00:31:33.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.473+0000 7fd7aa739800 20 add_watcher() i=3 2024-09-12T00:31:33.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.473+0000 7fd7aa739800 20 add_watcher() i=4 2024-09-12T00:31:33.472 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.473+0000 7fd7aa739800 20 add_watcher() i=5 2024-09-12T00:31:33.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.473+0000 7fd7aa739800 20 add_watcher() i=6 2024-09-12T00:31:33.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.474+0000 7fd7aa739800 20 add_watcher() i=7 2024-09-12T00:31:33.473 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.474+0000 7fd7aa739800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:33.475 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.476+0000 7fd65cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:33.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.477+0000 7fd7aa739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:33.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.477+0000 7fd7aa739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:33.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.477+0000 7fd7aa739800 5 note: GC not initialized 2024-09-12T00:31:33.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.477+0000 7fd5d77fe640 20 reqs_thread_entry: start 2024-09-12T00:31:33.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.477+0000 7fd7aa739800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:33.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.477+0000 7fd7aa739800 20 Filter name: none 2024-09-12T00:31:33.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.477+0000 7fd5d57fa640 20 reqs_thread_entry: start 2024-09-12T00:31:33.476 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.477+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.478+0000 7fd7aa739800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:33.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.478+0000 7fd7aa739800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.478+0000 7fd7aa739800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:33.477 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.478+0000 7fd7aa739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:33.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.478+0000 7fd7aa739800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:31:33.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.478+0000 7fd7aa739800 20 INFO: main: starting shard=0 2024-09-12T00:31:33.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.478+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:33.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.478+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:33.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.479+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.479+0000 7fd7aa739800 20 INFO: main: starting shard=1 2024-09-12T00:31:33.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.479+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:33.478 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.479+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:33.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.479+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.479+0000 7fd7aa739800 20 INFO: main: starting shard=2 2024-09-12T00:31:33.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.479+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:33.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.479+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:33.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.480+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.480+0000 7fd7aa739800 20 INFO: main: starting shard=3 2024-09-12T00:31:33.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.480+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:33.479 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.480+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:33.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.480+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.480+0000 7fd7aa739800 20 INFO: main: starting shard=4 2024-09-12T00:31:33.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:33.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:33.480 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 20 INFO: main: starting shard=5 2024-09-12T00:31:33.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:33.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:33.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 20 INFO: main: starting shard=6 2024-09-12T00:31:33.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:33.481 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.481+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:33.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.482+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.482+0000 7fd7aa739800 20 INFO: main: starting shard=7 2024-09-12T00:31:33.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.482+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:33.482 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.482+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 20 INFO: main: starting shard=8 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 20 INFO: main: starting shard=9 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.483+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 20 INFO: main: starting shard=10 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:33.483 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:33.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 20 INFO: main: starting shard=11 2024-09-12T00:31:33.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:33.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:33.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 20 INFO: main: starting shard=12 2024-09-12T00:31:33.484 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:33.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.484+0000 7fd7aa739800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:33.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.485+0000 7fd7aa739800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.485+0000 7fd7aa739800 20 INFO: main: done 2024-09-12T00:31:33.485 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.486+0000 7fd65cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:33.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.489+0000 7fd7aa739800 20 remove_watcher() i=0 2024-09-12T00:31:33.487 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.489+0000 7fd7aa739800 2 removed watcher, disabling cache 2024-09-12T00:31:33.489 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.490+0000 7fd7aa739800 20 remove_watcher() i=1 2024-09-12T00:31:33.490 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.491+0000 7fd7aa739800 20 remove_watcher() i=2 2024-09-12T00:31:33.491 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.492+0000 7fd7aa739800 20 remove_watcher() i=3 2024-09-12T00:31:33.492 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.493+0000 7fd7aa739800 20 remove_watcher() i=4 2024-09-12T00:31:33.493 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.494+0000 7fd7aa739800 20 remove_watcher() i=5 2024-09-12T00:31:33.494 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.495+0000 7fd7aa739800 20 remove_watcher() i=6 2024-09-12T00:31:33.495 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.496+0000 7fd7aa739800 20 remove_watcher() i=7 2024-09-12T00:31:33.508 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:33.508 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:33.533 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:33.533 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:33.613 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:31:33.614 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:31:33.646 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:33.646 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:33.685 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.686+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.688+0000 7f1c19020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.688+0000 7f1c19020800 20 realm 2024-09-12T00:31:33.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.688+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.688+0000 7f1c19020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.688+0000 7f1c19020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:33.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.688+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.687 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.688+0000 7f1c19020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.688+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.689+0000 7f1c19020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:33.688 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.689+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.690+0000 7f1c19020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:33.689 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.690+0000 7f1c19020800 20 searching for the correct realm 2024-09-12T00:31:33.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.692+0000 7f1c16b0a640 0 -- 172.21.15.33:0/2123524312 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f1c04003ab0 msgr2=0x7f1c10033910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:33.694 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.696+0000 7f1c16309640 0 -- 172.21.15.33:0/2123524312 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f1c08060070 msgr2=0x7f1c08057a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:33.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.701+0000 7f1c19020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:33.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.701+0000 7f1c19020800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:33.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.701+0000 7f1c19020800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:33.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.701+0000 7f1c19020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:33.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.701+0000 7f1c19020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:33.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.701+0000 7f1c19020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:33.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.701+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.701 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:33.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:33.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 20 zone default found 2024-09-12T00:31:33.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 4 Realm: () 2024-09-12T00:31:33.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:33.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:33.702 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 20 zonegroup default 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.702+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.703+0000 7f1c19020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.703+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.703+0000 7f1c19020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.703+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.703+0000 7f1c19020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.703+0000 7f1c19020800 20 started sync module instance, tier type = 2024-09-12T00:31:33.703 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.703+0000 7f1c19020800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:33.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.712+0000 7f1c19020800 20 add_watcher() i=0 2024-09-12T00:31:33.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.712+0000 7f1c19020800 20 add_watcher() i=1 2024-09-12T00:31:33.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.712+0000 7f1c19020800 20 add_watcher() i=2 2024-09-12T00:31:33.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.712+0000 7f1c19020800 20 add_watcher() i=3 2024-09-12T00:31:33.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.712+0000 7f1c19020800 20 add_watcher() i=4 2024-09-12T00:31:33.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.712+0000 7f1c19020800 20 add_watcher() i=5 2024-09-12T00:31:33.711 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.712+0000 7f1c19020800 20 add_watcher() i=6 2024-09-12T00:31:33.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.713+0000 7f1c19020800 20 add_watcher() i=7 2024-09-12T00:31:33.712 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.713+0000 7f1c19020800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:33.713 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.715+0000 7f1acd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:33.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.715+0000 7f1c19020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:33.715 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.715+0000 7f1c19020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.715+0000 7f1c19020800 5 note: GC not initialized 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.715+0000 7f1a47fff640 20 reqs_thread_entry: start 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.716+0000 7f1c19020800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.716+0000 7f1c19020800 20 Filter name: none 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.716+0000 7f1a45ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.716+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.716+0000 7f1c19020800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.716+0000 7f1c19020800 20 rados->read ofs=0 len=0 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:33.716 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:33.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:31:33.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 20 INFO: main: starting shard=0 2024-09-12T00:31:33.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:33.717 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 20 INFO: main: starting shard=1 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.717+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.718+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.718+0000 7f1c19020800 20 INFO: main: starting shard=2 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.718+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.718+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:33.718 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.719+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.719+0000 7f1c19020800 20 INFO: main: starting shard=3 2024-09-12T00:31:33.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.719+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:33.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.719+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:33.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.719+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.719+0000 7f1c19020800 20 INFO: main: starting shard=4 2024-09-12T00:31:33.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.719+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:33.719 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.719+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:33.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.720+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.720+0000 7f1c19020800 20 INFO: main: starting shard=5 2024-09-12T00:31:33.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.720+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:33.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.720+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:33.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.720+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.720+0000 7f1c19020800 20 INFO: main: starting shard=6 2024-09-12T00:31:33.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.720+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:33.720 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.720+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 INFO: main: starting shard=7 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 INFO: main: starting shard=8 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 INFO: main: starting shard=9 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:33.721 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.721+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:33.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.722+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.722+0000 7f1c19020800 20 INFO: main: starting shard=10 2024-09-12T00:31:33.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.722+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:33.722 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.722+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.723+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.723+0000 7f1c19020800 20 INFO: main: starting shard=11 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.723+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.723+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.723+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.723+0000 7f1c19020800 20 INFO: main: starting shard=12 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.723+0000 7f1c19020800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.723+0000 7f1c19020800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.724+0000 7f1c19020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:31:33.723 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.724+0000 7f1c19020800 20 INFO: main: done 2024-09-12T00:31:33.724 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.725+0000 7f1acd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:33.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.727+0000 7f1c19020800 20 remove_watcher() i=0 2024-09-12T00:31:33.725 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.727+0000 7f1c19020800 2 removed watcher, disabling cache 2024-09-12T00:31:33.727 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.728+0000 7f1c19020800 20 remove_watcher() i=1 2024-09-12T00:31:33.728 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.729+0000 7f1c19020800 20 remove_watcher() i=2 2024-09-12T00:31:33.729 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.730+0000 7f1c19020800 20 remove_watcher() i=3 2024-09-12T00:31:33.730 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.732+0000 7f1c19020800 20 remove_watcher() i=4 2024-09-12T00:31:33.731 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.733+0000 7f1c19020800 20 remove_watcher() i=5 2024-09-12T00:31:33.732 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.734+0000 7f1c19020800 20 remove_watcher() i=6 2024-09-12T00:31:33.733 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:33.735+0000 7f1c19020800 20 remove_watcher() i=7 2024-09-12T00:31:33.746 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:33.746 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:33.771 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:31:34.189 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:31:34.616 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:31:34.650 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:34.650 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:34.690 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.691+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.692+0000 7f34f4375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.692+0000 7f34f4375800 20 realm 2024-09-12T00:31:34.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.692+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.693+0000 7f34f4375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.693+0000 7f34f4375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:34.691 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.693+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.693+0000 7f34f4375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.693+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.694+0000 7f34f4375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:34.692 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.694+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.695+0000 7f34f4375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:34.693 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.695+0000 7f34f4375800 20 searching for the correct realm 2024-09-12T00:31:34.696 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.697+0000 7f34f165e640 0 -- 172.21.15.33:0/3916717519 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x558efeac1f50 msgr2=0x558efeac4360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:34.700 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.701+0000 7f34f1e5f640 0 -- 172.21.15.33:0/3916717519 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f34e8048a60 msgr2=0x7f34e8076820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:34.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.908+0000 7f34f4375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:34.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.908+0000 7f34f4375800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:34.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.908+0000 7f34f4375800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:34.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.908+0000 7f34f4375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:34.907 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.908+0000 7f34f4375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:34.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.908+0000 7f34f4375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:34.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.908+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.908 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 20 zone default found 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 4 Realm: () 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 20 zonegroup default 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.909+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.909 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.910+0000 7f34f4375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.910+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.910+0000 7f34f4375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.910+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.911+0000 7f34f4375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.911+0000 7f34f4375800 20 started sync module instance, tier type = 2024-09-12T00:31:34.910 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.911+0000 7f34f4375800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:34.919 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.921+0000 7f34f4375800 20 add_watcher() i=0 2024-09-12T00:31:34.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.921+0000 7f34f4375800 20 add_watcher() i=1 2024-09-12T00:31:34.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.921+0000 7f34f4375800 20 add_watcher() i=2 2024-09-12T00:31:34.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.921+0000 7f34f4375800 20 add_watcher() i=3 2024-09-12T00:31:34.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.921+0000 7f34f4375800 20 add_watcher() i=4 2024-09-12T00:31:34.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.921+0000 7f34f4375800 20 add_watcher() i=5 2024-09-12T00:31:34.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.921+0000 7f34f4375800 20 add_watcher() i=6 2024-09-12T00:31:34.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.922+0000 7f34f4375800 20 add_watcher() i=7 2024-09-12T00:31:34.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.922+0000 7f34f4375800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:34.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.924+0000 7f33a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:34.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.924+0000 7f34f4375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:34.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.924+0000 7f34f4375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:34.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.924+0000 7f34f4375800 5 note: GC not initialized 2024-09-12T00:31:34.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.924+0000 7f33a27fc640 20 reqs_thread_entry: start 2024-09-12T00:31:34.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.924+0000 7f34f4375800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:34.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.924+0000 7f34f4375800 20 Filter name: none 2024-09-12T00:31:34.923 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.925+0000 7f3313fff640 20 reqs_thread_entry: start 2024-09-12T00:31:34.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.925+0000 7f34f4375800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:31:34.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.925+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.925+0000 7f34f4375800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:34.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.925+0000 7f34f4375800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:31:34.924 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.925+0000 7f34f4375800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:31:34.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.925+0000 7f34f4375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : miss 2024-09-12T00:31:34.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.925+0000 7f34f4375800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.926+0000 7f34f4375800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:34.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.926+0000 7f34f4375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:34.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.926+0000 7f34f4375800 10 adding default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:34.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.926+0000 7f34f4375800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:34.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.926+0000 7f34f4375800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:34.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.926+0000 7f34f4375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:34.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.932+0000 7f34f4375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:34.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.932+0000 7f34f4375800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:34.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.932+0000 7f34f4375800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:34.930 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.932+0000 7f34f4375800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:34.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.932+0000 7f33d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366282 cookie 94072646418944 notifier 8763 bl.length()=905 2024-09-12T00:31:34.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.932+0000 7f33d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:34.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.932+0000 7f33d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:34.931 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.932+0000 7f33d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:34.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.934+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:34.932 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.934+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:34.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.934+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:34.933 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.934+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:34.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.0 2024-09-12T00:31:34.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.0 2024-09-12T00:31:34.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.1 2024-09-12T00:31:34.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.1 2024-09-12T00:31:34.938 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.2 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.2 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.3 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.3 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.4 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.4 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.5 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.5 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.6 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.6 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.7 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.7 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.8 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.8 2024-09-12T00:31:34.939 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.10 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.10 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.11 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.11 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.12 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.12 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.13 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.13 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.14 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.14 2024-09-12T00:31:34.940 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.15 2024-09-12T00:31:34.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.15 2024-09-12T00:31:34.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.16 2024-09-12T00:31:34.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.16 2024-09-12T00:31:34.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:34.941 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.939+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.940+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.940+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.941+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.941+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.941+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.941+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.942+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.942+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:34.942 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.942+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:34.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.942+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:34.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.943+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:34.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.943+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:34.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.943+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:34.943 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.943+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:34.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.944+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:34.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.944+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:34.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.944+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:34.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.944+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:34.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.945+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:34.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.945+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:34.944 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.945+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.945+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.946+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:34.945 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.946+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:34.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.948+0000 7f34f4375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:34.947 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.949+0000 7f34f4375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:34.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.950+0000 7f34f4375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:34.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.950+0000 7f34f4375800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:34.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.950+0000 7f34f4375800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:34.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.950+0000 7f34f4375800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:34.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.950+0000 7f33d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366283 cookie 94072646418944 notifier 8763 bl.length()=905 2024-09-12T00:31:34.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.950+0000 7f33d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:34.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.950+0000 7f33d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:34.949 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.950+0000 7f33d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:34.950 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.952+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:34.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.952+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:34.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.952+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:34.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.952+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:34.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.955+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:34.953 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.955+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.0 2024-09-12T00:31:34.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.955+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:34.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.955+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.1 2024-09-12T00:31:34.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.956+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:34.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.956+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.2 2024-09-12T00:31:34.954 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.956+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:34.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.956+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.3 2024-09-12T00:31:34.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.956+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:34.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.956+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.4 2024-09-12T00:31:34.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.957+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:34.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.957+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.5 2024-09-12T00:31:34.955 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.957+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:34.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.957+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.6 2024-09-12T00:31:34.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.957+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:34.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.957+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.7 2024-09-12T00:31:34.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.958+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:34.956 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.958+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.8 2024-09-12T00:31:34.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.958+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:34.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.958+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.9 2024-09-12T00:31:34.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.958+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:34.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.958+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.10 2024-09-12T00:31:34.957 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.959+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:34.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.959+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.11 2024-09-12T00:31:34.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.959+0000 7f34f4375800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:34.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.959+0000 7f34f4375800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.2.12 2024-09-12T00:31:34.958 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.959+0000 7f34f4375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:34.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.959+0000 7f34f4375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:34.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.961+0000 7f34f4375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:34.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.961+0000 7f34f4375800 10 moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:34.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.961+0000 7f34f4375800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:34.959 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.961+0000 7f34f4375800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19, ofs0, ns] 2024-09-12T00:31:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.961+0000 7f33d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366284 cookie 94072646418944 notifier 8763 bl.length()=873 2024-09-12T00:31:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.961+0000 7f33d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.961+0000 7f33d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:34.960 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.961+0000 7f33d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:34.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.963+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_sources= new_sources= 2024-09-12T00:31:34.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.963+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential sources added=[] removed=[] 2024-09-12T00:31:34.961 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.963+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): orig_dests= new_dests= 2024-09-12T00:31:34.962 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.963+0000 7f34f4375800 20 handle_bi_update(): bucket=:myver[46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19]): potential dests added=[] removed=[] 2024-09-12T00:31:34.964 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.965+0000 7f34f4375800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T00:31:34.966 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.967+0000 7f33a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:34.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.969+0000 7f34f4375800 20 remove_watcher() i=0 2024-09-12T00:31:34.968 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.969+0000 7f34f4375800 2 removed watcher, disabling cache 2024-09-12T00:31:34.969 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.971+0000 7f34f4375800 20 remove_watcher() i=1 2024-09-12T00:31:34.971 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.973+0000 7f34f4375800 20 remove_watcher() i=2 2024-09-12T00:31:34.972 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.974+0000 7f34f4375800 20 remove_watcher() i=3 2024-09-12T00:31:34.973 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.975+0000 7f34f4375800 20 remove_watcher() i=4 2024-09-12T00:31:34.975 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.977+0000 7f34f4375800 20 remove_watcher() i=5 2024-09-12T00:31:34.977 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.978+0000 7f34f4375800 20 remove_watcher() i=6 2024-09-12T00:31:34.978 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:34.979+0000 7f34f4375800 20 remove_watcher() i=7 2024-09-12T00:31:34.990 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:31:35.026 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:35.026 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:35.066 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.067+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.069+0000 7fc0d452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.069+0000 7fc0d452c800 20 realm 2024-09-12T00:31:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.069+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.069+0000 7fc0d452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.069+0000 7fc0d452c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.069+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.069+0000 7fc0d452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.068 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.069+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.070+0000 7fc0d452c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:35.069 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.070+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.071+0000 7fc0d452c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:35.070 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.071+0000 7fc0d452c800 20 searching for the correct realm 2024-09-12T00:31:35.072 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.074+0000 7fc0d0946640 0 -- 172.21.15.33:0/3223543988 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5567f0f6a4b0 msgr2=0x5567f0f6c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:35.076 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.078+0000 7fc0d0145640 0 -- 172.21.15.33:0/3223543988 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fc0c40893d0 msgr2=0x7fc0c4009cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:35.080 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:35.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:35.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:35.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:35.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:35.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:35.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.081 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:35.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.082+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:35.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 20 zone default found 2024-09-12T00:31:35.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 4 Realm: () 2024-09-12T00:31:35.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:35.083 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 20 zonegroup default 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.083+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.084+0000 7fc0d452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.084+0000 7fc0d452c800 20 started sync module instance, tier type = 2024-09-12T00:31:35.084 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.084+0000 7fc0d452c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:35.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.093+0000 7fc0d452c800 20 add_watcher() i=0 2024-09-12T00:31:35.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.093+0000 7fc0d452c800 20 add_watcher() i=1 2024-09-12T00:31:35.091 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.093+0000 7fc0d452c800 20 add_watcher() i=2 2024-09-12T00:31:35.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.093+0000 7fc0d452c800 20 add_watcher() i=3 2024-09-12T00:31:35.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.093+0000 7fc0d452c800 20 add_watcher() i=4 2024-09-12T00:31:35.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.093+0000 7fc0d452c800 20 add_watcher() i=5 2024-09-12T00:31:35.092 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.093+0000 7fc0d452c800 20 add_watcher() i=6 2024-09-12T00:31:35.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.095+0000 7fc0d452c800 20 add_watcher() i=7 2024-09-12T00:31:35.093 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.095+0000 7fc0d452c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:35.095 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.097+0000 7fbf86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:35.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.097+0000 7fc0d452c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:35.096 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.097+0000 7fc0d452c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:35.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.097+0000 7fc0d452c800 5 note: GC not initialized 2024-09-12T00:31:35.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.097+0000 7fbf85fdb640 20 reqs_thread_entry: start 2024-09-12T00:31:35.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:35.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 20 Filter name: none 2024-09-12T00:31:35.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fbef77fe640 20 reqs_thread_entry: start 2024-09-12T00:31:35.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:31:35.097 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 : miss 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.098+0000 7fc0d452c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 info.flags=0x17 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 10 adding default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 to cache LRU end 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19 2024-09-12T00:31:35.099 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.0 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.0 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.1 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.099+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.1 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.2 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.2 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.3 2024-09-12T00:31:35.100 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.3 2024-09-12T00:31:35.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:31:35.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.4 2024-09-12T00:31:35.101 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.100+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.4 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.101+0000 7fc0d452c800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.101+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.5 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.101+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.5 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.101+0000 7fc0d452c800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.101+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.6 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.101+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.6 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.102+0000 7fc0d452c800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.102+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.7 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.102+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.7 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.102+0000 7fc0d452c800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.102+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.8 2024-09-12T00:31:35.102 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.102+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.8 2024-09-12T00:31:35.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.103+0000 7fc0d452c800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:31:35.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.103+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.103+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.103 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.104+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.10 2024-09-12T00:31:35.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.104+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.10 2024-09-12T00:31:35.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.104+0000 7fc0d452c800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:31:35.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.104+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.11 2024-09-12T00:31:35.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.104+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.11 2024-09-12T00:31:35.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.104+0000 7fc0d452c800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:31:35.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.104+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.12 2024-09-12T00:31:35.104 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.104+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.12 2024-09-12T00:31:35.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.105+0000 7fc0d452c800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:31:35.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.105+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.13 2024-09-12T00:31:35.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.105+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.13 2024-09-12T00:31:35.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.106+0000 7fc0d452c800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:31:35.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.106+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.14 2024-09-12T00:31:35.105 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.106+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.14 2024-09-12T00:31:35.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.107+0000 7fc0d452c800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:31:35.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.107+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.15 2024-09-12T00:31:35.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.107+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.15 2024-09-12T00:31:35.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.107+0000 7fc0d452c800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:31:35.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.107+0000 7fc0d452c800 10 bucket_obj is .dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.16 2024-09-12T00:31:35.106 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.107+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.16 2024-09-12T00:31:35.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.108+0000 7fc0d452c800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:31:35.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.108+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.108+0000 7fc0d452c800 20 get_obj_state: octx=0x5567f0cd2690 obj=myver:x state=0x5567f0f97988 s->prefetch_data=0 2024-09-12T00:31:35.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.108+0000 7fc0d452c800 20 get_obj_state: setting s->obj_tag to 0fmbu1c027nts5bwj5yhszjbvqjo2s2q 2024-09-12T00:31:35.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.108+0000 7fc0d452c800 20 get_obj_state_impl: setting s->olh_tag to kb6sla8zmk2lf1nmrsv75ziivpc4h82x 2024-09-12T00:31:35.107 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.108+0000 7fc0d452c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kb6sla8zmk2lf1nmrsv75ziivpc4h82x 2024-09-12T00:31:35.108 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.109+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.109 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.111+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.111+0000 7fc0d452c800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:31:35.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.111+0000 7fc0d452c800 20 olh_log_entry: epoch=2 op=3 key=x[LCtAGst8IrH7zZ4IOqi6HbFcK3Fgg24] 2024-09-12T00:31:35.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.111+0000 7fc0d452c800 20 get_obj_state: octx=0x5567f0cd2690 obj=myver:_:LCtAGst8IrH7zZ4IOqi6HbFcK3Fgg24_x state=0x5567f0fd9c68 s->prefetch_data=0 2024-09-12T00:31:35.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.112+0000 7fc0d452c800 10 manifest: total_size = 9 2024-09-12T00:31:35.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.112+0000 7fc0d452c800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16656517094754468533 2024-09-12T00:31:35.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.112+0000 7fc0d452c800 20 get_obj_state: octx=0x5567f0cd2690 obj=myver:_:LCtAGst8IrH7zZ4IOqi6HbFcK3Fgg24_x state=0x5567f0fd9c68 s->prefetch_data=0 2024-09-12T00:31:35.110 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.112+0000 7fc0d452c800 20 prepare_atomic_modification: state is not atomic. state=0x5567f0fd9c68 2024-09-12T00:31:35.111 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.112+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.114 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.116+0000 7fc0d452c800 20 get_obj_state: octx=0x5567f0cd2690 obj=myver:x state=0x5567f0f97988 s->prefetch_data=0 2024-09-12T00:31:35.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.116+0000 7fc0d452c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kb6sla8zmk2lf1nmrsv75ziivpc4h82x 2024-09-12T00:31:35.115 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.116+0000 7fbfa6ffd640 20 handle_completion(): completion ok for obj=x[LCtAGst8IrH7zZ4IOqi6HbFcK3Fgg24] 2024-09-12T00:31:35.117 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.118+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.118 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.120+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.120+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.120+0000 7fc0d452c800 20 get_obj_state: octx=0x5567f0cd2690 obj=myver:y state=0x5567f0fdd4a8 s->prefetch_data=0 2024-09-12T00:31:35.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.121+0000 7fc0d452c800 20 get_obj_state: setting s->obj_tag to redl2wstdbfgfkbab9fo36i7bolbjo9s 2024-09-12T00:31:35.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.121+0000 7fc0d452c800 20 get_obj_state_impl: setting s->olh_tag to ytji5fm3z66df5tvzytso1n1xpfyh3dv 2024-09-12T00:31:35.119 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.121+0000 7fc0d452c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ytji5fm3z66df5tvzytso1n1xpfyh3dv 2024-09-12T00:31:35.121 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.122+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.122 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:31:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 20 olh_log_entry: epoch=2 op=3 key=y[MTijev.NWQe3BIO83niCimNk1Cf67nM] 2024-09-12T00:31:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 20 get_obj_state: octx=0x5567f0cd2690 obj=myver:_:MTijev.NWQe3BIO83niCimNk1Cf67nM_y state=0x5567f0f98488 s->prefetch_data=0 2024-09-12T00:31:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 10 manifest: total_size = 12 2024-09-12T00:31:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15732657054688655214 2024-09-12T00:31:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 20 get_obj_state: octx=0x5567f0cd2690 obj=myver:_:MTijev.NWQe3BIO83niCimNk1Cf67nM_y state=0x5567f0f98488 s->prefetch_data=0 2024-09-12T00:31:35.123 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 20 prepare_atomic_modification: state is not atomic. state=0x5567f0f98488 2024-09-12T00:31:35.124 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.124+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.126 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.128+0000 7fbfa6ffd640 20 handle_completion(): completion ok for obj=y[MTijev.NWQe3BIO83niCimNk1Cf67nM] 2024-09-12T00:31:35.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.128+0000 7fc0d452c800 20 get_obj_state: octx=0x5567f0cd2690 obj=myver:y state=0x5567f0fdd4a8 s->prefetch_data=0 2024-09-12T00:31:35.127 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.128+0000 7fc0d452c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ytji5fm3z66df5tvzytso1n1xpfyh3dv 2024-09-12T00:31:35.129 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.130+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.130 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.132+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.132+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.132+0000 7fc0d452c800 20 get_obj_state: octx=0x7fc0c4003190 obj=myver:z state=0x5567f0fdd4a8 s->prefetch_data=0 2024-09-12T00:31:35.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.132+0000 7fc0d452c800 20 get_obj_state: setting s->obj_tag to erer4vxl685wh2mt3w99qzopsi954l1q 2024-09-12T00:31:35.131 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.132+0000 7fc0d452c800 20 get_obj_state_impl: setting s->olh_tag to iyqfm90kdchvcl7v3wi6c8at12a8hw6u 2024-09-12T00:31:35.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.132+0000 7fc0d452c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iyqfm90kdchvcl7v3wi6c8at12a8hw6u 2024-09-12T00:31:35.132 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.134+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.133 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.135+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.135+0000 7fc0d452c800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:31:35.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.135+0000 7fc0d452c800 20 olh_log_entry: epoch=2 op=3 key=z[XgBGmlXPMLX2wpEuyaQQjZNflJ65kUv] 2024-09-12T00:31:35.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.135+0000 7fc0d452c800 20 get_obj_state: octx=0x7fc0c4003190 obj=myver:_:XgBGmlXPMLX2wpEuyaQQjZNflJ65kUv_z state=0x5567f0fd7458 s->prefetch_data=0 2024-09-12T00:31:35.134 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.136+0000 7fc0d452c800 10 manifest: total_size = 11 2024-09-12T00:31:35.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.136+0000 7fc0d452c800 20 get_obj_state: setting s->obj_tag to 46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5538184402387476452 2024-09-12T00:31:35.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.136+0000 7fc0d452c800 20 get_obj_state: octx=0x7fc0c4003190 obj=myver:_:XgBGmlXPMLX2wpEuyaQQjZNflJ65kUv_z state=0x5567f0fd7458 s->prefetch_data=0 2024-09-12T00:31:35.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.136+0000 7fc0d452c800 20 prepare_atomic_modification: state is not atomic. state=0x5567f0fd7458 2024-09-12T00:31:35.135 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.136+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.139+0000 7fbfa77fe640 20 handle_completion(): completion ok for obj=z[XgBGmlXPMLX2wpEuyaQQjZNflJ65kUv] 2024-09-12T00:31:35.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.139+0000 7fc0d452c800 20 get_obj_state: octx=0x7fc0c4003190 obj=myver:z state=0x5567f0fdd4a8 s->prefetch_data=0 2024-09-12T00:31:35.138 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.139+0000 7fc0d452c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iyqfm90kdchvcl7v3wi6c8at12a8hw6u 2024-09-12T00:31:35.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.142+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.143+0000 7fc0d452c800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.19.3.9 2024-09-12T00:31:35.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.143+0000 7fc0d452c800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:31:35.142 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.143+0000 7fc0d452c800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:31:35.143 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.144+0000 7fbf86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:35.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.146+0000 7fc0d452c800 20 remove_watcher() i=0 2024-09-12T00:31:35.145 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.146+0000 7fc0d452c800 2 removed watcher, disabling cache 2024-09-12T00:31:35.146 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.148+0000 7fc0d452c800 20 remove_watcher() i=1 2024-09-12T00:31:35.147 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.149+0000 7fc0d452c800 20 remove_watcher() i=2 2024-09-12T00:31:35.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.150+0000 7fc0d452c800 20 remove_watcher() i=3 2024-09-12T00:31:35.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.151+0000 7fc0d452c800 20 remove_watcher() i=4 2024-09-12T00:31:35.150 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.151+0000 7fc0d452c800 20 remove_watcher() i=5 2024-09-12T00:31:35.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.152+0000 7fc0d452c800 20 remove_watcher() i=6 2024-09-12T00:31:35.152 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.153+0000 7fc0d452c800 20 remove_watcher() i=7 2024-09-12T00:31:35.165 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:35.165 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:35.205 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:35.205 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:35.303 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:31:35.332 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:35.332 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:35.371 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.372+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.373 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.375+0000 7fb743b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.375+0000 7fb743b0c800 20 realm 2024-09-12T00:31:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.375+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.375+0000 7fb743b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.375+0000 7fb743b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.375+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.375+0000 7fb743b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.375+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.374 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.376+0000 7fb743b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:35.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.376+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.377+0000 7fb743b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:35.375 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.377+0000 7fb743b0c800 20 searching for the correct realm 2024-09-12T00:31:35.378 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.380+0000 7fb740df5640 0 -- 172.21.15.33:0/4251508970 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x55c0c88be0c0 msgr2=0x55c0c88c0560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:35.381 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.383+0000 7fb7415f6640 0 -- 172.21.15.33:0/4251508970 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fb7380449b0 msgr2=0x7fb738033420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:35.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:35.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:35.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:35.387 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 zone default found 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 4 Realm: () 2024-09-12T00:31:35.388 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:35.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:35.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:35.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 zonegroup default 2024-09-12T00:31:35.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.388+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.389+0000 7fb743b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.389 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.389+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.389+0000 7fb743b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.389+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.389+0000 7fb743b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.390 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.389+0000 7fb743b0c800 20 started sync module instance, tier type = 2024-09-12T00:31:35.391 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.389+0000 7fb743b0c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:35.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.398+0000 7fb743b0c800 20 add_watcher() i=0 2024-09-12T00:31:35.396 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.398+0000 7fb743b0c800 20 add_watcher() i=1 2024-09-12T00:31:35.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.398+0000 7fb743b0c800 20 add_watcher() i=2 2024-09-12T00:31:35.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.398+0000 7fb743b0c800 20 add_watcher() i=3 2024-09-12T00:31:35.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.398+0000 7fb743b0c800 20 add_watcher() i=4 2024-09-12T00:31:35.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.398+0000 7fb743b0c800 20 add_watcher() i=5 2024-09-12T00:31:35.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.398+0000 7fb743b0c800 20 add_watcher() i=6 2024-09-12T00:31:35.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.399+0000 7fb743b0c800 20 add_watcher() i=7 2024-09-12T00:31:35.397 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.399+0000 7fb743b0c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:35.399 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.400+0000 7fb5f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.400+0000 7fb743b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.400+0000 7fb743b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.401+0000 7fb743b0c800 5 note: GC not initialized 2024-09-12T00:31:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.401+0000 7fb5f67e4640 20 reqs_thread_entry: start 2024-09-12T00:31:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.401+0000 7fb743b0c800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.401+0000 7fb743b0c800 20 Filter name: none 2024-09-12T00:31:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.401+0000 7fb567fff640 20 reqs_thread_entry: start 2024-09-12T00:31:35.400 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.401+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.402+0000 7fb743b0c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:35.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.402+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.401 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.402+0000 7fb743b0c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:35.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.402+0000 7fb743b0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:35.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.402+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.402+0000 7fb743b0c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:35.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.402+0000 7fb743b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.403+0000 7fb743b0c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:35.402 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.403+0000 7fb743b0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:35.403 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.405+0000 7fb5f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:35.405 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.407+0000 7fb743b0c800 20 remove_watcher() i=0 2024-09-12T00:31:35.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.407+0000 7fb743b0c800 2 removed watcher, disabling cache 2024-09-12T00:31:35.406 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.408+0000 7fb743b0c800 20 remove_watcher() i=1 2024-09-12T00:31:35.407 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.409+0000 7fb743b0c800 20 remove_watcher() i=2 2024-09-12T00:31:35.409 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.411+0000 7fb743b0c800 20 remove_watcher() i=3 2024-09-12T00:31:35.410 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.412+0000 7fb743b0c800 20 remove_watcher() i=4 2024-09-12T00:31:35.411 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.413+0000 7fb743b0c800 20 remove_watcher() i=5 2024-09-12T00:31:35.412 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.414+0000 7fb743b0c800 20 remove_watcher() i=6 2024-09-12T00:31:35.413 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T00:31:35.415+0000 7fb743b0c800 20 remove_watcher() i=7 2024-09-12T00:31:35.424 INFO:tasks.workunit.client.0.smithi033.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:31:35.425 INFO:tasks.workunit.client.0.smithi033.stderr:Deleting bucket a-bucket 2024-09-12T00:31:35.426 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:35.426 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:35.451 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:35.451 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:35.509 INFO:tasks.workunit.client.0.smithi033.stderr:Deleting bucket myver 2024-09-12T00:31:35.510 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:35.510 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:35.584 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:31:35.585 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T00:31:35.751 INFO:tasks.workunit.client.0.smithi033.stderr:Completed resharding tests 2024-09-12T00:31:35.751 INFO:tasks.workunit.client.0.smithi033.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:31:35.751 INFO:tasks.workunit.client.0.smithi033.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:31:35.751 INFO:tasks.workunit.client.0.smithi033.stdout:connected to https://localhost:443 2024-09-12T00:31:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:+ deactivate 2024-09-12T00:31:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:31:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:31:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:+ export PATH 2024-09-12T00:31:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:31:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n '' ']' 2024-09-12T00:31:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:31:35.832 INFO:tasks.workunit.client.0.smithi033.stderr:+ hash -r 2024-09-12T00:31:35.833 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n '' ']' 2024-09-12T00:31:35.833 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:31:35.833 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:31:35.833 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset -f deactivate 2024-09-12T00:31:35.833 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo OK. 2024-09-12T00:31:35.834 INFO:tasks.workunit.client.0.smithi033.stdout:OK. 2024-09-12T00:31:35.834 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:31:35.835 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:31:35.915 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:31:35.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:31:36.353 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:36.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:36.393 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:36.394 DEBUG:teuthology.orchestra.run.smithi033:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:36.463 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:36.464 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:31:36.480 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:31:36.481 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:31:36.481 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:31:36.481 DEBUG:teuthology.orchestra.run.smithi033:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:31:36.533 INFO:teuthology.orchestra.run.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:31:41.655 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:31:41.655 DEBUG:teuthology.orchestra.run.smithi033:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:31:43.790 INFO:teuthology.orchestra.run.smithi033.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T00:31:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:32:13 ago on Wed 11 Sep 2024 11:59:31 PM UTC. 2024-09-12T00:31:44.534 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-12T00:31:44.535 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-12T00:31:44.535 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-09-12T00:31:44.535 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-12T00:31:44.535 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-09-12T00:31:44.535 INFO:teuthology.orchestra.run.smithi033.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T00:31:44.535 INFO:teuthology.orchestra.run.smithi033.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T00:31:44.535 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-09-12T00:31:44.536 INFO:teuthology.orchestra.run.smithi033.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T00:31:44.536 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-09-12T00:31:44.536 INFO:teuthology.orchestra.run.smithi033.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T00:31:44.536 INFO:teuthology.orchestra.run.smithi033.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T00:31:44.536 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:44.536 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-09-12T00:31:44.536 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-09-12T00:31:44.536 INFO:teuthology.orchestra.run.smithi033.stdout:Install 5 Packages 2024-09-12T00:31:44.537 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:44.537 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 46 M 2024-09-12T00:31:44.537 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 166 M 2024-09-12T00:31:44.537 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-09-12T00:31:45.600 INFO:teuthology.orchestra.run.smithi033.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 457 kB/s | 426 kB 00:00 2024-09-12T00:31:45.892 INFO:teuthology.orchestra.run.smithi033.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 2.9 MB/s | 3.5 MB 00:01 2024-09-12T00:31:46.109 INFO:teuthology.orchestra.run.smithi033.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 6.5 MB/s | 9.3 MB 00:01 2024-09-12T00:31:46.509 INFO:teuthology.orchestra.run.smithi033.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 43 kB/s | 26 kB 00:00 2024-09-12T00:31:47.743 INFO:teuthology.orchestra.run.smithi033.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 15 MB/s | 32 MB 00:02 2024-09-12T00:31:47.743 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:31:47.744 INFO:teuthology.orchestra.run.smithi033.stdout:Total 14 MB/s | 46 MB 00:03 2024-09-12T00:31:48.186 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-09-12T00:31:48.210 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-09-12T00:31:48.210 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-09-12T00:31:48.714 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-09-12T00:31:48.714 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-09-12T00:31:49.254 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T00:31:49.409 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-09-12T00:31:49.600 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T00:31:50.239 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T00:31:50.286 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:31:50.541 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:31:50.571 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:31:50.813 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:31:50.850 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:31:50.858 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:31:50.867 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T00:31:50.902 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T00:31:53.644 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:31:53.645 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T00:31:53.645 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T00:31:53.645 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T00:31:53.645 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:54.031 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-12T00:31:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:31:54.546 INFO:teuthology.orchestra.run.smithi033.stderr:--2024-09-12 00:31:54-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:31:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T00:31:54.696 INFO:teuthology.orchestra.run.smithi033.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T00:31:54.798 INFO:teuthology.orchestra.run.smithi033.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:31:54.798 INFO:teuthology.orchestra.run.smithi033.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:31:54.798 INFO:teuthology.orchestra.run.smithi033.stderr:--2024-09-12 00:31:54-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:31:54.798 INFO:teuthology.orchestra.run.smithi033.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-12T00:31:54.808 INFO:teuthology.orchestra.run.smithi033.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-12T00:31:54.946 INFO:teuthology.orchestra.run.smithi033.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:31:54.946 INFO:teuthology.orchestra.run.smithi033.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T003154Z&X-Amz-Expires=300&X-Amz-Signature=634cf487bc5e97f37baa0ef827ba658b2e9de325f81637020e9453b9fa0d72f4&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:31:54.946 INFO:teuthology.orchestra.run.smithi033.stderr:--2024-09-12 00:31:54-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T003154Z&X-Amz-Expires=300&X-Amz-Signature=634cf487bc5e97f37baa0ef827ba658b2e9de325f81637020e9453b9fa0d72f4&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:31:54.946 INFO:teuthology.orchestra.run.smithi033.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.109.133, 185.199.111.133, ... 2024-09-12T00:31:54.958 INFO:teuthology.orchestra.run.smithi033.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T00:31:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:31:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:31:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T00:31:55.038 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T00:31:55.052 INFO:teuthology.orchestra.run.smithi033.stderr: 0K .......... .......... .......... .......... .......... 0% 3.22M 28s 2024-09-12T00:31:55.065 INFO:teuthology.orchestra.run.smithi033.stderr: 50K .......... .......... .......... .......... .......... 0% 3.76M 26s 2024-09-12T00:31:55.075 INFO:teuthology.orchestra.run.smithi033.stderr: 100K .......... .......... .......... .......... .......... 0% 4.96M 24s 2024-09-12T00:31:55.077 INFO:teuthology.orchestra.run.smithi033.stderr: 150K .......... .......... .......... .......... .......... 0% 22.4M 19s 2024-09-12T00:31:55.079 INFO:teuthology.orchestra.run.smithi033.stderr: 200K .......... .......... .......... .......... .......... 0% 22.3M 16s 2024-09-12T00:31:55.086 INFO:teuthology.orchestra.run.smithi033.stderr: 250K .......... .......... .......... .......... .......... 0% 25.6M 14s 2024-09-12T00:31:55.088 INFO:teuthology.orchestra.run.smithi033.stderr: 300K .......... .......... .......... .......... .......... 0% 6.87M 14s 2024-09-12T00:31:55.090 INFO:teuthology.orchestra.run.smithi033.stderr: 350K .......... .......... .......... .......... .......... 0% 42.6M 12s 2024-09-12T00:31:55.091 INFO:teuthology.orchestra.run.smithi033.stderr: 400K .......... .......... .......... .......... .......... 0% 33.8M 11s 2024-09-12T00:31:55.091 INFO:teuthology.orchestra.run.smithi033.stderr: 450K .......... .......... .......... .......... .......... 0% 85.6M 10s 2024-09-12T00:31:55.092 INFO:teuthology.orchestra.run.smithi033.stderr: 500K .......... .......... .......... .......... .......... 0% 49.6M 9s 2024-09-12T00:31:55.094 INFO:teuthology.orchestra.run.smithi033.stderr: 550K .......... .......... .......... .......... .......... 0% 45.1M 9s 2024-09-12T00:31:55.098 INFO:teuthology.orchestra.run.smithi033.stderr: 600K .......... .......... .......... .......... .......... 0% 11.0M 9s 2024-09-12T00:31:55.102 INFO:teuthology.orchestra.run.smithi033.stderr: 650K .......... .......... .......... .......... .......... 0% 34.2M 8s 2024-09-12T00:31:55.102 INFO:teuthology.orchestra.run.smithi033.stderr: 700K .......... .......... .......... .......... .......... 0% 42.9M 8s 2024-09-12T00:31:55.103 INFO:teuthology.orchestra.run.smithi033.stderr: 750K .......... .......... .......... .......... .......... 0% 51.9M 7s 2024-09-12T00:31:55.103 INFO:teuthology.orchestra.run.smithi033.stderr: 800K .......... .......... .......... .......... .......... 0% 73.2M 7s 2024-09-12T00:31:55.109 INFO:teuthology.orchestra.run.smithi033.stderr: 850K .......... .......... .......... .......... .......... 0% 52.5M 7s 2024-09-12T00:31:55.109 INFO:teuthology.orchestra.run.smithi033.stderr: 900K .......... .......... .......... .......... .......... 1% 185M 6s 2024-09-12T00:31:55.109 INFO:teuthology.orchestra.run.smithi033.stderr: 950K .......... .......... .......... .......... .......... 1% 112M 6s 2024-09-12T00:31:55.109 INFO:teuthology.orchestra.run.smithi033.stderr: 1000K .......... .......... .......... .......... .......... 1% 69.4M 6s 2024-09-12T00:31:55.109 INFO:teuthology.orchestra.run.smithi033.stderr: 1050K .......... .......... .......... .......... .......... 1% 85.2M 6s 2024-09-12T00:31:55.109 INFO:teuthology.orchestra.run.smithi033.stderr: 1100K .......... .......... .......... .......... .......... 1% 78.8M 5s 2024-09-12T00:31:55.109 INFO:teuthology.orchestra.run.smithi033.stderr: 1150K .......... .......... .......... .......... .......... 1% 278M 5s 2024-09-12T00:31:55.109 INFO:teuthology.orchestra.run.smithi033.stderr: 1200K .......... .......... .......... .......... .......... 1% 85.0M 5s 2024-09-12T00:31:55.111 INFO:teuthology.orchestra.run.smithi033.stderr: 1250K .......... .......... .......... .......... .......... 1% 12.7M 5s 2024-09-12T00:31:56.555 INFO:teuthology.orchestra.run.smithi033.stderr: 1300K .......... .......... .......... .......... .......... 1% 27.6M 5s 2024-09-12T00:31:56.555 INFO:teuthology.orchestra.run.smithi033.stderr: 1350K .......... .......... .......... .......... .......... 1% 83.3M 5s 2024-09-12T00:31:56.555 INFO:teuthology.orchestra.run.smithi033.stderr: 1400K .......... .......... .......... .......... .......... 1% 338M 5s 2024-09-12T00:31:56.555 INFO:teuthology.orchestra.run.smithi033.stderr: 1450K .......... .......... .......... .......... .......... 1% 196M 5s 2024-09-12T00:31:56.555 INFO:teuthology.orchestra.run.smithi033.stderr: 1500K .......... .......... .......... .......... .......... 1% 87.9M 5s 2024-09-12T00:31:56.555 INFO:teuthology.orchestra.run.smithi033.stderr: 1550K .......... .......... .......... .......... .......... 1% 148M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 1600K .......... .......... .......... .......... .......... 1% 139M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 1650K .......... .......... .......... .......... .......... 1% 322M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 1700K .......... .......... .......... .......... .......... 1% 111M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 1750K .......... .......... .......... .......... .......... 1% 133M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 1800K .......... .......... .......... .......... .......... 1% 139M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 1850K .......... .......... .......... .......... .......... 2% 329M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 1900K .......... .......... .......... .......... .......... 2% 73.5M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 1950K .......... .......... .......... .......... .......... 2% 204M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 2000K .......... .......... .......... .......... .......... 2% 234M 4s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 2050K .......... .......... .......... .......... .......... 2% 181M 3s 2024-09-12T00:31:56.556 INFO:teuthology.orchestra.run.smithi033.stderr: 2100K .......... .......... .......... .......... .......... 2% 280M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2150K .......... .......... .......... .......... .......... 2% 165M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2200K .......... .......... .......... .......... .......... 2% 168M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2250K .......... .......... .......... .......... .......... 2% 159M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2300K .......... .......... .......... .......... .......... 2% 164M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2350K .......... .......... .......... .......... .......... 2% 332M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2400K .......... .......... .......... .......... .......... 2% 211M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2450K .......... .......... .......... .......... .......... 2% 182M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2500K .......... .......... .......... .......... .......... 2% 15.3M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2550K .......... .......... .......... .......... .......... 2% 241M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2600K .......... .......... .......... .......... .......... 2% 368M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2650K .......... .......... .......... .......... .......... 2% 33.6M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2700K .......... .......... .......... .......... .......... 2% 284M 3s 2024-09-12T00:31:56.557 INFO:teuthology.orchestra.run.smithi033.stderr: 2750K .......... .......... .......... .......... .......... 3% 103M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 2800K .......... .......... .......... .......... .......... 3% 300M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 2850K .......... .......... .......... .......... .......... 3% 325M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 2900K .......... .......... .......... .......... .......... 3% 222M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 2950K .......... .......... .......... .......... .......... 3% 339M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 3000K .......... .......... .......... .......... .......... 3% 359M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 3050K .......... .......... .......... .......... .......... 3% 218M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 3100K .......... .......... .......... .......... .......... 3% 189M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 3150K .......... .......... .......... .......... .......... 3% 259M 3s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 3200K .......... .......... .......... .......... .......... 3% 272M 2s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 3250K .......... .......... .......... .......... .......... 3% 322M 2s 2024-09-12T00:31:56.558 INFO:teuthology.orchestra.run.smithi033.stderr: 3300K .......... .......... .......... .......... .......... 3% 236M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3350K .......... .......... .......... .......... .......... 3% 251M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3400K .......... .......... .......... .......... .......... 3% 326M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3450K .......... .......... .......... .......... .......... 3% 270M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3500K .......... .......... .......... .......... .......... 3% 248M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3550K .......... .......... .......... .......... .......... 3% 236M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3600K .......... .......... .......... .......... .......... 3% 318M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3650K .......... .......... .......... .......... .......... 3% 292M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3700K .......... .......... .......... .......... .......... 4% 305M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3750K .......... .......... .......... .......... .......... 4% 349M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3800K .......... .......... .......... .......... .......... 4% 298M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3850K .......... .......... .......... .......... .......... 4% 355M 2s 2024-09-12T00:31:56.559 INFO:teuthology.orchestra.run.smithi033.stderr: 3900K .......... .......... .......... .......... .......... 4% 229M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 3950K .......... .......... .......... .......... .......... 4% 340M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4000K .......... .......... .......... .......... .......... 4% 356M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4050K .......... .......... .......... .......... .......... 4% 227M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4100K .......... .......... .......... .......... .......... 4% 302M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4150K .......... .......... .......... .......... .......... 4% 361M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4200K .......... .......... .......... .......... .......... 4% 324M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4250K .......... .......... .......... .......... .......... 4% 373M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4300K .......... .......... .......... .......... .......... 4% 226M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4350K .......... .......... .......... .......... .......... 4% 277M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4400K .......... .......... .......... .......... .......... 4% 336M 2s 2024-09-12T00:31:56.560 INFO:teuthology.orchestra.run.smithi033.stderr: 4450K .......... .......... .......... .......... .......... 4% 345M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4500K .......... .......... .......... .......... .......... 4% 321M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4550K .......... .......... .......... .......... .......... 4% 355M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4600K .......... .......... .......... .......... .......... 5% 349M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4650K .......... .......... .......... .......... .......... 5% 363M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4700K .......... .......... .......... .......... .......... 5% 304M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4750K .......... .......... .......... .......... .......... 5% 336M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4800K .......... .......... .......... .......... .......... 5% 356M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4850K .......... .......... .......... .......... .......... 5% 312M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4900K .......... .......... .......... .......... .......... 5% 316M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 4950K .......... .......... .......... .......... .......... 5% 357M 2s 2024-09-12T00:31:56.561 INFO:teuthology.orchestra.run.smithi033.stderr: 5000K .......... .......... .......... .......... .......... 5% 373M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5050K .......... .......... .......... .......... .......... 5% 22.4M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5100K .......... .......... .......... .......... .......... 5% 278M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5150K .......... .......... .......... .......... .......... 5% 365M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5200K .......... .......... .......... .......... .......... 5% 367M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5250K .......... .......... .......... .......... .......... 5% 365M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5300K .......... .......... .......... .......... .......... 5% 39.5M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5350K .......... .......... .......... .......... .......... 5% 350M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5400K .......... .......... .......... .......... .......... 5% 322M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5450K .......... .......... .......... .......... .......... 5% 358M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5500K .......... .......... .......... .......... .......... 5% 312M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5550K .......... .......... .......... .......... .......... 6% 325M 2s 2024-09-12T00:31:56.562 INFO:teuthology.orchestra.run.smithi033.stderr: 5600K .......... .......... .......... .......... .......... 6% 357M 2s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 5650K .......... .......... .......... .......... .......... 6% 356M 2s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 5700K .......... .......... .......... .......... .......... 6% 324M 2s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 5750K .......... .......... .......... .......... .......... 6% 331M 2s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 5800K .......... .......... .......... .......... .......... 6% 344M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 5850K .......... .......... .......... .......... .......... 6% 327M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 5900K .......... .......... .......... .......... .......... 6% 223M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 5950K .......... .......... .......... .......... .......... 6% 362M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 6000K .......... .......... .......... .......... .......... 6% 365M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 6050K .......... .......... .......... .......... .......... 6% 360M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 6100K .......... .......... .......... .......... .......... 6% 332M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 6150K .......... .......... .......... .......... .......... 6% 356M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 6200K .......... .......... .......... .......... .......... 6% 369M 1s 2024-09-12T00:31:56.563 INFO:teuthology.orchestra.run.smithi033.stderr: 6250K .......... .......... .......... .......... .......... 6% 367M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6300K .......... .......... .......... .......... .......... 6% 231M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6350K .......... .......... .......... .......... .......... 6% 377M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6400K .......... .......... .......... .......... .......... 6% 351M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6450K .......... .......... .......... .......... .......... 6% 372M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6500K .......... .......... .......... .......... .......... 7% 329M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6550K .......... .......... .......... .......... .......... 7% 381M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6600K .......... .......... .......... .......... .......... 7% 366M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6650K .......... .......... .......... .......... .......... 7% 324M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6700K .......... .......... .......... .......... .......... 7% 105M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6750K .......... .......... .......... .......... .......... 7% 308M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6800K .......... .......... .......... .......... .......... 7% 362M 1s 2024-09-12T00:31:56.564 INFO:teuthology.orchestra.run.smithi033.stderr: 6850K .......... .......... .......... .......... .......... 7% 368M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 6900K .......... .......... .......... .......... .......... 7% 106M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 6950K .......... .......... .......... .......... .......... 7% 330M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7000K .......... .......... .......... .......... .......... 7% 337M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7050K .......... .......... .......... .......... .......... 7% 358M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7100K .......... .......... .......... .......... .......... 7% 280M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7150K .......... .......... .......... .......... .......... 7% 350M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7200K .......... .......... .......... .......... .......... 7% 350M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7250K .......... .......... .......... .......... .......... 7% 333M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7300K .......... .......... .......... .......... .......... 7% 321M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7350K .......... .......... .......... .......... .......... 7% 315M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7400K .......... .......... .......... .......... .......... 8% 363M 1s 2024-09-12T00:31:56.565 INFO:teuthology.orchestra.run.smithi033.stderr: 7450K .......... .......... .......... .......... .......... 8% 360M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7500K .......... .......... .......... .......... .......... 8% 304M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7550K .......... .......... .......... .......... .......... 8% 360M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7600K .......... .......... .......... .......... .......... 8% 362M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7650K .......... .......... .......... .......... .......... 8% 365M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7700K .......... .......... .......... .......... .......... 8% 336M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7750K .......... .......... .......... .......... .......... 8% 374M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7800K .......... .......... .......... .......... .......... 8% 367M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7850K .......... .......... .......... .......... .......... 8% 364M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7900K .......... .......... .......... .......... .......... 8% 305M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 7950K .......... .......... .......... .......... .......... 8% 365M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 8000K .......... .......... .......... .......... .......... 8% 382M 1s 2024-09-12T00:31:56.566 INFO:teuthology.orchestra.run.smithi033.stderr: 8050K .......... .......... .......... .......... .......... 8% 25.4M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8100K .......... .......... .......... .......... .......... 8% 191M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8150K .......... .......... .......... .......... .......... 8% 372M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8200K .......... .......... .......... .......... .......... 8% 50.5M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8250K .......... .......... .......... .......... .......... 8% 356M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8300K .......... .......... .......... .......... .......... 8% 288M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8350K .......... .......... .......... .......... .......... 9% 360M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8400K .......... .......... .......... .......... .......... 9% 353M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8450K .......... .......... .......... .......... .......... 9% 124M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8500K .......... .......... .......... .......... .......... 9% 322M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8550K .......... .......... .......... .......... .......... 9% 352M 1s 2024-09-12T00:31:56.567 INFO:teuthology.orchestra.run.smithi033.stderr: 8600K .......... .......... .......... .......... .......... 9% 359M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 8650K .......... .......... .......... .......... .......... 9% 338M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 8700K .......... .......... .......... .......... .......... 9% 288M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 8750K .......... .......... .......... .......... .......... 9% 371M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 8800K .......... .......... .......... .......... .......... 9% 368M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 8850K .......... .......... .......... .......... .......... 9% 374M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 8900K .......... .......... .......... .......... .......... 9% 176M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 8950K .......... .......... .......... .......... .......... 9% 345M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 9000K .......... .......... .......... .......... .......... 9% 361M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 9050K .......... .......... .......... .......... .......... 9% 372M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 9100K .......... .......... .......... .......... .......... 9% 308M 1s 2024-09-12T00:31:56.568 INFO:teuthology.orchestra.run.smithi033.stderr: 9150K .......... .......... .......... .......... .......... 9% 362M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9200K .......... .......... .......... .......... .......... 9% 378M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9250K .......... .......... .......... .......... .......... 10% 370M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9300K .......... .......... .......... .......... .......... 10% 314M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9350K .......... .......... .......... .......... .......... 10% 374M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9400K .......... .......... .......... .......... .......... 10% 241M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9450K .......... .......... .......... .......... .......... 10% 349M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9500K .......... .......... .......... .......... .......... 10% 305M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9550K .......... .......... .......... .......... .......... 10% 380M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9600K .......... .......... .......... .......... .......... 10% 373M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9650K .......... .......... .......... .......... .......... 10% 335M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9700K .......... .......... .......... .......... .......... 10% 151M 1s 2024-09-12T00:31:56.569 INFO:teuthology.orchestra.run.smithi033.stderr: 9750K .......... .......... .......... .......... .......... 10% 90.6M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 9800K .......... .......... .......... .......... .......... 10% 337M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 9850K .......... .......... .......... .......... .......... 10% 306M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 9900K .......... .......... .......... .......... .......... 10% 298M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 9950K .......... .......... .......... .......... .......... 10% 240M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 10000K .......... .......... .......... .......... .......... 10% 295M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 10050K .......... .......... .......... .......... .......... 10% 277M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 10100K .......... .......... .......... .......... .......... 10% 255M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 10150K .......... .......... .......... .......... .......... 10% 360M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 10200K .......... .......... .......... .......... .......... 11% 348M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 10250K .......... .......... .......... .......... .......... 11% 399M 1s 2024-09-12T00:31:56.570 INFO:teuthology.orchestra.run.smithi033.stderr: 10300K .......... .......... .......... .......... .......... 11% 425M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10350K .......... .......... .......... .......... .......... 11% 221M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10400K .......... .......... .......... .......... .......... 11% 259M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10450K .......... .......... .......... .......... .......... 11% 279M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10500K .......... .......... .......... .......... .......... 11% 284M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10550K .......... .......... .......... .......... .......... 11% 99.3M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10600K .......... .......... .......... .......... .......... 11% 337M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10650K .......... .......... .......... .......... .......... 11% 360M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10700K .......... .......... .......... .......... .......... 11% 261M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10750K .......... .......... .......... .......... .......... 11% 367M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10800K .......... .......... .......... .......... .......... 11% 375M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10850K .......... .......... .......... .......... .......... 11% 368M 1s 2024-09-12T00:31:56.571 INFO:teuthology.orchestra.run.smithi033.stderr: 10900K .......... .......... .......... .......... .......... 11% 345M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 10950K .......... .......... .......... .......... .......... 11% 370M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11000K .......... .......... .......... .......... .......... 11% 321M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11050K .......... .......... .......... .......... .......... 11% 343M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11100K .......... .......... .......... .......... .......... 12% 306M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11150K .......... .......... .......... .......... .......... 12% 64.5M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11200K .......... .......... .......... .......... .......... 12% 25.8M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11250K .......... .......... .......... .......... .......... 12% 258M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11300K .......... .......... .......... .......... .......... 12% 331M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11350K .......... .......... .......... .......... .......... 12% 373M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11400K .......... .......... .......... .......... .......... 12% 365M 1s 2024-09-12T00:31:56.572 INFO:teuthology.orchestra.run.smithi033.stderr: 11450K .......... .......... .......... .......... .......... 12% 362M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11500K .......... .......... .......... .......... .......... 12% 289M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11550K .......... .......... .......... .......... .......... 12% 379M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11600K .......... .......... .......... .......... .......... 12% 360M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11650K .......... .......... .......... .......... .......... 12% 365M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11700K .......... .......... .......... .......... .......... 12% 344M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11750K .......... .......... .......... .......... .......... 12% 271M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11800K .......... .......... .......... .......... .......... 12% 352M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11850K .......... .......... .......... .......... .......... 12% 360M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11900K .......... .......... .......... .......... .......... 12% 315M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 11950K .......... .......... .......... .......... .......... 12% 377M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 12000K .......... .......... .......... .......... .......... 12% 235M 1s 2024-09-12T00:31:56.573 INFO:teuthology.orchestra.run.smithi033.stderr: 12050K .......... .......... .......... .......... .......... 13% 372M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12100K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12150K .......... .......... .......... .......... .......... 13% 260M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12200K .......... .......... .......... .......... .......... 13% 363M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12250K .......... .......... .......... .......... .......... 13% 365M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12300K .......... .......... .......... .......... .......... 13% 277M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12350K .......... .......... .......... .......... .......... 13% 279M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12400K .......... .......... .......... .......... .......... 13% 330M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12450K .......... .......... .......... .......... .......... 13% 359M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12500K .......... .......... .......... .......... .......... 13% 315M 1s 2024-09-12T00:31:56.574 INFO:teuthology.orchestra.run.smithi033.stderr: 12550K .......... .......... .......... .......... .......... 13% 366M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 12600K .......... .......... .......... .......... .......... 13% 299M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 12650K .......... .......... .......... .......... .......... 13% 368M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 12700K .......... .......... .......... .......... .......... 13% 366M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 12750K .......... .......... .......... .......... .......... 13% 363M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 12800K .......... .......... .......... .......... .......... 13% 188M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 12850K .......... .......... .......... .......... .......... 13% 252M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 12900K .......... .......... .......... .......... .......... 13% 168M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 12950K .......... .......... .......... .......... .......... 13% 131M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 13000K .......... .......... .......... .......... .......... 14% 327M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 13050K .......... .......... .......... .......... .......... 14% 359M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 13100K .......... .......... .......... .......... .......... 14% 314M 1s 2024-09-12T00:31:56.575 INFO:teuthology.orchestra.run.smithi033.stderr: 13150K .......... .......... .......... .......... .......... 14% 371M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13200K .......... .......... .......... .......... .......... 14% 325M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13250K .......... .......... .......... .......... .......... 14% 326M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13300K .......... .......... .......... .......... .......... 14% 325M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13350K .......... .......... .......... .......... .......... 14% 268M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13400K .......... .......... .......... .......... .......... 14% 177M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13450K .......... .......... .......... .......... .......... 14% 361M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13500K .......... .......... .......... .......... .......... 14% 302M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13550K .......... .......... .......... .......... .......... 14% 371M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13600K .......... .......... .......... .......... .......... 14% 207M 1s 2024-09-12T00:31:56.576 INFO:teuthology.orchestra.run.smithi033.stderr: 13650K .......... .......... .......... .......... .......... 14% 119M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 13700K .......... .......... .......... .......... .......... 14% 335M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 13750K .......... .......... .......... .......... .......... 14% 346M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 13800K .......... .......... .......... .......... .......... 14% 89.0M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 13850K .......... .......... .......... .......... .......... 14% 370M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 13900K .......... .......... .......... .......... .......... 15% 314M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 13950K .......... .......... .......... .......... .......... 15% 376M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 14000K .......... .......... .......... .......... .......... 15% 372M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 14050K .......... .......... .......... .......... .......... 15% 386M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 14100K .......... .......... .......... .......... .......... 15% 321M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 14150K .......... .......... .......... .......... .......... 15% 188M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 14200K .......... .......... .......... .......... .......... 15% 373M 1s 2024-09-12T00:31:56.577 INFO:teuthology.orchestra.run.smithi033.stderr: 14250K .......... .......... .......... .......... .......... 15% 378M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14300K .......... .......... .......... .......... .......... 15% 25.0M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14350K .......... .......... .......... .......... .......... 15% 373M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14400K .......... .......... .......... .......... .......... 15% 361M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14450K .......... .......... .......... .......... .......... 15% 359M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14500K .......... .......... .......... .......... .......... 15% 325M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14550K .......... .......... .......... .......... .......... 15% 369M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14600K .......... .......... .......... .......... .......... 15% 278M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14650K .......... .......... .......... .......... .......... 15% 366M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14700K .......... .......... .......... .......... .......... 15% 164M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14750K .......... .......... .......... .......... .......... 15% 335M 1s 2024-09-12T00:31:56.578 INFO:teuthology.orchestra.run.smithi033.stderr: 14800K .......... .......... .......... .......... .......... 15% 370M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 14850K .......... .......... .......... .......... .......... 16% 364M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 14900K .......... .......... .......... .......... .......... 16% 339M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 14950K .......... .......... .......... .......... .......... 16% 381M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15000K .......... .......... .......... .......... .......... 16% 385M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15050K .......... .......... .......... .......... .......... 16% 382M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15100K .......... .......... .......... .......... .......... 16% 292M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15150K .......... .......... .......... .......... .......... 16% 357M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15200K .......... .......... .......... .......... .......... 16% 388M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15250K .......... .......... .......... .......... .......... 16% 101M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15300K .......... .......... .......... .......... .......... 16% 331M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15350K .......... .......... .......... .......... .......... 16% 325M 1s 2024-09-12T00:31:56.579 INFO:teuthology.orchestra.run.smithi033.stderr: 15400K .......... .......... .......... .......... .......... 16% 356M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15450K .......... .......... .......... .......... .......... 16% 369M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15500K .......... .......... .......... .......... .......... 16% 308M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15550K .......... .......... .......... .......... .......... 16% 374M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15600K .......... .......... .......... .......... .......... 16% 370M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15650K .......... .......... .......... .......... .......... 16% 365M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15700K .......... .......... .......... .......... .......... 16% 327M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15750K .......... .......... .......... .......... .......... 17% 360M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15800K .......... .......... .......... .......... .......... 17% 371M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15850K .......... .......... .......... .......... .......... 17% 371M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15900K .......... .......... .......... .......... .......... 17% 289M 1s 2024-09-12T00:31:56.580 INFO:teuthology.orchestra.run.smithi033.stderr: 15950K .......... .......... .......... .......... .......... 17% 296M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16000K .......... .......... .......... .......... .......... 17% 124M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16050K .......... .......... .......... .......... .......... 17% 324M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16100K .......... .......... .......... .......... .......... 17% 349M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16150K .......... .......... .......... .......... .......... 17% 388M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16200K .......... .......... .......... .......... .......... 17% 293M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16250K .......... .......... .......... .......... .......... 17% 378M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16300K .......... .......... .......... .......... .......... 17% 229M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16350K .......... .......... .......... .......... .......... 17% 301M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16400K .......... .......... .......... .......... .......... 17% 121M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16450K .......... .......... .......... .......... .......... 17% 154M 1s 2024-09-12T00:31:56.581 INFO:teuthology.orchestra.run.smithi033.stderr: 16500K .......... .......... .......... .......... .......... 17% 310M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16550K .......... .......... .......... .......... .......... 17% 373M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16600K .......... .......... .......... .......... .......... 17% 386M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16650K .......... .......... .......... .......... .......... 17% 372M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16700K .......... .......... .......... .......... .......... 18% 327M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16750K .......... .......... .......... .......... .......... 18% 254M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16800K .......... .......... .......... .......... .......... 18% 377M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16850K .......... .......... .......... .......... .......... 18% 91.8M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16900K .......... .......... .......... .......... .......... 18% 292M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 16950K .......... .......... .......... .......... .......... 18% 192M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 17000K .......... .......... .......... .......... .......... 18% 351M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 17050K .......... .......... .......... .......... .......... 18% 250M 1s 2024-09-12T00:31:56.582 INFO:teuthology.orchestra.run.smithi033.stderr: 17100K .......... .......... .......... .......... .......... 18% 309M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17150K .......... .......... .......... .......... .......... 18% 179M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17200K .......... .......... .......... .......... .......... 18% 340M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17250K .......... .......... .......... .......... .......... 18% 382M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17300K .......... .......... .......... .......... .......... 18% 67.9M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17350K .......... .......... .......... .......... .......... 18% 47.1M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17400K .......... .......... .......... .......... .......... 18% 71.5M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17450K .......... .......... .......... .......... .......... 18% 342M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17500K .......... .......... .......... .......... .......... 18% 286M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17550K .......... .......... .......... .......... .......... 18% 354M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17600K .......... .......... .......... .......... .......... 18% 366M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17650K .......... .......... .......... .......... .......... 19% 349M 1s 2024-09-12T00:31:56.583 INFO:teuthology.orchestra.run.smithi033.stderr: 17700K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 17750K .......... .......... .......... .......... .......... 19% 380M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 17800K .......... .......... .......... .......... .......... 19% 376M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 17850K .......... .......... .......... .......... .......... 19% 262M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 17900K .......... .......... .......... .......... .......... 19% 239M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 17950K .......... .......... .......... .......... .......... 19% 362M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 18000K .......... .......... .......... .......... .......... 19% 294M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 18050K .......... .......... .......... .......... .......... 19% 270M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 18100K .......... .......... .......... .......... .......... 19% 302M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 18150K .......... .......... .......... .......... .......... 19% 381M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 18200K .......... .......... .......... .......... .......... 19% 389M 1s 2024-09-12T00:31:56.584 INFO:teuthology.orchestra.run.smithi033.stderr: 18250K .......... .......... .......... .......... .......... 19% 388M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18300K .......... .......... .......... .......... .......... 19% 193M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18350K .......... .......... .......... .......... .......... 19% 337M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18400K .......... .......... .......... .......... .......... 19% 219M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18450K .......... .......... .......... .......... .......... 19% 380M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18500K .......... .......... .......... .......... .......... 19% 341M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18550K .......... .......... .......... .......... .......... 20% 372M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18600K .......... .......... .......... .......... .......... 20% 342M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18650K .......... .......... .......... .......... .......... 20% 367M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18700K .......... .......... .......... .......... .......... 20% 323M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18750K .......... .......... .......... .......... .......... 20% 374M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18800K .......... .......... .......... .......... .......... 20% 386M 1s 2024-09-12T00:31:56.585 INFO:teuthology.orchestra.run.smithi033.stderr: 18850K .......... .......... .......... .......... .......... 20% 365M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 18900K .......... .......... .......... .......... .......... 20% 348M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 18950K .......... .......... .......... .......... .......... 20% 366M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19000K .......... .......... .......... .......... .......... 20% 380M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19050K .......... .......... .......... .......... .......... 20% 374M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19100K .......... .......... .......... .......... .......... 20% 224M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19150K .......... .......... .......... .......... .......... 20% 277M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19200K .......... .......... .......... .......... .......... 20% 289M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19250K .......... .......... .......... .......... .......... 20% 355M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19300K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19350K .......... .......... .......... .......... .......... 20% 357M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19400K .......... .......... .......... .......... .......... 20% 381M 1s 2024-09-12T00:31:56.586 INFO:teuthology.orchestra.run.smithi033.stderr: 19450K .......... .......... .......... .......... .......... 20% 260M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19500K .......... .......... .......... .......... .......... 21% 171M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19550K .......... .......... .......... .......... .......... 21% 98.0M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19600K .......... .......... .......... .......... .......... 21% 355M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19650K .......... .......... .......... .......... .......... 21% 378M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19700K .......... .......... .......... .......... .......... 21% 341M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19750K .......... .......... .......... .......... .......... 21% 357M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19800K .......... .......... .......... .......... .......... 21% 251M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19850K .......... .......... .......... .......... .......... 21% 409M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19900K .......... .......... .......... .......... .......... 21% 98.1M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 19950K .......... .......... .......... .......... .......... 21% 372M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 20000K .......... .......... .......... .......... .......... 21% 238M 1s 2024-09-12T00:31:56.587 INFO:teuthology.orchestra.run.smithi033.stderr: 20050K .......... .......... .......... .......... .......... 21% 216M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20100K .......... .......... .......... .......... .......... 21% 285M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20150K .......... .......... .......... .......... .......... 21% 270M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20200K .......... .......... .......... .......... .......... 21% 231M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20250K .......... .......... .......... .......... .......... 21% 266M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20300K .......... .......... .......... .......... .......... 21% 90.5M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20350K .......... .......... .......... .......... .......... 21% 250M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20400K .......... .......... .......... .......... .......... 22% 50.6M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20450K .......... .......... .......... .......... .......... 22% 61.2M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20500K .......... .......... .......... .......... .......... 22% 123M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20550K .......... .......... .......... .......... .......... 22% 304M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20600K .......... .......... .......... .......... .......... 22% 347M 1s 2024-09-12T00:31:56.588 INFO:teuthology.orchestra.run.smithi033.stderr: 20650K .......... .......... .......... .......... .......... 22% 382M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 20700K .......... .......... .......... .......... .......... 22% 217M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 20750K .......... .......... .......... .......... .......... 22% 351M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 20800K .......... .......... .......... .......... .......... 22% 355M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 20850K .......... .......... .......... .......... .......... 22% 342M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 20900K .......... .......... .......... .......... .......... 22% 323M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 20950K .......... .......... .......... .......... .......... 22% 373M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 21000K .......... .......... .......... .......... .......... 22% 360M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 21050K .......... .......... .......... .......... .......... 22% 368M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 21100K .......... .......... .......... .......... .......... 22% 258M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 21150K .......... .......... .......... .......... .......... 22% 330M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 21200K .......... .......... .......... .......... .......... 22% 105M 1s 2024-09-12T00:31:56.589 INFO:teuthology.orchestra.run.smithi033.stderr: 21250K .......... .......... .......... .......... .......... 22% 359M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21300K .......... .......... .......... .......... .......... 22% 335M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21350K .......... .......... .......... .......... .......... 23% 378M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21400K .......... .......... .......... .......... .......... 23% 386M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21450K .......... .......... .......... .......... .......... 23% 349M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21500K .......... .......... .......... .......... .......... 23% 316M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21550K .......... .......... .......... .......... .......... 23% 377M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21600K .......... .......... .......... .......... .......... 23% 371M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21650K .......... .......... .......... .......... .......... 23% 380M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21700K .......... .......... .......... .......... .......... 23% 339M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21750K .......... .......... .......... .......... .......... 23% 377M 1s 2024-09-12T00:31:56.590 INFO:teuthology.orchestra.run.smithi033.stderr: 21800K .......... .......... .......... .......... .......... 23% 358M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 21850K .......... .......... .......... .......... .......... 23% 369M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 21900K .......... .......... .......... .......... .......... 23% 295M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 21950K .......... .......... .......... .......... .......... 23% 370M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22000K .......... .......... .......... .......... .......... 23% 385M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22050K .......... .......... .......... .......... .......... 23% 389M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22100K .......... .......... .......... .......... .......... 23% 329M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22150K .......... .......... .......... .......... .......... 23% 394M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22200K .......... .......... .......... .......... .......... 23% 372M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22250K .......... .......... .......... .......... .......... 24% 187M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22300K .......... .......... .......... .......... .......... 24% 309M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22350K .......... .......... .......... .......... .......... 24% 383M 1s 2024-09-12T00:31:56.591 INFO:teuthology.orchestra.run.smithi033.stderr: 22400K .......... .......... .......... .......... .......... 24% 386M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22450K .......... .......... .......... .......... .......... 24% 367M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22500K .......... .......... .......... .......... .......... 24% 318M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22550K .......... .......... .......... .......... .......... 24% 349M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22600K .......... .......... .......... .......... .......... 24% 331M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22650K .......... .......... .......... .......... .......... 24% 116M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22700K .......... .......... .......... .......... .......... 24% 274M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22750K .......... .......... .......... .......... .......... 24% 308M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22800K .......... .......... .......... .......... .......... 24% 367M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22850K .......... .......... .......... .......... .......... 24% 385M 1s 2024-09-12T00:31:56.592 INFO:teuthology.orchestra.run.smithi033.stderr: 22900K .......... .......... .......... .......... .......... 24% 106M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 22950K .......... .......... .......... .......... .......... 24% 357M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23000K .......... .......... .......... .......... .......... 24% 257M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23050K .......... .......... .......... .......... .......... 24% 363M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23100K .......... .......... .......... .......... .......... 24% 159M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23150K .......... .......... .......... .......... .......... 24% 356M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23200K .......... .......... .......... .......... .......... 25% 217M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23250K .......... .......... .......... .......... .......... 25% 301M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23300K .......... .......... .......... .......... .......... 25% 300M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23350K .......... .......... .......... .......... .......... 25% 387M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23400K .......... .......... .......... .......... .......... 25% 85.9M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23450K .......... .......... .......... .......... .......... 25% 39.7M 1s 2024-09-12T00:31:56.593 INFO:teuthology.orchestra.run.smithi033.stderr: 23500K .......... .......... .......... .......... .......... 25% 110M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23550K .......... .......... .......... .......... .......... 25% 118M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23600K .......... .......... .......... .......... .......... 25% 248M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23650K .......... .......... .......... .......... .......... 25% 284M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23700K .......... .......... .......... .......... .......... 25% 146M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23750K .......... .......... .......... .......... .......... 25% 123M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23800K .......... .......... .......... .......... .......... 25% 312M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23850K .......... .......... .......... .......... .......... 25% 308M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23900K .......... .......... .......... .......... .......... 25% 250M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 23950K .......... .......... .......... .......... .......... 25% 279M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 24000K .......... .......... .......... .......... .......... 25% 313M 1s 2024-09-12T00:31:56.594 INFO:teuthology.orchestra.run.smithi033.stderr: 24050K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24100K .......... .......... .......... .......... .......... 25% 267M 1s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24150K .......... .......... .......... .......... .......... 26% 318M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24200K .......... .......... .......... .......... .......... 26% 293M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24250K .......... .......... .......... .......... .......... 26% 302M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24300K .......... .......... .......... .......... .......... 26% 207M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24350K .......... .......... .......... .......... .......... 26% 232M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24400K .......... .......... .......... .......... .......... 26% 280M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24450K .......... .......... .......... .......... .......... 26% 292M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24500K .......... .......... .......... .......... .......... 26% 260M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24550K .......... .......... .......... .......... .......... 26% 279M 0s 2024-09-12T00:31:56.595 INFO:teuthology.orchestra.run.smithi033.stderr: 24600K .......... .......... .......... .......... .......... 26% 285M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 24650K .......... .......... .......... .......... .......... 26% 263M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 24700K .......... .......... .......... .......... .......... 26% 254M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 24750K .......... .......... .......... .......... .......... 26% 314M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 24800K .......... .......... .......... .......... .......... 26% 316M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 24850K .......... .......... .......... .......... .......... 26% 296M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 24900K .......... .......... .......... .......... .......... 26% 247M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 24950K .......... .......... .......... .......... .......... 26% 284M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 25000K .......... .......... .......... .......... .......... 26% 290M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 25050K .......... .......... .......... .......... .......... 27% 284M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 25100K .......... .......... .......... .......... .......... 27% 255M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 25150K .......... .......... .......... .......... .......... 27% 269M 0s 2024-09-12T00:31:56.596 INFO:teuthology.orchestra.run.smithi033.stderr: 25200K .......... .......... .......... .......... .......... 27% 301M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25250K .......... .......... .......... .......... .......... 27% 289M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25300K .......... .......... .......... .......... .......... 27% 252M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25350K .......... .......... .......... .......... .......... 27% 286M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25400K .......... .......... .......... .......... .......... 27% 289M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25450K .......... .......... .......... .......... .......... 27% 277M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25500K .......... .......... .......... .......... .......... 27% 250M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25550K .......... .......... .......... .......... .......... 27% 293M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25600K .......... .......... .......... .......... .......... 27% 277M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25650K .......... .......... .......... .......... .......... 27% 279M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25700K .......... .......... .......... .......... .......... 27% 258M 0s 2024-09-12T00:31:56.597 INFO:teuthology.orchestra.run.smithi033.stderr: 25750K .......... .......... .......... .......... .......... 27% 300M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 25800K .......... .......... .......... .......... .......... 27% 314M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 25850K .......... .......... .......... .......... .......... 27% 294M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 25900K .......... .......... .......... .......... .......... 27% 236M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 25950K .......... .......... .......... .......... .......... 27% 313M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 26000K .......... .......... .......... .......... .......... 28% 281M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 26050K .......... .......... .......... .......... .......... 28% 318M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 26100K .......... .......... .......... .......... .......... 28% 273M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 26150K .......... .......... .......... .......... .......... 28% 308M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 26200K .......... .......... .......... .......... .......... 28% 309M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 26250K .......... .......... .......... .......... .......... 28% 319M 0s 2024-09-12T00:31:56.598 INFO:teuthology.orchestra.run.smithi033.stderr: 26300K .......... .......... .......... .......... .......... 28% 248M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26350K .......... .......... .......... .......... .......... 28% 310M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26400K .......... .......... .......... .......... .......... 28% 318M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26450K .......... .......... .......... .......... .......... 28% 180M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26500K .......... .......... .......... .......... .......... 28% 103M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26550K .......... .......... .......... .......... .......... 28% 85.8M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26600K .......... .......... .......... .......... .......... 28% 309M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26650K .......... .......... .......... .......... .......... 28% 117M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26700K .......... .......... .......... .......... .......... 28% 125M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26750K .......... .......... .......... .......... .......... 28% 279M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26800K .......... .......... .......... .......... .......... 28% 62.2M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26850K .......... .......... .......... .......... .......... 28% 260M 0s 2024-09-12T00:31:56.599 INFO:teuthology.orchestra.run.smithi033.stderr: 26900K .......... .......... .......... .......... .......... 29% 279M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 26950K .......... .......... .......... .......... .......... 29% 296M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27000K .......... .......... .......... .......... .......... 29% 302M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27050K .......... .......... .......... .......... .......... 29% 350M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27100K .......... .......... .......... .......... .......... 29% 248M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27150K .......... .......... .......... .......... .......... 29% 285M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27200K .......... .......... .......... .......... .......... 29% 125M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27250K .......... .......... .......... .......... .......... 29% 262M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27300K .......... .......... .......... .......... .......... 29% 267M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27350K .......... .......... .......... .......... .......... 29% 317M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27400K .......... .......... .......... .......... .......... 29% 40.5M 0s 2024-09-12T00:31:56.600 INFO:teuthology.orchestra.run.smithi033.stderr: 27450K .......... .......... .......... .......... .......... 29% 270M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27500K .......... .......... .......... .......... .......... 29% 252M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27550K .......... .......... .......... .......... .......... 29% 295M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27600K .......... .......... .......... .......... .......... 29% 298M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27650K .......... .......... .......... .......... .......... 29% 369M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27700K .......... .......... .......... .......... .......... 29% 322M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27750K .......... .......... .......... .......... .......... 29% 345M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27800K .......... .......... .......... .......... .......... 29% 370M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27850K .......... .......... .......... .......... .......... 30% 342M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27900K .......... .......... .......... .......... .......... 30% 295M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 27950K .......... .......... .......... .......... .......... 30% 354M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 28000K .......... .......... .......... .......... .......... 30% 349M 0s 2024-09-12T00:31:56.601 INFO:teuthology.orchestra.run.smithi033.stderr: 28050K .......... .......... .......... .......... .......... 30% 358M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28100K .......... .......... .......... .......... .......... 30% 298M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28150K .......... .......... .......... .......... .......... 30% 361M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28200K .......... .......... .......... .......... .......... 30% 368M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28250K .......... .......... .......... .......... .......... 30% 369M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28300K .......... .......... .......... .......... .......... 30% 325M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28350K .......... .......... .......... .......... .......... 30% 362M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28400K .......... .......... .......... .......... .......... 30% 377M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28450K .......... .......... .......... .......... .......... 30% 351M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28500K .......... .......... .......... .......... .......... 30% 338M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28550K .......... .......... .......... .......... .......... 30% 381M 0s 2024-09-12T00:31:56.602 INFO:teuthology.orchestra.run.smithi033.stderr: 28600K .......... .......... .......... .......... .......... 30% 373M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 28650K .......... .......... .......... .......... .......... 30% 357M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 28700K .......... .......... .......... .......... .......... 30% 310M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 28750K .......... .......... .......... .......... .......... 31% 339M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 28800K .......... .......... .......... .......... .......... 31% 351M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 28850K .......... .......... .......... .......... .......... 31% 378M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 28900K .......... .......... .......... .......... .......... 31% 345M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 28950K .......... .......... .......... .......... .......... 31% 364M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 29000K .......... .......... .......... .......... .......... 31% 334M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 29050K .......... .......... .......... .......... .......... 31% 374M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 29100K .......... .......... .......... .......... .......... 31% 316M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 29150K .......... .......... .......... .......... .......... 31% 345M 0s 2024-09-12T00:31:56.603 INFO:teuthology.orchestra.run.smithi033.stderr: 29200K .......... .......... .......... .......... .......... 31% 373M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29250K .......... .......... .......... .......... .......... 31% 375M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29300K .......... .......... .......... .......... .......... 31% 345M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29350K .......... .......... .......... .......... .......... 31% 368M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29400K .......... .......... .......... .......... .......... 31% 373M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29450K .......... .......... .......... .......... .......... 31% 387M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29500K .......... .......... .......... .......... .......... 31% 136M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29550K .......... .......... .......... .......... .......... 31% 298M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29600K .......... .......... .......... .......... .......... 31% 84.0M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29650K .......... .......... .......... .......... .......... 31% 315M 0s 2024-09-12T00:31:56.604 INFO:teuthology.orchestra.run.smithi033.stderr: 29700K .......... .......... .......... .......... .......... 32% 77.5M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 29750K .......... .......... .......... .......... .......... 32% 284M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 29800K .......... .......... .......... .......... .......... 32% 349M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 29850K .......... .......... .......... .......... .......... 32% 379M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 29900K .......... .......... .......... .......... .......... 32% 52.7M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 29950K .......... .......... .......... .......... .......... 32% 259M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 30000K .......... .......... .......... .......... .......... 32% 370M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 30050K .......... .......... .......... .......... .......... 32% 373M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 30100K .......... .......... .......... .......... .......... 32% 300M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 30150K .......... .......... .......... .......... .......... 32% 361M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 30200K .......... .......... .......... .......... .......... 32% 373M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 30250K .......... .......... .......... .......... .......... 32% 78.1M 0s 2024-09-12T00:31:56.605 INFO:teuthology.orchestra.run.smithi033.stderr: 30300K .......... .......... .......... .......... .......... 32% 212M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30350K .......... .......... .......... .......... .......... 32% 381M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30400K .......... .......... .......... .......... .......... 32% 39.8M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30450K .......... .......... .......... .......... .......... 32% 352M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30500K .......... .......... .......... .......... .......... 32% 107M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30550K .......... .......... .......... .......... .......... 32% 372M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30600K .......... .......... .......... .......... .......... 32% 181M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30650K .......... .......... .......... .......... .......... 33% 178M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30700K .......... .......... .......... .......... .......... 33% 338M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30750K .......... .......... .......... .......... .......... 33% 367M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30800K .......... .......... .......... .......... .......... 33% 330M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30850K .......... .......... .......... .......... .......... 33% 403M 0s 2024-09-12T00:31:56.606 INFO:teuthology.orchestra.run.smithi033.stderr: 30900K .......... .......... .......... .......... .......... 33% 368M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 30950K .......... .......... .......... .......... .......... 33% 162M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31000K .......... .......... .......... .......... .......... 33% 252M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31050K .......... .......... .......... .......... .......... 33% 293M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31100K .......... .......... .......... .......... .......... 33% 272M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31150K .......... .......... .......... .......... .......... 33% 284M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31200K .......... .......... .......... .......... .......... 33% 379M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31250K .......... .......... .......... .......... .......... 33% 387M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31300K .......... .......... .......... .......... .......... 33% 386M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31350K .......... .......... .......... .......... .......... 33% 350M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31400K .......... .......... .......... .......... .......... 33% 390M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31450K .......... .......... .......... .......... .......... 33% 388M 0s 2024-09-12T00:31:56.607 INFO:teuthology.orchestra.run.smithi033.stderr: 31500K .......... .......... .......... .......... .......... 33% 334M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31550K .......... .......... .......... .......... .......... 34% 321M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31600K .......... .......... .......... .......... .......... 34% 390M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31650K .......... .......... .......... .......... .......... 34% 397M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31700K .......... .......... .......... .......... .......... 34% 395M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31750K .......... .......... .......... .......... .......... 34% 344M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31800K .......... .......... .......... .......... .......... 34% 385M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31850K .......... .......... .......... .......... .......... 34% 382M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31900K .......... .......... .......... .......... .......... 34% 361M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 31950K .......... .......... .......... .......... .......... 34% 318M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 32000K .......... .......... .......... .......... .......... 34% 396M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 32050K .......... .......... .......... .......... .......... 34% 369M 0s 2024-09-12T00:31:56.608 INFO:teuthology.orchestra.run.smithi033.stderr: 32100K .......... .......... .......... .......... .......... 34% 383M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32150K .......... .......... .......... .......... .......... 34% 338M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32200K .......... .......... .......... .......... .......... 34% 379M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32250K .......... .......... .......... .......... .......... 34% 356M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32300K .......... .......... .......... .......... .......... 34% 383M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32350K .......... .......... .......... .......... .......... 34% 309M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32400K .......... .......... .......... .......... .......... 34% 362M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32450K .......... .......... .......... .......... .......... 34% 372M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32500K .......... .......... .......... .......... .......... 35% 386M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32550K .......... .......... .......... .......... .......... 35% 348M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32600K .......... .......... .......... .......... .......... 35% 387M 0s 2024-09-12T00:31:56.609 INFO:teuthology.orchestra.run.smithi033.stderr: 32650K .......... .......... .......... .......... .......... 35% 373M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 32700K .......... .......... .......... .......... .......... 35% 380M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 32750K .......... .......... .......... .......... .......... 35% 96.5M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 32800K .......... .......... .......... .......... .......... 35% 115M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 32850K .......... .......... .......... .......... .......... 35% 334M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 32900K .......... .......... .......... .......... .......... 35% 380M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 32950K .......... .......... .......... .......... .......... 35% 69.3M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 33000K .......... .......... .......... .......... .......... 35% 161M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 33050K .......... .......... .......... .......... .......... 35% 107M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 33100K .......... .......... .......... .......... .......... 35% 340M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 33150K .......... .......... .......... .......... .......... 35% 309M 0s 2024-09-12T00:31:56.610 INFO:teuthology.orchestra.run.smithi033.stderr: 33200K .......... .......... .......... .......... .......... 35% 381M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33250K .......... .......... .......... .......... .......... 35% 391M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33300K .......... .......... .......... .......... .......... 35% 221M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33350K .......... .......... .......... .......... .......... 35% 41.9M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33400K .......... .......... .......... .......... .......... 36% 273M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33450K .......... .......... .......... .......... .......... 36% 185M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33500K .......... .......... .......... .......... .......... 36% 83.1M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33550K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33600K .......... .......... .......... .......... .......... 36% 422M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33650K .......... .......... .......... .......... .......... 36% 305M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33700K .......... .......... .......... .......... .......... 36% 164M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33750K .......... .......... .......... .......... .......... 36% 127M 0s 2024-09-12T00:31:56.611 INFO:teuthology.orchestra.run.smithi033.stderr: 33800K .......... .......... .......... .......... .......... 36% 367M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 33850K .......... .......... .......... .......... .......... 36% 382M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 33900K .......... .......... .......... .......... .......... 36% 391M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 33950K .......... .......... .......... .......... .......... 36% 318M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34000K .......... .......... .......... .......... .......... 36% 391M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34050K .......... .......... .......... .......... .......... 36% 278M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34100K .......... .......... .......... .......... .......... 36% 247M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34150K .......... .......... .......... .......... .......... 36% 259M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34200K .......... .......... .......... .......... .......... 36% 352M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34250K .......... .......... .......... .......... .......... 36% 347M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34300K .......... .......... .......... .......... .......... 36% 391M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34350K .......... .......... .......... .......... .......... 37% 206M 0s 2024-09-12T00:31:56.612 INFO:teuthology.orchestra.run.smithi033.stderr: 34400K .......... .......... .......... .......... .......... 37% 343M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34450K .......... .......... .......... .......... .......... 37% 381M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34500K .......... .......... .......... .......... .......... 37% 398M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34550K .......... .......... .......... .......... .......... 37% 333M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34600K .......... .......... .......... .......... .......... 37% 382M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34650K .......... .......... .......... .......... .......... 37% 390M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34700K .......... .......... .......... .......... .......... 37% 397M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34750K .......... .......... .......... .......... .......... 37% 290M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34800K .......... .......... .......... .......... .......... 37% 344M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34850K .......... .......... .......... .......... .......... 37% 361M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34900K .......... .......... .......... .......... .......... 37% 373M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 34950K .......... .......... .......... .......... .......... 37% 394M 0s 2024-09-12T00:31:56.613 INFO:teuthology.orchestra.run.smithi033.stderr: 35000K .......... .......... .......... .......... .......... 37% 392M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35050K .......... .......... .......... .......... .......... 37% 329M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35100K .......... .......... .......... .......... .......... 37% 383M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35150K .......... .......... .......... .......... .......... 37% 346M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35200K .......... .......... .......... .......... .......... 37% 371M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35250K .......... .......... .......... .......... .......... 37% 348M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35300K .......... .......... .......... .......... .......... 38% 361M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35350K .......... .......... .......... .......... .......... 38% 392M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35400K .......... .......... .......... .......... .......... 38% 376M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35450K .......... .......... .......... .......... .......... 38% 328M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35500K .......... .......... .......... .......... .......... 38% 370M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35550K .......... .......... .......... .......... .......... 38% 357M 0s 2024-09-12T00:31:56.614 INFO:teuthology.orchestra.run.smithi033.stderr: 35600K .......... .......... .......... .......... .......... 38% 296M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 35650K .......... .......... .......... .......... .......... 38% 338M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 35700K .......... .......... .......... .......... .......... 38% 397M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 35750K .......... .......... .......... .......... .......... 38% 130M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 35800K .......... .......... .......... .......... .......... 38% 328M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 35850K .......... .......... .......... .......... .......... 38% 188M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 35900K .......... .......... .......... .......... .......... 38% 291M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 35950K .......... .......... .......... .......... .......... 38% 369M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 36000K .......... .......... .......... .......... .......... 38% 91.8M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 36050K .......... .......... .......... .......... .......... 38% 112M 0s 2024-09-12T00:31:56.615 INFO:teuthology.orchestra.run.smithi033.stderr: 36100K .......... .......... .......... .......... .......... 38% 103M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36150K .......... .......... .......... .......... .......... 38% 373M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36200K .......... .......... .......... .......... .......... 39% 146M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36250K .......... .......... .......... .......... .......... 39% 373M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36300K .......... .......... .......... .......... .......... 39% 325M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36350K .......... .......... .......... .......... .......... 39% 319M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36400K .......... .......... .......... .......... .......... 39% 49.5M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36450K .......... .......... .......... .......... .......... 39% 344M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36500K .......... .......... .......... .......... .......... 39% 105M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36550K .......... .......... .......... .......... .......... 39% 96.5M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36600K .......... .......... .......... .......... .......... 39% 256M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36650K .......... .......... .......... .......... .......... 39% 376M 0s 2024-09-12T00:31:56.616 INFO:teuthology.orchestra.run.smithi033.stderr: 36700K .......... .......... .......... .......... .......... 39% 297M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 36750K .......... .......... .......... .......... .......... 39% 183M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 36800K .......... .......... .......... .......... .......... 39% 121M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 36850K .......... .......... .......... .......... .......... 39% 208M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 36900K .......... .......... .......... .......... .......... 39% 359M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 36950K .......... .......... .......... .......... .......... 39% 322M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 37000K .......... .......... .......... .......... .......... 39% 250M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 37050K .......... .......... .......... .......... .......... 39% 338M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 37100K .......... .......... .......... .......... .......... 39% 367M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 37150K .......... .......... .......... .......... .......... 40% 320M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 37200K .......... .......... .......... .......... .......... 40% 269M 0s 2024-09-12T00:31:56.617 INFO:teuthology.orchestra.run.smithi033.stderr: 37250K .......... .......... .......... .......... .......... 40% 384M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37300K .......... .......... .......... .......... .......... 40% 178M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37350K .......... .......... .......... .......... .......... 40% 320M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37400K .......... .......... .......... .......... .......... 40% 389M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37450K .......... .......... .......... .......... .......... 40% 388M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37500K .......... .......... .......... .......... .......... 40% 150M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37550K .......... .......... .......... .......... .......... 40% 308M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37600K .......... .......... .......... .......... .......... 40% 354M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37650K .......... .......... .......... .......... .......... 40% 357M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37700K .......... .......... .......... .......... .......... 40% 387M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37750K .......... .......... .......... .......... .......... 40% 348M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37800K .......... .......... .......... .......... .......... 40% 382M 0s 2024-09-12T00:31:56.618 INFO:teuthology.orchestra.run.smithi033.stderr: 37850K .......... .......... .......... .......... .......... 40% 382M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 37900K .......... .......... .......... .......... .......... 40% 387M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 37950K .......... .......... .......... .......... .......... 40% 318M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38000K .......... .......... .......... .......... .......... 40% 368M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38050K .......... .......... .......... .......... .......... 41% 389M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38100K .......... .......... .......... .......... .......... 41% 387M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38150K .......... .......... .......... .......... .......... 41% 335M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38200K .......... .......... .......... .......... .......... 41% 381M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38250K .......... .......... .......... .......... .......... 41% 383M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38300K .......... .......... .......... .......... .......... 41% 254M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38350K .......... .......... .......... .......... .......... 41% 299M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38400K .......... .......... .......... .......... .......... 41% 389M 0s 2024-09-12T00:31:56.619 INFO:teuthology.orchestra.run.smithi033.stderr: 38450K .......... .......... .......... .......... .......... 41% 368M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38500K .......... .......... .......... .......... .......... 41% 380M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38550K .......... .......... .......... .......... .......... 41% 334M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38600K .......... .......... .......... .......... .......... 41% 372M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38650K .......... .......... .......... .......... .......... 41% 363M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38700K .......... .......... .......... .......... .......... 41% 363M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38750K .......... .......... .......... .......... .......... 41% 176M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38800K .......... .......... .......... .......... .......... 41% 365M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38850K .......... .......... .......... .......... .......... 41% 371M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38900K .......... .......... .......... .......... .......... 41% 376M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 38950K .......... .......... .......... .......... .......... 41% 341M 0s 2024-09-12T00:31:56.620 INFO:teuthology.orchestra.run.smithi033.stderr: 39000K .......... .......... .......... .......... .......... 42% 392M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39050K .......... .......... .......... .......... .......... 42% 167M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39100K .......... .......... .......... .......... .......... 42% 108M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39150K .......... .......... .......... .......... .......... 42% 81.7M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39200K .......... .......... .......... .......... .......... 42% 216M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39250K .......... .......... .......... .......... .......... 42% 354M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39300K .......... .......... .......... .......... .......... 42% 211M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39350K .......... .......... .......... .......... .......... 42% 265M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39400K .......... .......... .......... .......... .......... 42% 47.8M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39450K .......... .......... .......... .......... .......... 42% 377M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39500K .......... .......... .......... .......... .......... 42% 208M 0s 2024-09-12T00:31:56.621 INFO:teuthology.orchestra.run.smithi033.stderr: 39550K .......... .......... .......... .......... .......... 42% 281M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 39600K .......... .......... .......... .......... .......... 42% 87.1M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 39650K .......... .......... .......... .......... .......... 42% 262M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 39700K .......... .......... .......... .......... .......... 42% 300M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 39750K .......... .......... .......... .......... .......... 42% 279M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 39800K .......... .......... .......... .......... .......... 42% 163M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 39850K .......... .......... .......... .......... .......... 42% 177M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 39900K .......... .......... .......... .......... .......... 43% 195M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 39950K .......... .......... .......... .......... .......... 43% 315M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 40000K .......... .......... .......... .......... .......... 43% 103M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 40050K .......... .......... .......... .......... .......... 43% 375M 0s 2024-09-12T00:31:56.622 INFO:teuthology.orchestra.run.smithi033.stderr: 40100K .......... .......... .......... .......... .......... 43% 385M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40150K .......... .......... .......... .......... .......... 43% 343M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40200K .......... .......... .......... .......... .......... 43% 378M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40250K .......... .......... .......... .......... .......... 43% 394M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40300K .......... .......... .......... .......... .......... 43% 380M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40350K .......... .......... .......... .......... .......... 43% 249M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40400K .......... .......... .......... .......... .......... 43% 364M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40450K .......... .......... .......... .......... .......... 43% 373M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40500K .......... .......... .......... .......... .......... 43% 247M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40550K .......... .......... .......... .......... .......... 43% 240M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40600K .......... .......... .......... .......... .......... 43% 361M 0s 2024-09-12T00:31:56.623 INFO:teuthology.orchestra.run.smithi033.stderr: 40650K .......... .......... .......... .......... .......... 43% 75.6M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 40700K .......... .......... .......... .......... .......... 43% 365M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 40750K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 40800K .......... .......... .......... .......... .......... 43% 344M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 40850K .......... .......... .......... .......... .......... 44% 370M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 40900K .......... .......... .......... .......... .......... 44% 375M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 40950K .......... .......... .......... .......... .......... 44% 369M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 41000K .......... .......... .......... .......... .......... 44% 295M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 41050K .......... .......... .......... .......... .......... 44% 388M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 41100K .......... .......... .......... .......... .......... 44% 380M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 41150K .......... .......... .......... .......... .......... 44% 307M 0s 2024-09-12T00:31:56.624 INFO:teuthology.orchestra.run.smithi033.stderr: 41200K .......... .......... .......... .......... .......... 44% 412M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41250K .......... .......... .......... .......... .......... 44% 326M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41300K .......... .......... .......... .......... .......... 44% 406M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41350K .......... .......... .......... .......... .......... 44% 341M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41400K .......... .......... .......... .......... .......... 44% 376M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41450K .......... .......... .......... .......... .......... 44% 379M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41500K .......... .......... .......... .......... .......... 44% 386M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41550K .......... .......... .......... .......... .......... 44% 301M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41600K .......... .......... .......... .......... .......... 44% 374M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41650K .......... .......... .......... .......... .......... 44% 390M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41700K .......... .......... .......... .......... .......... 44% 394M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41750K .......... .......... .......... .......... .......... 44% 336M 0s 2024-09-12T00:31:56.625 INFO:teuthology.orchestra.run.smithi033.stderr: 41800K .......... .......... .......... .......... .......... 45% 376M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 41850K .......... .......... .......... .......... .......... 45% 383M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 41900K .......... .......... .......... .......... .......... 45% 363M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 41950K .......... .......... .......... .......... .......... 45% 300M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 42000K .......... .......... .......... .......... .......... 45% 182M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 42050K .......... .......... .......... .......... .......... 45% 349M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 42100K .......... .......... .......... .......... .......... 45% 372M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 42150K .......... .......... .......... .......... .......... 45% 334M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 42200K .......... .......... .......... .......... .......... 45% 81.9M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 42250K .......... .......... .......... .......... .......... 45% 336M 0s 2024-09-12T00:31:56.626 INFO:teuthology.orchestra.run.smithi033.stderr: 42300K .......... .......... .......... .......... .......... 45% 314M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42350K .......... .......... .......... .......... .......... 45% 113M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42400K .......... .......... .......... .......... .......... 45% 172M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42450K .......... .......... .......... .......... .......... 45% 57.5M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42500K .......... .......... .......... .......... .......... 45% 359M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42550K .......... .......... .......... .......... .......... 45% 274M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42600K .......... .......... .......... .......... .......... 45% 370M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42650K .......... .......... .......... .......... .......... 45% 70.9M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42700K .......... .......... .......... .......... .......... 46% 366M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42750K .......... .......... .......... .......... .......... 46% 307M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42800K .......... .......... .......... .......... .......... 46% 379M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42850K .......... .......... .......... .......... .......... 46% 270M 0s 2024-09-12T00:31:56.627 INFO:teuthology.orchestra.run.smithi033.stderr: 42900K .......... .......... .......... .......... .......... 46% 163M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 42950K .......... .......... .......... .......... .......... 46% 331M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43000K .......... .......... .......... .......... .......... 46% 110M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43050K .......... .......... .......... .......... .......... 46% 160M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43100K .......... .......... .......... .......... .......... 46% 72.0M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43150K .......... .......... .......... .......... .......... 46% 252M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43200K .......... .......... .......... .......... .......... 46% 368M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43250K .......... .......... .......... .......... .......... 46% 376M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43300K .......... .......... .......... .......... .......... 46% 381M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43350K .......... .......... .......... .......... .......... 46% 345M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43400K .......... .......... .......... .......... .......... 46% 339M 0s 2024-09-12T00:31:56.628 INFO:teuthology.orchestra.run.smithi033.stderr: 43450K .......... .......... .......... .......... .......... 46% 295M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43500K .......... .......... .......... .......... .......... 46% 327M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43550K .......... .......... .......... .......... .......... 46% 249M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43600K .......... .......... .......... .......... .......... 46% 322M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43650K .......... .......... .......... .......... .......... 47% 386M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43700K .......... .......... .......... .......... .......... 47% 96.6M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43750K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43800K .......... .......... .......... .......... .......... 47% 390M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43850K .......... .......... .......... .......... .......... 47% 387M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43900K .......... .......... .......... .......... .......... 47% 372M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 43950K .......... .......... .......... .......... .......... 47% 318M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 44000K .......... .......... .......... .......... .......... 47% 381M 0s 2024-09-12T00:31:56.629 INFO:teuthology.orchestra.run.smithi033.stderr: 44050K .......... .......... .......... .......... .......... 47% 359M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44100K .......... .......... .......... .......... .......... 47% 159M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44150K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44200K .......... .......... .......... .......... .......... 47% 361M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44250K .......... .......... .......... .......... .......... 47% 368M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44300K .......... .......... .......... .......... .......... 47% 389M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44350K .......... .......... .......... .......... .......... 47% 232M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44400K .......... .......... .......... .......... .......... 47% 352M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44450K .......... .......... .......... .......... .......... 47% 374M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44500K .......... .......... .......... .......... .......... 47% 346M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44550K .......... .......... .......... .......... .......... 48% 328M 0s 2024-09-12T00:31:56.630 INFO:teuthology.orchestra.run.smithi033.stderr: 44600K .......... .......... .......... .......... .......... 48% 377M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 44650K .......... .......... .......... .......... .......... 48% 270M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 44700K .......... .......... .......... .......... .......... 48% 333M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 44750K .......... .......... .......... .......... .......... 48% 309M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 44800K .......... .......... .......... .......... .......... 48% 368M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 44850K .......... .......... .......... .......... .......... 48% 374M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 44900K .......... .......... .......... .......... .......... 48% 374M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 44950K .......... .......... .......... .......... .......... 48% 335M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 45000K .......... .......... .......... .......... .......... 48% 385M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 45050K .......... .......... .......... .......... .......... 48% 334M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 45100K .......... .......... .......... .......... .......... 48% 354M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 45150K .......... .......... .......... .......... .......... 48% 246M 0s 2024-09-12T00:31:56.631 INFO:teuthology.orchestra.run.smithi033.stderr: 45200K .......... .......... .......... .......... .......... 48% 377M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45250K .......... .......... .......... .......... .......... 48% 385M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45300K .......... .......... .......... .......... .......... 48% 378M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45350K .......... .......... .......... .......... .......... 48% 258M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45400K .......... .......... .......... .......... .......... 48% 162M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45450K .......... .......... .......... .......... .......... 48% 169M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45500K .......... .......... .......... .......... .......... 49% 375M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45550K .......... .......... .......... .......... .......... 49% 47.7M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45600K .......... .......... .......... .......... .......... 49% 374M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45650K .......... .......... .......... .......... .......... 49% 349M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45700K .......... .......... .......... .......... .......... 49% 86.1M 0s 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi033.stderr: 45750K .......... .......... .......... .......... .......... 49% 301M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 45800K .......... .......... .......... .......... .......... 49% 367M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 45850K .......... .......... .......... .......... .......... 49% 255M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 45900K .......... .......... .......... .......... .......... 49% 328M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 45950K .......... .......... .......... .......... .......... 49% 150M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 46000K .......... .......... .......... .......... .......... 49% 379M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 46050K .......... .......... .......... .......... .......... 49% 149M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 46100K .......... .......... .......... .......... .......... 49% 140M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 46150K .......... .......... .......... .......... .......... 49% 43.9M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 46200K .......... .......... .......... .......... .......... 49% 360M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 46250K .......... .......... .......... .......... .......... 49% 378M 0s 2024-09-12T00:31:56.633 INFO:teuthology.orchestra.run.smithi033.stderr: 46300K .......... .......... .......... .......... .......... 49% 212M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46350K .......... .......... .......... .......... .......... 49% 128M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46400K .......... .......... .......... .......... .......... 49% 365M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46450K .......... .......... .......... .......... .......... 50% 372M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46500K .......... .......... .......... .......... .......... 50% 346M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46550K .......... .......... .......... .......... .......... 50% 344M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46600K .......... .......... .......... .......... .......... 50% 350M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46650K .......... .......... .......... .......... .......... 50% 165M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46700K .......... .......... .......... .......... .......... 50% 346M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46750K .......... .......... .......... .......... .......... 50% 311M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46800K .......... .......... .......... .......... .......... 50% 391M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46850K .......... .......... .......... .......... .......... 50% 134M 0s 2024-09-12T00:31:56.634 INFO:teuthology.orchestra.run.smithi033.stderr: 46900K .......... .......... .......... .......... .......... 50% 366M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 46950K .......... .......... .......... .......... .......... 50% 348M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47000K .......... .......... .......... .......... .......... 50% 391M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47050K .......... .......... .......... .......... .......... 50% 172M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47100K .......... .......... .......... .......... .......... 50% 171M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47150K .......... .......... .......... .......... .......... 50% 185M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47200K .......... .......... .......... .......... .......... 50% 360M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47250K .......... .......... .......... .......... .......... 50% 280M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47300K .......... .......... .......... .......... .......... 50% 293M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47350K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47400K .......... .......... .......... .......... .......... 51% 280M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47450K .......... .......... .......... .......... .......... 51% 299M 0s 2024-09-12T00:31:56.635 INFO:teuthology.orchestra.run.smithi033.stderr: 47500K .......... .......... .......... .......... .......... 51% 331M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47550K .......... .......... .......... .......... .......... 51% 272M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47600K .......... .......... .......... .......... .......... 51% 310M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47650K .......... .......... .......... .......... .......... 51% 383M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47700K .......... .......... .......... .......... .......... 51% 349M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47750K .......... .......... .......... .......... .......... 51% 336M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47800K .......... .......... .......... .......... .......... 51% 387M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47850K .......... .......... .......... .......... .......... 51% 350M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47900K .......... .......... .......... .......... .......... 51% 388M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 47950K .......... .......... .......... .......... .......... 51% 319M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 48000K .......... .......... .......... .......... .......... 51% 388M 0s 2024-09-12T00:31:56.636 INFO:teuthology.orchestra.run.smithi033.stderr: 48050K .......... .......... .......... .......... .......... 51% 372M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48100K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48150K .......... .......... .......... .......... .......... 51% 332M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48200K .......... .......... .......... .......... .......... 51% 382M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48250K .......... .......... .......... .......... .......... 51% 385M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48300K .......... .......... .......... .......... .......... 52% 384M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48350K .......... .......... .......... .......... .......... 52% 317M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48400K .......... .......... .......... .......... .......... 52% 383M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48450K .......... .......... .......... .......... .......... 52% 208M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48500K .......... .......... .......... .......... .......... 52% 193M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48550K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48600K .......... .......... .......... .......... .......... 52% 99.1M 0s 2024-09-12T00:31:56.637 INFO:teuthology.orchestra.run.smithi033.stderr: 48650K .......... .......... .......... .......... .......... 52% 369M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 48700K .......... .......... .......... .......... .......... 52% 383M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 48750K .......... .......... .......... .......... .......... 52% 161M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 48800K .......... .......... .......... .......... .......... 52% 352M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 48850K .......... .......... .......... .......... .......... 52% 236M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 48900K .......... .......... .......... .......... .......... 52% 353M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 48950K .......... .......... .......... .......... .......... 52% 144M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 49000K .......... .......... .......... .......... .......... 52% 364M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 49050K .......... .......... .......... .......... .......... 52% 301M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 49100K .......... .......... .......... .......... .......... 52% 155M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 49150K .......... .......... .......... .......... .......... 52% 115M 0s 2024-09-12T00:31:56.638 INFO:teuthology.orchestra.run.smithi033.stderr: 49200K .......... .......... .......... .......... .......... 53% 51.3M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49250K .......... .......... .......... .......... .......... 53% 330M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49300K .......... .......... .......... .......... .......... 53% 105M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49350K .......... .......... .......... .......... .......... 53% 338M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49400K .......... .......... .......... .......... .......... 53% 90.1M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49450K .......... .......... .......... .......... .......... 53% 359M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49500K .......... .......... .......... .......... .......... 53% 365M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49550K .......... .......... .......... .......... .......... 53% 96.6M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49600K .......... .......... .......... .......... .......... 53% 353M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49650K .......... .......... .......... .......... .......... 53% 376M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49700K .......... .......... .......... .......... .......... 53% 377M 0s 2024-09-12T00:31:56.639 INFO:teuthology.orchestra.run.smithi033.stderr: 49750K .......... .......... .......... .......... .......... 53% 322M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 49800K .......... .......... .......... .......... .......... 53% 382M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 49850K .......... .......... .......... .......... .......... 53% 388M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 49900K .......... .......... .......... .......... .......... 53% 388M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 49950K .......... .......... .......... .......... .......... 53% 77.9M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 50000K .......... .......... .......... .......... .......... 53% 336M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 50050K .......... .......... .......... .......... .......... 53% 371M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 50100K .......... .......... .......... .......... .......... 53% 377M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 50150K .......... .......... .......... .......... .......... 54% 344M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 50200K .......... .......... .......... .......... .......... 54% 380M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 50250K .......... .......... .......... .......... .......... 54% 388M 0s 2024-09-12T00:31:56.640 INFO:teuthology.orchestra.run.smithi033.stderr: 50300K .......... .......... .......... .......... .......... 54% 115M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50350K .......... .......... .......... .......... .......... 54% 301M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50400K .......... .......... .......... .......... .......... 54% 213M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50450K .......... .......... .......... .......... .......... 54% 387M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50500K .......... .......... .......... .......... .......... 54% 384M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50550K .......... .......... .......... .......... .......... 54% 74.1M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50600K .......... .......... .......... .......... .......... 54% 339M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50650K .......... .......... .......... .......... .......... 54% 357M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50700K .......... .......... .......... .......... .......... 54% 353M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50750K .......... .......... .......... .......... .......... 54% 312M 0s 2024-09-12T00:31:56.641 INFO:teuthology.orchestra.run.smithi033.stderr: 50800K .......... .......... .......... .......... .......... 54% 381M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 50850K .......... .......... .......... .......... .......... 54% 381M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 50900K .......... .......... .......... .......... .......... 54% 384M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 50950K .......... .......... .......... .......... .......... 54% 338M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 51000K .......... .......... .......... .......... .......... 54% 375M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 51050K .......... .......... .......... .......... .......... 55% 363M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 51100K .......... .......... .......... .......... .......... 55% 372M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 51150K .......... .......... .......... .......... .......... 55% 328M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 51200K .......... .......... .......... .......... .......... 55% 375M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 51250K .......... .......... .......... .......... .......... 55% 382M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 51300K .......... .......... .......... .......... .......... 55% 319M 0s 2024-09-12T00:31:56.642 INFO:teuthology.orchestra.run.smithi033.stderr: 51350K .......... .......... .......... .......... .......... 55% 386M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51400K .......... .......... .......... .......... .......... 55% 383M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51450K .......... .......... .......... .......... .......... 55% 369M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51500K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51550K .......... .......... .......... .......... .......... 55% 392M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51600K .......... .......... .......... .......... .......... 55% 379M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51650K .......... .......... .......... .......... .......... 55% 373M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51700K .......... .......... .......... .......... .......... 55% 346M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51750K .......... .......... .......... .......... .......... 55% 363M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51800K .......... .......... .......... .......... .......... 55% 362M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51850K .......... .......... .......... .......... .......... 55% 375M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51900K .......... .......... .......... .......... .......... 55% 106M 0s 2024-09-12T00:31:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 51950K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52000K .......... .......... .......... .......... .......... 56% 377M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52050K .......... .......... .......... .......... .......... 56% 353M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52100K .......... .......... .......... .......... .......... 56% 332M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52150K .......... .......... .......... .......... .......... 56% 389M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52200K .......... .......... .......... .......... .......... 56% 189M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52250K .......... .......... .......... .......... .......... 56% 333M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52300K .......... .......... .......... .......... .......... 56% 31.7M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52350K .......... .......... .......... .......... .......... 56% 204M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52400K .......... .......... .......... .......... .......... 56% 224M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52450K .......... .......... .......... .......... .......... 56% 171M 0s 2024-09-12T00:31:56.644 INFO:teuthology.orchestra.run.smithi033.stderr: 52500K .......... .......... .......... .......... .......... 56% 95.4M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52550K .......... .......... .......... .......... .......... 56% 209M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52600K .......... .......... .......... .......... .......... 56% 199M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52650K .......... .......... .......... .......... .......... 56% 216M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52700K .......... .......... .......... .......... .......... 56% 187M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52750K .......... .......... .......... .......... .......... 56% 210M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52800K .......... .......... .......... .......... .......... 56% 215M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52850K .......... .......... .......... .......... .......... 56% 222M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52900K .......... .......... .......... .......... .......... 56% 186M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 52950K .......... .......... .......... .......... .......... 57% 222M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 53000K .......... .......... .......... .......... .......... 57% 223M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 53050K .......... .......... .......... .......... .......... 57% 197M 0s 2024-09-12T00:31:56.645 INFO:teuthology.orchestra.run.smithi033.stderr: 53100K .......... .......... .......... .......... .......... 57% 185M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53150K .......... .......... .......... .......... .......... 57% 224M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53200K .......... .......... .......... .......... .......... 57% 228M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53250K .......... .......... .......... .......... .......... 57% 216M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53300K .......... .......... .......... .......... .......... 57% 199M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53350K .......... .......... .......... .......... .......... 57% 231M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53400K .......... .......... .......... .......... .......... 57% 230M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53450K .......... .......... .......... .......... .......... 57% 219M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53500K .......... .......... .......... .......... .......... 57% 180M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53550K .......... .......... .......... .......... .......... 57% 208M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53600K .......... .......... .......... .......... .......... 57% 224M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53650K .......... .......... .......... .......... .......... 57% 225M 0s 2024-09-12T00:31:56.646 INFO:teuthology.orchestra.run.smithi033.stderr: 53700K .......... .......... .......... .......... .......... 57% 192M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 53750K .......... .......... .......... .......... .......... 57% 222M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 53800K .......... .......... .......... .......... .......... 57% 224M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 53850K .......... .......... .......... .......... .......... 58% 214M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 53900K .......... .......... .......... .......... .......... 58% 183M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 53950K .......... .......... .......... .......... .......... 58% 215M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 54000K .......... .......... .......... .......... .......... 58% 209M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 54050K .......... .......... .......... .......... .......... 58% 218M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 54100K .......... .......... .......... .......... .......... 58% 195M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 54150K .......... .......... .......... .......... .......... 58% 210M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 54200K .......... .......... .......... .......... .......... 58% 224M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 54250K .......... .......... .......... .......... .......... 58% 221M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 54300K .......... .......... .......... .......... .......... 58% 174M 0s 2024-09-12T00:31:56.647 INFO:teuthology.orchestra.run.smithi033.stderr: 54350K .......... .......... .......... .......... .......... 58% 209M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54400K .......... .......... .......... .......... .......... 58% 220M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54450K .......... .......... .......... .......... .......... 58% 214M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54500K .......... .......... .......... .......... .......... 58% 200M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54550K .......... .......... .......... .......... .......... 58% 219M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54600K .......... .......... .......... .......... .......... 58% 228M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54650K .......... .......... .......... .......... .......... 58% 227M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54700K .......... .......... .......... .......... .......... 58% 183M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54750K .......... .......... .......... .......... .......... 58% 213M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54800K .......... .......... .......... .......... .......... 59% 218M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54850K .......... .......... .......... .......... .......... 59% 225M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54900K .......... .......... .......... .......... .......... 59% 195M 0s 2024-09-12T00:31:56.648 INFO:teuthology.orchestra.run.smithi033.stderr: 54950K .......... .......... .......... .......... .......... 59% 217M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55000K .......... .......... .......... .......... .......... 59% 213M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55050K .......... .......... .......... .......... .......... 59% 218M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55100K .......... .......... .......... .......... .......... 59% 190M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55150K .......... .......... .......... .......... .......... 59% 230M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55200K .......... .......... .......... .......... .......... 59% 210M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55250K .......... .......... .......... .......... .......... 59% 220M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55300K .......... .......... .......... .......... .......... 59% 198M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55350K .......... .......... .......... .......... .......... 59% 224M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55400K .......... .......... .......... .......... .......... 59% 216M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55450K .......... .......... .......... .......... .......... 59% 226M 0s 2024-09-12T00:31:56.649 INFO:teuthology.orchestra.run.smithi033.stderr: 55500K .......... .......... .......... .......... .......... 59% 185M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55550K .......... .......... .......... .......... .......... 59% 211M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55600K .......... .......... .......... .......... .......... 59% 227M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55650K .......... .......... .......... .......... .......... 59% 198M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55700K .......... .......... .......... .......... .......... 60% 199M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55750K .......... .......... .......... .......... .......... 60% 215M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55800K .......... .......... .......... .......... .......... 60% 212M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55850K .......... .......... .......... .......... .......... 60% 211M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55900K .......... .......... .......... .......... .......... 60% 184M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 55950K .......... .......... .......... .......... .......... 60% 220M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 56000K .......... .......... .......... .......... .......... 60% 222M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 56050K .......... .......... .......... .......... .......... 60% 209M 0s 2024-09-12T00:31:56.650 INFO:teuthology.orchestra.run.smithi033.stderr: 56100K .......... .......... .......... .......... .......... 60% 192M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56150K .......... .......... .......... .......... .......... 60% 222M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56200K .......... .......... .......... .......... .......... 60% 226M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56250K .......... .......... .......... .......... .......... 60% 218M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56300K .......... .......... .......... .......... .......... 60% 165M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56350K .......... .......... .......... .......... .......... 60% 217M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56400K .......... .......... .......... .......... .......... 60% 216M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56450K .......... .......... .......... .......... .......... 60% 226M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56500K .......... .......... .......... .......... .......... 60% 195M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56550K .......... .......... .......... .......... .......... 60% 221M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56600K .......... .......... .......... .......... .......... 60% 221M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56650K .......... .......... .......... .......... .......... 61% 211M 0s 2024-09-12T00:31:56.651 INFO:teuthology.orchestra.run.smithi033.stderr: 56700K .......... .......... .......... .......... .......... 61% 175M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 56750K .......... .......... .......... .......... .......... 61% 222M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 56800K .......... .......... .......... .......... .......... 61% 220M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 56850K .......... .......... .......... .......... .......... 61% 217M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 56900K .......... .......... .......... .......... .......... 61% 190M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 56950K .......... .......... .......... .......... .......... 61% 223M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 57000K .......... .......... .......... .......... .......... 61% 198M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 57050K .......... .......... .......... .......... .......... 61% 214M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 57100K .......... .......... .......... .......... .......... 61% 184M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 57150K .......... .......... .......... .......... .......... 61% 217M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 57200K .......... .......... .......... .......... .......... 61% 225M 0s 2024-09-12T00:31:56.652 INFO:teuthology.orchestra.run.smithi033.stderr: 57250K .......... .......... .......... .......... .......... 61% 227M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57300K .......... .......... .......... .......... .......... 61% 182M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57350K .......... .......... .......... .......... .......... 61% 279M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57400K .......... .......... .......... .......... .......... 61% 325M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57450K .......... .......... .......... .......... .......... 61% 361M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57500K .......... .......... .......... .......... .......... 61% 315M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57550K .......... .......... .......... .......... .......... 62% 379M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57600K .......... .......... .......... .......... .......... 62% 354M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57650K .......... .......... .......... .......... .......... 62% 361M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57700K .......... .......... .......... .......... .......... 62% 294M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57750K .......... .......... .......... .......... .......... 62% 337M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57800K .......... .......... .......... .......... .......... 62% 358M 0s 2024-09-12T00:31:56.653 INFO:teuthology.orchestra.run.smithi033.stderr: 57850K .......... .......... .......... .......... .......... 62% 377M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 57900K .......... .......... .......... .......... .......... 62% 315M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 57950K .......... .......... .......... .......... .......... 62% 384M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58000K .......... .......... .......... .......... .......... 62% 391M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58050K .......... .......... .......... .......... .......... 62% 342M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58100K .......... .......... .......... .......... .......... 62% 316M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58150K .......... .......... .......... .......... .......... 62% 382M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58200K .......... .......... .......... .......... .......... 62% 390M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58250K .......... .......... .......... .......... .......... 62% 369M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58300K .......... .......... .......... .......... .......... 62% 303M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58350K .......... .......... .......... .......... .......... 62% 343M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58400K .......... .......... .......... .......... .......... 62% 367M 0s 2024-09-12T00:31:56.654 INFO:teuthology.orchestra.run.smithi033.stderr: 58450K .......... .......... .......... .......... .......... 62% 386M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58500K .......... .......... .......... .......... .......... 63% 276M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58550K .......... .......... .......... .......... .......... 63% 362M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58600K .......... .......... .......... .......... .......... 63% 346M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58650K .......... .......... .......... .......... .......... 63% 245M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58700K .......... .......... .......... .......... .......... 63% 347M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58750K .......... .......... .......... .......... .......... 63% 197M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58800K .......... .......... .......... .......... .......... 63% 204M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58850K .......... .......... .......... .......... .......... 63% 361M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58900K .......... .......... .......... .......... .......... 63% 373M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 58950K .......... .......... .......... .......... .......... 63% 109M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 59000K .......... .......... .......... .......... .......... 63% 19.6M 0s 2024-09-12T00:31:56.655 INFO:teuthology.orchestra.run.smithi033.stderr: 59050K .......... .......... .......... .......... .......... 63% 331M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59100K .......... .......... .......... .......... .......... 63% 342M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59150K .......... .......... .......... .......... .......... 63% 346M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59200K .......... .......... .......... .......... .......... 63% 313M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59250K .......... .......... .......... .......... .......... 63% 369M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59300K .......... .......... .......... .......... .......... 63% 327M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59350K .......... .......... .......... .......... .......... 63% 263M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59400K .......... .......... .......... .......... .......... 63% 363M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59450K .......... .......... .......... .......... .......... 64% 340M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59500K .......... .......... .......... .......... .......... 64% 295M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59550K .......... .......... .......... .......... .......... 64% 359M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59600K .......... .......... .......... .......... .......... 64% 375M 0s 2024-09-12T00:31:56.656 INFO:teuthology.orchestra.run.smithi033.stderr: 59650K .......... .......... .......... .......... .......... 64% 379M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 59700K .......... .......... .......... .......... .......... 64% 338M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 59750K .......... .......... .......... .......... .......... 64% 326M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 59800K .......... .......... .......... .......... .......... 64% 355M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 59850K .......... .......... .......... .......... .......... 64% 379M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 59900K .......... .......... .......... .......... .......... 64% 258M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 59950K .......... .......... .......... .......... .......... 64% 362M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 60000K .......... .......... .......... .......... .......... 64% 374M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 60050K .......... .......... .......... .......... .......... 64% 387M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 60100K .......... .......... .......... .......... .......... 64% 343M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 60150K .......... .......... .......... .......... .......... 64% 376M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 60200K .......... .......... .......... .......... .......... 64% 290M 0s 2024-09-12T00:31:56.657 INFO:teuthology.orchestra.run.smithi033.stderr: 60250K .......... .......... .......... .......... .......... 64% 381M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60300K .......... .......... .......... .......... .......... 64% 42.9M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60350K .......... .......... .......... .......... .......... 65% 304M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60400K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60450K .......... .......... .......... .......... .......... 65% 323M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60500K .......... .......... .......... .......... .......... 65% 266M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60550K .......... .......... .......... .......... .......... 65% 326M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60600K .......... .......... .......... .......... .......... 65% 321M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60650K .......... .......... .......... .......... .......... 65% 332M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60700K .......... .......... .......... .......... .......... 65% 280M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60750K .......... .......... .......... .......... .......... 65% 378M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60800K .......... .......... .......... .......... .......... 65% 379M 0s 2024-09-12T00:31:56.658 INFO:teuthology.orchestra.run.smithi033.stderr: 60850K .......... .......... .......... .......... .......... 65% 353M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 60900K .......... .......... .......... .......... .......... 65% 320M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 60950K .......... .......... .......... .......... .......... 65% 351M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61000K .......... .......... .......... .......... .......... 65% 369M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61050K .......... .......... .......... .......... .......... 65% 382M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61100K .......... .......... .......... .......... .......... 65% 279M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61150K .......... .......... .......... .......... .......... 65% 359M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61200K .......... .......... .......... .......... .......... 65% 351M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61250K .......... .......... .......... .......... .......... 65% 373M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61300K .......... .......... .......... .......... .......... 66% 338M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61350K .......... .......... .......... .......... .......... 66% 365M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61400K .......... .......... .......... .......... .......... 66% 333M 0s 2024-09-12T00:31:56.659 INFO:teuthology.orchestra.run.smithi033.stderr: 61450K .......... .......... .......... .......... .......... 66% 383M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61500K .......... .......... .......... .......... .......... 66% 378M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61550K .......... .......... .......... .......... .......... 66% 301M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61600K .......... .......... .......... .......... .......... 66% 388M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61650K .......... .......... .......... .......... .......... 66% 387M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61700K .......... .......... .......... .......... .......... 66% 378M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61750K .......... .......... .......... .......... .......... 66% 338M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61800K .......... .......... .......... .......... .......... 66% 351M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61850K .......... .......... .......... .......... .......... 66% 371M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61900K .......... .......... .......... .......... .......... 66% 313M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 61950K .......... .......... .......... .......... .......... 66% 335M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 62000K .......... .......... .......... .......... .......... 66% 230M 0s 2024-09-12T00:31:56.660 INFO:teuthology.orchestra.run.smithi033.stderr: 62050K .......... .......... .......... .......... .......... 66% 20.5M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62100K .......... .......... .......... .......... .......... 66% 272M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62150K .......... .......... .......... .......... .......... 66% 78.5M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62200K .......... .......... .......... .......... .......... 67% 296M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62250K .......... .......... .......... .......... .......... 67% 316M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62300K .......... .......... .......... .......... .......... 67% 359M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62350K .......... .......... .......... .......... .......... 67% 276M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62400K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62450K .......... .......... .......... .......... .......... 67% 332M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62500K .......... .......... .......... .......... .......... 67% 390M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62550K .......... .......... .......... .......... .......... 67% 352M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62600K .......... .......... .......... .......... .......... 67% 103M 0s 2024-09-12T00:31:56.661 INFO:teuthology.orchestra.run.smithi033.stderr: 62650K .......... .......... .......... .......... .......... 67% 361M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 62700K .......... .......... .......... .......... .......... 67% 311M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 62750K .......... .......... .......... .......... .......... 67% 253M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 62800K .......... .......... .......... .......... .......... 67% 273M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 62850K .......... .......... .......... .......... .......... 67% 304M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 62900K .......... .......... .......... .......... .......... 67% 328M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 62950K .......... .......... .......... .......... .......... 67% 344M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 63000K .......... .......... .......... .......... .......... 67% 366M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 63050K .......... .......... .......... .......... .......... 67% 370M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 63100K .......... .......... .......... .......... .......... 67% 377M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 63150K .......... .......... .......... .......... .......... 68% 330M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 63200K .......... .......... .......... .......... .......... 68% 371M 0s 2024-09-12T00:31:56.662 INFO:teuthology.orchestra.run.smithi033.stderr: 63250K .......... .......... .......... .......... .......... 68% 126M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63300K .......... .......... .......... .......... .......... 68% 355M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63350K .......... .......... .......... .......... .......... 68% 204M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63400K .......... .......... .......... .......... .......... 68% 365M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63450K .......... .......... .......... .......... .......... 68% 142M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63500K .......... .......... .......... .......... .......... 68% 378M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63550K .......... .......... .......... .......... .......... 68% 209M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63600K .......... .......... .......... .......... .......... 68% 359M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63650K .......... .......... .......... .......... .......... 68% 376M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63700K .......... .......... .......... .......... .......... 68% 282M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63750K .......... .......... .......... .......... .......... 68% 328M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63800K .......... .......... .......... .......... .......... 68% 373M 0s 2024-09-12T00:31:56.663 INFO:teuthology.orchestra.run.smithi033.stderr: 63850K .......... .......... .......... .......... .......... 68% 260M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 63900K .......... .......... .......... .......... .......... 68% 311M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 63950K .......... .......... .......... .......... .......... 68% 277M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64000K .......... .......... .......... .......... .......... 68% 330M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64050K .......... .......... .......... .......... .......... 68% 324M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64100K .......... .......... .......... .......... .......... 69% 330M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64150K .......... .......... .......... .......... .......... 69% 339M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64200K .......... .......... .......... .......... .......... 69% 362M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64250K .......... .......... .......... .......... .......... 69% 329M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64300K .......... .......... .......... .......... .......... 69% 348M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64350K .......... .......... .......... .......... .......... 69% 246M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64400K .......... .......... .......... .......... .......... 69% 344M 0s 2024-09-12T00:31:56.664 INFO:teuthology.orchestra.run.smithi033.stderr: 64450K .......... .......... .......... .......... .......... 69% 363M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64500K .......... .......... .......... .......... .......... 69% 370M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64550K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64600K .......... .......... .......... .......... .......... 69% 369M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64650K .......... .......... .......... .......... .......... 69% 362M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64700K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64750K .......... .......... .......... .......... .......... 69% 313M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64800K .......... .......... .......... .......... .......... 69% 361M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64850K .......... .......... .......... .......... .......... 69% 395M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64900K .......... .......... .......... .......... .......... 69% 394M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 64950K .......... .......... .......... .......... .......... 69% 342M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 65000K .......... .......... .......... .......... .......... 70% 376M 0s 2024-09-12T00:31:56.665 INFO:teuthology.orchestra.run.smithi033.stderr: 65050K .......... .......... .......... .......... .......... 70% 387M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65100K .......... .......... .......... .......... .......... 70% 360M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65150K .......... .......... .......... .......... .......... 70% 24.1M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65200K .......... .......... .......... .......... .......... 70% 80.7M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65250K .......... .......... .......... .......... .......... 70% 207M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65300K .......... .......... .......... .......... .......... 70% 211M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65350K .......... .......... .......... .......... .......... 70% 200M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65400K .......... .......... .......... .......... .......... 70% 216M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65450K .......... .......... .......... .......... .......... 70% 223M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65500K .......... .......... .......... .......... .......... 70% 219M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65550K .......... .......... .......... .......... .......... 70% 95.1M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65600K .......... .......... .......... .......... .......... 70% 213M 0s 2024-09-12T00:31:56.666 INFO:teuthology.orchestra.run.smithi033.stderr: 65650K .......... .......... .......... .......... .......... 70% 203M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 65700K .......... .......... .......... .......... .......... 70% 208M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 65750K .......... .......... .......... .......... .......... 70% 197M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 65800K .......... .......... .......... .......... .......... 70% 217M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 65850K .......... .......... .......... .......... .......... 70% 202M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 65900K .......... .......... .......... .......... .......... 70% 213M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 65950K .......... .......... .......... .......... .......... 71% 180M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 66000K .......... .......... .......... .......... .......... 71% 227M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 66050K .......... .......... .......... .......... .......... 71% 217M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 66100K .......... .......... .......... .......... .......... 71% 210M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 66150K .......... .......... .......... .......... .......... 71% 205M 0s 2024-09-12T00:31:56.667 INFO:teuthology.orchestra.run.smithi033.stderr: 66200K .......... .......... .......... .......... .......... 71% 231M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66250K .......... .......... .......... .......... .......... 71% 222M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66300K .......... .......... .......... .......... .......... 71% 214M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66350K .......... .......... .......... .......... .......... 71% 188M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66400K .......... .......... .......... .......... .......... 71% 222M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66450K .......... .......... .......... .......... .......... 71% 224M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66500K .......... .......... .......... .......... .......... 71% 218M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66550K .......... .......... .......... .......... .......... 71% 187M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66600K .......... .......... .......... .......... .......... 71% 229M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66650K .......... .......... .......... .......... .......... 71% 8.21M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66700K .......... .......... .......... .......... .......... 71% 56.1M 0s 2024-09-12T00:31:56.668 INFO:teuthology.orchestra.run.smithi033.stderr: 66750K .......... .......... .......... .......... .......... 71% 182M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 66800K .......... .......... .......... .......... .......... 71% 208M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 66850K .......... .......... .......... .......... .......... 72% 209M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 66900K .......... .......... .......... .......... .......... 72% 216M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 66950K .......... .......... .......... .......... .......... 72% 190M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 67000K .......... .......... .......... .......... .......... 72% 220M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 67050K .......... .......... .......... .......... .......... 72% 221M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 67100K .......... .......... .......... .......... .......... 72% 36.1M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 67150K .......... .......... .......... .......... .......... 72% 164M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 67200K .......... .......... .......... .......... .......... 72% 225M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 67250K .......... .......... .......... .......... .......... 72% 212M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 67300K .......... .......... .......... .......... .......... 72% 224M 0s 2024-09-12T00:31:56.669 INFO:teuthology.orchestra.run.smithi033.stderr: 67350K .......... .......... .......... .......... .......... 72% 199M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67400K .......... .......... .......... .......... .......... 72% 217M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67450K .......... .......... .......... .......... .......... 72% 211M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67500K .......... .......... .......... .......... .......... 72% 223M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67550K .......... .......... .......... .......... .......... 72% 186M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67600K .......... .......... .......... .......... .......... 72% 219M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67650K .......... .......... .......... .......... .......... 72% 220M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67700K .......... .......... .......... .......... .......... 72% 211M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67750K .......... .......... .......... .......... .......... 72% 200M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67800K .......... .......... .......... .......... .......... 73% 220M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67850K .......... .......... .......... .......... .......... 73% 224M 0s 2024-09-12T00:31:56.670 INFO:teuthology.orchestra.run.smithi033.stderr: 67900K .......... .......... .......... .......... .......... 73% 199M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 67950K .......... .......... .......... .......... .......... 73% 179M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68000K .......... .......... .......... .......... .......... 73% 227M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68050K .......... .......... .......... .......... .......... 73% 223M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68100K .......... .......... .......... .......... .......... 73% 212M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68150K .......... .......... .......... .......... .......... 73% 193M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68200K .......... .......... .......... .......... .......... 73% 221M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68250K .......... .......... .......... .......... .......... 73% 214M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68300K .......... .......... .......... .......... .......... 73% 223M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68350K .......... .......... .......... .......... .......... 73% 172M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68400K .......... .......... .......... .......... .......... 73% 218M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68450K .......... .......... .......... .......... .......... 73% 226M 0s 2024-09-12T00:31:56.671 INFO:teuthology.orchestra.run.smithi033.stderr: 68500K .......... .......... .......... .......... .......... 73% 229M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68550K .......... .......... .......... .......... .......... 73% 197M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68600K .......... .......... .......... .......... .......... 73% 229M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68650K .......... .......... .......... .......... .......... 73% 230M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68700K .......... .......... .......... .......... .......... 74% 229M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68750K .......... .......... .......... .......... .......... 74% 183M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68800K .......... .......... .......... .......... .......... 74% 228M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68850K .......... .......... .......... .......... .......... 74% 224M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68900K .......... .......... .......... .......... .......... 74% 216M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 68950K .......... .......... .......... .......... .......... 74% 197M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 69000K .......... .......... .......... .......... .......... 74% 219M 0s 2024-09-12T00:31:56.672 INFO:teuthology.orchestra.run.smithi033.stderr: 69050K .......... .......... .......... .......... .......... 74% 226M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69100K .......... .......... .......... .......... .......... 74% 228M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69150K .......... .......... .......... .......... .......... 74% 185M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69200K .......... .......... .......... .......... .......... 74% 215M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69250K .......... .......... .......... .......... .......... 74% 225M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69300K .......... .......... .......... .......... .......... 74% 202M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69350K .......... .......... .......... .......... .......... 74% 208M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69400K .......... .......... .......... .......... .......... 74% 221M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69450K .......... .......... .......... .......... .......... 74% 226M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69500K .......... .......... .......... .......... .......... 74% 220M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69550K .......... .......... .......... .......... .......... 74% 186M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69600K .......... .......... .......... .......... .......... 74% 216M 0s 2024-09-12T00:31:56.673 INFO:teuthology.orchestra.run.smithi033.stderr: 69650K .......... .......... .......... .......... .......... 75% 220M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 69700K .......... .......... .......... .......... .......... 75% 223M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 69750K .......... .......... .......... .......... .......... 75% 204M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 69800K .......... .......... .......... .......... .......... 75% 214M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 69850K .......... .......... .......... .......... .......... 75% 203M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 69900K .......... .......... .......... .......... .......... 75% 213M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 69950K .......... .......... .......... .......... .......... 75% 175M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 70000K .......... .......... .......... .......... .......... 75% 219M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 70050K .......... .......... .......... .......... .......... 75% 214M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 70100K .......... .......... .......... .......... .......... 75% 223M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 70150K .......... .......... .......... .......... .......... 75% 195M 0s 2024-09-12T00:31:56.674 INFO:teuthology.orchestra.run.smithi033.stderr: 70200K .......... .......... .......... .......... .......... 75% 223M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70250K .......... .......... .......... .......... .......... 75% 220M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70300K .......... .......... .......... .......... .......... 75% 221M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70350K .......... .......... .......... .......... .......... 75% 189M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70400K .......... .......... .......... .......... .......... 75% 224M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70450K .......... .......... .......... .......... .......... 75% 230M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70500K .......... .......... .......... .......... .......... 75% 216M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70550K .......... .......... .......... .......... .......... 75% 202M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70600K .......... .......... .......... .......... .......... 76% 215M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70650K .......... .......... .......... .......... .......... 76% 204M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70700K .......... .......... .......... .......... .......... 76% 219M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70750K .......... .......... .......... .......... .......... 76% 181M 0s 2024-09-12T00:31:56.675 INFO:teuthology.orchestra.run.smithi033.stderr: 70800K .......... .......... .......... .......... .......... 76% 218M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 70850K .......... .......... .......... .......... .......... 76% 222M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 70900K .......... .......... .......... .......... .......... 76% 222M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 70950K .......... .......... .......... .......... .......... 76% 199M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 71000K .......... .......... .......... .......... .......... 76% 229M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 71050K .......... .......... .......... .......... .......... 76% 224M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 71100K .......... .......... .......... .......... .......... 76% 218M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 71150K .......... .......... .......... .......... .......... 76% 175M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 71200K .......... .......... .......... .......... .......... 76% 215M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 71250K .......... .......... .......... .......... .......... 76% 208M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 71300K .......... .......... .......... .......... .......... 76% 223M 0s 2024-09-12T00:31:56.676 INFO:teuthology.orchestra.run.smithi033.stderr: 71350K .......... .......... .......... .......... .......... 76% 198M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71400K .......... .......... .......... .......... .......... 76% 222M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71450K .......... .......... .......... .......... .......... 76% 224M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71500K .......... .......... .......... .......... .......... 77% 232M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71550K .......... .......... .......... .......... .......... 77% 180M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71600K .......... .......... .......... .......... .......... 77% 219M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71650K .......... .......... .......... .......... .......... 77% 206M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71700K .......... .......... .......... .......... .......... 77% 216M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71750K .......... .......... .......... .......... .......... 77% 198M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71800K .......... .......... .......... .......... .......... 77% 209M 0s 2024-09-12T00:31:56.677 INFO:teuthology.orchestra.run.smithi033.stderr: 71850K .......... .......... .......... .......... .......... 77% 234M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 71900K .......... .......... .......... .......... .......... 77% 223M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 71950K .......... .......... .......... .......... .......... 77% 183M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72000K .......... .......... .......... .......... .......... 77% 203M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72050K .......... .......... .......... .......... .......... 77% 230M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72100K .......... .......... .......... .......... .......... 77% 224M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72150K .......... .......... .......... .......... .......... 77% 205M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72200K .......... .......... .......... .......... .......... 77% 199M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72250K .......... .......... .......... .......... .......... 77% 215M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72300K .......... .......... .......... .......... .......... 77% 226M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72350K .......... .......... .......... .......... .......... 77% 190M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72400K .......... .......... .......... .......... .......... 77% 232M 0s 2024-09-12T00:31:56.678 INFO:teuthology.orchestra.run.smithi033.stderr: 72450K .......... .......... .......... .......... .......... 78% 208M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72500K .......... .......... .......... .......... .......... 78% 219M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72550K .......... .......... .......... .......... .......... 78% 200M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72600K .......... .......... .......... .......... .......... 78% 220M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72650K .......... .......... .......... .......... .......... 78% 217M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72700K .......... .......... .......... .......... .......... 78% 218M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72750K .......... .......... .......... .......... .......... 78% 183M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72800K .......... .......... .......... .......... .......... 78% 229M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72850K .......... .......... .......... .......... .......... 78% 216M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72900K .......... .......... .......... .......... .......... 78% 217M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 72950K .......... .......... .......... .......... .......... 78% 204M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 73000K .......... .......... .......... .......... .......... 78% 232M 0s 2024-09-12T00:31:56.679 INFO:teuthology.orchestra.run.smithi033.stderr: 73050K .......... .......... .......... .......... .......... 78% 230M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73100K .......... .......... .......... .......... .......... 78% 224M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73150K .......... .......... .......... .......... .......... 78% 190M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73200K .......... .......... .......... .......... .......... 78% 200M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73250K .......... .......... .......... .......... .......... 78% 216M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73300K .......... .......... .......... .......... .......... 78% 200M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73350K .......... .......... .......... .......... .......... 79% 186M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73400K .......... .......... .......... .......... .......... 79% 227M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73450K .......... .......... .......... .......... .......... 79% 231M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73500K .......... .......... .......... .......... .......... 79% 221M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73550K .......... .......... .......... .......... .......... 79% 177M 0s 2024-09-12T00:31:56.680 INFO:teuthology.orchestra.run.smithi033.stderr: 73600K .......... .......... .......... .......... .......... 79% 229M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 73650K .......... .......... .......... .......... .......... 79% 232M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 73700K .......... .......... .......... .......... .......... 79% 201M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 73750K .......... .......... .......... .......... .......... 79% 195M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 73800K .......... .......... .......... .......... .......... 79% 229M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 73850K .......... .......... .......... .......... .......... 79% 229M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 73900K .......... .......... .......... .......... .......... 79% 224M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 73950K .......... .......... .......... .......... .......... 79% 178M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 74000K .......... .......... .......... .......... .......... 79% 215M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 74050K .......... .......... .......... .......... .......... 79% 230M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 74100K .......... .......... .......... .......... .......... 79% 229M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 74150K .......... .......... .......... .......... .......... 79% 206M 0s 2024-09-12T00:31:56.681 INFO:teuthology.orchestra.run.smithi033.stderr: 74200K .......... .......... .......... .......... .......... 79% 218M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74250K .......... .......... .......... .......... .......... 79% 224M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74300K .......... .......... .......... .......... .......... 80% 215M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74350K .......... .......... .......... .......... .......... 80% 186M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74400K .......... .......... .......... .......... .......... 80% 212M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74450K .......... .......... .......... .......... .......... 80% 229M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74500K .......... .......... .......... .......... .......... 80% 221M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74550K .......... .......... .......... .......... .......... 80% 195M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74600K .......... .......... .......... .......... .......... 80% 216M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74650K .......... .......... .......... .......... .......... 80% 220M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74700K .......... .......... .......... .......... .......... 80% 226M 0s 2024-09-12T00:31:56.682 INFO:teuthology.orchestra.run.smithi033.stderr: 74750K .......... .......... .......... .......... .......... 80% 174M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 74800K .......... .......... .......... .......... .......... 80% 227M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 74850K .......... .......... .......... .......... .......... 80% 221M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 74900K .......... .......... .......... .......... .......... 80% 217M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 74950K .......... .......... .......... .......... .......... 80% 209M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 75000K .......... .......... .......... .......... .......... 80% 225M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 75050K .......... .......... .......... .......... .......... 80% 218M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 75100K .......... .......... .......... .......... .......... 80% 214M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 75150K .......... .......... .......... .......... .......... 80% 188M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 75200K .......... .......... .......... .......... .......... 81% 177M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 75250K .......... .......... .......... .......... .......... 81% 213M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 75300K .......... .......... .......... .......... .......... 81% 213M 0s 2024-09-12T00:31:56.683 INFO:teuthology.orchestra.run.smithi033.stderr: 75350K .......... .......... .......... .......... .......... 81% 197M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75400K .......... .......... .......... .......... .......... 81% 228M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75450K .......... .......... .......... .......... .......... 81% 218M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75500K .......... .......... .......... .......... .......... 81% 223M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75550K .......... .......... .......... .......... .......... 81% 187M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75600K .......... .......... .......... .......... .......... 81% 222M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75650K .......... .......... .......... .......... .......... 81% 223M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75700K .......... .......... .......... .......... .......... 81% 219M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75750K .......... .......... .......... .......... .......... 81% 206M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75800K .......... .......... .......... .......... .......... 81% 228M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75850K .......... .......... .......... .......... .......... 81% 224M 0s 2024-09-12T00:31:56.684 INFO:teuthology.orchestra.run.smithi033.stderr: 75900K .......... .......... .......... .......... .......... 81% 210M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 75950K .......... .......... .......... .......... .......... 81% 184M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76000K .......... .......... .......... .......... .......... 81% 219M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76050K .......... .......... .......... .......... .......... 81% 219M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76100K .......... .......... .......... .......... .......... 81% 212M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76150K .......... .......... .......... .......... .......... 82% 204M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76200K .......... .......... .......... .......... .......... 82% 226M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76250K .......... .......... .......... .......... .......... 82% 230M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76300K .......... .......... .......... .......... .......... 82% 225M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76350K .......... .......... .......... .......... .......... 82% 175M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76400K .......... .......... .......... .......... .......... 82% 221M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76450K .......... .......... .......... .......... .......... 82% 226M 0s 2024-09-12T00:31:56.685 INFO:teuthology.orchestra.run.smithi033.stderr: 76500K .......... .......... .......... .......... .......... 82% 218M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76550K .......... .......... .......... .......... .......... 82% 194M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76600K .......... .......... .......... .......... .......... 82% 228M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76650K .......... .......... .......... .......... .......... 82% 220M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76700K .......... .......... .......... .......... .......... 82% 228M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76750K .......... .......... .......... .......... .......... 82% 189M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76800K .......... .......... .......... .......... .......... 82% 221M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76850K .......... .......... .......... .......... .......... 82% 220M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76900K .......... .......... .......... .......... .......... 82% 221M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 76950K .......... .......... .......... .......... .......... 82% 199M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 77000K .......... .......... .......... .......... .......... 82% 208M 0s 2024-09-12T00:31:56.686 INFO:teuthology.orchestra.run.smithi033.stderr: 77050K .......... .......... .......... .......... .......... 82% 225M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77100K .......... .......... .......... .......... .......... 83% 226M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77150K .......... .......... .......... .......... .......... 83% 182M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77200K .......... .......... .......... .......... .......... 83% 214M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77250K .......... .......... .......... .......... .......... 83% 188M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77300K .......... .......... .......... .......... .......... 83% 235M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77350K .......... .......... .......... .......... .......... 83% 203M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77400K .......... .......... .......... .......... .......... 83% 225M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77450K .......... .......... .......... .......... .......... 83% 217M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77500K .......... .......... .......... .......... .......... 83% 231M 0s 2024-09-12T00:31:56.687 INFO:teuthology.orchestra.run.smithi033.stderr: 77550K .......... .......... .......... .......... .......... 83% 179M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 77600K .......... .......... .......... .......... .......... 83% 223M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 77650K .......... .......... .......... .......... .......... 83% 225M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 77700K .......... .......... .......... .......... .......... 83% 301M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 77750K .......... .......... .......... .......... .......... 83% 269M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 77800K .......... .......... .......... .......... .......... 83% 341M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 77850K .......... .......... .......... .......... .......... 83% 352M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 77900K .......... .......... .......... .......... .......... 83% 357M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 77950K .......... .......... .......... .......... .......... 83% 282M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 78000K .......... .......... .......... .......... .......... 84% 318M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 78050K .......... .......... .......... .......... .......... 84% 363M 0s 2024-09-12T00:31:56.688 INFO:teuthology.orchestra.run.smithi033.stderr: 78100K .......... .......... .......... .......... .......... 84% 336M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78150K .......... .......... .......... .......... .......... 84% 312M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78200K .......... .......... .......... .......... .......... 84% 324M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78250K .......... .......... .......... .......... .......... 84% 364M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78300K .......... .......... .......... .......... .......... 84% 349M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78350K .......... .......... .......... .......... .......... 84% 294M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78400K .......... .......... .......... .......... .......... 84% 348M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78450K .......... .......... .......... .......... .......... 84% 345M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78500K .......... .......... .......... .......... .......... 84% 311M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78550K .......... .......... .......... .......... .......... 84% 320M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78600K .......... .......... .......... .......... .......... 84% 363M 0s 2024-09-12T00:31:56.689 INFO:teuthology.orchestra.run.smithi033.stderr: 78650K .......... .......... .......... .......... .......... 84% 355M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 78700K .......... .......... .......... .......... .......... 84% 366M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 78750K .......... .......... .......... .......... .......... 84% 68.4M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 78800K .......... .......... .......... .......... .......... 84% 303M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 78850K .......... .......... .......... .......... .......... 84% 315M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 78900K .......... .......... .......... .......... .......... 84% 322M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 78950K .......... .......... .......... .......... .......... 85% 325M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 79000K .......... .......... .......... .......... .......... 85% 361M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 79050K .......... .......... .......... .......... .......... 85% 351M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 79100K .......... .......... .......... .......... .......... 85% 361M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 79150K .......... .......... .......... .......... .......... 85% 81.7M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 79200K .......... .......... .......... .......... .......... 85% 312M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 79250K .......... .......... .......... .......... .......... 85% 258M 0s 2024-09-12T00:31:56.690 INFO:teuthology.orchestra.run.smithi033.stderr: 79300K .......... .......... .......... .......... .......... 85% 322M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79350K .......... .......... .......... .......... .......... 85% 321M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79400K .......... .......... .......... .......... .......... 85% 341M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79450K .......... .......... .......... .......... .......... 85% 346M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79500K .......... .......... .......... .......... .......... 85% 341M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79550K .......... .......... .......... .......... .......... 85% 249M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79600K .......... .......... .......... .......... .......... 85% 313M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79650K .......... .......... .......... .......... .......... 85% 356M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79700K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79750K .......... .......... .......... .......... .......... 85% 149M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79800K .......... .......... .......... .......... .......... 85% 52.8M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79850K .......... .......... .......... .......... .......... 86% 299M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79900K .......... .......... .......... .......... .......... 86% 352M 0s 2024-09-12T00:31:56.691 INFO:teuthology.orchestra.run.smithi033.stderr: 79950K .......... .......... .......... .......... .......... 86% 283M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80000K .......... .......... .......... .......... .......... 86% 359M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80050K .......... .......... .......... .......... .......... 86% 354M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80100K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80150K .......... .......... .......... .......... .......... 86% 311M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80200K .......... .......... .......... .......... .......... 86% 369M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80250K .......... .......... .......... .......... .......... 86% 376M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80300K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80350K .......... .......... .......... .......... .......... 86% 272M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80400K .......... .......... .......... .......... .......... 86% 142M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80450K .......... .......... .......... .......... .......... 86% 197M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80500K .......... .......... .......... .......... .......... 86% 338M 0s 2024-09-12T00:31:56.692 INFO:teuthology.orchestra.run.smithi033.stderr: 80550K .......... .......... .......... .......... .......... 86% 311M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 80600K .......... .......... .......... .......... .......... 86% 85.0M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 80650K .......... .......... .......... .......... .......... 86% 351M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 80700K .......... .......... .......... .......... .......... 86% 286M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 80750K .......... .......... .......... .......... .......... 86% 177M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 80800K .......... .......... .......... .......... .......... 87% 335M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 80850K .......... .......... .......... .......... .......... 87% 379M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 80900K .......... .......... .......... .......... .......... 87% 138M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 80950K .......... .......... .......... .......... .......... 87% 247M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 81000K .......... .......... .......... .......... .......... 87% 317M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 81050K .......... .......... .......... .......... .......... 87% 312M 0s 2024-09-12T00:31:56.693 INFO:teuthology.orchestra.run.smithi033.stderr: 81100K .......... .......... .......... .......... .......... 87% 331M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81150K .......... .......... .......... .......... .......... 87% 279M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81200K .......... .......... .......... .......... .......... 87% 158M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81250K .......... .......... .......... .......... .......... 87% 322M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81300K .......... .......... .......... .......... .......... 87% 316M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81350K .......... .......... .......... .......... .......... 87% 290M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81400K .......... .......... .......... .......... .......... 87% 319M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81450K .......... .......... .......... .......... .......... 87% 320M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81500K .......... .......... .......... .......... .......... 87% 318M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81550K .......... .......... .......... .......... .......... 87% 206M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81600K .......... .......... .......... .......... .......... 87% 319M 0s 2024-09-12T00:31:56.694 INFO:teuthology.orchestra.run.smithi033.stderr: 81650K .......... .......... .......... .......... .......... 87% 68.2M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 81700K .......... .......... .......... .......... .......... 87% 316M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 81750K .......... .......... .......... .......... .......... 88% 269M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 81800K .......... .......... .......... .......... .......... 88% 331M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 81850K .......... .......... .......... .......... .......... 88% 330M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 81900K .......... .......... .......... .......... .......... 88% 284M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 81950K .......... .......... .......... .......... .......... 88% 362M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 82000K .......... .......... .......... .......... .......... 88% 267M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 82050K .......... .......... .......... .......... .......... 88% 332M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 82100K .......... .......... .......... .......... .......... 88% 330M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 82150K .......... .......... .......... .......... .......... 88% 272M 0s 2024-09-12T00:31:56.695 INFO:teuthology.orchestra.run.smithi033.stderr: 82200K .......... .......... .......... .......... .......... 88% 292M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82250K .......... .......... .......... .......... .......... 88% 317M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82300K .......... .......... .......... .......... .......... 88% 274M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82350K .......... .......... .......... .......... .......... 88% 198M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82400K .......... .......... .......... .......... .......... 88% 314M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82450K .......... .......... .......... .......... .......... 88% 336M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82500K .......... .......... .......... .......... .......... 88% 276M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82550K .......... .......... .......... .......... .......... 88% 278M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82600K .......... .......... .......... .......... .......... 88% 163M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82650K .......... .......... .......... .......... .......... 89% 312M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82700K .......... .......... .......... .......... .......... 89% 280M 0s 2024-09-12T00:31:56.696 INFO:teuthology.orchestra.run.smithi033.stderr: 82750K .......... .......... .......... .......... .......... 89% 295M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 82800K .......... .......... .......... .......... .......... 89% 324M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 82850K .......... .......... .......... .......... .......... 89% 71.6M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 82900K .......... .......... .......... .......... .......... 89% 251M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 82950K .......... .......... .......... .......... .......... 89% 154M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 83000K .......... .......... .......... .......... .......... 89% 317M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 83050K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 83100K .......... .......... .......... .......... .......... 89% 336M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 83150K .......... .......... .......... .......... .......... 89% 196M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 83200K .......... .......... .......... .......... .......... 89% 305M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 83250K .......... .......... .......... .......... .......... 89% 308M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 83300K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-12T00:31:56.697 INFO:teuthology.orchestra.run.smithi033.stderr: 83350K .......... .......... .......... .......... .......... 89% 295M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83400K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83450K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83500K .......... .......... .......... .......... .......... 89% 387M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83550K .......... .......... .......... .......... .......... 89% 157M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83600K .......... .......... .......... .......... .......... 90% 279M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83650K .......... .......... .......... .......... .......... 90% 136M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83700K .......... .......... .......... .......... .......... 90% 135M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83750K .......... .......... .......... .......... .......... 90% 289M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83800K .......... .......... .......... .......... .......... 90% 383M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83850K .......... .......... .......... .......... .......... 90% 219M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83900K .......... .......... .......... .......... .......... 90% 356M 0s 2024-09-12T00:31:56.698 INFO:teuthology.orchestra.run.smithi033.stderr: 83950K .......... .......... .......... .......... .......... 90% 302M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84000K .......... .......... .......... .......... .......... 90% 155M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84050K .......... .......... .......... .......... .......... 90% 374M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84100K .......... .......... .......... .......... .......... 90% 175M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84150K .......... .......... .......... .......... .......... 90% 329M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84200K .......... .......... .......... .......... .......... 90% 217M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84250K .......... .......... .......... .......... .......... 90% 303M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84300K .......... .......... .......... .......... .......... 90% 358M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84350K .......... .......... .......... .......... .......... 90% 228M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84400K .......... .......... .......... .......... .......... 90% 356M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84450K .......... .......... .......... .......... .......... 90% 258M 0s 2024-09-12T00:31:56.699 INFO:teuthology.orchestra.run.smithi033.stderr: 84500K .......... .......... .......... .......... .......... 91% 351M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84550K .......... .......... .......... .......... .......... 91% 322M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84600K .......... .......... .......... .......... .......... 91% 202M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84650K .......... .......... .......... .......... .......... 91% 45.8M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84700K .......... .......... .......... .......... .......... 91% 357M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84750K .......... .......... .......... .......... .......... 91% 316M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84800K .......... .......... .......... .......... .......... 91% 380M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84850K .......... .......... .......... .......... .......... 91% 342M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84900K .......... .......... .......... .......... .......... 91% 368M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 84950K .......... .......... .......... .......... .......... 91% 338M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 85000K .......... .......... .......... .......... .......... 91% 340M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 85050K .......... .......... .......... .......... .......... 91% 385M 0s 2024-09-12T00:31:56.700 INFO:teuthology.orchestra.run.smithi033.stderr: 85100K .......... .......... .......... .......... .......... 91% 387M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85150K .......... .......... .......... .......... .......... 91% 214M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85200K .......... .......... .......... .......... .......... 91% 348M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85250K .......... .......... .......... .......... .......... 91% 363M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85300K .......... .......... .......... .......... .......... 91% 372M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85350K .......... .......... .......... .......... .......... 91% 333M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85400K .......... .......... .......... .......... .......... 91% 163M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85450K .......... .......... .......... .......... .......... 92% 368M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85500K .......... .......... .......... .......... .......... 92% 180M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85550K .......... .......... .......... .......... .......... 92% 194M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85600K .......... .......... .......... .......... .......... 92% 251M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85650K .......... .......... .......... .......... .......... 92% 314M 0s 2024-09-12T00:31:56.701 INFO:teuthology.orchestra.run.smithi033.stderr: 85700K .......... .......... .......... .......... .......... 92% 339M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 85750K .......... .......... .......... .......... .......... 92% 309M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 85800K .......... .......... .......... .......... .......... 92% 382M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 85850K .......... .......... .......... .......... .......... 92% 377M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 85900K .......... .......... .......... .......... .......... 92% 359M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 85950K .......... .......... .......... .......... .......... 92% 134M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 86000K .......... .......... .......... .......... .......... 92% 118M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 86050K .......... .......... .......... .......... .......... 92% 109M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 86100K .......... .......... .......... .......... .......... 92% 350M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 86150K .......... .......... .......... .......... .......... 92% 326M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 86200K .......... .......... .......... .......... .......... 92% 390M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 86250K .......... .......... .......... .......... .......... 92% 370M 0s 2024-09-12T00:31:56.702 INFO:teuthology.orchestra.run.smithi033.stderr: 86300K .......... .......... .......... .......... .......... 92% 356M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86350K .......... .......... .......... .......... .......... 93% 157M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86400K .......... .......... .......... .......... .......... 93% 357M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86450K .......... .......... .......... .......... .......... 93% 355M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86500K .......... .......... .......... .......... .......... 93% 367M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86550K .......... .......... .......... .......... .......... 93% 341M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86600K .......... .......... .......... .......... .......... 93% 142M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86650K .......... .......... .......... .......... .......... 93% 349M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86700K .......... .......... .......... .......... .......... 93% 348M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86750K .......... .......... .......... .......... .......... 93% 85.6M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86800K .......... .......... .......... .......... .......... 93% 286M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86850K .......... .......... .......... .......... .......... 93% 381M 0s 2024-09-12T00:31:56.703 INFO:teuthology.orchestra.run.smithi033.stderr: 86900K .......... .......... .......... .......... .......... 93% 371M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 86950K .......... .......... .......... .......... .......... 93% 234M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87000K .......... .......... .......... .......... .......... 93% 373M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87050K .......... .......... .......... .......... .......... 93% 368M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87100K .......... .......... .......... .......... .......... 93% 335M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87150K .......... .......... .......... .......... .......... 93% 99.7M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87200K .......... .......... .......... .......... .......... 93% 368M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87250K .......... .......... .......... .......... .......... 93% 371M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87300K .......... .......... .......... .......... .......... 94% 161M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87350K .......... .......... .......... .......... .......... 94% 320M 0s 2024-09-12T00:31:56.704 INFO:teuthology.orchestra.run.smithi033.stderr: 87400K .......... .......... .......... .......... .......... 94% 304M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87450K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87500K .......... .......... .......... .......... .......... 94% 225M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87550K .......... .......... .......... .......... .......... 94% 322M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87600K .......... .......... .......... .......... .......... 94% 376M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87650K .......... .......... .......... .......... .......... 94% 381M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87700K .......... .......... .......... .......... .......... 94% 48.8M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87750K .......... .......... .......... .......... .......... 94% 160M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87800K .......... .......... .......... .......... .......... 94% 343M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87850K .......... .......... .......... .......... .......... 94% 329M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87900K .......... .......... .......... .......... .......... 94% 364M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 87950K .......... .......... .......... .......... .......... 94% 303M 0s 2024-09-12T00:31:56.705 INFO:teuthology.orchestra.run.smithi033.stderr: 88000K .......... .......... .......... .......... .......... 94% 384M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88050K .......... .......... .......... .......... .......... 94% 366M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88100K .......... .......... .......... .......... .......... 94% 393M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88150K .......... .......... .......... .......... .......... 94% 180M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88200K .......... .......... .......... .......... .......... 94% 356M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88250K .......... .......... .......... .......... .......... 95% 380M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88300K .......... .......... .......... .......... .......... 95% 338M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88350K .......... .......... .......... .......... .......... 95% 311M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88400K .......... .......... .......... .......... .......... 95% 260M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88450K .......... .......... .......... .......... .......... 95% 362M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88500K .......... .......... .......... .......... .......... 95% 371M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88550K .......... .......... .......... .......... .......... 95% 137M 0s 2024-09-12T00:31:56.706 INFO:teuthology.orchestra.run.smithi033.stderr: 88600K .......... .......... .......... .......... .......... 95% 298M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 88650K .......... .......... .......... .......... .......... 95% 340M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 88700K .......... .......... .......... .......... .......... 95% 359M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 88750K .......... .......... .......... .......... .......... 95% 312M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 88800K .......... .......... .......... .......... .......... 95% 98.4M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 88850K .......... .......... .......... .......... .......... 95% 379M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 88900K .......... .......... .......... .......... .......... 95% 374M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 88950K .......... .......... .......... .......... .......... 95% 315M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 89000K .......... .......... .......... .......... .......... 95% 382M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 89050K .......... .......... .......... .......... .......... 95% 379M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 89100K .......... .......... .......... .......... .......... 95% 90.9M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 89150K .......... .......... .......... .......... .......... 96% 161M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 89200K .......... .......... .......... .......... .......... 96% 377M 0s 2024-09-12T00:31:56.707 INFO:teuthology.orchestra.run.smithi033.stderr: 89250K .......... .......... .......... .......... .......... 96% 133M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89300K .......... .......... .......... .......... .......... 96% 357M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89350K .......... .......... .......... .......... .......... 96% 311M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89400K .......... .......... .......... .......... .......... 96% 355M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89450K .......... .......... .......... .......... .......... 96% 387M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89500K .......... .......... .......... .......... .......... 96% 364M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89550K .......... .......... .......... .......... .......... 96% 271M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89600K .......... .......... .......... .......... .......... 96% 389M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89650K .......... .......... .......... .......... .......... 96% 302M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89700K .......... .......... .......... .......... .......... 96% 379M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89750K .......... .......... .......... .......... .......... 96% 291M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89800K .......... .......... .......... .......... .......... 96% 64.9M 0s 2024-09-12T00:31:56.708 INFO:teuthology.orchestra.run.smithi033.stderr: 89850K .......... .......... .......... .......... .......... 96% 339M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 89900K .......... .......... .......... .......... .......... 96% 379M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 89950K .......... .......... .......... .......... .......... 96% 318M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90000K .......... .......... .......... .......... .......... 96% 343M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90050K .......... .......... .......... .......... .......... 96% 254M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90100K .......... .......... .......... .......... .......... 97% 369M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90150K .......... .......... .......... .......... .......... 97% 341M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90200K .......... .......... .......... .......... .......... 97% 173M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90250K .......... .......... .......... .......... .......... 97% 268M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90300K .......... .......... .......... .......... .......... 97% 381M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90350K .......... .......... .......... .......... .......... 97% 247M 0s 2024-09-12T00:31:56.709 INFO:teuthology.orchestra.run.smithi033.stderr: 90400K .......... .......... .......... .......... .......... 97% 324M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90450K .......... .......... .......... .......... .......... 97% 86.4M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90500K .......... .......... .......... .......... .......... 97% 374M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90550K .......... .......... .......... .......... .......... 97% 336M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90600K .......... .......... .......... .......... .......... 97% 368M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90650K .......... .......... .......... .......... .......... 97% 373M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90700K .......... .......... .......... .......... .......... 97% 350M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90750K .......... .......... .......... .......... .......... 97% 82.0M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90800K .......... .......... .......... .......... .......... 97% 103M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90850K .......... .......... .......... .......... .......... 97% 345M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90900K .......... .......... .......... .......... .......... 97% 372M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 90950K .......... .......... .......... .......... .......... 97% 182M 0s 2024-09-12T00:31:56.710 INFO:teuthology.orchestra.run.smithi033.stderr: 91000K .......... .......... .......... .......... .......... 98% 368M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91050K .......... .......... .......... .......... .......... 98% 334M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91100K .......... .......... .......... .......... .......... 98% 362M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91150K .......... .......... .......... .......... .......... 98% 316M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91200K .......... .......... .......... .......... .......... 98% 387M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91250K .......... .......... .......... .......... .......... 98% 321M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91300K .......... .......... .......... .......... .......... 98% 361M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91350K .......... .......... .......... .......... .......... 98% 337M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91400K .......... .......... .......... .......... .......... 98% 352M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91450K .......... .......... .......... .......... .......... 98% 102M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91500K .......... .......... .......... .......... .......... 98% 376M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91550K .......... .......... .......... .......... .......... 98% 190M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91600K .......... .......... .......... .......... .......... 98% 156M 0s 2024-09-12T00:31:56.711 INFO:teuthology.orchestra.run.smithi033.stderr: 91650K .......... .......... .......... .......... .......... 98% 362M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 91700K .......... .......... .......... .......... .......... 98% 374M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 91750K .......... .......... .......... .......... .......... 98% 324M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 91800K .......... .......... .......... .......... .......... 98% 340M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 91850K .......... .......... .......... .......... .......... 98% 107M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 91900K .......... .......... .......... .......... .......... 98% 82.7M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 91950K .......... .......... .......... .......... .......... 99% 310M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 92000K .......... .......... .......... .......... .......... 99% 374M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 92050K .......... .......... .......... .......... .......... 99% 357M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 92100K .......... .......... .......... .......... .......... 99% 364M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 92150K .......... .......... .......... .......... .......... 99% 362M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 92200K .......... .......... .......... .......... .......... 99% 315M 0s 2024-09-12T00:31:56.712 INFO:teuthology.orchestra.run.smithi033.stderr: 92250K .......... .......... .......... .......... .......... 99% 326M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92300K .......... .......... .......... .......... .......... 99% 294M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92350K .......... .......... .......... .......... .......... 99% 170M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92400K .......... .......... .......... .......... .......... 99% 314M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92450K .......... .......... .......... .......... .......... 99% 330M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92500K .......... .......... .......... .......... .......... 99% 357M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92550K .......... .......... .......... .......... .......... 99% 166M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92600K .......... .......... .......... .......... .......... 99% 320M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92650K .......... .......... .......... .......... .......... 99% 348M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92700K .......... .......... .......... .......... .......... 99% 360M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92750K .......... .......... .......... .......... .......... 99% 320M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92800K .......... .......... .......... .......... .......... 99% 382M 0s 2024-09-12T00:31:56.713 INFO:teuthology.orchestra.run.smithi033.stderr: 92850K .......... .......... .......... .......... .......... 99% 124M 0s 2024-09-12T00:31:56.714 INFO:teuthology.orchestra.run.smithi033.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:31:56.714 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T00:31:56.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12 00:31:55 (191 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T00:31:56.714 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:31:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:31:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:31:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:31:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:31:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:31:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:31:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:31:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:31:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:31:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:31:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:31:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:31:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:31:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:31:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:31:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:31:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:31:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:31:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:56.771 INFO:teuthology.orchestra.run.smithi033.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout:Here are the highlights of this release: 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - Advanced control of transitive versions 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - Support for optional features and dependencies 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - Rules to tweak published metadata 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - Support for Java 13 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - New Zinc compiler for Scala 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - VS2019 support 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:31:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout:------------------------------------------------------------ 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout:Gradle 6.0.1 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout:------------------------------------------------------------ 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:56.773 INFO:teuthology.orchestra.run.smithi033.stdout:Kotlin: 1.3.50 2024-09-12T00:31:56.774 INFO:teuthology.orchestra.run.smithi033.stdout:Groovy: 2.5.8 2024-09-12T00:31:56.774 INFO:teuthology.orchestra.run.smithi033.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:31:56.774 INFO:teuthology.orchestra.run.smithi033.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T00:31:56.774 INFO:teuthology.orchestra.run.smithi033.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T00:31:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:56.774 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:31:56.774 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:31:56.774 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T00:31:56.775 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:31:56.775 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T00:31:56.775 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:31:57.150 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:31:57.151 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:31:57.151 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'DRREZVJUEGJIWCMYYESC', 'access_secret': '8rJFPwCI7Voxeyfjt8aQPBtAqCaEpioNBVvlT5BdkUGohmcoRO2iGw==', 'region': 'mexico', 'endpoint': 'smithi033.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi033.front.sepia.ceph.com'} 2024-09-12T00:31:57.151 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:31:57.151 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'DRREZVJUEGJIWCMYYESC', '--secret', '8rJFPwCI7Voxeyfjt8aQPBtAqCaEpioNBVvlT5BdkUGohmcoRO2iGw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:31:57.151 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key DRREZVJUEGJIWCMYYESC --secret 8rJFPwCI7Voxeyfjt8aQPBtAqCaEpioNBVvlT5BdkUGohmcoRO2iGw== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:31:57.218 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:57.218 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:57.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.256+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.258+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.258+0000 7f3ca6f25800 20 realm 2024-09-12T00:31:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.258+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.258+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.258+0000 7f3ca6f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.258+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.258+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.258+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.259+0000 7f3ca6f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:57.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.259+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.260+0000 7f3ca6f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:57.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.260+0000 7f3ca6f25800 20 searching for the correct realm 2024-09-12T00:31:57.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.264+0000 7f3ca3334640 0 -- 172.21.15.33:0/1383883675 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f3c9803c040 msgr2=0x7f3c9803c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:57.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.470+0000 7f3ca2b33640 0 -- 172.21.15.33:0/1383883675 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x555c1a9b2f40 msgr2=0x555c1a9b5370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.473+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 20 zone default found 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 4 Realm: () 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 20 zonegroup default 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.474+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.475+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.475+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.475+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.475+0000 7f3ca6f25800 20 started sync module instance, tier type = 2024-09-12T00:31:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.475+0000 7f3ca6f25800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.485+0000 7f3ca6f25800 20 add_watcher() i=0 2024-09-12T00:31:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.485+0000 7f3ca6f25800 20 add_watcher() i=1 2024-09-12T00:31:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.485+0000 7f3ca6f25800 20 add_watcher() i=2 2024-09-12T00:31:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.485+0000 7f3ca6f25800 20 add_watcher() i=3 2024-09-12T00:31:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.485+0000 7f3ca6f25800 20 add_watcher() i=4 2024-09-12T00:31:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.485+0000 7f3ca6f25800 20 add_watcher() i=5 2024-09-12T00:31:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.485+0000 7f3ca6f25800 20 add_watcher() i=6 2024-09-12T00:31:57.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.486+0000 7f3ca6f25800 20 add_watcher() i=7 2024-09-12T00:31:57.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.486+0000 7f3ca6f25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.488+0000 7f3b597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.488+0000 7f3ca6f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.488+0000 7f3ca6f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.488+0000 7f3ca6f25800 5 note: GC not initialized 2024-09-12T00:31:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.488+0000 7f3ad3fff640 20 reqs_thread_entry: start 2024-09-12T00:31:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.488+0000 7f3ca6f25800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.488+0000 7f3ca6f25800 20 Filter name: none 2024-09-12T00:31:57.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.488+0000 7f3ad1ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:57.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:31:57.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:31:57.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 10 cache get: name=default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC : miss 2024-09-12T00:31:57.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.489+0000 7f3ca6f25800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.490+0000 7f3ca6f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.490+0000 7f3ca6f25800 10 cache put: name=default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC info.flags=0x0 2024-09-12T00:31:57.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.490+0000 7f3ca6f25800 10 adding default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC to cache LRU end 2024-09-12T00:31:57.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.490+0000 7f3ca6f25800 10 cache get: name=default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC : hit (negative entry) 2024-09-12T00:31:57.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.490+0000 7f3ca6f25800 10 cache get: name=default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC : hit (negative entry) 2024-09-12T00:31:57.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.491+0000 7f3ca6f25800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:31:57.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.491+0000 7f3ca6f25800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:31:57.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.491+0000 7f3ca6f25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:31:57.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.492+0000 7f3b867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366199 cookie 93854071779776 notifier 8820 bl.length()=670 2024-09-12T00:31:57.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.492+0000 7f3b867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:31:57.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.492+0000 7f3b867fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:31:57.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.497+0000 7f3ca6f25800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:31:57.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.497+0000 7f3ca6f25800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:31:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.497+0000 7f3ca6f25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:31:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.497+0000 7f3b867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 93854071786416 notifier 8820 bl.length()=200 2024-09-12T00:31:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.497+0000 7f3b867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:31:57.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.497+0000 7f3b867fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:31:57.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.500+0000 7f3ca6f25800 10 cache put: name=default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC info.flags=0x7 2024-09-12T00:31:57.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.500+0000 7f3ca6f25800 10 moving default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC to cache LRU end 2024-09-12T00:31:57.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.500+0000 7f3ca6f25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:DRREZVJUEGJIWCMYYESC, ofs0, ns] 2024-09-12T00:31:57.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.500+0000 7f3b85ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366200 cookie 93854071779776 notifier 8820 bl.length()=189 2024-09-12T00:31:57.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.500+0000 7f3b85ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC info.flags=0x7 2024-09-12T00:31:57.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.500+0000 7f3b85ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DRREZVJUEGJIWCMYYESC to cache LRU end 2024-09-12T00:31:57.500 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:31:57.500 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "tester.client.0", 2024-09-12T00:31:57.501 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:31:57.501 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:31:57.501 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:31:57.501 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:31:57.501 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:31:57.502 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:31:57.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:31:57.502 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "tester.client.0", 2024-09-12T00:31:57.502 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "DRREZVJUEGJIWCMYYESC", 2024-09-12T00:31:57.503 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "8rJFPwCI7Voxeyfjt8aQPBtAqCaEpioNBVvlT5BdkUGohmcoRO2iGw==", 2024-09-12T00:31:57.503 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:31:57.504 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:31:57.491106Z" 2024-09-12T00:31:57.504 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:31:57.504 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:31:57.504 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:31:57.504 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:31:57.504 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:31:57.505 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:31:57.505 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:31:57.505 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:31:57.505 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:31:57.505 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:31:57.505 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:31:57.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:31:57.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:31:57.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:31:57.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:31:57.506 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:31:57.506 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:31:57.507 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:31:57.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:31:57.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:31:57.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:31:57.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:31:57.508 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:31:57.508 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "rgw", 2024-09-12T00:31:57.508 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:31:57.508 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "", 2024-09-12T00:31:57.508 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:31:57.508 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:31:57.491089Z", 2024-09-12T00:31:57.509 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:31:57.509 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:31:57.509 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:31:57.509 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:31:57.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.502+0000 7f3b597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:57.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.506+0000 7f3ca6f25800 20 remove_watcher() i=0 2024-09-12T00:31:57.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.506+0000 7f3ca6f25800 2 removed watcher, disabling cache 2024-09-12T00:31:57.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.507+0000 7f3ca6f25800 20 remove_watcher() i=1 2024-09-12T00:31:57.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.508+0000 7f3ca6f25800 20 remove_watcher() i=2 2024-09-12T00:31:57.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.509+0000 7f3ca6f25800 20 remove_watcher() i=3 2024-09-12T00:31:57.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.511+0000 7f3ca6f25800 20 remove_watcher() i=4 2024-09-12T00:31:57.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.512+0000 7f3ca6f25800 20 remove_watcher() i=5 2024-09-12T00:31:57.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.513+0000 7f3ca6f25800 20 remove_watcher() i=6 2024-09-12T00:31:57.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.516+0000 7f3ca6f25800 20 remove_watcher() i=7 2024-09-12T00:31:57.528 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:31:57.528 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:31:57.561 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:31:57.561 DEBUG:teuthology.orchestra.run.smithi033:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:31:57.628 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:31:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:57.722 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:57.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.764+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.766+0000 7f59bb4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.766+0000 7f59bb4bb800 20 realm 2024-09-12T00:31:57.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.766+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.766+0000 7f59bb4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.766+0000 7f59bb4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:57.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.766+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.766+0000 7f59bb4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.766+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.767+0000 7f59bb4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:57.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.767+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.768+0000 7f59bb4bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:57.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.768+0000 7f59bb4bb800 20 searching for the correct realm 2024-09-12T00:31:57.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.769+0000 7f59b8fa5640 0 -- 172.21.15.33:0/465473312 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f59b4062070 msgr2=0x7f59b40a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:57.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.975+0000 7f59b3fff640 0 -- 172.21.15.33:0/465473312 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f59ac05b060 msgr2=0x7f59ac048030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:57.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:57.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:57.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:57.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:57.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:57.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:57.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:57.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.982+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 20 zone default found 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 4 Realm: () 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 20 zonegroup default 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.983+0000 7f59bb4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:31:57.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.984+0000 7f59bb4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:57.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.984+0000 7f59bb4bb800 20 started sync module instance, tier type = 2024-09-12T00:31:57.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.984+0000 7f59bb4bb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.993+0000 7f59bb4bb800 20 add_watcher() i=0 2024-09-12T00:31:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.993+0000 7f59bb4bb800 20 add_watcher() i=1 2024-09-12T00:31:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.993+0000 7f59bb4bb800 20 add_watcher() i=2 2024-09-12T00:31:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.993+0000 7f59bb4bb800 20 add_watcher() i=3 2024-09-12T00:31:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.993+0000 7f59bb4bb800 20 add_watcher() i=4 2024-09-12T00:31:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.993+0000 7f59bb4bb800 20 add_watcher() i=5 2024-09-12T00:31:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.993+0000 7f59bb4bb800 20 add_watcher() i=6 2024-09-12T00:31:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.994+0000 7f59bb4bb800 20 add_watcher() i=7 2024-09-12T00:31:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.994+0000 7f59bb4bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:57.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.996+0000 7f586f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:57.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.996+0000 7f59bb4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:57.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:57.996+0000 7f59bb4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:58.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.034+0000 7f586e7e4640 20 reqs_thread_entry: start 2024-09-12T00:31:58.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.034+0000 7f59bb4bb800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:58.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.034+0000 7f59bb4bb800 20 Filter name: none 2024-09-12T00:31:58.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.034+0000 7f5867fff640 20 reqs_thread_entry: start 2024-09-12T00:31:58.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.035+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:31:58.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.036+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.036+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.037+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.037+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_GKuZhZO6aM8z9Xhh2qgVEPBmGoZpIpP', time=2024-09-12T02:23:06.437512+0000, chain.objs.size()=2 2024-09-12T00:31:58.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.037+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.Qilc03yDIjhEiiz_JWCk36LzDn0q8B__1 2024-09-12T00:31:58.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.037+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.Qilc03yDIjhEiiz_JWCk36LzDn0q8B__2 2024-09-12T00:31:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.038+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.041+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:31:58.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.042+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.043+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.043+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.044+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:31:58.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.045+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.046+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.046+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.046+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_9z8pHboebCwnVTblDcYA-L83iMQyauP', time=2024-09-12T02:23:06.449984+0000, chain.objs.size()=2 2024-09-12T00:31:58.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.046+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.5FZibK090_fSaSXzPhTndhRVq37UN36_0 2024-09-12T00:31:58.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.046+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.5FZibK090_fSaSXzPhTndhRVq37UN36_1 2024-09-12T00:31:58.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.050+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.052+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:31:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.053+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.053+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.054+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:31:58.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.054+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_ZfbJx-feufZNxPbPPs-6VgmfWz-fS5f', time=2024-09-12T02:23:06.383153+0000, chain.objs.size()=1 2024-09-12T00:31:58.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.054+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.0GnNfDw-0P82Wrp33IJvak97nPJzfad_0 2024-09-12T00:31:58.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.054+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_i-rYVF5VVYRK-aAVZAZiUzLcwMlMPtc', time=2024-09-12T02:23:06.405397+0000, chain.objs.size()=1 2024-09-12T00:31:58.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.054+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.JCr1Z57KbCqDxPfrxoeoXLW1-HpVt93_0 2024-09-12T00:31:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.056+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.059+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:31:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.060+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.060+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.061+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.061+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9802233030281994754', time=2024-09-12T02:23:06.410248+0000, chain.objs.size()=1 2024-09-12T00:31:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.061+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.VZ9zvwv5WLW9JIq8AydDI9gGdazxrHO_0 2024-09-12T00:31:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.062+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.064+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:31:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.066+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.066+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.066+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.067+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:31:58.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.069+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.070+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.070+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.070+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17274097010246404863', time=2024-09-12T02:23:06.470978+0000, chain.objs.size()=3 2024-09-12T00:31:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.070+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.1 2024-09-12T00:31:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.070+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.2 2024-09-12T00:31:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.070+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.3 2024-09-12T00:31:58.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.071+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.073+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:31:58.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.075+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.075+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.076+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:31:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.076+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_bMI8IR3uKoUiPBekq0xyP0bb-QDLioy', time=2024-09-12T02:23:06.366425+0000, chain.objs.size()=1 2024-09-12T00:31:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.076+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.dW3StSUh2ghm5hWG1MKwdY28xwYLtoy_0 2024-09-12T00:31:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.076+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6521000508985767440', time=2024-09-12T02:23:06.504989+0000, chain.objs.size()=3 2024-09-12T00:31:58.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.076+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-FROZEN.2~c7xu676OKUObEFwjZQuN0xFhcxVnmvY.1 2024-09-12T00:31:58.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.076+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-FROZEN.2~c7xu676OKUObEFwjZQuN0xFhcxVnmvY.2 2024-09-12T00:31:58.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.076+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-FROZEN.2~c7xu676OKUObEFwjZQuN0xFhcxVnmvY.3 2024-09-12T00:31:58.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.082+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.085+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:31:58.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.086+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.086+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.087+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.087+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.812037649198332474', time=2024-09-12T02:23:06.401298+0000, chain.objs.size()=1 2024-09-12T00:31:58.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.087+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.UJKgrQw-VMdDbPTmYljSFpyVcUQr7Hj_0 2024-09-12T00:31:58.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.088+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.090+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:31:58.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.091+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.092+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.092+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.093+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:31:58.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.095+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.095+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.095+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.096+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:31:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.098+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.098+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.098+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.098+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6058135197744258908', time=2024-09-12T02:23:06.466521+0000, chain.objs.size()=3 2024-09-12T00:31:58.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.098+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.1 2024-09-12T00:31:58.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.098+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.2 2024-09-12T00:31:58.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.098+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.3 2024-09-12T00:31:58.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.100+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.102+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:31:58.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.104+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.104+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.104+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.104+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11891220471994533789', time=2024-09-12T02:23:06.312808+0000, chain.objs.size()=4 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.104+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11__multipart_foo.2~5JmT0o-C3m22UhL_tS1wXAd_2v60nl-.1 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.104+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11__multipart_foo.2~5JmT0o-C3m22UhL_tS1wXAd_2v60nl-.2 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.105+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11__multipart_foo.2~5JmT0o-C3m22UhL_tS1wXAd_2v60nl-.3 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.105+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11__multipart_foo.2~5JmT0o-C3m22UhL_tS1wXAd_2v60nl-.4 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.105+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1350686612888003823', time=2024-09-12T02:23:06.374568+0000, chain.objs.size()=1 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.105+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.VZ9zvwv5WLW9JIq8AydDI9gGdazxrHO_0 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.105+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17118100129180405829', time=2024-09-12T02:23:06.509511+0000, chain.objs.size()=3 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.105+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-STANDARD.2~gvONtXLOMo64XzGcyo8CcZ4h_zqBULg.1 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.105+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-STANDARD.2~gvONtXLOMo64XzGcyo8CcZ4h_zqBULg.2 2024-09-12T00:31:58.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.105+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-STANDARD.2~gvONtXLOMo64XzGcyo8CcZ4h_zqBULg.3 2024-09-12T00:31:58.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.108+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.110+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:31:58.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.111+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.112+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.112+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.113+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:31:58.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.114+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.115+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.116+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.117+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:31:58.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.118+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.118+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.119+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.119+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_m5M-R2C-VWsW6SPn0ZE1TK1BZHK7uzN', time=2024-09-12T02:23:06.458379+0000, chain.objs.size()=2 2024-09-12T00:31:58.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.119+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.nt8CntH8_t9bdcnclzCngr6gJedNtD4_1 2024-09-12T00:31:58.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.119+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.nt8CntH8_t9bdcnclzCngr6gJedNtD4_2 2024-09-12T00:31:58.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.121+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.123+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:31:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.125+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.125+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.126+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:31:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.126+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_TEUQ2RkLk1-SVO5zfHrxDeK3KJZSycU', time=2024-09-12T02:23:06.433136+0000, chain.objs.size()=1 2024-09-12T00:31:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.126+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.gpfmo8VSnYYz5GMbItpueb4-uVhFTZ6_0 2024-09-12T00:31:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.126+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12075984103037939474', time=2024-09-12T02:23:06.543569+0000, chain.objs.size()=2 2024-09-12T00:31:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.126+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14__shadow_.zy_JsR9v4j7pAS-yzIzukpQ6I0BG7-B_0 2024-09-12T00:31:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.126+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14__shadow_.zy_JsR9v4j7pAS-yzIzukpQ6I0BG7-B_1 2024-09-12T00:31:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.128+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.131+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:31:58.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.132+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.132+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.133+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.133+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10515876718468785174', time=2024-09-12T02:23:06.441699+0000, chain.objs.size()=3 2024-09-12T00:31:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.133+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.1 2024-09-12T00:31:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.133+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.2 2024-09-12T00:31:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.133+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.3 2024-09-12T00:31:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.134+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.136+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:31:58.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.137+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.138+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.138+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.138+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_3mwq_aTcsapZ7C5w8ZdIIe6Lkn3wRMO', time=2024-09-12T02:23:06.446002+0000, chain.objs.size()=2 2024-09-12T00:31:58.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.138+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.FZvhrgQ61-6hltUb2aA04k6hrcwoGjt_0 2024-09-12T00:31:58.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.138+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.FZvhrgQ61-6hltUb2aA04k6hrcwoGjt_1 2024-09-12T00:31:58.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.141+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.143+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:31:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.145+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.146+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.146+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.146+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.339850139422300829', time=2024-09-12T02:23:06.342473+0000, chain.objs.size()=4 2024-09-12T00:31:58.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.146+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10__multipart_foo.2~yf9MQWznC0tlOGNwdalps-pC_DnJm8t.1 2024-09-12T00:31:58.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.146+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10__multipart_foo.2~yf9MQWznC0tlOGNwdalps-pC_DnJm8t.2 2024-09-12T00:31:58.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.146+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10__multipart_foo.2~yf9MQWznC0tlOGNwdalps-pC_DnJm8t.3 2024-09-12T00:31:58.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.146+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10__multipart_foo.2~yf9MQWznC0tlOGNwdalps-pC_DnJm8t.4 2024-09-12T00:31:58.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.148+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.150+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:31:58.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.152+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.152+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.153+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.153+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8538537911214557494', time=2024-09-12T02:23:06.480982+0000, chain.objs.size()=3 2024-09-12T00:31:58.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.153+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.1 2024-09-12T00:31:58.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.153+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.2 2024-09-12T00:31:58.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.153+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-FROZEN.2~q5VFl3I44qm1pwwiN9EEDxrjsuSSmH5.3 2024-09-12T00:31:58.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.155+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.158+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:31:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.159+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.159+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.761558948079615941', time=2024-09-12T02:23:06.260402+0000, chain.objs.size()=4 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12__multipart_foo.2~pFORWXdcC5QnLrQe1vUM0bSeForCJIg.1 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12__multipart_foo.2~pFORWXdcC5QnLrQe1vUM0bSeForCJIg.2 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12__multipart_foo.2~pFORWXdcC5QnLrQe1vUM0bSeForCJIg.3 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12__multipart_foo.2~pFORWXdcC5QnLrQe1vUM0bSeForCJIg.4 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3741958473258818720', time=2024-09-12T02:23:06.286362+0000, chain.objs.size()=4 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13__multipart_foo.2~Qi3nBS9Yct2gCEzHPn_KVMKzsHf3srD.1 2024-09-12T00:31:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13__multipart_foo.2~Qi3nBS9Yct2gCEzHPn_KVMKzsHf3srD.2 2024-09-12T00:31:58.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13__multipart_foo.2~Qi3nBS9Yct2gCEzHPn_KVMKzsHf3srD.3 2024-09-12T00:31:58.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.160+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13__multipart_foo.2~Qi3nBS9Yct2gCEzHPn_KVMKzsHf3srD.4 2024-09-12T00:31:58.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.163+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.165+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:31:58.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.167+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.167+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.167+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.167+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16446452755842528498', time=2024-09-12T02:23:06.536022+0000, chain.objs.size()=2 2024-09-12T00:31:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.167+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14__shadow_.ERj7mLRv1DYJefXpp4odevAwY29kmCY_0 2024-09-12T00:31:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.167+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14__shadow_.ERj7mLRv1DYJefXpp4odevAwY29kmCY_1 2024-09-12T00:31:58.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.170+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.172+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:31:58.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.173+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.174+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.174+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.174+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.187960881258044629', time=2024-09-12T02:23:06.454097+0000, chain.objs.size()=3 2024-09-12T00:31:58.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.174+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.1 2024-09-12T00:31:58.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.174+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.2 2024-09-12T00:31:58.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.174+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-STANDARD.2~5Fck2awvh0L8S3Z6Q0Izaz0B6u_0zoM.3 2024-09-12T00:31:58.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.176+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.178+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:31:58.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.179+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.180+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.180+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.181+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:31:58.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.182+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.183+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.183+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:31:58.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.183+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_KJUTIirt4Ndl5niOsd8UB9ukUwnH1kX', time=2024-09-12T02:23:06.378917+0000, chain.objs.size()=1 2024-09-12T00:31:58.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.183+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.D1o4XPIKgaqXzISi_xx5i6AgM5ieJ1s_0 2024-09-12T00:31:58.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.183+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_apqim-GRIzi5QvrMwjPMcWNw1G2v7OX', time=2024-09-12T02:23:06.476754+0000, chain.objs.size()=1 2024-09-12T00:31:58.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.183+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__shadow_.M6EWKlsP6PXbF9NS94I0I9jokYHcb4d_0 2024-09-12T00:31:58.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.185+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.188+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:31:58.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.189+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.190+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.190+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:31:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.190+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_dEfXOVeltz8ojTPngXElXfR29SeM0wc', time=2024-09-12T02:23:06.370690+0000, chain.objs.size()=1 2024-09-12T00:31:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.190+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.IQ1wkY3JZOTi8v9letUVdK0Po0Efeby_1 2024-09-12T00:31:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.190+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.787241855193822931', time=2024-09-12T02:23:06.513782+0000, chain.objs.size()=3 2024-09-12T00:31:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.190+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-LUKEWARM.2~8NlwYfwKu79rc3c_eZOw1cUg_5ESSSP.1 2024-09-12T00:31:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.190+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-LUKEWARM.2~8NlwYfwKu79rc3c_eZOw1cUg_5ESSSP.2 2024-09-12T00:31:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.190+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15__multipart_foo-LUKEWARM.2~8NlwYfwKu79rc3c_eZOw1cUg_5ESSSP.3 2024-09-12T00:31:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.193+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.195+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:31:58.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.197+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.197+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.197+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.197+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16834470540148393673', time=2024-09-12T02:23:06.462449+0000, chain.objs.size()=3 2024-09-12T00:31:58.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.197+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.1 2024-09-12T00:31:58.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.197+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.2 2024-09-12T00:31:58.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.197+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17__multipart_foo-LUKEWARM.2~qtgbLC-3oH2qqKPH9IFYcQLVWsUgy6X.3 2024-09-12T00:31:58.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.200+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.202+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:31:58.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.203+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.203+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.204+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.205+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:31:58.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.206+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.207+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.207+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.207+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.840223848198242399', time=2024-09-12T02:23:06.394146+0000, chain.objs.size()=1 2024-09-12T00:31:58.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.207+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.UJKgrQw-VMdDbPTmYljSFpyVcUQr7Hj_0 2024-09-12T00:31:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.209+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.211+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:31:58.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.212+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.213+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.213+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.214+0000 7f59bb4bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:31:58.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.215+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.216+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.216+0000 7f59bb4bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:31:58.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.216+0000 7f59bb4bb800 20 garbage collection: RGWGC::process iterating over entry tag='_ZZ2hmMqduE-aeZUsoExQ6ylHtndHlyc', time=2024-09-12T02:23:06.390293+0000, chain.objs.size()=1 2024-09-12T00:31:58.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.216+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16__shadow_.tSAEI11KL7L0x2xjW8S1p0-Uf1hCaV1_1 2024-09-12T00:31:58.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.217+0000 7f59bb4bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:31:58.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.220+0000 7f586f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:58.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.222+0000 7f59bb4bb800 20 remove_watcher() i=0 2024-09-12T00:31:58.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.222+0000 7f59bb4bb800 2 removed watcher, disabling cache 2024-09-12T00:31:58.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.223+0000 7f59bb4bb800 20 remove_watcher() i=1 2024-09-12T00:31:58.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.224+0000 7f59bb4bb800 20 remove_watcher() i=2 2024-09-12T00:31:58.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.225+0000 7f59bb4bb800 20 remove_watcher() i=3 2024-09-12T00:31:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.226+0000 7f59bb4bb800 20 remove_watcher() i=4 2024-09-12T00:31:58.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.227+0000 7f59bb4bb800 20 remove_watcher() i=5 2024-09-12T00:31:58.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.228+0000 7f59bb4bb800 20 remove_watcher() i=6 2024-09-12T00:31:58.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.229+0000 7f59bb4bb800 20 remove_watcher() i=7 2024-09-12T00:31:58.239 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:31:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:58.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.333+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.334+0000 7fc62a124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.334+0000 7fc62a124800 20 realm 2024-09-12T00:31:58.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.334+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.335+0000 7fc62a124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.335+0000 7fc62a124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:58.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.335+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.335+0000 7fc62a124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.335+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.336+0000 7fc62a124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:58.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.336+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.337+0000 7fc62a124800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:58.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.337+0000 7fc62a124800 20 searching for the correct realm 2024-09-12T00:31:58.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.340+0000 7fc626669640 0 -- 172.21.15.33:0/3073988861 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5620cfb0e880 msgr2=0x5620cfb10d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:58.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.343+0000 7fc625e68640 0 -- 172.21.15.33:0/3073988861 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fc61c029070 msgr2=0x7fc61c060730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:31:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:31:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:58.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.347+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 20 zone default found 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 4 Realm: () 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 20 zonegroup default 2024-09-12T00:31:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.348+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.349+0000 7fc62a124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.349+0000 7fc62a124800 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.349+0000 7fc62a124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.349+0000 7fc62a124800 20 started sync module instance, tier type = 2024-09-12T00:31:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.349+0000 7fc62a124800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:31:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.357+0000 7fc62a124800 20 add_watcher() i=0 2024-09-12T00:31:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.357+0000 7fc62a124800 20 add_watcher() i=1 2024-09-12T00:31:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.357+0000 7fc62a124800 20 add_watcher() i=2 2024-09-12T00:31:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.357+0000 7fc62a124800 20 add_watcher() i=3 2024-09-12T00:31:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.357+0000 7fc62a124800 20 add_watcher() i=4 2024-09-12T00:31:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.357+0000 7fc62a124800 20 add_watcher() i=5 2024-09-12T00:31:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.357+0000 7fc62a124800 20 add_watcher() i=6 2024-09-12T00:31:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.358+0000 7fc62a124800 20 add_watcher() i=7 2024-09-12T00:31:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.358+0000 7fc62a124800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.360+0000 7fc4d7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.361+0000 7fc62a124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.361+0000 7fc62a124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:58.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.396+0000 7fc4d6ffd640 20 reqs_thread_entry: start 2024-09-12T00:31:58.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.396+0000 7fc62a124800 20 init_complete bucket index max shards: 11 2024-09-12T00:31:58.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.396+0000 7fc62a124800 20 Filter name: none 2024-09-12T00:31:58.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.396+0000 7fc4d4ff9640 20 reqs_thread_entry: start 2024-09-12T00:31:58.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.396+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:31:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.398+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.398+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.398+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.399+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:31:58.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.401+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.401+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.401+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.402+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:31:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.404+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.404+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.404+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.405+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:31:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.407+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.407+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.407+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.408+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:31:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.410+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.410+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.410+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.411+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:31:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.413+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.413+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.413+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.414+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:31:58.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.416+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.416+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.417+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.417+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:31:58.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.419+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.419+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.419+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.420+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:31:58.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.422+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.422+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.422+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.423+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:31:58.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.425+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.425+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.425+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.426+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:31:58.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.428+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.429+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.429+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.430+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:31:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.431+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.432+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.432+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.433+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:31:58.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.434+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.435+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.435+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.436+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:31:58.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.438+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.438+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.438+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.439+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:31:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.441+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.441+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.441+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.442+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:31:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.444+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.444+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.444+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.445+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:31:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.447+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.447+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.448+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.449+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:31:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.450+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.450+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.451+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.452+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:31:58.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.453+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.453+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.454+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.455+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:31:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.456+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.457+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.457+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.458+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:31:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.459+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.460+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.460+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.461+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.462+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.463+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.463+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.464+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:31:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.465+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.466+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.466+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.467+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:31:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.469+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.469+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.470+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.471+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:31:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.472+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.473+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.473+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.474+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:31:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.476+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.476+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.476+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.478+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:31:58.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.479+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.480+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.480+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.481+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:31:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.483+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.483+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.483+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.485+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:31:58.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.486+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.486+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.487+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.488+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:31:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.489+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.490+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.490+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.491+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:31:58.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.492+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.493+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.493+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.494+0000 7fc62a124800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:31:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.495+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.496+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:31:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.496+0000 7fc62a124800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:31:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.498+0000 7fc4d7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.501+0000 7fc62a124800 20 remove_watcher() i=0 2024-09-12T00:31:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.501+0000 7fc62a124800 2 removed watcher, disabling cache 2024-09-12T00:31:58.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.502+0000 7fc62a124800 20 remove_watcher() i=1 2024-09-12T00:31:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.503+0000 7fc62a124800 20 remove_watcher() i=2 2024-09-12T00:31:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.504+0000 7fc62a124800 20 remove_watcher() i=3 2024-09-12T00:31:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.505+0000 7fc62a124800 20 remove_watcher() i=4 2024-09-12T00:31:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.506+0000 7fc62a124800 20 remove_watcher() i=5 2024-09-12T00:31:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.507+0000 7fc62a124800 20 remove_watcher() i=6 2024-09-12T00:31:58.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:31:58.508+0000 7fc62a124800 20 remove_watcher() i=7 2024-09-12T00:31:58.520 DEBUG:teuthology.orchestra.run.smithi033:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:31:59.014 INFO:teuthology.orchestra.run.smithi033.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:32:02.615 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:32:20.714 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :compileJava 2024-09-12T00:32:20.714 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :processResources 2024-09-12T00:32:20.714 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :classes 2024-09-12T00:32:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:21.514 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :compileTestJava 2024-09-12T00:32:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:32:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:32:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:21.515 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:32:21.515 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :testClasses 2024-09-12T00:32:27.513 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:27.513 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :test 2024-09-12T00:32:27.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:27.514 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:32:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:33.313 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:32:33.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:33.713 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:32:33.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:33.813 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:32:34.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:34.213 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:32:43.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:43.213 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:32:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:43.713 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:32:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:43.714 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:32:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:43.813 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:32:43.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:43.913 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:32:44.313 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:44.313 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:32:49.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:49.713 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:32:50.513 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:50.513 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:32:50.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:32:50.713 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:32:50.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:32:50,703 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:33:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:26.714 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:33:27.513 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:27.513 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:33:27.613 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:27.613 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:33:28.013 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:28.013 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:33:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:28.213 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:33:28.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:28.813 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:33:34.413 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:34.413 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:33:34.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:34.813 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:33:34.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:34.913 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:33:35.013 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:35.013 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:33:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:43.813 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:33:45.414 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:45.414 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-12T00:33:45.414 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:33:45,355 [s3-transfer-manager-worker-7] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:33:45.414 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:33:45,359 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:33:45.414 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:33:45,361 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:33:45.414 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:33:45,364 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:33:45.613 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:45.613 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:33:55.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:55.814 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:33:56.413 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:56.413 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:33:58.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:58.914 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:33:59.413 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:33:59.413 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:35:10.414 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:10.415 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:35:10.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:10.913 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:35:19.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:19.214 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:35:19.613 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:19.614 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:35:24.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:24.913 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:35:25.313 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:25.313 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:35:27.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:35:33.613 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:33.613 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:35:33.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:33.713 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:35:34.113 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:34.113 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:35:34.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:34.213 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:35:34.613 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:34.613 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:35:34.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:34.713 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:35:35.113 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:35.113 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:35:35.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:35.213 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:35:35.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:35.913 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:35:36.013 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:36.013 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:35:36.413 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:36.413 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:35:36.513 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:36.513 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:35:36.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:36.913 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:35:37.013 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:37.013 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:35:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:37.413 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:35:49.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:49.213 INFO:teuthology.orchestra.run.smithi033.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:35:49.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:49.713 INFO:teuthology.orchestra.run.smithi033.stdout:---------------------------------------------------------------------- 2024-09-12T00:35:49.714 INFO:teuthology.orchestra.run.smithi033.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:35:49.714 INFO:teuthology.orchestra.run.smithi033.stdout:---------------------------------------------------------------------- 2024-09-12T00:35:49.749 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:49.749 INFO:teuthology.orchestra.run.smithi033.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:35:49.749 INFO:teuthology.orchestra.run.smithi033.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:35:49.749 INFO:teuthology.orchestra.run.smithi033.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:35:49.749 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:49.750 INFO:teuthology.orchestra.run.smithi033.stdout:BUILD SUCCESSFUL in 3m 51s 2024-09-12T00:35:49.750 INFO:teuthology.orchestra.run.smithi033.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:35:50.068 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:35:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:50.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.163+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.165+0000 7f7665f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.165+0000 7f7665f20800 20 realm 2024-09-12T00:35:50.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.165+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.165+0000 7f7665f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.165+0000 7f7665f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:50.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.165+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.165+0000 7f7665f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.165+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.166+0000 7f7665f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:50.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.166+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.167+0000 7f7665f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:50.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.167+0000 7f7665f20800 20 searching for the correct realm 2024-09-12T00:35:50.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.171+0000 7f7662469640 0 -- 172.21.15.33:0/644411212 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f7658015070 msgr2=0x7f7658034920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.377+0000 7f7661c68640 0 -- 172.21.15.33:0/644411212 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x559bb3d74580 msgr2=0x559bb3d769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.380+0000 7f7665f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.380+0000 7f7665f20800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:35:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.380+0000 7f7665f20800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:35:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.380+0000 7f7665f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.380+0000 7f7665f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.380+0000 7f7665f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.380+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:50.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:50.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 20 zone default found 2024-09-12T00:35:50.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 4 Realm: () 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 20 zonegroup default 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.381+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.382+0000 7f7665f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.382+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.382+0000 7f7665f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.382+0000 7f7665f20800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.382+0000 7f7665f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.382+0000 7f7665f20800 20 started sync module instance, tier type = 2024-09-12T00:35:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.382+0000 7f7665f20800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:35:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.392+0000 7f7665f20800 20 add_watcher() i=0 2024-09-12T00:35:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.392+0000 7f7665f20800 20 add_watcher() i=1 2024-09-12T00:35:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.392+0000 7f7665f20800 20 add_watcher() i=2 2024-09-12T00:35:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.392+0000 7f7665f20800 20 add_watcher() i=3 2024-09-12T00:35:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.392+0000 7f7665f20800 20 add_watcher() i=4 2024-09-12T00:35:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.392+0000 7f7665f20800 20 add_watcher() i=5 2024-09-12T00:35:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.392+0000 7f7665f20800 20 add_watcher() i=6 2024-09-12T00:35:50.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.393+0000 7f7665f20800 20 add_watcher() i=7 2024-09-12T00:35:50.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.393+0000 7f7665f20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.395+0000 7f7513fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:50.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.395+0000 7f7665f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:50.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.395+0000 7f7665f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.433+0000 7f7512ffd640 20 reqs_thread_entry: start 2024-09-12T00:35:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.433+0000 7f7665f20800 20 init_complete bucket index max shards: 11 2024-09-12T00:35:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.433+0000 7f7665f20800 20 Filter name: none 2024-09-12T00:35:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.434+0000 7f7510ff9640 20 reqs_thread_entry: start 2024-09-12T00:35:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.434+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:35:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.435+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.436+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.436+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.437+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:35:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.438+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.439+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.439+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.439+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5729349362911583759', time=2024-09-12T02:35:19.278754+0000, chain.objs.size()=5 2024-09-12T00:35:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.439+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.57__multipart_key1.2~HOcPW4G56QTO9-Desi0dcra9C-NzZBr.1 2024-09-12T00:35:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.439+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.57__multipart_key1.2~HOcPW4G56QTO9-Desi0dcra9C-NzZBr.2 2024-09-12T00:35:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.439+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.57__multipart_key1.2~HOcPW4G56QTO9-Desi0dcra9C-NzZBr.3 2024-09-12T00:35:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.439+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.57__multipart_key1.2~HOcPW4G56QTO9-Desi0dcra9C-NzZBr.4 2024-09-12T00:35:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.439+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.57__multipart_key1.2~HOcPW4G56QTO9-Desi0dcra9C-NzZBr.5 2024-09-12T00:35:50.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.442+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.445+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:35:50.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.447+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.447+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.448+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.449+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:35:50.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.450+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.450+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:35:50.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14795281342560983173', time=2024-09-12T02:33:07.400370+0000, chain.objs.size()=5 2024-09-12T00:35:50.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Ur299A0buptBTE8wFCVrolfLLP-k9TM.1 2024-09-12T00:35:50.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Ur299A0buptBTE8wFCVrolfLLP-k9TM.2 2024-09-12T00:35:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Ur299A0buptBTE8wFCVrolfLLP-k9TM.3 2024-09-12T00:35:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Ur299A0buptBTE8wFCVrolfLLP-k9TM.4 2024-09-12T00:35:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Ur299A0buptBTE8wFCVrolfLLP-k9TM.5 2024-09-12T00:35:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4855814913624672626', time=2024-09-12T02:33:56.000468+0000, chain.objs.size()=4 2024-09-12T00:35:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file2.mpg.2~AwJvRXrv-aU45vmxTe65RWkFh7Jko7p.1 2024-09-12T00:35:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file2.mpg.2~AwJvRXrv-aU45vmxTe65RWkFh7Jko7p.2 2024-09-12T00:35:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file2.mpg.2~AwJvRXrv-aU45vmxTe65RWkFh7Jko7p.3 2024-09-12T00:35:50.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.451+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file2.mpg.2~AwJvRXrv-aU45vmxTe65RWkFh7Jko7p.4 2024-09-12T00:35:50.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.455+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.457+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:35:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.459+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.459+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.459+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.460+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:35:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.462+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.462+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.462+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.463+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:35:50.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.464+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.465+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.465+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.465+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.182617670348096038', time=2024-09-12T02:35:24.980724+0000, chain.objs.size()=5 2024-09-12T00:35:50.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.465+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.58__multipart_key1.2~UMYW8PVLCJ0_Z8m6C9ylTJOC7QvWRY3.1 2024-09-12T00:35:50.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.465+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.58__multipart_key1.2~UMYW8PVLCJ0_Z8m6C9ylTJOC7QvWRY3.2 2024-09-12T00:35:50.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.465+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.58__multipart_key1.2~UMYW8PVLCJ0_Z8m6C9ylTJOC7QvWRY3.3 2024-09-12T00:35:50.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.465+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.58__multipart_key1.2~UMYW8PVLCJ0_Z8m6C9ylTJOC7QvWRY3.4 2024-09-12T00:35:50.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.465+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.58__multipart_key1.2~UMYW8PVLCJ0_Z8m6C9ylTJOC7QvWRY3.5 2024-09-12T00:35:50.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.468+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.471+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:35:50.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.472+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12477533611971549546', time=2024-09-12T02:35:49.354277+0000, chain.objs.size()=11 2024-09-12T00:35:50.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.1 2024-09-12T00:35:50.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.2 2024-09-12T00:35:50.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.3 2024-09-12T00:35:50.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.4 2024-09-12T00:35:50.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.5 2024-09-12T00:35:50.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.6 2024-09-12T00:35:50.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.7 2024-09-12T00:35:50.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.473+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.8 2024-09-12T00:35:50.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.474+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.9 2024-09-12T00:35:50.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.474+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.10 2024-09-12T00:35:50.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.474+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.67__multipart_key1.2~-w4MUG5slLOU8rt9zYLdOa7ksVydOW5.11 2024-09-12T00:35:50.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.480+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.482+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:35:50.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.483+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.484+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.484+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.485+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:35:50.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.486+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.487+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.487+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.487+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3040350092729030613', time=2024-09-12T02:33:44.844121+0000, chain.objs.size()=5 2024-09-12T00:35:50.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.487+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.53__multipart_key1.2~0g0h0Zy9QHQWqCFbAe06Q380xP-vWAe.1 2024-09-12T00:35:50.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.487+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.53__multipart_key1.2~0g0h0Zy9QHQWqCFbAe06Q380xP-vWAe.2 2024-09-12T00:35:50.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.487+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.53__multipart_key1.2~0g0h0Zy9QHQWqCFbAe06Q380xP-vWAe.3 2024-09-12T00:35:50.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.487+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.53__multipart_key1.2~0g0h0Zy9QHQWqCFbAe06Q380xP-vWAe.4 2024-09-12T00:35:50.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.487+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.53__multipart_key1.2~0g0h0Zy9QHQWqCFbAe06Q380xP-vWAe.5 2024-09-12T00:35:50.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.491+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.493+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:35:50.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.494+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.495+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.495+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.496+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:35:50.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.498+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.498+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:35:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.949110395491242984', time=2024-09-12T02:33:03.391478+0000, chain.objs.size()=5 2024-09-12T00:35:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~69jHShcQ9wNi6z3aiZTDGj4iuAXoAmr.1 2024-09-12T00:35:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~69jHShcQ9wNi6z3aiZTDGj4iuAXoAmr.2 2024-09-12T00:35:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~69jHShcQ9wNi6z3aiZTDGj4iuAXoAmr.3 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~69jHShcQ9wNi6z3aiZTDGj4iuAXoAmr.4 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~69jHShcQ9wNi6z3aiZTDGj4iuAXoAmr.5 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7268707114914972878', time=2024-09-12T02:34:23.114731+0000, chain.objs.size()=11 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.1 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.2 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.3 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.4 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.5 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.6 2024-09-12T00:35:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.499+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.7 2024-09-12T00:35:50.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.502+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.8 2024-09-12T00:35:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.504+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.9 2024-09-12T00:35:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.504+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.10 2024-09-12T00:35:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.504+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~zTg1VpNPrlCzP1JShFUUi2CcweB2diQ.11 2024-09-12T00:35:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.507+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.510+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:35:50.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.511+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.512+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.512+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.512+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4965559488281235226', time=2024-09-12T02:33:23.207524+0000, chain.objs.size()=5 2024-09-12T00:35:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.512+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~-wkz5wzJFXqRd4nqbsms49RTBJ97bEL.1 2024-09-12T00:35:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.512+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__shadow_key1.2~-wkz5wzJFXqRd4nqbsms49RTBJ97bEL.1_1 2024-09-12T00:35:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.512+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~-wkz5wzJFXqRd4nqbsms49RTBJ97bEL.2 2024-09-12T00:35:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.512+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__shadow_key1.2~-wkz5wzJFXqRd4nqbsms49RTBJ97bEL.2_1 2024-09-12T00:35:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.512+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~-wkz5wzJFXqRd4nqbsms49RTBJ97bEL.3 2024-09-12T00:35:50.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.515+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.517+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:35:50.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.518+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.519+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.519+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.520+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:35:50.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.522+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.522+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.523+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.523+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11053978767480555136', time=2024-09-12T02:32:43.365380+0000, chain.objs.size()=5 2024-09-12T00:35:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.523+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.43__multipart_key1.2~nrYKE17xKiCuBuhUTaNlTkXpqCDGYvF.1 2024-09-12T00:35:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.523+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.43__multipart_key1.2~nrYKE17xKiCuBuhUTaNlTkXpqCDGYvF.2 2024-09-12T00:35:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.523+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.43__multipart_key1.2~nrYKE17xKiCuBuhUTaNlTkXpqCDGYvF.3 2024-09-12T00:35:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.523+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.43__multipart_key1.2~nrYKE17xKiCuBuhUTaNlTkXpqCDGYvF.4 2024-09-12T00:35:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.523+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.43__multipart_key1.2~nrYKE17xKiCuBuhUTaNlTkXpqCDGYvF.5 2024-09-12T00:35:50.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.524+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.528+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:35:50.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.529+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.529+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:35:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5408110149616268698', time=2024-09-12T02:33:19.806282+0000, chain.objs.size()=5 2024-09-12T00:35:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Q8i_QnicA4jtiQLc2nqJM4Xq2Qb554o.1 2024-09-12T00:35:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Q8i_QnicA4jtiQLc2nqJM4Xq2Qb554o.2 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Q8i_QnicA4jtiQLc2nqJM4Xq2Qb554o.3 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Q8i_QnicA4jtiQLc2nqJM4Xq2Qb554o.4 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~Q8i_QnicA4jtiQLc2nqJM4Xq2Qb554o.5 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15248024592954192888', time=2024-09-12T02:33:26.828029+0000, chain.objs.size()=5 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~a69Y6HydJhEJhoWpuYE7wJQESSi59Ck.1 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__shadow_key1.2~a69Y6HydJhEJhoWpuYE7wJQESSi59Ck.1_1 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~a69Y6HydJhEJhoWpuYE7wJQESSi59Ck.2 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__shadow_key1.2~a69Y6HydJhEJhoWpuYE7wJQESSi59Ck.2_1 2024-09-12T00:35:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.530+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~a69Y6HydJhEJhoWpuYE7wJQESSi59Ck.3 2024-09-12T00:35:50.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.534+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.536+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:35:50.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.538+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.538+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:35:50.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6722906120011194279', time=2024-09-12T02:32:50.175476+0000, chain.objs.size()=5 2024-09-12T00:35:50.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.1 2024-09-12T00:35:50.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.2 2024-09-12T00:35:50.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.3 2024-09-12T00:35:50.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.4 2024-09-12T00:35:50.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.5 2024-09-12T00:35:50.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14587535612643271720', time=2024-09-12T02:34:34.727067+0000, chain.objs.size()=11 2024-09-12T00:35:50.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.1 2024-09-12T00:35:50.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.2 2024-09-12T00:35:50.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.3 2024-09-12T00:35:50.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.4 2024-09-12T00:35:50.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.5 2024-09-12T00:35:50.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.6 2024-09-12T00:35:50.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.539+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.7 2024-09-12T00:35:50.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.541+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.8 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.9 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.10 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~IlyWYBxJi_V0EhvKu-0eovpEh1lHT4f.11 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6', time=2024-09-12T02:35:31.190030+0000, chain.objs.size()=1 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.18 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6', time=2024-09-12T02:35:31.251172+0000, chain.objs.size()=49 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.1 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.2 2024-09-12T00:35:50.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.3 2024-09-12T00:35:50.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.4 2024-09-12T00:35:50.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.5 2024-09-12T00:35:50.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.544+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.6 2024-09-12T00:35:50.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.546+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.7 2024-09-12T00:35:50.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.547+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.8 2024-09-12T00:35:50.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.547+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.9 2024-09-12T00:35:50.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.547+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.10 2024-09-12T00:35:50.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.549+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.11 2024-09-12T00:35:50.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.549+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.12 2024-09-12T00:35:50.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.549+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.13 2024-09-12T00:35:50.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.549+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.14 2024-09-12T00:35:50.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.549+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.15 2024-09-12T00:35:50.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.549+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.16 2024-09-12T00:35:50.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.549+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.17 2024-09-12T00:35:50.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.549+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.qsQf0oyxd2mojdTp97-K_fw0opBhH3fU.18 2024-09-12T00:35:50.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.551+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.19 2024-09-12T00:35:50.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.20 2024-09-12T00:35:50.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.21 2024-09-12T00:35:50.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.22 2024-09-12T00:35:50.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.23 2024-09-12T00:35:50.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.24 2024-09-12T00:35:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.25 2024-09-12T00:35:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.26 2024-09-12T00:35:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.27 2024-09-12T00:35:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.28 2024-09-12T00:35:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.29 2024-09-12T00:35:50.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.554+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.30 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.557+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.31 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.557+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.32 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.557+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.33 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.557+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.34 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.557+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.35 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.557+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.36 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.558+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.37 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.559+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.38 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.559+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.39 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.559+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.40 2024-09-12T00:35:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.559+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.41 2024-09-12T00:35:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.563+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.42 2024-09-12T00:35:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.563+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.43 2024-09-12T00:35:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.563+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.44 2024-09-12T00:35:50.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.566+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.45 2024-09-12T00:35:50.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.566+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.46 2024-09-12T00:35:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.566+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.47 2024-09-12T00:35:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.566+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.48 2024-09-12T00:35:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.566+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.59__multipart_key1.2~ukhHarqCeVp8IcHMY_PQLzuXbrZ2Id6.49 2024-09-12T00:35:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.572+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.574+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:35:50.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.575+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:35:50.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9164055280441314000', time=2024-09-12T02:33:34.487998+0000, chain.objs.size()=5 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.52__multipart_key1.2~xsg_MRBa0hYINhDz_d6QOAxVr8U2zwQ.1 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.52__multipart_key1.2~xsg_MRBa0hYINhDz_d6QOAxVr8U2zwQ.2 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.52__multipart_key1.2~xsg_MRBa0hYINhDz_d6QOAxVr8U2zwQ.3 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.52__multipart_key1.2~xsg_MRBa0hYINhDz_d6QOAxVr8U2zwQ.4 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.52__multipart_key1.2~xsg_MRBa0hYINhDz_d6QOAxVr8U2zwQ.5 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11152370772119184507', time=2024-09-12T02:35:10.570154+0000, chain.objs.size()=11 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.1 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.1_1 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.2 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.2_1 2024-09-12T00:35:50.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.3 2024-09-12T00:35:50.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.3_1 2024-09-12T00:35:50.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.576+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.4 2024-09-12T00:35:50.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.581+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.4_1 2024-09-12T00:35:50.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.581+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.5 2024-09-12T00:35:50.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.581+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.5_1 2024-09-12T00:35:50.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.581+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~PSgb_b8DHs3bgu4W48uQUJApIkgXd9P.6 2024-09-12T00:35:50.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.585+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.587+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:35:50.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.589+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.589+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.589+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.590+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:35:50.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11535863672037771689', time=2024-09-12T02:34:58.087932+0000, chain.objs.size()=11 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.1 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.1_1 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.2 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.2_1 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.3 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.3_1 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.4 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.4_1 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.5 2024-09-12T00:35:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.5_1 2024-09-12T00:35:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.592+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~EzTp-5abmvw8OmjwHk9yFY7TTGt7WL0.6 2024-09-12T00:35:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.597+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.600+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:35:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.601+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13145238402112531611', time=2024-09-12T02:35:10.349783+0000, chain.objs.size()=11 2024-09-12T00:35:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.1 2024-09-12T00:35:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.1_1 2024-09-12T00:35:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.2 2024-09-12T00:35:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.2_1 2024-09-12T00:35:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.3 2024-09-12T00:35:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.3_1 2024-09-12T00:35:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.4 2024-09-12T00:35:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.4_1 2024-09-12T00:35:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.5 2024-09-12T00:35:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__shadow_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.5_1 2024-09-12T00:35:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.602+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~hNDf9auu54jmlJUE4IM5l0yJ24BYy96.6 2024-09-12T00:35:50.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.606+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.609+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:35:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.610+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.611+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.611+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.611+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~6Wo1-aO7DeDTuClRGeIP9MEInuLotqq', time=2024-09-12T02:32:33.222193+0000, chain.objs.size()=5 2024-09-12T00:35:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.611+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.41__multipart_key1.2~6Wo1-aO7DeDTuClRGeIP9MEInuLotqq.1 2024-09-12T00:35:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.611+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.41__multipart_key1.2~6Wo1-aO7DeDTuClRGeIP9MEInuLotqq.2 2024-09-12T00:35:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.611+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.41__multipart_key1.2~6Wo1-aO7DeDTuClRGeIP9MEInuLotqq.3 2024-09-12T00:35:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.611+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.41__multipart_key1.2~6Wo1-aO7DeDTuClRGeIP9MEInuLotqq.4 2024-09-12T00:35:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.611+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.41__multipart_key1.2~6Wo1-aO7DeDTuClRGeIP9MEInuLotqq.5 2024-09-12T00:35:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.614+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.616+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:35:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.618+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.618+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.618+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.619+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:35:50.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.621+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.621+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.621+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.622+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:35:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.624+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.625+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.625+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.626+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:35:50.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.627+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.627+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.628+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.629+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:35:50.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.630+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11098123987247882129', time=2024-09-12T02:33:27.194308+0000, chain.objs.size()=4 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.47__shadow_.-gkgsewIENttCTo9jVj-SclTeFz0XHX_1 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.47__shadow_.-gkgsewIENttCTo9jVj-SclTeFz0XHX_2 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.47__shadow_.-gkgsewIENttCTo9jVj-SclTeFz0XHX_3 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.47__shadow_.-gkgsewIENttCTo9jVj-SclTeFz0XHX_4 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='2~0WLV0JvoZTPaTn5TjZvtZReUQY-Z8bN', time=2024-09-12T02:33:59.185008+0000, chain.objs.size()=3 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.55__multipart_key1.2~0WLV0JvoZTPaTn5TjZvtZReUQY-Z8bN.7 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.55__multipart_key1.2~0WLV0JvoZTPaTn5TjZvtZReUQY-Z8bN.10 2024-09-12T00:35:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.631+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.55__multipart_key1.2~0WLV0JvoZTPaTn5TjZvtZReUQY-Z8bN.13 2024-09-12T00:35:50.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.635+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.637+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:35:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.638+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.639+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.639+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.639+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7933601301560409996', time=2024-09-12T02:33:26.602063+0000, chain.objs.size()=5 2024-09-12T00:35:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.639+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~-qeoBOAoXyBCDWm0nIf9OsOpkqp93m5.1 2024-09-12T00:35:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.639+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__shadow_key1.2~-qeoBOAoXyBCDWm0nIf9OsOpkqp93m5.1_1 2024-09-12T00:35:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.639+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~-qeoBOAoXyBCDWm0nIf9OsOpkqp93m5.2 2024-09-12T00:35:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.639+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__shadow_key1.2~-qeoBOAoXyBCDWm0nIf9OsOpkqp93m5.2_1 2024-09-12T00:35:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.639+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.48__multipart_key1.2~-qeoBOAoXyBCDWm0nIf9OsOpkqp93m5.3 2024-09-12T00:35:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.641+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.644+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:35:50.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.645+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.645+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.646+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.647+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:35:50.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.648+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:35:50.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11860420359065585993', time=2024-09-12T02:33:55.928292+0000, chain.objs.size()=5 2024-09-12T00:35:50.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file.mpg.2~_R-ID450DkKNvmi6_Zwpn8vaXBqMVkt.1 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file.mpg.2~_R-ID450DkKNvmi6_Zwpn8vaXBqMVkt.2 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file.mpg.2~_R-ID450DkKNvmi6_Zwpn8vaXBqMVkt.3 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file.mpg.2~_R-ID450DkKNvmi6_Zwpn8vaXBqMVkt.4 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.54__multipart_file.mpg.2~_R-ID450DkKNvmi6_Zwpn8vaXBqMVkt.5 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14491011186068712347', time=2024-09-12T02:34:47.145114+0000, chain.objs.size()=10 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.1 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.2 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.3 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.4 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.5 2024-09-12T00:35:50.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.6 2024-09-12T00:35:50.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.649+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.7 2024-09-12T00:35:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.653+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.8 2024-09-12T00:35:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.653+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.9 2024-09-12T00:35:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.653+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.56__multipart_key1.2~81GXSIuC4UKcEalvl-RfgAEPNpC9-t7.10 2024-09-12T00:35:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.656+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.659+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:35:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.660+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.661+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.661+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:35:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.661+0000 7f7665f20800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8965246994286947562', time=2024-09-12T02:32:49.858474+0000, chain.objs.size()=5 2024-09-12T00:35:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.661+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.1 2024-09-12T00:35:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.661+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.2 2024-09-12T00:35:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.661+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.3 2024-09-12T00:35:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.661+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.4 2024-09-12T00:35:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.661+0000 7f7665f20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.45__multipart_key1.2~97JJtEMZuIw7jyMkU-pXVqCpz3R8IhH.5 2024-09-12T00:35:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.663+0000 7f7665f20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:35:50.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.666+0000 7f7665f20800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:35:50.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.667+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.668+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.668+0000 7f7665f20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.670+0000 7f7513fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:50.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.672+0000 7f7665f20800 20 remove_watcher() i=0 2024-09-12T00:35:50.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.672+0000 7f7665f20800 2 removed watcher, disabling cache 2024-09-12T00:35:50.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.673+0000 7f7665f20800 20 remove_watcher() i=1 2024-09-12T00:35:50.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.674+0000 7f7665f20800 20 remove_watcher() i=2 2024-09-12T00:35:50.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.675+0000 7f7665f20800 20 remove_watcher() i=3 2024-09-12T00:35:50.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.676+0000 7f7665f20800 20 remove_watcher() i=4 2024-09-12T00:35:50.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.677+0000 7f7665f20800 20 remove_watcher() i=5 2024-09-12T00:35:50.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.678+0000 7f7665f20800 20 remove_watcher() i=6 2024-09-12T00:35:50.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.679+0000 7f7665f20800 20 remove_watcher() i=7 2024-09-12T00:35:50.690 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:35:50.742 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:50.743 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:50.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.784+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.785+0000 7fac73d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.785+0000 7fac73d2c800 20 realm 2024-09-12T00:35:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.785+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.786+0000 7fac73d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.786+0000 7fac73d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.786+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.786+0000 7fac73d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.786+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.787+0000 7fac73d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:50.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.787+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.788+0000 7fac73d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:50.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.788+0000 7fac73d2c800 20 searching for the correct realm 2024-09-12T00:35:50.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.791+0000 7fac70146640 0 -- 172.21.15.33:0/51321811 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5637bc00e7f0 msgr2=0x5637bc010cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:50.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.794+0000 7fac6f945640 0 -- 172.21.15.33:0/51321811 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fac58017050 msgr2=0x7fac5806e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.799+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 zone default found 2024-09-12T00:35:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 4 Realm: () 2024-09-12T00:35:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 zonegroup default 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.800+0000 7fac73d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.801+0000 7fac73d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.801+0000 7fac73d2c800 20 started sync module instance, tier type = 2024-09-12T00:35:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.801+0000 7fac73d2c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:35:50.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.810+0000 7fac73d2c800 20 add_watcher() i=0 2024-09-12T00:35:50.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.810+0000 7fac73d2c800 20 add_watcher() i=1 2024-09-12T00:35:50.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.810+0000 7fac73d2c800 20 add_watcher() i=2 2024-09-12T00:35:50.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.810+0000 7fac73d2c800 20 add_watcher() i=3 2024-09-12T00:35:50.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.810+0000 7fac73d2c800 20 add_watcher() i=4 2024-09-12T00:35:50.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.810+0000 7fac73d2c800 20 add_watcher() i=5 2024-09-12T00:35:50.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.810+0000 7fac73d2c800 20 add_watcher() i=6 2024-09-12T00:35:50.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.811+0000 7fac73d2c800 20 add_watcher() i=7 2024-09-12T00:35:50.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.811+0000 7fac73d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:50.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.812+0000 7fab25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:50.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.813+0000 7fac73d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:50.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.813+0000 7fac73d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.847+0000 7fab24fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.847+0000 7fac73d2c800 20 init_complete bucket index max shards: 11 2024-09-12T00:35:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.847+0000 7fac73d2c800 20 Filter name: none 2024-09-12T00:35:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.847+0000 7faa9e7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.847+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:35:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.849+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.849+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.849+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.850+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:35:50.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.852+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.852+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.853+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.854+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:35:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.855+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.855+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.856+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.857+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:35:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.858+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.858+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.859+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.860+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:35:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.861+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.861+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.862+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.863+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:35:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.864+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.864+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.865+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.865+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:35:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.867+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.867+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.868+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.869+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:35:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.870+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.870+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.871+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.872+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:35:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.873+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.874+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.874+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.875+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:35:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.876+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.877+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.877+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.878+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:35:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.879+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.880+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.880+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.881+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:35:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.883+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.883+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.884+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.885+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:35:50.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.886+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.886+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.887+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.888+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:35:50.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.889+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.890+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.890+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.891+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:35:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.893+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.893+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.893+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.894+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:35:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.895+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.896+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.896+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.897+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:35:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.899+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.899+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.900+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.901+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:35:50.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.902+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.902+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.903+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.903+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:35:50.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.905+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.905+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.906+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.907+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:35:50.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.908+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.908+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.908+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.909+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:35:50.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.911+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.911+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.911+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.912+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:35:50.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.914+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.914+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.914+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.916+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:35:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.917+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.918+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.918+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.919+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:35:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.921+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.921+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.921+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.922+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:35:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.924+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.924+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.924+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.926+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:35:50.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.927+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.927+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.928+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.929+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:35:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.930+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.931+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.931+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.932+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:35:50.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.933+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.934+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.934+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.935+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:35:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.937+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.937+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.937+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.938+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:35:50.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.940+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.940+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.941+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.942+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:35:50.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.943+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.944+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.944+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.945+0000 7fac73d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:35:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.947+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.947+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.947+0000 7fac73d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.951+0000 7fab25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:50.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.953+0000 7fac73d2c800 20 remove_watcher() i=0 2024-09-12T00:35:50.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.953+0000 7fac73d2c800 2 removed watcher, disabling cache 2024-09-12T00:35:50.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.954+0000 7fac73d2c800 20 remove_watcher() i=1 2024-09-12T00:35:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.955+0000 7fac73d2c800 20 remove_watcher() i=2 2024-09-12T00:35:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.956+0000 7fac73d2c800 20 remove_watcher() i=3 2024-09-12T00:35:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.957+0000 7fac73d2c800 20 remove_watcher() i=4 2024-09-12T00:35:50.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.958+0000 7fac73d2c800 20 remove_watcher() i=5 2024-09-12T00:35:50.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.959+0000 7fac73d2c800 20 remove_watcher() i=6 2024-09-12T00:35:50.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:50.960+0000 7fac73d2c800 20 remove_watcher() i=7 2024-09-12T00:35:50.970 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:35:51.023 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:51.023 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:51.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.064+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.065+0000 7ff5be80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.065+0000 7ff5be80f800 20 realm 2024-09-12T00:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.065+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.066+0000 7ff5be80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.066+0000 7ff5be80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.066+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.066+0000 7ff5be80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.066+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.067+0000 7ff5be80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.067+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.068+0000 7ff5be80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.068+0000 7ff5be80f800 20 searching for the correct realm 2024-09-12T00:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.071+0000 7ff5bbaff640 0 -- 172.21.15.33:0/398836155 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55986c119ef0 msgr2=0x55986c11c2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.075+0000 7ff5bcb01640 0 -- 172.21.15.33:0/398836155 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7ff5b0042c10 msgr2=0x7ff5b004e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:51.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:35:51.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:35:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 zone default found 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 4 Realm: () 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 zonegroup default 2024-09-12T00:35:51.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.079+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.080+0000 7ff5be80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.080+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.080+0000 7ff5be80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.080+0000 7ff5be80f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.081+0000 7ff5be80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.081+0000 7ff5be80f800 20 started sync module instance, tier type = 2024-09-12T00:35:51.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.081+0000 7ff5be80f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:35:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.089+0000 7ff5be80f800 20 add_watcher() i=0 2024-09-12T00:35:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.089+0000 7ff5be80f800 20 add_watcher() i=1 2024-09-12T00:35:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.089+0000 7ff5be80f800 20 add_watcher() i=2 2024-09-12T00:35:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.089+0000 7ff5be80f800 20 add_watcher() i=3 2024-09-12T00:35:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.089+0000 7ff5be80f800 20 add_watcher() i=4 2024-09-12T00:35:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.089+0000 7ff5be80f800 20 add_watcher() i=5 2024-09-12T00:35:51.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.089+0000 7ff5be80f800 20 add_watcher() i=6 2024-09-12T00:35:51.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.090+0000 7ff5be80f800 20 add_watcher() i=7 2024-09-12T00:35:51.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.090+0000 7ff5be80f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:51.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.092+0000 7ff472fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.092+0000 7ff5be80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:51.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.092+0000 7ff5be80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.130+0000 7ff471fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.130+0000 7ff5be80f800 20 init_complete bucket index max shards: 11 2024-09-12T00:35:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.130+0000 7ff5be80f800 20 Filter name: none 2024-09-12T00:35:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.130+0000 7ff3e37fe640 20 reqs_thread_entry: start 2024-09-12T00:35:51.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.130+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:35:51.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.132+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.132+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.132+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.133+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:35:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.135+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.135+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.135+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.136+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:35:51.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.137+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.138+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.138+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.139+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:35:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.141+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.141+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.141+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.142+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:35:51.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.144+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.144+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.144+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.145+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:35:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.147+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.147+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.147+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.148+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:35:51.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.149+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.150+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.150+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.151+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:35:51.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.152+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.153+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.153+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.154+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:35:51.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.155+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.155+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.156+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.157+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:35:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.158+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.158+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.158+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.160+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:35:51.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.161+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.161+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.161+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.162+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:35:51.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.164+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.164+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.164+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.165+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:35:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.167+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.167+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.168+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.169+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:35:51.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.170+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.170+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.171+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.172+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:35:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.173+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.173+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.174+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.174+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:35:51.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.176+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.176+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.177+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.178+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:35:51.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.179+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.179+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.180+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.181+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:35:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.182+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.182+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.183+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.184+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:35:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.185+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.186+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.186+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.187+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:35:51.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.188+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.189+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.189+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.190+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:35:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.191+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.192+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.192+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.193+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:35:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.194+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.195+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.195+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.196+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:35:51.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.197+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.197+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.198+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.199+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:35:51.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.200+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.200+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.201+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.202+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:35:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.203+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.203+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.204+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.205+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:35:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.206+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.206+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.206+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.207+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:35:51.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.209+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.209+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.210+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.211+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:35:51.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.212+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.213+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.213+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.214+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:35:51.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.216+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.216+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.216+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.217+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:35:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.220+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.220+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.220+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.221+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:35:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.223+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.223+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.223+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.224+0000 7ff5be80f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:35:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.226+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.226+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.227+0000 7ff5be80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.228+0000 7ff472fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.230+0000 7ff5be80f800 20 remove_watcher() i=0 2024-09-12T00:35:51.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.230+0000 7ff5be80f800 2 removed watcher, disabling cache 2024-09-12T00:35:51.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.232+0000 7ff5be80f800 20 remove_watcher() i=1 2024-09-12T00:35:51.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.233+0000 7ff5be80f800 20 remove_watcher() i=2 2024-09-12T00:35:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.234+0000 7ff5be80f800 20 remove_watcher() i=3 2024-09-12T00:35:51.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.235+0000 7ff5be80f800 20 remove_watcher() i=4 2024-09-12T00:35:51.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.236+0000 7ff5be80f800 20 remove_watcher() i=5 2024-09-12T00:35:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.237+0000 7ff5be80f800 20 remove_watcher() i=6 2024-09-12T00:35:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.238+0000 7ff5be80f800 20 remove_watcher() i=7 2024-09-12T00:35:51.249 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:35:51.302 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:51.302 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:51.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.343+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.344+0000 7fa4bcd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.344+0000 7fa4bcd36800 20 realm 2024-09-12T00:35:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.344+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.345+0000 7fa4bcd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.345+0000 7fa4bcd36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.345+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.345+0000 7fa4bcd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.345+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.346+0000 7fa4bcd36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.346+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.346+0000 7fa4bcd36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.346+0000 7fa4bcd36800 20 searching for the correct realm 2024-09-12T00:35:51.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.349+0000 7fa4b8ab7640 0 -- 172.21.15.33:0/3520414375 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fa4b0089650 msgr2=0x7fa4b008ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.353+0000 7fa4b8ab7640 0 -- 172.21.15.33:0/3520414375 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa4ac0ab040 msgr2=0x7fa4ac0db6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.559+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 20 zone default found 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 4 Realm: () 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 20 zonegroup default 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.560+0000 7fa4bcd36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.561+0000 7fa4bcd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.561+0000 7fa4bcd36800 20 started sync module instance, tier type = 2024-09-12T00:35:51.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.561+0000 7fa4bcd36800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:35:51.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.571+0000 7fa4bcd36800 20 add_watcher() i=0 2024-09-12T00:35:51.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.571+0000 7fa4bcd36800 20 add_watcher() i=1 2024-09-12T00:35:51.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.571+0000 7fa4bcd36800 20 add_watcher() i=2 2024-09-12T00:35:51.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.571+0000 7fa4bcd36800 20 add_watcher() i=3 2024-09-12T00:35:51.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.571+0000 7fa4bcd36800 20 add_watcher() i=4 2024-09-12T00:35:51.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.571+0000 7fa4bcd36800 20 add_watcher() i=5 2024-09-12T00:35:51.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.571+0000 7fa4bcd36800 20 add_watcher() i=6 2024-09-12T00:35:51.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.572+0000 7fa4bcd36800 20 add_watcher() i=7 2024-09-12T00:35:51.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.572+0000 7fa4bcd36800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:51.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.573+0000 7fa36f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.574+0000 7fa4bcd36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:51.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.574+0000 7fa4bcd36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.609+0000 7fa36e7e4640 20 reqs_thread_entry: start 2024-09-12T00:35:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.609+0000 7fa4bcd36800 20 init_complete bucket index max shards: 11 2024-09-12T00:35:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.609+0000 7fa4bcd36800 20 Filter name: none 2024-09-12T00:35:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.609+0000 7fa367fff640 20 reqs_thread_entry: start 2024-09-12T00:35:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.609+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:35:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.611+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.611+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.611+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.612+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:35:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.614+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.615+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.615+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.616+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:35:51.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.617+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.617+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.618+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.619+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:35:51.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.620+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.620+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.621+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.622+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:35:51.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.623+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.623+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.624+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.625+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:35:51.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.626+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.626+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.626+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.627+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:35:51.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.629+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.629+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.629+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.631+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:35:51.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.632+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.633+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.633+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.634+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:35:51.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.635+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.636+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.636+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.637+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:35:51.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.639+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.639+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.639+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.640+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:35:51.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.641+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.642+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.642+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.643+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:35:51.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.644+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.645+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.645+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.646+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:35:51.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.648+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.649+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.649+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.650+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:35:51.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.652+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.652+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.652+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.654+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:35:51.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.655+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.656+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.656+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.657+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:35:51.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.659+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.659+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.659+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.661+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:35:51.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.662+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.662+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.663+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.663+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:35:51.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.665+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.665+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.666+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.667+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:35:51.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.668+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.669+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.669+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.670+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:35:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.671+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.672+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.672+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.673+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:35:51.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.675+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.675+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.675+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.676+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:35:51.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.677+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.678+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.678+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.679+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:35:51.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.681+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.681+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.682+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.683+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:35:51.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.684+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.684+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.684+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.685+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:35:51.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.687+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.687+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.688+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.689+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:35:51.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.690+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.690+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.690+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.691+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:35:51.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.693+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.694+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.694+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.695+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:35:51.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.696+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.697+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.697+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.698+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:35:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.699+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.700+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.700+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.701+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:35:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.703+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.703+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.703+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.704+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:35:51.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.705+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.706+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.706+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.707+0000 7fa4bcd36800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:35:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.709+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.709+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:51.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.709+0000 7fa4bcd36800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.711+0000 7fa36f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.713+0000 7fa4bcd36800 20 remove_watcher() i=0 2024-09-12T00:35:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.713+0000 7fa4bcd36800 2 removed watcher, disabling cache 2024-09-12T00:35:51.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.714+0000 7fa4bcd36800 20 remove_watcher() i=1 2024-09-12T00:35:51.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.715+0000 7fa4bcd36800 20 remove_watcher() i=2 2024-09-12T00:35:51.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.716+0000 7fa4bcd36800 20 remove_watcher() i=3 2024-09-12T00:35:51.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.717+0000 7fa4bcd36800 20 remove_watcher() i=4 2024-09-12T00:35:51.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.718+0000 7fa4bcd36800 20 remove_watcher() i=5 2024-09-12T00:35:51.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.719+0000 7fa4bcd36800 20 remove_watcher() i=6 2024-09-12T00:35:51.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:51.720+0000 7fa4bcd36800 20 remove_watcher() i=7 2024-09-12T00:35:51.730 DEBUG:teuthology.orchestra.run.smithi033:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:35:52.354 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :clean 2024-09-12T00:35:53.253 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :compileJava 2024-09-12T00:35:53.253 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :processResources 2024-09-12T00:35:53.253 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :classes 2024-09-12T00:35:53.853 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:53.853 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :compileTestJava 2024-09-12T00:35:53.853 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:53.853 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:35:53.854 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :testClasses 2024-09-12T00:35:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:35:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:35:55.854 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:55.854 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :test 2024-09-12T00:35:55.854 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:55.854 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:35:55.854 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:35:55,080 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:35:55.855 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:55.855 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:35:55.855 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:55.855 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:35:55.855 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:55.855 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:35:55.855 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:55.855 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:35:56.253 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:56.253 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:35:56.253 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:56.253 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:35:56.652 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:56.653 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:35:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:56.853 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:35:56.952 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:56.953 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:35:57.152 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:57.153 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:35:57.553 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:57.553 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:35:57.553 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:57.553 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:35:57.652 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:57.653 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:35:57.852 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:57.853 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:35:58.553 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:58.553 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:35:58.653 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:58.653 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:35:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:58.952 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:35:59.052 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:59.053 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:35:59.131 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:59.131 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------- 2024-09-12T00:35:59.131 INFO:teuthology.orchestra.run.smithi033.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:35:59.131 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------- 2024-09-12T00:35:59.131 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:59.132 INFO:teuthology.orchestra.run.smithi033.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:35:59.132 INFO:teuthology.orchestra.run.smithi033.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:35:59.132 INFO:teuthology.orchestra.run.smithi033.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:35:59.132 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:35:59.132 INFO:teuthology.orchestra.run.smithi033.stdout:BUILD SUCCESSFUL in 7s 2024-09-12T00:35:59.132 INFO:teuthology.orchestra.run.smithi033.stdout:5 actionable tasks: 5 executed 2024-09-12T00:35:59.135 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:35:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.230+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.231+0000 7f9098840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.231+0000 7f9098840800 20 realm 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.231+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.231+0000 7f9098840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.231+0000 7f9098840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.231+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.232+0000 7f9098840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.232+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.232+0000 7f9098840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.232+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.233+0000 7f9098840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:59.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.233+0000 7f9098840800 20 searching for the correct realm 2024-09-12T00:35:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.236+0000 7f908ffff640 0 -- 172.21.15.33:0/1337986658 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55662d0642c0 msgr2=0x55662d0666d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.239+0000 7f909632a640 0 -- 172.21.15.33:0/1337986658 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f9080060970 msgr2=0x7f908003b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:59.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:59.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:35:59.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:35:59.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:59.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:59.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:59.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.445+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 20 zone default found 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 4 Realm: () 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 20 zonegroup default 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.446+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.447+0000 7f9098840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.447+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.447+0000 7f9098840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.447+0000 7f9098840800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.447+0000 7f9098840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.447+0000 7f9098840800 20 started sync module instance, tier type = 2024-09-12T00:35:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.447+0000 7f9098840800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:35:59.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.457+0000 7f9098840800 20 add_watcher() i=0 2024-09-12T00:35:59.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.457+0000 7f9098840800 20 add_watcher() i=1 2024-09-12T00:35:59.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.457+0000 7f9098840800 20 add_watcher() i=2 2024-09-12T00:35:59.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.457+0000 7f9098840800 20 add_watcher() i=3 2024-09-12T00:35:59.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.457+0000 7f9098840800 20 add_watcher() i=4 2024-09-12T00:35:59.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.457+0000 7f9098840800 20 add_watcher() i=5 2024-09-12T00:35:59.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.457+0000 7f9098840800 20 add_watcher() i=6 2024-09-12T00:35:59.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.457+0000 7f9098840800 20 add_watcher() i=7 2024-09-12T00:35:59.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.458+0000 7f9098840800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.459+0000 7f8f4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.460+0000 7f9098840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.460+0000 7f9098840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:59.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.496+0000 7f8ec77fe640 20 reqs_thread_entry: start 2024-09-12T00:35:59.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.496+0000 7f9098840800 20 init_complete bucket index max shards: 11 2024-09-12T00:35:59.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.496+0000 7f9098840800 20 Filter name: none 2024-09-12T00:35:59.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.496+0000 7f8ec57fa640 20 reqs_thread_entry: start 2024-09-12T00:35:59.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.496+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:35:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.497+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.498+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.498+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.500+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:35:59.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.502+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.502+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.502+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.503+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:35:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.505+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.505+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.505+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.507+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:35:59.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.508+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.509+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.509+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.511+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:35:59.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.512+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.512+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.513+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.514+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:35:59.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.515+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.515+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.516+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.517+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:35:59.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.518+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.518+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.519+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.520+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:35:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.521+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.522+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.522+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.523+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:35:59.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.525+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.525+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.525+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.526+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:35:59.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.528+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.528+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.528+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.530+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:35:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.532+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.532+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.532+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.534+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:35:59.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.535+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.536+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.536+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.537+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:35:59.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.539+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.540+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.540+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.541+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:35:59.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.542+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.543+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.543+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.544+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:35:59.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.546+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.546+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.546+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.548+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:35:59.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.549+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.549+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.549+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.552+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:35:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.553+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.554+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.554+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.555+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:35:59.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.556+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.557+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.557+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.558+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:35:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.559+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.560+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.560+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.561+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:35:59.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.563+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.563+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.563+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.564+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:35:59.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.566+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.566+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.567+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.568+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:35:59.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.570+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.571+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.571+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.572+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:35:59.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.574+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.574+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.574+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.575+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:35:59.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.576+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.577+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.577+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.578+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:35:59.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.579+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.580+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.580+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.581+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:35:59.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.582+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.583+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.583+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.584+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:35:59.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.585+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.586+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.586+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.587+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:35:59.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.589+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.589+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.589+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.590+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:35:59.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.592+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.592+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.592+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.593+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:35:59.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.596+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.596+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.597+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.598+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:35:59.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.600+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.600+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.600+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.601+0000 7f9098840800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:35:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.603+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.604+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.604+0000 7f9098840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.606+0000 7f8f4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:59.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.609+0000 7f9098840800 20 remove_watcher() i=0 2024-09-12T00:35:59.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.609+0000 7f9098840800 2 removed watcher, disabling cache 2024-09-12T00:35:59.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.610+0000 7f9098840800 20 remove_watcher() i=1 2024-09-12T00:35:59.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.611+0000 7f9098840800 20 remove_watcher() i=2 2024-09-12T00:35:59.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.612+0000 7f9098840800 20 remove_watcher() i=3 2024-09-12T00:35:59.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.614+0000 7f9098840800 20 remove_watcher() i=4 2024-09-12T00:35:59.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.615+0000 7f9098840800 20 remove_watcher() i=5 2024-09-12T00:35:59.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.615+0000 7f9098840800 20 remove_watcher() i=6 2024-09-12T00:35:59.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.616+0000 7f9098840800 20 remove_watcher() i=7 2024-09-12T00:35:59.627 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:35:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:59.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.721+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.722+0000 7f8a5e82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.722+0000 7f8a5e82f800 20 realm 2024-09-12T00:35:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.722+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.722+0000 7f8a5e82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.722+0000 7f8a5e82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.722+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.723+0000 7f8a5e82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.723+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.724+0000 7f8a5e82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:59.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.724+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.725+0000 7f8a5e82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:59.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.725+0000 7f8a5e82f800 20 searching for the correct realm 2024-09-12T00:35:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.727+0000 7f8a53b18640 0 -- 172.21.15.33:0/3485916358 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f8a4c086060 msgr2=0x7f8a4c0aaba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.731+0000 7f8a5c319640 0 -- 172.21.15.33:0/3485916358 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f8a4401f060 msgr2=0x7f8a4407a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:35:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:35:59.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:59.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.938+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 20 zone default found 2024-09-12T00:35:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 4 Realm: () 2024-09-12T00:35:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:35:59.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 20 zonegroup default 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.939+0000 7f8a5e82f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.940+0000 7f8a5e82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.940+0000 7f8a5e82f800 20 started sync module instance, tier type = 2024-09-12T00:35:59.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.940+0000 7f8a5e82f800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:35:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.949+0000 7f8a5e82f800 20 add_watcher() i=0 2024-09-12T00:35:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.949+0000 7f8a5e82f800 20 add_watcher() i=1 2024-09-12T00:35:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.949+0000 7f8a5e82f800 20 add_watcher() i=2 2024-09-12T00:35:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.949+0000 7f8a5e82f800 20 add_watcher() i=3 2024-09-12T00:35:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.949+0000 7f8a5e82f800 20 add_watcher() i=4 2024-09-12T00:35:59.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.949+0000 7f8a5e82f800 20 add_watcher() i=5 2024-09-12T00:35:59.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.949+0000 7f8a5e82f800 20 add_watcher() i=6 2024-09-12T00:35:59.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.950+0000 7f8a5e82f800 20 add_watcher() i=7 2024-09-12T00:35:59.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.950+0000 7f8a5e82f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.952+0000 7f8912fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.953+0000 7f8a5e82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:59.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.953+0000 7f8a5e82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:59.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.988+0000 7f8911fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:59.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.988+0000 7f8a5e82f800 20 init_complete bucket index max shards: 11 2024-09-12T00:35:59.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.988+0000 7f8a5e82f800 20 Filter name: none 2024-09-12T00:35:59.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.989+0000 7f88837fe640 20 reqs_thread_entry: start 2024-09-12T00:35:59.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.989+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:35:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.990+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.991+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.991+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.992+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:35:59.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.993+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.994+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.994+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.995+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:35:59.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.996+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.997+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.997+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.998+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:35:59.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:35:59.999+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:35:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.000+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:35:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.000+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.001+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:36:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.003+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.003+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.004+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.004+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:36:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.006+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.006+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.006+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.007+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:36:00.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.009+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.009+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.010+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.011+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:36:00.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.012+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.012+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.012+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.013+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:36:00.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.015+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.015+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.015+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.016+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:36:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.018+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.018+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.018+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.019+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:36:00.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.020+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.021+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.021+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.022+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:36:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.024+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.024+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.025+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.025+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:36:00.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.027+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.028+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.028+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.029+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:36:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.030+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.031+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.031+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.032+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:36:00.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.033+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.034+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.034+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.035+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:36:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.036+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.037+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.037+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.038+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:36:00.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.039+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.039+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.040+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.041+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:36:00.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.042+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.042+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.042+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.043+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:36:00.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.045+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.046+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.046+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.047+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:36:00.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.048+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.049+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.049+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.050+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:36:00.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.052+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.052+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.052+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.054+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:36:00.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.055+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.056+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.056+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.057+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:36:00.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.059+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.059+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.059+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.061+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:36:00.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.062+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.062+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.062+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.063+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:36:00.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.065+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.065+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.065+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.066+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:36:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.067+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.068+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.068+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.069+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:36:00.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.071+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.071+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.071+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.073+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:36:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.074+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.074+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.075+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.076+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:36:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.077+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.077+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.078+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.079+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:36:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.080+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.080+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.081+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.082+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:36:00.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.083+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.083+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.084+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.085+0000 7f8a5e82f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:36:00.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.086+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.086+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.087+0000 7f8a5e82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.089+0000 7f8912fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:00.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.091+0000 7f8a5e82f800 20 remove_watcher() i=0 2024-09-12T00:36:00.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.091+0000 7f8a5e82f800 2 removed watcher, disabling cache 2024-09-12T00:36:00.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.092+0000 7f8a5e82f800 20 remove_watcher() i=1 2024-09-12T00:36:00.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.093+0000 7f8a5e82f800 20 remove_watcher() i=2 2024-09-12T00:36:00.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.094+0000 7f8a5e82f800 20 remove_watcher() i=3 2024-09-12T00:36:00.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.095+0000 7f8a5e82f800 20 remove_watcher() i=4 2024-09-12T00:36:00.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.096+0000 7f8a5e82f800 20 remove_watcher() i=5 2024-09-12T00:36:00.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.097+0000 7f8a5e82f800 20 remove_watcher() i=6 2024-09-12T00:36:00.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.098+0000 7f8a5e82f800 20 remove_watcher() i=7 2024-09-12T00:36:00.109 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:36:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:00.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.204+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.205+0000 7faca2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.205+0000 7faca2c16800 20 realm 2024-09-12T00:36:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.205+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.206+0000 7faca2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.206+0000 7faca2c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.206+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.206+0000 7faca2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.206+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.207+0000 7faca2c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:00.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.207+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.207+0000 7faca2c16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:00.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.207+0000 7faca2c16800 20 searching for the correct realm 2024-09-12T00:36:00.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.211+0000 7fac9ebe8640 0 -- 172.21.15.33:0/425758421 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fac94087150 msgr2=0x7fac9402b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:00.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.418+0000 7fac9e3e7640 0 -- 172.21.15.33:0/425758421 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x55cd399fe1c0 msgr2=0x55cd39a005b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:00.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.420+0000 7faca2c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.420+0000 7faca2c16800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:36:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.420+0000 7faca2c16800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:36:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.420+0000 7faca2c16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.420+0000 7faca2c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.420+0000 7faca2c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.420+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 20 zone default found 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 4 Realm: () 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 20 zonegroup default 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.421+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.422+0000 7faca2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.422+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.422+0000 7faca2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.422+0000 7faca2c16800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.422+0000 7faca2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.422+0000 7faca2c16800 20 started sync module instance, tier type = 2024-09-12T00:36:00.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.422+0000 7faca2c16800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:36:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.431+0000 7faca2c16800 20 add_watcher() i=0 2024-09-12T00:36:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.431+0000 7faca2c16800 20 add_watcher() i=1 2024-09-12T00:36:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.431+0000 7faca2c16800 20 add_watcher() i=2 2024-09-12T00:36:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.431+0000 7faca2c16800 20 add_watcher() i=3 2024-09-12T00:36:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.431+0000 7faca2c16800 20 add_watcher() i=4 2024-09-12T00:36:00.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.431+0000 7faca2c16800 20 add_watcher() i=5 2024-09-12T00:36:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.431+0000 7faca2c16800 20 add_watcher() i=6 2024-09-12T00:36:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.432+0000 7faca2c16800 20 add_watcher() i=7 2024-09-12T00:36:00.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.432+0000 7faca2c16800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:00.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.434+0000 7fab54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:00.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.434+0000 7faca2c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:00.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.434+0000 7faca2c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.470+0000 7faacf7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.471+0000 7faca2c16800 20 init_complete bucket index max shards: 11 2024-09-12T00:36:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.471+0000 7faca2c16800 20 Filter name: none 2024-09-12T00:36:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.471+0000 7faacd7fa640 20 reqs_thread_entry: start 2024-09-12T00:36:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.471+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:36:00.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.473+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.473+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.473+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.475+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:36:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.476+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.476+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.477+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.478+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:36:00.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.479+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.479+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.480+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.481+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:36:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.482+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.483+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.483+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.484+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:36:00.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.486+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.486+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.487+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.488+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:36:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.489+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.489+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.490+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.491+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:36:00.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.493+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.493+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.494+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.495+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:36:00.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.496+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.497+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.497+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.498+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:36:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.499+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.500+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.500+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.501+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:36:00.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.503+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.503+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.503+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.504+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:36:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.506+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.506+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.506+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.508+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:36:00.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.509+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.510+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.510+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.511+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:36:00.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.512+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.513+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.513+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.514+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:36:00.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.515+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.515+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.516+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.517+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:36:00.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.518+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.518+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.519+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.520+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:36:00.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.521+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.522+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.522+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.524+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:36:00.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.525+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.525+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.526+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.527+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:36:00.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.528+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.528+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.529+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.529+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:36:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.531+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.531+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.531+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.532+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:36:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.533+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.534+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.534+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.535+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:36:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.537+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.537+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.537+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.538+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:36:00.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.540+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.540+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.540+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.541+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:36:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.543+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.543+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.544+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.545+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:36:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.546+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.547+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.547+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.548+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:36:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.550+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.550+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.550+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.551+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:36:00.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.553+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.554+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.554+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.555+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:36:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.556+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.556+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.557+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.558+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:36:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.559+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.559+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.560+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.561+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:36:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.562+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.563+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.563+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.564+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:36:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.565+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.566+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.566+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.567+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:36:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.568+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.569+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.569+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.570+0000 7faca2c16800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:36:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.571+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.572+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.572+0000 7faca2c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.574+0000 7fab54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.576+0000 7faca2c16800 20 remove_watcher() i=0 2024-09-12T00:36:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.576+0000 7faca2c16800 2 removed watcher, disabling cache 2024-09-12T00:36:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.577+0000 7faca2c16800 20 remove_watcher() i=1 2024-09-12T00:36:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.578+0000 7faca2c16800 20 remove_watcher() i=2 2024-09-12T00:36:00.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.579+0000 7faca2c16800 20 remove_watcher() i=3 2024-09-12T00:36:00.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.580+0000 7faca2c16800 20 remove_watcher() i=4 2024-09-12T00:36:00.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.581+0000 7faca2c16800 20 remove_watcher() i=5 2024-09-12T00:36:00.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.582+0000 7faca2c16800 20 remove_watcher() i=6 2024-09-12T00:36:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.583+0000 7faca2c16800 20 remove_watcher() i=7 2024-09-12T00:36:00.597 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:36:00.651 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:00.651 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.692+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.693+0000 7f4c5ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.693+0000 7f4c5ab46800 20 realm 2024-09-12T00:36:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.693+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.694+0000 7f4c5ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.694+0000 7f4c5ab46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.694+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.694+0000 7f4c5ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.694+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.695+0000 7f4c5ab46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.695+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.695+0000 7f4c5ab46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.695+0000 7f4c5ab46800 20 searching for the correct realm 2024-09-12T00:36:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.698+0000 7f4c58e38640 0 -- 172.21.15.33:0/810708472 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x55bf02109440 msgr2=0x55bf0210b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:00.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.702+0000 7f4c57e36640 0 -- 172.21.15.33:0/810708472 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55bf02110f20 msgr2=0x55bf02113330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.705+0000 7f4c5ab46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.705+0000 7f4c5ab46800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.705+0000 7f4c5ab46800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.705+0000 7f4c5ab46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.705+0000 7f4c5ab46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.705+0000 7f4c5ab46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.705+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 zone default found 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 4 Realm: () 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 zonegroup default 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.706+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.707+0000 7f4c5ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.707+0000 7f4c5ab46800 20 rados->read ofs=0 len=0 2024-09-12T00:36:00.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.707+0000 7f4c5ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:00.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.707+0000 7f4c5ab46800 20 started sync module instance, tier type = 2024-09-12T00:36:00.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.707+0000 7f4c5ab46800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:36:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.716+0000 7f4c5ab46800 20 add_watcher() i=0 2024-09-12T00:36:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.716+0000 7f4c5ab46800 20 add_watcher() i=1 2024-09-12T00:36:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.716+0000 7f4c5ab46800 20 add_watcher() i=2 2024-09-12T00:36:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.716+0000 7f4c5ab46800 20 add_watcher() i=3 2024-09-12T00:36:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.716+0000 7f4c5ab46800 20 add_watcher() i=4 2024-09-12T00:36:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.716+0000 7f4c5ab46800 20 add_watcher() i=5 2024-09-12T00:36:00.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.716+0000 7f4c5ab46800 20 add_watcher() i=6 2024-09-12T00:36:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.717+0000 7f4c5ab46800 20 add_watcher() i=7 2024-09-12T00:36:00.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.717+0000 7f4c5ab46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.718+0000 7f4b0efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.719+0000 7f4c5ab46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:00.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.719+0000 7f4c5ab46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.752+0000 7f4b0dfdb640 20 reqs_thread_entry: start 2024-09-12T00:36:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.752+0000 7f4c5ab46800 20 init_complete bucket index max shards: 11 2024-09-12T00:36:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.752+0000 7f4c5ab46800 20 Filter name: none 2024-09-12T00:36:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.752+0000 7f4a7f7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.752+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:36:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.754+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.754+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.755+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.755+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:36:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.757+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.757+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.757+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.759+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:36:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.760+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.761+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.761+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.763+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:36:00.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.764+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.764+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.765+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.766+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:36:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.767+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.767+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.768+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.769+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:36:00.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.770+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.771+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.771+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.772+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:36:00.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.773+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.774+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.774+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.775+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:36:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.777+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.777+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.777+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.778+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:36:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.780+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.780+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.780+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.782+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:36:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.783+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.784+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.784+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.785+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:36:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.786+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.787+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.787+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.788+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:36:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.790+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.790+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.790+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.791+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:36:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.793+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.793+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.793+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.794+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:36:00.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.796+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.796+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.796+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.797+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:36:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.799+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.799+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.799+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.800+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:36:00.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.802+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.802+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.802+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.803+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:36:00.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.805+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.805+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.805+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.806+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:36:00.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.808+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.808+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.808+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.809+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:36:00.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.811+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.811+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.811+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.812+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:36:00.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.814+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.814+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.815+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.816+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:36:00.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.817+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.818+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.818+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.819+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:36:00.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.821+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.821+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.822+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.822+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:36:00.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.824+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.824+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.825+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.826+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:36:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.827+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.827+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.828+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.828+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:36:00.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.830+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.830+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.831+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.832+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:36:00.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.834+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.834+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.834+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.835+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:36:00.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.837+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.838+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.838+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.839+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:36:00.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.840+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.841+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.841+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.842+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:36:00.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.843+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.844+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.844+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.846+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:36:00.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.847+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.847+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.848+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.849+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:36:00.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.850+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.850+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.850+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.851+0000 7f4c5ab46800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:36:00.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.853+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.853+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:36:00.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.854+0000 7f4c5ab46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:36:00.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.855+0000 7f4b0efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.858+0000 7f4c5ab46800 20 remove_watcher() i=0 2024-09-12T00:36:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.858+0000 7f4c5ab46800 2 removed watcher, disabling cache 2024-09-12T00:36:00.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.859+0000 7f4c5ab46800 20 remove_watcher() i=1 2024-09-12T00:36:00.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.860+0000 7f4c5ab46800 20 remove_watcher() i=2 2024-09-12T00:36:00.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.861+0000 7f4c5ab46800 20 remove_watcher() i=3 2024-09-12T00:36:00.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.862+0000 7f4c5ab46800 20 remove_watcher() i=4 2024-09-12T00:36:00.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.863+0000 7f4c5ab46800 20 remove_watcher() i=5 2024-09-12T00:36:00.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.864+0000 7f4c5ab46800 20 remove_watcher() i=6 2024-09-12T00:36:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:36:00.865+0000 7f4c5ab46800 20 remove_watcher() i=7 2024-09-12T00:36:00.876 DEBUG:teuthology.orchestra.run.smithi033:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:36:01.397 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :clean 2024-09-12T00:36:02.094 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :compileJava 2024-09-12T00:36:02.094 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :processResources 2024-09-12T00:36:02.094 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :classes 2024-09-12T00:36:02.594 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:02.594 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :compileTestJava 2024-09-12T00:36:02.594 INFO:teuthology.orchestra.run.smithi033.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:36:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:36:02.595 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:02.595 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:36:02.595 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :testClasses 2024-09-12T00:36:04.594 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:04.595 INFO:teuthology.orchestra.run.smithi033.stdout:> Task :test 2024-09-12T00:36:04.595 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:04.595 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:36:04.595 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:36:03,912 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:36:04.595 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:04.595 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:36:04.595 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:04.595 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:36:04.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:04.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:36:05.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:05.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:36:05.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:05.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:36:05.594 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:05.594 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:36:05.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:05.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:36:10.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:10.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:36:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:11.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:36:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:11.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:36:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:36:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:36:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:12.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:36:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:12.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:36:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:12.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:36:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:12.594 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:36:12.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:12.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:36:18.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:18.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:36:18.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:18.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:36:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:18.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:36:19.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:19.453 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:36:19.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:19.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:36:19.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:19.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:36:19.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:19.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:36:20.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:20.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:36:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:20.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:36:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:20.793 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:36:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:20.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:36:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:21.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:36:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:21.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:36:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:36:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:21.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:36:22.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:22.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:36:27.895 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:27.895 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:36:28.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:36:28.594 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:37:04.694 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:04.695 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:37:05.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:05.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:37:05.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:05.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:37:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:05.793 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:37:05.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:05.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:37:06.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:06.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:37:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:11.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:37:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:12.093 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:37:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:12.194 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:37:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:12.293 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:37:19.696 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:19.696 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:37:22.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:22.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:37:22.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:37:22,031 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:37:22.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:37:22,034 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:37:22.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12 00:37:22,045 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:37:22.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:22.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:37:31.993 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:31.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:37:32.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:32.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:37:37.696 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:37.696 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:37:38.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:37:38.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:38:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:17.095 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:38:17.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:17.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:38:25.694 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:25.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:38:25.993 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:25.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:38:31.194 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:31.194 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:38:31.594 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:31.594 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:38:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:33.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:38:39.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:39.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:38:39.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:39.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:38:39.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:39.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:38:39.894 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:39.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:38:40.294 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:40.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:38:40.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:40.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:38:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:40.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:38:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:40.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:38:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:41.193 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:38:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:41.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:38:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:41.594 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:38:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:41.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:38:42.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:42.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:38:42.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:42.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:38:42.794 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:42.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:38:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:42.993 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:38:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:43.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:38:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:43.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:38:44.193 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:44.194 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:38:44.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:44.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:38:44.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:44.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:38:45.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:45.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:38:45.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:45.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:38:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:45.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:38:46.194 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:46.194 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:38:46.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:46.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:38:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:46.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:38:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:47.093 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:38:47.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:47.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:38:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:47.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:38:48.193 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:48.194 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:38:48.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:48.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:38:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:48.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:38:49.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:49.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:38:49.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:49.593 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:38:49.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:49.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:38:50.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:50.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:38:50.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:50.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:38:50.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:50.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:38:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:51.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:38:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:51.493 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:38:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:51.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:38:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:52.194 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:38:52.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:38:52.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:52.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:38:53.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:53.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:38:53.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:53.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:38:53.794 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:53.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:38:54.193 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:54.193 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:38:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:54.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:38:54.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:54.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:38:55.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:55.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:38:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:55.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:38:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:55.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:38:56.193 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:56.194 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:38:56.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:56.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:38:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:56.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:38:56.993 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:56.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:38:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:57.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:38:57.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:57.494 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:38:57.894 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:57.894 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:38:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:57.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:38:58.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:58.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:38:58.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:58.394 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:38:58.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:58.793 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:38:58.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:58.893 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:38:59.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:59.293 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:38:59.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:59.594 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:38:59.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:59.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:38:59.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:38:59.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:39:00.096 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:00.096 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:39:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:00.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:39:00.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:00.594 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:39:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:00.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:39:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:39:01.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:01.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:39:01.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:01.693 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:39:01.794 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:01.794 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:39:02.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:02.094 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T00:39:07.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:07.294 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T00:39:07.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:07.694 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T00:39:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:21.994 INFO:teuthology.orchestra.run.smithi033.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout:---------------------------------------------------------------------- 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout:---------------------------------------------------------------------- 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:39:22.471 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:22.472 INFO:teuthology.orchestra.run.smithi033.stdout:BUILD SUCCESSFUL in 3m 21s 2024-09-12T00:39:22.472 INFO:teuthology.orchestra.run.smithi033.stdout:5 actionable tasks: 5 executed 2024-09-12T00:39:22.476 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:39:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:22.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.572+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.574+0000 7f5f9e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.574+0000 7f5f9e925800 20 realm 2024-09-12T00:39:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.574+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.574+0000 7f5f9e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.574+0000 7f5f9e925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.574+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.574+0000 7f5f9e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.574+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.575+0000 7f5f9e925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:22.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.575+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.576+0000 7f5f9e925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:22.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.576+0000 7f5f9e925800 20 searching for the correct realm 2024-09-12T00:39:22.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.578+0000 7f5f91d32640 0 -- 172.21.15.33:0/1009243867 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f5f8c046020 msgr2=0x7f5f8c03d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.583+0000 7f5f9a533640 0 -- 172.21.15.33:0/1009243867 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f5f840ab1d0 msgr2=0x7f5f840639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:22.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:22.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.790+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:22.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:22.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 20 zone default found 2024-09-12T00:39:22.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 4 Realm: () 2024-09-12T00:39:22.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:22.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:22.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 20 zonegroup default 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.791+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.792+0000 7f5f9e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.792+0000 7f5f9e925800 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.792+0000 7f5f9e925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.792+0000 7f5f9e925800 20 started sync module instance, tier type = 2024-09-12T00:39:22.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.792+0000 7f5f9e925800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.802+0000 7f5f9e925800 20 add_watcher() i=0 2024-09-12T00:39:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.802+0000 7f5f9e925800 20 add_watcher() i=1 2024-09-12T00:39:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.802+0000 7f5f9e925800 20 add_watcher() i=2 2024-09-12T00:39:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.802+0000 7f5f9e925800 20 add_watcher() i=3 2024-09-12T00:39:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.802+0000 7f5f9e925800 20 add_watcher() i=4 2024-09-12T00:39:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.802+0000 7f5f9e925800 20 add_watcher() i=5 2024-09-12T00:39:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.802+0000 7f5f9e925800 20 add_watcher() i=6 2024-09-12T00:39:22.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.803+0000 7f5f9e925800 20 add_watcher() i=7 2024-09-12T00:39:22.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.803+0000 7f5f9e925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:22.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.805+0000 7f5e50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:22.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.805+0000 7f5f9e925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:22.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.805+0000 7f5f9e925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:22.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.844+0000 7f5dcb7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:22.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.845+0000 7f5f9e925800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:22.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.845+0000 7f5f9e925800 20 Filter name: none 2024-09-12T00:39:22.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.845+0000 7f5dc97fa640 20 reqs_thread_entry: start 2024-09-12T00:39:22.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.845+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:39:22.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.847+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.847+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.847+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.848+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:39:22.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.850+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.851+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.851+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.852+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:39:22.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.854+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.855+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.855+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.856+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:39:22.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.857+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.858+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.858+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.858+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3092452699330399334', time=2024-09-12T02:36:27.985353+0000, chain.objs.size()=5 2024-09-12T00:39:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.858+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.1 2024-09-12T00:39:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.858+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.2 2024-09-12T00:39:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.858+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.3 2024-09-12T00:39:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.858+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.4 2024-09-12T00:39:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.858+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.5 2024-09-12T00:39:22.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.861+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.863+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:39:22.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.865+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.865+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.865+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.865+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11881668858134100333', time=2024-09-12T02:37:32.131074+0000, chain.objs.size()=5 2024-09-12T00:39:22.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.865+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file.mpg.2~OEgXVquXfylg_kccqqROattqbUXykom.1 2024-09-12T00:39:22.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.865+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file.mpg.2~OEgXVquXfylg_kccqqROattqbUXykom.2 2024-09-12T00:39:22.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.865+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file.mpg.2~OEgXVquXfylg_kccqqROattqbUXykom.3 2024-09-12T00:39:22.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.866+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file.mpg.2~OEgXVquXfylg_kccqqROattqbUXykom.4 2024-09-12T00:39:22.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.866+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file.mpg.2~OEgXVquXfylg_kccqqROattqbUXykom.5 2024-09-12T00:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.868+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.871+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:39:22.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.872+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.873+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.873+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.874+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:39:22.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.875+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.876+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.877+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.877+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14100761429379393969', time=2024-09-12T02:36:41.334343+0000, chain.objs.size()=5 2024-09-12T00:39:22.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.877+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~nwsQDtVAQMlPj5dbYaqrVM8bHfsrmsv.1 2024-09-12T00:39:22.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.877+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~nwsQDtVAQMlPj5dbYaqrVM8bHfsrmsv.2 2024-09-12T00:39:22.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.877+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~nwsQDtVAQMlPj5dbYaqrVM8bHfsrmsv.3 2024-09-12T00:39:22.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.877+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~nwsQDtVAQMlPj5dbYaqrVM8bHfsrmsv.4 2024-09-12T00:39:22.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.877+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~nwsQDtVAQMlPj5dbYaqrVM8bHfsrmsv.5 2024-09-12T00:39:22.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.879+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.882+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:39:22.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.884+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.884+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17613110773404710823', time=2024-09-12T02:37:21.759534+0000, chain.objs.size()=5 2024-09-12T00:39:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.100__multipart_key1.2~ezEiwAlwJcEc2lWenikheBgmS6HBFfs.1 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.100__multipart_key1.2~ezEiwAlwJcEc2lWenikheBgmS6HBFfs.2 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.100__multipart_key1.2~ezEiwAlwJcEc2lWenikheBgmS6HBFfs.3 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.100__multipart_key1.2~ezEiwAlwJcEc2lWenikheBgmS6HBFfs.4 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.100__multipart_key1.2~ezEiwAlwJcEc2lWenikheBgmS6HBFfs.5 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='2~yMs6ibnZOOoUr43vJR8N26bs0cE4Jyv', time=2024-09-12T02:37:37.897262+0000, chain.objs.size()=5 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.102__multipart_key1.2~yMs6ibnZOOoUr43vJR8N26bs0cE4Jyv.7 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.102__multipart_key1.2~yMs6ibnZOOoUr43vJR8N26bs0cE4Jyv.8 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.102__multipart_key1.2~yMs6ibnZOOoUr43vJR8N26bs0cE4Jyv.9 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.102__multipart_key1.2~yMs6ibnZOOoUr43vJR8N26bs0cE4Jyv.10 2024-09-12T00:39:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.885+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.102__multipart_key1.2~yMs6ibnZOOoUr43vJR8N26bs0cE4Jyv.11 2024-09-12T00:39:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.890+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.893+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:39:22.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.895+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.895+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.895+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.896+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:39:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.898+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.898+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.899+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.899+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17783278760850878221', time=2024-09-12T02:36:48.817952+0000, chain.objs.size()=5 2024-09-12T00:39:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.899+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~0xJ3vrnVSLO5HNTuu9LwGR17a8XmSbv.1 2024-09-12T00:39:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.899+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~0xJ3vrnVSLO5HNTuu9LwGR17a8XmSbv.2 2024-09-12T00:39:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.899+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~0xJ3vrnVSLO5HNTuu9LwGR17a8XmSbv.3 2024-09-12T00:39:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.899+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~0xJ3vrnVSLO5HNTuu9LwGR17a8XmSbv.4 2024-09-12T00:39:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.899+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~0xJ3vrnVSLO5HNTuu9LwGR17a8XmSbv.5 2024-09-12T00:39:22.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.902+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.904+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:39:22.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.905+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.906+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.906+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.907+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:39:22.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.909+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.909+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.909+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.909+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='2~TClc18cYRX8P2nBXY3QjH-94uUXIGK6', time=2024-09-12T02:36:10.922163+0000, chain.objs.size()=5 2024-09-12T00:39:22.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.909+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.80__multipart_key1.2~TClc18cYRX8P2nBXY3QjH-94uUXIGK6.1 2024-09-12T00:39:22.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.909+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.80__multipart_key1.2~TClc18cYRX8P2nBXY3QjH-94uUXIGK6.2 2024-09-12T00:39:22.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.910+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.80__multipart_key1.2~TClc18cYRX8P2nBXY3QjH-94uUXIGK6.3 2024-09-12T00:39:22.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.910+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.80__multipart_key1.2~TClc18cYRX8P2nBXY3QjH-94uUXIGK6.4 2024-09-12T00:39:22.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.910+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.80__multipart_key1.2~TClc18cYRX8P2nBXY3QjH-94uUXIGK6.5 2024-09-12T00:39:22.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.912+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.915+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:39:22.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.916+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.917+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.917+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.918+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:39:22.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.919+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.920+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.920+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.921+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:39:22.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.922+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.923+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.923+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.924+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:39:22.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.926+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.926+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.927+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.927+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1887437714462216968', time=2024-09-12T02:37:04.580608+0000, chain.objs.size()=5 2024-09-12T00:39:22.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.927+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~vo0K198u_Z4Il_QPSZij7laKJthBzc2.1 2024-09-12T00:39:22.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.927+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__shadow_key1.2~vo0K198u_Z4Il_QPSZij7laKJthBzc2.1_1 2024-09-12T00:39:22.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.927+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~vo0K198u_Z4Il_QPSZij7laKJthBzc2.2 2024-09-12T00:39:22.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.927+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__shadow_key1.2~vo0K198u_Z4Il_QPSZij7laKJthBzc2.2_1 2024-09-12T00:39:22.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.927+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~vo0K198u_Z4Il_QPSZij7laKJthBzc2.3 2024-09-12T00:39:22.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.930+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.933+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:39:22.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.934+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:22.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15706557060036449758', time=2024-09-12T02:37:58.195438+0000, chain.objs.size()=5 2024-09-12T00:39:22.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~rJ5pXd6nl2gMUZJ9h89FnC548rBS36b.1 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~rJ5pXd6nl2gMUZJ9h89FnC548rBS36b.2 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~rJ5pXd6nl2gMUZJ9h89FnC548rBS36b.3 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~rJ5pXd6nl2gMUZJ9h89FnC548rBS36b.4 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~rJ5pXd6nl2gMUZJ9h89FnC548rBS36b.5 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14556426841621681075', time=2024-09-12T02:38:03.031175+0000, chain.objs.size()=5 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~UXtngm5i4GVKGUUGwDMSSXXZChu9OxB.1 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__shadow_key1.2~UXtngm5i4GVKGUUGwDMSSXXZChu9OxB.1_1 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~UXtngm5i4GVKGUUGwDMSSXXZChu9OxB.2 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__shadow_key1.2~UXtngm5i4GVKGUUGwDMSSXXZChu9OxB.2_1 2024-09-12T00:39:22.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.935+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~UXtngm5i4GVKGUUGwDMSSXXZChu9OxB.3 2024-09-12T00:39:22.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.940+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.943+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:39:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.944+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.945+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.945+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.945+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16610031760923376616', time=2024-09-12T02:37:11.841148+0000, chain.objs.size()=5 2024-09-12T00:39:22.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.945+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.99__multipart_key1.2~CWdSq0QiMNcunfduI6twY8_ya4pyzEL.1 2024-09-12T00:39:22.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.945+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.99__multipart_key1.2~CWdSq0QiMNcunfduI6twY8_ya4pyzEL.2 2024-09-12T00:39:22.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.945+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.99__multipart_key1.2~CWdSq0QiMNcunfduI6twY8_ya4pyzEL.3 2024-09-12T00:39:22.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.945+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.99__multipart_key1.2~CWdSq0QiMNcunfduI6twY8_ya4pyzEL.4 2024-09-12T00:39:22.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.945+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.99__multipart_key1.2~CWdSq0QiMNcunfduI6twY8_ya4pyzEL.5 2024-09-12T00:39:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.948+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.950+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:39:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.952+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.952+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.952+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:39:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.952+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2652083518348168129', time=2024-09-12T02:37:32.184499+0000, chain.objs.size()=4 2024-09-12T00:39:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.952+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file2.mpg.2~kULHjbXGTctzjf_bS2Ub8aIR7zleBRt.1 2024-09-12T00:39:22.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.952+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file2.mpg.2~kULHjbXGTctzjf_bS2Ub8aIR7zleBRt.2 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file2.mpg.2~kULHjbXGTctzjf_bS2Ub8aIR7zleBRt.3 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.101__multipart_file2.mpg.2~kULHjbXGTctzjf_bS2Ub8aIR7zleBRt.4 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7627548567219516171', time=2024-09-12T02:38:25.702635+0000, chain.objs.size()=5 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.104__multipart_key1.2~_pG_fdsOZYFilmtB6Y2ATnOsEMG8ZOH.1 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.104__multipart_key1.2~_pG_fdsOZYFilmtB6Y2ATnOsEMG8ZOH.2 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.104__multipart_key1.2~_pG_fdsOZYFilmtB6Y2ATnOsEMG8ZOH.3 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.104__multipart_key1.2~_pG_fdsOZYFilmtB6Y2ATnOsEMG8ZOH.4 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.104__multipart_key1.2~_pG_fdsOZYFilmtB6Y2ATnOsEMG8ZOH.5 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI', time=2024-09-12T02:38:36.642466+0000, chain.objs.size()=1 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.20 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI', time=2024-09-12T02:38:36.697764+0000, chain.objs.size()=39 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.1 2024-09-12T00:39:22.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.953+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.2 2024-09-12T00:39:22.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.955+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.3 2024-09-12T00:39:22.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.956+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.4 2024-09-12T00:39:22.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.956+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.5 2024-09-12T00:39:22.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.956+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.6 2024-09-12T00:39:22.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.957+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.7 2024-09-12T00:39:22.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.957+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.8 2024-09-12T00:39:22.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.957+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.9 2024-09-12T00:39:22.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.957+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.10 2024-09-12T00:39:22.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.957+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.11 2024-09-12T00:39:22.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.958+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.12 2024-09-12T00:39:22.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.958+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.13 2024-09-12T00:39:22.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.959+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.14 2024-09-12T00:39:22.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.959+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.15 2024-09-12T00:39:22.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.961+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.16 2024-09-12T00:39:22.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.961+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.17 2024-09-12T00:39:22.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.961+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.18 2024-09-12T00:39:22.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.961+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.19 2024-09-12T00:39:22.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.961+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.oQcGYUwK8CIis6fzt2BKkG9J5yWGSMCG.20 2024-09-12T00:39:22.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.961+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.21 2024-09-12T00:39:22.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.962+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.22 2024-09-12T00:39:22.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.963+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.23 2024-09-12T00:39:22.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.963+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.24 2024-09-12T00:39:22.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.963+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.25 2024-09-12T00:39:22.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.963+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.26 2024-09-12T00:39:22.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.965+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.27 2024-09-12T00:39:22.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.966+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.28 2024-09-12T00:39:22.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.966+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.29 2024-09-12T00:39:22.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.966+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.30 2024-09-12T00:39:22.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.966+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.31 2024-09-12T00:39:22.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.966+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.32 2024-09-12T00:39:22.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.966+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.33 2024-09-12T00:39:22.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.969+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.34 2024-09-12T00:39:22.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.969+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.35 2024-09-12T00:39:22.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.969+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.36 2024-09-12T00:39:22.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.969+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.37 2024-09-12T00:39:22.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.969+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.38 2024-09-12T00:39:22.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.969+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.106__multipart_key1.2~FY83oSPeSeLA3yoSW7l8o6GqqltSFsI.39 2024-09-12T00:39:22.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.972+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.975+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:39:22.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.976+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.977+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.977+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.978+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:39:22.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.979+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.980+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.980+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.980+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.503589098926907005', time=2024-09-12T02:37:48.441815+0000, chain.objs.size()=5 2024-09-12T00:39:22.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.980+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~Em0jaPuXC7P9Zeoz5SyD7YOGxLeNyAl.1 2024-09-12T00:39:22.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.980+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~Em0jaPuXC7P9Zeoz5SyD7YOGxLeNyAl.2 2024-09-12T00:39:22.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.980+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~Em0jaPuXC7P9Zeoz5SyD7YOGxLeNyAl.3 2024-09-12T00:39:22.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.980+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~Em0jaPuXC7P9Zeoz5SyD7YOGxLeNyAl.4 2024-09-12T00:39:22.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.980+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~Em0jaPuXC7P9Zeoz5SyD7YOGxLeNyAl.5 2024-09-12T00:39:22.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.982+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.985+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:39:22.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.987+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.987+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.988+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:22.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.988+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11691045804316854823', time=2024-09-12T02:37:01.201338+0000, chain.objs.size()=5 2024-09-12T00:39:22.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.988+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~yJeE_cz3gExdAGd5ZpmCJBRbfA2Ss2Q.1 2024-09-12T00:39:22.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.988+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__shadow_key1.2~yJeE_cz3gExdAGd5ZpmCJBRbfA2Ss2Q.1_1 2024-09-12T00:39:22.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.988+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~yJeE_cz3gExdAGd5ZpmCJBRbfA2Ss2Q.2 2024-09-12T00:39:22.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.988+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__shadow_key1.2~yJeE_cz3gExdAGd5ZpmCJBRbfA2Ss2Q.2_1 2024-09-12T00:39:22.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.988+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~yJeE_cz3gExdAGd5ZpmCJBRbfA2Ss2Q.3 2024-09-12T00:39:22.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.990+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:22.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.993+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:39:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.994+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:22.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11021658252148288393', time=2024-09-12T02:36:18.526234+0000, chain.objs.size()=2 2024-09-12T00:39:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.84__shadow_.GicF10O5bmhbrEwNmOYhXQh5ILg_ex0_1 2024-09-12T00:39:22.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.84__shadow_.GicF10O5bmhbrEwNmOYhXQh5ILg_ex0_2 2024-09-12T00:39:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14729157608863599961', time=2024-09-12T02:38:31.291631+0000, chain.objs.size()=5 2024-09-12T00:39:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.105__multipart_key1.2~PaYfTRbhfFOpHA0cnr71xl5j7piIRv1.1 2024-09-12T00:39:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.105__multipart_key1.2~PaYfTRbhfFOpHA0cnr71xl5j7piIRv1.2 2024-09-12T00:39:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.105__multipart_key1.2~PaYfTRbhfFOpHA0cnr71xl5j7piIRv1.3 2024-09-12T00:39:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.105__multipart_key1.2~PaYfTRbhfFOpHA0cnr71xl5j7piIRv1.4 2024-09-12T00:39:22.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.995+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.105__multipart_key1.2~PaYfTRbhfFOpHA0cnr71xl5j7piIRv1.5 2024-09-12T00:39:22.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:22.998+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.001+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:39:23.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.002+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:23.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3356944236774215536', time=2024-09-12T02:37:05.063544+0000, chain.objs.size()=4 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.94__shadow_.NU__Zyne7DMcI5GOgVLuazh55gtXi8t_1 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.94__shadow_.NU__Zyne7DMcI5GOgVLuazh55gtXi8t_2 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.94__shadow_.NU__Zyne7DMcI5GOgVLuazh55gtXi8t_3 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.94__shadow_.NU__Zyne7DMcI5GOgVLuazh55gtXi8t_4 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11829939070496408742', time=2024-09-12T02:38:17.148035+0000, chain.objs.size()=5 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~sQkV4QUDWX5LHyJ_trJqyfEQbLBoT87.1 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__shadow_key1.2~sQkV4QUDWX5LHyJ_trJqyfEQbLBoT87.1_1 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~sQkV4QUDWX5LHyJ_trJqyfEQbLBoT87.2 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__shadow_key1.2~sQkV4QUDWX5LHyJ_trJqyfEQbLBoT87.2_1 2024-09-12T00:39:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.003+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~sQkV4QUDWX5LHyJ_trJqyfEQbLBoT87.3 2024-09-12T00:39:23.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.008+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.011+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:39:23.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.012+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:39:23.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13049167802513737434', time=2024-09-12T02:37:04.784051+0000, chain.objs.size()=5 2024-09-12T00:39:23.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~KRq4XsCK1VGpPx0wF16b7s-CXx75Qg5.1 2024-09-12T00:39:23.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__shadow_key1.2~KRq4XsCK1VGpPx0wF16b7s-CXx75Qg5.1_1 2024-09-12T00:39:23.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~KRq4XsCK1VGpPx0wF16b7s-CXx75Qg5.2 2024-09-12T00:39:23.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__shadow_key1.2~KRq4XsCK1VGpPx0wF16b7s-CXx75Qg5.2_1 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~KRq4XsCK1VGpPx0wF16b7s-CXx75Qg5.3 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13626862920092321461', time=2024-09-12T02:37:53.348977+0000, chain.objs.size()=5 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~0w_44ZOEu3-z-P8LiDSXft1kwjJQ6hg.1 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~0w_44ZOEu3-z-P8LiDSXft1kwjJQ6hg.2 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~0w_44ZOEu3-z-P8LiDSXft1kwjJQ6hg.3 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~0w_44ZOEu3-z-P8LiDSXft1kwjJQ6hg.4 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~0w_44ZOEu3-z-P8LiDSXft1kwjJQ6hg.5 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4311525995264939886', time=2024-09-12T02:39:22.131489+0000, chain.objs.size()=5 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.145__multipart_key1/data/file.mpg.2~XOFcB78BcONzRWiRMa7AkFreRqXbTHg.1 2024-09-12T00:39:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.013+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.145__multipart_key1/data/file.mpg.2~XOFcB78BcONzRWiRMa7AkFreRqXbTHg.2 2024-09-12T00:39:23.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.015+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.145__multipart_key1/data/file.mpg.2~XOFcB78BcONzRWiRMa7AkFreRqXbTHg.3 2024-09-12T00:39:23.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.017+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.145__multipart_key1/data/file.mpg.2~XOFcB78BcONzRWiRMa7AkFreRqXbTHg.4 2024-09-12T00:39:23.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.017+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.145__multipart_key1/data/file.mpg.2~XOFcB78BcONzRWiRMa7AkFreRqXbTHg.5 2024-09-12T00:39:23.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.021+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.023+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:39:23.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.024+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.025+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.025+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.026+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:39:23.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.027+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:23.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4188358475468578651', time=2024-09-12T02:36:28.264462+0000, chain.objs.size()=5 2024-09-12T00:39:23.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.1 2024-09-12T00:39:23.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.2 2024-09-12T00:39:23.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.3 2024-09-12T00:39:23.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.4 2024-09-12T00:39:23.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.92__multipart_key1.2~Rk7aCPa52yjAbdgUHW4me3Wm4hXSyIf.5 2024-09-12T00:39:23.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.22036066942213425', time=2024-09-12T02:39:07.412821+0000, chain.objs.size()=5 2024-09-12T00:39:23.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.144__multipart_key1.2~5tiJ9uozpWuOeetYO9BoDO5G96-ISnZ.1 2024-09-12T00:39:23.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.144__multipart_key1.2~5tiJ9uozpWuOeetYO9BoDO5G96-ISnZ.2 2024-09-12T00:39:23.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.144__multipart_key1.2~5tiJ9uozpWuOeetYO9BoDO5G96-ISnZ.3 2024-09-12T00:39:23.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.144__multipart_key1.2~5tiJ9uozpWuOeetYO9BoDO5G96-ISnZ.4 2024-09-12T00:39:23.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.028+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.144__multipart_key1.2~5tiJ9uozpWuOeetYO9BoDO5G96-ISnZ.5 2024-09-12T00:39:23.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.032+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.035+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:39:23.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.037+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.037+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.037+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.039+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:39:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.040+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.041+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.041+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.041+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5289833671624440574', time=2024-09-12T02:38:16.952146+0000, chain.objs.size()=5 2024-09-12T00:39:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.041+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~4nCbDpaD9tWf8-_PNUaYrz7ODSlDfJd.1 2024-09-12T00:39:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.041+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__shadow_key1.2~4nCbDpaD9tWf8-_PNUaYrz7ODSlDfJd.1_1 2024-09-12T00:39:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.041+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~4nCbDpaD9tWf8-_PNUaYrz7ODSlDfJd.2 2024-09-12T00:39:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.041+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__shadow_key1.2~4nCbDpaD9tWf8-_PNUaYrz7ODSlDfJd.2_1 2024-09-12T00:39:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.041+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.103__multipart_key1.2~4nCbDpaD9tWf8-_PNUaYrz7ODSlDfJd.3 2024-09-12T00:39:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.044+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.046+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:39:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.048+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.048+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.049+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.049+0000 7f5f9e925800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15455728925505671860', time=2024-09-12T02:36:45.406100+0000, chain.objs.size()=5 2024-09-12T00:39:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.049+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~2xlvpMpcOnTnHm_f2XKkDP-WXiWokAc.1 2024-09-12T00:39:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.049+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~2xlvpMpcOnTnHm_f2XKkDP-WXiWokAc.2 2024-09-12T00:39:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.049+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~2xlvpMpcOnTnHm_f2XKkDP-WXiWokAc.3 2024-09-12T00:39:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.049+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~2xlvpMpcOnTnHm_f2XKkDP-WXiWokAc.4 2024-09-12T00:39:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.049+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.95__multipart_key1.2~2xlvpMpcOnTnHm_f2XKkDP-WXiWokAc.5 2024-09-12T00:39:23.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.052+0000 7f5f9e925800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.054+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:39:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.055+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.056+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.056+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.057+0000 7f5f9e925800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:39:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.058+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.058+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.059+0000 7f5f9e925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.061+0000 7f5e50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.063+0000 7f5f9e925800 20 remove_watcher() i=0 2024-09-12T00:39:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.063+0000 7f5f9e925800 2 removed watcher, disabling cache 2024-09-12T00:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.064+0000 7f5f9e925800 20 remove_watcher() i=1 2024-09-12T00:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.065+0000 7f5f9e925800 20 remove_watcher() i=2 2024-09-12T00:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.066+0000 7f5f9e925800 20 remove_watcher() i=3 2024-09-12T00:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.067+0000 7f5f9e925800 20 remove_watcher() i=4 2024-09-12T00:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.068+0000 7f5f9e925800 20 remove_watcher() i=5 2024-09-12T00:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.068+0000 7f5f9e925800 20 remove_watcher() i=6 2024-09-12T00:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.069+0000 7f5f9e925800 20 remove_watcher() i=7 2024-09-12T00:39:23.080 DEBUG:teuthology.orchestra.run.smithi033:> radosgw-admin gc process --include-all 2024-09-12T00:39:23.134 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:23.134 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.175+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.177+0000 7f6a4f817800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.177+0000 7f6a4f817800 20 realm 2024-09-12T00:39:23.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.177+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.177+0000 7f6a4f817800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.177+0000 7f6a4f817800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:23.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.177+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.177+0000 7f6a4f817800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.177+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.178+0000 7f6a4f817800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.178+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.179+0000 7f6a4f817800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:23.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.179+0000 7f6a4f817800 20 searching for the correct realm 2024-09-12T00:39:23.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.181+0000 7f6a427e6640 0 -- 172.21.15.33:0/724877309 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x560d759d83e0 msgr2=0x560d759da7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:23.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.185+0000 7f6a4afe7640 0 -- 172.21.15.33:0/724877309 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f6a3405c3b0 msgr2=0x7f6a34068a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.391+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 zone default found 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 4 Realm: () 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 zonegroup default 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.392+0000 7f6a4f817800 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.393+0000 7f6a4f817800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.393+0000 7f6a4f817800 20 started sync module instance, tier type = 2024-09-12T00:39:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.393+0000 7f6a4f817800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.402+0000 7f6a4f817800 20 add_watcher() i=0 2024-09-12T00:39:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.402+0000 7f6a4f817800 20 add_watcher() i=1 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.402+0000 7f6a4f817800 20 add_watcher() i=2 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.402+0000 7f6a4f817800 20 add_watcher() i=3 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.402+0000 7f6a4f817800 20 add_watcher() i=4 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.402+0000 7f6a4f817800 20 add_watcher() i=5 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.402+0000 7f6a4f817800 20 add_watcher() i=6 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.403+0000 7f6a4f817800 20 add_watcher() i=7 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.403+0000 7f6a4f817800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:23.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.404+0000 7f69017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.404+0000 7f6a4f817800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:23.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.404+0000 7f6a4f817800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:23.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.439+0000 7f687bfff640 20 reqs_thread_entry: start 2024-09-12T00:39:23.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.439+0000 7f6a4f817800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:23.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.439+0000 7f6a4f817800 20 Filter name: none 2024-09-12T00:39:23.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.440+0000 7f6879ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:23.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.440+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.441+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.441+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.442+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.443+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:39:23.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.444+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.445+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.445+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.446+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:39:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.447+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.448+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.448+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.449+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:39:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.450+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.451+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.451+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.452+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:39:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.453+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.454+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.454+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.455+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:39:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.456+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.457+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.457+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.458+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:39:23.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.459+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.460+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.460+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.461+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:39:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.463+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.464+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.464+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.465+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:39:23.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.466+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.467+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.467+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.468+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:39:23.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.469+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.470+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.470+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.471+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:39:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.472+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.472+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.473+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.474+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:39:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.475+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.475+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.476+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.477+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:39:23.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.478+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.478+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.479+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.480+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:39:23.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.481+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.482+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.482+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.483+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:39:23.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.485+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.486+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.486+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.487+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:39:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.488+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.489+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.489+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.490+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:39:23.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.491+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.492+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.492+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.493+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:39:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.494+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.495+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.495+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.496+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:39:23.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.497+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.498+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.498+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.499+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:39:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.500+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.501+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.501+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.502+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:39:23.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.503+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.504+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.504+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.505+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:39:23.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.506+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.507+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.507+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.508+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:39:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.509+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.510+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.510+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.511+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.513+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.513+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.513+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.514+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:39:23.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.516+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.516+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.517+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.518+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:39:23.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.519+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.519+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.520+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.521+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:39:23.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.522+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.522+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.523+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.524+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:39:23.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.526+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.526+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.526+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.527+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:39:23.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.529+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.529+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.529+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.530+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:39:23.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.532+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.532+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.532+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.533+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:39:23.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.535+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.535+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.535+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.536+0000 7f6a4f817800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:39:23.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.537+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.538+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.538+0000 7f6a4f817800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.540+0000 7f69017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.543+0000 7f6a4f817800 20 remove_watcher() i=0 2024-09-12T00:39:23.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.543+0000 7f6a4f817800 2 removed watcher, disabling cache 2024-09-12T00:39:23.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.544+0000 7f6a4f817800 20 remove_watcher() i=1 2024-09-12T00:39:23.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.545+0000 7f6a4f817800 20 remove_watcher() i=2 2024-09-12T00:39:23.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.546+0000 7f6a4f817800 20 remove_watcher() i=3 2024-09-12T00:39:23.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.547+0000 7f6a4f817800 20 remove_watcher() i=4 2024-09-12T00:39:23.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.548+0000 7f6a4f817800 20 remove_watcher() i=5 2024-09-12T00:39:23.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.549+0000 7f6a4f817800 20 remove_watcher() i=6 2024-09-12T00:39:23.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:23.550+0000 7f6a4f817800 20 remove_watcher() i=7 2024-09-12T00:39:23.560 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T00:39:23.583 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T00:39:23.584 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T00:39:23.584 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T00:39:23.584 DEBUG:teuthology.orchestra.run.smithi033:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:39:23.614 INFO:teuthology.orchestra.run.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T00:39:24.415 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T00:39:24.416 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T00:39:24.416 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key CTJWHGEHXJTYMXBCHEJY --secret oJ1tubYmddzqs78fgSBn3hKO+Deie1Rnz5EE79ulGch142Pwc3UdMg== --cluster ceph 2024-09-12T00:39:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.560+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.562+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.562+0000 7f9de0939800 20 realm 2024-09-12T00:39:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.562+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.562+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.562+0000 7f9de0939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.562+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.562+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.562+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.563+0000 7f9de0939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.563+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.564+0000 7f9de0939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.564+0000 7f9de0939800 20 searching for the correct realm 2024-09-12T00:39:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.568+0000 7f9ddcdc8640 0 -- 172.21.15.33:0/491364869 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55d169de4bd0 msgr2=0x55d169de7090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:24.773+0000 7f9ddc5c7640 0 -- 172.21.15.33:0/491364869 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f9dd0067bb0 msgr2=0x7f9dd0015970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.183+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 20 zone default found 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 4 Realm: () 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 20 zonegroup default 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.184+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.185+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.185+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.185+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.185+0000 7f9de0939800 20 started sync module instance, tier type = 2024-09-12T00:39:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.185+0000 7f9de0939800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:25.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.196+0000 7f9de0939800 20 add_watcher() i=0 2024-09-12T00:39:25.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.196+0000 7f9de0939800 20 add_watcher() i=1 2024-09-12T00:39:25.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.196+0000 7f9de0939800 20 add_watcher() i=2 2024-09-12T00:39:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.196+0000 7f9de0939800 20 add_watcher() i=3 2024-09-12T00:39:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.196+0000 7f9de0939800 20 add_watcher() i=4 2024-09-12T00:39:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.196+0000 7f9de0939800 20 add_watcher() i=5 2024-09-12T00:39:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.196+0000 7f9de0939800 20 add_watcher() i=6 2024-09-12T00:39:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.198+0000 7f9de0939800 20 add_watcher() i=7 2024-09-12T00:39:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.198+0000 7f9de0939800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.200+0000 7f9c92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.200+0000 7f9de0939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.200+0000 7f9de0939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.200+0000 7f9de0939800 5 note: GC not initialized 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.200+0000 7f9c91fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.200+0000 7f9de0939800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.200+0000 7f9de0939800 20 Filter name: none 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.200+0000 7f9c8affd640 20 reqs_thread_entry: start 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T00:39:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T00:39:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T00:39:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:39:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 10 cache get: name=default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY : miss 2024-09-12T00:39:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.201+0000 7f9de0939800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.202+0000 7f9de0939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.202+0000 7f9de0939800 10 cache put: name=default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY info.flags=0x0 2024-09-12T00:39:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.202+0000 7f9de0939800 10 adding default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY to cache LRU end 2024-09-12T00:39:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.202+0000 7f9de0939800 10 cache get: name=default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY : hit (negative entry) 2024-09-12T00:39:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.202+0000 7f9de0939800 10 cache get: name=default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY : hit (negative entry) 2024-09-12T00:39:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.203+0000 7f9de0939800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:39:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.203+0000 7f9de0939800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.203+0000 7f9de0939800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:39:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.203+0000 7f9cbb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366385 cookie 94357912708880 notifier 9060 bl.length()=645 2024-09-12T00:39:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.203+0000 7f9cbb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:39:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.203+0000 7f9cbb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.207+0000 7f9de0939800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:39:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.207+0000 7f9de0939800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:39:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.207+0000 7f9de0939800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T00:39:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.207+0000 7f9cbb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366386 cookie 94357912723024 notifier 9060 bl.length()=185 2024-09-12T00:39:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.207+0000 7f9cbb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:39:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.207+0000 7f9cbb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:39:25.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.210+0000 7f9de0939800 10 cache put: name=default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY info.flags=0x7 2024-09-12T00:39:25.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.210+0000 7f9de0939800 10 moving default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY to cache LRU end 2024-09-12T00:39:25.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.210+0000 7f9de0939800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:CTJWHGEHXJTYMXBCHEJY, ofs0, ns] 2024-09-12T00:39:25.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.211+0000 7f9cbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366317 cookie 94357912728592 notifier 9060 bl.length()=186 2024-09-12T00:39:25.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.211+0000 7f9cbaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY info.flags=0x7 2024-09-12T00:39:25.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.211+0000 7f9cbaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CTJWHGEHXJTYMXBCHEJY to cache LRU end 2024-09-12T00:39:25.211 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "foo.client.0", 2024-09-12T00:39:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T00:39:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "foo+test@test.test", 2024-09-12T00:39:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:39:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:39:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "foo.client.0", 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "CTJWHGEHXJTYMXBCHEJY", 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "oJ1tubYmddzqs78fgSBn3hKO+Deie1Rnz5EE79ulGch142Pwc3UdMg==", 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:25.202916Z" 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:39:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "rgw", 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "", 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:25.202897Z", 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:25.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.213+0000 7f9c92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:25.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.216+0000 7f9de0939800 20 remove_watcher() i=0 2024-09-12T00:39:25.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.216+0000 7f9de0939800 2 removed watcher, disabling cache 2024-09-12T00:39:25.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.218+0000 7f9de0939800 20 remove_watcher() i=1 2024-09-12T00:39:25.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.219+0000 7f9de0939800 20 remove_watcher() i=2 2024-09-12T00:39:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.220+0000 7f9de0939800 20 remove_watcher() i=3 2024-09-12T00:39:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.221+0000 7f9de0939800 20 remove_watcher() i=4 2024-09-12T00:39:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.223+0000 7f9de0939800 20 remove_watcher() i=5 2024-09-12T00:39:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.224+0000 7f9de0939800 20 remove_watcher() i=6 2024-09-12T00:39:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.225+0000 7f9de0939800 20 remove_watcher() i=7 2024-09-12T00:39:25.237 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3134360490 --totp-seed KRU5EKSNHYSBD3PV277SDUPBGTC2ETN4MIIFVPAVHUCNCUEE22XLR55JVYF5CXHT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:25.309 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:25.309 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:25.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.347+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.349+0000 7f6544335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.349+0000 7f6544335800 20 realm 2024-09-12T00:39:25.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.349+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.349+0000 7f6544335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.349+0000 7f6544335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:25.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.349+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.350+0000 7f6544335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.350+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.351+0000 7f6544335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:25.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.351+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.352+0000 7f6544335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:25.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.352+0000 7f6544335800 20 searching for the correct realm 2024-09-12T00:39:25.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.355+0000 7f65408e5640 0 -- 172.21.15.33:0/3726340396 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x55c5da249c80 msgr2=0x55c5da24c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:25.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.359+0000 7f65400e4640 0 -- 172.21.15.33:0/3726340396 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f653401a040 msgr2=0x7f653406ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.566+0000 7f6544335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.566+0000 7f6544335800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.566+0000 7f6544335800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.566+0000 7f6544335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.566+0000 7f6544335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.566+0000 7f6544335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.566+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:25.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 20 zone default found 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 4 Realm: () 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 20 zonegroup default 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.567+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.568+0000 7f6544335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.568+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.568+0000 7f6544335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.568+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.568+0000 7f6544335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.568+0000 7f6544335800 20 started sync module instance, tier type = 2024-09-12T00:39:25.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.568+0000 7f6544335800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:25.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.579+0000 7f6544335800 20 add_watcher() i=0 2024-09-12T00:39:25.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.579+0000 7f6544335800 20 add_watcher() i=1 2024-09-12T00:39:25.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.579+0000 7f6544335800 20 add_watcher() i=2 2024-09-12T00:39:25.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.579+0000 7f6544335800 20 add_watcher() i=3 2024-09-12T00:39:25.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.579+0000 7f6544335800 20 add_watcher() i=4 2024-09-12T00:39:25.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.579+0000 7f6544335800 20 add_watcher() i=5 2024-09-12T00:39:25.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.579+0000 7f6544335800 20 add_watcher() i=6 2024-09-12T00:39:25.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.580+0000 7f6544335800 20 add_watcher() i=7 2024-09-12T00:39:25.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.580+0000 7f6544335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:25.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.582+0000 7f63f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:25.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.582+0000 7f6544335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:25.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.582+0000 7f6544335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:25.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.582+0000 7f6544335800 5 note: GC not initialized 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.582+0000 7f63f5fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.582+0000 7f6544335800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.582+0000 7f6544335800 20 Filter name: none 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.583+0000 7f63677fe640 20 reqs_thread_entry: start 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.583+0000 7f6544335800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.583+0000 7f6544335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.583+0000 7f6544335800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.583+0000 7f6544335800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T00:39:25.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.583+0000 7f6544335800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:25.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:25.583+0000 7f6544335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:26.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.638+0000 7f6544335800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:39:26.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.638+0000 7f6544335800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:26.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.639+0000 7f6544335800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:39:26.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.640+0000 7f6416ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300979 cookie 94308256759936 notifier 8399 bl.length()=659 2024-09-12T00:39:26.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.640+0000 7f6416ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:39:26.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.640+0000 7f6416ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:26.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.644+0000 7f63f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:26.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.646+0000 7f6544335800 20 remove_watcher() i=0 2024-09-12T00:39:26.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.646+0000 7f6544335800 2 removed watcher, disabling cache 2024-09-12T00:39:26.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.648+0000 7f6544335800 20 remove_watcher() i=1 2024-09-12T00:39:26.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.649+0000 7f6544335800 20 remove_watcher() i=2 2024-09-12T00:39:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.650+0000 7f6544335800 20 remove_watcher() i=3 2024-09-12T00:39:26.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.651+0000 7f6544335800 20 remove_watcher() i=4 2024-09-12T00:39:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.652+0000 7f6544335800 20 remove_watcher() i=5 2024-09-12T00:39:26.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.653+0000 7f6544335800 20 remove_watcher() i=6 2024-09-12T00:39:26.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.655+0000 7f6544335800 20 remove_watcher() i=7 2024-09-12T00:39:26.666 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T00:39:26.667 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key YHRREMDHFORNXVMKEGTT --secret s8lPPgb6mIJxeEERuowrkfcbhSUISj7wezBALJANeMz30hPUVVJ4yw== --cluster ceph 2024-09-12T00:39:26.736 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:26.736 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:26.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.774+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.776+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.776+0000 7fc798b37800 20 realm 2024-09-12T00:39:26.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.776+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.776+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.776+0000 7fc798b37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:26.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.776+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.776+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.776+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.777+0000 7fc798b37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:26.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.777+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.778+0000 7fc798b37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:26.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.778+0000 7fc798b37800 20 searching for the correct realm 2024-09-12T00:39:26.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.781+0000 7fc794821640 0 -- 172.21.15.33:0/762794039 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7fc78c064af0 msgr2=0x7fc78c056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:26.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.784+0000 7fc794821640 0 -- 172.21.15.33:0/762794039 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fc788057980 msgr2=0x7fc788016430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:26.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:26.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:26.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:26.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:26.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:26.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:26.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.990+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:26.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:26.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 20 zone default found 2024-09-12T00:39:26.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 4 Realm: () 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 20 zonegroup default 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.991+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.992+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.992+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.992+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.992+0000 7fc798b37800 20 started sync module instance, tier type = 2024-09-12T00:39:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:26.992+0000 7fc798b37800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.001+0000 7fc798b37800 20 add_watcher() i=0 2024-09-12T00:39:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.001+0000 7fc798b37800 20 add_watcher() i=1 2024-09-12T00:39:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.001+0000 7fc798b37800 20 add_watcher() i=2 2024-09-12T00:39:27.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.001+0000 7fc798b37800 20 add_watcher() i=3 2024-09-12T00:39:27.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.001+0000 7fc798b37800 20 add_watcher() i=4 2024-09-12T00:39:27.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.001+0000 7fc798b37800 20 add_watcher() i=5 2024-09-12T00:39:27.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.001+0000 7fc798b37800 20 add_watcher() i=6 2024-09-12T00:39:27.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.002+0000 7fc798b37800 20 add_watcher() i=7 2024-09-12T00:39:27.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.002+0000 7fc798b37800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc64b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc798b37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc798b37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc798b37800 5 note: GC not initialized 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc64a7e4640 20 reqs_thread_entry: start 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc798b37800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc798b37800 20 Filter name: none 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc6437fe640 20 reqs_thread_entry: start 2024-09-12T00:39:27.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc798b37800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:39:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.004+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T00:39:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T00:39:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 cache get: name=default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT : miss 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 cache put: name=default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT info.flags=0x0 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 adding default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT to cache LRU end 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 cache get: name=default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT : hit (negative entry) 2024-09-12T00:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.005+0000 7fc798b37800 10 cache get: name=default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT : hit (negative entry) 2024-09-12T00:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.007+0000 7fc798b37800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.007+0000 7fc798b37800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.007+0000 7fc798b37800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.007+0000 7fc66bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300898 cookie 94090130131472 notifier 9090 bl.length()=645 2024-09-12T00:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.007+0000 7fc66bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.007+0000 7fc66bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.010+0000 7fc798b37800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.010+0000 7fc798b37800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.010+0000 7fc798b37800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T00:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.010+0000 7fc66bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300910 cookie 94090130143248 notifier 9090 bl.length()=185 2024-09-12T00:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.010+0000 7fc66bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.010+0000 7fc66bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:39:27.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.013+0000 7fc798b37800 10 cache put: name=default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT info.flags=0x7 2024-09-12T00:39:27.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.013+0000 7fc798b37800 10 moving default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT to cache LRU end 2024-09-12T00:39:27.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.013+0000 7fc798b37800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:YHRREMDHFORNXVMKEGTT, ofs0, ns] 2024-09-12T00:39:27.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.013+0000 7fc66b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300814 cookie 94090130136512 notifier 9090 bl.length()=186 2024-09-12T00:39:27.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.013+0000 7fc66b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT info.flags=0x7 2024-09-12T00:39:27.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.013+0000 7fc66b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YHRREMDHFORNXVMKEGTT to cache LRU end 2024-09-12T00:39:27.013 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:27.013 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "bar.client.0", 2024-09-12T00:39:27.013 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T00:39:27.013 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "bar+test@test.test", 2024-09-12T00:39:27.013 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:39:27.013 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:27.013 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:39:27.013 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "bar.client.0", 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "YHRREMDHFORNXVMKEGTT", 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "s8lPPgb6mIJxeEERuowrkfcbhSUISj7wezBALJANeMz30hPUVVJ4yw==", 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:27.006495Z" 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:39:27.014 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:39:27.015 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "rgw", 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "", 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:27.006480Z", 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:39:27.016 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:27.017 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:27.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.015+0000 7fc64b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:27.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.018+0000 7fc798b37800 20 remove_watcher() i=0 2024-09-12T00:39:27.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.018+0000 7fc798b37800 2 removed watcher, disabling cache 2024-09-12T00:39:27.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.020+0000 7fc798b37800 20 remove_watcher() i=1 2024-09-12T00:39:27.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.021+0000 7fc798b37800 20 remove_watcher() i=2 2024-09-12T00:39:27.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.022+0000 7fc798b37800 20 remove_watcher() i=3 2024-09-12T00:39:27.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.023+0000 7fc798b37800 20 remove_watcher() i=4 2024-09-12T00:39:27.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.024+0000 7fc798b37800 20 remove_watcher() i=5 2024-09-12T00:39:27.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.025+0000 7fc798b37800 20 remove_watcher() i=6 2024-09-12T00:39:27.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.026+0000 7fc798b37800 20 remove_watcher() i=7 2024-09-12T00:39:27.037 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 3120741480 --totp-seed 4JNQSR4LTN5W75YJNY2HILQV4JJLG25EODDBINK4I5XACRNWH6KENKVIUVTFUFJ6 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:27.105 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:27.105 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:27.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.143+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.144+0000 7ff9f7d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.144+0000 7ff9f7d21800 20 realm 2024-09-12T00:39:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.144+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.144+0000 7ff9f7d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.144+0000 7ff9f7d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.144+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.144+0000 7ff9f7d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.144+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.145+0000 7ff9f7d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.145+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.146+0000 7ff9f7d21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:27.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.146+0000 7ff9f7d21800 20 searching for the correct realm 2024-09-12T00:39:27.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.149+0000 7ff9f320b640 0 -- 172.21.15.33:0/1274414155 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55db63ef8550 msgr2=0x55db63efa960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:27.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.152+0000 7ff9f3a0c640 0 -- 172.21.15.33:0/1274414155 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7ff9e8060790 msgr2=0x7ff9e807b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.358+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:27.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 20 zone default found 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 4 Realm: () 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 20 zonegroup default 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.359+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.360+0000 7ff9f7d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.360+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.360+0000 7ff9f7d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.360+0000 7ff9f7d21800 20 started sync module instance, tier type = 2024-09-12T00:39:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.360+0000 7ff9f7d21800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:27.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.369+0000 7ff9f7d21800 20 add_watcher() i=0 2024-09-12T00:39:27.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.369+0000 7ff9f7d21800 20 add_watcher() i=1 2024-09-12T00:39:27.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.369+0000 7ff9f7d21800 20 add_watcher() i=2 2024-09-12T00:39:27.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.369+0000 7ff9f7d21800 20 add_watcher() i=3 2024-09-12T00:39:27.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.369+0000 7ff9f7d21800 20 add_watcher() i=4 2024-09-12T00:39:27.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.369+0000 7ff9f7d21800 20 add_watcher() i=5 2024-09-12T00:39:27.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.369+0000 7ff9f7d21800 20 add_watcher() i=6 2024-09-12T00:39:27.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.370+0000 7ff9f7d21800 20 add_watcher() i=7 2024-09-12T00:39:27.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.370+0000 7ff9f7d21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:27.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.372+0000 7ff8a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:27.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.372+0000 7ff9f7d21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:27.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.372+0000 7ff9f7d21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:27.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.372+0000 7ff9f7d21800 5 note: GC not initialized 2024-09-12T00:39:27.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.372+0000 7ff8a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:27.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.373+0000 7ff9f7d21800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:27.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.373+0000 7ff9f7d21800 20 Filter name: none 2024-09-12T00:39:27.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.373+0000 7ff8227fc640 20 reqs_thread_entry: start 2024-09-12T00:39:27.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.373+0000 7ff9f7d21800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:39:27.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.373+0000 7ff9f7d21800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.374+0000 7ff9f7d21800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:39:27.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.374+0000 7ff9f7d21800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T00:39:27.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.374+0000 7ff9f7d21800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:27.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.374+0000 7ff9f7d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:27.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.376+0000 7ff9f7d21800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:27.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.376+0000 7ff9f7d21800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:27.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.376+0000 7ff9f7d21800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:39:27.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.377+0000 7ff8d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300899 cookie 94400762873600 notifier 8435 bl.length()=659 2024-09-12T00:39:27.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.377+0000 7ff8d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:27.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.377+0000 7ff8d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:27.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.380+0000 7ff8a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:27.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.382+0000 7ff9f7d21800 20 remove_watcher() i=0 2024-09-12T00:39:27.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.382+0000 7ff9f7d21800 2 removed watcher, disabling cache 2024-09-12T00:39:27.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.383+0000 7ff9f7d21800 20 remove_watcher() i=1 2024-09-12T00:39:27.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.384+0000 7ff9f7d21800 20 remove_watcher() i=2 2024-09-12T00:39:27.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.385+0000 7ff9f7d21800 20 remove_watcher() i=3 2024-09-12T00:39:27.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.387+0000 7ff9f7d21800 20 remove_watcher() i=4 2024-09-12T00:39:27.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.388+0000 7ff9f7d21800 20 remove_watcher() i=5 2024-09-12T00:39:27.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.389+0000 7ff9f7d21800 20 remove_watcher() i=6 2024-09-12T00:39:27.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.390+0000 7ff9f7d21800 20 remove_watcher() i=7 2024-09-12T00:39:27.400 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T00:39:27.401 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key ROFHBTPMMRRFNZEGKHBI --secret zNTevy0h4O/GaE5kMV7uYxp8nzNNnN5Q7D6YEGFqWm5cttcr/PmtWQ== --cluster ceph 2024-09-12T00:39:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.505+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.507+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.507+0000 7fa2232bb800 20 realm 2024-09-12T00:39:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.507+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.507+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.507+0000 7fa2232bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.507+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.507+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.507+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.508+0000 7fa2232bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.508+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.509+0000 7fa2232bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:27.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.509+0000 7fa2232bb800 20 searching for the correct realm 2024-09-12T00:39:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.511+0000 7fa21bfff640 0 -- 172.21.15.33:0/3153261623 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fa2140dac20 msgr2=0x7fa2140b16d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.515+0000 7fa220da5640 0 -- 172.21.15.33:0/3153261623 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fa20c06bbe0 msgr2=0x7fa20c07a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:27.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.739+0000 7fa2232bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.739+0000 7fa2232bb800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.739+0000 7fa2232bb800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.739+0000 7fa2232bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.739+0000 7fa2232bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.739+0000 7fa2232bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.739+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 20 zone default found 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 4 Realm: () 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 20 zonegroup default 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.740+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.741+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.741+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.741+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.741+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.741+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.741+0000 7fa2232bb800 20 started sync module instance, tier type = 2024-09-12T00:39:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.741+0000 7fa2232bb800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.752+0000 7fa2232bb800 20 add_watcher() i=0 2024-09-12T00:39:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.752+0000 7fa2232bb800 20 add_watcher() i=1 2024-09-12T00:39:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.752+0000 7fa2232bb800 20 add_watcher() i=2 2024-09-12T00:39:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.752+0000 7fa2232bb800 20 add_watcher() i=3 2024-09-12T00:39:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.752+0000 7fa2232bb800 20 add_watcher() i=4 2024-09-12T00:39:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.752+0000 7fa2232bb800 20 add_watcher() i=5 2024-09-12T00:39:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.752+0000 7fa2232bb800 20 add_watcher() i=6 2024-09-12T00:39:27.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.753+0000 7fa2232bb800 20 add_watcher() i=7 2024-09-12T00:39:27.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.753+0000 7fa2232bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:27.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.754+0000 7fa0d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa2232bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa2232bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa2232bb800 5 note: GC not initialized 2024-09-12T00:39:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa0d5fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa2232bb800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa2232bb800 20 Filter name: none 2024-09-12T00:39:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa0477fe640 20 reqs_thread_entry: start 2024-09-12T00:39:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa2232bb800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:39:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.755+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T00:39:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T00:39:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T00:39:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:39:27.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 cache get: name=default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI : miss 2024-09-12T00:39:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 cache put: name=default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI info.flags=0x0 2024-09-12T00:39:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 adding default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI to cache LRU end 2024-09-12T00:39:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 cache get: name=default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI : hit (negative entry) 2024-09-12T00:39:27.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.756+0000 7fa2232bb800 10 cache get: name=default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI : hit (negative entry) 2024-09-12T00:39:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.758+0000 7fa2232bb800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:39:27.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.758+0000 7fa2232bb800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.758+0000 7fa2232bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:39:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.758+0000 7fa0f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268207 cookie 94036853086528 notifier 8453 bl.length()=719 2024-09-12T00:39:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.758+0000 7fa0f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:39:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.758+0000 7fa0f7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:27.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.761+0000 7fa2232bb800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:39:27.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.761+0000 7fa2232bb800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:39:27.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.761+0000 7fa2232bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T00:39:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.761+0000 7fa0f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268144 cookie 94036853091664 notifier 8453 bl.length()=215 2024-09-12T00:39:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.761+0000 7fa0f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:39:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.761+0000 7fa0f7fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:39:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.764+0000 7fa2232bb800 10 cache put: name=default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI info.flags=0x7 2024-09-12T00:39:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.764+0000 7fa2232bb800 10 moving default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI to cache LRU end 2024-09-12T00:39:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.764+0000 7fa2232bb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:ROFHBTPMMRRFNZEGKHBI, ofs0, ns] 2024-09-12T00:39:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.764+0000 7fa0f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268196 cookie 94036853066832 notifier 8453 bl.length()=201 2024-09-12T00:39:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.764+0000 7fa0f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI info.flags=0x7 2024-09-12T00:39:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.764+0000 7fa0f77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ROFHBTPMMRRFNZEGKHBI to cache LRU end 2024-09-12T00:39:27.767 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:27.767 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T00:39:27.767 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T00:39:27.767 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T00:39:27.767 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:39:27.768 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:27.768 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:39:27.768 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:39:27.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:27.768 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T00:39:27.769 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "ROFHBTPMMRRFNZEGKHBI", 2024-09-12T00:39:27.769 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "zNTevy0h4O/GaE5kMV7uYxp8nzNNnN5Q7D6YEGFqWm5cttcr/PmtWQ==", 2024-09-12T00:39:27.769 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:39:27.769 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:27.757749Z" 2024-09-12T00:39:27.769 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:39:27.769 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:27.770 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:39:27.770 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:39:27.770 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:27.770 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:39:27.770 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:39:27.770 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:39:27.770 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:27.771 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:27.771 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:27.771 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:27.771 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:27.771 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:27.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:27.772 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:39:27.772 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:27.772 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:27.772 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:27.772 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:27.772 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:27.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:27.773 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:39:27.773 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "rgw", 2024-09-12T00:39:27.774 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:39:27.774 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "", 2024-09-12T00:39:27.774 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:39:27.774 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:27.757730Z", 2024-09-12T00:39:27.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:39:27.774 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:39:27.775 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:27.775 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:27.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.767+0000 7fa0d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.769+0000 7fa2232bb800 20 remove_watcher() i=0 2024-09-12T00:39:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.769+0000 7fa2232bb800 2 removed watcher, disabling cache 2024-09-12T00:39:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.770+0000 7fa2232bb800 20 remove_watcher() i=1 2024-09-12T00:39:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.772+0000 7fa2232bb800 20 remove_watcher() i=2 2024-09-12T00:39:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.773+0000 7fa2232bb800 20 remove_watcher() i=3 2024-09-12T00:39:27.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.774+0000 7fa2232bb800 20 remove_watcher() i=4 2024-09-12T00:39:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.775+0000 7fa2232bb800 20 remove_watcher() i=5 2024-09-12T00:39:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.776+0000 7fa2232bb800 20 remove_watcher() i=6 2024-09-12T00:39:27.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.777+0000 7fa2232bb800 20 remove_watcher() i=7 2024-09-12T00:39:27.788 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 5964262006 --totp-seed AMVDIBGGAJFEIL7LCHB6P5Z32SFIA2UPPOFS6SWTXKCXEU247474PS63RKN737UB --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:27.857 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:27.857 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:27.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.895+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.896+0000 7f6a1ab26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.896+0000 7f6a1ab26800 20 realm 2024-09-12T00:39:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.896+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.896+0000 7f6a1ab26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.896+0000 7f6a1ab26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:27.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.896+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.897+0000 7f6a1ab26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.897+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.898+0000 7f6a1ab26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.898+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.898+0000 7f6a1ab26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.898+0000 7f6a1ab26800 20 searching for the correct realm 2024-09-12T00:39:27.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.902+0000 7f6a16f0a640 0 -- 172.21.15.33:0/1580338564 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5637f1dbdd10 msgr2=0x5637f1dc0180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:27.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.905+0000 7f6a16709640 0 -- 172.21.15.33:0/1580338564 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f6a000a3960 msgr2=0x7f6a00077410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.910+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 20 zone default found 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 4 Realm: () 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 20 zonegroup default 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.911+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.912+0000 7f6a1ab26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.912+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.912+0000 7f6a1ab26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:27.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.912+0000 7f6a1ab26800 20 started sync module instance, tier type = 2024-09-12T00:39:27.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.912+0000 7f6a1ab26800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:27.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.921+0000 7f6a1ab26800 20 add_watcher() i=0 2024-09-12T00:39:27.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.921+0000 7f6a1ab26800 20 add_watcher() i=1 2024-09-12T00:39:27.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.921+0000 7f6a1ab26800 20 add_watcher() i=2 2024-09-12T00:39:27.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.921+0000 7f6a1ab26800 20 add_watcher() i=3 2024-09-12T00:39:27.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.921+0000 7f6a1ab26800 20 add_watcher() i=4 2024-09-12T00:39:27.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.921+0000 7f6a1ab26800 20 add_watcher() i=5 2024-09-12T00:39:27.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.921+0000 7f6a1ab26800 20 add_watcher() i=6 2024-09-12T00:39:27.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.922+0000 7f6a1ab26800 20 add_watcher() i=7 2024-09-12T00:39:27.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.922+0000 7f6a1ab26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:27.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.924+0000 7f68ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:27.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.924+0000 7f6a1ab26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:27.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.924+0000 7f6a1ab26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:27.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.924+0000 7f6a1ab26800 5 note: GC not initialized 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.924+0000 7f68477fe640 20 reqs_thread_entry: start 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.924+0000 7f6a1ab26800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.925+0000 7f6a1ab26800 20 Filter name: none 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.925+0000 7f68457fa640 20 reqs_thread_entry: start 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.925+0000 7f6a1ab26800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.925+0000 7f6a1ab26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.925+0000 7f6a1ab26800 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.925+0000 7f6a1ab26800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.925+0000 7f6a1ab26800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:27.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.925+0000 7f6a1ab26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:27.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.928+0000 7f6a1ab26800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:39:27.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.928+0000 7f6a1ab26800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:27.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.928+0000 7f6a1ab26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:39:27.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.928+0000 7f68f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268208 cookie 94798280924848 notifier 9144 bl.length()=733 2024-09-12T00:39:27.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.928+0000 7f68f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:39:27.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.928+0000 7f68f9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:27.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.930+0000 7f68ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:27.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.933+0000 7f6a1ab26800 20 remove_watcher() i=0 2024-09-12T00:39:27.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.933+0000 7f6a1ab26800 2 removed watcher, disabling cache 2024-09-12T00:39:27.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.934+0000 7f6a1ab26800 20 remove_watcher() i=1 2024-09-12T00:39:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.935+0000 7f6a1ab26800 20 remove_watcher() i=2 2024-09-12T00:39:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.936+0000 7f6a1ab26800 20 remove_watcher() i=3 2024-09-12T00:39:27.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.937+0000 7f6a1ab26800 20 remove_watcher() i=4 2024-09-12T00:39:27.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.938+0000 7f6a1ab26800 20 remove_watcher() i=5 2024-09-12T00:39:27.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.939+0000 7f6a1ab26800 20 remove_watcher() i=6 2024-09-12T00:39:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:27.940+0000 7f6a1ab26800 20 remove_watcher() i=7 2024-09-12T00:39:27.951 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T00:39:27.951 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key OFGGIWWGQAKQTVNMWMHQ --secret mlyZ3StwyDp59F59XpwGevwIVI8dWNQ+gu0bs5j2ToJWhLQVkoE4Og== --cluster ceph 2024-09-12T00:39:28.017 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:28.017 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:28.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.054+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.056+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.056+0000 7f4191f39800 20 realm 2024-09-12T00:39:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.056+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.056+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.056+0000 7f4191f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.056+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.056+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.056+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.057+0000 7f4191f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.057+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.058+0000 7f4191f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:28.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.058+0000 7f4191f39800 20 searching for the correct realm 2024-09-12T00:39:28.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.060+0000 7f418d3c6640 0 -- 172.21.15.33:0/1500693548 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f418001a3a0 msgr2=0x7f418001a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.064+0000 7f418dbc7640 0 -- 172.21.15.33:0/1500693548 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f418407c500 msgr2=0x7f41840aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.270+0000 7f4191f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:28.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.270+0000 7f4191f39800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:28.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.270+0000 7f4191f39800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:28.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.270+0000 7f4191f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:28.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.270+0000 7f4191f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:28.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.270+0000 7f4191f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:28.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.270+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 20 zone default found 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 4 Realm: () 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 20 zonegroup default 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.271+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.272+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.272+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.272+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.272+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.273+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.273+0000 7f4191f39800 20 started sync module instance, tier type = 2024-09-12T00:39:28.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.273+0000 7f4191f39800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:28.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.282+0000 7f4191f39800 20 add_watcher() i=0 2024-09-12T00:39:28.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.282+0000 7f4191f39800 20 add_watcher() i=1 2024-09-12T00:39:28.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.282+0000 7f4191f39800 20 add_watcher() i=2 2024-09-12T00:39:28.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.282+0000 7f4191f39800 20 add_watcher() i=3 2024-09-12T00:39:28.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.282+0000 7f4191f39800 20 add_watcher() i=4 2024-09-12T00:39:28.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.282+0000 7f4191f39800 20 add_watcher() i=5 2024-09-12T00:39:28.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.282+0000 7f4191f39800 20 add_watcher() i=6 2024-09-12T00:39:28.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.283+0000 7f4191f39800 20 add_watcher() i=7 2024-09-12T00:39:28.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.283+0000 7f4191f39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:28.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.285+0000 7f403f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.285+0000 7f4191f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.285+0000 7f4191f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.285+0000 7f4191f39800 5 note: GC not initialized 2024-09-12T00:39:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.285+0000 7f403e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.285+0000 7f4191f39800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.285+0000 7f4191f39800 20 Filter name: none 2024-09-12T00:39:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.286+0000 7f3faffff640 20 reqs_thread_entry: start 2024-09-12T00:39:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.286+0000 7f4191f39800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:39:28.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.286+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.286+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.286+0000 7f4191f39800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.286+0000 7f4191f39800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.286+0000 7f4191f39800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.286+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 10 cache get: name=default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ : miss 2024-09-12T00:39:28.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 10 cache put: name=default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ info.flags=0x0 2024-09-12T00:39:28.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 10 adding default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ to cache LRU end 2024-09-12T00:39:28.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 10 cache get: name=default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ : hit (negative entry) 2024-09-12T00:39:28.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.287+0000 7f4191f39800 10 cache get: name=default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ : hit (negative entry) 2024-09-12T00:39:28.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.288+0000 7f4191f39800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:28.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.288+0000 7f4191f39800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:28.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.288+0000 7f4191f39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:39:28.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.288+0000 7f40717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268145 cookie 94383970128688 notifier 8486 bl.length()=660 2024-09-12T00:39:28.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.288+0000 7f40717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:28.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.288+0000 7f40717fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:28.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.291+0000 7f4191f39800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:39:28.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.291+0000 7f4191f39800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:39:28.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.291+0000 7f4191f39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T00:39:28.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.292+0000 7f40717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268197 cookie 94383970104960 notifier 8486 bl.length()=191 2024-09-12T00:39:28.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.292+0000 7f40717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:39:28.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.292+0000 7f40717fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:39:28.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.294+0000 7f4191f39800 10 cache put: name=default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ info.flags=0x7 2024-09-12T00:39:28.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.294+0000 7f4191f39800 10 moving default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ to cache LRU end 2024-09-12T00:39:28.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.294+0000 7f4191f39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:OFGGIWWGQAKQTVNMWMHQ, ofs0, ns] 2024-09-12T00:39:28.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.294+0000 7f4070ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268209 cookie 94383970123776 notifier 8486 bl.length()=189 2024-09-12T00:39:28.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.295+0000 7f4070ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ info.flags=0x7 2024-09-12T00:39:28.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.295+0000 7f4070ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OFGGIWWGQAKQTVNMWMHQ to cache LRU end 2024-09-12T00:39:28.294 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "foobar.client.0", 2024-09-12T00:39:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "foobar+test@test.test", 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "foobar.client.0", 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "OFGGIWWGQAKQTVNMWMHQ", 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "mlyZ3StwyDp59F59XpwGevwIVI8dWNQ+gu0bs5j2ToJWhLQVkoE4Og==", 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:28.288196Z" 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:39:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "rgw", 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "", 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:28.288185Z", 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:28.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.297+0000 7f403f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.299+0000 7f4191f39800 20 remove_watcher() i=0 2024-09-12T00:39:28.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.299+0000 7f4191f39800 2 removed watcher, disabling cache 2024-09-12T00:39:28.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.301+0000 7f4191f39800 20 remove_watcher() i=1 2024-09-12T00:39:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.302+0000 7f4191f39800 20 remove_watcher() i=2 2024-09-12T00:39:28.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.303+0000 7f4191f39800 20 remove_watcher() i=3 2024-09-12T00:39:28.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.304+0000 7f4191f39800 20 remove_watcher() i=4 2024-09-12T00:39:28.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.305+0000 7f4191f39800 20 remove_watcher() i=5 2024-09-12T00:39:28.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.306+0000 7f4191f39800 20 remove_watcher() i=6 2024-09-12T00:39:28.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.307+0000 7f4191f39800 20 remove_watcher() i=7 2024-09-12T00:39:28.318 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 8841838352 --totp-seed IGCRTS6K5QKOEGJW7VMG3UCVU6SXVVD62XIUVNCZNBCZP4NOKAMUHMELJMW6FF7E --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:28.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.424+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.425+0000 7f9176335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.425+0000 7f9176335800 20 realm 2024-09-12T00:39:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.425+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.425+0000 7f9176335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.425+0000 7f9176335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.425+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.426+0000 7f9176335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.426+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.426+0000 7f9176335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.426+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.427+0000 7f9176335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:28.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.427+0000 7f9176335800 20 searching for the correct realm 2024-09-12T00:39:28.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.429+0000 7f917187c640 0 -- 172.21.15.33:0/1450264194 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f91640aaf40 msgr2=0x7f91640c1a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.433+0000 7f917207d640 0 -- 172.21.15.33:0/1450264194 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f91680774a0 msgr2=0x7f9168051440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.640+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 20 zone default found 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 4 Realm: () 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 20 zonegroup default 2024-09-12T00:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.641+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.642+0000 7f9176335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.642+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.642+0000 7f9176335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.642+0000 7f9176335800 20 started sync module instance, tier type = 2024-09-12T00:39:28.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.642+0000 7f9176335800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.652+0000 7f9176335800 20 add_watcher() i=0 2024-09-12T00:39:28.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.652+0000 7f9176335800 20 add_watcher() i=1 2024-09-12T00:39:28.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.652+0000 7f9176335800 20 add_watcher() i=2 2024-09-12T00:39:28.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.652+0000 7f9176335800 20 add_watcher() i=3 2024-09-12T00:39:28.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.652+0000 7f9176335800 20 add_watcher() i=4 2024-09-12T00:39:28.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.652+0000 7f9176335800 20 add_watcher() i=5 2024-09-12T00:39:28.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.652+0000 7f9176335800 20 add_watcher() i=6 2024-09-12T00:39:28.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.653+0000 7f9176335800 20 add_watcher() i=7 2024-09-12T00:39:28.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.653+0000 7f9176335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:28.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f9028fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f9176335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:28.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f9176335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:28.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f9176335800 5 note: GC not initialized 2024-09-12T00:39:28.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f8fa37fe640 20 reqs_thread_entry: start 2024-09-12T00:39:28.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f9176335800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:28.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f9176335800 20 Filter name: none 2024-09-12T00:39:28.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f8fa17fa640 20 reqs_thread_entry: start 2024-09-12T00:39:28.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f9176335800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:39:28.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.655+0000 7f9176335800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.656+0000 7f9176335800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T00:39:28.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.656+0000 7f9176335800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:39:28.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.656+0000 7f9176335800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:28.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.656+0000 7f9176335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:28.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.659+0000 7f9176335800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:28.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.659+0000 7f9176335800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:28.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.659+0000 7f9176335800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:39:28.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.659+0000 7f9055ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268146 cookie 94913675024976 notifier 9183 bl.length()=674 2024-09-12T00:39:28.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.659+0000 7f9055ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:28.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.659+0000 7f9055ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:28.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.662+0000 7f9028fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.664+0000 7f9176335800 20 remove_watcher() i=0 2024-09-12T00:39:28.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.664+0000 7f9176335800 2 removed watcher, disabling cache 2024-09-12T00:39:28.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.665+0000 7f9176335800 20 remove_watcher() i=1 2024-09-12T00:39:28.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.666+0000 7f9176335800 20 remove_watcher() i=2 2024-09-12T00:39:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.667+0000 7f9176335800 20 remove_watcher() i=3 2024-09-12T00:39:28.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.668+0000 7f9176335800 20 remove_watcher() i=4 2024-09-12T00:39:28.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.669+0000 7f9176335800 20 remove_watcher() i=5 2024-09-12T00:39:28.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.670+0000 7f9176335800 20 remove_watcher() i=6 2024-09-12T00:39:28.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.671+0000 7f9176335800 20 remove_watcher() i=7 2024-09-12T00:39:28.682 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T00:39:28.741 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:28.742 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.779+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.781+0000 7fc83dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.781+0000 7fc83dd2e800 20 realm 2024-09-12T00:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.781+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.781+0000 7fc83dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.781+0000 7fc83dd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.781+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.781+0000 7fc83dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.781+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.782+0000 7fc83dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.782+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.783+0000 7fc83dd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.783+0000 7fc83dd2e800 20 searching for the correct realm 2024-09-12T00:39:28.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.787+0000 7fc83a165640 0 -- 172.21.15.33:0/934452563 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fc83001c040 msgr2=0x7fc830039410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.993+0000 7fc839964640 0 -- 172.21.15.33:0/934452563 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x55bce8fdf120 msgr2=0x55bce8fe1510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.996+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 20 zone default found 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 4 Realm: () 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 20 zonegroup default 2024-09-12T00:39:28.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.997+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.998+0000 7fc83dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.998+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.998+0000 7fc83dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.998+0000 7fc83dd2e800 20 started sync module instance, tier type = 2024-09-12T00:39:28.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:28.998+0000 7fc83dd2e800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:29.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.007+0000 7fc83dd2e800 20 add_watcher() i=0 2024-09-12T00:39:29.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.007+0000 7fc83dd2e800 20 add_watcher() i=1 2024-09-12T00:39:29.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.007+0000 7fc83dd2e800 20 add_watcher() i=2 2024-09-12T00:39:29.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.007+0000 7fc83dd2e800 20 add_watcher() i=3 2024-09-12T00:39:29.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.007+0000 7fc83dd2e800 20 add_watcher() i=4 2024-09-12T00:39:29.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.007+0000 7fc83dd2e800 20 add_watcher() i=5 2024-09-12T00:39:29.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.007+0000 7fc83dd2e800 20 add_watcher() i=6 2024-09-12T00:39:29.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.008+0000 7fc83dd2e800 20 add_watcher() i=7 2024-09-12T00:39:29.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.008+0000 7fc83dd2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:29.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc6eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc83dd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:29.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc83dd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:29.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc83dd2e800 5 note: GC not initialized 2024-09-12T00:39:29.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc6ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:29.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc83dd2e800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:29.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc83dd2e800 20 Filter name: none 2024-09-12T00:39:29.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc65bfff640 20 reqs_thread_entry: start 2024-09-12T00:39:29.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc83dd2e800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:39:29.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.010+0000 7fc83dd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.011+0000 7fc83dd2e800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:39:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.011+0000 7fc83dd2e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:39:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.011+0000 7fc83dd2e800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.011+0000 7fc83dd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.012+0000 7fc83dd2e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.012+0000 7fc83dd2e800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.012+0000 7fc83dd2e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:39:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.013+0000 7fc71d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268147 cookie 94269851236976 notifier 9201 bl.length()=727 2024-09-12T00:39:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.013+0000 7fc71d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.013+0000 7fc71d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "foobar.client.0", 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "foobar+test@test.test", 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:29.013 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "foobar.client.0", 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "OFGGIWWGQAKQTVNMWMHQ", 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "mlyZ3StwyDp59F59XpwGevwIVI8dWNQ+gu0bs5j2ToJWhLQVkoE4Og==", 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:28.288196Z" 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [ 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "oidc-provider", 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "perm": "*" 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "roles", 2024-09-12T00:39:29.014 INFO:teuthology.orchestra.run.smithi033.stdout: "perm": "*" 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "user-policy", 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "perm": "*" 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:29.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "rgw", 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [ 2024-09-12T00:39:29.016 INFO:teuthology.orchestra.run.smithi033.stdout: "8841838352" 2024-09-12T00:39:29.017 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:29.017 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "", 2024-09-12T00:39:29.017 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:39:29.017 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:28.288185Z", 2024-09-12T00:39:29.017 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:39:29.017 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:39:29.017 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:29.017 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:29.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.015+0000 7fc6eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.018+0000 7fc83dd2e800 20 remove_watcher() i=0 2024-09-12T00:39:29.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.018+0000 7fc83dd2e800 2 removed watcher, disabling cache 2024-09-12T00:39:29.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.019+0000 7fc83dd2e800 20 remove_watcher() i=1 2024-09-12T00:39:29.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.020+0000 7fc83dd2e800 20 remove_watcher() i=2 2024-09-12T00:39:29.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.021+0000 7fc83dd2e800 20 remove_watcher() i=3 2024-09-12T00:39:29.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.022+0000 7fc83dd2e800 20 remove_watcher() i=4 2024-09-12T00:39:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.023+0000 7fc83dd2e800 20 remove_watcher() i=5 2024-09-12T00:39:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.024+0000 7fc83dd2e800 20 remove_watcher() i=6 2024-09-12T00:39:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.026+0000 7fc83dd2e800 20 remove_watcher() i=7 2024-09-12T00:39:29.036 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T00:39:29.098 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:29.098 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.136+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.138+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.138+0000 7f79da020800 20 realm 2024-09-12T00:39:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.138+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.138+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.138+0000 7f79da020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.138+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.138+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.138+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.139+0000 7f79da020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.139+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.140+0000 7f79da020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.140+0000 7f79da020800 20 searching for the correct realm 2024-09-12T00:39:29.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.142+0000 7f79d7309640 0 -- 172.21.15.33:0/3490825372 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55e360a2f470 msgr2=0x55e360a318c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.146+0000 7f79d7b0a640 0 -- 172.21.15.33:0/3490825372 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f79cc0a9450 msgr2=0x7f79cc0a98b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.352+0000 7f79da020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:29.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.352+0000 7f79da020800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:29.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.352+0000 7f79da020800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:29.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.352+0000 7f79da020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:29.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.352+0000 7f79da020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:29.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.352+0000 7f79da020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:29.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.352+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:29.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 zone default found 2024-09-12T00:39:29.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 4 Realm: () 2024-09-12T00:39:29.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:29.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 zonegroup default 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.353+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.354+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.354+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.354+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.354+0000 7f79da020800 20 started sync module instance, tier type = 2024-09-12T00:39:29.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.354+0000 7f79da020800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.364+0000 7f79da020800 20 add_watcher() i=0 2024-09-12T00:39:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.364+0000 7f79da020800 20 add_watcher() i=1 2024-09-12T00:39:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.364+0000 7f79da020800 20 add_watcher() i=2 2024-09-12T00:39:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.364+0000 7f79da020800 20 add_watcher() i=3 2024-09-12T00:39:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.364+0000 7f79da020800 20 add_watcher() i=4 2024-09-12T00:39:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.364+0000 7f79da020800 20 add_watcher() i=5 2024-09-12T00:39:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.364+0000 7f79da020800 20 add_watcher() i=6 2024-09-12T00:39:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.365+0000 7f79da020800 20 add_watcher() i=7 2024-09-12T00:39:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.365+0000 7f79da020800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.366+0000 7f788dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.366+0000 7f79da020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.366+0000 7f79da020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 5 note: GC not initialized 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f788cfe1640 20 reqs_thread_entry: start 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 20 Filter name: none 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f78067fc640 20 reqs_thread_entry: start 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T00:39:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.367+0000 7f79da020800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.368+0000 7f79da020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.368+0000 7f79da020800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.368+0000 7f79da020800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.368+0000 7f79da020800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.370+0000 7f79da020800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.370+0000 7f79da020800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.370+0000 7f79da020800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T00:39:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.370+0000 7f78b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268198 cookie 94435067233952 notifier 8537 bl.length()=384 2024-09-12T00:39:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.370+0000 7f78b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.370+0000 7f78b6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.373+0000 7f79da020800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.373+0000 7f79da020800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.373+0000 7f79da020800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.374+0000 7f78b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268276 cookie 94435067271616 notifier 8537 bl.length()=225 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.374+0000 7f78b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.374+0000 7f78b6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.377+0000 7f79da020800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:39:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.377+0000 7f79da020800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:39:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.377+0000 7f79da020800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T00:39:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.377+0000 7f78b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268111 cookie 94435067266992 notifier 8537 bl.length()=234 2024-09-12T00:39:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.377+0000 7f78b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:39:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.377+0000 7f78b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:39:29.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.379+0000 7f788dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.382+0000 7f79da020800 20 remove_watcher() i=0 2024-09-12T00:39:29.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.382+0000 7f79da020800 2 removed watcher, disabling cache 2024-09-12T00:39:29.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.383+0000 7f79da020800 20 remove_watcher() i=1 2024-09-12T00:39:29.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.384+0000 7f79da020800 20 remove_watcher() i=2 2024-09-12T00:39:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.385+0000 7f79da020800 20 remove_watcher() i=3 2024-09-12T00:39:29.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.386+0000 7f79da020800 20 remove_watcher() i=4 2024-09-12T00:39:29.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.387+0000 7f79da020800 20 remove_watcher() i=5 2024-09-12T00:39:29.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.388+0000 7f79da020800 20 remove_watcher() i=6 2024-09-12T00:39:29.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.389+0000 7f79da020800 20 remove_watcher() i=7 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout: "id": "RGW88888888888888888", 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout: "tenant": "", 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout: "quota": { 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max_users": 1000, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max_roles": 1000, 2024-09-12T00:39:29.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max_groups": 1000, 2024-09-12T00:39:29.399 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:29.399 INFO:teuthology.orchestra.run.smithi033.stdout: "max_access_keys": 4 2024-09-12T00:39:29.399 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:29.401 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T00:39:29.401 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key HXMKDSFPOHATMJXSEYPB --secret UIMmghvAP7Ei9hY8oSdXUQ+/z7E34gS4ftZXVDsCnrFle7DkSF6tiQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T00:39:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:29.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.507+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.509+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.509+0000 7f6418f25800 20 realm 2024-09-12T00:39:29.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.509+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.509+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.509+0000 7f6418f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:29.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.509+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.509+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.509+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.510+0000 7f6418f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.510+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.511+0000 7f6418f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:29.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.511+0000 7f6418f25800 20 searching for the correct realm 2024-09-12T00:39:29.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.514+0000 7f6414332640 0 -- 172.21.15.33:0/1398875617 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x557bfcf288c0 msgr2=0x557bfcf2acb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.518+0000 7f6415334640 0 -- 172.21.15.33:0/1398875617 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7f6408001c20 msgr2=0x7f640803baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.521+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 20 zone default found 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 4 Realm: () 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 20 zonegroup default 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.522+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.523+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.523+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.523+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.523+0000 7f6418f25800 20 started sync module instance, tier type = 2024-09-12T00:39:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.523+0000 7f6418f25800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.532+0000 7f6418f25800 20 add_watcher() i=0 2024-09-12T00:39:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.532+0000 7f6418f25800 20 add_watcher() i=1 2024-09-12T00:39:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.532+0000 7f6418f25800 20 add_watcher() i=2 2024-09-12T00:39:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.532+0000 7f6418f25800 20 add_watcher() i=3 2024-09-12T00:39:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.532+0000 7f6418f25800 20 add_watcher() i=4 2024-09-12T00:39:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.532+0000 7f6418f25800 20 add_watcher() i=5 2024-09-12T00:39:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.532+0000 7f6418f25800 20 add_watcher() i=6 2024-09-12T00:39:29.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.533+0000 7f6418f25800 20 add_watcher() i=7 2024-09-12T00:39:29.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.533+0000 7f6418f25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f62cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f6418f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f6418f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f6418f25800 5 note: GC not initialized 2024-09-12T00:39:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f62c9fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f6418f25800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f6418f25800 20 Filter name: none 2024-09-12T00:39:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f623b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:29.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f6418f25800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:39:29.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.535+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T00:39:29.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:29.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T00:39:29.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T00:39:29.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 cache get: name=default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB : miss 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 cache put: name=default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB info.flags=0x0 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 adding default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB to cache LRU end 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.536+0000 7f6418f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.537+0000 7f6418f25800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.537+0000 7f6418f25800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.537+0000 7f6418f25800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.537+0000 7f6418f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.537+0000 7f6418f25800 10 cache get: name=default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB : hit (negative entry) 2024-09-12T00:39:29.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.537+0000 7f6418f25800 10 cache get: name=default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB : hit (negative entry) 2024-09-12T00:39:29.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.539+0000 7f6418f25800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:39:29.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.539+0000 7f6418f25800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:29.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.539+0000 7f6418f25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:39:29.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.539+0000 7f62eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268199 cookie 93991013124752 notifier 9237 bl.length()=681 2024-09-12T00:39:29.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.539+0000 7f62eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:39:29.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.539+0000 7f62eb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:29.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.542+0000 7f6418f25800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:39:29.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.542+0000 7f6418f25800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:39:29.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.542+0000 7f6418f25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T00:39:29.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.542+0000 7f62eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268210 cookie 93991013140576 notifier 9237 bl.length()=189 2024-09-12T00:39:29.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.542+0000 7f62eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:39:29.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.542+0000 7f62eb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:39:29.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.545+0000 7f6418f25800 10 cache put: name=default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB info.flags=0x7 2024-09-12T00:39:29.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.545+0000 7f6418f25800 10 moving default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB to cache LRU end 2024-09-12T00:39:29.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.545+0000 7f6418f25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:HXMKDSFPOHATMJXSEYPB, ofs0, ns] 2024-09-12T00:39:29.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.545+0000 7f62eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268200 cookie 93991013124752 notifier 9237 bl.length()=188 2024-09-12T00:39:29.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.545+0000 7f62eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB info.flags=0x7 2024-09-12T00:39:29.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.545+0000 7f62eb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HXMKDSFPOHATMJXSEYPB to cache LRU end 2024-09-12T00:39:29.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.548+0000 7f6418f25800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T00:39:29.547 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:29.547 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "root1.client.0", 2024-09-12T00:39:29.547 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T00:39:29.547 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "root1+test@test.test", 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "root1.client.0", 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "HXMKDSFPOHATMJXSEYPB", 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "UIMmghvAP7Ei9hY8oSdXUQ+/z7E34gS4ftZXVDsCnrFle7DkSF6tiQ==", 2024-09-12T00:39:29.548 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:29.538008Z" 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:39:29.549 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "root", 2024-09-12T00:39:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:39:29.552 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "RGW88888888888888888", 2024-09-12T00:39:29.552 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:39:29.552 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:29.537988Z", 2024-09-12T00:39:29.552 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:39:29.552 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:39:29.552 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:29.552 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:29.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.549+0000 7f62cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.551+0000 7f6418f25800 20 remove_watcher() i=0 2024-09-12T00:39:29.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.551+0000 7f6418f25800 2 removed watcher, disabling cache 2024-09-12T00:39:29.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.552+0000 7f6418f25800 20 remove_watcher() i=1 2024-09-12T00:39:29.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.553+0000 7f6418f25800 20 remove_watcher() i=2 2024-09-12T00:39:29.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.555+0000 7f6418f25800 20 remove_watcher() i=3 2024-09-12T00:39:29.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.556+0000 7f6418f25800 20 remove_watcher() i=4 2024-09-12T00:39:29.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.557+0000 7f6418f25800 20 remove_watcher() i=5 2024-09-12T00:39:29.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.558+0000 7f6418f25800 20 remove_watcher() i=6 2024-09-12T00:39:29.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.559+0000 7f6418f25800 20 remove_watcher() i=7 2024-09-12T00:39:29.571 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 7608386418 --totp-seed OKJMHSNSS47U7R2RM3UEJ5VF3EAUTHX6QJ2VJJ4YM36IROHPUBV5UBP7HXTPMTCG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:29.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.680+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.681+0000 7f1ff0524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.681+0000 7f1ff0524800 20 realm 2024-09-12T00:39:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.681+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.681+0000 7f1ff0524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.681+0000 7f1ff0524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.681+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.681+0000 7f1ff0524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.681+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.682+0000 7f1ff0524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.682+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.683+0000 7f1ff0524800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.683+0000 7f1ff0524800 20 searching for the correct realm 2024-09-12T00:39:29.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.686+0000 7f1fec9d3640 0 -- 172.21.15.33:0/3321375007 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5605c85c7f00 msgr2=0x5605c85ca3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:29.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.690+0000 7f1fec1d2640 0 -- 172.21.15.33:0/3321375007 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f1fe006e7e0 msgr2=0x7f1fe00cd1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.694+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 20 zone default found 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 4 Realm: () 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 20 zonegroup default 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.695+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.696+0000 7f1ff0524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.696+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.696+0000 7f1ff0524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.696+0000 7f1ff0524800 20 started sync module instance, tier type = 2024-09-12T00:39:29.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.696+0000 7f1ff0524800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.705+0000 7f1ff0524800 20 add_watcher() i=0 2024-09-12T00:39:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.706+0000 7f1ff0524800 20 add_watcher() i=1 2024-09-12T00:39:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.706+0000 7f1ff0524800 20 add_watcher() i=2 2024-09-12T00:39:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.706+0000 7f1ff0524800 20 add_watcher() i=3 2024-09-12T00:39:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.706+0000 7f1ff0524800 20 add_watcher() i=4 2024-09-12T00:39:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.706+0000 7f1ff0524800 20 add_watcher() i=5 2024-09-12T00:39:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.706+0000 7f1ff0524800 20 add_watcher() i=6 2024-09-12T00:39:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.706+0000 7f1ff0524800 20 add_watcher() i=7 2024-09-12T00:39:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.706+0000 7f1ff0524800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.708+0000 7f1ea2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.708+0000 7f1ff0524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.708+0000 7f1ff0524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.708+0000 7f1ff0524800 5 note: GC not initialized 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.709+0000 7f1ea1fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.709+0000 7f1ff0524800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.709+0000 7f1ff0524800 20 Filter name: none 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.709+0000 7f1e9affd640 20 reqs_thread_entry: start 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.709+0000 7f1ff0524800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:39:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.709+0000 7f1ff0524800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.710+0000 7f1ff0524800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:39:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.710+0000 7f1ff0524800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T00:39:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.710+0000 7f1ff0524800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.710+0000 7f1ff0524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.712+0000 7f1ff0524800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:39:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.712+0000 7f1ff0524800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.712+0000 7f1ff0524800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:39:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.712+0000 7f1ecb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268201 cookie 94582836335008 notifier 8570 bl.length()=695 2024-09-12T00:39:29.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.712+0000 7f1ecb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:39:29.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.712+0000 7f1ecb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.715+0000 7f1ea2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.718+0000 7f1ff0524800 20 remove_watcher() i=0 2024-09-12T00:39:29.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.718+0000 7f1ff0524800 2 removed watcher, disabling cache 2024-09-12T00:39:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.719+0000 7f1ff0524800 20 remove_watcher() i=1 2024-09-12T00:39:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.720+0000 7f1ff0524800 20 remove_watcher() i=2 2024-09-12T00:39:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.721+0000 7f1ff0524800 20 remove_watcher() i=3 2024-09-12T00:39:29.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.722+0000 7f1ff0524800 20 remove_watcher() i=4 2024-09-12T00:39:29.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.723+0000 7f1ff0524800 20 remove_watcher() i=5 2024-09-12T00:39:29.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.724+0000 7f1ff0524800 20 remove_watcher() i=6 2024-09-12T00:39:29.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.725+0000 7f1ff0524800 20 remove_watcher() i=7 2024-09-12T00:39:29.735 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T00:39:29.797 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:29.797 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:29.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.835+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.836+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.836+0000 7fb65bd3d800 20 realm 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.836+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.836+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.836+0000 7fb65bd3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.836+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.836+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.836+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.837+0000 7fb65bd3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.837+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.838+0000 7fb65bd3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.838+0000 7fb65bd3d800 20 searching for the correct realm 2024-09-12T00:39:29.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.840+0000 7fb657229640 0 -- 172.21.15.33:0/2073714845 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fb648074020 msgr2=0x7fb6480ef240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:29.844+0000 7fb657a2a640 0 -- 172.21.15.33:0/2073714845 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fb64c03aab0 msgr2=0x7fb64c04b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:30.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:30.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:30.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:30.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:30.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:30.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:30.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.050+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 20 zone default found 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 4 Realm: () 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 20 zonegroup default 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.051+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.052+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.052+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.052+0000 7fb65bd3d800 20 started sync module instance, tier type = 2024-09-12T00:39:30.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.052+0000 7fb65bd3d800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:30.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.062+0000 7fb65bd3d800 20 add_watcher() i=0 2024-09-12T00:39:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.062+0000 7fb65bd3d800 20 add_watcher() i=1 2024-09-12T00:39:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.062+0000 7fb65bd3d800 20 add_watcher() i=2 2024-09-12T00:39:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.062+0000 7fb65bd3d800 20 add_watcher() i=3 2024-09-12T00:39:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.062+0000 7fb65bd3d800 20 add_watcher() i=4 2024-09-12T00:39:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.062+0000 7fb65bd3d800 20 add_watcher() i=5 2024-09-12T00:39:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.062+0000 7fb65bd3d800 20 add_watcher() i=6 2024-09-12T00:39:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.063+0000 7fb65bd3d800 20 add_watcher() i=7 2024-09-12T00:39:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.063+0000 7fb65bd3d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.064+0000 7fb50dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.064+0000 7fb65bd3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.064+0000 7fb65bd3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.064+0000 7fb65bd3d800 5 note: GC not initialized 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb50cfe1640 20 reqs_thread_entry: start 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 20 Filter name: none 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb4867fc640 20 reqs_thread_entry: start 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T00:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T00:39:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T00:39:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T00:39:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.065+0000 7fb65bd3d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.066+0000 7fb65bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.066+0000 7fb65bd3d800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T00:39:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.066+0000 7fb65bd3d800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:39:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.066+0000 7fb65bd3d800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T00:39:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.067+0000 7fb65bd3d800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.067+0000 7fb65bd3d800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.067+0000 7fb65bd3d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T00:39:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.067+0000 7fb536ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268202 cookie 94559812799408 notifier 8588 bl.length()=384 2024-09-12T00:39:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.067+0000 7fb536ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.067+0000 7fb536ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:30.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.071+0000 7fb65bd3d800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:30.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.071+0000 7fb65bd3d800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:30.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.071+0000 7fb65bd3d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T00:39:30.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.071+0000 7fb536ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268277 cookie 94559812804656 notifier 8588 bl.length()=225 2024-09-12T00:39:30.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.071+0000 7fb536ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:30.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.071+0000 7fb536ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:30.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.074+0000 7fb65bd3d800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:39:30.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.074+0000 7fb65bd3d800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:39:30.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.074+0000 7fb65bd3d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T00:39:30.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.074+0000 7fb536ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268112 cookie 94559812810992 notifier 8588 bl.length()=234 2024-09-12T00:39:30.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.074+0000 7fb536ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:39:30.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.074+0000 7fb536ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:39:30.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.076+0000 7fb50dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.079+0000 7fb65bd3d800 20 remove_watcher() i=0 2024-09-12T00:39:30.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.079+0000 7fb65bd3d800 2 removed watcher, disabling cache 2024-09-12T00:39:30.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.080+0000 7fb65bd3d800 20 remove_watcher() i=1 2024-09-12T00:39:30.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.081+0000 7fb65bd3d800 20 remove_watcher() i=2 2024-09-12T00:39:30.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.082+0000 7fb65bd3d800 20 remove_watcher() i=3 2024-09-12T00:39:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.083+0000 7fb65bd3d800 20 remove_watcher() i=4 2024-09-12T00:39:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.084+0000 7fb65bd3d800 20 remove_watcher() i=5 2024-09-12T00:39:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.085+0000 7fb65bd3d800 20 remove_watcher() i=6 2024-09-12T00:39:30.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.086+0000 7fb65bd3d800 20 remove_watcher() i=7 2024-09-12T00:39:30.095 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:30.095 INFO:teuthology.orchestra.run.smithi033.stdout: "id": "RGW99999999999999999", 2024-09-12T00:39:30.095 INFO:teuthology.orchestra.run.smithi033.stdout: "tenant": "", 2024-09-12T00:39:30.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T00:39:30.095 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T00:39:30.095 INFO:teuthology.orchestra.run.smithi033.stdout: "quota": { 2024-09-12T00:39:30.095 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:30.096 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:30.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:30.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:30.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:30.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:30.096 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:30.096 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:30.097 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:30.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:30.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:30.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:30.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:30.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max_users": 1000, 2024-09-12T00:39:30.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max_roles": 1000, 2024-09-12T00:39:30.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max_groups": 1000, 2024-09-12T00:39:30.098 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:30.098 INFO:teuthology.orchestra.run.smithi033.stdout: "max_access_keys": 4 2024-09-12T00:39:30.098 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:30.100 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T00:39:30.100 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key RXKLMXQMXXSRJQHKQPJL --secret 7V39323ffHOXQYY/qGfYjGHtQ73n1fTjoOSMjRjkdc+Nzvm7ItZ8Vw== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T00:39:30.171 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:30.171 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:30.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.208+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.210+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.210+0000 7f5b40946800 20 realm 2024-09-12T00:39:30.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.210+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.210+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.210+0000 7f5b40946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:30.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.210+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.211+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.211+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.211+0000 7f5b40946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.211+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.212+0000 7f5b40946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:30.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.212+0000 7f5b40946800 20 searching for the correct realm 2024-09-12T00:39:30.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.215+0000 7f5b3e437640 0 -- 172.21.15.33:0/2223794319 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f5b38017420 msgr2=0x7f5b38017840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:30.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.218+0000 7f5b3e437640 0 -- 172.21.15.33:0/2223794319 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f5b28097a50 msgr2=0x7f5b2808f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:30.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:30.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:30.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:30.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:30.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:30.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:30.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.423+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:30.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 20 zone default found 2024-09-12T00:39:30.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 4 Realm: () 2024-09-12T00:39:30.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 20 zonegroup default 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.424+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.425+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.425+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.425+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.425+0000 7f5b40946800 20 started sync module instance, tier type = 2024-09-12T00:39:30.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.425+0000 7f5b40946800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.434+0000 7f5b40946800 20 add_watcher() i=0 2024-09-12T00:39:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.434+0000 7f5b40946800 20 add_watcher() i=1 2024-09-12T00:39:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.434+0000 7f5b40946800 20 add_watcher() i=2 2024-09-12T00:39:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.434+0000 7f5b40946800 20 add_watcher() i=3 2024-09-12T00:39:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.434+0000 7f5b40946800 20 add_watcher() i=4 2024-09-12T00:39:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.434+0000 7f5b40946800 20 add_watcher() i=5 2024-09-12T00:39:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.434+0000 7f5b40946800 20 add_watcher() i=6 2024-09-12T00:39:30.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.435+0000 7f5b40946800 20 add_watcher() i=7 2024-09-12T00:39:30.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.435+0000 7f5b40946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:30.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.437+0000 7f59f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.437+0000 7f5b40946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.437+0000 7f5b40946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.437+0000 7f5b40946800 5 note: GC not initialized 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.437+0000 7f596f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.437+0000 7f5b40946800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.437+0000 7f5b40946800 20 Filter name: none 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.437+0000 7f596d7fa640 20 reqs_thread_entry: start 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T00:39:30.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T00:39:30.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:39:30.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 cache get: name=default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL : miss 2024-09-12T00:39:30.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 cache put: name=default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL info.flags=0x0 2024-09-12T00:39:30.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 adding default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL to cache LRU end 2024-09-12T00:39:30.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T00:39:30.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.438+0000 7f5b40946800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.439+0000 7f5b40946800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:39:30.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.439+0000 7f5b40946800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:30.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.439+0000 7f5b40946800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:30.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.439+0000 7f5b40946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:30.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.439+0000 7f5b40946800 10 cache get: name=default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL : hit (negative entry) 2024-09-12T00:39:30.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.439+0000 7f5b40946800 10 cache get: name=default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL : hit (negative entry) 2024-09-12T00:39:30.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.441+0000 7f5b40946800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:39:30.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.441+0000 7f5b40946800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:30.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.441+0000 7f5b40946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:39:30.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.441+0000 7f5a21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268203 cookie 94456212975088 notifier 8606 bl.length()=681 2024-09-12T00:39:30.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.441+0000 7f5a21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:39:30.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.441+0000 7f5a21ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:30.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.444+0000 7f5b40946800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:39:30.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.444+0000 7f5b40946800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:39:30.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.444+0000 7f5b40946800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T00:39:30.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.445+0000 7f5a21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268211 cookie 94456212990240 notifier 8606 bl.length()=189 2024-09-12T00:39:30.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.445+0000 7f5a21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:39:30.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.445+0000 7f5a21ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:39:30.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.447+0000 7f5b40946800 10 cache put: name=default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL info.flags=0x7 2024-09-12T00:39:30.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.447+0000 7f5b40946800 10 moving default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL to cache LRU end 2024-09-12T00:39:30.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.447+0000 7f5b40946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:RXKLMXQMXXSRJQHKQPJL, ofs0, ns] 2024-09-12T00:39:30.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.447+0000 7f5a21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268278 cookie 94456212987936 notifier 8606 bl.length()=188 2024-09-12T00:39:30.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.447+0000 7f5a21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL info.flags=0x7 2024-09-12T00:39:30.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.447+0000 7f5a21ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RXKLMXQMXXSRJQHKQPJL to cache LRU end 2024-09-12T00:39:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.450+0000 7f5b40946800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "user_id": "root2.client.0", 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "email": "root2+test@test.test", 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "suspended": 0, 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "max_buckets": 1000, 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "subusers": [], 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "keys": [ 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "user": "root2.client.0", 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "access_key": "RXKLMXQMXXSRJQHKQPJL", 2024-09-12T00:39:30.450 INFO:teuthology.orchestra.run.smithi033.stdout: "secret_key": "7V39323ffHOXQYY/qGfYjGHtQ73n1fTjoOSMjRjkdc+Nzvm7ItZ8Vw==", 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "active": true, 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:30.441381Z" 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "swift_keys": [], 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": [], 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_placement": "", 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_storage_class": "", 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "placement_tags": [], 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "bucket_quota": { 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:30.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "user_quota": { 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": false, 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "check_on_raw": false, 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size": -1, 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max_size_kb": 0, 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max_objects": -1 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "temp_url_keys": [], 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "root", 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "mfa_ids": [], 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "account_id": "RGW99999999999999999", 2024-09-12T00:39:30.452 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-09-12T00:39:30.453 INFO:teuthology.orchestra.run.smithi033.stdout: "create_date": "2024-09-12T00:39:30.441368Z", 2024-09-12T00:39:30.453 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-12T00:39:30.453 INFO:teuthology.orchestra.run.smithi033.stdout: "group_ids": [] 2024-09-12T00:39:30.453 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T00:39:30.453 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:39:30.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.451+0000 7f59f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.453+0000 7f5b40946800 20 remove_watcher() i=0 2024-09-12T00:39:30.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.453+0000 7f5b40946800 2 removed watcher, disabling cache 2024-09-12T00:39:30.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.454+0000 7f5b40946800 20 remove_watcher() i=1 2024-09-12T00:39:30.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.455+0000 7f5b40946800 20 remove_watcher() i=2 2024-09-12T00:39:30.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.456+0000 7f5b40946800 20 remove_watcher() i=3 2024-09-12T00:39:30.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.457+0000 7f5b40946800 20 remove_watcher() i=4 2024-09-12T00:39:30.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.458+0000 7f5b40946800 20 remove_watcher() i=5 2024-09-12T00:39:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.459+0000 7f5b40946800 20 remove_watcher() i=6 2024-09-12T00:39:30.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.460+0000 7f5b40946800 20 remove_watcher() i=7 2024-09-12T00:39:30.472 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 0473208073 --totp-seed Y5DNW4333EDZEGPRTMPC4C2BO4YXETATDSO5LOMHGQXPZ7DFVYPJRGOVGGVWVG4T --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:30.540 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:30.540 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:30.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.576+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.578+0000 7feccf12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.578+0000 7feccf12c800 20 realm 2024-09-12T00:39:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.578+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.578+0000 7feccf12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.578+0000 7feccf12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.578+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.578+0000 7feccf12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.578+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.579+0000 7feccf12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.579+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.580+0000 7feccf12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:30.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.580+0000 7feccf12c800 20 searching for the correct realm 2024-09-12T00:39:30.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.582+0000 7fecca64e640 0 -- 172.21.15.33:0/3249726099 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7fecbc018070 msgr2=0x7fecbc08f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:30.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.587+0000 7feccae4f640 0 -- 172.21.15.33:0/3249726099 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7fecc0078060 msgr2=0x7fecc0050830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.794+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:30.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 20 zone default found 2024-09-12T00:39:30.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 4 Realm: () 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 20 zonegroup default 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.795+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.796+0000 7feccf12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.796+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.796+0000 7feccf12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.796+0000 7feccf12c800 20 started sync module instance, tier type = 2024-09-12T00:39:30.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.796+0000 7feccf12c800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T00:39:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.805+0000 7feccf12c800 20 add_watcher() i=0 2024-09-12T00:39:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.805+0000 7feccf12c800 20 add_watcher() i=1 2024-09-12T00:39:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.805+0000 7feccf12c800 20 add_watcher() i=2 2024-09-12T00:39:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.805+0000 7feccf12c800 20 add_watcher() i=3 2024-09-12T00:39:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.805+0000 7feccf12c800 20 add_watcher() i=4 2024-09-12T00:39:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.805+0000 7feccf12c800 20 add_watcher() i=5 2024-09-12T00:39:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.805+0000 7feccf12c800 20 add_watcher() i=6 2024-09-12T00:39:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.806+0000 7feccf12c800 20 add_watcher() i=7 2024-09-12T00:39:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.806+0000 7feccf12c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.808+0000 7feb817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.808+0000 7feccf12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.808+0000 7feccf12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.808+0000 7feccf12c800 5 note: GC not initialized 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.809+0000 7feafbfff640 20 reqs_thread_entry: start 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.809+0000 7feccf12c800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.809+0000 7feccf12c800 20 Filter name: none 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.809+0000 7feaf9ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.809+0000 7feccf12c800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:39:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.809+0000 7feccf12c800 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.810+0000 7feccf12c800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:39:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.810+0000 7feccf12c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T00:39:30.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.810+0000 7feccf12c800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:30.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.810+0000 7feccf12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.812+0000 7feccf12c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:39:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.812+0000 7feccf12c800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.812+0000 7feccf12c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:39:30.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.813+0000 7febae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268204 cookie 94228934359248 notifier 9318 bl.length()=695 2024-09-12T00:39:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.813+0000 7febae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:39:30.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.813+0000 7febae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:30.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.816+0000 7feb817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.819+0000 7feccf12c800 20 remove_watcher() i=0 2024-09-12T00:39:30.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.819+0000 7feccf12c800 2 removed watcher, disabling cache 2024-09-12T00:39:30.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.820+0000 7feccf12c800 20 remove_watcher() i=1 2024-09-12T00:39:30.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.821+0000 7feccf12c800 20 remove_watcher() i=2 2024-09-12T00:39:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.822+0000 7feccf12c800 20 remove_watcher() i=3 2024-09-12T00:39:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.823+0000 7feccf12c800 20 remove_watcher() i=4 2024-09-12T00:39:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.825+0000 7feccf12c800 20 remove_watcher() i=5 2024-09-12T00:39:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.826+0000 7feccf12c800 20 remove_watcher() i=6 2024-09-12T00:39:30.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T00:39:30.827+0000 7feccf12c800 20 remove_watcher() i=7 2024-09-12T00:39:30.841 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T00:39:30.842 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:39:30.842 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T00:39:30.871 INFO:tasks.s3tests:Configuring boto... 2024-09-12T00:39:30.872 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T00:39:30.872 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:39:30.941 DEBUG:teuthology.orchestra.run.smithi033:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:39:31.127 INFO:teuthology.orchestra.run.smithi033.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T00:39:31.317 INFO:teuthology.orchestra.run.smithi033.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T00:39:31.665 INFO:teuthology.orchestra.run.smithi033.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:41:21.396 INFO:teuthology.orchestra.run.smithi033.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T00:41:22.979 INFO:teuthology.orchestra.run.smithi033.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=ea626c0434f3fee2691a277565c456472393d3dcc83dc263b9fc4e311aad2bd0,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:41:22.980 INFO:teuthology.orchestra.run.smithi033.stdout:py run-test-pre: PYTHONHASHSEED='2880983082' 2024-09-12T00:41:22.980 INFO:teuthology.orchestra.run.smithi033.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:41:23.120 INFO:teuthology.orchestra.run.smithi033.stdout:============================= test session starts ============================== 2024-09-12T00:41:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T00:41:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:41:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:41:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:configfile: pytest.ini 2024-09-12T00:41:24.949 INFO:teuthology.orchestra.run.smithi033.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T00:41:24.949 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T00:41:25.655 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T00:41:26.081 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T00:41:26.477 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T00:41:26.859 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T00:41:27.265 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T00:41:27.572 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T00:41:28.010 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T00:41:28.316 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T00:41:28.443 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T00:41:28.571 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T00:41:28.972 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T00:41:29.380 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T00:41:29.783 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T00:41:30.318 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T00:41:30.448 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T00:41:30.528 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T00:41:30.609 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T00:41:30.689 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T00:41:30.778 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T00:41:30.858 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T00:41:30.940 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T00:41:31.021 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:41:31.103 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:41:31.183 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:41:31.264 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:41:31.344 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:41:31.432 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:41:31.514 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T00:41:31.595 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T00:41:31.675 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:41:31.757 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:41:31.837 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:41:31.918 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:41:31.999 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:41:32.080 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:41:32.162 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T00:41:32.243 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T00:41:32.324 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:41:32.405 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:41:32.488 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T00:41:32.570 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:41:32.650 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:41:32.733 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:41:32.813 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T00:41:32.894 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:41:32.974 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:41:33.056 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:41:33.137 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:41:33.221 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:41:33.302 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:41:33.384 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T00:41:33.464 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T00:41:34.299 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T00:41:43.507 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T00:41:51.416 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T00:42:08.418 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T00:42:30.578 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T00:42:36.197 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T00:42:42.305 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T00:42:43.888 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T00:42:44.297 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T00:42:45.340 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T00:42:46.379 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T00:42:47.390 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T00:42:47.925 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T00:42:48.447 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T00:42:48.447 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:42:48.448 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:42:48.449 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:42:48.450 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:42:48.451 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:42:48.452 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:42:48.453 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T00:42:48.453 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:42:48.454 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:42:48.455 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:42:48.456 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:42:48.457 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T00:42:48.458 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:42:48.458 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:42:48.459 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:42:48.460 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:42:48.461 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:42:48.462 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:42:48.462 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:42:48.463 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T00:42:48.464 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T00:42:48.465 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T00:42:48.466 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T00:42:48.466 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T00:42:48.467 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T00:42:48.468 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T00:42:48.469 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T00:42:48.558 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T00:42:48.570 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T00:42:49.840 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T00:42:59.010 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T00:43:00.072 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T00:43:01.122 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T00:43:02.163 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T00:43:03.203 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T00:43:04.237 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T00:43:05.332 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T00:43:06.386 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T00:43:07.334 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T00:43:08.280 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T00:43:09.134 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T00:43:09.896 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T00:43:10.664 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T00:43:11.254 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T00:43:12.131 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T00:43:13.168 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T00:43:14.158 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T00:43:15.032 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T00:43:15.908 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T00:43:16.786 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T00:43:17.643 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T00:43:18.517 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T00:43:19.284 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T00:43:20.059 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T00:43:20.648 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T00:43:21.245 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T00:43:21.823 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T00:43:22.396 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T00:43:22.957 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T00:43:23.933 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T00:43:24.518 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:43:25.104 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T00:43:25.836 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T00:43:26.550 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T00:43:27.149 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:43:27.935 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T00:43:28.676 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:43:29.543 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:43:30.396 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T00:43:31.105 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T00:43:31.832 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T00:43:32.875 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:43:33.924 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:43:34.854 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:43:35.936 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:43:37.149 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:43:39.240 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:43:41.334 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:43:42.547 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:43:43.712 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:43:44.687 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T00:43:45.827 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T00:43:46.677 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T00:43:48.357 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T00:43:49.525 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T00:43:50.897 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T00:43:53.461 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T00:43:56.790 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T00:43:58.727 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T00:44:00.553 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T00:44:01.995 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T00:44:02.984 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T00:44:04.643 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T00:44:05.847 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T00:44:07.411 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T00:44:08.569 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T00:44:10.533 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T00:44:12.243 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T00:44:14.449 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T00:44:16.576 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T00:44:18.144 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T00:44:19.571 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T00:44:20.743 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T00:44:23.297 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T00:44:25.195 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T00:44:27.387 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T00:44:29.481 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T00:44:31.462 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T00:44:33.442 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T00:44:35.099 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T00:44:36.330 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T00:44:37.705 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T00:44:40.079 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T00:44:43.103 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T00:44:44.542 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T00:44:46.543 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T00:44:48.550 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T00:44:50.512 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:44:52.685 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:44:54.943 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T00:44:57.158 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T00:44:59.207 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T00:45:00.559 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T00:45:01.712 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:45:02.833 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:45:03.983 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T00:45:05.964 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:45:08.041 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:45:10.308 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:45:14.327 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:45:16.311 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:45:18.315 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T00:45:20.399 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T00:45:22.382 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T00:45:24.413 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:45:26.397 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T00:45:28.465 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T00:45:29.917 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T00:45:31.363 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T00:45:32.775 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:45:34.161 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T00:45:35.295 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T00:45:36.538 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T00:45:37.636 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T00:45:38.753 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T00:45:39.833 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T00:45:40.913 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T00:45:41.996 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T00:45:43.088 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T00:45:44.210 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T00:45:45.986 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T00:45:47.779 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T00:45:48.758 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:45:49.719 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:45:50.795 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T00:45:51.864 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T00:45:53.709 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:45:55.481 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:45:56.560 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T00:45:57.662 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T00:45:58.752 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:45:59.830 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:46:00.945 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T00:46:02.018 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T00:46:03.106 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:46:04.177 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:46:05.264 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T00:46:06.331 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T00:46:07.459 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T00:46:08.534 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T00:46:09.574 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T00:46:10.619 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T00:46:11.654 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T00:46:12.741 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:46:13.823 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:47:00.605 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T00:47:01.670 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T00:47:02.718 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T00:47:03.762 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T00:47:04.808 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T00:47:05.857 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T00:47:06.886 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T00:47:07.949 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T00:47:09.024 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T00:47:10.062 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T00:47:11.099 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T00:47:12.128 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T00:47:13.186 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T00:47:14.261 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:47:15.335 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:47:16.438 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:47:17.504 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:47:18.596 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T00:47:19.682 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T00:47:20.755 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:47:21.840 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:47:22.927 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:47:24.025 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:47:25.188 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T00:47:26.341 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T00:47:27.406 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T00:47:28.507 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T00:47:29.580 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T00:47:30.710 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T00:47:31.277 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T00:47:32.245 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T00:47:34.597 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T00:47:36.929 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T00:47:38.016 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T00:47:39.149 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T00:47:40.218 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T00:47:41.289 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T00:47:42.444 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T00:47:43.620 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T00:47:44.705 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T00:47:45.770 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T00:47:46.879 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T00:47:47.973 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T00:47:49.047 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T00:47:50.126 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T00:47:51.461 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T00:47:53.182 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T00:47:54.176 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T00:47:55.132 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T00:47:56.020 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:47:56.889 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:47:57.455 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T00:47:58.036 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T00:47:58.599 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T00:47:59.572 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T00:48:04.075 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T00:48:04.682 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T00:48:05.615 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T00:48:06.440 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T00:48:07.305 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T00:48:08.242 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T00:48:10.845 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T00:48:12.096 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T00:48:13.370 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T00:49:00.823 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T00:49:48.017 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T00:49:48.968 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T00:49:49.918 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T00:49:50.878 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T00:49:51.846 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T00:49:52.921 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T00:49:53.904 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T00:49:54.869 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T00:49:56.013 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T00:49:57.016 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T00:49:58.029 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T00:49:59.060 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T00:50:00.183 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T00:50:01.144 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T00:50:02.010 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T00:50:02.947 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T00:50:03.903 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T00:50:06.055 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T00:50:07.100 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T00:50:08.040 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T00:50:08.975 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T00:50:10.003 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T00:50:11.022 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T00:50:11.902 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T00:50:12.764 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T00:50:13.649 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T00:50:14.561 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T00:50:15.430 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T00:50:16.314 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T00:50:17.338 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T00:50:18.214 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T00:50:19.109 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T00:50:19.983 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T00:50:20.876 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T00:50:22.044 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T00:50:22.951 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T00:50:23.841 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T00:50:24.710 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T00:50:25.620 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T00:50:26.494 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T00:50:27.374 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T00:50:28.257 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T00:50:30.227 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T00:50:31.106 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T00:50:32.159 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T00:50:33.166 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T00:50:34.149 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T00:50:35.159 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T00:50:36.167 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T00:50:38.250 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T00:50:39.287 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T00:50:40.297 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T00:50:41.445 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T00:50:42.583 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T00:50:43.735 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T00:50:44.711 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T00:50:45.822 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T00:50:46.962 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T00:50:47.977 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T00:50:49.138 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T00:50:50.149 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T00:50:51.089 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T00:50:52.013 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T00:50:53.019 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T00:50:53.901 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T00:50:54.466 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T00:50:55.630 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T00:50:56.593 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T00:50:57.598 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T00:51:01.096 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T00:51:02.078 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T00:51:03.046 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T00:51:04.013 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T00:51:04.977 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T00:51:05.870 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T00:51:06.856 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T00:51:07.917 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T00:51:09.056 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T00:51:10.027 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T00:51:11.001 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T00:51:11.993 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T00:51:13.018 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T00:51:14.058 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T00:51:15.002 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T00:51:16.023 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T00:51:17.110 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T00:51:18.140 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T00:51:18.706 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T00:51:19.277 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T00:51:19.843 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T00:51:20.627 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T00:51:21.408 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T00:51:22.186 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T00:51:22.954 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T00:51:23.799 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T00:51:24.390 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T00:51:24.953 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T00:51:25.772 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T00:51:26.340 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T00:51:26.908 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T00:51:27.479 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T00:51:28.049 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T00:51:28.973 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T00:51:29.819 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T00:51:30.692 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T00:51:31.533 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T00:51:32.362 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T00:51:33.263 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T00:51:34.120 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T00:51:35.052 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T00:51:35.887 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:51:36.717 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:51:37.736 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T00:51:38.734 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T00:51:39.864 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T00:51:40.886 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:51:41.893 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:51:43.007 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T00:51:44.104 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T00:51:45.188 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T00:51:46.300 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T00:51:47.176 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T00:51:48.273 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T00:51:49.400 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T00:51:50.509 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T00:51:51.613 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T00:51:52.766 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T00:51:54.345 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T00:51:55.748 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T00:51:57.159 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T00:51:58.623 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T00:52:00.051 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T00:52:01.069 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T00:52:02.075 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T00:52:03.317 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T00:52:04.345 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T00:52:05.308 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T00:52:06.440 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T00:52:07.937 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T00:52:09.463 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T00:52:10.950 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T00:52:12.462 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T00:52:13.957 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:52:15.477 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T00:52:17.028 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T00:52:18.523 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T00:52:20.025 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:52:21.414 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T00:52:22.797 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T00:52:24.178 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T00:52:26.104 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T00:52:27.967 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T00:52:28.523 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T00:52:29.092 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T00:52:29.675 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T00:52:30.630 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T00:52:31.597 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T00:52:32.372 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T00:52:33.143 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T00:52:34.420 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T00:52:37.052 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T00:52:38.262 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T00:52:39.385 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T00:52:43.504 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T00:52:44.652 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T00:52:45.767 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T00:52:46.851 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T00:52:47.914 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T00:52:49.411 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T00:52:50.618 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T00:52:51.999 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T00:52:53.260 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T00:52:55.288 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T00:52:57.161 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T00:52:58.028 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T00:52:58.889 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T00:53:01.723 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T00:53:02.923 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T00:53:30.081 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T00:53:31.094 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T00:53:32.295 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T00:53:36.487 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T00:53:37.631 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T00:53:39.488 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T00:53:50.505 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T00:54:15.500 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T00:54:44.825 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T00:56:40.272 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T00:56:51.814 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T00:57:15.332 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T00:57:16.829 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T00:57:23.637 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T00:57:29.374 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T00:57:32.445 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T00:57:33.432 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T00:57:38.864 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T00:57:40.049 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T00:57:41.058 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T00:57:42.104 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T00:58:01.367 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T00:58:05.509 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T00:58:06.579 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T00:58:07.561 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T00:58:08.640 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T00:58:15.783 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T00:58:19.898 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T00:58:23.956 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T00:58:25.057 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T00:58:26.169 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T00:58:27.277 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T00:58:28.398 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T00:58:29.502 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T00:58:30.606 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T00:58:31.652 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T00:58:33.610 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T00:58:37.354 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T00:58:43.669 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T00:58:45.994 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T00:58:50.854 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T00:58:59.170 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T00:59:01.108 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T00:59:05.154 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T00:59:11.980 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T00:59:14.089 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T00:59:15.258 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T00:59:16.837 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T00:59:17.850 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T00:59:24.984 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T00:59:25.986 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T00:59:27.003 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T00:59:28.043 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T00:59:29.048 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T00:59:30.509 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T00:59:42.327 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T00:59:43.934 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T00:59:45.264 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T00:59:46.803 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T00:59:48.425 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T00:59:53.738 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T00:59:55.321 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:00:01.496 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:00:23.362 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:01:02.689 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:01:05.424 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:01:08.210 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:01:09.607 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:01:11.065 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:01:12.263 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:01:13.895 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:01:15.426 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:01:18.039 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:01:18.962 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:01:19.934 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:01:20.860 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:01:21.733 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:01:22.667 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:01:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:01:24.559 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:01:25.633 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:01:26.642 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:01:27.513 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:01:28.401 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:01:29.298 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:01:31.091 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:01:32.099 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:01:33.128 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:01:34.620 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:01:35.622 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:01:36.641 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:01:37.661 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:01:38.687 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:01:39.620 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:01:40.486 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:01:41.341 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:01:42.207 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:02:32.874 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:03:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:03:34.555 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:03:35.580 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:04:36.949 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:05:38.639 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:05:39.666 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:05:40.680 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:05:41.552 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:05:42.428 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:06:14.943 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:06:24.265 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:06:33.624 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:06:34.639 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:06:35.665 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:06:36.696 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:06:38.172 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:06:39.183 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:06:40.195 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:06:41.274 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:06:42.403 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:06:43.610 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:06:44.772 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:06:45.849 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:06:46.857 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:06:48.567 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:06:50.222 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:06:52.820 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:06:55.252 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:06:57.772 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:07:00.230 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:07:02.734 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:07:05.286 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:07:07.795 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:07:10.924 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:07:14.554 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:07:15.583 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:07:16.668 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:07:19.223 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:07:21.722 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:07:24.324 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:07:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:07:49.497 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:07:50.916 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:07:52.379 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:07:53.829 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:07:55.694 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:07:57.344 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:07:58.448 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:08:00.085 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:08:00.959 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:08:01.825 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:08:02.698 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:08:03.618 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:08:04.671 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:08:05.619 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:08:07.070 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:08:07.979 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:08:08.820 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:08:09.690 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:08:10.523 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:08:11.385 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:08:12.322 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:08:13.159 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:08:14.233 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:08:15.100 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:08:15.936 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:08:16.945 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:08:17.889 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:08:18.913 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:08:19.927 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:08:20.878 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:08:21.859 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:08:22.971 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:08:23.999 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:08:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:08:26.037 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:08:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:08:28.050 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:08:29.218 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:08:30.366 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:08:31.463 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:08:32.422 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:08:33.354 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:08:34.345 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:08:35.444 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:08:36.402 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:08:37.431 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:08:38.591 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:08:39.533 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:08:40.555 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:08:41.554 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:08:52.263 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:08:53.245 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:09:03.619 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:09:04.737 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:09:05.838 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:09:06.705 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:09:07.636 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:09:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:09:09.595 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:09:10.561 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:09:11.492 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:09:12.361 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:09:13.323 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:09:14.340 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:09:15.296 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:09:16.397 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:09:17.433 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:09:18.411 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:09:19.314 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:09:20.573 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:09:35.746 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:09:36.615 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:09:37.593 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:09:38.579 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:09:39.636 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:09:42.130 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:09:43.183 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:09:44.755 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:09:50.782 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:09:52.884 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:10:03.637 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:10:13.962 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:10:14.818 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:10:16.119 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:10:32.067 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:10:56.126 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:11:00.612 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:11:04.536 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:11:08.504 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:11:10.639 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:11:11.536 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:11:15.941 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:11:21.276 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:12:18.417 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:12:22.026 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:12:24.377 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:12:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:12:27.596 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:12:33.534 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:12:37.867 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:12:39.230 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:12:40.746 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:12:46.768 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:12:50.509 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:12:55.453 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:12:57.601 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:12:58.066 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:13:05.837 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:13:13.743 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:13:16.591 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:13:20.664 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:13:22.281 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:13:59.537 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:14:00.002 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:14:01.299 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:14:02.297 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:14:03.291 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:14:04.542 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:14:04.563 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:14:04.563 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.563 INFO:teuthology.orchestra.run.smithi033.stdout:=============================== warnings summary =============================== 2024-09-12T01:14:04.563 INFO:teuthology.orchestra.run.smithi033.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T01:14:04.563 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T01:14:04.563 INFO:teuthology.orchestra.run.smithi033.stdout: import imp 2024-09-12T01:14:04.563 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.563 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: if boto_type is 'S3Connection': 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:14:04.564 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: if k is 'BucketName': 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: @pytest.mark.timeout(10) 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:14:04.565 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.566 INFO:teuthology.orchestra.run.smithi033.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.567 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:14:04.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi033.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout: warnings.warn( 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:14:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 1961.44s (0:32:41) = 2024-09-12T01:14:04.692 INFO:teuthology.orchestra.run.smithi033.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:14:04.693 INFO:teuthology.orchestra.run.smithi033.stdout: py: commands succeeded 2024-09-12T01:14:04.693 INFO:teuthology.orchestra.run.smithi033.stdout: congratulations :) 2024-09-12T01:14:04.710 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:14:04.711 DEBUG:teuthology.orchestra.run.smithi033:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:14:04.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:14:04.824 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:14:04.824 DEBUG:teuthology.orchestra.run.smithi033:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:14:04.854 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:14:04.854 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:14:05.055 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:14:05.069 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:14:05.069 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:14:05.069 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:14:05.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:14:05.099 INFO:teuthology.orchestra.run.smithi033.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:14:05.099 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:14:05.170 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:14:05.170 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:14:05.241 INFO:tasks.workunit:timeout=3h 2024-09-12T01:14:05.241 INFO:tasks.workunit:cleanup=True 2024-09-12T01:14:05.242 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:14:05.311 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:14:52.138 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:14:52.138 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:14:52.138 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:14:52.138 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:14:52.138 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:14:52.138 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:14:52.138 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:14:52.139 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:14:52.142 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:14:52.212 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:14:52.214 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:14:52.214 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:14:52.264 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:14:52.315 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:14:52.355 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:14:52.357 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:14:52.357 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:14:52.397 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:14:52.401 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-12T01:14:52.401 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:14:52.471 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:14:52.472 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:14:52.472 DEBUG:teuthology.orchestra.run.smithi033:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:14:52.546 INFO:tasks.workunit.client.0.smithi033.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:14:52.547 INFO:tasks.workunit.client.0.smithi033.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:14:52.547 INFO:tasks.workunit.client.0.smithi033.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:14:55.045 INFO:tasks.workunit.client.0.smithi033.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ deactivate nondestructive 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ hash -r 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:14:55.046 INFO:tasks.workunit.client.0.smithi033.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:14:55.047 INFO:tasks.workunit.client.0.smithi033.stderr:++ export VIRTUAL_ENV 2024-09-12T01:14:55.047 INFO:tasks.workunit.client.0.smithi033.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:14:55.047 INFO:tasks.workunit.client.0.smithi033.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:++ export PATH 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n '' ']' 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -z '' ']' 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:++ PS1='(rgw) ' 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:++ export PS1 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:++ hash -r 2024-09-12T01:14:55.048 INFO:tasks.workunit.client.0.smithi033.stderr:+ pip install pip --upgrade 2024-09-12T01:14:55.285 INFO:tasks.workunit.client.0.smithi033.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T01:14:55.634 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting pip 2024-09-12T01:14:55.640 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:14:55.687 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: pip 2024-09-12T01:14:55.687 INFO:tasks.workunit.client.0.smithi033.stdout: Attempting uninstall: pip 2024-09-12T01:14:55.687 INFO:tasks.workunit.client.0.smithi033.stdout: Found existing installation: pip 21.3.1 2024-09-12T01:14:55.848 INFO:tasks.workunit.client.0.smithi033.stdout: Uninstalling pip-21.3.1: 2024-09-12T01:14:55.853 INFO:tasks.workunit.client.0.smithi033.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T01:14:56.629 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed pip-24.2 2024-09-12T01:14:56.678 INFO:tasks.workunit.client.0.smithi033.stderr:+ pip install boto3 2024-09-12T01:14:57.478 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting boto3 2024-09-12T01:14:57.479 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:14:58.037 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:14:58.038 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:14:58.098 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:14:58.099 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:14:58.153 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:14:58.155 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:14:58.204 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:14:58.205 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:14:58.291 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:14:58.292 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T01:14:58.443 INFO:tasks.workunit.client.0.smithi033.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:14:58.444 INFO:tasks.workunit.client.0.smithi033.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:14:58.448 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:14:58.450 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:14:58.459 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:14:58.460 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:14:58.462 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:14:58.463 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T01:14:58.465 INFO:tasks.workunit.client.0.smithi033.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:14:58.541 INFO:tasks.workunit.client.0.smithi033.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:14:59.597 INFO:tasks.workunit.client.0.smithi033.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T01:14:59.715 INFO:tasks.workunit.client.0.smithi033.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:14:59.842 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:14:59.878 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:14:59.878 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:14:59.918 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.918+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:14:59.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.920+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:14:59.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.920+0000 7f369c325800 20 realm 2024-09-12T01:14:59.920 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.920+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:14:59.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.920+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:14:59.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.920+0000 7f369c325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:14:59.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.920+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:14:59.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.920+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:14:59.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.920+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:14:59.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.921+0000 7f369c325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:14:59.921 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.921+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:14:59.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.922+0000 7f369c325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:14:59.922 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.922+0000 7f369c325800 20 searching for the correct realm 2024-09-12T01:14:59.925 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.925+0000 7f36977b4640 0 -- 172.21.15.33:0/2741702239 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x5647133cd160 msgr2=0x5647133cf570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:14:59.929 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:14:59.929+0000 7f3697fb5640 0 -- 172.21.15.33:0/2741702239 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f368c03cb80 msgr2=0x7f368c008950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:15:00.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:15:00.136 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T01:15:00.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T01:15:00.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:15:00.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:15:00.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:15:00.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.137 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.136+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 20 zone default found 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 4 Realm: () 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 20 zonegroup default 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.139 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.137+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.138+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.138+0000 7f369c325800 20 started sync module instance, tier type = 2024-09-12T01:15:00.140 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.138+0000 7f369c325800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T01:15:00.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.148+0000 7f369c325800 20 add_watcher() i=0 2024-09-12T01:15:00.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.148+0000 7f369c325800 20 add_watcher() i=1 2024-09-12T01:15:00.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.148+0000 7f369c325800 20 add_watcher() i=2 2024-09-12T01:15:00.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.148+0000 7f369c325800 20 add_watcher() i=3 2024-09-12T01:15:00.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.148+0000 7f369c325800 20 add_watcher() i=4 2024-09-12T01:15:00.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.148+0000 7f369c325800 20 add_watcher() i=5 2024-09-12T01:15:00.148 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.148+0000 7f369c325800 20 add_watcher() i=6 2024-09-12T01:15:00.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.149+0000 7f369c325800 20 add_watcher() i=7 2024-09-12T01:15:00.149 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.149+0000 7f369c325800 2 all 8 watchers are set, enabling cache 2024-09-12T01:15:00.151 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.151+0000 7f354dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f369c325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f369c325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f369c325800 5 note: GC not initialized 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f354cfe1640 20 reqs_thread_entry: start 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f369c325800 20 init_complete bucket index max shards: 11 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f369c325800 20 Filter name: none 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f34c67fc640 20 reqs_thread_entry: start 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f369c325800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:15:00.153 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.152+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:15:00.154 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.153+0000 7f369c325800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:15:00.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.154+0000 7f369c325800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:15:00.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.154+0000 7f369c325800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:15:00.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.154+0000 7f369c325800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:15:00.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.155+0000 7f3576ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268340 cookie 94863265462096 notifier 9336 bl.length()=613 2024-09-12T01:15:00.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.155+0000 7f3576ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:15:00.155 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.155+0000 7f3576ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:15:00.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.158+0000 7f369c325800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:15:00.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.158+0000 7f369c325800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:15:00.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.158+0000 7f369c325800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:15:00.161 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.158+0000 7f3576ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268462 cookie 94863265469648 notifier 9336 bl.length()=191 2024-09-12T01:15:00.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.158+0000 7f3576ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:15:00.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.158+0000 7f3576ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:15:00.162 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.160+0000 7f354dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:00.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.162+0000 7f369c325800 20 remove_watcher() i=0 2024-09-12T01:15:00.163 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.162+0000 7f369c325800 2 removed watcher, disabling cache 2024-09-12T01:15:00.164 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.164+0000 7f369c325800 20 remove_watcher() i=1 2024-09-12T01:15:00.165 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.165+0000 7f369c325800 20 remove_watcher() i=2 2024-09-12T01:15:00.166 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.166+0000 7f369c325800 20 remove_watcher() i=3 2024-09-12T01:15:00.167 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.167+0000 7f369c325800 20 remove_watcher() i=4 2024-09-12T01:15:00.168 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.168+0000 7f369c325800 20 remove_watcher() i=5 2024-09-12T01:15:00.169 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.169+0000 7f369c325800 20 remove_watcher() i=6 2024-09-12T01:15:00.170 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.170+0000 7f369c325800 20 remove_watcher() i=7 2024-09-12T01:15:00.362 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:00.362 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:00.411 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:00.411 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:00.471 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:00.471 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:00.518 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:00.518 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:00.546 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:15:00.547 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:15:00.549 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:00.550 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:00.589 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:00.589 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:00.626 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:00.627 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:00.670 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:15:00.699 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:15:00.699 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:15:00.739 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.738+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.740+0000 7f4e62339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.740+0000 7f4e62339800 20 realm 2024-09-12T01:15:00.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.740+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.741+0000 7f4e62339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.741+0000 7f4e62339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:15:00.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.741+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.741+0000 7f4e62339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.741 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.741+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.742+0000 7f4e62339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:00.742 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.742+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.743+0000 7f4e62339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:15:00.743 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.743+0000 7f4e62339800 20 searching for the correct realm 2024-09-12T01:15:00.746 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.746+0000 7f4e5e7c8640 0 -- 172.21.15.33:0/633934347 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x5632db3a8990 msgr2=0x5632db3aae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:00.750 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.750+0000 7f4e5dfc7640 0 -- 172.21.15.33:0/633934347 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f4e540e70c0 msgr2=0x7f4e5407a710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.754+0000 7f4e62339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.754+0000 7f4e62339800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.754+0000 7f4e62339800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.754+0000 7f4e62339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.754+0000 7f4e62339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.754+0000 7f4e62339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.754+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.755 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:00.756 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 20 zone default found 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 4 Realm: () 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 20 zonegroup default 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.755+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.756+0000 7f4e62339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.756+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.756+0000 7f4e62339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.756+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.757 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.756+0000 7f4e62339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:00.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.756+0000 7f4e62339800 20 started sync module instance, tier type = 2024-09-12T01:15:00.758 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.756+0000 7f4e62339800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T01:15:00.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.766+0000 7f4e62339800 20 add_watcher() i=0 2024-09-12T01:15:00.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.766+0000 7f4e62339800 20 add_watcher() i=1 2024-09-12T01:15:00.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.766+0000 7f4e62339800 20 add_watcher() i=2 2024-09-12T01:15:00.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.766+0000 7f4e62339800 20 add_watcher() i=3 2024-09-12T01:15:00.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.766+0000 7f4e62339800 20 add_watcher() i=4 2024-09-12T01:15:00.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.766+0000 7f4e62339800 20 add_watcher() i=5 2024-09-12T01:15:00.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.767+0000 7f4e62339800 20 add_watcher() i=6 2024-09-12T01:15:00.767 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.767+0000 7f4e62339800 20 add_watcher() i=7 2024-09-12T01:15:00.768 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.767+0000 7f4e62339800 2 all 8 watchers are set, enabling cache 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.769+0000 7f4d0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.769+0000 7f4e62339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.769+0000 7f4e62339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.770+0000 7f4e62339800 5 note: GC not initialized 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.770+0000 7f4d0e7fc640 20 reqs_thread_entry: start 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.770+0000 7f4e62339800 20 init_complete bucket index max shards: 11 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.770+0000 7f4e62339800 20 Filter name: none 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.770+0000 7f4c7ffff640 20 reqs_thread_entry: start 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.770+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.771+0000 7f4e62339800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:15:00.774 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.771+0000 7f4e62339800 20 rados->read ofs=0 len=0 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.771+0000 7f4e62339800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.771+0000 7f4e62339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.771+0000 7f4e62339800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.771+0000 7f4e62339800 20 INFO: main: starting shard=0 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.771+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.0 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.772+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.772+0000 7f4e62339800 20 INFO: main: starting shard=1 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.772+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.1 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.772+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.772+0000 7f4e62339800 20 INFO: main: starting shard=2 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.772+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.2 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.773+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.775 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.773+0000 7f4e62339800 20 INFO: main: starting shard=3 2024-09-12T01:15:00.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.773+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.3 2024-09-12T01:15:00.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 INFO: main: starting shard=4 2024-09-12T01:15:00.776 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.4 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 INFO: main: starting shard=5 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.5 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 INFO: main: starting shard=6 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.774+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.6 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.775+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.775+0000 7f4e62339800 20 INFO: main: starting shard=7 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.775+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.7 2024-09-12T01:15:00.777 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.775+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.775+0000 7f4e62339800 20 INFO: main: starting shard=8 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.775+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.8 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.776+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.776+0000 7f4e62339800 20 INFO: main: starting shard=9 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.776+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.9 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.776+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.776+0000 7f4e62339800 20 INFO: main: starting shard=10 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.776+0000 7f4e62339800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.10 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.777+0000 7f4e62339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:00.778 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.777+0000 7f4e62339800 20 INFO: main: done 2024-09-12T01:15:00.779 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.778+0000 7f4d0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:00.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.780+0000 7f4e62339800 20 remove_watcher() i=0 2024-09-12T01:15:00.780 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.780+0000 7f4e62339800 2 removed watcher, disabling cache 2024-09-12T01:15:00.781 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.781+0000 7f4e62339800 20 remove_watcher() i=1 2024-09-12T01:15:00.783 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.783+0000 7f4e62339800 20 remove_watcher() i=2 2024-09-12T01:15:00.784 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.784+0000 7f4e62339800 20 remove_watcher() i=3 2024-09-12T01:15:00.785 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.785+0000 7f4e62339800 20 remove_watcher() i=4 2024-09-12T01:15:00.786 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.786+0000 7f4e62339800 20 remove_watcher() i=5 2024-09-12T01:15:00.787 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.787+0000 7f4e62339800 20 remove_watcher() i=6 2024-09-12T01:15:00.788 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.788+0000 7f4e62339800 20 remove_watcher() i=7 2024-09-12T01:15:00.800 INFO:tasks.workunit.client.0.smithi033.stderr:rados -p default.rgw.buckets.data ls | grep e25d9fab-5413-4a72-af6f-696991de7bef 2024-09-12T01:15:00.823 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:15:00.823 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:15:00.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:00.866+0000 7f72e47bc640 0 -- 172.21.15.33:0/2204272228 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f72d400fb70 msgr2=0x7f72d4037870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:00.874 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:15:00.874 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:15:00.875 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:15:02.291 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:02.291 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:02.329 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:15:02.755 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:15:02.784 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:15:02.784 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:15:02.824 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.824+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.826+0000 7f0baa887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:02.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.826+0000 7f0baa887800 20 realm 2024-09-12T01:15:02.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.826+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.826 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.826+0000 7f0baa887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:02.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.826+0000 7f0baa887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:15:02.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.826+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.826+0000 7f0baa887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:02.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.826+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.827+0000 7f0baa887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:02.827 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.827+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.828+0000 7f0baa887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:15:02.828 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.828+0000 7f0baa887800 20 searching for the correct realm 2024-09-12T01:15:02.829 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.829+0000 7f0ba8371640 0 -- 172.21.15.33:0/1315081584 >> [v2:172.21.15.162:6808/3549921352,v1:172.21.15.162:6809/3549921352] conn(0x7f0b90003bd0 msgr2=0x7f0ba0025460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:02.834 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.834+0000 7f0ba7b70640 0 -- 172.21.15.33:0/1315081584 >> [v2:172.21.15.33:6808/2826150194,v1:172.21.15.33:6809/2826150194] conn(0x7f0b9809e040 msgr2=0x7f0b9804d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:02.840 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.840+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:02.841 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.842 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 zone default found 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 4 Realm: () 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 zonegroup default 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.841+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.842+0000 7f0baa887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:02.843 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.842+0000 7f0baa887800 20 started sync module instance, tier type = 2024-09-12T01:15:02.844 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.842+0000 7f0baa887800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T01:15:02.851 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.851+0000 7f0baa887800 20 add_watcher() i=0 2024-09-12T01:15:02.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.851+0000 7f0baa887800 20 add_watcher() i=1 2024-09-12T01:15:02.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.851+0000 7f0baa887800 20 add_watcher() i=2 2024-09-12T01:15:02.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.851+0000 7f0baa887800 20 add_watcher() i=3 2024-09-12T01:15:02.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.851+0000 7f0baa887800 20 add_watcher() i=4 2024-09-12T01:15:02.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.851+0000 7f0baa887800 20 add_watcher() i=5 2024-09-12T01:15:02.852 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.851+0000 7f0baa887800 20 add_watcher() i=6 2024-09-12T01:15:02.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.852+0000 7f0baa887800 20 add_watcher() i=7 2024-09-12T01:15:02.853 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.852+0000 7f0baa887800 2 all 8 watchers are set, enabling cache 2024-09-12T01:15:02.854 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.854+0000 7f0a5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:02.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.854+0000 7f0baa887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:15:02.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.854+0000 7f0baa887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:15:02.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.854+0000 7f0baa887800 5 note: GC not initialized 2024-09-12T01:15:02.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.855+0000 7f0a5dfdb640 20 reqs_thread_entry: start 2024-09-12T01:15:02.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.855+0000 7f0baa887800 20 init_complete bucket index max shards: 11 2024-09-12T01:15:02.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.855+0000 7f0baa887800 20 Filter name: none 2024-09-12T01:15:02.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.855+0000 7f09cf7fe640 20 reqs_thread_entry: start 2024-09-12T01:15:02.855 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.855+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.855+0000 7f0baa887800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:15:02.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.855+0000 7f0baa887800 20 rados->read ofs=0 len=0 2024-09-12T01:15:02.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.856+0000 7f0baa887800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:15:02.856 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.856+0000 7f0baa887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:15:02.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.856+0000 7f0baa887800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T01:15:02.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.856+0000 7f0baa887800 20 INFO: main: starting shard=0 2024-09-12T01:15:02.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.856+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.0 2024-09-12T01:15:02.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.857+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.857 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.857+0000 7f0baa887800 20 INFO: main: starting shard=1 2024-09-12T01:15:02.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.857+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.1 2024-09-12T01:15:02.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.857+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.857+0000 7f0baa887800 20 INFO: main: starting shard=2 2024-09-12T01:15:02.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.857+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.2 2024-09-12T01:15:02.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.858+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.858 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.858+0000 7f0baa887800 20 INFO: main: starting shard=3 2024-09-12T01:15:02.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.858+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.3 2024-09-12T01:15:02.859 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 INFO: main: starting shard=4 2024-09-12T01:15:02.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.4 2024-09-12T01:15:02.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 INFO: main: starting shard=5 2024-09-12T01:15:02.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.5 2024-09-12T01:15:02.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 INFO: main: starting shard=6 2024-09-12T01:15:02.860 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.859+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.6 2024-09-12T01:15:02.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.860+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.860+0000 7f0baa887800 20 INFO: main: starting shard=7 2024-09-12T01:15:02.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.860+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.7 2024-09-12T01:15:02.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.861+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.861+0000 7f0baa887800 20 INFO: main: starting shard=8 2024-09-12T01:15:02.861 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.861+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.8 2024-09-12T01:15:02.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.861+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.861+0000 7f0baa887800 20 INFO: main: starting shard=9 2024-09-12T01:15:02.862 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.861+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.9 2024-09-12T01:15:02.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.862+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.862+0000 7f0baa887800 20 INFO: main: starting shard=10 2024-09-12T01:15:02.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.862+0000 7f0baa887800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.10 2024-09-12T01:15:02.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.862+0000 7f0baa887800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:15:02.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.862+0000 7f0baa887800 20 INFO: main: done 2024-09-12T01:15:02.863 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.863+0000 7f0a5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:02.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.866+0000 7f0baa887800 20 remove_watcher() i=0 2024-09-12T01:15:02.866 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.866+0000 7f0baa887800 2 removed watcher, disabling cache 2024-09-12T01:15:02.867 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.867+0000 7f0baa887800 20 remove_watcher() i=1 2024-09-12T01:15:02.868 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.868+0000 7f0baa887800 20 remove_watcher() i=2 2024-09-12T01:15:02.869 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.869+0000 7f0baa887800 20 remove_watcher() i=3 2024-09-12T01:15:02.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.871+0000 7f0baa887800 20 remove_watcher() i=4 2024-09-12T01:15:02.871 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.872+0000 7f0baa887800 20 remove_watcher() i=5 2024-09-12T01:15:02.872 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.872+0000 7f0baa887800 20 remove_watcher() i=6 2024-09-12T01:15:02.873 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.873+0000 7f0baa887800 20 remove_watcher() i=7 2024-09-12T01:15:02.887 INFO:tasks.workunit.client.0.smithi033.stderr:rados -p default.rgw.buckets.data ls | grep ab8ce40f-d637-4d13-8349-e4f8b8c69356 2024-09-12T01:15:02.909 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:15:02.909 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:15:02.951 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:02.950+0000 7fe5f62be640 0 -- 172.21.15.33:0/513017182 >> [v2:172.21.15.33:6820/1243170537,v1:172.21.15.33:6822/1243170537] conn(0x7fe5ec01a040 msgr2=0x7fe5ec01c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:02.959 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:15:02.960 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:15:02.961 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:02.962 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:02.992 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:02.992 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:03.031 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:03.031 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:03.060 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:15:04.477 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:04.477 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:04.570 INFO:tasks.workunit.client.0.smithi033.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:15:04.572 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:15:04.999 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:04.999 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:05.069 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:05.070 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:05.116 INFO:tasks.workunit.client.0.smithi033.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:15:05.116 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-09-12T01:15:05.118 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:05.118 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:05.190 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:05.190 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:05.251 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:05.251 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:05.287 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:15:06.710 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:06.710 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:06.773 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:06.773 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:08.846 INFO:tasks.workunit.client.0.smithi033.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:15:09.262 INFO:tasks.workunit.client.0.smithi033.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:15:09.293 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:15:09.293 INFO:tasks.workunit.client.0.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:15:09.334 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.335+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.335 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.336+0000 7fc983b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:09.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.336+0000 7fc983b39800 20 realm 2024-09-12T01:15:09.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.336+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.337+0000 7fc983b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:09.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.337+0000 7fc983b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:15:09.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.337+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.337+0000 7fc983b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:09.336 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.337+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.338+0000 7fc983b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:09.337 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.338+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.339+0000 7fc983b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:15:09.338 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.339+0000 7fc983b39800 20 searching for the correct realm 2024-09-12T01:15:09.342 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.343+0000 7fc97ffc8640 0 -- 172.21.15.33:0/454529835 >> [v2:172.21.15.162:6824/3281183708,v1:172.21.15.162:6825/3281183708] conn(0x7fc974063070 msgr2=0x7fc97408b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:09.550 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.551+0000 7fc97f7c7640 0 -- 172.21.15.33:0/454529835 >> [v2:172.21.15.162:6800/85576769,v1:172.21.15.162:6801/85576769] conn(0x5620e48f1d40 msgr2=0x5620e48f4150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:09.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:15:09.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T01:15:09.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T01:15:09.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:15:09.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:15:09.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:15:09.553 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.554 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.554+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 20 zone default found 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 4 Realm: () 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 20 zonegroup default 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.555 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:09.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.555+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.556+0000 7fc983b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:09.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.556+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.556+0000 7fc983b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:09.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.556+0000 7fc983b39800 20 started sync module instance, tier type = 2024-09-12T01:15:09.556 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.556+0000 7fc983b39800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T01:15:09.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.565+0000 7fc983b39800 20 add_watcher() i=0 2024-09-12T01:15:09.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.566+0000 7fc983b39800 20 add_watcher() i=1 2024-09-12T01:15:09.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.566+0000 7fc983b39800 20 add_watcher() i=2 2024-09-12T01:15:09.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.566+0000 7fc983b39800 20 add_watcher() i=3 2024-09-12T01:15:09.565 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.566+0000 7fc983b39800 20 add_watcher() i=4 2024-09-12T01:15:09.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.566+0000 7fc983b39800 20 add_watcher() i=5 2024-09-12T01:15:09.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.566+0000 7fc983b39800 20 add_watcher() i=6 2024-09-12T01:15:09.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.566+0000 7fc983b39800 20 add_watcher() i=7 2024-09-12T01:15:09.566 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.567+0000 7fc983b39800 2 all 8 watchers are set, enabling cache 2024-09-12T01:15:09.567 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.568+0000 7fc835fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:09.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc983b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:15:09.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc983b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:15:09.568 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc983b39800 5 note: GC not initialized 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc834fe1640 20 reqs_thread_entry: start 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc983b39800 20 init_complete bucket index max shards: 11 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc983b39800 20 Filter name: none 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc7ae7fc640 20 reqs_thread_entry: start 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc983b39800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.569+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:15:09.569 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783 : miss 2024-09-12T01:15:09.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 20 rados->read ofs=0 len=0 2024-09-12T01:15:09.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:15:09.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783 info.flags=0x17 2024-09-12T01:15:09.570 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783 to cache LRU end 2024-09-12T01:15:09.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:15:09.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:15:09.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783 2024-09-12T01:15:09.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.570+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.0 2024-09-12T01:15:09.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.571+0000 7fc983b39800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:15:09.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.571+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.1 2024-09-12T01:15:09.571 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.572+0000 7fc983b39800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T01:15:09.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.572+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.2 2024-09-12T01:15:09.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.572+0000 7fc983b39800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T01:15:09.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.572+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.3 2024-09-12T01:15:09.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.573+0000 7fc983b39800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T01:15:09.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.573+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.4 2024-09-12T01:15:09.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.573+0000 7fc983b39800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T01:15:09.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.573+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.5 2024-09-12T01:15:09.572 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.573+0000 7fc983b39800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T01:15:09.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.573+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.6 2024-09-12T01:15:09.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.574+0000 7fc983b39800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T01:15:09.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.574+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.7 2024-09-12T01:15:09.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.574+0000 7fc983b39800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T01:15:09.573 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.574+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.8 2024-09-12T01:15:09.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.575+0000 7fc983b39800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T01:15:09.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.575+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.9 2024-09-12T01:15:09.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.575+0000 7fc983b39800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T01:15:09.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.575+0000 7fc983b39800 20 bucket index object: :.dir.46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.783.10 2024-09-12T01:15:09.574 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.576+0000 7fc983b39800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T01:15:09.575 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.576+0000 7fc983b39800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:15:09.576 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.576+0000 7fc835fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:09.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.579+0000 7fc983b39800 20 remove_watcher() i=0 2024-09-12T01:15:09.578 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.579+0000 7fc983b39800 2 removed watcher, disabling cache 2024-09-12T01:15:09.579 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.580+0000 7fc983b39800 20 remove_watcher() i=1 2024-09-12T01:15:09.580 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.581+0000 7fc983b39800 20 remove_watcher() i=2 2024-09-12T01:15:09.582 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.583+0000 7fc983b39800 20 remove_watcher() i=3 2024-09-12T01:15:09.583 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.584+0000 7fc983b39800 20 remove_watcher() i=4 2024-09-12T01:15:09.584 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.585+0000 7fc983b39800 20 remove_watcher() i=5 2024-09-12T01:15:09.585 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.586+0000 7fc983b39800 20 remove_watcher() i=6 2024-09-12T01:15:09.586 INFO:tasks.workunit.client.0.smithi033.stderr:2024-09-12T01:15:09.587+0000 7fc983b39800 20 remove_watcher() i=7 2024-09-12T01:15:09.597 INFO:tasks.workunit.client.0.smithi033.stderr:Deleting bucket versioning-bucket 2024-09-12T01:15:09.599 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:09.599 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:09.633 INFO:tasks.workunit.client.0.smithi033.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:15:09.633 INFO:tasks.workunit.client.0.smithi033.stderr: warnings.warn( 2024-09-12T01:15:09.758 INFO:tasks.workunit.client.0.smithi033.stderr:Completed bucket versioning tests 2024-09-12T01:15:09.759 INFO:tasks.workunit.client.0.smithi033.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:15:09.759 INFO:tasks.workunit.client.0.smithi033.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:15:09.759 INFO:tasks.workunit.client.0.smithi033.stdout:connected to https://localhost:443 2024-09-12T01:15:09.821 INFO:tasks.workunit.client.0.smithi033.stderr:+ deactivate 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ export PATH 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n '' ']' 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ hash -r 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' -n '' ']' 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:15:09.822 INFO:tasks.workunit.client.0.smithi033.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:15:09.823 INFO:tasks.workunit.client.0.smithi033.stderr:+ unset -f deactivate 2024-09-12T01:15:09.823 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo OK. 2024-09-12T01:15:09.824 INFO:tasks.workunit.client.0.smithi033.stdout:OK. 2024-09-12T01:15:09.824 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:15:09.825 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:15:09.906 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:15:09.906 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:15:10.298 DEBUG:teuthology.parallel:result is None 2024-09-12T01:15:10.299 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:15:10.339 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:15:10.339 DEBUG:teuthology.orchestra.run.smithi033:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:15:10.409 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:15:10.409 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:15:10.422 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:15:10.431 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:15:10.431 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:15:10.431 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:15:10.515 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:15:10.515 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:15:10.575 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:15:10.575 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:15:10.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.620+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.621+0000 7f8b2933d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:10.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.621+0000 7f8b2933d800 20 realm 2024-09-12T01:15:10.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.622+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.622+0000 7f8b2933d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:10.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.622+0000 7f8b2933d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:15:10.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.622+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.622+0000 7f8b2933d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:10.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.622+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.623+0000 7f8b2933d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:10.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.623+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.624+0000 7f8b2933d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:15:10.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.624+0000 7f8b2933d800 20 searching for the correct realm 2024-09-12T01:15:10.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.627+0000 7f8b24829640 0 -- 172.21.15.33:0/4030598962 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55d46dcfcc40 msgr2=0x55d46dcff050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:10.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.631+0000 7f8b2502a640 0 -- 172.21.15.33:0/4030598962 >> [v2:172.21.15.33:6800/659192624,v1:172.21.15.33:6801/659192624] conn(0x7f8b1c07a9d0 msgr2=0x7f8b1c048920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:15:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T01:15:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T01:15:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:15:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:15:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:15:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.838+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 20 zone default found 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 4 Realm: () 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 20 zonegroup default 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.839+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.840+0000 7f8b2933d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.840+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.840+0000 7f8b2933d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.840+0000 7f8b2933d800 20 started sync module instance, tier type = 2024-09-12T01:15:10.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.840+0000 7f8b2933d800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T01:15:10.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.850+0000 7f8b2933d800 20 add_watcher() i=0 2024-09-12T01:15:10.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.850+0000 7f8b2933d800 20 add_watcher() i=1 2024-09-12T01:15:10.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.850+0000 7f8b2933d800 20 add_watcher() i=2 2024-09-12T01:15:10.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.850+0000 7f8b2933d800 20 add_watcher() i=3 2024-09-12T01:15:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.850+0000 7f8b2933d800 20 add_watcher() i=4 2024-09-12T01:15:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.850+0000 7f8b2933d800 20 add_watcher() i=5 2024-09-12T01:15:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.850+0000 7f8b2933d800 20 add_watcher() i=6 2024-09-12T01:15:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.851+0000 7f8b2933d800 20 add_watcher() i=7 2024-09-12T01:15:10.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.851+0000 7f8b2933d800 2 all 8 watchers are set, enabling cache 2024-09-12T01:15:10.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.853+0000 7f89db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:10.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.853+0000 7f8b2933d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:15:10.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.853+0000 7f8b2933d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:15:10.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.892+0000 7f89da7e4640 20 reqs_thread_entry: start 2024-09-12T01:15:10.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.892+0000 7f8b2933d800 20 init_complete bucket index max shards: 11 2024-09-12T01:15:10.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.893+0000 7f8b2933d800 20 Filter name: none 2024-09-12T01:15:10.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.893+0000 7f894bfff640 20 reqs_thread_entry: start 2024-09-12T01:15:10.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.893+0000 7f8b2933d800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:15:10.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.893+0000 7f8b2933d800 20 rados->read ofs=0 len=0 2024-09-12T01:15:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.893+0000 7f8b2933d800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:15:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.893+0000 7f8b2933d800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:15:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.893+0000 7f8b2933d800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:15:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.893+0000 7f8b2933d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:15:10.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.894+0000 7f8b2933d800 10 removing key index: DRREZVJUEGJIWCMYYESC 2024-09-12T01:15:10.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.895+0000 7f8b2933d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:DRREZVJUEGJIWCMYYESC, ofs0, ns] 2024-09-12T01:15:10.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.896+0000 7f8a08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268465 cookie 94370863808256 notifier 9471 bl.length()=170 2024-09-12T01:15:10.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.897+0000 7f8b2933d800 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:15:10.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.898+0000 7f8b2933d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:15:10.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.899+0000 7f8a08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268278 cookie 94370863769248 notifier 9471 bl.length()=181 2024-09-12T01:15:10.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.900+0000 7f8b2933d800 10 removing user buckets index 2024-09-12T01:15:10.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.902+0000 7f8b2933d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:15:10.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.902+0000 7f89f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268341 cookie 94370863811264 notifier 9471 bl.length()=172 2024-09-12T01:15:10.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.903+0000 7f8b2933d800 10 removing user index: tester.client.0 2024-09-12T01:15:10.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.904+0000 7f8b2933d800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:15:10.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.904+0000 7f8b2933d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:15:10.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.905+0000 7f89f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268466 cookie 94370863808256 notifier 9471 bl.length()=164 2024-09-12T01:15:10.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.907+0000 7f89db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:10.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.909+0000 7f8b2933d800 20 remove_watcher() i=0 2024-09-12T01:15:10.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.909+0000 7f8b2933d800 2 removed watcher, disabling cache 2024-09-12T01:15:10.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.911+0000 7f8b2933d800 20 remove_watcher() i=1 2024-09-12T01:15:10.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.912+0000 7f8b2933d800 20 remove_watcher() i=2 2024-09-12T01:15:10.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.913+0000 7f8b2933d800 20 remove_watcher() i=3 2024-09-12T01:15:10.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.914+0000 7f8b2933d800 20 remove_watcher() i=4 2024-09-12T01:15:10.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.915+0000 7f8b2933d800 20 remove_watcher() i=5 2024-09-12T01:15:10.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.916+0000 7f8b2933d800 20 remove_watcher() i=6 2024-09-12T01:15:10.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:10.917+0000 7f8b2933d800 20 remove_watcher() i=7 2024-09-12T01:15:10.929 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:15:10.939 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:15:10.949 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:15:11.007 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:15:11.018 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:15:11.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:15:11.028 INFO:tasks.rgw.client.0.smithi033.stdout:2024-09-12T01:15:11.024+0000 f874640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44311) UID: 0 2024-09-12T01:15:11.028 INFO:tasks.rgw.client.0.smithi033.stdout:2024-09-12T01:15:11.026+0000 a1be240 -1 shutting down 2024-09-12T01:15:45.551 INFO:tasks.rgw.client.0.smithi033.stderr:==00:01:12:44.467 44315== could not unlink /tmp/vgdb-pipe-from-vgdb-to-44315-by-root-on-??? 2024-09-12T01:15:45.551 INFO:tasks.rgw.client.0.smithi033.stderr:==00:01:12:44.467 44315== could not unlink /tmp/vgdb-pipe-to-vgdb-from-44315-by-root-on-??? 2024-09-12T01:15:45.552 INFO:tasks.rgw.client.0.smithi033.stderr:==00:01:12:44.467 44315== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-44315-by-root-on-??? 2024-09-12T01:15:47.627 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:15:47.627 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:15:47.663 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:15:47.751 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:15:47.793 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:15:47.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:15:47.794 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:15:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:15:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:15:47.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.933+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.935+0000 7fde53010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:47.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.935+0000 7fde53010800 20 realm 2024-09-12T01:15:47.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.935+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.935+0000 7fde53010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:47.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.935+0000 7fde53010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:15:47.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.935+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.935+0000 7fde53010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:47.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.935+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.936+0000 7fde53010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:47.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.936+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.937+0000 7fde53010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:15:47.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.937+0000 7fde53010800 20 searching for the correct realm 2024-09-12T01:15:47.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.941+0000 7fde4dfbb640 0 -- 172.21.15.33:0/1346610676 >> [v2:172.21.15.33:6816/3131120991,v1:172.21.15.33:6817/3131120991] conn(0x55d7a5b0d5d0 msgr2=0x55d7a5b0fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:47.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.944+0000 7fde4dfbb640 0 -- 172.21.15.33:0/1346610676 >> [v2:172.21.15.162:6816/3412691534,v1:172.21.15.162:6817/3412691534] conn(0x55d7a5b151d0 msgr2=0x55d7a5b175c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 RGWRados::pool_iterate: got zone_info.46a733b9-e1d0-4fb4-b303-ac8b84c0769e 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 RGWRados::pool_iterate: got zonegroup_info.31499a79-1d3c-451a-b23c-228ffb7ee997 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.949+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 zone default found 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 4 Realm: () 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 4 ZoneGroup: default (31499a79-1d3c-451a-b23c-228ffb7ee997) 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 4 Zone: default (46a733b9-e1d0-4fb4-b303-ac8b84c0769e) 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 zonegroup default 2024-09-12T01:15:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 rados->read ofs=0 len=0 2024-09-12T01:15:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:15:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 started sync module instance, tier type = 2024-09-12T01:15:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.950+0000 7fde53010800 20 started zone id=46a733b9-e1d0-4fb4-b303-ac8b84c0769e (name=default) with tier type = 2024-09-12T01:15:47.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.961+0000 7fde53010800 20 add_watcher() i=0 2024-09-12T01:15:47.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.961+0000 7fde53010800 20 add_watcher() i=1 2024-09-12T01:15:47.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.961+0000 7fde53010800 20 add_watcher() i=2 2024-09-12T01:15:47.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.961+0000 7fde53010800 20 add_watcher() i=3 2024-09-12T01:15:47.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.961+0000 7fde53010800 20 add_watcher() i=4 2024-09-12T01:15:47.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.961+0000 7fde53010800 20 add_watcher() i=5 2024-09-12T01:15:47.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.961+0000 7fde53010800 20 add_watcher() i=6 2024-09-12T01:15:47.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.962+0000 7fde53010800 20 add_watcher() i=7 2024-09-12T01:15:47.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.962+0000 7fde53010800 2 all 8 watchers are set, enabling cache 2024-09-12T01:15:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.964+0000 7fdd04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.964+0000 7fde53010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:15:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:47.964+0000 7fde53010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:15:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.002+0000 7fdc7f7fe640 20 reqs_thread_entry: start 2024-09-12T01:15:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.002+0000 7fde53010800 20 init_complete bucket index max shards: 11 2024-09-12T01:15:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.002+0000 7fde53010800 20 Filter name: none 2024-09-12T01:15:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.002+0000 7fdc7d7fa640 20 reqs_thread_entry: start 2024-09-12T01:15:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.002+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:15:48.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.004+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5386078487197501182', time=2024-09-12T02:42:19.744562+0000, chain.objs.size()=3 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-LUKEWARM.2~85ASWSV4nnTRFiLVZ_PW7Naku2qaY9K.1 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-LUKEWARM.2~85ASWSV4nnTRFiLVZ_PW7Naku2qaY9K.2 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-LUKEWARM.2~85ASWSV4nnTRFiLVZ_PW7Naku2qaY9K.3 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3261245543451389158', time=2024-09-12T02:42:27.069813+0000, chain.objs.size()=3 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-FROZEN.2~IF-ZjNfvX6PorHwtEHT7yN4CAkirhNB.1 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-FROZEN.2~IF-ZjNfvX6PorHwtEHT7yN4CAkirhNB.2 2024-09-12T01:15:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-FROZEN.2~IF-ZjNfvX6PorHwtEHT7yN4CAkirhNB.3 2024-09-12T01:15:48.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~NUPLh7Yo7a3KCT7erxVRGVgwaNc-6mr', time=2024-09-12T02:55:33.915050+0000, chain.objs.size()=1 2024-09-12T01:15:48.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~NUPLh7Yo7a3KCT7erxVRGVgwaNc-6mr.3 2024-09-12T01:15:48.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.005+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7206334042299000322', time=2024-09-12T02:56:51.283651+0000, chain.objs.size()=2 2024-09-12T01:15:48.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.006+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~Mvtxm73dsjnuQCAtdJ4cTT-2tW959oD.1 2024-09-12T01:15:48.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.007+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~Mvtxm73dsjnuQCAtdJ4cTT-2tW959oD.2 2024-09-12T01:15:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.007+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7722457914538285186', time=2024-09-12T02:57:03.435105+0000, chain.objs.size()=2 2024-09-12T01:15:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.007+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~rvwjqv5LpEtfcwTwYikSXNNFZHW-tOM.1 2024-09-12T01:15:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.007+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~rvwjqv5LpEtfcwTwYikSXNNFZHW-tOM.2 2024-09-12T01:15:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.007+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6642737789185345739', time=2024-09-12T02:58:04.983999+0000, chain.objs.size()=1 2024-09-12T01:15:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.007+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.537__multipart_mymultipart.2~tP1V8jd9mNHbBI9iLQQt5efsLNkd4b6.1 2024-09-12T01:15:48.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.010+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.013+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:15:48.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.014+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.014+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:15:48.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17514133596367626676', time=2024-09-12T02:53:28.858724+0000, chain.objs.size()=6 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.1 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.2 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.3 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.4 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.5 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.6 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13350149304729588277', time=2024-09-12T02:53:49.974764+0000, chain.objs.size()=1 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.519__multipart_mymultipart.2~I7oCiHqYsDpXHfsRaIWLwj5LUWhVd32.1 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4384891993850464502', time=2024-09-12T02:56:25.305959+0000, chain.objs.size()=6 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~ELp4yUQsPM8iNJrGk_YHocQhO222QrT.1 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.4HgOvIT-diDcVpaK46JugTJFcrgQYh7d.2 2024-09-12T01:15:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.QMVY7N5rURX-B2q4aVHGHaHsXzxU4G09.3 2024-09-12T01:15:48.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~ELp4yUQsPM8iNJrGk_YHocQhO222QrT.4 2024-09-12T01:15:48.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.015+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~ELp4yUQsPM8iNJrGk_YHocQhO222QrT.5 2024-09-12T01:15:48.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.017+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~ELp4yUQsPM8iNJrGk_YHocQhO222QrT.6 2024-09-12T01:15:48.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.018+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je', time=2024-09-12T02:57:16.376400+0000, chain.objs.size()=10 2024-09-12T01:15:48.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.018+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.1 2024-09-12T01:15:48.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.018+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.2 2024-09-12T01:15:48.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.018+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.3 2024-09-12T01:15:48.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.018+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.4 2024-09-12T01:15:48.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.021+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.5 2024-09-12T01:15:48.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.021+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.6 2024-09-12T01:15:48.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.021+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.7 2024-09-12T01:15:48.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.021+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.8 2024-09-12T01:15:48.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.021+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.9 2024-09-12T01:15:48.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.021+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.527__multipart_mymultipart.2~l99j7WOwp-kFHZ3Wnr6xxv-3xatM4Je.10 2024-09-12T01:15:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.025+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.028+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:15:48.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.029+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.029+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.030+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:15:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.030+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10729248897426209100', time=2024-09-12T02:41:51.255339+0000, chain.objs.size()=3 2024-09-12T01:15:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.030+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-STANDARD.2~bSbODe-hZR6xes4H2xAFivG5fCLWKb8.1 2024-09-12T01:15:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.030+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-STANDARD.2~bSbODe-hZR6xes4H2xAFivG5fCLWKb8.2 2024-09-12T01:15:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.030+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-STANDARD.2~bSbODe-hZR6xes4H2xAFivG5fCLWKb8.3 2024-09-12T01:15:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.030+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1340355308185549692', time=2024-09-12T03:07:12.975073+0000, chain.objs.size()=1 2024-09-12T01:15:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.030+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.651__shadow_.e-Rkyhie1-kiIRv0xmNuETEFq47ubpE_1 2024-09-12T01:15:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.032+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.035+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:15:48.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.036+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.036+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13039256151612339910', time=2024-09-12T02:41:51.227694+0000, chain.objs.size()=3 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-LUKEWARM.2~RzYx0Sk5ZTgzw0HixPxyBizRGce03Be.1 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-LUKEWARM.2~RzYx0Sk5ZTgzw0HixPxyBizRGce03Be.2 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-LUKEWARM.2~RzYx0Sk5ZTgzw0HixPxyBizRGce03Be.3 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13504871146056542685', time=2024-09-12T02:42:12.649684+0000, chain.objs.size()=3 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-STANDARD.2~_uo6X7X6fR5NnaIVMzZUC-EfnGDhbzp.1 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-STANDARD.2~_uo6X7X6fR5NnaIVMzZUC-EfnGDhbzp.2 2024-09-12T01:15:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__multipart_foo-STANDARD.2~_uo6X7X6fR5NnaIVMzZUC-EfnGDhbzp.3 2024-09-12T01:15:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~3bNxc4bzpte6bgfN1UlOkDWuiVDjcl7', time=2024-09-12T03:06:23.822895+0000, chain.objs.size()=6 2024-09-12T01:15:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.625__multipart_multipart_enc.2~3bNxc4bzpte6bgfN1UlOkDWuiVDjcl7.1 2024-09-12T01:15:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.625__multipart_multipart_enc.2~3bNxc4bzpte6bgfN1UlOkDWuiVDjcl7.2 2024-09-12T01:15:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.625__multipart_multipart_enc.2~3bNxc4bzpte6bgfN1UlOkDWuiVDjcl7.3 2024-09-12T01:15:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.625__multipart_multipart_enc.2~3bNxc4bzpte6bgfN1UlOkDWuiVDjcl7.4 2024-09-12T01:15:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.625__multipart_multipart_enc.2~3bNxc4bzpte6bgfN1UlOkDWuiVDjcl7.5 2024-09-12T01:15:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.037+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.625__multipart_multipart_enc.2~3bNxc4bzpte6bgfN1UlOkDWuiVDjcl7.6 2024-09-12T01:15:48.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.043+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.045+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:15:48.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.047+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.048+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.048+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.049+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:15:48.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.051+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.051+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:15:48.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_SnY54RzfG3_-OfOmVwVIaMZv3nJRI9t', time=2024-09-12T02:42:30.365423+0000, chain.objs.size()=2 2024-09-12T01:15:48.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.JWHk565kdw7Ay2zGA0JOxaqbVCtFPjt_0 2024-09-12T01:15:48.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.JWHk565kdw7Ay2zGA0JOxaqbVCtFPjt_1 2024-09-12T01:15:48.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_S3owG-ipV008M2RzpDv2z-XpYa0aHOT', time=2024-09-12T02:42:30.393109+0000, chain.objs.size()=2 2024-09-12T01:15:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.lWmh0QVtKP3pEY8YSGz8C8S6bw2niUm_0 2024-09-12T01:15:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.lWmh0QVtKP3pEY8YSGz8C8S6bw2niUm_1 2024-09-12T01:15:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_xE_A_FWvnzy-_t9uYfxzM2Mwh4A4ZNz', time=2024-09-12T02:42:42.127292+0000, chain.objs.size()=1 2024-09-12T01:15:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.166__shadow_.WcIYZphqNj6D8lp_HlhG7eetY_i9q5e_0 2024-09-12T01:15:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6757657449088858401', time=2024-09-12T02:53:46.537434+0000, chain.objs.size()=1 2024-09-12T01:15:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.519__multipart_mymultipart.2~vLsCuwIqr761zqvH9l7ZOG4JxRIWZGG.1 2024-09-12T01:15:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4121244896534827378', time=2024-09-12T02:54:14.998658+0000, chain.objs.size()=6 2024-09-12T01:15:48.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.520__multipart_mymultipart.2~HRpDYihZREr0nzOUfQt8PN45JfJVANB.1 2024-09-12T01:15:48.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.520__multipart_mymultipart.2~HRpDYihZREr0nzOUfQt8PN45JfJVANB.2 2024-09-12T01:15:48.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.520__multipart_mymultipart.2~HRpDYihZREr0nzOUfQt8PN45JfJVANB.3 2024-09-12T01:15:48.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.520__multipart_mymultipart.2~HRpDYihZREr0nzOUfQt8PN45JfJVANB.4 2024-09-12T01:15:48.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.520__multipart_mymultipart.2~HRpDYihZREr0nzOUfQt8PN45JfJVANB.5 2024-09-12T01:15:48.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.052+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.520__multipart_mymultipart.2~HRpDYihZREr0nzOUfQt8PN45JfJVANB.6 2024-09-12T01:15:48.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.055+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12747294005269612861', time=2024-09-12T02:54:34.093712+0000, chain.objs.size()=3 2024-09-12T01:15:48.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.055+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~wSblt8VzTBM-V2j6REVsU8hKMrdJ7EE.1 2024-09-12T01:15:48.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.057+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~wSblt8VzTBM-V2j6REVsU8hKMrdJ7EE.2 2024-09-12T01:15:48.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.057+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~wSblt8VzTBM-V2j6REVsU8hKMrdJ7EE.3 2024-09-12T01:15:48.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.059+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.061+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:15:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.062+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:15:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11092046322592972114', time=2024-09-12T02:41:59.579373+0000, chain.objs.size()=2 2024-09-12T01:15:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.v-HHjfKCKLIMfFxA9VipC7I954PjupH_0 2024-09-12T01:15:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.v-HHjfKCKLIMfFxA9VipC7I954PjupH_1 2024-09-12T01:15:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_LjLFEZN5hyY7UK5pWZdivnHPtzS20C5', time=2024-09-12T02:42:42.154755+0000, chain.objs.size()=1 2024-09-12T01:15:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.166__shadow_.CO5XdIpve5NDz88aMWsCooFaz2lJtvL_0 2024-09-12T01:15:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~-thmE79Xz9Md9OYTUP0S-nrrqpeRoYK', time=2024-09-12T02:43:38.578734+0000, chain.objs.size()=1 2024-09-12T01:15:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.202__multipart_mymultipart.2~-thmE79Xz9Md9OYTUP0S-nrrqpeRoYK.1 2024-09-12T01:15:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~QwOiJi38SM3YWmFI3Io8_AZpUvOz_qL', time=2024-09-12T02:57:31.662385+0000, chain.objs.size()=2 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.530__multipart_mymultipart.2~QwOiJi38SM3YWmFI3Io8_AZpUvOz_qL.1 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.530__multipart_mymultipart.2~QwOiJi38SM3YWmFI3Io8_AZpUvOz_qL.2 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~_GZP9Aq_tae0l427QexP1ee5-vvmtmd', time=2024-09-12T02:57:38.151953+0000, chain.objs.size()=2 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.532__multipart_mymultipart.2~_GZP9Aq_tae0l427QexP1ee5-vvmtmd.1 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.532__multipart_mymultipart.2~_GZP9Aq_tae0l427QexP1ee5-vvmtmd.2 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14363661862262477105', time=2024-09-12T03:09:35.203306+0000, chain.objs.size()=10 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.1 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.2 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.3 2024-09-12T01:15:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.063+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.4 2024-09-12T01:15:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.067+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.5 2024-09-12T01:15:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.067+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.6 2024-09-12T01:15:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.067+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.7 2024-09-12T01:15:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.067+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.8 2024-09-12T01:15:48.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.067+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.9 2024-09-12T01:15:48.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.067+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.736__multipart_foo.2~v6sZFfFi1dwLXOnPGJi7Z6vDUqE9LHj.10 2024-09-12T01:15:48.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.067+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4587415432166251241', time=2024-09-12T03:09:44.173508+0000, chain.objs.size()=1 2024-09-12T01:15:48.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.067+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.743__multipart_mymultipart3.2~32CD47OkbyHDw1eHbNKWAar5qjyiviJ.1 2024-09-12T01:15:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.071+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.074+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:15:48.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.075+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:15:48.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~fLlUmTfg1enhIU60vBd-SJ9mPaXdANT', time=2024-09-12T02:57:46.706288+0000, chain.objs.size()=1 2024-09-12T01:15:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.536__multipart_mymultipart.2~fLlUmTfg1enhIU60vBd-SJ9mPaXdANT.3 2024-09-12T01:15:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10659355926768496782', time=2024-09-12T02:58:00.843608+0000, chain.objs.size()=4 2024-09-12T01:15:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.536__multipart_mymultipart.2~fLlUmTfg1enhIU60vBd-SJ9mPaXdANT.1 2024-09-12T01:15:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.536__multipart_mymultipart.2~fLlUmTfg1enhIU60vBd-SJ9mPaXdANT.2 2024-09-12T01:15:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.536__multipart_mymultipart.vhO-fcfhGyS6Elkzlh3onZoxjGdH5UpG.3 2024-09-12T01:15:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.536__multipart_mymultipart.2~fLlUmTfg1enhIU60vBd-SJ9mPaXdANT.4 2024-09-12T01:15:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17465621576163885185', time=2024-09-12T03:06:57.237870+0000, chain.objs.size()=1 2024-09-12T01:15:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.076+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.645__shadow_.mqIXt740JpqsJY9FPjl-vkuZMqwf9iH_1 2024-09-12T01:15:48.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.078+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.081+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:15:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.082+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_JsqL1Qcp68DHaYTBP2FPj3XI0LKvtgY', time=2024-09-12T02:42:08.265371+0000, chain.objs.size()=1 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.2_p8paynJi2QqLAifbxGOax6wF1U8Xt_0 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17579714903663055271', time=2024-09-12T03:07:48.436354+0000, chain.objs.size()=6 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.661__multipart_bar.2~liBw_tWveNJSe5ugad-3m02CzEAQvJn.1 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.661__multipart_bar.2~liBw_tWveNJSe5ugad-3m02CzEAQvJn.2 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.661__multipart_bar.2~liBw_tWveNJSe5ugad-3m02CzEAQvJn.3 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.661__multipart_bar.2~liBw_tWveNJSe5ugad-3m02CzEAQvJn.4 2024-09-12T01:15:48.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.661__multipart_bar.2~liBw_tWveNJSe5ugad-3m02CzEAQvJn.5 2024-09-12T01:15:48.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.661__multipart_bar.2~liBw_tWveNJSe5ugad-3m02CzEAQvJn.6 2024-09-12T01:15:48.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10906762317829780475', time=2024-09-12T03:07:48.978344+0000, chain.objs.size()=6 2024-09-12T01:15:48.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.663__multipart_foo.2~9i2hpexLSP5pF6uKwPkb95zxjChdhTV.1 2024-09-12T01:15:48.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.663__multipart_foo.2~9i2hpexLSP5pF6uKwPkb95zxjChdhTV.2 2024-09-12T01:15:48.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.663__multipart_foo.2~9i2hpexLSP5pF6uKwPkb95zxjChdhTV.3 2024-09-12T01:15:48.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.663__multipart_foo.2~9i2hpexLSP5pF6uKwPkb95zxjChdhTV.4 2024-09-12T01:15:48.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.083+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.663__multipart_foo.2~9i2hpexLSP5pF6uKwPkb95zxjChdhTV.5 2024-09-12T01:15:48.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.087+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.663__multipart_foo.2~9i2hpexLSP5pF6uKwPkb95zxjChdhTV.6 2024-09-12T01:15:48.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.089+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.092+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:15:48.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.093+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:15:48.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6367115254377835489', time=2024-09-12T02:53:28.881199+0000, chain.objs.size()=6 2024-09-12T01:15:48.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.1 2024-09-12T01:15:48.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.2 2024-09-12T01:15:48.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.3 2024-09-12T01:15:48.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.4 2024-09-12T01:15:48.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.5 2024-09-12T01:15:48.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.6 2024-09-12T01:15:48.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2283242563046195535', time=2024-09-12T02:53:43.756268+0000, chain.objs.size()=1 2024-09-12T01:15:48.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.094+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.519__multipart_mymultipart.2~YL2CgSWHf3g5jTVCst8fiDX-GcdI61X.1 2024-09-12T01:15:48.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.097+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.099+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:15:48.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.101+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.101+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.102+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:15:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.102+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17063205593747431449', time=2024-09-12T02:53:35.967163+0000, chain.objs.size()=1 2024-09-12T01:15:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.102+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.514__multipart_mymultipart.2~DLb1aEAOQGNc5cOlNEHCkCOVIYgGJpv.1 2024-09-12T01:15:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.102+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~ELp4yUQsPM8iNJrGk_YHocQhO222QrT', time=2024-09-12T02:55:57.507353+0000, chain.objs.size()=1 2024-09-12T01:15:48.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.102+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~ELp4yUQsPM8iNJrGk_YHocQhO222QrT.2 2024-09-12T01:15:48.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.102+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~ELp4yUQsPM8iNJrGk_YHocQhO222QrT', time=2024-09-12T02:55:57.511419+0000, chain.objs.size()=1 2024-09-12T01:15:48.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.102+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~ELp4yUQsPM8iNJrGk_YHocQhO222QrT.3 2024-09-12T01:15:48.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.103+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.106+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:15:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.107+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.700245046309618386', time=2024-09-12T02:41:43.331301+0000, chain.objs.size()=2 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.159__shadow_.eaYR-wTpBOVwK69iIm-ZBwt3nSP99co_0 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.159__shadow_.eaYR-wTpBOVwK69iIm-ZBwt3nSP99co_1 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_OncB9-RungBtlHxctrDz8i4pIm2UI17', time=2024-09-12T02:42:08.237668+0000, chain.objs.size()=2 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.Yubyk_M85h0G2Zi-V4ufLJ9lZfElqGP_0 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.Yubyk_M85h0G2Zi-V4ufLJ9lZfElqGP_1 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~qHTY-i1WACY16qpT4ySpcr1N12P2jVD', time=2024-09-12T02:54:52.525638+0000, chain.objs.size()=1 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~qHTY-i1WACY16qpT4ySpcr1N12P2jVD.1 2024-09-12T01:15:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.8332443003550176131', time=2024-09-12T02:55:57.534744+0000, chain.objs.size()=6 2024-09-12T01:15:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~NUPLh7Yo7a3KCT7erxVRGVgwaNc-6mr.1 2024-09-12T01:15:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~NUPLh7Yo7a3KCT7erxVRGVgwaNc-6mr.2 2024-09-12T01:15:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.fiCMl92MXsMBTHoUd8e1y5zLJ63tCgIm.3 2024-09-12T01:15:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~NUPLh7Yo7a3KCT7erxVRGVgwaNc-6mr.4 2024-09-12T01:15:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~NUPLh7Yo7a3KCT7erxVRGVgwaNc-6mr.5 2024-09-12T01:15:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~NUPLh7Yo7a3KCT7erxVRGVgwaNc-6mr.6 2024-09-12T01:15:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6039785609537417328', time=2024-09-12T03:00:57.569850+0000, chain.objs.size()=4 2024-09-12T01:15:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.108+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~1Lssyg7BUzAYSCJiiGZ9MWhkCCkuh1j.1 2024-09-12T01:15:48.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.111+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~1Lssyg7BUzAYSCJiiGZ9MWhkCCkuh1j.2 2024-09-12T01:15:48.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.112+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~1Lssyg7BUzAYSCJiiGZ9MWhkCCkuh1j.3 2024-09-12T01:15:48.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.112+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~1Lssyg7BUzAYSCJiiGZ9MWhkCCkuh1j.4 2024-09-12T01:15:48.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.112+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~emIhKdunLnjPzjhb7Kx8uBNke0bqk8t', time=2024-09-12T03:09:44.296006+0000, chain.objs.size()=1 2024-09-12T01:15:48.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.112+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.743__multipart_mymultipart2.2~emIhKdunLnjPzjhb7Kx8uBNke0bqk8t.1 2024-09-12T01:15:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.116+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.118+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:15:48.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.119+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.120+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.120+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:15:48.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.120+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_iJJK1-LW6ZFxVxllMv0mK0pTXxGdmwy', time=2024-09-12T02:41:55.414736+0000, chain.objs.size()=1 2024-09-12T01:15:48.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.120+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.zh_hYXpRArKhBMNWx3r2FX9n0psF1Oz_0 2024-09-12T01:15:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.120+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16308251268278933987', time=2024-09-12T02:57:14.812197+0000, chain.objs.size()=2 2024-09-12T01:15:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.120+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~CPXf2Y35yFmbzeEFNeF6sazQnQ7jUF6.1 2024-09-12T01:15:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.120+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~CPXf2Y35yFmbzeEFNeF6sazQnQ7jUF6.2 2024-09-12T01:15:48.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.122+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.124+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:15:48.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.125+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_z9517Cf76gF6n0qG88MN9WIGhtlGSww', time=2024-09-12T02:42:08.209864+0000, chain.objs.size()=2 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.tJu9RLV_C_PEDZL_wObgVY5pPjJSe9G_0 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.tJu9RLV_C_PEDZL_wObgVY5pPjJSe9G_1 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_YuRz0Qr3YJEVJHJTZpmqvV8_Xws2CHd', time=2024-09-12T02:42:14.250937+0000, chain.objs.size()=2 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.x4zDVH-sVfe9Z5UCUeJBnoYCewmdViR_0 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.x4zDVH-sVfe9Z5UCUeJBnoYCewmdViR_1 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_WpjqQm-HmIKcI9KCM-Yk1E7Af1fKNxQ', time=2024-09-12T02:42:36.044783+0000, chain.objs.size()=1 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.164__shadow_.1nljcZ4t1iTkmSF9_E2jhaZdEOR8MSt_0 2024-09-12T01:15:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6338699987947088607', time=2024-09-12T02:56:39.753588+0000, chain.objs.size()=6 2024-09-12T01:15:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.c_01c21kZZ_QjOp3vUyAInH8tRXLiKaP.1 2024-09-12T01:15:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.V8DmBPQdBdIgUPgwXx1LuLPMV_9tgnzI.2 2024-09-12T01:15:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.Ws1FkA3-jz2b_-c1jgCcLuXsp8d3rPGr.3 2024-09-12T01:15:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.EwBAwsdNdJLeMSi3RNSCc79OVhtI44uq.4 2024-09-12T01:15:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.nXW7HAVgNtK_-DRoWayicxGlY4KUUtxP.5 2024-09-12T01:15:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.nJffNRrrCzsQys9bFkbfnd398BzydlTY.6 2024-09-12T01:15:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1129743113990509856', time=2024-09-12T02:56:44.236992+0000, chain.objs.size()=2 2024-09-12T01:15:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.126+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~AFplaxLQ5ezDAYsOej_tUeLmF7-nji8.1 2024-09-12T01:15:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.129+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~AFplaxLQ5ezDAYsOej_tUeLmF7-nji8.2 2024-09-12T01:15:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.130+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16222052874293216630', time=2024-09-12T02:56:46.456180+0000, chain.objs.size()=2 2024-09-12T01:15:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.130+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~WonukIDij4nGGOux7J7QAFWBzOOpfQa.1 2024-09-12T01:15:48.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.132+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~WonukIDij4nGGOux7J7QAFWBzOOpfQa.2 2024-09-12T01:15:48.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.132+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7157511830687309346', time=2024-09-12T02:57:11.516931+0000, chain.objs.size()=3 2024-09-12T01:15:48.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.132+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~B1-96qnh3AZKmdwQzIxfWlVKXX28Ifx.1 2024-09-12T01:15:48.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.132+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~B1-96qnh3AZKmdwQzIxfWlVKXX28Ifx.2 2024-09-12T01:15:48.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.132+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~B1-96qnh3AZKmdwQzIxfWlVKXX28Ifx.3 2024-09-12T01:15:48.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.135+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.138+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:15:48.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.139+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.139+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:15:48.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14233042159408676910', time=2024-09-12T02:53:28.880481+0000, chain.objs.size()=6 2024-09-12T01:15:48.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.1 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.2 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.3 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.4 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.5 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.6 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5973803932995016872', time=2024-09-12T02:59:10.286021+0000, chain.objs.size()=1 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.559__shadow_.lS9hbQr6xNBGm-pxQVTC-rjvXF4_A4w_1 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14908518223256941458', time=2024-09-12T02:59:24.472276+0000, chain.objs.size()=1 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.564__shadow_.5amj-t9_biJTgHL4oC-uZ734uVlfwuh_1 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1709496784700948718', time=2024-09-12T03:07:48.688082+0000, chain.objs.size()=6 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.662__multipart_baz.2~MkhZ0ti5sCG7mrBFE8uKXwT_dDDUcFK.1 2024-09-12T01:15:48.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.662__multipart_baz.2~MkhZ0ti5sCG7mrBFE8uKXwT_dDDUcFK.2 2024-09-12T01:15:48.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.662__multipart_baz.2~MkhZ0ti5sCG7mrBFE8uKXwT_dDDUcFK.3 2024-09-12T01:15:48.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.140+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.662__multipart_baz.2~MkhZ0ti5sCG7mrBFE8uKXwT_dDDUcFK.4 2024-09-12T01:15:48.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.144+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.662__multipart_baz.2~MkhZ0ti5sCG7mrBFE8uKXwT_dDDUcFK.5 2024-09-12T01:15:48.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.144+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.662__multipart_baz.2~MkhZ0ti5sCG7mrBFE8uKXwT_dDDUcFK.6 2024-09-12T01:15:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.146+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.148+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:15:48.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.149+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.150+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.150+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:15:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.150+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~7Ea80q4IA19kKwFMFwykwX9rP7zBBWF', time=2024-09-12T02:55:14.309679+0000, chain.objs.size()=1 2024-09-12T01:15:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.150+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~7Ea80q4IA19kKwFMFwykwX9rP7zBBWF.2 2024-09-12T01:15:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.150+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK', time=2024-09-12T02:56:25.267538+0000, chain.objs.size()=1 2024-09-12T01:15:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.150+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK.1 2024-09-12T01:15:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK', time=2024-09-12T02:56:25.271355+0000, chain.objs.size()=1 2024-09-12T01:15:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK.2 2024-09-12T01:15:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK', time=2024-09-12T02:56:25.275064+0000, chain.objs.size()=1 2024-09-12T01:15:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK.3 2024-09-12T01:15:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK', time=2024-09-12T02:56:25.279111+0000, chain.objs.size()=1 2024-09-12T01:15:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK.4 2024-09-12T01:15:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK', time=2024-09-12T02:56:25.282699+0000, chain.objs.size()=1 2024-09-12T01:15:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK.5 2024-09-12T01:15:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK', time=2024-09-12T02:56:25.286322+0000, chain.objs.size()=1 2024-09-12T01:15:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~MMZU2p-hsuslsFtOxSkCndGVLFX2RAK.6 2024-09-12T01:15:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~sqhjBQ60tQNdDDrIjZmJ11iab6kkwia', time=2024-09-12T02:57:38.187596+0000, chain.objs.size()=1 2024-09-12T01:15:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.532__multipart_mymultipart2.2~sqhjBQ60tQNdDDrIjZmJ11iab6kkwia.1 2024-09-12T01:15:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.203477171184537152', time=2024-09-12T03:07:07.269683+0000, chain.objs.size()=1 2024-09-12T01:15:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.151+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.649__shadow_.XPdU28iwJwpXpqi7owhXhFhHiIixPdW_1 2024-09-12T01:15:48.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.155+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.157+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:15:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.158+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:15:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~kI45ToWIpGlbyZhkNnTedqZoTPdhFTH', time=2024-09-12T02:43:40.736005+0000, chain.objs.size()=1 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.203__multipart_mymultipart.2~kI45ToWIpGlbyZhkNnTedqZoTPdhFTH.1 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17199819455701026754', time=2024-09-12T02:53:29.490398+0000, chain.objs.size()=6 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.1 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.2 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.3 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.4 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.5 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.6 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17326131285530842771', time=2024-09-12T02:53:49.010255+0000, chain.objs.size()=1 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.519__multipart_mymultipart.2~b17j7tAAXiNwOU9z7Rw54jxg1zUce-a.1 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~WK1mLbb7Qc0FFPCFRyyyksBhchmyYEx', time=2024-09-12T02:57:40.615998+0000, chain.objs.size()=1 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.534__multipart_mymultipart.2~WK1mLbb7Qc0FFPCFRyyyksBhchmyYEx.1 2024-09-12T01:15:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~c50Zqn7Zce5-7n_f9h8MdtG_eqOJSq4', time=2024-09-12T02:57:41.671993+0000, chain.objs.size()=1 2024-09-12T01:15:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.535__multipart_mymultipart.2~c50Zqn7Zce5-7n_f9h8MdtG_eqOJSq4.1 2024-09-12T01:15:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11241354218640057017', time=2024-09-12T03:00:51.056639+0000, chain.objs.size()=4 2024-09-12T01:15:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~KXHcy509ZNMIchXs_kjzz-cTNSBjGsT.1 2024-09-12T01:15:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.159+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~KXHcy509ZNMIchXs_kjzz-cTNSBjGsT.2 2024-09-12T01:15:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.164+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~KXHcy509ZNMIchXs_kjzz-cTNSBjGsT.3 2024-09-12T01:15:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.164+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~KXHcy509ZNMIchXs_kjzz-cTNSBjGsT.4 2024-09-12T01:15:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.164+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10251044986888190624', time=2024-09-12T03:01:02.004204+0000, chain.objs.size()=4 2024-09-12T01:15:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.164+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~iengpYtfIVffY4pHkYEYNytE0pPJDlE.1 2024-09-12T01:15:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.164+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~iengpYtfIVffY4pHkYEYNytE0pPJDlE.2 2024-09-12T01:15:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.164+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~iengpYtfIVffY4pHkYEYNytE0pPJDlE.3 2024-09-12T01:15:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.164+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.579__multipart_testobj.2~iengpYtfIVffY4pHkYEYNytE0pPJDlE.4 2024-09-12T01:15:48.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.168+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.171+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:15:48.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.172+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:15:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_v3nYDaqy0ZvVfvQKM2jOPxreAGhTMO4', time=2024-09-12T02:42:01.052442+0000, chain.objs.size()=1 2024-09-12T01:15:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.JnvAODdj3zxydMP_xKpEOyt46Bmpe22_1 2024-09-12T01:15:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.13258647286857289737', time=2024-09-12T02:53:38.966174+0000, chain.objs.size()=1 2024-09-12T01:15:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.517__multipart_mymultipartcopy.2~CtEDC1mC7ULVGqM0mLcac9kcx88kHSx.1 2024-09-12T01:15:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~IJzbzQhqRM5s4QOCFaGk17AUzpmdzJe', time=2024-09-12T03:06:33.176860+0000, chain.objs.size()=6 2024-09-12T01:15:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.626__multipart_multipart_enc.2~IJzbzQhqRM5s4QOCFaGk17AUzpmdzJe.1 2024-09-12T01:15:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.626__multipart_multipart_enc.2~IJzbzQhqRM5s4QOCFaGk17AUzpmdzJe.2 2024-09-12T01:15:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.626__multipart_multipart_enc.2~IJzbzQhqRM5s4QOCFaGk17AUzpmdzJe.3 2024-09-12T01:15:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.626__multipart_multipart_enc.2~IJzbzQhqRM5s4QOCFaGk17AUzpmdzJe.4 2024-09-12T01:15:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.626__multipart_multipart_enc.2~IJzbzQhqRM5s4QOCFaGk17AUzpmdzJe.5 2024-09-12T01:15:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.626__multipart_multipart_enc.2~IJzbzQhqRM5s4QOCFaGk17AUzpmdzJe.6 2024-09-12T01:15:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9781805488424205937', time=2024-09-12T03:08:28.497808+0000, chain.objs.size()=1 2024-09-12T01:15:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.173+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.703__multipart_file1.2~b5c9cuGaEgcj3Oy2c7WlS3LFDheRNMi.1 2024-09-12T01:15:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.178+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.181+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:15:48.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.182+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:15:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12136632335502468389', time=2024-09-12T02:53:29.498999+0000, chain.objs.size()=6 2024-09-12T01:15:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.1 2024-09-12T01:15:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.2 2024-09-12T01:15:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.3 2024-09-12T01:15:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.4 2024-09-12T01:15:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.5 2024-09-12T01:15:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.183+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.6 2024-09-12T01:15:48.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.186+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.188+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:15:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.189+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.189+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.190+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.191+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:15:48.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.192+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.192+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.193+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:15:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.193+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9620085774203162884', time=2024-09-12T02:42:41.914070+0000, chain.objs.size()=2 2024-09-12T01:15:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.193+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.165__multipart_foo.2~gh2YzL3xh6wMR1Kb0ZhpqEUc0EW_4ij.1 2024-09-12T01:15:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.193+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.165__multipart_foo.2~gh2YzL3xh6wMR1Kb0ZhpqEUc0EW_4ij.2 2024-09-12T01:15:48.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.194+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.196+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:15:48.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.198+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.198+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.198+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:15:48.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.198+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3439790966672721437', time=2024-09-12T02:56:51.069708+0000, chain.objs.size()=3 2024-09-12T01:15:48.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.198+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~kjZ6wGLimbZHaAbcUk6bVDVP5U7It_W.1 2024-09-12T01:15:48.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~kjZ6wGLimbZHaAbcUk6bVDVP5U7It_W.2 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~kjZ6wGLimbZHaAbcUk6bVDVP5U7It_W.3 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11282655430542275842', time=2024-09-12T02:57:00.373199+0000, chain.objs.size()=2 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~For7nwaznPPWiLURJPjdSlA2y-ujP98.1 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~For7nwaznPPWiLURJPjdSlA2y-ujP98.2 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~YK7A9WyrxisxMLL__L0lQTpDKvJZSXO', time=2024-09-12T02:57:38.113222+0000, chain.objs.size()=1 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.532__multipart_mymultipart.2~YK7A9WyrxisxMLL__L0lQTpDKvJZSXO.1 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.1418840649348782655', time=2024-09-12T02:59:16.317755+0000, chain.objs.size()=1 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.562__multipart_mymultipart.Wj8g8fuvdR7vTQxYYUrikuEYYR-YA8TW.1 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.834849494236724402', time=2024-09-12T03:08:38.081955+0000, chain.objs.size()=1 2024-09-12T01:15:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.199+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.712__multipart_file1.2~d-0PBfHetNkPBINvIuwSkrJf0wW7AHE.1 2024-09-12T01:15:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.202+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.205+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:15:48.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.206+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:15:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.16868598194291964376', time=2024-09-12T02:41:51.199355+0000, chain.objs.size()=3 2024-09-12T01:15:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-FROZEN.2~ET4R3b413rga6ZPNhM4laEpdQWoYhod.1 2024-09-12T01:15:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-FROZEN.2~ET4R3b413rga6ZPNhM4laEpdQWoYhod.2 2024-09-12T01:15:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.160__multipart_mymultipart-FROZEN.2~ET4R3b413rga6ZPNhM4laEpdQWoYhod.3 2024-09-12T01:15:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_tkt356L1WzHTQAXaRuSecBeb2xR2_L-', time=2024-09-12T02:42:28.859775+0000, chain.objs.size()=2 2024-09-12T01:15:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.qtqVcXQ2hg4GKFEp3BLVwnJ6_dDk2rX_1 2024-09-12T01:15:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.qtqVcXQ2hg4GKFEp3BLVwnJ6_dDk2rX_2 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11230386328230786031', time=2024-09-12T02:53:31.771694+0000, chain.objs.size()=1 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.512__multipart_mymultipart.2~aMVc7V8kHOIE_gLTEiaDlLA8V2CgC2j.1 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4846966627637651618', time=2024-09-12T03:03:34.039522+0000, chain.objs.size()=6 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.616__multipart_multipart_enc.2~6vFXLWAJ4GEEvJ9TeS9022fctVwngA3.1 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.616__multipart_multipart_enc.2~6vFXLWAJ4GEEvJ9TeS9022fctVwngA3.2 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.616__multipart_multipart_enc.2~6vFXLWAJ4GEEvJ9TeS9022fctVwngA3.3 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.616__multipart_multipart_enc.2~6vFXLWAJ4GEEvJ9TeS9022fctVwngA3.4 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.616__multipart_multipart_enc.2~6vFXLWAJ4GEEvJ9TeS9022fctVwngA3.5 2024-09-12T01:15:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.207+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.616__multipart_multipart_enc.2~6vFXLWAJ4GEEvJ9TeS9022fctVwngA3.6 2024-09-12T01:15:48.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.213+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.215+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:15:48.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.217+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.217+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4528585975817997899', time=2024-09-12T02:42:05.388594+0000, chain.objs.size()=2 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.eMKQNcQx2qBUpLMEbsnDWsDxnaoRE8p_0 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.eMKQNcQx2qBUpLMEbsnDWsDxnaoRE8p_1 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_cHOuCa9lIx3t08OE7jbhlQtGnIGIMjm', time=2024-09-12T02:42:06.937945+0000, chain.objs.size()=1 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.161__shadow_.RftHfpOekFBWOkBVVU5awDqBtdjsRuL_1 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18004125010190341277', time=2024-09-12T02:53:29.195935+0000, chain.objs.size()=6 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.1 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.2 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.3 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.4 2024-09-12T01:15:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.5 2024-09-12T01:15:48.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.508__multipart_srcmultipart.2~x9NygEvkGsmvla_qfzhx1S0LFcXUi-C.6 2024-09-12T01:15:48.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.42912928172316591', time=2024-09-12T03:07:02.211950+0000, chain.objs.size()=1 2024-09-12T01:15:48.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.218+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.647__shadow_.SEqOf7u20TwLrntrMEy4Kj6jti83Ltq_1 2024-09-12T01:15:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.222+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.224+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:15:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.225+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_bQ5XXlrZ2wfPo0YyfwHTQVGJTz9xYrI', time=2024-09-12T02:42:21.476932+0000, chain.objs.size()=2 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.ejnSoNt3SQKAAskzPGtDWt2mNKd9aKG_1 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.ejnSoNt3SQKAAskzPGtDWt2mNKd9aKG_2 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.6702601118824254548', time=2024-09-12T02:53:49.702158+0000, chain.objs.size()=1 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.518__shadow_.Hy_Wm662mcsymSfHV8aZdLLGh5hp4jB_1 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.14863596342770732973', time=2024-09-12T02:54:44.301481+0000, chain.objs.size()=3 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~1ZW6o7M_kqgebIqB93nuBFVi27AjLhw.1 2024-09-12T01:15:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~1ZW6o7M_kqgebIqB93nuBFVi27AjLhw.2 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~1ZW6o7M_kqgebIqB93nuBFVi27AjLhw.3 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11159203661143454168', time=2024-09-12T02:57:07.440128+0000, chain.objs.size()=3 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~bj5oiH2aJy_07DcKqdRf6Seh8NGi9OL.1 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~bj5oiH2aJy_07DcKqdRf6Seh8NGi9OL.2 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~bj5oiH2aJy_07DcKqdRf6Seh8NGi9OL.3 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.10524657325979029887', time=2024-09-12T03:03:23.056201+0000, chain.objs.size()=6 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.615__multipart_multipart_enc.2~CpgOuTVsuyRTQ9Wh2_yvpbUW6hX83nh.1 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.615__multipart_multipart_enc.2~CpgOuTVsuyRTQ9Wh2_yvpbUW6hX83nh.2 2024-09-12T01:15:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.226+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.615__multipart_multipart_enc.2~CpgOuTVsuyRTQ9Wh2_yvpbUW6hX83nh.3 2024-09-12T01:15:48.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.229+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.615__multipart_multipart_enc.2~CpgOuTVsuyRTQ9Wh2_yvpbUW6hX83nh.4 2024-09-12T01:15:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.231+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.615__multipart_multipart_enc.2~CpgOuTVsuyRTQ9Wh2_yvpbUW6hX83nh.5 2024-09-12T01:15:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.231+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.615__multipart_multipart_enc.2~CpgOuTVsuyRTQ9Wh2_yvpbUW6hX83nh.6 2024-09-12T01:15:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.231+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.9403841944754816580', time=2024-09-12T03:09:50.224942+0000, chain.objs.size()=3 2024-09-12T01:15:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.231+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.744__multipart_mymultipart3.2~cqJyHkn4yapz7LAG1LcHM2QlA1xb7-r.1 2024-09-12T01:15:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.231+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.744__multipart_mymultipart3.2~cqJyHkn4yapz7LAG1LcHM2QlA1xb7-r.2 2024-09-12T01:15:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.231+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.744__multipart_mymultipart3.2~cqJyHkn4yapz7LAG1LcHM2QlA1xb7-r.3 2024-09-12T01:15:48.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.235+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.238+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:15:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.239+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.239+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.240+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:15:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.240+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.4206659592442678762', time=2024-09-12T02:58:43.150430+0000, chain.objs.size()=1 2024-09-12T01:15:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.240+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.553__shadow_.K1woqtsPBXhQ0KGLv5V8k5wc3UoZ7gs_1 2024-09-12T01:15:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.240+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~_7zV0kS03Ry44LPCVFe24ELeE_QAsxW', time=2024-09-12T03:09:44.281716+0000, chain.objs.size()=1 2024-09-12T01:15:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.240+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.743__multipart_mymultipart.2~_7zV0kS03Ry44LPCVFe24ELeE_QAsxW.1 2024-09-12T01:15:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.242+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.244+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:15:48.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.245+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.246+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.246+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:15:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.246+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.11228510733547524984', time=2024-09-12T02:56:57.799542+0000, chain.objs.size()=1 2024-09-12T01:15:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.246+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.526__multipart_mymultipart.2~2Km6uivHi7YMcRAkfnLTEhZ66YLgOR0.1 2024-09-12T01:15:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.246+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.3660102922194462193', time=2024-09-12T02:59:15.620910+0000, chain.objs.size()=1 2024-09-12T01:15:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.246+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.562__multipart_mymultipart.2~FOMdXkNGzjb9KgNCl2GDmQkZyjetVuN.1 2024-09-12T01:15:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.248+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.250+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:15:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.251+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:15:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_LCvbVCzcGLSUUU74JzbddE0q4OCS2lW', time=2024-09-12T02:42:30.420692+0000, chain.objs.size()=2 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.4pVmXkXArxisQhCqeoPC79Yjh5bdBUo_0 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.162__shadow_.4pVmXkXArxisQhCqeoPC79Yjh5bdBUo_1 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.17935796128537663285', time=2024-09-12T02:55:14.328959+0000, chain.objs.size()=6 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.cR6ELpnis8aQVlUuBR9TbxaV2b9fIFSW.1 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~qHTY-i1WACY16qpT4ySpcr1N12P2jVD.2 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~qHTY-i1WACY16qpT4ySpcr1N12P2jVD.3 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~qHTY-i1WACY16qpT4ySpcr1N12P2jVD.4 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~qHTY-i1WACY16qpT4ySpcr1N12P2jVD.5 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~qHTY-i1WACY16qpT4ySpcr1N12P2jVD.6 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2617863931857688143', time=2024-09-12T02:56:42.854188+0000, chain.objs.size()=1 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~x309jQovepr2uQMvjW5O75d7kRl175N.1 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.653981903612912920', time=2024-09-12T02:56:48.920273+0000, chain.objs.size()=3 2024-09-12T01:15:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~sMn4Haot_q8YkDQkyvFCOG7Mh12nMNN.1 2024-09-12T01:15:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~sMn4Haot_q8YkDQkyvFCOG7Mh12nMNN.2 2024-09-12T01:15:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.252+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.524__multipart_mymultipart.2~sMn4Haot_q8YkDQkyvFCOG7Mh12nMNN.3 2024-09-12T01:15:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.256+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.7812410817926208169', time=2024-09-12T03:06:14.404786+0000, chain.objs.size()=6 2024-09-12T01:15:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.256+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.624__multipart_multipart_enc.2~EWAPrD7q9336YwV5IgpWIAvY3v2zeSN.1 2024-09-12T01:15:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.257+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.624__multipart_multipart_enc.2~EWAPrD7q9336YwV5IgpWIAvY3v2zeSN.2 2024-09-12T01:15:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.257+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.624__multipart_multipart_enc.2~EWAPrD7q9336YwV5IgpWIAvY3v2zeSN.3 2024-09-12T01:15:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.258+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.624__multipart_multipart_enc.2~EWAPrD7q9336YwV5IgpWIAvY3v2zeSN.4 2024-09-12T01:15:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.258+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.624__multipart_multipart_enc.2~EWAPrD7q9336YwV5IgpWIAvY3v2zeSN.5 2024-09-12T01:15:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.258+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.624__multipart_multipart_enc.2~EWAPrD7q9336YwV5IgpWIAvY3v2zeSN.6 2024-09-12T01:15:48.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.263+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.266+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:15:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.268+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.268+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.268+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:15:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.268+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='_SlUcfevBb2TT6Ue5y7J6EqM_BkNxB7e', time=2024-09-12T02:42:36.017494+0000, chain.objs.size()=1 2024-09-12T01:15:48.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.268+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.164__shadow_.zxVo0YG09HdZTaBlloa_bf84eqddHnm_0 2024-09-12T01:15:48.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.269+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.271+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:15:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.272+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.18425593051834351488', time=2024-09-12T02:55:33.934529+0000, chain.objs.size()=6 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~7Ea80q4IA19kKwFMFwykwX9rP7zBBWF.1 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.pmQKUJjauLTgARExLXPiCYp-S4wOPKfd.2 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~7Ea80q4IA19kKwFMFwykwX9rP7zBBWF.3 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~7Ea80q4IA19kKwFMFwykwX9rP7zBBWF.4 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~7Ea80q4IA19kKwFMFwykwX9rP7zBBWF.5 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.523__multipart_mymultipart.2~7Ea80q4IA19kKwFMFwykwX9rP7zBBWF.6 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.12704882153378045178', time=2024-09-12T02:57:23.112462+0000, chain.objs.size()=4 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.528__multipart_mymultipart.2~TFHQFdI5PADgHU3nRMHvbUcrTv26Qn0.1 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.528__multipart_mymultipart.2~TFHQFdI5PADgHU3nRMHvbUcrTv26Qn0.2 2024-09-12T01:15:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.528__multipart_mymultipart.2~TFHQFdI5PADgHU3nRMHvbUcrTv26Qn0.3 2024-09-12T01:15:48.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.273+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.528__multipart_mymultipart.2~TFHQFdI5PADgHU3nRMHvbUcrTv26Qn0.4 2024-09-12T01:15:48.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.279+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.281+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:15:48.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.282+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:15:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.5849600564207583410', time=2024-09-12T02:54:39.705653+0000, chain.objs.size()=3 2024-09-12T01:15:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~ATiNmyjJYeBtzp6rUSsxyrxlkDPRvGL.1 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~ATiNmyjJYeBtzp6rUSsxyrxlkDPRvGL.2 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.522__multipart_mymultipart.2~ATiNmyjJYeBtzp6rUSsxyrxlkDPRvGL.3 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.2366932111710038499', time=2024-09-12T02:57:28.850645+0000, chain.objs.size()=2 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.529__multipart_mymultipart.2~GEfiJzDOVjWBtdjxLyU8WdgqNFzNx6e.1 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.529__multipart_mymultipart.2~GEfiJzDOVjWBtdjxLyU8WdgqNFzNx6e.2 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.15283709391086332915', time=2024-09-12T02:58:58.641163+0000, chain.objs.size()=1 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.556__shadow_.MDqoAtZ9cgVvwjobuKaPCrR0AAP5Bwa_1 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='2~xAC9rIuxkh-roB8rVkQgMj0JYoWzpg8', time=2024-09-12T02:59:15.875434+0000, chain.objs.size()=1 2024-09-12T01:15:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.283+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.562__multipart_mymultipart.2~xAC9rIuxkh-roB8rVkQgMj0JYoWzpg8.1 2024-09-12T01:15:48.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.286+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.289+0000 7fde53010800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:15:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.290+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:15:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.921152862339602111', time=2024-09-12T02:41:43.304100+0000, chain.objs.size()=2 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.159__shadow_.c2BTP12ICK8Z2JXueKQ1qPIQ2Gdhn-J_0 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.159__shadow_.c2BTP12ICK8Z2JXueKQ1qPIQ2Gdhn-J_1 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 20 garbage collection: RGWGC::process iterating over entry tag='46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.156498051836751068', time=2024-09-12T03:02:32.350642+0000, chain.objs.size()=6 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.614__multipart_multipart_enc.2~e1YERFpYvXQ0hbYsA4j_EyJ8LlPex8m.1 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.614__multipart_multipart_enc.2~e1YERFpYvXQ0hbYsA4j_EyJ8LlPex8m.2 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.614__multipart_multipart_enc.2~e1YERFpYvXQ0hbYsA4j_EyJ8LlPex8m.3 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.614__multipart_multipart_enc.2~e1YERFpYvXQ0hbYsA4j_EyJ8LlPex8m.4 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.614__multipart_multipart_enc.2~e1YERFpYvXQ0hbYsA4j_EyJ8LlPex8m.5 2024-09-12T01:15:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.291+0000 7fde53010800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:46a733b9-e1d0-4fb4-b303-ac8b84c0769e.4590.614__multipart_multipart_enc.2~e1YERFpYvXQ0hbYsA4j_EyJ8LlPex8m.6 2024-09-12T01:15:48.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.294+0000 7fde53010800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:15:48.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.298+0000 7fdd04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:15:48.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.300+0000 7fde53010800 20 remove_watcher() i=0 2024-09-12T01:15:48.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.300+0000 7fde53010800 2 removed watcher, disabling cache 2024-09-12T01:15:48.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.301+0000 7fde53010800 20 remove_watcher() i=1 2024-09-12T01:15:48.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.302+0000 7fde53010800 20 remove_watcher() i=2 2024-09-12T01:15:48.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.304+0000 7fde53010800 20 remove_watcher() i=3 2024-09-12T01:15:48.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.305+0000 7fde53010800 20 remove_watcher() i=4 2024-09-12T01:15:48.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.305+0000 7fde53010800 20 remove_watcher() i=5 2024-09-12T01:15:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.306+0000 7fde53010800 20 remove_watcher() i=6 2024-09-12T01:15:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-12T01:15:48.307+0000 7fde53010800 20 remove_watcher() i=7 2024-09-12T01:15:48.318 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:15:48.661 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T01:15:48.693 DEBUG:teuthology.orchestra.run.smithi033:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:15:48.765 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T01:15:48.835 DEBUG:teuthology.orchestra.run.smithi033:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:15:48.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T01:15:48.984 DEBUG:teuthology.orchestra.run.smithi033:> sudo update-ca-trust 2024-09-12T01:15:50.050 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:15:50.061 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:15:50.061 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:15:50.398 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:15:50.410 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T01:15:50.413 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":2462,"stamp":"2024-09-12T01:15:49.319941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210746866,"num_objects":777,"num_object_clones":0,"num_object_copies":1823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":777,"num_whiteouts":0,"num_read":279380,"num_read_kb":3104823,"num_write":143417,"num_write_kb":2513039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14182,"ondisk_log_size":14182,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2275204,"kb_used_data":962320,"kb_used_omap":12,"kb_used_meta":1312627,"kb_avail":752699516,"statfs":{"total":773094113280,"available":770764304384,"internally_reserved":0,"allocated":985415680,"data_stored":968399671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1344130609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-513064071,"num_objects":-230,"num_object_clones":0,"num_object_copies":-661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-230,"num_whiteouts":0,"num_read":486,"num_read_kb":515,"num_write":354,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005263"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502105+0000","last_change":"2024-09-12T00:39:26.642397+0000","last_active":"2024-09-12T01:11:58.502105+0000","last_peered":"2024-09-12T01:11:58.502105+0000","last_clean":"2024-09-12T01:11:58.502105+0000","last_became_active":"2024-09-12T00:39:26.642090+0000","last_became_peered":"2024-09-12T00:39:26.642090+0000","last_unstale":"2024-09-12T01:11:58.502105+0000","last_undegraded":"2024-09-12T01:11:58.502105+0000","last_fullsized":"2024-09-12T01:11:58.502105+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:54.374892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.502826+0000","last_change":"2024-09-12T00:22:02.424471+0000","last_active":"2024-09-12T01:12:03.502826+0000","last_peered":"2024-09-12T01:12:03.502826+0000","last_clean":"2024-09-12T01:12:03.502826+0000","last_became_active":"2024-09-12T00:22:02.423867+0000","last_became_peered":"2024-09-12T00:22:02.423867+0000","last_unstale":"2024-09-12T01:12:03.502826+0000","last_undegraded":"2024-09-12T01:12:03.502826+0000","last_fullsized":"2024-09-12T01:12:03.502826+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.940652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.246266+0000","last_change":"2024-09-12T00:21:58.336211+0000","last_active":"2024-09-12T01:14:28.246266+0000","last_peered":"2024-09-12T01:14:28.246266+0000","last_clean":"2024-09-12T01:14:28.246266+0000","last_became_active":"2024-09-12T00:21:58.335882+0000","last_became_peered":"2024-09-12T00:21:58.335882+0000","last_unstale":"2024-09-12T01:14:28.246266+0000","last_undegraded":"2024-09-12T01:14:28.246266+0000","last_fullsized":"2024-09-12T01:14:28.246266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:06.306799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":322,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'60","reported_seq":223,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238949+0000","last_change":"2024-09-12T00:17:58.354178+0000","last_active":"2024-09-12T01:12:10.238949+0000","last_peered":"2024-09-12T01:12:10.238949+0000","last_clean":"2024-09-12T01:12:10.238949+0000","last_became_active":"2024-09-12T00:17:58.353889+0000","last_became_peered":"2024-09-12T00:17:58.353889+0000","last_unstale":"2024-09-12T01:12:10.238949+0000","last_undegraded":"2024-09-12T01:12:10.238949+0000","last_fullsized":"2024-09-12T01:12:10.238949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.435699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":209,"num_write":117,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221699+0000","last_change":"2024-09-12T00:39:26.637541+0000","last_active":"2024-09-12T01:11:58.221699+0000","last_peered":"2024-09-12T01:11:58.221699+0000","last_clean":"2024-09-12T01:11:58.221699+0000","last_became_active":"2024-09-12T00:39:26.637244+0000","last_became_peered":"2024-09-12T00:39:26.637244+0000","last_unstale":"2024-09-12T01:11:58.221699+0000","last_undegraded":"2024-09-12T01:11:58.221699+0000","last_fullsized":"2024-09-12T01:11:58.221699+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:40.343211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.390545+0000","last_change":"2024-09-12T00:22:02.421061+0000","last_active":"2024-09-12T01:12:03.390545+0000","last_peered":"2024-09-12T01:12:03.390545+0000","last_clean":"2024-09-12T01:12:03.390545+0000","last_became_active":"2024-09-12T00:22:02.420774+0000","last_became_peered":"2024-09-12T00:22:02.420774+0000","last_unstale":"2024-09-12T01:12:03.390545+0000","last_undegraded":"2024-09-12T01:12:03.390545+0000","last_fullsized":"2024-09-12T01:12:03.390545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:12.865558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229707+0000","last_change":"2024-09-12T00:21:58.338086+0000","last_active":"2024-09-12T01:11:58.229707+0000","last_peered":"2024-09-12T01:11:58.229707+0000","last_clean":"2024-09-12T01:11:58.229707+0000","last_became_active":"2024-09-12T00:21:58.336723+0000","last_became_peered":"2024-09-12T00:21:58.336723+0000","last_unstale":"2024-09-12T01:11:58.229707+0000","last_undegraded":"2024-09-12T01:11:58.229707+0000","last_fullsized":"2024-09-12T01:11:58.229707+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:29.016179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.223001+0000","last_change":"2024-09-12T00:17:58.361616+0000","last_active":"2024-09-12T01:12:08.223001+0000","last_peered":"2024-09-12T01:12:08.223001+0000","last_clean":"2024-09-12T01:12:08.223001+0000","last_became_active":"2024-09-12T00:17:58.361306+0000","last_became_peered":"2024-09-12T00:17:58.361306+0000","last_unstale":"2024-09-12T01:12:08.223001+0000","last_undegraded":"2024-09-12T01:12:08.223001+0000","last_fullsized":"2024-09-12T01:12:08.223001+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:11.973986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618592+0000","last_change":"2024-09-12T00:39:26.625650+0000","last_active":"2024-09-12T01:13:18.618592+0000","last_peered":"2024-09-12T01:13:18.618592+0000","last_clean":"2024-09-12T01:13:18.618592+0000","last_became_active":"2024-09-12T00:39:26.625454+0000","last_became_peered":"2024-09-12T00:39:26.625454+0000","last_unstale":"2024-09-12T01:13:18.618592+0000","last_undegraded":"2024-09-12T01:13:18.618592+0000","last_fullsized":"2024-09-12T01:13:18.618592+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:07.891692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238405+0000","last_change":"2024-09-12T00:22:02.422000+0000","last_active":"2024-09-12T01:12:05.238405+0000","last_peered":"2024-09-12T01:12:05.238405+0000","last_clean":"2024-09-12T01:12:05.238405+0000","last_became_active":"2024-09-12T00:22:02.421689+0000","last_became_peered":"2024-09-12T00:22:02.421689+0000","last_unstale":"2024-09-12T01:12:05.238405+0000","last_undegraded":"2024-09-12T01:12:05.238405+0000","last_fullsized":"2024-09-12T01:12:05.238405+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:25.931614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222987+0000","last_change":"2024-09-12T00:21:58.333094+0000","last_active":"2024-09-12T01:12:08.222987+0000","last_peered":"2024-09-12T01:12:08.222987+0000","last_clean":"2024-09-12T01:12:08.222987+0000","last_became_active":"2024-09-12T00:21:58.332782+0000","last_became_peered":"2024-09-12T00:21:58.332782+0000","last_unstale":"2024-09-12T01:12:08.222987+0000","last_undegraded":"2024-09-12T01:12:08.222987+0000","last_fullsized":"2024-09-12T01:12:08.222987+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:03.474793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'34","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244636+0000","last_change":"2024-09-12T00:17:58.353482+0000","last_active":"2024-09-12T01:13:00.244636+0000","last_peered":"2024-09-12T01:13:00.244636+0000","last_clean":"2024-09-12T01:13:00.244636+0000","last_became_active":"2024-09-12T00:17:58.353045+0000","last_became_peered":"2024-09-12T00:17:58.353045+0000","last_unstale":"2024-09-12T01:13:00.244636+0000","last_undegraded":"2024-09-12T01:13:00.244636+0000","last_fullsized":"2024-09-12T01:13:00.244636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:52.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.237224+0000","last_change":"2024-09-12T00:39:26.637464+0000","last_active":"2024-09-12T01:13:23.237224+0000","last_peered":"2024-09-12T01:13:23.237224+0000","last_clean":"2024-09-12T01:13:23.237224+0000","last_became_active":"2024-09-12T00:39:26.637185+0000","last_became_peered":"2024-09-12T00:39:26.637185+0000","last_unstale":"2024-09-12T01:13:23.237224+0000","last_undegraded":"2024-09-12T01:13:23.237224+0000","last_fullsized":"2024-09-12T01:13:23.237224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:20.137461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449572+0000","last_change":"2024-09-12T00:22:02.428079+0000","last_active":"2024-09-12T01:12:08.449572+0000","last_peered":"2024-09-12T01:12:08.449572+0000","last_clean":"2024-09-12T01:12:08.449572+0000","last_became_active":"2024-09-12T00:22:02.427612+0000","last_became_peered":"2024-09-12T00:22:02.427612+0000","last_unstale":"2024-09-12T01:12:08.449572+0000","last_undegraded":"2024-09-12T01:12:08.449572+0000","last_fullsized":"2024-09-12T01:12:08.449572+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:46.790157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.389901+0000","last_change":"2024-09-12T00:21:58.335917+0000","last_active":"2024-09-12T01:11:58.389901+0000","last_peered":"2024-09-12T01:11:58.389901+0000","last_clean":"2024-09-12T01:11:58.389901+0000","last_became_active":"2024-09-12T00:21:58.335619+0000","last_became_peered":"2024-09-12T00:21:58.335619+0000","last_unstale":"2024-09-12T01:11:58.389901+0000","last_undegraded":"2024-09-12T01:11:58.389901+0000","last_fullsized":"2024-09-12T01:11:58.389901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.724726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455358+0000","last_change":"2024-09-12T00:17:58.356021+0000","last_active":"2024-09-12T01:12:58.455358+0000","last_peered":"2024-09-12T01:12:58.455358+0000","last_clean":"2024-09-12T01:12:58.455358+0000","last_became_active":"2024-09-12T00:17:58.355691+0000","last_became_peered":"2024-09-12T00:17:58.355691+0000","last_unstale":"2024-09-12T01:12:58.455358+0000","last_undegraded":"2024-09-12T01:12:58.455358+0000","last_fullsized":"2024-09-12T01:12:58.455358+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:23.027551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238400+0000","last_change":"2024-09-12T00:39:26.635830+0000","last_active":"2024-09-12T01:13:33.238400+0000","last_peered":"2024-09-12T01:13:33.238400+0000","last_clean":"2024-09-12T01:13:33.238400+0000","last_became_active":"2024-09-12T00:39:26.635537+0000","last_became_peered":"2024-09-12T00:39:26.635537+0000","last_unstale":"2024-09-12T01:13:33.238400+0000","last_undegraded":"2024-09-12T01:13:33.238400+0000","last_fullsized":"2024-09-12T01:13:33.238400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:16.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510161+0000","last_change":"2024-09-12T00:22:02.429586+0000","last_active":"2024-09-12T01:12:53.510161+0000","last_peered":"2024-09-12T01:12:53.510161+0000","last_clean":"2024-09-12T01:12:53.510161+0000","last_became_active":"2024-09-12T00:22:02.429230+0000","last_became_peered":"2024-09-12T00:22:02.429230+0000","last_unstale":"2024-09-12T01:12:53.510161+0000","last_undegraded":"2024-09-12T01:12:53.510161+0000","last_fullsized":"2024-09-12T01:12:53.510161+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:50.744822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242639+0000","last_change":"2024-09-12T00:21:58.338788+0000","last_active":"2024-09-12T01:12:45.242639+0000","last_peered":"2024-09-12T01:12:45.242639+0000","last_clean":"2024-09-12T01:12:45.242639+0000","last_became_active":"2024-09-12T00:21:58.338021+0000","last_became_peered":"2024-09-12T00:21:58.338021+0000","last_unstale":"2024-09-12T01:12:45.242639+0000","last_undegraded":"2024-09-12T01:12:45.242639+0000","last_fullsized":"2024-09-12T01:12:45.242639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:31.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'22","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455331+0000","last_change":"2024-09-12T00:17:58.358082+0000","last_active":"2024-09-12T01:12:58.455331+0000","last_peered":"2024-09-12T01:12:58.455331+0000","last_clean":"2024-09-12T01:12:58.455331+0000","last_became_active":"2024-09-12T00:17:58.357755+0000","last_became_peered":"2024-09-12T00:17:58.357755+0000","last_unstale":"2024-09-12T01:12:58.455331+0000","last_undegraded":"2024-09-12T01:12:58.455331+0000","last_fullsized":"2024-09-12T01:12:58.455331+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:17.853509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.235439+0000","last_change":"2024-09-12T00:39:26.631339+0000","last_active":"2024-09-12T01:12:48.235439+0000","last_peered":"2024-09-12T01:12:48.235439+0000","last_clean":"2024-09-12T01:12:48.235439+0000","last_became_active":"2024-09-12T00:39:26.630758+0000","last_became_peered":"2024-09-12T00:39:26.630758+0000","last_unstale":"2024-09-12T01:12:48.235439+0000","last_undegraded":"2024-09-12T01:12:48.235439+0000","last_fullsized":"2024-09-12T01:12:48.235439+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.184229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'5","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041261+0000","last_change":"2024-09-12T00:22:02.428161+0000","last_active":"2024-09-12T01:15:48.041261+0000","last_peered":"2024-09-12T01:15:48.041261+0000","last_clean":"2024-09-12T01:15:48.041261+0000","last_became_active":"2024-09-12T00:22:02.427863+0000","last_became_peered":"2024-09-12T00:22:02.427863+0000","last_unstale":"2024-09-12T01:15:48.041261+0000","last_undegraded":"2024-09-12T01:15:48.041261+0000","last_fullsized":"2024-09-12T01:15:48.041261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:46.107765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":40,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397371+0000","last_change":"2024-09-12T00:21:58.330893+0000","last_active":"2024-09-12T01:12:53.397371+0000","last_peered":"2024-09-12T01:12:53.397371+0000","last_clean":"2024-09-12T01:12:53.397371+0000","last_became_active":"2024-09-12T00:21:58.330308+0000","last_became_peered":"2024-09-12T00:21:58.330308+0000","last_unstale":"2024-09-12T01:12:53.397371+0000","last_undegraded":"2024-09-12T01:12:53.397371+0000","last_fullsized":"2024-09-12T01:12:53.397371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.864549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'33","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616030+0000","last_change":"2024-09-12T00:17:58.360675+0000","last_active":"2024-09-12T01:12:58.616030+0000","last_peered":"2024-09-12T01:12:58.616030+0000","last_clean":"2024-09-12T01:12:58.616030+0000","last_became_active":"2024-09-12T00:17:58.360394+0000","last_became_peered":"2024-09-12T00:17:58.360394+0000","last_unstale":"2024-09-12T01:12:58.616030+0000","last_undegraded":"2024-09-12T01:12:58.616030+0000","last_fullsized":"2024-09-12T01:12:58.616030+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:36.476994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":120,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391380+0000","last_change":"2024-09-12T00:39:26.638745+0000","last_active":"2024-09-12T01:11:58.391380+0000","last_peered":"2024-09-12T01:11:58.391380+0000","last_clean":"2024-09-12T01:11:58.391380+0000","last_became_active":"2024-09-12T00:39:26.638443+0000","last_became_peered":"2024-09-12T00:39:26.638443+0000","last_unstale":"2024-09-12T01:11:58.391380+0000","last_undegraded":"2024-09-12T01:11:58.391380+0000","last_fullsized":"2024-09-12T01:11:58.391380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:39.177058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"264'5","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608465+0000","last_change":"2024-09-12T00:22:02.420219+0000","last_active":"2024-09-12T01:12:03.608465+0000","last_peered":"2024-09-12T01:12:03.608465+0000","last_clean":"2024-09-12T01:12:03.608465+0000","last_became_active":"2024-09-12T00:22:02.419920+0000","last_became_peered":"2024-09-12T00:22:02.419920+0000","last_unstale":"2024-09-12T01:12:03.608465+0000","last_undegraded":"2024-09-12T01:12:03.608465+0000","last_fullsized":"2024-09-12T01:12:03.608465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.257546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6462,"num_write":5,"num_write_kb":6462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.057954+0000","last_change":"2024-09-12T00:21:58.334923+0000","last_active":"2024-09-12T01:15:48.057954+0000","last_peered":"2024-09-12T01:15:48.057954+0000","last_clean":"2024-09-12T01:15:48.057954+0000","last_became_active":"2024-09-12T00:21:58.334622+0000","last_became_peered":"2024-09-12T00:21:58.334622+0000","last_unstale":"2024-09-12T01:15:48.057954+0000","last_undegraded":"2024-09-12T01:15:48.057954+0000","last_fullsized":"2024-09-12T01:15:48.057954+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:27.246572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'18","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.233636+0000","last_change":"2024-09-12T00:17:58.362164+0000","last_active":"2024-09-12T01:11:25.233636+0000","last_peered":"2024-09-12T01:11:25.233636+0000","last_clean":"2024-09-12T01:11:25.233636+0000","last_became_active":"2024-09-12T00:17:58.361620+0000","last_became_peered":"2024-09-12T00:17:58.361620+0000","last_unstale":"2024-09-12T01:11:25.233636+0000","last_undegraded":"2024-09-12T01:11:25.233636+0000","last_fullsized":"2024-09-12T01:11:25.233636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:00.693430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391431+0000","last_change":"2024-09-12T00:39:26.643583+0000","last_active":"2024-09-12T01:11:58.391431+0000","last_peered":"2024-09-12T01:11:58.391431+0000","last_clean":"2024-09-12T01:11:58.391431+0000","last_became_active":"2024-09-12T00:39:26.643223+0000","last_became_peered":"2024-09-12T00:39:26.643223+0000","last_unstale":"2024-09-12T01:11:58.391431+0000","last_undegraded":"2024-09-12T01:11:58.391431+0000","last_fullsized":"2024-09-12T01:11:58.391431+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:18.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'5","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066478+0000","last_change":"2024-09-12T00:22:22.312042+0000","last_active":"2024-09-12T01:15:48.066478+0000","last_peered":"2024-09-12T01:15:48.066478+0000","last_clean":"2024-09-12T01:15:48.066478+0000","last_became_active":"2024-09-12T00:22:22.311701+0000","last_became_peered":"2024-09-12T00:22:22.311701+0000","last_unstale":"2024-09-12T01:15:48.066478+0000","last_undegraded":"2024-09-12T01:15:48.066478+0000","last_fullsized":"2024-09-12T01:15:48.066478+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.780165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":5,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237766+0000","last_change":"2024-09-12T00:21:58.339874+0000","last_active":"2024-09-12T01:12:00.237766+0000","last_peered":"2024-09-12T01:12:00.237766+0000","last_clean":"2024-09-12T01:12:00.237766+0000","last_became_active":"2024-09-12T00:21:58.339586+0000","last_became_peered":"2024-09-12T00:21:58.339586+0000","last_unstale":"2024-09-12T01:12:00.237766+0000","last_undegraded":"2024-09-12T01:12:00.237766+0000","last_fullsized":"2024-09-12T01:12:00.237766+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:27.131816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'26","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.223825+0000","last_change":"2024-09-12T00:17:58.352434+0000","last_active":"2024-09-12T01:11:08.223825+0000","last_peered":"2024-09-12T01:11:08.223825+0000","last_clean":"2024-09-12T01:11:08.223825+0000","last_became_active":"2024-09-12T00:17:58.352129+0000","last_became_peered":"2024-09-12T00:17:58.352129+0000","last_unstale":"2024-09-12T01:11:08.223825+0000","last_undegraded":"2024-09-12T01:11:08.223825+0000","last_fullsized":"2024-09-12T01:11:08.223825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:16.704935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230767+0000","last_change":"2024-09-12T00:39:26.636027+0000","last_active":"2024-09-12T01:12:08.230767+0000","last_peered":"2024-09-12T01:12:08.230767+0000","last_clean":"2024-09-12T01:12:08.230767+0000","last_became_active":"2024-09-12T00:39:26.635558+0000","last_became_peered":"2024-09-12T00:39:26.635558+0000","last_unstale":"2024-09-12T01:12:08.230767+0000","last_undegraded":"2024-09-12T01:12:08.230767+0000","last_fullsized":"2024-09-12T01:12:08.230767+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.105963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.252261+0000","last_change":"2024-09-12T00:22:02.427487+0000","last_active":"2024-09-12T01:15:13.252261+0000","last_peered":"2024-09-12T01:15:13.252261+0000","last_clean":"2024-09-12T01:15:13.252261+0000","last_became_active":"2024-09-12T00:22:02.427180+0000","last_became_peered":"2024-09-12T00:22:02.427180+0000","last_unstale":"2024-09-12T01:15:13.252261+0000","last_undegraded":"2024-09-12T01:15:13.252261+0000","last_fullsized":"2024-09-12T01:15:13.252261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:40.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.535314+0000","last_change":"2024-09-12T00:21:58.334729+0000","last_active":"2024-09-12T01:15:43.535314+0000","last_peered":"2024-09-12T01:15:43.535314+0000","last_clean":"2024-09-12T01:15:43.535314+0000","last_became_active":"2024-09-12T00:21:58.334446+0000","last_became_peered":"2024-09-12T00:21:58.334446+0000","last_unstale":"2024-09-12T01:15:43.535314+0000","last_undegraded":"2024-09-12T01:15:43.535314+0000","last_fullsized":"2024-09-12T01:15:43.535314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:37.568023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'14","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.232052+0000","last_change":"2024-09-12T00:17:58.360971+0000","last_active":"2024-09-12T01:11:10.232052+0000","last_peered":"2024-09-12T01:11:10.232052+0000","last_clean":"2024-09-12T01:11:10.232052+0000","last_became_active":"2024-09-12T00:17:58.360560+0000","last_became_peered":"2024-09-12T00:17:58.360560+0000","last_unstale":"2024-09-12T01:11:10.232052+0000","last_undegraded":"2024-09-12T01:11:10.232052+0000","last_fullsized":"2024-09-12T01:11:10.232052+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:20.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222918+0000","last_change":"2024-09-12T00:39:26.635643+0000","last_active":"2024-09-12T01:12:08.222918+0000","last_peered":"2024-09-12T01:12:08.222918+0000","last_clean":"2024-09-12T01:12:08.222918+0000","last_became_active":"2024-09-12T00:39:26.635359+0000","last_became_peered":"2024-09-12T00:39:26.635359+0000","last_unstale":"2024-09-12T01:12:08.222918+0000","last_undegraded":"2024-09-12T01:12:08.222918+0000","last_fullsized":"2024-09-12T01:12:08.222918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.949344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238347+0000","last_change":"2024-09-12T00:22:02.432403+0000","last_active":"2024-09-12T01:13:33.238347+0000","last_peered":"2024-09-12T01:13:33.238347+0000","last_clean":"2024-09-12T01:13:33.238347+0000","last_became_active":"2024-09-12T00:22:02.431994+0000","last_became_peered":"2024-09-12T00:22:02.431994+0000","last_unstale":"2024-09-12T01:13:33.238347+0000","last_undegraded":"2024-09-12T01:13:33.238347+0000","last_fullsized":"2024-09-12T01:13:33.238347+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.483552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397576+0000","last_change":"2024-09-12T00:21:58.327781+0000","last_active":"2024-09-12T01:12:43.397576+0000","last_peered":"2024-09-12T01:12:43.397576+0000","last_clean":"2024-09-12T01:12:43.397576+0000","last_became_active":"2024-09-12T00:21:58.327504+0000","last_became_peered":"2024-09-12T00:21:58.327504+0000","last_unstale":"2024-09-12T01:12:43.397576+0000","last_undegraded":"2024-09-12T01:12:43.397576+0000","last_fullsized":"2024-09-12T01:12:43.397576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:09.606355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'62","reported_seq":221,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.442193+0000","last_change":"2024-09-12T00:17:58.360373+0000","last_active":"2024-09-12T01:11:08.442193+0000","last_peered":"2024-09-12T01:11:08.442193+0000","last_clean":"2024-09-12T01:11:08.442193+0000","last_became_active":"2024-09-12T00:17:58.360095+0000","last_became_peered":"2024-09-12T00:17:58.360095+0000","last_unstale":"2024-09-12T01:11:08.442193+0000","last_undegraded":"2024-09-12T01:11:08.442193+0000","last_fullsized":"2024-09-12T01:11:08.442193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:39.437158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":213,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392762+0000","last_change":"2024-09-12T00:39:26.639982+0000","last_active":"2024-09-12T01:12:08.392762+0000","last_peered":"2024-09-12T01:12:08.392762+0000","last_clean":"2024-09-12T01:12:08.392762+0000","last_became_active":"2024-09-12T00:39:26.639681+0000","last_became_peered":"2024-09-12T00:39:26.639681+0000","last_unstale":"2024-09-12T01:12:08.392762+0000","last_undegraded":"2024-09-12T01:12:08.392762+0000","last_fullsized":"2024-09-12T01:12:08.392762+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:35.336644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.454200+0000","last_change":"2024-09-12T00:22:02.427581+0000","last_active":"2024-09-12T01:12:48.454200+0000","last_peered":"2024-09-12T01:12:48.454200+0000","last_clean":"2024-09-12T01:12:48.454200+0000","last_became_active":"2024-09-12T00:22:02.427285+0000","last_became_peered":"2024-09-12T00:22:02.427285+0000","last_unstale":"2024-09-12T01:12:48.454200+0000","last_undegraded":"2024-09-12T01:12:48.454200+0000","last_fullsized":"2024-09-12T01:12:48.454200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:22.119778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.227172+0000","last_change":"2024-09-12T00:21:58.335430+0000","last_active":"2024-09-12T01:12:43.227172+0000","last_peered":"2024-09-12T01:12:43.227172+0000","last_clean":"2024-09-12T01:12:43.227172+0000","last_became_active":"2024-09-12T00:21:58.335100+0000","last_became_peered":"2024-09-12T00:21:58.335100+0000","last_unstale":"2024-09-12T01:12:43.227172+0000","last_undegraded":"2024-09-12T01:12:43.227172+0000","last_fullsized":"2024-09-12T01:12:43.227172+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:24.939276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'91","reported_seq":369,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.216774+0000","last_change":"2024-09-12T00:17:58.350821+0000","last_active":"2024-09-12T01:11:08.216774+0000","last_peered":"2024-09-12T01:11:08.216774+0000","last_clean":"2024-09-12T01:11:08.216774+0000","last_became_active":"2024-09-12T00:17:58.350522+0000","last_became_peered":"2024-09-12T00:17:58.350522+0000","last_unstale":"2024-09-12T01:11:08.216774+0000","last_undegraded":"2024-09-12T01:11:08.216774+0000","last_fullsized":"2024-09-12T01:11:08.216774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.821787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":413,"num_write":129,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503487+0000","last_change":"2024-09-12T00:39:26.642765+0000","last_active":"2024-09-12T01:12:08.503487+0000","last_peered":"2024-09-12T01:12:08.503487+0000","last_clean":"2024-09-12T01:12:08.503487+0000","last_became_active":"2024-09-12T00:39:26.642486+0000","last_became_peered":"2024-09-12T00:39:26.642486+0000","last_unstale":"2024-09-12T01:12:08.503487+0000","last_undegraded":"2024-09-12T01:12:08.503487+0000","last_fullsized":"2024-09-12T01:12:08.503487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:37.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396598+0000","last_change":"2024-09-12T00:22:02.418272+0000","last_active":"2024-09-12T01:12:48.396598+0000","last_peered":"2024-09-12T01:12:48.396598+0000","last_clean":"2024-09-12T01:12:48.396598+0000","last_became_active":"2024-09-12T00:22:02.417518+0000","last_became_peered":"2024-09-12T00:22:02.417518+0000","last_unstale":"2024-09-12T01:12:48.396598+0000","last_undegraded":"2024-09-12T01:12:48.396598+0000","last_fullsized":"2024-09-12T01:12:48.396598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.931899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'10","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242751+0000","last_change":"2024-09-12T00:21:58.337365+0000","last_active":"2024-09-12T01:12:45.242751+0000","last_peered":"2024-09-12T01:12:45.242751+0000","last_clean":"2024-09-12T01:12:45.242751+0000","last_became_active":"2024-09-12T00:21:58.337079+0000","last_became_peered":"2024-09-12T00:21:58.337079+0000","last_unstale":"2024-09-12T01:12:45.242751+0000","last_undegraded":"2024-09-12T01:12:45.242751+0000","last_fullsized":"2024-09-12T01:12:45.242751+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.875541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":24618,"num_write":20,"num_write_kb":14376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'26","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390038+0000","last_change":"2024-09-12T00:17:58.360573+0000","last_active":"2024-09-12T01:11:48.390038+0000","last_peered":"2024-09-12T01:11:48.390038+0000","last_clean":"2024-09-12T01:11:48.390038+0000","last_became_active":"2024-09-12T00:17:58.360141+0000","last_became_peered":"2024-09-12T00:17:58.360141+0000","last_unstale":"2024-09-12T01:11:48.390038+0000","last_undegraded":"2024-09-12T01:11:48.390038+0000","last_fullsized":"2024-09-12T01:11:48.390038+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.883700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236768+0000","last_change":"2024-09-12T00:39:26.636792+0000","last_active":"2024-09-12T01:13:18.236768+0000","last_peered":"2024-09-12T01:13:18.236768+0000","last_clean":"2024-09-12T01:13:18.236768+0000","last_became_active":"2024-09-12T00:39:26.636434+0000","last_became_peered":"2024-09-12T00:39:26.636434+0000","last_unstale":"2024-09-12T01:13:18.236768+0000","last_undegraded":"2024-09-12T01:13:18.236768+0000","last_fullsized":"2024-09-12T01:13:18.236768+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:17.120295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256725+0000","last_change":"2024-09-12T00:22:02.420813+0000","last_active":"2024-09-12T01:15:43.256725+0000","last_peered":"2024-09-12T01:15:43.256725+0000","last_clean":"2024-09-12T01:15:43.256725+0000","last_became_active":"2024-09-12T00:22:02.420528+0000","last_became_peered":"2024-09-12T00:22:02.420528+0000","last_unstale":"2024-09-12T01:15:43.256725+0000","last_undegraded":"2024-09-12T01:15:43.256725+0000","last_fullsized":"2024-09-12T01:15:43.256725+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:36.557751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:38.274384+0000","last_change":"2024-09-12T00:21:58.337490+0000","last_active":"2024-09-12T01:15:38.274384+0000","last_peered":"2024-09-12T01:15:38.274384+0000","last_clean":"2024-09-12T01:15:38.274384+0000","last_became_active":"2024-09-12T00:21:58.337215+0000","last_became_peered":"2024-09-12T00:21:58.337215+0000","last_unstale":"2024-09-12T01:15:38.274384+0000","last_undegraded":"2024-09-12T01:15:38.274384+0000","last_fullsized":"2024-09-12T01:15:38.274384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.089070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.388739+0000","last_change":"2024-09-12T00:17:58.360965+0000","last_active":"2024-09-12T01:11:38.388739+0000","last_peered":"2024-09-12T01:11:38.388739+0000","last_clean":"2024-09-12T01:11:38.388739+0000","last_became_active":"2024-09-12T00:17:58.360592+0000","last_became_peered":"2024-09-12T00:17:58.360592+0000","last_unstale":"2024-09-12T01:11:38.388739+0000","last_undegraded":"2024-09-12T01:11:38.388739+0000","last_fullsized":"2024-09-12T01:11:38.388739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:45.213272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.247005+0000","last_change":"2024-09-12T00:39:26.641706+0000","last_active":"2024-09-12T01:13:20.247005+0000","last_peered":"2024-09-12T01:13:20.247005+0000","last_clean":"2024-09-12T01:13:20.247005+0000","last_became_active":"2024-09-12T00:39:26.641432+0000","last_became_peered":"2024-09-12T00:39:26.641432+0000","last_unstale":"2024-09-12T01:13:20.247005+0000","last_undegraded":"2024-09-12T01:13:20.247005+0000","last_fullsized":"2024-09-12T01:13:20.247005+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.345745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.239133+0000","last_change":"2024-09-12T00:22:02.423461+0000","last_active":"2024-09-12T01:13:23.239133+0000","last_peered":"2024-09-12T01:13:23.239133+0000","last_clean":"2024-09-12T01:13:23.239133+0000","last_became_active":"2024-09-12T00:22:02.423012+0000","last_became_peered":"2024-09-12T00:22:02.423012+0000","last_unstale":"2024-09-12T01:13:23.239133+0000","last_undegraded":"2024-09-12T01:13:23.239133+0000","last_fullsized":"2024-09-12T01:13:23.239133+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:14.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236682+0000","last_change":"2024-09-12T00:21:58.334875+0000","last_active":"2024-09-12T01:13:18.236682+0000","last_peered":"2024-09-12T01:13:18.236682+0000","last_clean":"2024-09-12T01:13:18.236682+0000","last_became_active":"2024-09-12T00:21:58.334493+0000","last_became_peered":"2024-09-12T00:21:58.334493+0000","last_unstale":"2024-09-12T01:13:18.236682+0000","last_undegraded":"2024-09-12T01:13:18.236682+0000","last_fullsized":"2024-09-12T01:13:18.236682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:46.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'39","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235549+0000","last_change":"2024-09-12T00:17:58.355241+0000","last_active":"2024-09-12T01:11:40.235549+0000","last_peered":"2024-09-12T01:11:40.235549+0000","last_clean":"2024-09-12T01:11:40.235549+0000","last_became_active":"2024-09-12T00:17:58.354989+0000","last_became_peered":"2024-09-12T00:17:58.354989+0000","last_unstale":"2024-09-12T01:11:40.235549+0000","last_undegraded":"2024-09-12T01:11:40.235549+0000","last_fullsized":"2024-09-12T01:11:40.235549+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:24.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":70,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240008+0000","last_change":"2024-09-12T00:39:26.630455+0000","last_active":"2024-09-12T01:12:20.240008+0000","last_peered":"2024-09-12T01:12:20.240008+0000","last_clean":"2024-09-12T01:12:20.240008+0000","last_became_active":"2024-09-12T00:39:26.627899+0000","last_became_peered":"2024-09-12T00:39:26.627899+0000","last_unstale":"2024-09-12T01:12:20.240008+0000","last_undegraded":"2024-09-12T01:12:20.240008+0000","last_fullsized":"2024-09-12T01:12:20.240008+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:19.704293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256860+0000","last_change":"2024-09-12T00:22:02.428036+0000","last_active":"2024-09-12T01:15:43.256860+0000","last_peered":"2024-09-12T01:15:43.256860+0000","last_clean":"2024-09-12T01:15:43.256860+0000","last_became_active":"2024-09-12T00:22:02.427322+0000","last_became_peered":"2024-09-12T00:22:02.427322+0000","last_unstale":"2024-09-12T01:15:43.256860+0000","last_undegraded":"2024-09-12T01:15:43.256860+0000","last_fullsized":"2024-09-12T01:15:43.256860+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:40.144405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618639+0000","last_change":"2024-09-12T00:21:58.329454+0000","last_active":"2024-09-12T01:13:18.618639+0000","last_peered":"2024-09-12T01:13:18.618639+0000","last_clean":"2024-09-12T01:13:18.618639+0000","last_became_active":"2024-09-12T00:21:58.329166+0000","last_became_peered":"2024-09-12T00:21:58.329166+0000","last_unstale":"2024-09-12T01:13:18.618639+0000","last_undegraded":"2024-09-12T01:13:18.618639+0000","last_fullsized":"2024-09-12T01:13:18.618639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:00.444000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'42","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386895+0000","last_change":"2024-09-12T00:17:58.355842+0000","last_active":"2024-09-12T01:11:38.386895+0000","last_peered":"2024-09-12T01:11:38.386895+0000","last_clean":"2024-09-12T01:11:38.386895+0000","last_became_active":"2024-09-12T00:17:58.355530+0000","last_became_peered":"2024-09-12T00:17:58.355530+0000","last_unstale":"2024-09-12T01:11:38.386895+0000","last_undegraded":"2024-09-12T01:11:38.386895+0000","last_fullsized":"2024-09-12T01:11:38.386895+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:00.979655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":155,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236747+0000","last_change":"2024-09-12T00:39:26.636645+0000","last_active":"2024-09-12T01:13:18.236747+0000","last_peered":"2024-09-12T01:13:18.236747+0000","last_clean":"2024-09-12T01:13:18.236747+0000","last_became_active":"2024-09-12T00:39:26.635996+0000","last_became_peered":"2024-09-12T00:39:26.635996+0000","last_unstale":"2024-09-12T01:13:18.236747+0000","last_undegraded":"2024-09-12T01:13:18.236747+0000","last_fullsized":"2024-09-12T01:13:18.236747+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:54.401173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.619395+0000","last_change":"2024-09-12T00:22:02.424107+0000","last_active":"2024-09-12T01:13:23.619395+0000","last_peered":"2024-09-12T01:13:23.619395+0000","last_clean":"2024-09-12T01:13:23.619395+0000","last_became_active":"2024-09-12T00:22:02.423766+0000","last_became_peered":"2024-09-12T00:22:02.423766+0000","last_unstale":"2024-09-12T01:13:23.619395+0000","last_undegraded":"2024-09-12T01:13:23.619395+0000","last_fullsized":"2024-09-12T01:13:23.619395+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:45.304079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.514151+0000","last_change":"2024-09-12T00:21:58.334763+0000","last_active":"2024-09-12T01:13:18.514151+0000","last_peered":"2024-09-12T01:13:18.514151+0000","last_clean":"2024-09-12T01:13:18.514151+0000","last_became_active":"2024-09-12T00:21:58.334482+0000","last_became_peered":"2024-09-12T00:21:58.334482+0000","last_unstale":"2024-09-12T01:13:18.514151+0000","last_undegraded":"2024-09-12T01:13:18.514151+0000","last_fullsized":"2024-09-12T01:13:18.514151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.615431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'8","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.445588+0000","last_change":"2024-09-12T00:17:58.357504+0000","last_active":"2024-09-12T01:11:38.445588+0000","last_peered":"2024-09-12T01:11:38.445588+0000","last_clean":"2024-09-12T01:11:38.445588+0000","last_became_active":"2024-09-12T00:17:58.357226+0000","last_became_peered":"2024-09-12T00:17:58.357226+0000","last_unstale":"2024-09-12T01:11:38.445588+0000","last_undegraded":"2024-09-12T01:11:38.445588+0000","last_fullsized":"2024-09-12T01:11:38.445588+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.150821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222890+0000","last_change":"2024-09-12T00:39:26.638504+0000","last_active":"2024-09-12T01:12:08.222890+0000","last_peered":"2024-09-12T01:12:08.222890+0000","last_clean":"2024-09-12T01:12:08.222890+0000","last_became_active":"2024-09-12T00:39:26.638202+0000","last_became_peered":"2024-09-12T00:39:26.638202+0000","last_unstale":"2024-09-12T01:12:08.222890+0000","last_undegraded":"2024-09-12T01:12:08.222890+0000","last_fullsized":"2024-09-12T01:12:08.222890+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:29.584845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.445007+0000","last_change":"2024-09-12T00:22:02.428671+0000","last_active":"2024-09-12T01:11:33.445007+0000","last_peered":"2024-09-12T01:11:33.445007+0000","last_clean":"2024-09-12T01:11:33.445007+0000","last_became_active":"2024-09-12T00:22:02.427762+0000","last_became_peered":"2024-09-12T00:22:02.427762+0000","last_unstale":"2024-09-12T01:11:33.445007+0000","last_undegraded":"2024-09-12T01:11:33.445007+0000","last_fullsized":"2024-09-12T01:11:33.445007+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:44.251003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"267'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010703+0000","last_change":"2024-09-12T00:21:58.338414+0000","last_active":"2024-09-12T01:15:48.010703+0000","last_peered":"2024-09-12T01:15:48.010703+0000","last_clean":"2024-09-12T01:15:48.010703+0000","last_became_active":"2024-09-12T00:21:58.338104+0000","last_became_peered":"2024-09-12T00:21:58.338104+0000","last_unstale":"2024-09-12T01:15:48.010703+0000","last_undegraded":"2024-09-12T01:15:48.010703+0000","last_fullsized":"2024-09-12T01:15:48.010703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:51.139680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10244,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'33","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.448982+0000","last_change":"2024-09-12T00:17:58.352171+0000","last_active":"2024-09-12T01:12:03.448982+0000","last_peered":"2024-09-12T01:12:03.448982+0000","last_clean":"2024-09-12T01:12:03.448982+0000","last_became_active":"2024-09-12T00:17:58.351876+0000","last_became_peered":"2024-09-12T00:17:58.351876+0000","last_unstale":"2024-09-12T01:12:03.448982+0000","last_undegraded":"2024-09-12T01:12:03.448982+0000","last_fullsized":"2024-09-12T01:12:03.448982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.992607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":110,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401591+0000","last_change":"2024-09-12T00:39:26.640188+0000","last_active":"2024-09-12T01:13:13.401591+0000","last_peered":"2024-09-12T01:13:13.401591+0000","last_clean":"2024-09-12T01:13:13.401591+0000","last_became_active":"2024-09-12T00:39:26.639704+0000","last_became_peered":"2024-09-12T00:39:26.639704+0000","last_unstale":"2024-09-12T01:13:13.401591+0000","last_undegraded":"2024-09-12T01:13:13.401591+0000","last_fullsized":"2024-09-12T01:13:13.401591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.680724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'6","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.009468+0000","last_change":"2024-09-12T00:22:02.430308+0000","last_active":"2024-09-12T01:15:48.009468+0000","last_peered":"2024-09-12T01:15:48.009468+0000","last_clean":"2024-09-12T01:15:48.009468+0000","last_became_active":"2024-09-12T00:22:02.430034+0000","last_became_peered":"2024-09-12T00:22:02.430034+0000","last_unstale":"2024-09-12T01:15:48.009468+0000","last_undegraded":"2024-09-12T01:15:48.009468+0000","last_fullsized":"2024-09-12T01:15:48.009468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.194625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'4","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.233384+0000","last_change":"2024-09-12T00:21:58.333427+0000","last_active":"2024-09-12T01:13:43.233384+0000","last_peered":"2024-09-12T01:13:43.233384+0000","last_clean":"2024-09-12T01:13:43.233384+0000","last_became_active":"2024-09-12T00:21:58.333135+0000","last_became_peered":"2024-09-12T00:21:58.333135+0000","last_unstale":"2024-09-12T01:13:43.233384+0000","last_undegraded":"2024-09-12T01:13:43.233384+0000","last_fullsized":"2024-09-12T01:13:43.233384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:11.164534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'34","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502186+0000","last_change":"2024-09-12T00:17:58.360392+0000","last_active":"2024-09-12T01:11:58.502186+0000","last_peered":"2024-09-12T01:11:58.502186+0000","last_clean":"2024-09-12T01:11:58.502186+0000","last_became_active":"2024-09-12T00:17:58.360064+0000","last_became_peered":"2024-09-12T00:17:58.360064+0000","last_unstale":"2024-09-12T01:11:58.502186+0000","last_undegraded":"2024-09-12T01:11:58.502186+0000","last_fullsized":"2024-09-12T01:11:58.502186+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:06.356739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":114,"num_write":67,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607743+0000","last_change":"2024-09-12T00:39:26.620334+0000","last_active":"2024-09-12T01:11:58.607743+0000","last_peered":"2024-09-12T01:11:58.607743+0000","last_clean":"2024-09-12T01:11:58.607743+0000","last_became_active":"2024-09-12T00:39:26.620012+0000","last_became_peered":"2024-09-12T00:39:26.620012+0000","last_unstale":"2024-09-12T01:11:58.607743+0000","last_undegraded":"2024-09-12T01:11:58.607743+0000","last_fullsized":"2024-09-12T01:11:58.607743+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.575760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.228663+0000","last_change":"2024-09-12T00:22:02.420815+0000","last_active":"2024-09-12T01:11:48.228663+0000","last_peered":"2024-09-12T01:11:48.228663+0000","last_clean":"2024-09-12T01:11:48.228663+0000","last_became_active":"2024-09-12T00:22:02.420536+0000","last_became_peered":"2024-09-12T00:22:02.420536+0000","last_unstale":"2024-09-12T01:11:48.228663+0000","last_undegraded":"2024-09-12T01:11:48.228663+0000","last_fullsized":"2024-09-12T01:11:48.228663+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:29.069188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.234276+0000","last_change":"2024-09-12T00:21:58.339677+0000","last_active":"2024-09-12T01:11:30.234276+0000","last_peered":"2024-09-12T01:11:30.234276+0000","last_clean":"2024-09-12T01:11:30.234276+0000","last_became_active":"2024-09-12T00:21:58.339390+0000","last_became_peered":"2024-09-12T00:21:58.339390+0000","last_unstale":"2024-09-12T01:11:30.234276+0000","last_undegraded":"2024-09-12T01:11:30.234276+0000","last_fullsized":"2024-09-12T01:11:30.234276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:52.122856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'22","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607816+0000","last_change":"2024-09-12T00:17:58.355891+0000","last_active":"2024-09-12T01:11:58.607816+0000","last_peered":"2024-09-12T01:11:58.607816+0000","last_clean":"2024-09-12T01:11:58.607816+0000","last_became_active":"2024-09-12T00:17:58.355602+0000","last_became_peered":"2024-09-12T00:17:58.355602+0000","last_unstale":"2024-09-12T01:11:58.607816+0000","last_undegraded":"2024-09-12T01:11:58.607816+0000","last_fullsized":"2024-09-12T01:11:58.607816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:26.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391317+0000","last_change":"2024-09-12T00:39:26.644546+0000","last_active":"2024-09-12T01:11:58.391317+0000","last_peered":"2024-09-12T01:11:58.391317+0000","last_clean":"2024-09-12T01:11:58.391317+0000","last_became_active":"2024-09-12T00:39:26.644190+0000","last_became_peered":"2024-09-12T00:39:26.644190+0000","last_unstale":"2024-09-12T01:11:58.391317+0000","last_undegraded":"2024-09-12T01:11:58.391317+0000","last_fullsized":"2024-09-12T01:11:58.391317+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:28.896406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.240192+0000","last_change":"2024-09-12T00:22:02.429622+0000","last_active":"2024-09-12T01:13:48.240192+0000","last_peered":"2024-09-12T01:13:48.240192+0000","last_clean":"2024-09-12T01:13:48.240192+0000","last_became_active":"2024-09-12T00:22:02.429289+0000","last_became_peered":"2024-09-12T00:22:02.429289+0000","last_unstale":"2024-09-12T01:13:48.240192+0000","last_undegraded":"2024-09-12T01:13:48.240192+0000","last_fullsized":"2024-09-12T01:13:48.240192+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:57.498730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.228080+0000","last_change":"2024-09-12T00:21:58.334628+0000","last_active":"2024-09-12T01:11:43.228080+0000","last_peered":"2024-09-12T01:11:43.228080+0000","last_clean":"2024-09-12T01:11:43.228080+0000","last_became_active":"2024-09-12T00:21:58.334362+0000","last_became_peered":"2024-09-12T00:21:58.334362+0000","last_unstale":"2024-09-12T01:11:43.228080+0000","last_undegraded":"2024-09-12T01:11:43.228080+0000","last_fullsized":"2024-09-12T01:11:43.228080+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:03.057103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'50","reported_seq":198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221741+0000","last_change":"2024-09-12T00:17:58.353550+0000","last_active":"2024-09-12T01:11:58.221741+0000","last_peered":"2024-09-12T01:11:58.221741+0000","last_clean":"2024-09-12T01:11:58.221741+0000","last_became_active":"2024-09-12T00:17:58.353253+0000","last_became_peered":"2024-09-12T00:17:58.353253+0000","last_unstale":"2024-09-12T01:11:58.221741+0000","last_undegraded":"2024-09-12T01:11:58.221741+0000","last_fullsized":"2024-09-12T01:11:58.221741+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":79,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.457321+0000","last_change":"2024-09-12T00:39:26.636163+0000","last_active":"2024-09-12T01:13:13.457321+0000","last_peered":"2024-09-12T01:13:13.457321+0000","last_clean":"2024-09-12T01:13:13.457321+0000","last_became_active":"2024-09-12T00:39:26.633295+0000","last_became_peered":"2024-09-12T00:39:26.633295+0000","last_unstale":"2024-09-12T01:13:13.457321+0000","last_undegraded":"2024-09-12T01:13:13.457321+0000","last_fullsized":"2024-09-12T01:13:13.457321+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:58.692850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.389134+0000","last_change":"2024-09-12T00:22:02.429406+0000","last_active":"2024-09-12T01:11:53.389134+0000","last_peered":"2024-09-12T01:11:53.389134+0000","last_clean":"2024-09-12T01:11:53.389134+0000","last_became_active":"2024-09-12T00:22:02.429088+0000","last_became_peered":"2024-09-12T00:22:02.429088+0000","last_unstale":"2024-09-12T01:11:53.389134+0000","last_undegraded":"2024-09-12T01:11:53.389134+0000","last_fullsized":"2024-09-12T01:11:53.389134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:06.418067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.236622+0000","last_change":"2024-09-12T00:21:58.338881+0000","last_active":"2024-09-12T01:11:50.236622+0000","last_peered":"2024-09-12T01:11:50.236622+0000","last_clean":"2024-09-12T01:11:50.236622+0000","last_became_active":"2024-09-12T00:21:58.338592+0000","last_became_peered":"2024-09-12T00:21:58.338592+0000","last_unstale":"2024-09-12T01:11:50.236622+0000","last_undegraded":"2024-09-12T01:11:50.236622+0000","last_fullsized":"2024-09-12T01:11:50.236622+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:24.783440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'20","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237791+0000","last_change":"2024-09-12T00:17:58.357513+0000","last_active":"2024-09-12T01:12:00.237791+0000","last_peered":"2024-09-12T01:12:00.237791+0000","last_clean":"2024-09-12T01:12:00.237791+0000","last_became_active":"2024-09-12T00:17:58.357219+0000","last_became_peered":"2024-09-12T00:17:58.357219+0000","last_unstale":"2024-09-12T01:12:00.237791+0000","last_undegraded":"2024-09-12T01:12:00.237791+0000","last_fullsized":"2024-09-12T01:12:00.237791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:44.097143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":69,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.402289+0000","last_change":"2024-09-12T00:39:26.643775+0000","last_active":"2024-09-12T01:13:18.402289+0000","last_peered":"2024-09-12T01:13:18.402289+0000","last_clean":"2024-09-12T01:13:18.402289+0000","last_became_active":"2024-09-12T00:39:26.643469+0000","last_became_peered":"2024-09-12T00:39:26.643469+0000","last_unstale":"2024-09-12T01:13:18.402289+0000","last_undegraded":"2024-09-12T01:13:18.402289+0000","last_fullsized":"2024-09-12T01:13:18.402289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:16.398681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390670+0000","last_change":"2024-09-12T00:22:02.422788+0000","last_active":"2024-09-12T01:11:53.390670+0000","last_peered":"2024-09-12T01:11:53.390670+0000","last_clean":"2024-09-12T01:11:53.390670+0000","last_became_active":"2024-09-12T00:22:02.422532+0000","last_became_peered":"2024-09-12T00:22:02.422532+0000","last_unstale":"2024-09-12T01:11:53.390670+0000","last_undegraded":"2024-09-12T01:11:53.390670+0000","last_fullsized":"2024-09-12T01:11:53.390670+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.940961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.242873+0000","last_change":"2024-09-12T00:21:58.333014+0000","last_active":"2024-09-12T01:13:58.242873+0000","last_peered":"2024-09-12T01:13:58.242873+0000","last_clean":"2024-09-12T01:13:58.242873+0000","last_became_active":"2024-09-12T00:21:58.332715+0000","last_became_peered":"2024-09-12T00:21:58.332715+0000","last_unstale":"2024-09-12T01:13:58.242873+0000","last_undegraded":"2024-09-12T01:13:58.242873+0000","last_fullsized":"2024-09-12T01:13:58.242873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.043720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'12","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394261+0000","last_change":"2024-09-12T00:17:58.348284+0000","last_active":"2024-09-12T01:12:18.394261+0000","last_peered":"2024-09-12T01:12:18.394261+0000","last_clean":"2024-09-12T01:12:18.394261+0000","last_became_active":"2024-09-12T00:17:58.347709+0000","last_became_peered":"2024-09-12T00:17:58.347709+0000","last_unstale":"2024-09-12T01:12:18.394261+0000","last_undegraded":"2024-09-12T01:12:18.394261+0000","last_fullsized":"2024-09-12T01:12:18.394261+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:50.010174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401624+0000","last_change":"2024-09-12T00:39:26.639353+0000","last_active":"2024-09-12T01:13:13.401624+0000","last_peered":"2024-09-12T01:13:13.401624+0000","last_clean":"2024-09-12T01:13:13.401624+0000","last_became_active":"2024-09-12T00:39:26.639094+0000","last_became_peered":"2024-09-12T00:39:26.639094+0000","last_unstale":"2024-09-12T01:13:13.401624+0000","last_undegraded":"2024-09-12T01:13:13.401624+0000","last_fullsized":"2024-09-12T01:13:13.401624+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.226749+0000","last_change":"2024-09-12T00:22:02.423237+0000","last_active":"2024-09-12T01:11:33.226749+0000","last_peered":"2024-09-12T01:11:33.226749+0000","last_clean":"2024-09-12T01:11:33.226749+0000","last_became_active":"2024-09-12T00:22:02.422922+0000","last_became_peered":"2024-09-12T00:22:02.422922+0000","last_unstale":"2024-09-12T01:11:33.226749+0000","last_undegraded":"2024-09-12T01:11:33.226749+0000","last_fullsized":"2024-09-12T01:11:33.226749+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:06.357213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238314+0000","last_change":"2024-09-12T00:21:58.341237+0000","last_active":"2024-09-12T01:12:05.238314+0000","last_peered":"2024-09-12T01:12:05.238314+0000","last_clean":"2024-09-12T01:12:05.238314+0000","last_became_active":"2024-09-12T00:21:58.340910+0000","last_became_peered":"2024-09-12T00:21:58.340910+0000","last_unstale":"2024-09-12T01:12:05.238314+0000","last_undegraded":"2024-09-12T01:12:05.238314+0000","last_fullsized":"2024-09-12T01:12:05.238314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:12.245684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'59","reported_seq":219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449466+0000","last_change":"2024-09-12T00:17:58.351895+0000","last_active":"2024-09-12T01:12:08.449466+0000","last_peered":"2024-09-12T01:12:08.449466+0000","last_clean":"2024-09-12T01:12:08.449466+0000","last_became_active":"2024-09-12T00:17:58.351362+0000","last_became_peered":"2024-09-12T00:17:58.351362+0000","last_unstale":"2024-09-12T01:12:08.449466+0000","last_undegraded":"2024-09-12T01:12:08.449466+0000","last_fullsized":"2024-09-12T01:12:08.449466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.054114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":214,"num_write":104,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:15.246472+0000","last_change":"2024-09-12T00:39:26.631761+0000","last_active":"2024-09-12T01:13:15.246472+0000","last_peered":"2024-09-12T01:13:15.246472+0000","last_clean":"2024-09-12T01:13:15.246472+0000","last_became_active":"2024-09-12T00:39:26.631491+0000","last_became_peered":"2024-09-12T00:39:26.631491+0000","last_unstale":"2024-09-12T01:13:15.246472+0000","last_undegraded":"2024-09-12T01:13:15.246472+0000","last_fullsized":"2024-09-12T01:13:15.246472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:37.091629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'3","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.410353+0000","last_change":"2024-09-12T00:22:02.430547+0000","last_active":"2024-09-12T01:14:13.410353+0000","last_peered":"2024-09-12T01:14:13.410353+0000","last_clean":"2024-09-12T01:14:13.410353+0000","last_became_active":"2024-09-12T00:22:02.430209+0000","last_became_peered":"2024-09-12T00:22:02.430209+0000","last_unstale":"2024-09-12T01:14:13.410353+0000","last_undegraded":"2024-09-12T01:14:13.410353+0000","last_fullsized":"2024-09-12T01:14:13.410353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:01.694638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.385332+0000","last_change":"2024-09-12T00:21:58.339483+0000","last_active":"2024-09-12T01:11:28.385332+0000","last_peered":"2024-09-12T01:11:28.385332+0000","last_clean":"2024-09-12T01:11:28.385332+0000","last_became_active":"2024-09-12T00:21:58.339248+0000","last_became_peered":"2024-09-12T00:21:58.339248+0000","last_unstale":"2024-09-12T01:11:28.385332+0000","last_undegraded":"2024-09-12T01:11:28.385332+0000","last_fullsized":"2024-09-12T01:11:28.385332+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:13.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'36","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609071+0000","last_change":"2024-09-12T00:17:58.358376+0000","last_active":"2024-09-12T01:12:08.609071+0000","last_peered":"2024-09-12T01:12:08.609071+0000","last_clean":"2024-09-12T01:12:08.609071+0000","last_became_active":"2024-09-12T00:17:58.358022+0000","last_became_peered":"2024-09-12T00:17:58.358022+0000","last_unstale":"2024-09-12T01:12:08.609071+0000","last_undegraded":"2024-09-12T01:12:08.609071+0000","last_fullsized":"2024-09-12T01:12:08.609071+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:18.456203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":54,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398216+0000","last_change":"2024-09-12T00:39:26.645252+0000","last_active":"2024-09-12T01:12:48.398216+0000","last_peered":"2024-09-12T01:12:48.398216+0000","last_clean":"2024-09-12T01:12:48.398216+0000","last_became_active":"2024-09-12T00:39:26.644935+0000","last_became_peered":"2024-09-12T00:39:26.644935+0000","last_unstale":"2024-09-12T01:12:48.398216+0000","last_undegraded":"2024-09-12T01:12:48.398216+0000","last_fullsized":"2024-09-12T01:12:48.398216+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:56.007971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240045+0000","last_change":"2024-09-12T00:22:02.424691+0000","last_active":"2024-09-12T01:12:20.240045+0000","last_peered":"2024-09-12T01:12:20.240045+0000","last_clean":"2024-09-12T01:12:20.240045+0000","last_became_active":"2024-09-12T00:22:02.424116+0000","last_became_peered":"2024-09-12T00:22:02.424116+0000","last_unstale":"2024-09-12T01:12:20.240045+0000","last_undegraded":"2024-09-12T01:12:20.240045+0000","last_fullsized":"2024-09-12T01:12:20.240045+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.947612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'6","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408732+0000","last_change":"2024-09-12T00:21:58.332119+0000","last_active":"2024-09-12T01:14:03.408732+0000","last_peered":"2024-09-12T01:14:03.408732+0000","last_clean":"2024-09-12T01:14:03.408732+0000","last_became_active":"2024-09-12T00:21:58.331839+0000","last_became_peered":"2024-09-12T00:21:58.331839+0000","last_unstale":"2024-09-12T01:14:03.408732+0000","last_undegraded":"2024-09-12T01:14:03.408732+0000","last_fullsized":"2024-09-12T01:14:03.408732+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:22.439701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238960+0000","last_change":"2024-09-12T00:17:58.354881+0000","last_active":"2024-09-12T01:12:10.238960+0000","last_peered":"2024-09-12T01:12:10.238960+0000","last_clean":"2024-09-12T01:12:10.238960+0000","last_became_active":"2024-09-12T00:17:58.354568+0000","last_became_peered":"2024-09-12T00:17:58.354568+0000","last_unstale":"2024-09-12T01:12:10.238960+0000","last_undegraded":"2024-09-12T01:12:10.238960+0000","last_fullsized":"2024-09-12T01:12:10.238960+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:54.500434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.509385+0000","last_change":"2024-09-12T00:39:26.640912+0000","last_active":"2024-09-12T01:12:48.509385+0000","last_peered":"2024-09-12T01:12:48.509385+0000","last_clean":"2024-09-12T01:12:48.509385+0000","last_became_active":"2024-09-12T00:39:26.635679+0000","last_became_peered":"2024-09-12T00:39:26.635679+0000","last_unstale":"2024-09-12T01:12:48.509385+0000","last_undegraded":"2024-09-12T01:12:48.509385+0000","last_fullsized":"2024-09-12T01:12:48.509385+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:19.017813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'11","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238367+0000","last_change":"2024-09-12T00:22:02.420520+0000","last_active":"2024-09-12T01:12:05.238367+0000","last_peered":"2024-09-12T01:12:05.238367+0000","last_clean":"2024-09-12T01:12:05.238367+0000","last_became_active":"2024-09-12T00:22:02.420246+0000","last_became_peered":"2024-09-12T00:22:02.420246+0000","last_unstale":"2024-09-12T01:12:05.238367+0000","last_undegraded":"2024-09-12T01:12:05.238367+0000","last_fullsized":"2024-09-12T01:12:05.238367+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:31.472875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":23552,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.236313+0000","last_change":"2024-09-12T00:21:58.332641+0000","last_active":"2024-09-12T01:14:13.236313+0000","last_peered":"2024-09-12T01:14:13.236313+0000","last_clean":"2024-09-12T01:14:13.236313+0000","last_became_active":"2024-09-12T00:21:58.332362+0000","last_became_peered":"2024-09-12T00:21:58.332362+0000","last_unstale":"2024-09-12T01:14:13.236313+0000","last_undegraded":"2024-09-12T01:14:13.236313+0000","last_fullsized":"2024-09-12T01:14:13.236313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:38.121091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'54","reported_seq":199,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609180+0000","last_change":"2024-09-12T00:17:58.356444+0000","last_active":"2024-09-12T01:12:08.609180+0000","last_peered":"2024-09-12T01:12:08.609180+0000","last_clean":"2024-09-12T01:12:08.609180+0000","last_became_active":"2024-09-12T00:17:58.356120+0000","last_became_peered":"2024-09-12T00:17:58.356120+0000","last_unstale":"2024-09-12T01:12:08.609180+0000","last_undegraded":"2024-09-12T01:12:08.609180+0000","last_fullsized":"2024-09-12T01:12:08.609180+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:56.553542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":175,"num_write":100,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.240729+0000","last_change":"2024-09-12T00:39:26.625293+0000","last_active":"2024-09-12T01:13:38.240729+0000","last_peered":"2024-09-12T01:13:38.240729+0000","last_clean":"2024-09-12T01:13:38.240729+0000","last_became_active":"2024-09-12T00:39:26.624994+0000","last_became_peered":"2024-09-12T00:39:26.624994+0000","last_unstale":"2024-09-12T01:13:38.240729+0000","last_undegraded":"2024-09-12T01:13:38.240729+0000","last_fullsized":"2024-09-12T01:13:38.240729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:56.114504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390791+0000","last_change":"2024-09-12T00:22:02.424780+0000","last_active":"2024-09-12T01:11:53.390791+0000","last_peered":"2024-09-12T01:11:53.390791+0000","last_clean":"2024-09-12T01:11:53.390791+0000","last_became_active":"2024-09-12T00:22:02.424412+0000","last_became_peered":"2024-09-12T00:22:02.424412+0000","last_unstale":"2024-09-12T01:11:53.390791+0000","last_undegraded":"2024-09-12T01:11:53.390791+0000","last_fullsized":"2024-09-12T01:11:53.390791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.074060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.500730+0000","last_change":"2024-09-12T00:21:58.334861+0000","last_active":"2024-09-12T01:11:48.500730+0000","last_peered":"2024-09-12T01:11:48.500730+0000","last_clean":"2024-09-12T01:11:48.500730+0000","last_became_active":"2024-09-12T00:21:58.334536+0000","last_became_peered":"2024-09-12T00:21:58.334536+0000","last_unstale":"2024-09-12T01:11:48.500730+0000","last_undegraded":"2024-09-12T01:11:48.500730+0000","last_fullsized":"2024-09-12T01:11:48.500730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:39.419871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394307+0000","last_change":"2024-09-12T00:17:58.353484+0000","last_active":"2024-09-12T01:12:18.394307+0000","last_peered":"2024-09-12T01:12:18.394307+0000","last_clean":"2024-09-12T01:12:18.394307+0000","last_became_active":"2024-09-12T00:17:58.353219+0000","last_became_peered":"2024-09-12T00:17:58.353219+0000","last_unstale":"2024-09-12T01:12:18.394307+0000","last_undegraded":"2024-09-12T01:12:18.394307+0000","last_fullsized":"2024-09-12T01:12:18.394307+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:54.015109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":151,"num_write":85,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396509+0000","last_change":"2024-09-12T00:39:26.638305+0000","last_active":"2024-09-12T01:12:48.396509+0000","last_peered":"2024-09-12T01:12:48.396509+0000","last_clean":"2024-09-12T01:12:48.396509+0000","last_became_active":"2024-09-12T00:39:26.638008+0000","last_became_peered":"2024-09-12T00:39:26.638008+0000","last_unstale":"2024-09-12T01:12:48.396509+0000","last_undegraded":"2024-09-12T01:12:48.396509+0000","last_fullsized":"2024-09-12T01:12:48.396509+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:10.696670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'3","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.260835+0000","last_change":"2024-09-12T00:22:02.419773+0000","last_active":"2024-09-12T01:14:03.260835+0000","last_peered":"2024-09-12T01:14:03.260835+0000","last_clean":"2024-09-12T01:14:03.260835+0000","last_became_active":"2024-09-12T00:22:02.419443+0000","last_became_peered":"2024-09-12T00:22:02.419443+0000","last_unstale":"2024-09-12T01:14:03.260835+0000","last_undegraded":"2024-09-12T01:14:03.260835+0000","last_fullsized":"2024-09-12T01:14:03.260835+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:01.383190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390111+0000","last_change":"2024-09-12T00:21:58.335735+0000","last_active":"2024-09-12T01:11:48.390111+0000","last_peered":"2024-09-12T01:11:48.390111+0000","last_clean":"2024-09-12T01:11:48.390111+0000","last_became_active":"2024-09-12T00:21:58.335360+0000","last_became_peered":"2024-09-12T00:21:58.335360+0000","last_unstale":"2024-09-12T01:11:48.390111+0000","last_undegraded":"2024-09-12T01:11:48.390111+0000","last_fullsized":"2024-09-12T01:11:48.390111+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:46.236982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'110","reported_seq":429,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230801+0000","last_change":"2024-09-12T00:17:58.356038+0000","last_active":"2024-09-12T01:12:08.230801+0000","last_peered":"2024-09-12T01:12:08.230801+0000","last_clean":"2024-09-12T01:12:08.230801+0000","last_became_active":"2024-09-12T00:17:58.355688+0000","last_became_peered":"2024-09-12T00:17:58.355688+0000","last_unstale":"2024-09-12T01:12:08.230801+0000","last_undegraded":"2024-09-12T01:12:08.230801+0000","last_fullsized":"2024-09-12T01:12:08.230801+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:17.662520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":717,"num_read_kb":507,"num_write":143,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221804+0000","last_change":"2024-09-12T00:39:26.637811+0000","last_active":"2024-09-12T01:11:58.221804+0000","last_peered":"2024-09-12T01:11:58.221804+0000","last_clean":"2024-09-12T01:11:58.221804+0000","last_became_active":"2024-09-12T00:39:26.637393+0000","last_became_peered":"2024-09-12T00:39:26.637393+0000","last_unstale":"2024-09-12T01:11:58.221804+0000","last_undegraded":"2024-09-12T01:11:58.221804+0000","last_fullsized":"2024-09-12T01:11:58.221804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:54.616369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.230233+0000","last_change":"2024-09-12T00:22:02.423927+0000","last_active":"2024-09-12T01:12:03.230233+0000","last_peered":"2024-09-12T01:12:03.230233+0000","last_clean":"2024-09-12T01:12:03.230233+0000","last_became_active":"2024-09-12T00:22:02.423601+0000","last_became_peered":"2024-09-12T00:22:02.423601+0000","last_unstale":"2024-09-12T01:12:03.230233+0000","last_undegraded":"2024-09-12T01:12:03.230233+0000","last_fullsized":"2024-09-12T01:12:03.230233+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:37.317770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392781+0000","last_change":"2024-09-12T00:21:58.339918+0000","last_active":"2024-09-12T01:12:08.392781+0000","last_peered":"2024-09-12T01:12:08.392781+0000","last_clean":"2024-09-12T01:12:08.392781+0000","last_became_active":"2024-09-12T00:21:58.339625+0000","last_became_peered":"2024-09-12T00:21:58.339625+0000","last_unstale":"2024-09-12T01:12:08.392781+0000","last_undegraded":"2024-09-12T01:12:08.392781+0000","last_fullsized":"2024-09-12T01:12:08.392781+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:55.567062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503535+0000","last_change":"2024-09-12T00:17:58.357264+0000","last_active":"2024-09-12T01:12:08.503535+0000","last_peered":"2024-09-12T01:12:08.503535+0000","last_clean":"2024-09-12T01:12:08.503535+0000","last_became_active":"2024-09-12T00:17:58.356906+0000","last_became_peered":"2024-09-12T00:17:58.356906+0000","last_unstale":"2024-09-12T01:12:08.503535+0000","last_undegraded":"2024-09-12T01:12:08.503535+0000","last_fullsized":"2024-09-12T01:12:08.503535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:35.900823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":164,"num_write":72,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237860+0000","last_change":"2024-09-12T00:39:26.628713+0000","last_active":"2024-09-12T01:12:00.237860+0000","last_peered":"2024-09-12T01:12:00.237860+0000","last_clean":"2024-09-12T01:12:00.237860+0000","last_became_active":"2024-09-12T00:39:26.628244+0000","last_became_peered":"2024-09-12T00:39:26.628244+0000","last_unstale":"2024-09-12T01:12:00.237860+0000","last_undegraded":"2024-09-12T01:12:00.237860+0000","last_fullsized":"2024-09-12T01:12:00.237860+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:04.390305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.521387+0000","last_change":"2024-09-12T00:22:02.417514+0000","last_active":"2024-09-12T01:14:08.521387+0000","last_peered":"2024-09-12T01:14:08.521387+0000","last_clean":"2024-09-12T01:14:08.521387+0000","last_became_active":"2024-09-12T00:22:02.417237+0000","last_became_peered":"2024-09-12T00:22:02.417237+0000","last_unstale":"2024-09-12T01:14:08.521387+0000","last_undegraded":"2024-09-12T01:14:08.521387+0000","last_fullsized":"2024-09-12T01:14:08.521387+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.844465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408682+0000","last_change":"2024-09-12T00:21:58.335825+0000","last_active":"2024-09-12T01:14:03.408682+0000","last_peered":"2024-09-12T01:14:03.408682+0000","last_clean":"2024-09-12T01:14:03.408682+0000","last_became_active":"2024-09-12T00:21:58.335541+0000","last_became_peered":"2024-09-12T00:21:58.335541+0000","last_unstale":"2024-09-12T01:14:03.408682+0000","last_undegraded":"2024-09-12T01:14:03.408682+0000","last_fullsized":"2024-09-12T01:14:03.408682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:13.185076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.391247+0000","last_change":"2024-09-12T00:17:58.349817+0000","last_active":"2024-09-12T01:12:08.391247+0000","last_peered":"2024-09-12T01:12:08.391247+0000","last_clean":"2024-09-12T01:12:08.391247+0000","last_became_active":"2024-09-12T00:17:58.349428+0000","last_became_peered":"2024-09-12T00:17:58.349428+0000","last_unstale":"2024-09-12T01:12:08.391247+0000","last_undegraded":"2024-09-12T01:12:08.391247+0000","last_fullsized":"2024-09-12T01:12:08.391247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:25.884859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":78,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243328+0000","last_change":"2024-09-12T00:39:26.641703+0000","last_active":"2024-09-12T01:12:50.243328+0000","last_peered":"2024-09-12T01:12:50.243328+0000","last_clean":"2024-09-12T01:12:50.243328+0000","last_became_active":"2024-09-12T00:39:26.641360+0000","last_became_peered":"2024-09-12T00:39:26.641360+0000","last_unstale":"2024-09-12T01:12:50.243328+0000","last_undegraded":"2024-09-12T01:12:50.243328+0000","last_fullsized":"2024-09-12T01:12:50.243328+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.843665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608437+0000","last_change":"2024-09-12T00:22:02.430353+0000","last_active":"2024-09-12T01:12:03.608437+0000","last_peered":"2024-09-12T01:12:03.608437+0000","last_clean":"2024-09-12T01:12:03.608437+0000","last_became_active":"2024-09-12T00:22:02.430041+0000","last_became_peered":"2024-09-12T00:22:02.430041+0000","last_unstale":"2024-09-12T01:12:03.608437+0000","last_undegraded":"2024-09-12T01:12:03.608437+0000","last_fullsized":"2024-09-12T01:12:03.608437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:01.886573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.243388+0000","last_change":"2024-09-12T00:21:58.327372+0000","last_active":"2024-09-12T01:14:03.243388+0000","last_peered":"2024-09-12T01:14:03.243388+0000","last_clean":"2024-09-12T01:14:03.243388+0000","last_became_active":"2024-09-12T00:21:58.327094+0000","last_became_peered":"2024-09-12T00:21:58.327094+0000","last_unstale":"2024-09-12T01:14:03.243388+0000","last_undegraded":"2024-09-12T01:14:03.243388+0000","last_fullsized":"2024-09-12T01:14:03.243388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.131588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'15","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609100+0000","last_change":"2024-09-12T00:17:58.355203+0000","last_active":"2024-09-12T01:12:08.609100+0000","last_peered":"2024-09-12T01:12:08.609100+0000","last_clean":"2024-09-12T01:12:08.609100+0000","last_became_active":"2024-09-12T00:17:58.354797+0000","last_became_peered":"2024-09-12T00:17:58.354797+0000","last_unstale":"2024-09-12T01:12:08.609100+0000","last_undegraded":"2024-09-12T01:12:08.609100+0000","last_fullsized":"2024-09-12T01:12:08.609100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.618609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399062+0000","last_change":"2024-09-12T00:39:26.641320+0000","last_active":"2024-09-12T01:12:53.399062+0000","last_peered":"2024-09-12T01:12:53.399062+0000","last_clean":"2024-09-12T01:12:53.399062+0000","last_became_active":"2024-09-12T00:39:26.640877+0000","last_became_peered":"2024-09-12T00:39:26.640877+0000","last_unstale":"2024-09-12T01:12:53.399062+0000","last_undegraded":"2024-09-12T01:12:53.399062+0000","last_fullsized":"2024-09-12T01:12:53.399062+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:44.522883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.261478+0000","last_change":"2024-09-12T00:22:02.418887+0000","last_active":"2024-09-12T01:14:08.261478+0000","last_peered":"2024-09-12T01:14:08.261478+0000","last_clean":"2024-09-12T01:14:08.261478+0000","last_became_active":"2024-09-12T00:22:02.418588+0000","last_became_peered":"2024-09-12T00:22:02.418588+0000","last_unstale":"2024-09-12T01:14:08.261478+0000","last_undegraded":"2024-09-12T01:14:08.261478+0000","last_fullsized":"2024-09-12T01:14:08.261478+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:23.078029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'7","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.625107+0000","last_change":"2024-09-12T00:21:58.332292+0000","last_active":"2024-09-12T01:14:03.625107+0000","last_peered":"2024-09-12T01:14:03.625107+0000","last_clean":"2024-09-12T01:14:03.625107+0000","last_became_active":"2024-09-12T00:21:58.331972+0000","last_became_peered":"2024-09-12T00:21:58.331972+0000","last_unstale":"2024-09-12T01:14:03.625107+0000","last_undegraded":"2024-09-12T01:14:03.625107+0000","last_fullsized":"2024-09-12T01:14:03.625107+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:41.270684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'16","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392791+0000","last_change":"2024-09-12T00:17:58.358230+0000","last_active":"2024-09-12T01:12:08.392791+0000","last_peered":"2024-09-12T01:12:08.392791+0000","last_clean":"2024-09-12T01:12:08.392791+0000","last_became_active":"2024-09-12T00:17:58.357689+0000","last_became_peered":"2024-09-12T00:17:58.357689+0000","last_unstale":"2024-09-12T01:12:08.392791+0000","last_undegraded":"2024-09-12T01:12:08.392791+0000","last_fullsized":"2024-09-12T01:12:08.392791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.417538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'204","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041492+0000","last_change":"2024-09-12T00:02:48.051469+0000","last_active":"2024-09-12T01:15:48.041492+0000","last_peered":"2024-09-12T01:15:48.041492+0000","last_clean":"2024-09-12T01:15:48.041492+0000","last_became_active":"2024-09-12T00:02:48.051117+0000","last_became_peered":"2024-09-12T00:02:48.051117+0000","last_unstale":"2024-09-12T01:15:48.041492+0000","last_undegraded":"2024-09-12T01:15:48.041492+0000","last_fullsized":"2024-09-12T01:15:48.041492+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:31.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342064,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":17555,"num_write":999,"num_write_kb":27178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'739","reported_seq":2130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061089+0000","last_change":"2024-09-12T00:02:50.065523+0000","last_active":"2024-09-12T01:13:06.061089+0000","last_peered":"2024-09-12T01:13:06.061089+0000","last_clean":"2024-09-12T01:13:06.061089+0000","last_became_active":"2024-09-12T00:02:50.065257+0000","last_became_peered":"2024-09-12T00:02:50.065257+0000","last_unstale":"2024-09-12T01:13:06.061089+0000","last_undegraded":"2024-09-12T01:13:06.061089+0000","last_fullsized":"2024-09-12T01:13:06.061089+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:22.262738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3376,"num_read_kb":3036,"num_write":968,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'285","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.186886+0000","last_change":"2024-09-12T00:02:48.049346+0000","last_active":"2024-09-12T01:15:48.186886+0000","last_peered":"2024-09-12T01:15:48.186886+0000","last_clean":"2024-09-12T01:15:48.186886+0000","last_became_active":"2024-09-12T00:02:48.049002+0000","last_became_peered":"2024-09-12T00:02:48.049002+0000","last_unstale":"2024-09-12T01:15:48.186886+0000","last_undegraded":"2024-09-12T01:15:48.186886+0000","last_fullsized":"2024-09-12T01:15:48.186886+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:20.073613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":975,"num_read_kb":18236,"num_write":1256,"num_write_kb":26545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'691","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398967+0000","last_change":"2024-09-12T00:02:50.063909+0000","last_active":"2024-09-12T01:12:53.398967+0000","last_peered":"2024-09-12T01:12:53.398967+0000","last_clean":"2024-09-12T01:12:53.398967+0000","last_became_active":"2024-09-12T00:02:50.063612+0000","last_became_peered":"2024-09-12T00:02:50.063612+0000","last_unstale":"2024-09-12T01:12:53.398967+0000","last_undegraded":"2024-09-12T01:12:53.398967+0000","last_fullsized":"2024-09-12T01:12:53.398967+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":600,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:00.810818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3358,"num_read_kb":3023,"num_write":921,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'218","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249550+0000","last_change":"2024-09-12T00:02:48.047754+0000","last_active":"2024-09-12T01:13:40.249550+0000","last_peered":"2024-09-12T01:13:40.249550+0000","last_clean":"2024-09-12T01:13:40.249550+0000","last_became_active":"2024-09-12T00:02:48.045960+0000","last_became_peered":"2024-09-12T00:02:48.045960+0000","last_unstale":"2024-09-12T01:13:40.249550+0000","last_undegraded":"2024-09-12T01:13:40.249550+0000","last_fullsized":"2024-09-12T01:13:40.249550+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:15.082870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119487,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":21329,"num_write":1071,"num_write_kb":32132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'460","reported_seq":2020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127768+0000","last_change":"2024-09-12T00:02:50.062684+0000","last_active":"2024-09-12T01:14:04.127768+0000","last_peered":"2024-09-12T01:14:04.127768+0000","last_clean":"2024-09-12T01:14:04.127768+0000","last_became_active":"2024-09-12T00:02:50.060902+0000","last_became_peered":"2024-09-12T00:02:50.060902+0000","last_unstale":"2024-09-12T01:14:04.127768+0000","last_undegraded":"2024-09-12T01:14:04.127768+0000","last_fullsized":"2024-09-12T01:14:04.127768+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:33.890960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2604,"num_read_kb":2455,"num_write":536,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'260","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.067359+0000","last_change":"2024-09-12T00:02:48.054237+0000","last_active":"2024-09-12T01:15:48.067359+0000","last_peered":"2024-09-12T01:15:48.067359+0000","last_clean":"2024-09-12T01:15:48.067359+0000","last_became_active":"2024-09-12T00:02:48.052802+0000","last_became_peered":"2024-09-12T00:02:48.052802+0000","last_unstale":"2024-09-12T01:15:48.067359+0000","last_undegraded":"2024-09-12T01:15:48.067359+0000","last_fullsized":"2024-09-12T01:15:48.067359+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:33.528197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":8609,"num_write":1124,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'1277","reported_seq":2864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863786+0000","last_change":"2024-09-12T00:02:50.072880+0000","last_active":"2024-09-12T01:13:20.863786+0000","last_peered":"2024-09-12T01:13:20.863786+0000","last_clean":"2024-09-12T01:13:20.863786+0000","last_became_active":"2024-09-12T00:02:50.072574+0000","last_became_peered":"2024-09-12T00:02:50.072574+0000","last_unstale":"2024-09-12T01:13:20.863786+0000","last_undegraded":"2024-09-12T01:13:20.863786+0000","last_fullsized":"2024-09-12T01:13:20.863786+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:18.343144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5797,"num_read_kb":5069,"num_write":1818,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'162","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:18.419930+0000","last_change":"2024-09-12T00:02:48.053474+0000","last_active":"2024-09-12T01:15:18.419930+0000","last_peered":"2024-09-12T01:15:18.419930+0000","last_clean":"2024-09-12T01:15:18.419930+0000","last_became_active":"2024-09-12T00:02:48.052778+0000","last_became_peered":"2024-09-12T00:02:48.052778+0000","last_unstale":"2024-09-12T01:15:18.419930+0000","last_undegraded":"2024-09-12T01:15:18.419930+0000","last_fullsized":"2024-09-12T01:15:18.419930+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:00.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":373,"num_read_kb":36558,"num_write":790,"num_write_kb":25424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'761","reported_seq":2171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.862249+0000","last_change":"2024-09-12T00:02:50.062543+0000","last_active":"2024-09-12T01:13:20.862249+0000","last_peered":"2024-09-12T01:13:20.862249+0000","last_clean":"2024-09-12T01:13:20.862249+0000","last_became_active":"2024-09-12T00:02:50.062257+0000","last_became_peered":"2024-09-12T00:02:50.062257+0000","last_unstale":"2024-09-12T01:13:20.862249+0000","last_undegraded":"2024-09-12T01:13:20.862249+0000","last_fullsized":"2024-09-12T01:13:20.862249+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:20.110214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3047,"num_write":970,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'225","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.259407+0000","last_change":"2024-09-12T00:02:48.056467+0000","last_active":"2024-09-12T01:15:48.259407+0000","last_peered":"2024-09-12T01:15:48.259407+0000","last_clean":"2024-09-12T01:15:48.259407+0000","last_became_active":"2024-09-12T00:02:48.052257+0000","last_became_peered":"2024-09-12T00:02:48.052257+0000","last_unstale":"2024-09-12T01:15:48.259407+0000","last_undegraded":"2024-09-12T01:15:48.259407+0000","last_fullsized":"2024-09-12T01:15:48.259407+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:42.352728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798278,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":39161,"num_write":992,"num_write_kb":40171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'407","reported_seq":1873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748758+0000","last_change":"2024-09-12T00:02:50.061476+0000","last_active":"2024-09-12T01:15:09.748758+0000","last_peered":"2024-09-12T01:15:09.748758+0000","last_clean":"2024-09-12T01:15:09.748758+0000","last_became_active":"2024-09-12T00:02:50.060756+0000","last_became_peered":"2024-09-12T00:02:50.060756+0000","last_unstale":"2024-09-12T01:15:09.748758+0000","last_undegraded":"2024-09-12T01:15:09.748758+0000","last_fullsized":"2024-09-12T01:15:09.748758+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:07.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2108,"num_read_kb":1993,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'193","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.213028+0000","last_change":"2024-09-12T00:03:21.144282+0000","last_active":"2024-09-12T01:15:48.213028+0000","last_peered":"2024-09-12T01:15:48.213028+0000","last_clean":"2024-09-12T01:15:48.213028+0000","last_became_active":"2024-09-12T00:03:21.143840+0000","last_became_peered":"2024-09-12T00:03:21.143840+0000","last_unstale":"2024-09-12T01:15:48.213028+0000","last_undegraded":"2024-09-12T01:15:48.213028+0000","last_fullsized":"2024-09-12T01:15:48.213028+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:25.883175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":20506,"num_write":998,"num_write_kb":32663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'432","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.517921+0000","last_change":"2024-09-12T00:02:50.065057+0000","last_active":"2024-09-12T01:13:43.517921+0000","last_peered":"2024-09-12T01:13:43.517921+0000","last_clean":"2024-09-12T01:13:43.517921+0000","last_became_active":"2024-09-12T00:02:50.064658+0000","last_became_peered":"2024-09-12T00:02:50.064658+0000","last_unstale":"2024-09-12T01:13:43.517921+0000","last_undegraded":"2024-09-12T01:13:43.517921+0000","last_fullsized":"2024-09-12T01:13:43.517921+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:42.210482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":488,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'181","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.071132+0000","last_change":"2024-09-12T00:02:48.059025+0000","last_active":"2024-09-12T01:15:48.071132+0000","last_peered":"2024-09-12T01:15:48.071132+0000","last_clean":"2024-09-12T01:15:48.071132+0000","last_became_active":"2024-09-12T00:02:48.058678+0000","last_became_peered":"2024-09-12T00:02:48.058678+0000","last_unstale":"2024-09-12T01:15:48.071132+0000","last_undegraded":"2024-09-12T01:15:48.071132+0000","last_fullsized":"2024-09-12T01:15:48.071132+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:51.470037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170390,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1879,"num_write":959,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'888","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.957023+0000","last_change":"2024-09-12T00:02:50.070198+0000","last_active":"2024-09-12T01:14:02.957023+0000","last_peered":"2024-09-12T01:14:02.957023+0000","last_clean":"2024-09-12T01:14:02.957023+0000","last_became_active":"2024-09-12T00:02:50.069840+0000","last_became_peered":"2024-09-12T00:02:50.069840+0000","last_unstale":"2024-09-12T01:14:02.957023+0000","last_undegraded":"2024-09-12T01:14:02.957023+0000","last_fullsized":"2024-09-12T01:14:02.957023+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.926054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4122,"num_read_kb":3699,"num_write":1233,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'596","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863098+0000","last_change":"2024-09-12T00:02:50.061218+0000","last_active":"2024-09-12T01:13:20.863098+0000","last_peered":"2024-09-12T01:13:20.863098+0000","last_clean":"2024-09-12T01:13:20.863098+0000","last_became_active":"2024-09-12T00:02:50.060919+0000","last_became_peered":"2024-09-12T00:02:50.060919+0000","last_unstale":"2024-09-12T01:13:20.863098+0000","last_undegraded":"2024-09-12T01:13:20.863098+0000","last_fullsized":"2024-09-12T01:13:20.863098+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:06.460607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3046,"num_read_kb":2788,"num_write":785,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'202","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.243046+0000","last_change":"2024-09-12T00:02:48.051390+0000","last_active":"2024-09-12T01:15:48.243046+0000","last_peered":"2024-09-12T01:15:48.243046+0000","last_clean":"2024-09-12T01:15:48.243046+0000","last_became_active":"2024-09-12T00:02:48.050909+0000","last_became_peered":"2024-09-12T00:02:48.050909+0000","last_unstale":"2024-09-12T01:15:48.243046+0000","last_undegraded":"2024-09-12T01:15:48.243046+0000","last_fullsized":"2024-09-12T01:15:48.243046+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:04.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":10751,"num_write":911,"num_write_kb":36355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'825","reported_seq":2313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863421+0000","last_change":"2024-09-12T00:02:50.073111+0000","last_active":"2024-09-12T01:13:20.863421+0000","last_peered":"2024-09-12T01:13:20.863421+0000","last_clean":"2024-09-12T01:13:20.863421+0000","last_became_active":"2024-09-12T00:02:50.072791+0000","last_became_peered":"2024-09-12T00:02:50.072791+0000","last_unstale":"2024-09-12T01:13:20.863421+0000","last_undegraded":"2024-09-12T01:13:20.863421+0000","last_fullsized":"2024-09-12T01:13:20.863421+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:30.271643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3382,"num_write":1095,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'201","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.222482+0000","last_change":"2024-09-12T00:02:48.053788+0000","last_active":"2024-09-12T01:15:48.222482+0000","last_peered":"2024-09-12T01:15:48.222482+0000","last_clean":"2024-09-12T01:15:48.222482+0000","last_became_active":"2024-09-12T00:02:48.053452+0000","last_became_peered":"2024-09-12T00:02:48.053452+0000","last_unstale":"2024-09-12T01:15:48.222482+0000","last_undegraded":"2024-09-12T01:15:48.222482+0000","last_fullsized":"2024-09-12T01:15:48.222482+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:23.267737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684145,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":6281,"num_write":1001,"num_write_kb":31607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'856","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956760+0000","last_change":"2024-09-12T00:02:50.072524+0000","last_active":"2024-09-12T01:14:02.956760+0000","last_peered":"2024-09-12T01:14:02.956760+0000","last_clean":"2024-09-12T01:14:02.956760+0000","last_became_active":"2024-09-12T00:02:50.072128+0000","last_became_peered":"2024-09-12T00:02:50.072128+0000","last_unstale":"2024-09-12T01:14:02.956760+0000","last_undegraded":"2024-09-12T01:14:02.956760+0000","last_fullsized":"2024-09-12T01:14:02.956760+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:10.120502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4255,"num_read_kb":3837,"num_write":1128,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'188","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.164834+0000","last_change":"2024-09-12T00:02:48.059802+0000","last_active":"2024-09-12T01:15:48.164834+0000","last_peered":"2024-09-12T01:15:48.164834+0000","last_clean":"2024-09-12T01:15:48.164834+0000","last_became_active":"2024-09-12T00:02:48.059289+0000","last_became_peered":"2024-09-12T00:02:48.059289+0000","last_unstale":"2024-09-12T01:15:48.164834+0000","last_undegraded":"2024-09-12T01:15:48.164834+0000","last_fullsized":"2024-09-12T01:15:48.164834+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:59.633157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342107,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":40439,"num_write":973,"num_write_kb":33156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'997","reported_seq":2680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956778+0000","last_change":"2024-09-12T00:02:50.070109+0000","last_active":"2024-09-12T01:14:02.956778+0000","last_peered":"2024-09-12T01:14:02.956778+0000","last_clean":"2024-09-12T01:14:02.956778+0000","last_became_active":"2024-09-12T00:02:50.069775+0000","last_became_peered":"2024-09-12T00:02:50.069775+0000","last_unstale":"2024-09-12T01:14:02.956778+0000","last_undegraded":"2024-09-12T01:14:02.956778+0000","last_fullsized":"2024-09-12T01:14:02.956778+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:30.986657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4692,"num_read_kb":4217,"num_write":1368,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'200","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.019994+0000","last_change":"2024-09-12T00:04:21.323388+0000","last_active":"2024-09-12T01:15:48.019994+0000","last_peered":"2024-09-12T01:15:48.019994+0000","last_clean":"2024-09-12T01:15:48.019994+0000","last_became_active":"2024-09-12T00:04:21.322881+0000","last_became_peered":"2024-09-12T00:04:21.322881+0000","last_unstale":"2024-09-12T01:15:48.019994+0000","last_undegraded":"2024-09-12T01:15:48.019994+0000","last_fullsized":"2024-09-12T01:15:48.019994+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.218601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15793517,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":543,"num_read_kb":44397,"num_write":1008,"num_write_kb":26074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"267'849","reported_seq":2416,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.284675+0000","last_change":"2024-09-12T00:02:50.061400+0000","last_active":"2024-09-12T01:12:58.284675+0000","last_peered":"2024-09-12T01:12:58.284675+0000","last_clean":"2024-09-12T01:12:58.284675+0000","last_became_active":"2024-09-12T00:02:50.061055+0000","last_became_peered":"2024-09-12T00:02:50.061055+0000","last_unstale":"2024-09-12T01:12:58.284675+0000","last_undegraded":"2024-09-12T01:12:58.284675+0000","last_fullsized":"2024-09-12T01:12:58.284675+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:36.257000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3601,"num_write":1146,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'245","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.114969+0000","last_change":"2024-09-12T00:03:22.073808+0000","last_active":"2024-09-12T01:15:48.114969+0000","last_peered":"2024-09-12T01:15:48.114969+0000","last_clean":"2024-09-12T01:15:48.114969+0000","last_became_active":"2024-09-12T00:03:22.073294+0000","last_became_peered":"2024-09-12T00:03:22.073294+0000","last_unstale":"2024-09-12T01:15:48.114969+0000","last_undegraded":"2024-09-12T01:15:48.114969+0000","last_fullsized":"2024-09-12T01:15:48.114969+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:48.679955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5615297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":9461,"num_write":1067,"num_write_kb":47816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"267'873","reported_seq":2497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.955537+0000","last_change":"2024-09-12T00:02:50.067613+0000","last_active":"2024-09-12T01:14:02.955537+0000","last_peered":"2024-09-12T01:14:02.955537+0000","last_clean":"2024-09-12T01:14:02.955537+0000","last_became_active":"2024-09-12T00:02:50.067334+0000","last_became_peered":"2024-09-12T00:02:50.067334+0000","last_unstale":"2024-09-12T01:14:02.955537+0000","last_undegraded":"2024-09-12T01:14:02.955537+0000","last_fullsized":"2024-09-12T01:14:02.955537+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:15.631907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4129,"num_read_kb":3712,"num_write":1142,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'240","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.835489+0000","last_change":"2024-09-12T00:02:48.050847+0000","last_active":"2024-09-12T01:15:08.835489+0000","last_peered":"2024-09-12T01:15:08.835489+0000","last_clean":"2024-09-12T01:15:08.835489+0000","last_became_active":"2024-09-12T00:02:48.049926+0000","last_became_peered":"2024-09-12T00:02:48.049926+0000","last_unstale":"2024-09-12T01:15:08.835489+0000","last_undegraded":"2024-09-12T01:15:08.835489+0000","last_fullsized":"2024-09-12T01:15:08.835489+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:56.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10884929,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":663,"num_read_kb":41400,"num_write":1179,"num_write_kb":37207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'135","reported_seq":652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.271975+0000","last_change":"2024-09-12T00:02:58.094744+0000","last_active":"2024-09-12T01:14:04.271975+0000","last_peered":"2024-09-12T01:14:04.271975+0000","last_clean":"2024-09-12T01:14:04.271975+0000","last_became_active":"2024-09-12T00:02:58.094271+0000","last_became_peered":"2024-09-12T00:02:58.094271+0000","last_unstale":"2024-09-12T01:14:04.271975+0000","last_undegraded":"2024-09-12T01:14:04.271975+0000","last_fullsized":"2024-09-12T01:14:04.271975+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:25.220277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":142,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'583","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.279891+0000","last_change":"2024-09-12T00:02:50.073678+0000","last_active":"2024-09-12T01:13:32.279891+0000","last_peered":"2024-09-12T01:13:32.279891+0000","last_clean":"2024-09-12T01:13:32.279891+0000","last_became_active":"2024-09-12T00:02:50.073327+0000","last_became_peered":"2024-09-12T00:02:50.073327+0000","last_unstale":"2024-09-12T01:13:32.279891+0000","last_undegraded":"2024-09-12T01:13:32.279891+0000","last_fullsized":"2024-09-12T01:13:32.279891+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:33.890960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3161,"num_read_kb":2955,"num_write":696,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'270","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.221731+0000","last_change":"2024-09-12T00:03:21.143983+0000","last_active":"2024-09-12T01:15:48.221731+0000","last_peered":"2024-09-12T01:15:48.221731+0000","last_clean":"2024-09-12T01:15:48.221731+0000","last_became_active":"2024-09-12T00:03:21.143543+0000","last_became_peered":"2024-09-12T00:03:21.143543+0000","last_unstale":"2024-09-12T01:15:48.221731+0000","last_undegraded":"2024-09-12T01:15:48.221731+0000","last_fullsized":"2024-09-12T01:15:48.221731+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:23.255657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":789,"num_read_kb":207403,"num_write":1277,"num_write_kb":65033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510971+0000","last_change":"2024-09-12T00:02:52.067537+0000","last_active":"2024-09-12T01:12:58.510971+0000","last_peered":"2024-09-12T01:12:58.510971+0000","last_clean":"2024-09-12T01:12:58.510971+0000","last_became_active":"2024-09-12T00:02:52.067288+0000","last_became_peered":"2024-09-12T00:02:52.067288+0000","last_unstale":"2024-09-12T01:12:58.510971+0000","last_undegraded":"2024-09-12T01:12:58.510971+0000","last_fullsized":"2024-09-12T01:12:58.510971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:59.660984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'232","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.876021+0000","last_change":"2024-09-12T00:02:54.070876+0000","last_active":"2024-09-12T01:15:10.876021+0000","last_peered":"2024-09-12T01:15:10.876021+0000","last_clean":"2024-09-12T01:15:10.876021+0000","last_became_active":"2024-09-12T00:02:54.070547+0000","last_became_peered":"2024-09-12T00:02:54.070547+0000","last_unstale":"2024-09-12T01:15:10.876021+0000","last_undegraded":"2024-09-12T01:15:10.876021+0000","last_fullsized":"2024-09-12T01:15:10.876021+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:55.618177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14585,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":395,"num_write":192,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.400430+0000","last_change":"2024-09-12T00:02:56.081347+0000","last_active":"2024-09-12T01:13:03.400430+0000","last_peered":"2024-09-12T01:13:03.400430+0000","last_clean":"2024-09-12T01:13:03.400430+0000","last_became_active":"2024-09-12T00:02:56.081086+0000","last_became_peered":"2024-09-12T00:02:56.081086+0000","last_unstale":"2024-09-12T01:13:03.400430+0000","last_undegraded":"2024-09-12T01:13:03.400430+0000","last_fullsized":"2024-09-12T01:13:03.400430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:59.050278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'2432","reported_seq":4341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.081005+0000","last_change":"2024-09-12T00:02:58.096284+0000","last_active":"2024-09-12T01:14:00.081005+0000","last_peered":"2024-09-12T01:14:00.081005+0000","last_clean":"2024-09-12T01:14:00.081005+0000","last_became_active":"2024-09-12T00:02:58.095948+0000","last_became_peered":"2024-09-12T00:02:58.095948+0000","last_unstale":"2024-09-12T01:14:00.081005+0000","last_undegraded":"2024-09-12T01:14:00.081005+0000","last_fullsized":"2024-09-12T01:14:00.081005+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6163,"num_read_kb":6149,"num_write":4865,"num_write_kb":1796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'433","reported_seq":1960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510948+0000","last_change":"2024-09-12T00:02:50.066811+0000","last_active":"2024-09-12T01:12:58.510948+0000","last_peered":"2024-09-12T01:12:58.510948+0000","last_clean":"2024-09-12T01:12:58.510948+0000","last_became_active":"2024-09-12T00:02:50.065654+0000","last_became_peered":"2024-09-12T00:02:50.065654+0000","last_unstale":"2024-09-12T01:12:58.510948+0000","last_undegraded":"2024-09-12T01:12:58.510948+0000","last_fullsized":"2024-09-12T01:12:58.510948+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:32.174985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2304,"num_read_kb":2172,"num_write":510,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'197","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243250+0000","last_change":"2024-09-12T00:02:48.052092+0000","last_active":"2024-09-12T01:12:50.243250+0000","last_peered":"2024-09-12T01:12:50.243250+0000","last_clean":"2024-09-12T01:12:50.243250+0000","last_became_active":"2024-09-12T00:02:48.050499+0000","last_became_peered":"2024-09-12T00:02:48.050499+0000","last_unstale":"2024-09-12T01:12:50.243250+0000","last_undegraded":"2024-09-12T01:12:50.243250+0000","last_fullsized":"2024-09-12T01:12:50.243250+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.925597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324673,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":413,"num_read_kb":23205,"num_write":929,"num_write_kb":52906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455377+0000","last_change":"2024-09-12T00:02:52.068820+0000","last_active":"2024-09-12T01:12:58.455377+0000","last_peered":"2024-09-12T01:12:58.455377+0000","last_clean":"2024-09-12T01:12:58.455377+0000","last_became_active":"2024-09-12T00:02:52.068519+0000","last_became_peered":"2024-09-12T00:02:52.068519+0000","last_unstale":"2024-09-12T01:12:58.455377+0000","last_undegraded":"2024-09-12T01:12:58.455377+0000","last_fullsized":"2024-09-12T01:12:58.455377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:41.402904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'115","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.479573+0000","last_change":"2024-09-12T00:02:54.060615+0000","last_active":"2024-09-12T01:13:29.479573+0000","last_peered":"2024-09-12T01:13:29.479573+0000","last_clean":"2024-09-12T01:13:29.479573+0000","last_became_active":"2024-09-12T00:02:54.060334+0000","last_became_peered":"2024-09-12T00:02:54.060334+0000","last_unstale":"2024-09-12T01:13:29.479573+0000","last_undegraded":"2024-09-12T01:13:29.479573+0000","last_fullsized":"2024-09-12T01:13:29.479573+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:06.270504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.399195+0000","last_change":"2024-09-12T00:02:56.085489+0000","last_active":"2024-09-12T01:13:03.399195+0000","last_peered":"2024-09-12T01:13:03.399195+0000","last_clean":"2024-09-12T01:13:03.399195+0000","last_became_active":"2024-09-12T00:02:56.085222+0000","last_became_peered":"2024-09-12T00:02:56.085222+0000","last_unstale":"2024-09-12T01:13:03.399195+0000","last_undegraded":"2024-09-12T01:13:03.399195+0000","last_fullsized":"2024-09-12T01:13:03.399195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:10.915396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'143","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244578+0000","last_change":"2024-09-12T00:02:58.094502+0000","last_active":"2024-09-12T01:13:00.244578+0000","last_peered":"2024-09-12T01:13:00.244578+0000","last_clean":"2024-09-12T01:13:00.244578+0000","last_became_active":"2024-09-12T00:02:58.094312+0000","last_became_peered":"2024-09-12T00:02:58.094312+0000","last_unstale":"2024-09-12T01:13:00.244578+0000","last_undegraded":"2024-09-12T01:13:00.244578+0000","last_fullsized":"2024-09-12T01:13:00.244578+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:05.995438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":193,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'829","reported_seq":2430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.964131+0000","last_change":"2024-09-12T00:02:50.071513+0000","last_active":"2024-09-12T01:13:13.964131+0000","last_peered":"2024-09-12T01:13:13.964131+0000","last_clean":"2024-09-12T01:13:13.964131+0000","last_became_active":"2024-09-12T00:02:50.071219+0000","last_became_peered":"2024-09-12T00:02:50.071219+0000","last_unstale":"2024-09-12T01:13:13.964131+0000","last_undegraded":"2024-09-12T01:13:13.964131+0000","last_fullsized":"2024-09-12T01:13:13.964131+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:42.605165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4069,"num_read_kb":3661,"num_write":1104,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'211","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.133404+0000","last_change":"2024-09-12T00:02:48.059794+0000","last_active":"2024-09-12T01:15:48.133404+0000","last_peered":"2024-09-12T01:15:48.133404+0000","last_clean":"2024-09-12T01:15:48.133404+0000","last_became_active":"2024-09-12T00:02:48.059132+0000","last_became_peered":"2024-09-12T00:02:48.059132+0000","last_unstale":"2024-09-12T01:15:48.133404+0000","last_undegraded":"2024-09-12T01:15:48.133404+0000","last_fullsized":"2024-09-12T01:15:48.133404+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.465348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":5763,"num_write":993,"num_write_kb":32529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455423+0000","last_change":"2024-09-12T00:02:52.064543+0000","last_active":"2024-09-12T01:12:58.455423+0000","last_peered":"2024-09-12T01:12:58.455423+0000","last_clean":"2024-09-12T01:12:58.455423+0000","last_became_active":"2024-09-12T00:02:52.064216+0000","last_became_peered":"2024-09-12T00:02:52.064216+0000","last_unstale":"2024-09-12T01:12:58.455423+0000","last_undegraded":"2024-09-12T01:12:58.455423+0000","last_fullsized":"2024-09-12T01:12:58.455423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:47.668439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'155","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.520130+0000","last_change":"2024-09-12T00:02:54.060808+0000","last_active":"2024-09-12T01:13:29.520130+0000","last_peered":"2024-09-12T01:13:29.520130+0000","last_clean":"2024-09-12T01:13:29.520130+0000","last_became_active":"2024-09-12T00:02:54.060501+0000","last_became_peered":"2024-09-12T00:02:54.060501+0000","last_unstale":"2024-09-12T01:13:29.520130+0000","last_undegraded":"2024-09-12T01:13:29.520130+0000","last_fullsized":"2024-09-12T01:13:29.520130+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.725874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":182,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'766","reported_seq":2662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.957227+0000","last_change":"2024-09-12T00:02:56.087899+0000","last_active":"2024-09-12T01:15:47.957227+0000","last_peered":"2024-09-12T01:15:47.957227+0000","last_clean":"2024-09-12T01:15:47.957227+0000","last_became_active":"2024-09-12T00:02:56.087506+0000","last_became_peered":"2024-09-12T00:02:56.087506+0000","last_unstale":"2024-09-12T01:15:47.957227+0000","last_undegraded":"2024-09-12T01:15:47.957227+0000","last_fullsized":"2024-09-12T01:15:47.957227+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.840099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'208","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.331265+0000","last_change":"2024-09-12T00:02:58.090727+0000","last_active":"2024-09-12T01:14:04.331265+0000","last_peered":"2024-09-12T01:14:04.331265+0000","last_clean":"2024-09-12T01:14:04.331265+0000","last_became_active":"2024-09-12T00:02:58.090424+0000","last_became_peered":"2024-09-12T00:02:58.090424+0000","last_unstale":"2024-09-12T01:14:04.331265+0000","last_undegraded":"2024-09-12T01:14:04.331265+0000","last_fullsized":"2024-09-12T01:14:04.331265+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:25.948169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":609,"num_read_kb":603,"num_write":442,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'493","reported_seq":2294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455414+0000","last_change":"2024-09-12T00:02:50.068236+0000","last_active":"2024-09-12T01:12:58.455414+0000","last_peered":"2024-09-12T01:12:58.455414+0000","last_clean":"2024-09-12T01:12:58.455414+0000","last_became_active":"2024-09-12T00:02:50.067933+0000","last_became_peered":"2024-09-12T00:02:50.067933+0000","last_unstale":"2024-09-12T01:12:58.455414+0000","last_undegraded":"2024-09-12T01:12:58.455414+0000","last_fullsized":"2024-09-12T01:12:58.455414+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:07.127880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2745,"num_read_kb":2618,"num_write":566,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'210","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.262322+0000","last_change":"2024-09-12T00:02:48.052920+0000","last_active":"2024-09-12T01:15:48.262322+0000","last_peered":"2024-09-12T01:15:48.262322+0000","last_clean":"2024-09-12T01:15:48.262322+0000","last_became_active":"2024-09-12T00:02:48.052566+0000","last_became_peered":"2024-09-12T00:02:48.052566+0000","last_unstale":"2024-09-12T01:15:48.262322+0000","last_undegraded":"2024-09-12T01:15:48.262322+0000","last_fullsized":"2024-09-12T01:15:48.262322+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:54.469835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":572,"num_read_kb":73907,"num_write":996,"num_write_kb":20895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.511011+0000","last_change":"2024-09-12T00:02:52.066484+0000","last_active":"2024-09-12T01:12:58.511011+0000","last_peered":"2024-09-12T01:12:58.511011+0000","last_clean":"2024-09-12T01:12:58.511011+0000","last_became_active":"2024-09-12T00:02:52.066171+0000","last_became_peered":"2024-09-12T00:02:52.066171+0000","last_unstale":"2024-09-12T01:12:58.511011+0000","last_undegraded":"2024-09-12T01:12:58.511011+0000","last_fullsized":"2024-09-12T01:12:58.511011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.617107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'168","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.074173+0000","last_change":"2024-09-12T00:02:54.239939+0000","last_active":"2024-09-12T01:15:48.074173+0000","last_peered":"2024-09-12T01:15:48.074173+0000","last_clean":"2024-09-12T01:15:48.074173+0000","last_became_active":"2024-09-12T00:02:54.239618+0000","last_became_peered":"2024-09-12T00:02:54.239618+0000","last_unstale":"2024-09-12T01:15:48.074173+0000","last_undegraded":"2024-09-12T01:15:48.074173+0000","last_fullsized":"2024-09-12T01:15:48.074173+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:03.054772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":308,"num_write":128,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'806","reported_seq":2629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.960735+0000","last_change":"2024-09-12T00:02:56.082933+0000","last_active":"2024-09-12T01:15:47.960735+0000","last_peered":"2024-09-12T01:15:47.960735+0000","last_clean":"2024-09-12T01:15:47.960735+0000","last_became_active":"2024-09-12T00:02:56.082567+0000","last_became_peered":"2024-09-12T00:02:56.082567+0000","last_unstale":"2024-09-12T01:15:47.960735+0000","last_undegraded":"2024-09-12T01:15:47.960735+0000","last_fullsized":"2024-09-12T01:15:47.960735+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:12.520817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'363","reported_seq":1779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.740706+0000","last_change":"2024-09-12T00:02:50.063983+0000","last_active":"2024-09-12T01:12:50.740706+0000","last_peered":"2024-09-12T01:12:50.740706+0000","last_clean":"2024-09-12T01:12:50.740706+0000","last_became_active":"2024-09-12T00:02:50.063707+0000","last_became_peered":"2024-09-12T00:02:50.063707+0000","last_unstale":"2024-09-12T01:12:50.740706+0000","last_undegraded":"2024-09-12T01:12:50.740706+0000","last_fullsized":"2024-09-12T01:12:50.740706+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:50.652404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1902,"num_write":425,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'196","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154808+0000","last_change":"2024-09-12T00:02:48.056458+0000","last_active":"2024-09-12T01:15:48.154808+0000","last_peered":"2024-09-12T01:15:48.154808+0000","last_clean":"2024-09-12T01:15:48.154808+0000","last_became_active":"2024-09-12T00:02:48.056135+0000","last_became_peered":"2024-09-12T00:02:48.056135+0000","last_unstale":"2024-09-12T01:15:48.154808+0000","last_undegraded":"2024-09-12T01:15:48.154808+0000","last_fullsized":"2024-09-12T01:15:48.154808+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:17.917949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":40539,"num_write":934,"num_write_kb":46911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.393561+0000","last_change":"2024-09-12T00:02:52.069040+0000","last_active":"2024-09-12T01:12:13.393561+0000","last_peered":"2024-09-12T01:12:13.393561+0000","last_clean":"2024-09-12T01:12:13.393561+0000","last_became_active":"2024-09-12T00:02:52.068747+0000","last_became_peered":"2024-09-12T00:02:52.068747+0000","last_unstale":"2024-09-12T01:12:13.393561+0000","last_undegraded":"2024-09-12T01:12:13.393561+0000","last_fullsized":"2024-09-12T01:12:13.393561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.948073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'275","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.157693+0000","last_change":"2024-09-12T00:02:54.239819+0000","last_active":"2024-09-12T01:15:48.157693+0000","last_peered":"2024-09-12T01:15:48.157693+0000","last_clean":"2024-09-12T01:15:48.157693+0000","last_became_active":"2024-09-12T00:02:54.239475+0000","last_became_peered":"2024-09-12T00:02:54.239475+0000","last_unstale":"2024-09-12T01:15:48.157693+0000","last_undegraded":"2024-09-12T01:15:48.157693+0000","last_fullsized":"2024-09-12T01:15:48.157693+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:54.855357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5743,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":380,"num_read_kb":454,"num_write":232,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.234848+0000","last_change":"2024-09-12T00:02:56.082064+0000","last_active":"2024-09-12T01:12:43.234848+0000","last_peered":"2024-09-12T01:12:43.234848+0000","last_clean":"2024-09-12T01:12:43.234848+0000","last_became_active":"2024-09-12T00:02:56.080748+0000","last_became_peered":"2024-09-12T00:02:56.080748+0000","last_unstale":"2024-09-12T01:12:43.234848+0000","last_undegraded":"2024-09-12T01:12:43.234848+0000","last_fullsized":"2024-09-12T01:12:43.234848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:53.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'526","reported_seq":1341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.895471+0000","last_change":"2024-09-12T00:02:58.095783+0000","last_active":"2024-09-12T01:15:10.895471+0000","last_peered":"2024-09-12T01:15:10.895471+0000","last_clean":"2024-09-12T01:15:10.895471+0000","last_became_active":"2024-09-12T00:02:58.095311+0000","last_became_peered":"2024-09-12T00:02:58.095311+0000","last_unstale":"2024-09-12T01:15:10.895471+0000","last_undegraded":"2024-09-12T01:15:10.895471+0000","last_fullsized":"2024-09-12T01:15:10.895471+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:26.606781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1247,"num_read_kb":1245,"num_write":1070,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'399","reported_seq":1701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.391883+0000","last_change":"2024-09-12T00:02:50.068582+0000","last_active":"2024-09-12T01:12:13.391883+0000","last_peered":"2024-09-12T01:12:13.391883+0000","last_clean":"2024-09-12T01:12:13.391883+0000","last_became_active":"2024-09-12T00:02:50.068223+0000","last_became_peered":"2024-09-12T00:02:50.068223+0000","last_unstale":"2024-09-12T01:12:13.391883+0000","last_undegraded":"2024-09-12T01:12:13.391883+0000","last_fullsized":"2024-09-12T01:12:13.391883+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:39.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1919,"num_read_kb":1778,"num_write":479,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'153","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.212769+0000","last_change":"2024-09-12T00:02:48.056639+0000","last_active":"2024-09-12T01:15:48.212769+0000","last_peered":"2024-09-12T01:15:48.212769+0000","last_clean":"2024-09-12T01:15:48.212769+0000","last_became_active":"2024-09-12T00:02:48.055480+0000","last_became_peered":"2024-09-12T00:02:48.055480+0000","last_unstale":"2024-09-12T01:15:48.212769+0000","last_undegraded":"2024-09-12T01:15:48.212769+0000","last_fullsized":"2024-09-12T01:15:48.212769+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:35.963894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250607,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":416,"num_read_kb":43431,"num_write":767,"num_write_kb":28983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.223502+0000","last_change":"2024-09-12T00:02:52.062537+0000","last_active":"2024-09-12T01:12:13.223502+0000","last_peered":"2024-09-12T01:12:13.223502+0000","last_clean":"2024-09-12T01:12:13.223502+0000","last_became_active":"2024-09-12T00:02:52.062219+0000","last_became_peered":"2024-09-12T00:02:52.062219+0000","last_unstale":"2024-09-12T01:12:13.223502+0000","last_undegraded":"2024-09-12T01:12:13.223502+0000","last_fullsized":"2024-09-12T01:12:13.223502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:37.629100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'154","reported_seq":742,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.857945+0000","last_change":"2024-09-12T00:02:54.069965+0000","last_active":"2024-09-12T01:15:10.857945+0000","last_peered":"2024-09-12T01:15:10.857945+0000","last_clean":"2024-09-12T01:15:10.857945+0000","last_became_active":"2024-09-12T00:02:54.069656+0000","last_became_peered":"2024-09-12T00:02:54.069656+0000","last_unstale":"2024-09-12T01:15:10.857945+0000","last_undegraded":"2024-09-12T01:15:10.857945+0000","last_fullsized":"2024-09-12T01:15:10.857945+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.543544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":256,"num_write":104,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.451158+0000","last_change":"2024-09-12T00:02:56.082127+0000","last_active":"2024-09-12T01:12:23.451158+0000","last_peered":"2024-09-12T01:12:23.451158+0000","last_clean":"2024-09-12T01:12:23.451158+0000","last_became_active":"2024-09-12T00:02:56.081804+0000","last_became_peered":"2024-09-12T00:02:56.081804+0000","last_unstale":"2024-09-12T01:12:23.451158+0000","last_undegraded":"2024-09-12T01:12:23.451158+0000","last_fullsized":"2024-09-12T01:12:23.451158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'120","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:53.623729+0000","last_change":"2024-09-12T00:02:58.095336+0000","last_active":"2024-09-12T01:13:53.623729+0000","last_peered":"2024-09-12T01:13:53.623729+0000","last_clean":"2024-09-12T01:13:53.623729+0000","last_became_active":"2024-09-12T00:02:58.095068+0000","last_became_peered":"2024-09-12T00:02:58.095068+0000","last_unstale":"2024-09-12T01:13:53.623729+0000","last_undegraded":"2024-09-12T01:13:53.623729+0000","last_fullsized":"2024-09-12T01:13:53.623729+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:41.572699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":135,"num_write":297,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'895","reported_seq":2417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956001+0000","last_change":"2024-09-12T00:02:50.078307+0000","last_active":"2024-09-12T01:14:02.956001+0000","last_peered":"2024-09-12T01:14:02.956001+0000","last_clean":"2024-09-12T01:14:02.956001+0000","last_became_active":"2024-09-12T00:02:50.078033+0000","last_became_peered":"2024-09-12T00:02:50.078033+0000","last_unstale":"2024-09-12T01:14:02.956001+0000","last_undegraded":"2024-09-12T01:14:02.956001+0000","last_fullsized":"2024-09-12T01:14:02.956001+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:39.344301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4128,"num_read_kb":3671,"num_write":1209,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'185","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010442+0000","last_change":"2024-09-12T00:02:48.050254+0000","last_active":"2024-09-12T01:15:48.010442+0000","last_peered":"2024-09-12T01:15:48.010442+0000","last_clean":"2024-09-12T01:15:48.010442+0000","last_became_active":"2024-09-12T00:02:48.048973+0000","last_became_peered":"2024-09-12T00:02:48.048973+0000","last_unstale":"2024-09-12T01:15:48.010442+0000","last_undegraded":"2024-09-12T01:15:48.010442+0000","last_fullsized":"2024-09-12T01:15:48.010442+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:37.674699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":6868,"num_write":918,"num_write_kb":34085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.226604+0000","last_change":"2024-09-12T00:02:52.066165+0000","last_active":"2024-09-12T01:12:38.226604+0000","last_peered":"2024-09-12T01:12:38.226604+0000","last_clean":"2024-09-12T01:12:38.226604+0000","last_became_active":"2024-09-12T00:02:52.065809+0000","last_became_peered":"2024-09-12T00:02:52.065809+0000","last_unstale":"2024-09-12T01:12:38.226604+0000","last_undegraded":"2024-09-12T01:12:38.226604+0000","last_fullsized":"2024-09-12T01:12:38.226604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:04.139647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'211","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.180814+0000","last_change":"2024-09-12T00:02:54.067330+0000","last_active":"2024-09-12T01:15:48.180814+0000","last_peered":"2024-09-12T01:15:48.180814+0000","last_clean":"2024-09-12T01:15:48.180814+0000","last_became_active":"2024-09-12T00:02:54.066781+0000","last_became_peered":"2024-09-12T00:02:54.066781+0000","last_unstale":"2024-09-12T01:15:48.180814+0000","last_undegraded":"2024-09-12T01:15:48.180814+0000","last_fullsized":"2024-09-12T01:15:48.180814+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:13.921060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":282,"num_read_kb":329,"num_write":166,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'791","reported_seq":2814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.937531+0000","last_change":"2024-09-12T00:02:56.086997+0000","last_active":"2024-09-12T01:15:13.937531+0000","last_peered":"2024-09-12T01:15:13.937531+0000","last_clean":"2024-09-12T01:15:13.937531+0000","last_became_active":"2024-09-12T00:02:56.086692+0000","last_became_peered":"2024-09-12T00:02:56.086692+0000","last_unstale":"2024-09-12T01:15:13.937531+0000","last_undegraded":"2024-09-12T01:15:13.937531+0000","last_fullsized":"2024-09-12T01:15:13.937531+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:43.673008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'116","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.570840+0000","last_change":"2024-09-12T00:02:58.093723+0000","last_active":"2024-09-12T01:15:09.570840+0000","last_peered":"2024-09-12T01:15:09.570840+0000","last_clean":"2024-09-12T01:15:09.570840+0000","last_became_active":"2024-09-12T00:02:58.093419+0000","last_became_peered":"2024-09-12T00:02:58.093419+0000","last_unstale":"2024-09-12T01:15:09.570840+0000","last_undegraded":"2024-09-12T01:15:09.570840+0000","last_fullsized":"2024-09-12T01:15:09.570840+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:27.505545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":298,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'399","reported_seq":1992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.655457+0000","last_change":"2024-09-12T00:02:50.074292+0000","last_active":"2024-09-12T01:12:55.655457+0000","last_peered":"2024-09-12T01:12:55.655457+0000","last_clean":"2024-09-12T01:12:55.655457+0000","last_became_active":"2024-09-12T00:02:50.073986+0000","last_became_peered":"2024-09-12T00:02:50.073986+0000","last_unstale":"2024-09-12T01:12:55.655457+0000","last_undegraded":"2024-09-12T01:12:55.655457+0000","last_fullsized":"2024-09-12T01:12:55.655457+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:10.242887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2369,"num_read_kb":2271,"num_write":449,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'218","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041533+0000","last_change":"2024-09-12T00:02:48.051538+0000","last_active":"2024-09-12T01:15:48.041533+0000","last_peered":"2024-09-12T01:15:48.041533+0000","last_clean":"2024-09-12T01:15:48.041533+0000","last_became_active":"2024-09-12T00:02:48.051190+0000","last_became_peered":"2024-09-12T00:02:48.051190+0000","last_unstale":"2024-09-12T01:15:48.041533+0000","last_undegraded":"2024-09-12T01:15:48.041533+0000","last_fullsized":"2024-09-12T01:15:48.041533+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:22.141104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":21060,"num_write":1056,"num_write_kb":24204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:28.225385+0000","last_change":"2024-09-12T00:02:52.057007+0000","last_active":"2024-09-12T01:12:28.225385+0000","last_peered":"2024-09-12T01:12:28.225385+0000","last_clean":"2024-09-12T01:12:28.225385+0000","last_became_active":"2024-09-12T00:02:52.056676+0000","last_became_peered":"2024-09-12T00:02:52.056676+0000","last_unstale":"2024-09-12T01:12:28.225385+0000","last_undegraded":"2024-09-12T01:12:28.225385+0000","last_fullsized":"2024-09-12T01:12:28.225385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:05.044357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'218","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.861291+0000","last_change":"2024-09-12T00:02:54.067361+0000","last_active":"2024-09-12T01:15:10.861291+0000","last_peered":"2024-09-12T01:15:10.861291+0000","last_clean":"2024-09-12T01:15:10.861291+0000","last_became_active":"2024-09-12T00:02:54.066994+0000","last_became_peered":"2024-09-12T00:02:54.066994+0000","last_unstale":"2024-09-12T01:15:10.861291+0000","last_undegraded":"2024-09-12T01:15:10.861291+0000","last_fullsized":"2024-09-12T01:15:10.861291+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:13.963065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":303,"num_read_kb":404,"num_write":158,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.224174+0000","last_change":"2024-09-12T00:02:56.079092+0000","last_active":"2024-09-12T01:12:18.224174+0000","last_peered":"2024-09-12T01:12:18.224174+0000","last_clean":"2024-09-12T01:12:18.224174+0000","last_became_active":"2024-09-12T00:02:56.078740+0000","last_became_peered":"2024-09-12T00:02:56.078740+0000","last_unstale":"2024-09-12T01:12:18.224174+0000","last_undegraded":"2024-09-12T01:12:18.224174+0000","last_fullsized":"2024-09-12T01:12:18.224174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.551797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'108","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.778285+0000","last_change":"2024-09-12T00:02:58.092860+0000","last_active":"2024-09-12T01:14:00.778285+0000","last_peered":"2024-09-12T01:14:00.778285+0000","last_clean":"2024-09-12T01:14:00.778285+0000","last_became_active":"2024-09-12T00:02:58.092520+0000","last_became_peered":"2024-09-12T00:02:58.092520+0000","last_unstale":"2024-09-12T01:14:00.778285+0000","last_undegraded":"2024-09-12T01:14:00.778285+0000","last_fullsized":"2024-09-12T01:14:00.778285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":241,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'520","reported_seq":2234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.281027+0000","last_change":"2024-09-12T00:02:50.069136+0000","last_active":"2024-09-12T01:13:32.281027+0000","last_peered":"2024-09-12T01:13:32.281027+0000","last_clean":"2024-09-12T01:13:32.281027+0000","last_became_active":"2024-09-12T00:02:50.068691+0000","last_became_peered":"2024-09-12T00:02:50.068691+0000","last_unstale":"2024-09-12T01:13:32.281027+0000","last_undegraded":"2024-09-12T01:13:32.281027+0000","last_fullsized":"2024-09-12T01:13:32.281027+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.229579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2837,"num_read_kb":2668,"num_write":620,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'203","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.230560+0000","last_change":"2024-09-12T00:02:48.052397+0000","last_active":"2024-09-12T01:15:48.230560+0000","last_peered":"2024-09-12T01:15:48.230560+0000","last_clean":"2024-09-12T01:15:48.230560+0000","last_became_active":"2024-09-12T00:02:48.050513+0000","last_became_peered":"2024-09-12T00:02:48.050513+0000","last_unstale":"2024-09-12T01:15:48.230560+0000","last_undegraded":"2024-09-12T01:15:48.230560+0000","last_fullsized":"2024-09-12T01:15:48.230560+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:38.868513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6584947,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":922,"num_read_kb":76851,"num_write":1039,"num_write_kb":50138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.226648+0000","last_change":"2024-09-12T00:02:52.064616+0000","last_active":"2024-09-12T01:12:38.226648+0000","last_peered":"2024-09-12T01:12:38.226648+0000","last_clean":"2024-09-12T01:12:38.226648+0000","last_became_active":"2024-09-12T00:02:52.064333+0000","last_became_peered":"2024-09-12T00:02:52.064333+0000","last_unstale":"2024-09-12T01:12:38.226648+0000","last_undegraded":"2024-09-12T01:12:38.226648+0000","last_fullsized":"2024-09-12T01:12:38.226648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:11.063949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'175","reported_seq":778,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.013426+0000","last_change":"2024-09-12T00:02:54.069072+0000","last_active":"2024-09-12T01:15:48.013426+0000","last_peered":"2024-09-12T01:15:48.013426+0000","last_clean":"2024-09-12T01:15:48.013426+0000","last_became_active":"2024-09-12T00:02:54.068732+0000","last_became_peered":"2024-09-12T00:02:54.068732+0000","last_unstale":"2024-09-12T01:15:48.013426+0000","last_undegraded":"2024-09-12T01:15:48.013426+0000","last_fullsized":"2024-09-12T01:15:48.013426+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:07.854071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":259,"num_read_kb":329,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.244035+0000","last_change":"2024-09-12T00:02:56.088885+0000","last_active":"2024-09-12T01:12:55.244035+0000","last_peered":"2024-09-12T01:12:55.244035+0000","last_clean":"2024-09-12T01:12:55.244035+0000","last_became_active":"2024-09-12T00:02:56.088527+0000","last_became_peered":"2024-09-12T00:02:56.088527+0000","last_unstale":"2024-09-12T01:12:55.244035+0000","last_undegraded":"2024-09-12T01:12:55.244035+0000","last_fullsized":"2024-09-12T01:12:55.244035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:43.640519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'110","reported_seq":616,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:00.159830+0000","last_change":"2024-09-12T00:02:58.101029+0000","last_active":"2024-09-12T01:15:00.159830+0000","last_peered":"2024-09-12T01:15:00.159830+0000","last_clean":"2024-09-12T01:15:00.159830+0000","last_became_active":"2024-09-12T00:02:58.100726+0000","last_became_peered":"2024-09-12T00:02:58.100726+0000","last_unstale":"2024-09-12T01:15:00.159830+0000","last_undegraded":"2024-09-12T01:15:00.159830+0000","last_fullsized":"2024-09-12T01:15:00.159830+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:32.362052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":109,"num_write":270,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'820","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.718982+0000","last_change":"2024-09-12T00:02:50.059930+0000","last_active":"2024-09-12T01:15:09.718982+0000","last_peered":"2024-09-12T01:15:09.718982+0000","last_clean":"2024-09-12T01:15:09.718982+0000","last_became_active":"2024-09-12T00:02:50.059646+0000","last_became_peered":"2024-09-12T00:02:50.059646+0000","last_unstale":"2024-09-12T01:15:09.718982+0000","last_undegraded":"2024-09-12T01:15:09.718982+0000","last_fullsized":"2024-09-12T01:15:09.718982+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:39.274084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3626,"num_write":1074,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'218","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.147170+0000","last_change":"2024-09-12T00:02:48.046764+0000","last_active":"2024-09-12T01:15:48.147170+0000","last_peered":"2024-09-12T01:15:48.147170+0000","last_clean":"2024-09-12T01:15:48.147170+0000","last_became_active":"2024-09-12T00:02:48.046424+0000","last_became_peered":"2024-09-12T00:02:48.046424+0000","last_unstale":"2024-09-12T01:15:48.147170+0000","last_undegraded":"2024-09-12T01:15:48.147170+0000","last_fullsized":"2024-09-12T01:15:48.147170+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.965456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":142057,"num_write":895,"num_write_kb":42631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.234273+0000","last_change":"2024-09-12T00:02:52.064194+0000","last_active":"2024-09-12T01:12:38.234273+0000","last_peered":"2024-09-12T01:12:38.234273+0000","last_clean":"2024-09-12T01:12:38.234273+0000","last_became_active":"2024-09-12T00:02:52.063641+0000","last_became_peered":"2024-09-12T00:02:52.063641+0000","last_unstale":"2024-09-12T01:12:38.234273+0000","last_undegraded":"2024-09-12T01:12:38.234273+0000","last_fullsized":"2024-09-12T01:12:38.234273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:26.679512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'186","reported_seq":806,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.244141+0000","last_change":"2024-09-12T00:02:54.067652+0000","last_active":"2024-09-12T01:15:48.244141+0000","last_peered":"2024-09-12T01:15:48.244141+0000","last_clean":"2024-09-12T01:15:48.244141+0000","last_became_active":"2024-09-12T00:02:54.067328+0000","last_became_peered":"2024-09-12T00:02:54.067328+0000","last_unstale":"2024-09-12T01:15:48.244141+0000","last_undegraded":"2024-09-12T01:15:48.244141+0000","last_fullsized":"2024-09-12T01:15:48.244141+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:44.430717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":308,"num_write":148,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'743","reported_seq":2617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.956961+0000","last_change":"2024-09-12T00:02:56.079479+0000","last_active":"2024-09-12T01:15:47.956961+0000","last_peered":"2024-09-12T01:15:47.956961+0000","last_clean":"2024-09-12T01:15:47.956961+0000","last_became_active":"2024-09-12T00:02:56.079167+0000","last_became_peered":"2024-09-12T00:02:56.079167+0000","last_unstale":"2024-09-12T01:15:47.956961+0000","last_undegraded":"2024-09-12T01:15:47.956961+0000","last_fullsized":"2024-09-12T01:15:47.956961+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:15.403409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'124","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.241818+0000","last_change":"2024-09-12T00:02:58.097685+0000","last_active":"2024-09-12T01:13:48.241818+0000","last_peered":"2024-09-12T01:13:48.241818+0000","last_clean":"2024-09-12T01:13:48.241818+0000","last_became_active":"2024-09-12T00:02:58.097332+0000","last_became_peered":"2024-09-12T00:02:58.097332+0000","last_unstale":"2024-09-12T01:13:48.241818+0000","last_undegraded":"2024-09-12T01:13:48.241818+0000","last_fullsized":"2024-09-12T01:13:48.241818+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'385","reported_seq":1995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127378+0000","last_change":"2024-09-12T00:02:50.064012+0000","last_active":"2024-09-12T01:14:04.127378+0000","last_peered":"2024-09-12T01:14:04.127378+0000","last_clean":"2024-09-12T01:14:04.127378+0000","last_became_active":"2024-09-12T00:02:50.063676+0000","last_became_peered":"2024-09-12T00:02:50.063676+0000","last_unstale":"2024-09-12T01:14:04.127378+0000","last_undegraded":"2024-09-12T01:14:04.127378+0000","last_fullsized":"2024-09-12T01:14:04.127378+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:48.138249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2187,"num_read_kb":2115,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'185","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.213869+0000","last_change":"2024-09-12T00:02:48.046773+0000","last_active":"2024-09-12T01:15:48.213869+0000","last_peered":"2024-09-12T01:15:48.213869+0000","last_clean":"2024-09-12T01:15:48.213869+0000","last_became_active":"2024-09-12T00:02:48.046457+0000","last_became_peered":"2024-09-12T00:02:48.046457+0000","last_unstale":"2024-09-12T01:15:48.213869+0000","last_undegraded":"2024-09-12T01:15:48.213869+0000","last_fullsized":"2024-09-12T01:15:48.213869+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:27.570957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":408,"num_read_kb":52839,"num_write":877,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.937718+0000","last_change":"2024-09-12T00:02:52.068801+0000","last_active":"2024-09-12T01:15:47.937718+0000","last_peered":"2024-09-12T01:15:47.937718+0000","last_clean":"2024-09-12T01:15:47.937718+0000","last_became_active":"2024-09-12T00:02:52.068535+0000","last_became_peered":"2024-09-12T00:02:52.068535+0000","last_unstale":"2024-09-12T01:15:47.937718+0000","last_undegraded":"2024-09-12T01:15:47.937718+0000","last_fullsized":"2024-09-12T01:15:47.937718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:14.683759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'103","reported_seq":644,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.447426+0000","last_change":"2024-09-12T00:02:54.240354+0000","last_active":"2024-09-12T01:13:29.447426+0000","last_peered":"2024-09-12T01:13:29.447426+0000","last_clean":"2024-09-12T01:13:29.447426+0000","last_became_active":"2024-09-12T00:02:54.239924+0000","last_became_peered":"2024-09-12T00:02:54.239924+0000","last_unstale":"2024-09-12T01:13:29.447426+0000","last_undegraded":"2024-09-12T01:13:29.447426+0000","last_fullsized":"2024-09-12T01:13:29.447426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:39.666122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":4496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.959587+0000","last_change":"2024-09-12T00:02:56.086976+0000","last_active":"2024-09-12T01:15:47.959587+0000","last_peered":"2024-09-12T01:15:47.959587+0000","last_clean":"2024-09-12T01:15:47.959587+0000","last_became_active":"2024-09-12T00:02:56.086668+0000","last_became_peered":"2024-09-12T00:02:56.086668+0000","last_unstale":"2024-09-12T01:15:47.959587+0000","last_undegraded":"2024-09-12T01:15:47.959587+0000","last_fullsized":"2024-09-12T01:15:47.959587+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:09.139717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'150","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.387710+0000","last_change":"2024-09-12T00:02:58.097729+0000","last_active":"2024-09-12T01:11:43.387710+0000","last_peered":"2024-09-12T01:11:43.387710+0000","last_clean":"2024-09-12T01:11:43.387710+0000","last_became_active":"2024-09-12T00:02:58.097435+0000","last_became_peered":"2024-09-12T00:02:58.097435+0000","last_unstale":"2024-09-12T01:11:43.387710+0000","last_undegraded":"2024-09-12T01:11:43.387710+0000","last_fullsized":"2024-09-12T01:11:43.387710+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:06.625906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":180,"num_write":378,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'757","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:21.039751+0000","last_change":"2024-09-12T00:02:50.069930+0000","last_active":"2024-09-12T01:13:21.039751+0000","last_peered":"2024-09-12T01:13:21.039751+0000","last_clean":"2024-09-12T01:13:21.039751+0000","last_became_active":"2024-09-12T00:02:50.069661+0000","last_became_peered":"2024-09-12T00:02:50.069661+0000","last_unstale":"2024-09-12T01:13:21.039751+0000","last_undegraded":"2024-09-12T01:13:21.039751+0000","last_fullsized":"2024-09-12T01:13:21.039751+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:29.419116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4159,"num_read_kb":3799,"num_write":1082,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'214","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167450+0000","last_change":"2024-09-12T00:02:48.047887+0000","last_active":"2024-09-12T01:15:48.167450+0000","last_peered":"2024-09-12T01:15:48.167450+0000","last_clean":"2024-09-12T01:15:48.167450+0000","last_became_active":"2024-09-12T00:02:48.046527+0000","last_became_peered":"2024-09-12T00:02:48.046527+0000","last_unstale":"2024-09-12T01:15:48.167450+0000","last_undegraded":"2024-09-12T01:15:48.167450+0000","last_fullsized":"2024-09-12T01:15:48.167450+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:11.514356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":898,"num_read_kb":26543,"num_write":1077,"num_write_kb":24642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"38'4","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.925616+0000","last_change":"2024-09-12T00:02:52.064448+0000","last_active":"2024-09-12T01:15:47.925616+0000","last_peered":"2024-09-12T01:15:47.925616+0000","last_clean":"2024-09-12T01:15:47.925616+0000","last_became_active":"2024-09-12T00:02:52.064186+0000","last_became_peered":"2024-09-12T00:02:52.064186+0000","last_unstale":"2024-09-12T01:15:47.925616+0000","last_undegraded":"2024-09-12T01:15:47.925616+0000","last_fullsized":"2024-09-12T01:15:47.925616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:57.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'295","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.124813+0000","last_change":"2024-09-12T00:02:54.072647+0000","last_active":"2024-09-12T01:15:48.124813+0000","last_peered":"2024-09-12T01:15:48.124813+0000","last_clean":"2024-09-12T01:15:48.124813+0000","last_became_active":"2024-09-12T00:02:54.072431+0000","last_became_peered":"2024-09-12T00:02:54.072431+0000","last_unstale":"2024-09-12T01:15:48.124813+0000","last_undegraded":"2024-09-12T01:15:48.124813+0000","last_fullsized":"2024-09-12T01:15:48.124813+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:22.191371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1000,"num_write":1544,"num_write_kb":1370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.613978+0000","last_change":"2024-09-12T00:02:56.083934+0000","last_active":"2024-09-12T01:12:43.613978+0000","last_peered":"2024-09-12T01:12:43.613978+0000","last_clean":"2024-09-12T01:12:43.613978+0000","last_became_active":"2024-09-12T00:02:56.083643+0000","last_became_peered":"2024-09-12T00:02:56.083643+0000","last_unstale":"2024-09-12T01:12:43.613978+0000","last_undegraded":"2024-09-12T01:12:43.613978+0000","last_fullsized":"2024-09-12T01:12:43.613978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:28.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'154","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.228014+0000","last_change":"2024-09-12T00:02:58.096803+0000","last_active":"2024-09-12T01:11:43.228014+0000","last_peered":"2024-09-12T01:11:43.228014+0000","last_clean":"2024-09-12T01:11:43.228014+0000","last_became_active":"2024-09-12T00:02:58.096337+0000","last_became_peered":"2024-09-12T00:02:58.096337+0000","last_unstale":"2024-09-12T01:11:43.228014+0000","last_undegraded":"2024-09-12T01:11:43.228014+0000","last_fullsized":"2024-09-12T01:11:43.228014+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":374,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'343","reported_seq":1738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.729659+0000","last_change":"2024-09-12T00:02:50.063532+0000","last_active":"2024-09-12T01:15:09.729659+0000","last_peered":"2024-09-12T01:15:09.729659+0000","last_clean":"2024-09-12T01:15:09.729659+0000","last_became_active":"2024-09-12T00:02:50.063141+0000","last_became_peered":"2024-09-12T00:02:50.063141+0000","last_unstale":"2024-09-12T01:15:09.729659+0000","last_undegraded":"2024-09-12T01:15:09.729659+0000","last_fullsized":"2024-09-12T01:15:09.729659+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:36.757516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1807,"num_write":392,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397459+0000","last_change":"2024-09-12T00:02:31.950306+0000","last_active":"2024-09-12T01:12:43.397459+0000","last_peered":"2024-09-12T01:12:43.397459+0000","last_clean":"2024-09-12T01:12:43.397459+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T01:12:43.397459+0000","last_undegraded":"2024-09-12T01:12:43.397459+0000","last_fullsized":"2024-09-12T01:12:43.397459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_clean_scrub_stamp":"2024-09-12T00:02:29.944268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.076017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.515515+0000","last_change":"2024-09-12T00:02:38.003392+0000","last_active":"2024-09-12T01:13:28.515515+0000","last_peered":"2024-09-12T01:13:28.515515+0000","last_clean":"2024-09-12T01:13:28.515515+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T01:13:28.515515+0000","last_undegraded":"2024-09-12T01:13:28.515515+0000","last_fullsized":"2024-09-12T01:13:28.515515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.472492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'199","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154708+0000","last_change":"2024-09-12T00:02:48.048426+0000","last_active":"2024-09-12T01:15:48.154708+0000","last_peered":"2024-09-12T01:15:48.154708+0000","last_clean":"2024-09-12T01:15:48.154708+0000","last_became_active":"2024-09-12T00:02:48.047739+0000","last_became_peered":"2024-09-12T00:02:48.047739+0000","last_unstale":"2024-09-12T01:15:48.154708+0000","last_undegraded":"2024-09-12T01:15:48.154708+0000","last_fullsized":"2024-09-12T01:15:48.154708+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:56.338442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":439,"num_read_kb":34702,"num_write":919,"num_write_kb":51263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.405908+0000","last_change":"2024-09-12T00:02:52.065910+0000","last_active":"2024-09-12T01:13:43.405908+0000","last_peered":"2024-09-12T01:13:43.405908+0000","last_clean":"2024-09-12T01:13:43.405908+0000","last_became_active":"2024-09-12T00:02:52.065587+0000","last_became_peered":"2024-09-12T00:02:52.065587+0000","last_unstale":"2024-09-12T01:13:43.405908+0000","last_undegraded":"2024-09-12T01:13:43.405908+0000","last_fullsized":"2024-09-12T01:13:43.405908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:58.876252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'333","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.224680+0000","last_change":"2024-09-12T00:02:54.069602+0000","last_active":"2024-09-12T01:15:48.224680+0000","last_peered":"2024-09-12T01:15:48.224680+0000","last_clean":"2024-09-12T01:15:48.224680+0000","last_became_active":"2024-09-12T00:02:54.069167+0000","last_became_peered":"2024-09-12T00:02:54.069167+0000","last_unstale":"2024-09-12T01:15:48.224680+0000","last_undegraded":"2024-09-12T01:15:48.224680+0000","last_fullsized":"2024-09-12T01:15:48.224680+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.314767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":868,"num_write":580,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.239491+0000","last_change":"2024-09-12T00:02:56.083312+0000","last_active":"2024-09-12T01:12:15.239491+0000","last_peered":"2024-09-12T01:12:15.239491+0000","last_clean":"2024-09-12T01:12:15.239491+0000","last_became_active":"2024-09-12T00:02:56.082981+0000","last_became_peered":"2024-09-12T00:02:56.082981+0000","last_unstale":"2024-09-12T01:12:15.239491+0000","last_undegraded":"2024-09-12T01:12:15.239491+0000","last_fullsized":"2024-09-12T01:12:15.239491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:01.810212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'220","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.154487+0000","last_change":"2024-09-12T00:02:58.099932+0000","last_active":"2024-09-12T01:14:04.154487+0000","last_peered":"2024-09-12T01:14:04.154487+0000","last_clean":"2024-09-12T01:14:04.154487+0000","last_became_active":"2024-09-12T00:02:58.099655+0000","last_became_peered":"2024-09-12T00:02:58.099655+0000","last_unstale":"2024-09-12T01:14:04.154487+0000","last_undegraded":"2024-09-12T01:14:04.154487+0000","last_fullsized":"2024-09-12T01:14:04.154487+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:49.539153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1237,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":468,"num_write":474,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'874","reported_seq":2624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127264+0000","last_change":"2024-09-12T00:02:50.076009+0000","last_active":"2024-09-12T01:14:04.127264+0000","last_peered":"2024-09-12T01:14:04.127264+0000","last_clean":"2024-09-12T01:14:04.127264+0000","last_became_active":"2024-09-12T00:02:50.075700+0000","last_became_peered":"2024-09-12T00:02:50.075700+0000","last_unstale":"2024-09-12T01:14:04.127264+0000","last_undegraded":"2024-09-12T01:14:04.127264+0000","last_fullsized":"2024-09-12T01:14:04.127264+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.088247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4451,"num_read_kb":4025,"num_write":1186,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398157+0000","last_change":"2024-09-12T00:02:37.999892+0000","last_active":"2024-09-12T01:12:48.398157+0000","last_peered":"2024-09-12T01:12:48.398157+0000","last_clean":"2024-09-12T01:12:48.398157+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T01:12:48.398157+0000","last_undegraded":"2024-09-12T01:12:48.398157+0000","last_fullsized":"2024-09-12T01:12:48.398157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.336025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'211","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249465+0000","last_change":"2024-09-12T00:02:48.058588+0000","last_active":"2024-09-12T01:13:40.249465+0000","last_peered":"2024-09-12T01:13:40.249465+0000","last_clean":"2024-09-12T01:13:40.249465+0000","last_became_active":"2024-09-12T00:02:48.057849+0000","last_became_peered":"2024-09-12T00:02:48.057849+0000","last_unstale":"2024-09-12T01:13:40.249465+0000","last_undegraded":"2024-09-12T01:13:40.249465+0000","last_fullsized":"2024-09-12T01:13:40.249465+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:26.461055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14266353,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":516,"num_read_kb":138068,"num_write":1052,"num_write_kb":57312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.504352+0000","last_change":"2024-09-12T00:02:52.066638+0000","last_active":"2024-09-12T01:12:13.504352+0000","last_peered":"2024-09-12T01:12:13.504352+0000","last_clean":"2024-09-12T01:12:13.504352+0000","last_became_active":"2024-09-12T00:02:52.066352+0000","last_became_peered":"2024-09-12T00:02:52.066352+0000","last_unstale":"2024-09-12T01:12:13.504352+0000","last_undegraded":"2024-09-12T01:12:13.504352+0000","last_fullsized":"2024-09-12T01:12:13.504352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:43.605378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'935","reported_seq":2771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.138847+0000","last_change":"2024-09-12T00:02:54.070381+0000","last_active":"2024-09-12T01:15:48.138847+0000","last_peered":"2024-09-12T01:15:48.138847+0000","last_clean":"2024-09-12T01:15:48.138847+0000","last_became_active":"2024-09-12T00:02:54.070061+0000","last_became_peered":"2024-09-12T00:02:54.070061+0000","last_unstale":"2024-09-12T01:15:48.138847+0000","last_undegraded":"2024-09-12T01:15:48.138847+0000","last_fullsized":"2024-09-12T01:15:48.138847+0000","mapping_epoch":32,"log_start":"267'901","ondisk_log_start":"267'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":901,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:23.921978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23657,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1272,"num_read_kb":1457,"num_write":388,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390773+0000","last_change":"2024-09-12T00:02:56.078956+0000","last_active":"2024-09-12T01:11:53.390773+0000","last_peered":"2024-09-12T01:11:53.390773+0000","last_clean":"2024-09-12T01:11:53.390773+0000","last_became_active":"2024-09-12T00:02:56.078658+0000","last_became_peered":"2024-09-12T00:02:56.078658+0000","last_unstale":"2024-09-12T01:11:53.390773+0000","last_undegraded":"2024-09-12T01:11:53.390773+0000","last_fullsized":"2024-09-12T01:11:53.390773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:42.358383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'171","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:33.233571+0000","last_change":"2024-09-12T00:02:58.089668+0000","last_active":"2024-09-12T01:12:33.233571+0000","last_peered":"2024-09-12T01:12:33.233571+0000","last_clean":"2024-09-12T01:12:33.233571+0000","last_became_active":"2024-09-12T00:02:58.089378+0000","last_became_peered":"2024-09-12T00:02:58.089378+0000","last_unstale":"2024-09-12T01:12:33.233571+0000","last_undegraded":"2024-09-12T01:12:33.233571+0000","last_fullsized":"2024-09-12T01:12:33.233571+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.424097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":336,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'1105","reported_seq":2822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128513+0000","last_change":"2024-09-12T00:02:50.069236+0000","last_active":"2024-09-12T01:14:04.128513+0000","last_peered":"2024-09-12T01:14:04.128513+0000","last_clean":"2024-09-12T01:14:04.128513+0000","last_became_active":"2024-09-12T00:02:50.067002+0000","last_became_peered":"2024-09-12T00:02:50.067002+0000","last_unstale":"2024-09-12T01:14:04.128513+0000","last_undegraded":"2024-09-12T01:14:04.128513+0000","last_fullsized":"2024-09-12T01:14:04.128513+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.055428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5247,"num_read_kb":4613,"num_write":1599,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.231834+0000","last_change":"2024-09-12T00:02:37.999935+0000","last_active":"2024-09-12T01:13:28.231834+0000","last_peered":"2024-09-12T01:13:28.231834+0000","last_clean":"2024-09-12T01:13:28.231834+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T01:13:28.231834+0000","last_undegraded":"2024-09-12T01:13:28.231834+0000","last_fullsized":"2024-09-12T01:13:28.231834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:36.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'185","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167361+0000","last_change":"2024-09-12T00:02:48.044496+0000","last_active":"2024-09-12T01:15:48.167361+0000","last_peered":"2024-09-12T01:15:48.167361+0000","last_clean":"2024-09-12T01:15:48.167361+0000","last_became_active":"2024-09-12T00:02:48.044126+0000","last_became_peered":"2024-09-12T00:02:48.044126+0000","last_unstale":"2024-09-12T01:15:48.167361+0000","last_undegraded":"2024-09-12T01:15:48.167361+0000","last_fullsized":"2024-09-12T01:15:48.167361+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:22.117737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4751719,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":400,"num_read_kb":27065,"num_write":781,"num_write_kb":40333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.223592+0000","last_change":"2024-09-12T00:02:52.068671+0000","last_active":"2024-09-12T01:12:13.223592+0000","last_peered":"2024-09-12T01:12:13.223592+0000","last_clean":"2024-09-12T01:12:13.223592+0000","last_became_active":"2024-09-12T00:02:52.068351+0000","last_became_peered":"2024-09-12T00:02:52.068351+0000","last_unstale":"2024-09-12T01:12:13.223592+0000","last_undegraded":"2024-09-12T01:12:13.223592+0000","last_fullsized":"2024-09-12T01:12:13.223592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:00.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'302","reported_seq":1732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.187593+0000","last_change":"2024-09-12T00:02:54.241862+0000","last_active":"2024-09-12T01:15:08.187593+0000","last_peered":"2024-09-12T01:15:08.187593+0000","last_clean":"2024-09-12T01:15:08.187593+0000","last_became_active":"2024-09-12T00:02:54.241581+0000","last_became_peered":"2024-09-12T00:02:54.241581+0000","last_unstale":"2024-09-12T01:15:08.187593+0000","last_undegraded":"2024-09-12T01:15:08.187593+0000","last_fullsized":"2024-09-12T01:15:08.187593+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:51.409146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":254,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235605+0000","last_change":"2024-09-12T00:02:56.081949+0000","last_active":"2024-09-12T01:11:40.235605+0000","last_peered":"2024-09-12T01:11:40.235605+0000","last_clean":"2024-09-12T01:11:40.235605+0000","last_became_active":"2024-09-12T00:02:56.081641+0000","last_became_peered":"2024-09-12T00:02:56.081641+0000","last_unstale":"2024-09-12T01:11:40.235605+0000","last_undegraded":"2024-09-12T01:11:40.235605+0000","last_fullsized":"2024-09-12T01:11:40.235605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:16.553415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'273","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.410516+0000","last_change":"2024-09-12T00:02:58.088758+0000","last_active":"2024-09-12T01:14:04.410516+0000","last_peered":"2024-09-12T01:14:04.410516+0000","last_clean":"2024-09-12T01:14:04.410516+0000","last_became_active":"2024-09-12T00:02:58.088442+0000","last_became_peered":"2024-09-12T00:02:58.088442+0000","last_unstale":"2024-09-12T01:14:04.410516+0000","last_undegraded":"2024-09-12T01:14:04.410516+0000","last_fullsized":"2024-09-12T01:14:04.410516+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:27.430742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":615,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'437","reported_seq":2013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061424+0000","last_change":"2024-09-12T00:03:21.140992+0000","last_active":"2024-09-12T01:13:06.061424+0000","last_peered":"2024-09-12T01:13:06.061424+0000","last_clean":"2024-09-12T01:13:06.061424+0000","last_became_active":"2024-09-12T00:03:21.140691+0000","last_became_peered":"2024-09-12T00:03:21.140691+0000","last_unstale":"2024-09-12T01:13:06.061424+0000","last_undegraded":"2024-09-12T01:13:06.061424+0000","last_fullsized":"2024-09-12T01:13:06.061424+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:09.243706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2439,"num_read_kb":2322,"num_write":494,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.515475+0000","last_change":"2024-09-12T00:02:38.004050+0000","last_active":"2024-09-12T01:13:28.515475+0000","last_peered":"2024-09-12T01:13:28.515475+0000","last_clean":"2024-09-12T01:13:28.515475+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T01:13:28.515475+0000","last_undegraded":"2024-09-12T01:13:28.515475+0000","last_fullsized":"2024-09-12T01:13:28.515475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:14.983821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'207","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.079182+0000","last_change":"2024-09-12T00:02:48.049579+0000","last_active":"2024-09-12T01:15:48.079182+0000","last_peered":"2024-09-12T01:15:48.079182+0000","last_clean":"2024-09-12T01:15:48.079182+0000","last_became_active":"2024-09-12T00:02:48.049260+0000","last_became_peered":"2024-09-12T00:02:48.049260+0000","last_unstale":"2024-09-12T01:15:48.079182+0000","last_undegraded":"2024-09-12T01:15:48.079182+0000","last_fullsized":"2024-09-12T01:15:48.079182+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:34.461974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":103584,"num_write":943,"num_write_kb":20218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.237256+0000","last_change":"2024-09-12T00:02:52.066733+0000","last_active":"2024-09-12T01:11:55.237256+0000","last_peered":"2024-09-12T01:11:55.237256+0000","last_clean":"2024-09-12T01:11:55.237256+0000","last_became_active":"2024-09-12T00:02:52.066289+0000","last_became_peered":"2024-09-12T00:02:52.066289+0000","last_unstale":"2024-09-12T01:11:55.237256+0000","last_undegraded":"2024-09-12T01:11:55.237256+0000","last_fullsized":"2024-09-12T01:11:55.237256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:55.049376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'159","reported_seq":725,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:02.202549+0000","last_change":"2024-09-12T00:02:54.067179+0000","last_active":"2024-09-12T01:15:02.202549+0000","last_peered":"2024-09-12T01:15:02.202549+0000","last_clean":"2024-09-12T01:15:02.202549+0000","last_became_active":"2024-09-12T00:02:54.066864+0000","last_became_peered":"2024-09-12T00:02:54.066864+0000","last_unstale":"2024-09-12T01:15:02.202549+0000","last_undegraded":"2024-09-12T01:15:02.202549+0000","last_fullsized":"2024-09-12T01:15:02.202549+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:34.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":203,"num_read_kb":195,"num_write":150,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.610434+0000","last_change":"2024-09-12T00:02:56.085732+0000","last_active":"2024-09-12T01:12:18.610434+0000","last_peered":"2024-09-12T01:12:18.610434+0000","last_clean":"2024-09-12T01:12:18.610434+0000","last_became_active":"2024-09-12T00:02:56.085437+0000","last_became_peered":"2024-09-12T00:02:56.085437+0000","last_unstale":"2024-09-12T01:12:18.610434+0000","last_undegraded":"2024-09-12T01:12:18.610434+0000","last_fullsized":"2024-09-12T01:12:18.610434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:41.321446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'109","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.524360+0000","last_change":"2024-09-12T00:02:58.095790+0000","last_active":"2024-09-12T01:14:28.524360+0000","last_peered":"2024-09-12T01:14:28.524360+0000","last_clean":"2024-09-12T01:14:28.524360+0000","last_became_active":"2024-09-12T00:02:58.095419+0000","last_became_peered":"2024-09-12T00:02:58.095419+0000","last_unstale":"2024-09-12T01:14:28.524360+0000","last_undegraded":"2024-09-12T01:14:28.524360+0000","last_fullsized":"2024-09-12T01:14:28.524360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":189,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'415","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.241281+0000","last_change":"2024-09-12T00:02:50.075586+0000","last_active":"2024-09-12T01:13:43.241281+0000","last_peered":"2024-09-12T01:13:43.241281+0000","last_clean":"2024-09-12T01:13:43.241281+0000","last_became_active":"2024-09-12T00:02:50.075209+0000","last_became_peered":"2024-09-12T00:02:50.075209+0000","last_unstale":"2024-09-12T01:13:43.241281+0000","last_undegraded":"2024-09-12T01:13:43.241281+0000","last_fullsized":"2024-09-12T01:13:43.241281+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:32.991455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2214,"num_read_kb":2093,"num_write":483,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'191","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.259489+0000","last_change":"2024-09-12T00:02:48.054875+0000","last_active":"2024-09-12T01:15:48.259489+0000","last_peered":"2024-09-12T01:15:48.259489+0000","last_clean":"2024-09-12T01:15:48.259489+0000","last_became_active":"2024-09-12T00:02:48.052751+0000","last_became_peered":"2024-09-12T00:02:48.052751+0000","last_unstale":"2024-09-12T01:15:48.259489+0000","last_undegraded":"2024-09-12T01:15:48.259489+0000","last_fullsized":"2024-09-12T01:15:48.259489+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493417,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":26295,"num_write":910,"num_write_kb":36863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.239685+0000","last_change":"2024-09-12T00:02:38.007657+0000","last_active":"2024-09-12T01:13:28.239685+0000","last_peered":"2024-09-12T01:13:28.239685+0000","last_clean":"2024-09-12T01:13:28.239685+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T01:13:28.239685+0000","last_undegraded":"2024-09-12T01:13:28.239685+0000","last_fullsized":"2024-09-12T01:13:28.239685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:40.382288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235592+0000","last_change":"2024-09-12T00:02:52.067482+0000","last_active":"2024-09-12T01:11:40.235592+0000","last_peered":"2024-09-12T01:11:40.235592+0000","last_clean":"2024-09-12T01:11:40.235592+0000","last_became_active":"2024-09-12T00:02:52.067200+0000","last_became_peered":"2024-09-12T00:02:52.067200+0000","last_unstale":"2024-09-12T01:11:40.235592+0000","last_undegraded":"2024-09-12T01:11:40.235592+0000","last_fullsized":"2024-09-12T01:11:40.235592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:28.955322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'299","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.870818+0000","last_change":"2024-09-12T00:02:54.069403+0000","last_active":"2024-09-12T01:15:10.870818+0000","last_peered":"2024-09-12T01:15:10.870818+0000","last_clean":"2024-09-12T01:15:10.870818+0000","last_became_active":"2024-09-12T00:02:54.069071+0000","last_became_peered":"2024-09-12T00:02:54.069071+0000","last_unstale":"2024-09-12T01:15:10.870818+0000","last_undegraded":"2024-09-12T01:15:10.870818+0000","last_fullsized":"2024-09-12T01:15:10.870818+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:01.293660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":432,"num_read_kb":552,"num_write":250,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.387679+0000","last_change":"2024-09-12T00:02:56.082353+0000","last_active":"2024-09-12T01:11:43.387679+0000","last_peered":"2024-09-12T01:11:43.387679+0000","last_clean":"2024-09-12T01:11:43.387679+0000","last_became_active":"2024-09-12T00:02:56.082046+0000","last_became_peered":"2024-09-12T00:02:56.082046+0000","last_unstale":"2024-09-12T01:11:43.387679+0000","last_undegraded":"2024-09-12T01:11:43.387679+0000","last_fullsized":"2024-09-12T01:11:43.387679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:22.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'163","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.352871+0000","last_change":"2024-09-12T00:02:58.091879+0000","last_active":"2024-09-12T01:14:00.352871+0000","last_peered":"2024-09-12T01:14:00.352871+0000","last_clean":"2024-09-12T01:14:00.352871+0000","last_became_active":"2024-09-12T00:02:58.091590+0000","last_became_peered":"2024-09-12T00:02:58.091590+0000","last_unstale":"2024-09-12T01:14:00.352871+0000","last_undegraded":"2024-09-12T01:14:00.352871+0000","last_fullsized":"2024-09-12T01:14:00.352871+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:04.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1150,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":174,"num_write":425,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'450","reported_seq":1993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249513+0000","last_change":"2024-09-12T00:02:50.073492+0000","last_active":"2024-09-12T01:13:40.249513+0000","last_peered":"2024-09-12T01:13:40.249513+0000","last_clean":"2024-09-12T01:13:40.249513+0000","last_became_active":"2024-09-12T00:02:50.073262+0000","last_became_peered":"2024-09-12T00:02:50.073262+0000","last_unstale":"2024-09-12T01:13:40.249513+0000","last_undegraded":"2024-09-12T01:13:40.249513+0000","last_fullsized":"2024-09-12T01:13:40.249513+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.830556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2298,"num_read_kb":2165,"num_write":516,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'158","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.234561+0000","last_change":"2024-09-12T00:02:48.053125+0000","last_active":"2024-09-12T01:15:48.234561+0000","last_peered":"2024-09-12T01:15:48.234561+0000","last_clean":"2024-09-12T01:15:48.234561+0000","last_became_active":"2024-09-12T00:02:48.052768+0000","last_became_peered":"2024-09-12T00:02:48.052768+0000","last_unstale":"2024-09-12T01:15:48.234561+0000","last_undegraded":"2024-09-12T01:15:48.234561+0000","last_fullsized":"2024-09-12T01:15:48.234561+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:37.886716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3687654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":16851,"num_write":770,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.405106+0000","last_change":"2024-09-12T00:02:37.999991+0000","last_active":"2024-09-12T01:13:38.405106+0000","last_peered":"2024-09-12T01:13:38.405106+0000","last_clean":"2024-09-12T01:13:38.405106+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T01:13:38.405106+0000","last_undegraded":"2024-09-12T01:13:38.405106+0000","last_fullsized":"2024-09-12T01:13:38.405106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622249+0000","last_change":"2024-09-12T00:02:52.069738+0000","last_active":"2024-09-12T01:13:43.622249+0000","last_peered":"2024-09-12T01:13:43.622249+0000","last_clean":"2024-09-12T01:13:43.622249+0000","last_became_active":"2024-09-12T00:02:52.069469+0000","last_became_peered":"2024-09-12T00:02:52.069469+0000","last_unstale":"2024-09-12T01:13:43.622249+0000","last_undegraded":"2024-09-12T01:13:43.622249+0000","last_fullsized":"2024-09-12T01:13:43.622249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:53.012401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'259","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.188900+0000","last_change":"2024-09-12T00:02:54.240228+0000","last_active":"2024-09-12T01:14:02.188900+0000","last_peered":"2024-09-12T01:14:02.188900+0000","last_clean":"2024-09-12T01:14:02.188900+0000","last_became_active":"2024-09-12T00:02:54.239879+0000","last_became_peered":"2024-09-12T00:02:54.239879+0000","last_unstale":"2024-09-12T01:14:02.188900+0000","last_undegraded":"2024-09-12T01:14:02.188900+0000","last_fullsized":"2024-09-12T01:14:02.188900+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:03.113532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":332,"num_read_kb":322,"num_write":304,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'793","reported_seq":5263,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.252240+0000","last_change":"2024-09-12T00:02:56.087559+0000","last_active":"2024-09-12T01:15:48.252240+0000","last_peered":"2024-09-12T01:15:48.252240+0000","last_clean":"2024-09-12T01:15:48.252240+0000","last_became_active":"2024-09-12T00:02:56.086704+0000","last_became_peered":"2024-09-12T00:02:56.086704+0000","last_unstale":"2024-09-12T01:15:48.252240+0000","last_undegraded":"2024-09-12T01:15:48.252240+0000","last_fullsized":"2024-09-12T01:15:48.252240+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:41.420237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'152","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.251702+0000","last_change":"2024-09-12T00:02:58.091748+0000","last_active":"2024-09-12T01:15:08.251702+0000","last_peered":"2024-09-12T01:15:08.251702+0000","last_clean":"2024-09-12T01:15:08.251702+0000","last_became_active":"2024-09-12T00:02:58.091466+0000","last_became_peered":"2024-09-12T00:02:58.091466+0000","last_unstale":"2024-09-12T01:15:08.251702+0000","last_undegraded":"2024-09-12T01:15:08.251702+0000","last_fullsized":"2024-09-12T01:15:08.251702+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":335,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'989","reported_seq":2652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.864836+0000","last_change":"2024-09-12T00:02:50.068181+0000","last_active":"2024-09-12T01:13:20.864836+0000","last_peered":"2024-09-12T01:13:20.864836+0000","last_clean":"2024-09-12T01:13:20.864836+0000","last_became_active":"2024-09-12T00:02:50.067868+0000","last_became_peered":"2024-09-12T00:02:50.067868+0000","last_unstale":"2024-09-12T01:13:20.864836+0000","last_undegraded":"2024-09-12T01:13:20.864836+0000","last_fullsized":"2024-09-12T01:13:20.864836+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":900,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:02.445799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4764,"num_read_kb":4246,"num_write":1341,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'173","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.244938+0000","last_change":"2024-09-12T00:02:48.052760+0000","last_active":"2024-09-12T01:14:18.244938+0000","last_peered":"2024-09-12T01:14:18.244938+0000","last_clean":"2024-09-12T01:14:18.244938+0000","last_became_active":"2024-09-12T00:02:48.052431+0000","last_became_peered":"2024-09-12T00:02:48.052431+0000","last_unstale":"2024-09-12T01:14:18.244938+0000","last_undegraded":"2024-09-12T01:14:18.244938+0000","last_fullsized":"2024-09-12T01:14:18.244938+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:51.003972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1212092,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":121623,"num_write":831,"num_write_kb":33084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229731+0000","last_change":"2024-09-12T00:02:38.007684+0000","last_active":"2024-09-12T01:11:58.229731+0000","last_peered":"2024-09-12T01:11:58.229731+0000","last_clean":"2024-09-12T01:11:58.229731+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T01:11:58.229731+0000","last_undegraded":"2024-09-12T01:11:58.229731+0000","last_fullsized":"2024-09-12T01:11:58.229731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.596959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257884+0000","last_change":"2024-09-12T00:02:52.062924+0000","last_active":"2024-09-12T01:13:43.257884+0000","last_peered":"2024-09-12T01:13:43.257884+0000","last_clean":"2024-09-12T01:13:43.257884+0000","last_became_active":"2024-09-12T00:02:52.062631+0000","last_became_peered":"2024-09-12T00:02:52.062631+0000","last_unstale":"2024-09-12T01:13:43.257884+0000","last_undegraded":"2024-09-12T01:13:43.257884+0000","last_fullsized":"2024-09-12T01:13:43.257884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:03.938023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'137","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257905+0000","last_change":"2024-09-12T00:02:54.069239+0000","last_active":"2024-09-12T01:13:43.257905+0000","last_peered":"2024-09-12T01:13:43.257905+0000","last_clean":"2024-09-12T01:13:43.257905+0000","last_became_active":"2024-09-12T00:02:54.068812+0000","last_became_peered":"2024-09-12T00:02:54.068812+0000","last_unstale":"2024-09-12T01:13:43.257905+0000","last_undegraded":"2024-09-12T01:13:43.257905+0000","last_fullsized":"2024-09-12T01:13:43.257905+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:58.060604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":169,"num_write":118,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'807","reported_seq":2608,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.959102+0000","last_change":"2024-09-12T00:02:56.084227+0000","last_active":"2024-09-12T01:15:47.959102+0000","last_peered":"2024-09-12T01:15:47.959102+0000","last_clean":"2024-09-12T01:15:47.959102+0000","last_became_active":"2024-09-12T00:02:56.083894+0000","last_became_peered":"2024-09-12T00:02:56.083894+0000","last_unstale":"2024-09-12T01:15:47.959102+0000","last_undegraded":"2024-09-12T01:15:47.959102+0000","last_fullsized":"2024-09-12T01:15:47.959102+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:40.096034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'273","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242702+0000","last_change":"2024-09-12T00:02:58.093731+0000","last_active":"2024-09-12T01:12:45.242702+0000","last_peered":"2024-09-12T01:12:45.242702+0000","last_clean":"2024-09-12T01:12:45.242702+0000","last_became_active":"2024-09-12T00:02:58.093442+0000","last_became_peered":"2024-09-12T00:02:58.093442+0000","last_unstale":"2024-09-12T01:12:45.242702+0000","last_undegraded":"2024-09-12T01:12:45.242702+0000","last_fullsized":"2024-09-12T01:12:45.242702+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:58.495113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":340,"num_read_kb":339,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'411","reported_seq":1918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956504+0000","last_change":"2024-09-12T00:02:50.058382+0000","last_active":"2024-09-12T01:14:02.956504+0000","last_peered":"2024-09-12T01:14:02.956504+0000","last_clean":"2024-09-12T01:14:02.956504+0000","last_became_active":"2024-09-12T00:02:50.057999+0000","last_became_peered":"2024-09-12T00:02:50.057999+0000","last_unstale":"2024-09-12T01:14:02.956504+0000","last_undegraded":"2024-09-12T01:14:02.956504+0000","last_fullsized":"2024-09-12T01:14:02.956504+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:37.001555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2267,"num_read_kb":2133,"num_write":493,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'268","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:46.122696+0000","last_change":"2024-09-12T00:02:48.051832+0000","last_active":"2024-09-12T01:13:46.122696+0000","last_peered":"2024-09-12T01:13:46.122696+0000","last_clean":"2024-09-12T01:13:46.122696+0000","last_became_active":"2024-09-12T00:02:48.051495+0000","last_became_peered":"2024-09-12T00:02:48.051495+0000","last_unstale":"2024-09-12T01:13:46.122696+0000","last_undegraded":"2024-09-12T01:13:46.122696+0000","last_fullsized":"2024-09-12T01:13:46.122696+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:15.411092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864181,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":668,"num_read_kb":18611,"num_write":1218,"num_write_kb":43211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607868+0000","last_change":"2024-09-12T00:02:38.760426+0000","last_active":"2024-09-12T01:11:58.607868+0000","last_peered":"2024-09-12T01:11:58.607868+0000","last_clean":"2024-09-12T01:11:58.607868+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T01:11:58.607868+0000","last_undegraded":"2024-09-12T01:11:58.607868+0000","last_fullsized":"2024-09-12T01:11:58.607868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:03.698275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455282+0000","last_change":"2024-09-12T00:02:52.062908+0000","last_active":"2024-09-12T01:12:58.455282+0000","last_peered":"2024-09-12T01:12:58.455282+0000","last_clean":"2024-09-12T01:12:58.455282+0000","last_became_active":"2024-09-12T00:02:52.062544+0000","last_became_peered":"2024-09-12T00:02:52.062544+0000","last_unstale":"2024-09-12T01:12:58.455282+0000","last_undegraded":"2024-09-12T01:12:58.455282+0000","last_fullsized":"2024-09-12T01:12:58.455282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:54.138905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'358","reported_seq":1105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.290569+0000","last_change":"2024-09-12T00:02:54.239678+0000","last_active":"2024-09-12T01:15:48.290569+0000","last_peered":"2024-09-12T01:15:48.290569+0000","last_clean":"2024-09-12T01:15:48.290569+0000","last_became_active":"2024-09-12T00:02:54.239355+0000","last_became_peered":"2024-09-12T00:02:54.239355+0000","last_unstale":"2024-09-12T01:15:48.290569+0000","last_undegraded":"2024-09-12T01:15:48.290569+0000","last_fullsized":"2024-09-12T01:15:48.290569+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:10.540534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":736,"num_write":272,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.446391+0000","last_change":"2024-09-12T00:02:56.087894+0000","last_active":"2024-09-12T01:11:43.446391+0000","last_peered":"2024-09-12T01:11:43.446391+0000","last_clean":"2024-09-12T01:11:43.446391+0000","last_became_active":"2024-09-12T00:02:56.087448+0000","last_became_peered":"2024-09-12T00:02:56.087448+0000","last_unstale":"2024-09-12T01:11:43.446391+0000","last_undegraded":"2024-09-12T01:11:43.446391+0000","last_fullsized":"2024-09-12T01:11:43.446391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:19.357528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'125","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.291357+0000","last_change":"2024-09-12T00:02:58.100159+0000","last_active":"2024-09-12T01:12:58.291357+0000","last_peered":"2024-09-12T01:12:58.291357+0000","last_clean":"2024-09-12T01:12:58.291357+0000","last_became_active":"2024-09-12T00:02:58.099906+0000","last_became_peered":"2024-09-12T00:02:58.099906+0000","last_unstale":"2024-09-12T01:12:58.291357+0000","last_undegraded":"2024-09-12T01:12:58.291357+0000","last_fullsized":"2024-09-12T01:12:58.291357+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:36.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":140,"num_write":299,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'130","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.571352+0000","last_change":"2024-09-12T00:02:58.099964+0000","last_active":"2024-09-12T01:15:09.571352+0000","last_peered":"2024-09-12T01:15:09.571352+0000","last_clean":"2024-09-12T01:15:09.571352+0000","last_became_active":"2024-09-12T00:02:58.099564+0000","last_became_peered":"2024-09-12T00:02:58.099564+0000","last_unstale":"2024-09-12T01:15:09.571352+0000","last_undegraded":"2024-09-12T01:15:09.571352+0000","last_fullsized":"2024-09-12T01:15:09.571352+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:10.174347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":201,"num_write":295,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'827","reported_seq":2372,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.862987+0000","last_change":"2024-09-12T00:02:50.064386+0000","last_active":"2024-09-12T01:13:20.862987+0000","last_peered":"2024-09-12T01:13:20.862987+0000","last_clean":"2024-09-12T01:13:20.862987+0000","last_became_active":"2024-09-12T00:02:50.063351+0000","last_became_peered":"2024-09-12T00:02:50.063351+0000","last_unstale":"2024-09-12T01:13:20.862987+0000","last_undegraded":"2024-09-12T01:13:20.862987+0000","last_fullsized":"2024-09-12T01:13:20.862987+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:44.265606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3851,"num_read_kb":3457,"num_write":1080,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'158","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.079218+0000","last_change":"2024-09-12T00:02:48.048545+0000","last_active":"2024-09-12T01:15:48.079218+0000","last_peered":"2024-09-12T01:15:48.079218+0000","last_clean":"2024-09-12T01:15:48.079218+0000","last_became_active":"2024-09-12T00:02:48.047723+0000","last_became_peered":"2024-09-12T00:02:48.047723+0000","last_unstale":"2024-09-12T01:15:48.079218+0000","last_undegraded":"2024-09-12T01:15:48.079218+0000","last_fullsized":"2024-09-12T01:15:48.079218+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:13.827704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":26182,"num_write":818,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.235888+0000","last_change":"2024-09-12T00:02:52.067136+0000","last_active":"2024-09-12T01:12:53.235888+0000","last_peered":"2024-09-12T01:12:53.235888+0000","last_clean":"2024-09-12T01:12:53.235888+0000","last_became_active":"2024-09-12T00:02:52.066702+0000","last_became_peered":"2024-09-12T00:02:52.066702+0000","last_unstale":"2024-09-12T01:12:53.235888+0000","last_undegraded":"2024-09-12T01:12:53.235888+0000","last_fullsized":"2024-09-12T01:12:53.235888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:51.618720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'196","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.171053+0000","last_change":"2024-09-12T00:02:54.067156+0000","last_active":"2024-09-12T01:15:48.171053+0000","last_peered":"2024-09-12T01:15:48.171053+0000","last_clean":"2024-09-12T01:15:48.171053+0000","last_became_active":"2024-09-12T00:02:54.066679+0000","last_became_peered":"2024-09-12T00:02:54.066679+0000","last_unstale":"2024-09-12T01:15:48.171053+0000","last_undegraded":"2024-09-12T01:15:48.171053+0000","last_fullsized":"2024-09-12T01:15:48.171053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:44.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":343,"num_write":152,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455258+0000","last_change":"2024-09-12T00:02:56.081781+0000","last_active":"2024-09-12T01:12:58.455258+0000","last_peered":"2024-09-12T01:12:58.455258+0000","last_clean":"2024-09-12T01:12:58.455258+0000","last_became_active":"2024-09-12T00:02:56.081445+0000","last_became_peered":"2024-09-12T00:02:56.081445+0000","last_unstale":"2024-09-12T01:12:58.455258+0000","last_undegraded":"2024-09-12T01:12:58.455258+0000","last_fullsized":"2024-09-12T01:12:58.455258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.185278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'151","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.456004+0000","last_change":"2024-09-12T00:02:58.097284+0000","last_active":"2024-09-12T01:13:03.456004+0000","last_peered":"2024-09-12T01:13:03.456004+0000","last_clean":"2024-09-12T01:13:03.456004+0000","last_became_active":"2024-09-12T00:02:58.096979+0000","last_became_peered":"2024-09-12T00:02:58.096979+0000","last_unstale":"2024-09-12T01:13:03.456004+0000","last_undegraded":"2024-09-12T01:13:03.456004+0000","last_fullsized":"2024-09-12T01:13:03.456004+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:10.194576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":142,"num_write":377,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'428","reported_seq":1977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.278516+0000","last_change":"2024-09-12T00:02:50.066578+0000","last_active":"2024-09-12T01:13:32.278516+0000","last_peered":"2024-09-12T01:13:32.278516+0000","last_clean":"2024-09-12T01:13:32.278516+0000","last_became_active":"2024-09-12T00:02:50.065307+0000","last_became_peered":"2024-09-12T00:02:50.065307+0000","last_unstale":"2024-09-12T01:13:32.278516+0000","last_undegraded":"2024-09-12T01:13:32.278516+0000","last_fullsized":"2024-09-12T01:13:32.278516+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:31.996369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2299,"num_read_kb":2174,"num_write":505,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'162","reported_seq":774,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.163753+0000","last_change":"2024-09-12T00:02:48.051718+0000","last_active":"2024-09-12T01:15:48.163753+0000","last_peered":"2024-09-12T01:15:48.163753+0000","last_clean":"2024-09-12T01:15:48.163753+0000","last_became_active":"2024-09-12T00:02:48.048506+0000","last_became_peered":"2024-09-12T00:02:48.048506+0000","last_unstale":"2024-09-12T01:15:48.163753+0000","last_undegraded":"2024-09-12T01:15:48.163753+0000","last_fullsized":"2024-09-12T01:15:48.163753+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:49.124459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":321,"num_read_kb":61867,"num_write":777,"num_write_kb":44911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.454749+0000","last_change":"2024-09-12T00:02:52.065265+0000","last_active":"2024-09-12T01:12:53.454749+0000","last_peered":"2024-09-12T01:12:53.454749+0000","last_clean":"2024-09-12T01:12:53.454749+0000","last_became_active":"2024-09-12T00:02:52.064967+0000","last_became_peered":"2024-09-12T00:02:52.064967+0000","last_unstale":"2024-09-12T01:12:53.454749+0000","last_undegraded":"2024-09-12T01:12:53.454749+0000","last_fullsized":"2024-09-12T01:12:53.454749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.210086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'59","reported_seq":576,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.171183+0000","last_change":"2024-09-12T00:02:54.067540+0000","last_active":"2024-09-12T01:13:29.171183+0000","last_peered":"2024-09-12T01:13:29.171183+0000","last_clean":"2024-09-12T01:13:29.171183+0000","last_became_active":"2024-09-12T00:02:54.067255+0000","last_became_peered":"2024-09-12T00:02:54.067255+0000","last_unstale":"2024-09-12T01:13:29.171183+0000","last_undegraded":"2024-09-12T01:13:29.171183+0000","last_fullsized":"2024-09-12T01:13:29.171183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:18.453952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399626+0000","last_change":"2024-09-12T00:02:56.079344+0000","last_active":"2024-09-12T01:12:58.399626+0000","last_peered":"2024-09-12T01:12:58.399626+0000","last_clean":"2024-09-12T01:12:58.399626+0000","last_became_active":"2024-09-12T00:02:56.079057+0000","last_became_peered":"2024-09-12T00:02:56.079057+0000","last_unstale":"2024-09-12T01:12:58.399626+0000","last_undegraded":"2024-09-12T01:12:58.399626+0000","last_fullsized":"2024-09-12T01:12:58.399626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:17.425376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'185","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.012822+0000","last_change":"2024-09-12T00:02:58.091784+0000","last_active":"2024-09-12T01:14:03.012822+0000","last_peered":"2024-09-12T01:14:03.012822+0000","last_clean":"2024-09-12T01:14:03.012822+0000","last_became_active":"2024-09-12T00:02:58.091505+0000","last_became_peered":"2024-09-12T00:02:58.091505+0000","last_unstale":"2024-09-12T01:14:03.012822+0000","last_undegraded":"2024-09-12T01:14:03.012822+0000","last_fullsized":"2024-09-12T01:14:03.012822+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:32.965615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":268,"num_read_kb":263,"num_write":396,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'443","reported_seq":1915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.057934+0000","last_change":"2024-09-12T00:02:50.068429+0000","last_active":"2024-09-12T01:13:06.057934+0000","last_peered":"2024-09-12T01:13:06.057934+0000","last_clean":"2024-09-12T01:13:06.057934+0000","last_became_active":"2024-09-12T00:02:50.068129+0000","last_became_peered":"2024-09-12T00:02:50.068129+0000","last_unstale":"2024-09-12T01:13:06.057934+0000","last_undegraded":"2024-09-12T01:13:06.057934+0000","last_fullsized":"2024-09-12T01:13:06.057934+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:38.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2203,"num_read_kb":2070,"num_write":514,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'206","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.261460+0000","last_change":"2024-09-12T00:02:48.050120+0000","last_active":"2024-09-12T01:15:48.261460+0000","last_peered":"2024-09-12T01:15:48.261460+0000","last_clean":"2024-09-12T01:15:48.261460+0000","last_became_active":"2024-09-12T00:02:48.049791+0000","last_became_peered":"2024-09-12T00:02:48.049791+0000","last_unstale":"2024-09-12T01:15:48.261460+0000","last_undegraded":"2024-09-12T01:15:48.261460+0000","last_fullsized":"2024-09-12T01:15:48.261460+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:02.402223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":116478,"num_write":1001,"num_write_kb":35286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398938+0000","last_change":"2024-09-12T00:02:52.071771+0000","last_active":"2024-09-12T01:12:53.398938+0000","last_peered":"2024-09-12T01:12:53.398938+0000","last_clean":"2024-09-12T01:12:53.398938+0000","last_became_active":"2024-09-12T00:02:52.071502+0000","last_became_peered":"2024-09-12T00:02:52.071502+0000","last_unstale":"2024-09-12T01:12:53.398938+0000","last_undegraded":"2024-09-12T01:12:53.398938+0000","last_fullsized":"2024-09-12T01:12:53.398938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:36.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'203","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.061053+0000","last_change":"2024-09-12T00:02:54.069300+0000","last_active":"2024-09-12T01:15:48.061053+0000","last_peered":"2024-09-12T01:15:48.061053+0000","last_clean":"2024-09-12T01:15:48.061053+0000","last_became_active":"2024-09-12T00:02:54.067314+0000","last_became_peered":"2024-09-12T00:02:54.067314+0000","last_unstale":"2024-09-12T01:15:48.061053+0000","last_undegraded":"2024-09-12T01:15:48.061053+0000","last_fullsized":"2024-09-12T01:15:48.061053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:25.593409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18955,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":388,"num_write":160,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616059+0000","last_change":"2024-09-12T00:02:56.084951+0000","last_active":"2024-09-12T01:12:58.616059+0000","last_peered":"2024-09-12T01:12:58.616059+0000","last_clean":"2024-09-12T01:12:58.616059+0000","last_became_active":"2024-09-12T00:02:56.084651+0000","last_became_peered":"2024-09-12T00:02:56.084651+0000","last_unstale":"2024-09-12T01:12:58.616059+0000","last_undegraded":"2024-09-12T01:12:58.616059+0000","last_fullsized":"2024-09-12T01:12:58.616059+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.763159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'155","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:05.706621+0000","last_change":"2024-09-12T00:02:58.100001+0000","last_active":"2024-09-12T01:13:05.706621+0000","last_peered":"2024-09-12T01:13:05.706621+0000","last_clean":"2024-09-12T01:13:05.706621+0000","last_became_active":"2024-09-12T00:02:58.099635+0000","last_became_peered":"2024-09-12T00:02:58.099635+0000","last_unstale":"2024-09-12T01:13:05.706621+0000","last_undegraded":"2024-09-12T01:13:05.706621+0000","last_fullsized":"2024-09-12T01:13:05.706621+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":359,"num_read_kb":309,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'637","reported_seq":2521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749291+0000","last_change":"2024-09-12T00:02:50.068821+0000","last_active":"2024-09-12T01:15:09.749291+0000","last_peered":"2024-09-12T01:15:09.749291+0000","last_clean":"2024-09-12T01:15:09.749291+0000","last_became_active":"2024-09-12T00:02:50.068518+0000","last_became_peered":"2024-09-12T00:02:50.068518+0000","last_unstale":"2024-09-12T01:15:09.749291+0000","last_undegraded":"2024-09-12T01:15:09.749291+0000","last_fullsized":"2024-09-12T01:15:09.749291+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:48.137188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3685,"num_read_kb":3433,"num_write":846,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'192","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.244021+0000","last_change":"2024-09-12T00:02:48.055024+0000","last_active":"2024-09-12T01:12:55.244021+0000","last_peered":"2024-09-12T01:12:55.244021+0000","last_clean":"2024-09-12T01:12:55.244021+0000","last_became_active":"2024-09-12T00:02:48.054056+0000","last_became_peered":"2024-09-12T00:02:48.054056+0000","last_unstale":"2024-09-12T01:12:55.244021+0000","last_undegraded":"2024-09-12T01:12:55.244021+0000","last_fullsized":"2024-09-12T01:12:55.244021+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:26.535088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":523085,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":463,"num_read_kb":69874,"num_write":895,"num_write_kb":25144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.615384+0000","last_change":"2024-09-12T00:02:52.064704+0000","last_active":"2024-09-12T01:12:53.615384+0000","last_peered":"2024-09-12T01:12:53.615384+0000","last_clean":"2024-09-12T01:12:53.615384+0000","last_became_active":"2024-09-12T00:02:52.064441+0000","last_became_peered":"2024-09-12T00:02:52.064441+0000","last_unstale":"2024-09-12T01:12:53.615384+0000","last_undegraded":"2024-09-12T01:12:53.615384+0000","last_fullsized":"2024-09-12T01:12:53.615384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:59.801795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'141","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.035158+0000","last_change":"2024-09-12T00:02:54.067331+0000","last_active":"2024-09-12T01:15:48.035158+0000","last_peered":"2024-09-12T01:15:48.035158+0000","last_clean":"2024-09-12T01:15:48.035158+0000","last_became_active":"2024-09-12T00:02:54.066900+0000","last_became_peered":"2024-09-12T00:02:54.066900+0000","last_unstale":"2024-09-12T01:15:48.035158+0000","last_undegraded":"2024-09-12T01:15:48.035158+0000","last_fullsized":"2024-09-12T01:15:48.035158+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:20.920036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243955+0000","last_change":"2024-09-12T00:02:56.085678+0000","last_active":"2024-09-12T01:12:55.243955+0000","last_peered":"2024-09-12T01:12:55.243955+0000","last_clean":"2024-09-12T01:12:55.243955+0000","last_became_active":"2024-09-12T00:02:56.084454+0000","last_became_peered":"2024-09-12T00:02:56.084454+0000","last_unstale":"2024-09-12T01:12:55.243955+0000","last_undegraded":"2024-09-12T01:12:55.243955+0000","last_fullsized":"2024-09-12T01:12:55.243955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.942660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'810","reported_seq":2284,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128303+0000","last_change":"2024-09-12T00:02:50.072883+0000","last_active":"2024-09-12T01:14:04.128303+0000","last_peered":"2024-09-12T01:14:04.128303+0000","last_clean":"2024-09-12T01:14:04.128303+0000","last_became_active":"2024-09-12T00:02:50.072570+0000","last_became_peered":"2024-09-12T00:02:50.072570+0000","last_unstale":"2024-09-12T01:14:04.128303+0000","last_undegraded":"2024-09-12T01:14:04.128303+0000","last_fullsized":"2024-09-12T01:14:04.128303+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:59.471970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3795,"num_read_kb":3393,"num_write":1092,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'152","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.115853+0000","last_change":"2024-09-12T00:02:48.050380+0000","last_active":"2024-09-12T01:15:48.115853+0000","last_peered":"2024-09-12T01:15:48.115853+0000","last_clean":"2024-09-12T01:15:48.115853+0000","last_became_active":"2024-09-12T00:02:48.050025+0000","last_became_peered":"2024-09-12T00:02:48.050025+0000","last_unstale":"2024-09-12T01:15:48.115853+0000","last_undegraded":"2024-09-12T01:15:48.115853+0000","last_fullsized":"2024-09-12T01:15:48.115853+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:32.062297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":278,"num_read_kb":9330,"num_write":746,"num_write_kb":34876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:10.245905+0000","last_change":"2024-09-12T00:02:52.071470+0000","last_active":"2024-09-12T01:13:10.245905+0000","last_peered":"2024-09-12T01:13:10.245905+0000","last_clean":"2024-09-12T01:13:10.245905+0000","last_became_active":"2024-09-12T00:02:52.071201+0000","last_became_peered":"2024-09-12T00:02:52.071201+0000","last_unstale":"2024-09-12T01:13:10.245905+0000","last_undegraded":"2024-09-12T01:13:10.245905+0000","last_fullsized":"2024-09-12T01:13:10.245905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.887009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'225","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.215655+0000","last_change":"2024-09-12T00:02:54.073975+0000","last_active":"2024-09-12T01:15:48.215655+0000","last_peered":"2024-09-12T01:15:48.215655+0000","last_clean":"2024-09-12T01:15:48.215655+0000","last_became_active":"2024-09-12T00:02:54.073541+0000","last_became_peered":"2024-09-12T00:02:54.073541+0000","last_unstale":"2024-09-12T01:15:48.215655+0000","last_undegraded":"2024-09-12T01:15:48.215655+0000","last_fullsized":"2024-09-12T01:15:48.215655+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.658572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15168,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":358,"num_read_kb":528,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510916+0000","last_change":"2024-09-12T00:02:56.084926+0000","last_active":"2024-09-12T01:12:58.510916+0000","last_peered":"2024-09-12T01:12:58.510916+0000","last_clean":"2024-09-12T01:12:58.510916+0000","last_became_active":"2024-09-12T00:02:56.084627+0000","last_became_peered":"2024-09-12T00:02:56.084627+0000","last_unstale":"2024-09-12T01:12:58.510916+0000","last_undegraded":"2024-09-12T01:12:58.510916+0000","last_fullsized":"2024-09-12T01:12:58.510916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:48.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'184","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.259373+0000","last_change":"2024-09-12T00:02:58.090856+0000","last_active":"2024-09-12T01:14:04.259373+0000","last_peered":"2024-09-12T01:14:04.259373+0000","last_clean":"2024-09-12T01:14:04.259373+0000","last_became_active":"2024-09-12T00:02:58.089750+0000","last_became_peered":"2024-09-12T00:02:58.089750+0000","last_unstale":"2024-09-12T01:14:04.259373+0000","last_undegraded":"2024-09-12T01:14:04.259373+0000","last_fullsized":"2024-09-12T01:14:04.259373+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:39.825708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":234,"num_read_kb":235,"num_write":422,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'478","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.723839+0000","last_change":"2024-09-12T00:02:50.064457+0000","last_active":"2024-09-12T01:15:09.723839+0000","last_peered":"2024-09-12T01:15:09.723839+0000","last_clean":"2024-09-12T01:15:09.723839+0000","last_became_active":"2024-09-12T00:02:50.064157+0000","last_became_peered":"2024-09-12T00:02:50.064157+0000","last_unstale":"2024-09-12T01:15:09.723839+0000","last_undegraded":"2024-09-12T01:15:09.723839+0000","last_fullsized":"2024-09-12T01:15:09.723839+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:29.208142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2183,"num_write":585,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'252","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041430+0000","last_change":"2024-09-12T00:02:48.053735+0000","last_active":"2024-09-12T01:15:48.041430+0000","last_peered":"2024-09-12T01:15:48.041430+0000","last_clean":"2024-09-12T01:15:48.041430+0000","last_became_active":"2024-09-12T00:02:48.053055+0000","last_became_peered":"2024-09-12T00:02:48.053055+0000","last_unstale":"2024-09-12T01:15:48.041430+0000","last_undegraded":"2024-09-12T01:15:48.041430+0000","last_fullsized":"2024-09-12T01:15:48.041430+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:59.588429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":662,"num_read_kb":2689,"num_write":1334,"num_write_kb":25481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622306+0000","last_change":"2024-09-12T00:02:52.060376+0000","last_active":"2024-09-12T01:13:43.622306+0000","last_peered":"2024-09-12T01:13:43.622306+0000","last_clean":"2024-09-12T01:13:43.622306+0000","last_became_active":"2024-09-12T00:02:52.060034+0000","last_became_peered":"2024-09-12T00:02:52.060034+0000","last_unstale":"2024-09-12T01:13:43.622306+0000","last_undegraded":"2024-09-12T01:13:43.622306+0000","last_fullsized":"2024-09-12T01:13:43.622306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.319586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'197","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.045639+0000","last_change":"2024-09-12T00:02:54.067256+0000","last_active":"2024-09-12T01:15:48.045639+0000","last_peered":"2024-09-12T01:15:48.045639+0000","last_clean":"2024-09-12T01:15:48.045639+0000","last_became_active":"2024-09-12T00:02:54.066854+0000","last_became_peered":"2024-09-12T00:02:54.066854+0000","last_unstale":"2024-09-12T01:15:48.045639+0000","last_undegraded":"2024-09-12T01:15:48.045639+0000","last_fullsized":"2024-09-12T01:15:48.045639+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:56.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":290,"num_read_kb":407,"num_write":194,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.236453+0000","last_change":"2024-09-12T00:02:56.086661+0000","last_active":"2024-09-12T01:12:58.236453+0000","last_peered":"2024-09-12T01:12:58.236453+0000","last_clean":"2024-09-12T01:12:58.236453+0000","last_became_active":"2024-09-12T00:02:56.086349+0000","last_became_peered":"2024-09-12T00:02:56.086349+0000","last_unstale":"2024-09-12T01:12:58.236453+0000","last_undegraded":"2024-09-12T01:12:58.236453+0000","last_fullsized":"2024-09-12T01:12:58.236453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:32.352621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'169","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.265206+0000","last_change":"2024-09-12T00:02:58.100935+0000","last_active":"2024-09-12T01:14:04.265206+0000","last_peered":"2024-09-12T01:14:04.265206+0000","last_clean":"2024-09-12T01:14:04.265206+0000","last_became_active":"2024-09-12T00:02:58.100646+0000","last_became_peered":"2024-09-12T00:02:58.100646+0000","last_unstale":"2024-09-12T01:14:04.265206+0000","last_undegraded":"2024-09-12T01:14:04.265206+0000","last_fullsized":"2024-09-12T01:14:04.265206+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:32.687456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":591,"num_write":465,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'695","reported_seq":2038,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127708+0000","last_change":"2024-09-12T00:02:50.072964+0000","last_active":"2024-09-12T01:14:04.127708+0000","last_peered":"2024-09-12T01:14:04.127708+0000","last_clean":"2024-09-12T01:14:04.127708+0000","last_became_active":"2024-09-12T00:02:50.072665+0000","last_became_peered":"2024-09-12T00:02:50.072665+0000","last_unstale":"2024-09-12T01:14:04.127708+0000","last_undegraded":"2024-09-12T01:14:04.127708+0000","last_fullsized":"2024-09-12T01:14:04.127708+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.757307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3202,"num_read_kb":2877,"num_write":917,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'240","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.211007+0000","last_change":"2024-09-12T00:03:21.140521+0000","last_active":"2024-09-12T01:15:48.211007+0000","last_peered":"2024-09-12T01:15:48.211007+0000","last_clean":"2024-09-12T01:15:48.211007+0000","last_became_active":"2024-09-12T00:03:21.140095+0000","last_became_peered":"2024-09-12T00:03:21.140095+0000","last_unstale":"2024-09-12T01:15:48.211007+0000","last_undegraded":"2024-09-12T01:15:48.211007+0000","last_fullsized":"2024-09-12T01:15:48.211007+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.899923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322785,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":39289,"num_write":1008,"num_write_kb":58524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397483+0000","last_change":"2024-09-12T00:02:52.063849+0000","last_active":"2024-09-12T01:12:53.397483+0000","last_peered":"2024-09-12T01:12:53.397483+0000","last_clean":"2024-09-12T01:12:53.397483+0000","last_became_active":"2024-09-12T00:02:52.063334+0000","last_became_peered":"2024-09-12T00:02:52.063334+0000","last_unstale":"2024-09-12T01:12:53.397483+0000","last_undegraded":"2024-09-12T01:12:53.397483+0000","last_fullsized":"2024-09-12T01:12:53.397483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:03.747256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.197503+0000","last_change":"2024-09-12T00:02:54.240449+0000","last_active":"2024-09-12T01:15:48.197503+0000","last_peered":"2024-09-12T01:15:48.197503+0000","last_clean":"2024-09-12T01:15:48.197503+0000","last_became_active":"2024-09-12T00:02:54.240007+0000","last_became_peered":"2024-09-12T00:02:54.240007+0000","last_unstale":"2024-09-12T01:15:48.197503+0000","last_undegraded":"2024-09-12T01:15:48.197503+0000","last_fullsized":"2024-09-12T01:15:48.197503+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:58.601042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":288,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.238159+0000","last_change":"2024-09-12T00:02:56.087660+0000","last_active":"2024-09-12T01:13:13.238159+0000","last_peered":"2024-09-12T01:13:13.238159+0000","last_clean":"2024-09-12T01:13:13.238159+0000","last_became_active":"2024-09-12T00:02:56.087317+0000","last_became_peered":"2024-09-12T00:02:56.087317+0000","last_unstale":"2024-09-12T01:13:13.238159+0000","last_undegraded":"2024-09-12T01:13:13.238159+0000","last_fullsized":"2024-09-12T01:13:13.238159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:30.847202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'148","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.905755+0000","last_change":"2024-09-12T00:02:58.099988+0000","last_active":"2024-09-12T01:15:10.905755+0000","last_peered":"2024-09-12T01:15:10.905755+0000","last_clean":"2024-09-12T01:15:10.905755+0000","last_became_active":"2024-09-12T00:02:58.099712+0000","last_became_peered":"2024-09-12T00:02:58.099712+0000","last_unstale":"2024-09-12T01:15:10.905755+0000","last_undegraded":"2024-09-12T01:15:10.905755+0000","last_fullsized":"2024-09-12T01:15:10.905755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.021756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'706","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.058665+0000","last_change":"2024-09-12T00:02:50.062196+0000","last_active":"2024-09-12T01:13:06.058665+0000","last_peered":"2024-09-12T01:13:06.058665+0000","last_clean":"2024-09-12T01:13:06.058665+0000","last_became_active":"2024-09-12T00:02:50.061909+0000","last_became_peered":"2024-09-12T00:02:50.061909+0000","last_unstale":"2024-09-12T01:13:06.058665+0000","last_undegraded":"2024-09-12T01:13:06.058665+0000","last_fullsized":"2024-09-12T01:13:06.058665+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":600,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:59.811798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3690,"num_read_kb":3334,"num_write":961,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'196","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243290+0000","last_change":"2024-09-12T00:02:48.051220+0000","last_active":"2024-09-12T01:12:50.243290+0000","last_peered":"2024-09-12T01:12:50.243290+0000","last_clean":"2024-09-12T01:12:50.243290+0000","last_became_active":"2024-09-12T00:02:48.050894+0000","last_became_peered":"2024-09-12T00:02:48.050894+0000","last_unstale":"2024-09-12T01:12:50.243290+0000","last_undegraded":"2024-09-12T01:12:50.243290+0000","last_fullsized":"2024-09-12T01:12:50.243290+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:06.067280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19167861,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":20890,"num_write":1007,"num_write_kb":39832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.235936+0000","last_change":"2024-09-12T00:02:52.064983+0000","last_active":"2024-09-12T01:12:53.235936+0000","last_peered":"2024-09-12T01:12:53.235936+0000","last_clean":"2024-09-12T01:12:53.235936+0000","last_became_active":"2024-09-12T00:02:52.064125+0000","last_became_peered":"2024-09-12T00:02:52.064125+0000","last_unstale":"2024-09-12T01:12:53.235936+0000","last_undegraded":"2024-09-12T01:12:53.235936+0000","last_fullsized":"2024-09-12T01:12:53.235936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:32.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'111","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.555449+0000","last_change":"2024-09-12T00:02:54.239923+0000","last_active":"2024-09-12T01:13:29.555449+0000","last_peered":"2024-09-12T01:13:29.555449+0000","last_clean":"2024-09-12T01:13:29.555449+0000","last_became_active":"2024-09-12T00:02:54.239412+0000","last_became_peered":"2024-09-12T00:02:54.239412+0000","last_unstale":"2024-09-12T01:13:29.555449+0000","last_undegraded":"2024-09-12T01:13:29.555449+0000","last_fullsized":"2024-09-12T01:13:29.555449+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.570833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'772","reported_seq":2645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.954676+0000","last_change":"2024-09-12T00:02:56.080694+0000","last_active":"2024-09-12T01:15:47.954676+0000","last_peered":"2024-09-12T01:15:47.954676+0000","last_clean":"2024-09-12T01:15:47.954676+0000","last_became_active":"2024-09-12T00:02:56.080374+0000","last_became_peered":"2024-09-12T00:02:56.080374+0000","last_unstale":"2024-09-12T01:15:47.954676+0000","last_undegraded":"2024-09-12T01:15:47.954676+0000","last_fullsized":"2024-09-12T01:15:47.954676+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:02.095265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'116","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399596+0000","last_change":"2024-09-12T00:02:58.101477+0000","last_active":"2024-09-12T01:12:58.399596+0000","last_peered":"2024-09-12T01:12:58.399596+0000","last_clean":"2024-09-12T01:12:58.399596+0000","last_became_active":"2024-09-12T00:02:58.100777+0000","last_became_peered":"2024-09-12T00:02:58.100777+0000","last_unstale":"2024-09-12T01:12:58.399596+0000","last_undegraded":"2024-09-12T01:12:58.399596+0000","last_fullsized":"2024-09-12T01:12:58.399596+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:03.981795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'472","reported_seq":2034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127865+0000","last_change":"2024-09-12T00:02:50.070545+0000","last_active":"2024-09-12T01:14:04.127865+0000","last_peered":"2024-09-12T01:14:04.127865+0000","last_clean":"2024-09-12T01:14:04.127865+0000","last_became_active":"2024-09-12T00:02:50.070186+0000","last_became_peered":"2024-09-12T00:02:50.070186+0000","last_unstale":"2024-09-12T01:14:04.127865+0000","last_undegraded":"2024-09-12T01:14:04.127865+0000","last_fullsized":"2024-09-12T01:14:04.127865+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:36.641202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2560,"num_read_kb":2381,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'280","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.257256+0000","last_change":"2024-09-12T00:02:48.055180+0000","last_active":"2024-09-12T01:15:48.257256+0000","last_peered":"2024-09-12T01:15:48.257256+0000","last_clean":"2024-09-12T01:15:48.257256+0000","last_became_active":"2024-09-12T00:02:48.054303+0000","last_became_peered":"2024-09-12T00:02:48.054303+0000","last_unstale":"2024-09-12T01:15:48.257256+0000","last_undegraded":"2024-09-12T01:15:48.257256+0000","last_fullsized":"2024-09-12T01:15:48.257256+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:53.174386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":47582,"num_write":1191,"num_write_kb":28572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399009+0000","last_change":"2024-09-12T00:02:52.071857+0000","last_active":"2024-09-12T01:12:53.399009+0000","last_peered":"2024-09-12T01:12:53.399009+0000","last_clean":"2024-09-12T01:12:53.399009+0000","last_became_active":"2024-09-12T00:02:52.071580+0000","last_became_peered":"2024-09-12T00:02:52.071580+0000","last_unstale":"2024-09-12T01:12:53.399009+0000","last_undegraded":"2024-09-12T01:12:53.399009+0000","last_fullsized":"2024-09-12T01:12:53.399009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:15.575099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'229","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.250455+0000","last_change":"2024-09-12T00:02:54.069107+0000","last_active":"2024-09-12T01:15:48.250455+0000","last_peered":"2024-09-12T01:15:48.250455+0000","last_clean":"2024-09-12T01:15:48.250455+0000","last_became_active":"2024-09-12T00:02:54.068806+0000","last_became_peered":"2024-09-12T00:02:54.068806+0000","last_unstale":"2024-09-12T01:15:48.250455+0000","last_undegraded":"2024-09-12T01:15:48.250455+0000","last_fullsized":"2024-09-12T01:15:48.250455+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:03.065780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9605,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":355,"num_write":182,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244538+0000","last_change":"2024-09-12T00:02:56.083225+0000","last_active":"2024-09-12T01:13:00.244538+0000","last_peered":"2024-09-12T01:13:00.244538+0000","last_clean":"2024-09-12T01:13:00.244538+0000","last_became_active":"2024-09-12T00:02:56.082924+0000","last_became_peered":"2024-09-12T00:02:56.082924+0000","last_unstale":"2024-09-12T01:13:00.244538+0000","last_undegraded":"2024-09-12T01:13:00.244538+0000","last_fullsized":"2024-09-12T01:13:00.244538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:14.433764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'109","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.113160+0000","last_change":"2024-09-12T00:02:58.099967+0000","last_active":"2024-09-12T01:14:04.113160+0000","last_peered":"2024-09-12T01:14:04.113160+0000","last_clean":"2024-09-12T01:14:04.113160+0000","last_became_active":"2024-09-12T00:02:58.099683+0000","last_became_peered":"2024-09-12T00:02:58.099683+0000","last_unstale":"2024-09-12T01:14:04.113160+0000","last_undegraded":"2024-09-12T01:14:04.113160+0000","last_fullsized":"2024-09-12T01:14:04.113160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:14.241268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":199,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'538","reported_seq":2265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748583+0000","last_change":"2024-09-12T00:02:50.070201+0000","last_active":"2024-09-12T01:15:09.748583+0000","last_peered":"2024-09-12T01:15:09.748583+0000","last_clean":"2024-09-12T01:15:09.748583+0000","last_became_active":"2024-09-12T00:02:50.069907+0000","last_became_peered":"2024-09-12T00:02:50.069907+0000","last_unstale":"2024-09-12T01:15:09.748583+0000","last_undegraded":"2024-09-12T01:15:09.748583+0000","last_fullsized":"2024-09-12T01:15:09.748583+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:16.483724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2946,"num_read_kb":2752,"num_write":643,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'210","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203279+0000","last_change":"2024-09-12T00:02:48.054530+0000","last_active":"2024-09-12T01:15:48.203279+0000","last_peered":"2024-09-12T01:15:48.203279+0000","last_clean":"2024-09-12T01:15:48.203279+0000","last_became_active":"2024-09-12T00:02:48.052303+0000","last_became_peered":"2024-09-12T00:02:48.052303+0000","last_unstale":"2024-09-12T01:15:48.203279+0000","last_undegraded":"2024-09-12T01:15:48.203279+0000","last_fullsized":"2024-09-12T01:15:48.203279+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:02.915896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":51729,"num_write":985,"num_write_kb":45446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510194+0000","last_change":"2024-09-12T00:02:52.066240+0000","last_active":"2024-09-12T01:12:53.510194+0000","last_peered":"2024-09-12T01:12:53.510194+0000","last_clean":"2024-09-12T01:12:53.510194+0000","last_became_active":"2024-09-12T00:02:52.065653+0000","last_became_peered":"2024-09-12T00:02:52.065653+0000","last_unstale":"2024-09-12T01:12:53.510194+0000","last_undegraded":"2024-09-12T01:12:53.510194+0000","last_fullsized":"2024-09-12T01:12:53.510194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'148","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.856789+0000","last_change":"2024-09-12T00:02:54.074579+0000","last_active":"2024-09-12T01:15:10.856789+0000","last_peered":"2024-09-12T01:15:10.856789+0000","last_clean":"2024-09-12T01:15:10.856789+0000","last_became_active":"2024-09-12T00:02:54.073930+0000","last_became_peered":"2024-09-12T00:02:54.073930+0000","last_unstale":"2024-09-12T01:15:10.856789+0000","last_undegraded":"2024-09-12T01:15:10.856789+0000","last_fullsized":"2024-09-12T01:15:10.856789+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.507632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10183,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":191,"num_read_kb":242,"num_write":106,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.617272+0000","last_change":"2024-09-12T00:02:56.078803+0000","last_active":"2024-09-12T01:13:08.617272+0000","last_peered":"2024-09-12T01:13:08.617272+0000","last_clean":"2024-09-12T01:13:08.617272+0000","last_became_active":"2024-09-12T00:02:56.078528+0000","last_became_peered":"2024-09-12T00:02:56.078528+0000","last_unstale":"2024-09-12T01:13:08.617272+0000","last_undegraded":"2024-09-12T01:13:08.617272+0000","last_fullsized":"2024-09-12T01:13:08.617272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:32.315601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'99","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.947976+0000","last_change":"2024-09-12T00:02:58.087504+0000","last_active":"2024-09-12T01:14:02.947976+0000","last_peered":"2024-09-12T01:14:02.947976+0000","last_clean":"2024-09-12T01:14:02.947976+0000","last_became_active":"2024-09-12T00:02:58.087199+0000","last_became_peered":"2024-09-12T00:02:58.087199+0000","last_unstale":"2024-09-12T01:14:02.947976+0000","last_undegraded":"2024-09-12T01:14:02.947976+0000","last_fullsized":"2024-09-12T01:14:02.947976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:03.468020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":246,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'466","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749348+0000","last_change":"2024-09-12T00:02:50.073193+0000","last_active":"2024-09-12T01:15:09.749348+0000","last_peered":"2024-09-12T01:15:09.749348+0000","last_clean":"2024-09-12T01:15:09.749348+0000","last_became_active":"2024-09-12T00:02:50.072920+0000","last_became_peered":"2024-09-12T00:02:50.072920+0000","last_unstale":"2024-09-12T01:15:09.749348+0000","last_undegraded":"2024-09-12T01:15:09.749348+0000","last_fullsized":"2024-09-12T01:15:09.749348+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.921031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2371,"num_write":566,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'211","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.195443+0000","last_change":"2024-09-12T00:02:48.048693+0000","last_active":"2024-09-12T01:15:48.195443+0000","last_peered":"2024-09-12T01:15:48.195443+0000","last_clean":"2024-09-12T01:15:48.195443+0000","last_became_active":"2024-09-12T00:02:48.048308+0000","last_became_peered":"2024-09-12T00:02:48.048308+0000","last_unstale":"2024-09-12T01:15:48.195443+0000","last_undegraded":"2024-09-12T01:15:48.195443+0000","last_fullsized":"2024-09-12T01:15:48.195443+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:27.341399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2092,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":37398,"num_write":996,"num_write_kb":57972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398220+0000","last_change":"2024-09-12T00:02:52.060575+0000","last_active":"2024-09-12T01:12:58.398220+0000","last_peered":"2024-09-12T01:12:58.398220+0000","last_clean":"2024-09-12T01:12:58.398220+0000","last_became_active":"2024-09-12T00:02:52.060283+0000","last_became_peered":"2024-09-12T00:02:52.060283+0000","last_unstale":"2024-09-12T01:12:58.398220+0000","last_undegraded":"2024-09-12T01:12:58.398220+0000","last_fullsized":"2024-09-12T01:12:58.398220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.734208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'126","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.188246+0000","last_change":"2024-09-12T00:02:54.068064+0000","last_active":"2024-09-12T01:15:48.188246+0000","last_peered":"2024-09-12T01:15:48.188246+0000","last_clean":"2024-09-12T01:15:48.188246+0000","last_became_active":"2024-09-12T00:02:54.067770+0000","last_became_peered":"2024-09-12T00:02:54.067770+0000","last_unstale":"2024-09-12T01:15:48.188246+0000","last_undegraded":"2024-09-12T01:15:48.188246+0000","last_fullsized":"2024-09-12T01:15:48.188246+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:35.379645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4641,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":72,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398279+0000","last_change":"2024-09-12T00:02:56.078599+0000","last_active":"2024-09-12T01:12:58.398279+0000","last_peered":"2024-09-12T01:12:58.398279+0000","last_clean":"2024-09-12T01:12:58.398279+0000","last_became_active":"2024-09-12T00:02:56.077573+0000","last_became_peered":"2024-09-12T00:02:56.077573+0000","last_unstale":"2024-09-12T01:12:58.398279+0000","last_undegraded":"2024-09-12T01:12:58.398279+0000","last_fullsized":"2024-09-12T01:12:58.398279+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.485844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'149","reported_seq":1250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.171046+0000","last_change":"2024-09-12T00:02:58.099809+0000","last_active":"2024-09-12T01:14:00.171046+0000","last_peered":"2024-09-12T01:14:00.171046+0000","last_clean":"2024-09-12T01:14:00.171046+0000","last_became_active":"2024-09-12T00:02:58.099426+0000","last_became_peered":"2024-09-12T00:02:58.099426+0000","last_unstale":"2024-09-12T01:14:00.171046+0000","last_undegraded":"2024-09-12T01:14:00.171046+0000","last_fullsized":"2024-09-12T01:14:00.171046+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:47.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":755,"num_read_kb":754,"num_write":338,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'470","reported_seq":1958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.281149+0000","last_change":"2024-09-12T00:02:50.064387+0000","last_active":"2024-09-12T01:13:32.281149+0000","last_peered":"2024-09-12T01:13:32.281149+0000","last_clean":"2024-09-12T01:13:32.281149+0000","last_became_active":"2024-09-12T00:02:50.063959+0000","last_became_peered":"2024-09-12T00:02:50.063959+0000","last_unstale":"2024-09-12T01:13:32.281149+0000","last_undegraded":"2024-09-12T01:13:32.281149+0000","last_fullsized":"2024-09-12T01:13:32.281149+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:18.236963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2471,"num_read_kb":2277,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'189","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249606+0000","last_change":"2024-09-12T00:02:48.055373+0000","last_active":"2024-09-12T01:13:40.249606+0000","last_peered":"2024-09-12T01:13:40.249606+0000","last_clean":"2024-09-12T01:13:40.249606+0000","last_became_active":"2024-09-12T00:02:48.054650+0000","last_became_peered":"2024-09-12T00:02:48.054650+0000","last_unstale":"2024-09-12T01:13:40.249606+0000","last_undegraded":"2024-09-12T01:13:40.249606+0000","last_fullsized":"2024-09-12T01:13:40.249606+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:13.706061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9667457,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":855,"num_read_kb":59687,"num_write":950,"num_write_kb":41766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.926078+0000","last_change":"2024-09-12T00:02:52.066201+0000","last_active":"2024-09-12T01:15:47.926078+0000","last_peered":"2024-09-12T01:15:47.926078+0000","last_clean":"2024-09-12T01:15:47.926078+0000","last_became_active":"2024-09-12T00:02:52.065804+0000","last_became_peered":"2024-09-12T00:02:52.065804+0000","last_unstale":"2024-09-12T01:15:47.926078+0000","last_undegraded":"2024-09-12T01:15:47.926078+0000","last_fullsized":"2024-09-12T01:15:47.926078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:39.988981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'181","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.205498+0000","last_change":"2024-09-12T00:02:54.067254+0000","last_active":"2024-09-12T01:15:48.205498+0000","last_peered":"2024-09-12T01:15:48.205498+0000","last_clean":"2024-09-12T01:15:48.205498+0000","last_became_active":"2024-09-12T00:02:54.066918+0000","last_became_peered":"2024-09-12T00:02:54.066918+0000","last_unstale":"2024-09-12T01:15:48.205498+0000","last_undegraded":"2024-09-12T01:15:48.205498+0000","last_fullsized":"2024-09-12T01:15:48.205498+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:12.059169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":266,"num_write":140,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243946+0000","last_change":"2024-09-12T00:02:56.085398+0000","last_active":"2024-09-12T01:12:55.243946+0000","last_peered":"2024-09-12T01:12:55.243946+0000","last_clean":"2024-09-12T01:12:55.243946+0000","last_became_active":"2024-09-12T00:02:56.084768+0000","last_became_peered":"2024-09-12T00:02:56.084768+0000","last_unstale":"2024-09-12T01:12:55.243946+0000","last_undegraded":"2024-09-12T01:12:55.243946+0000","last_fullsized":"2024-09-12T01:12:55.243946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:48.456473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'155","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.758350+0000","last_change":"2024-09-12T00:02:58.097950+0000","last_active":"2024-09-12T01:15:09.758350+0000","last_peered":"2024-09-12T01:15:09.758350+0000","last_clean":"2024-09-12T01:15:09.758350+0000","last_became_active":"2024-09-12T00:02:58.097725+0000","last_became_peered":"2024-09-12T00:02:58.097725+0000","last_unstale":"2024-09-12T01:15:09.758350+0000","last_undegraded":"2024-09-12T01:15:09.758350+0000","last_fullsized":"2024-09-12T01:15:09.758350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:53.001751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":109,"num_write":343,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'690","reported_seq":2193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.278553+0000","last_change":"2024-09-12T00:02:50.064639+0000","last_active":"2024-09-12T01:13:32.278553+0000","last_peered":"2024-09-12T01:13:32.278553+0000","last_clean":"2024-09-12T01:13:32.278553+0000","last_became_active":"2024-09-12T00:02:50.064354+0000","last_became_peered":"2024-09-12T00:02:50.064354+0000","last_unstale":"2024-09-12T01:13:32.278553+0000","last_undegraded":"2024-09-12T01:13:32.278553+0000","last_fullsized":"2024-09-12T01:13:32.278553+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:47.800598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3412,"num_read_kb":3118,"num_write":870,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'187","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154216+0000","last_change":"2024-09-12T00:02:48.049912+0000","last_active":"2024-09-12T01:15:48.154216+0000","last_peered":"2024-09-12T01:15:48.154216+0000","last_clean":"2024-09-12T01:15:48.154216+0000","last_became_active":"2024-09-12T00:02:48.049242+0000","last_became_peered":"2024-09-12T00:02:48.049242+0000","last_unstale":"2024-09-12T01:15:48.154216+0000","last_undegraded":"2024-09-12T01:15:48.154216+0000","last_fullsized":"2024-09-12T01:15:48.154216+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:23.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":39372,"num_write":875,"num_write_kb":46728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'350","reported_seq":1687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128431+0000","last_change":"2024-09-12T00:02:50.066620+0000","last_active":"2024-09-12T01:14:04.128431+0000","last_peered":"2024-09-12T01:14:04.128431+0000","last_clean":"2024-09-12T01:14:04.128431+0000","last_became_active":"2024-09-12T00:02:50.065060+0000","last_became_peered":"2024-09-12T00:02:50.065060+0000","last_unstale":"2024-09-12T01:14:04.128431+0000","last_undegraded":"2024-09-12T01:14:04.128431+0000","last_fullsized":"2024-09-12T01:14:04.128431+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:29.932545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1806,"num_read_kb":1710,"num_write":413,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'203","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.232859+0000","last_change":"2024-09-12T00:02:48.042203+0000","last_active":"2024-09-12T01:13:38.232859+0000","last_peered":"2024-09-12T01:13:38.232859+0000","last_clean":"2024-09-12T01:13:38.232859+0000","last_became_active":"2024-09-12T00:02:48.041842+0000","last_became_peered":"2024-09-12T00:02:48.041842+0000","last_unstale":"2024-09-12T01:13:38.232859+0000","last_undegraded":"2024-09-12T01:13:38.232859+0000","last_fullsized":"2024-09-12T01:13:38.232859+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.057094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":13124,"num_write":1044,"num_write_kb":38354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'456","reported_seq":2064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.953879+0000","last_change":"2024-09-12T00:02:50.066620+0000","last_active":"2024-09-12T01:14:02.953879+0000","last_peered":"2024-09-12T01:14:02.953879+0000","last_clean":"2024-09-12T01:14:02.953879+0000","last_became_active":"2024-09-12T00:02:50.066341+0000","last_became_peered":"2024-09-12T00:02:50.066341+0000","last_unstale":"2024-09-12T01:14:02.953879+0000","last_undegraded":"2024-09-12T01:14:02.953879+0000","last_fullsized":"2024-09-12T01:14:02.953879+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:24.335215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2383,"num_read_kb":2262,"num_write":523,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'185","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203656+0000","last_change":"2024-09-12T00:02:48.053321+0000","last_active":"2024-09-12T01:15:48.203656+0000","last_peered":"2024-09-12T01:15:48.203656+0000","last_clean":"2024-09-12T01:15:48.203656+0000","last_became_active":"2024-09-12T00:02:48.052205+0000","last_became_peered":"2024-09-12T00:02:48.052205+0000","last_unstale":"2024-09-12T01:15:48.203656+0000","last_undegraded":"2024-09-12T01:15:48.203656+0000","last_fullsized":"2024-09-12T01:15:48.203656+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:46.259191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":389,"num_read_kb":19493,"num_write":855,"num_write_kb":24928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'366","reported_seq":1876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.726506+0000","last_change":"2024-09-12T00:02:50.066198+0000","last_active":"2024-09-12T01:15:09.726506+0000","last_peered":"2024-09-12T01:15:09.726506+0000","last_clean":"2024-09-12T01:15:09.726506+0000","last_became_active":"2024-09-12T00:02:50.065534+0000","last_became_peered":"2024-09-12T00:02:50.065534+0000","last_unstale":"2024-09-12T01:15:09.726506+0000","last_undegraded":"2024-09-12T01:15:09.726506+0000","last_fullsized":"2024-09-12T01:15:09.726506+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:03.014135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1966,"num_read_kb":1903,"num_write":390,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'155","reported_seq":751,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.238188+0000","last_change":"2024-09-12T00:03:21.720945+0000","last_active":"2024-09-12T01:14:28.238188+0000","last_peered":"2024-09-12T01:14:28.238188+0000","last_clean":"2024-09-12T01:14:28.238188+0000","last_became_active":"2024-09-12T00:03:21.720441+0000","last_became_peered":"2024-09-12T00:03:21.720441+0000","last_unstale":"2024-09-12T01:14:28.238188+0000","last_undegraded":"2024-09-12T01:14:28.238188+0000","last_fullsized":"2024-09-12T01:14:28.238188+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:43.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":16297,"num_write":778,"num_write_kb":33256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"267'1239","reported_seq":3053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.279664+0000","last_change":"2024-09-12T00:02:50.070807+0000","last_active":"2024-09-12T01:13:32.279664+0000","last_peered":"2024-09-12T01:13:32.279664+0000","last_clean":"2024-09-12T01:13:32.279664+0000","last_became_active":"2024-09-12T00:02:50.070406+0000","last_became_peered":"2024-09-12T00:02:50.070406+0000","last_unstale":"2024-09-12T01:13:32.279664+0000","last_undegraded":"2024-09-12T01:13:32.279664+0000","last_fullsized":"2024-09-12T01:13:32.279664+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:02.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5822,"num_read_kb":5176,"num_write":1694,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'194","reported_seq":841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.244888+0000","last_change":"2024-09-12T00:02:48.051785+0000","last_active":"2024-09-12T01:14:18.244888+0000","last_peered":"2024-09-12T01:14:18.244888+0000","last_clean":"2024-09-12T01:14:18.244888+0000","last_became_active":"2024-09-12T00:02:48.051454+0000","last_became_peered":"2024-09-12T00:02:48.051454+0000","last_unstale":"2024-09-12T01:14:18.244888+0000","last_undegraded":"2024-09-12T01:14:18.244888+0000","last_fullsized":"2024-09-12T01:14:18.244888+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:03.729498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22651,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":459,"num_read_kb":27281,"num_write":912,"num_write_kb":43596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'808","reported_seq":2264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257926+0000","last_change":"2024-09-12T00:02:50.065953+0000","last_active":"2024-09-12T01:13:43.257926+0000","last_peered":"2024-09-12T01:13:43.257926+0000","last_clean":"2024-09-12T01:13:43.257926+0000","last_became_active":"2024-09-12T00:02:50.065615+0000","last_became_peered":"2024-09-12T00:02:50.065615+0000","last_unstale":"2024-09-12T01:13:43.257926+0000","last_undegraded":"2024-09-12T01:13:43.257926+0000","last_fullsized":"2024-09-12T01:13:43.257926+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:10.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3886,"num_read_kb":3508,"num_write":1123,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'222","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.245194+0000","last_change":"2024-09-12T00:02:48.047922+0000","last_active":"2024-09-12T01:14:18.245194+0000","last_peered":"2024-09-12T01:14:18.245194+0000","last_clean":"2024-09-12T01:14:18.245194+0000","last_became_active":"2024-09-12T00:02:48.047357+0000","last_became_peered":"2024-09-12T00:02:48.047357+0000","last_unstale":"2024-09-12T01:14:18.245194+0000","last_undegraded":"2024-09-12T01:14:18.245194+0000","last_fullsized":"2024-09-12T01:14:18.245194+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:00.961888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2112,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":474,"num_read_kb":6089,"num_write":1091,"num_write_kb":27766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1102","reported_seq":2609,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.239495+0000","last_change":"2024-09-12T00:02:50.076287+0000","last_active":"2024-09-12T01:13:43.239495+0000","last_peered":"2024-09-12T01:13:43.239495+0000","last_clean":"2024-09-12T01:13:43.239495+0000","last_became_active":"2024-09-12T00:02:50.075265+0000","last_became_peered":"2024-09-12T00:02:50.075265+0000","last_unstale":"2024-09-12T01:13:43.239495+0000","last_undegraded":"2024-09-12T01:13:43.239495+0000","last_fullsized":"2024-09-12T01:13:43.239495+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":1000,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:28.198469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4403,"num_write":1512,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'200","reported_seq":822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.177090+0000","last_change":"2024-09-12T00:02:48.047911+0000","last_active":"2024-09-12T01:15:48.177090+0000","last_peered":"2024-09-12T01:15:48.177090+0000","last_clean":"2024-09-12T01:15:48.177090+0000","last_became_active":"2024-09-12T00:02:48.047266+0000","last_became_peered":"2024-09-12T00:02:48.047266+0000","last_unstale":"2024-09-12T01:15:48.177090+0000","last_undegraded":"2024-09-12T01:15:48.177090+0000","last_fullsized":"2024-09-12T01:15:48.177090+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.110547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":23654,"num_write":912,"num_write_kb":39021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'475","reported_seq":2121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622203+0000","last_change":"2024-09-12T00:02:50.068176+0000","last_active":"2024-09-12T01:13:43.622203+0000","last_peered":"2024-09-12T01:13:43.622203+0000","last_clean":"2024-09-12T01:13:43.622203+0000","last_became_active":"2024-09-12T00:02:50.067919+0000","last_became_peered":"2024-09-12T00:02:50.067919+0000","last_unstale":"2024-09-12T01:13:43.622203+0000","last_undegraded":"2024-09-12T01:13:43.622203+0000","last_fullsized":"2024-09-12T01:13:43.622203+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:55.966361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2453,"num_write":580,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:53.249785+0000","last_change":"2024-09-12T00:03:21.143532+0000","last_active":"2024-09-12T01:14:53.249785+0000","last_peered":"2024-09-12T01:14:53.249785+0000","last_clean":"2024-09-12T01:14:53.249785+0000","last_became_active":"2024-09-12T00:03:21.143091+0000","last_became_peered":"2024-09-12T00:03:21.143091+0000","last_unstale":"2024-09-12T01:14:53.249785+0000","last_undegraded":"2024-09-12T01:14:53.249785+0000","last_fullsized":"2024-09-12T01:14:53.249785+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:15.405828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":6539,"num_write":770,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'874","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863508+0000","last_change":"2024-09-12T00:02:50.076474+0000","last_active":"2024-09-12T01:13:20.863508+0000","last_peered":"2024-09-12T01:13:20.863508+0000","last_clean":"2024-09-12T01:13:20.863508+0000","last_became_active":"2024-09-12T00:02:50.076097+0000","last_became_peered":"2024-09-12T00:02:50.076097+0000","last_unstale":"2024-09-12T01:13:20.863508+0000","last_undegraded":"2024-09-12T01:13:20.863508+0000","last_fullsized":"2024-09-12T01:13:20.863508+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:53.760772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3804,"num_write":1206,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'185","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:23.523597+0000","last_change":"2024-09-12T00:02:48.058120+0000","last_active":"2024-09-12T01:14:23.523597+0000","last_peered":"2024-09-12T01:14:23.523597+0000","last_clean":"2024-09-12T01:14:23.523597+0000","last_became_active":"2024-09-12T00:02:48.057693+0000","last_became_peered":"2024-09-12T00:02:48.057693+0000","last_unstale":"2024-09-12T01:14:23.523597+0000","last_undegraded":"2024-09-12T01:14:23.523597+0000","last_fullsized":"2024-09-12T01:14:23.523597+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:03.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":352,"num_read_kb":5525,"num_write":905,"num_write_kb":35074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'837","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.955489+0000","last_change":"2024-09-12T00:02:50.062788+0000","last_active":"2024-09-12T01:14:02.955489+0000","last_peered":"2024-09-12T01:14:02.955489+0000","last_clean":"2024-09-12T01:14:02.955489+0000","last_became_active":"2024-09-12T00:02:50.062524+0000","last_became_peered":"2024-09-12T00:02:50.062524+0000","last_unstale":"2024-09-12T01:14:02.955489+0000","last_undegraded":"2024-09-12T01:14:02.955489+0000","last_fullsized":"2024-09-12T01:14:02.955489+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:00.117674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4232,"num_read_kb":3859,"num_write":1078,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'257","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.214002+0000","last_change":"2024-09-12T00:02:48.050975+0000","last_active":"2024-09-12T01:15:48.214002+0000","last_peered":"2024-09-12T01:15:48.214002+0000","last_clean":"2024-09-12T01:15:48.214002+0000","last_became_active":"2024-09-12T00:02:48.050574+0000","last_became_peered":"2024-09-12T00:02:48.050574+0000","last_unstale":"2024-09-12T01:15:48.214002+0000","last_undegraded":"2024-09-12T01:15:48.214002+0000","last_fullsized":"2024-09-12T01:15:48.214002+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:18.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68583,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":597,"num_read_kb":15341,"num_write":1131,"num_write_kb":29230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'811","reported_seq":2278,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.722532+0000","last_change":"2024-09-12T00:02:50.063982+0000","last_active":"2024-09-12T01:15:09.722532+0000","last_peered":"2024-09-12T01:15:09.722532+0000","last_clean":"2024-09-12T01:15:09.722532+0000","last_became_active":"2024-09-12T00:02:50.063668+0000","last_became_peered":"2024-09-12T00:02:50.063668+0000","last_unstale":"2024-09-12T01:15:09.722532+0000","last_undegraded":"2024-09-12T01:15:09.722532+0000","last_fullsized":"2024-09-12T01:15:09.722532+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.340207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3770,"num_read_kb":3367,"num_write":1118,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'211","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.231252+0000","last_change":"2024-09-12T00:02:48.049176+0000","last_active":"2024-09-12T01:15:48.231252+0000","last_peered":"2024-09-12T01:15:48.231252+0000","last_clean":"2024-09-12T01:15:48.231252+0000","last_became_active":"2024-09-12T00:02:48.048851+0000","last_became_peered":"2024-09-12T00:02:48.048851+0000","last_unstale":"2024-09-12T01:15:48.231252+0000","last_undegraded":"2024-09-12T01:15:48.231252+0000","last_fullsized":"2024-09-12T01:15:48.231252+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:48.606466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":48639,"num_write":1072,"num_write_kb":41735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'811","reported_seq":2269,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.790333+0000","last_change":"2024-09-12T00:02:50.064007+0000","last_active":"2024-09-12T01:13:16.790333+0000","last_peered":"2024-09-12T01:13:16.790333+0000","last_clean":"2024-09-12T01:13:16.790333+0000","last_became_active":"2024-09-12T00:02:50.063615+0000","last_became_peered":"2024-09-12T00:02:50.063615+0000","last_unstale":"2024-09-12T01:13:16.790333+0000","last_undegraded":"2024-09-12T01:13:16.790333+0000","last_fullsized":"2024-09-12T01:13:16.790333+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:42.699086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3747,"num_read_kb":3346,"num_write":1068,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'283","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:35.241622+0000","last_change":"2024-09-12T00:02:48.047449+0000","last_active":"2024-09-12T01:12:35.241622+0000","last_peered":"2024-09-12T01:12:35.241622+0000","last_clean":"2024-09-12T01:12:35.241622+0000","last_became_active":"2024-09-12T00:02:48.046828+0000","last_became_peered":"2024-09-12T00:02:48.046828+0000","last_unstale":"2024-09-12T01:12:35.241622+0000","last_undegraded":"2024-09-12T01:12:35.241622+0000","last_fullsized":"2024-09-12T01:12:35.241622+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.302266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508432,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":715,"num_read_kb":12026,"num_write":1073,"num_write_kb":33544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'751","reported_seq":2258,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127565+0000","last_change":"2024-09-12T00:02:50.070132+0000","last_active":"2024-09-12T01:14:04.127565+0000","last_peered":"2024-09-12T01:14:04.127565+0000","last_clean":"2024-09-12T01:14:04.127565+0000","last_became_active":"2024-09-12T00:02:50.069844+0000","last_became_peered":"2024-09-12T00:02:50.069844+0000","last_unstale":"2024-09-12T01:14:04.127565+0000","last_undegraded":"2024-09-12T01:14:04.127565+0000","last_fullsized":"2024-09-12T01:14:04.127565+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:41.241382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3535,"num_read_kb":3209,"num_write":983,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'198","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154781+0000","last_change":"2024-09-12T00:02:48.046768+0000","last_active":"2024-09-12T01:15:48.154781+0000","last_peered":"2024-09-12T01:15:48.154781+0000","last_clean":"2024-09-12T01:15:48.154781+0000","last_became_active":"2024-09-12T00:02:48.046397+0000","last_became_peered":"2024-09-12T00:02:48.046397+0000","last_unstale":"2024-09-12T01:15:48.154781+0000","last_undegraded":"2024-09-12T01:15:48.154781+0000","last_fullsized":"2024-09-12T01:15:48.154781+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:20.073613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":38047,"num_write":933,"num_write_kb":24740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'852","reported_seq":2476,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.727874+0000","last_change":"2024-09-12T00:02:50.078323+0000","last_active":"2024-09-12T01:15:09.727874+0000","last_peered":"2024-09-12T01:15:09.727874+0000","last_clean":"2024-09-12T01:15:09.727874+0000","last_became_active":"2024-09-12T00:02:50.078018+0000","last_became_peered":"2024-09-12T00:02:50.078018+0000","last_unstale":"2024-09-12T01:15:09.727874+0000","last_undegraded":"2024-09-12T01:15:09.727874+0000","last_fullsized":"2024-09-12T01:15:09.727874+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.331727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4154,"num_read_kb":3748,"num_write":1160,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'171","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.248955+0000","last_change":"2024-09-12T00:02:48.049824+0000","last_active":"2024-09-12T01:15:48.248955+0000","last_peered":"2024-09-12T01:15:48.248955+0000","last_clean":"2024-09-12T01:15:48.248955+0000","last_became_active":"2024-09-12T00:02:48.047945+0000","last_became_peered":"2024-09-12T00:02:48.047945+0000","last_unstale":"2024-09-12T01:15:48.248955+0000","last_undegraded":"2024-09-12T01:15:48.248955+0000","last_fullsized":"2024-09-12T01:15:48.248955+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:07.052258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":324,"num_read_kb":25981,"num_write":829,"num_write_kb":31809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'530","reported_seq":2291,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.229835+0000","last_change":"2024-09-12T00:03:21.133800+0000","last_active":"2024-09-12T01:13:08.229835+0000","last_peered":"2024-09-12T01:13:08.229835+0000","last_clean":"2024-09-12T01:13:08.229835+0000","last_became_active":"2024-09-12T00:03:21.133475+0000","last_became_peered":"2024-09-12T00:03:21.133475+0000","last_unstale":"2024-09-12T01:13:08.229835+0000","last_undegraded":"2024-09-12T01:13:08.229835+0000","last_fullsized":"2024-09-12T01:13:08.229835+0000","mapping_epoch":39,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:12.713868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2976,"num_read_kb":2811,"num_write":614,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"267'233","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.059488+0000","last_change":"2024-09-12T00:02:48.049475+0000","last_active":"2024-09-12T01:15:48.059488+0000","last_peered":"2024-09-12T01:15:48.059488+0000","last_clean":"2024-09-12T01:15:48.059488+0000","last_became_active":"2024-09-12T00:02:48.049104+0000","last_became_peered":"2024-09-12T00:02:48.049104+0000","last_unstale":"2024-09-12T01:15:48.059488+0000","last_undegraded":"2024-09-12T01:15:48.059488+0000","last_fullsized":"2024-09-12T01:15:48.059488+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:30.113842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456491,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":11103,"num_write":1027,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'905","reported_seq":2496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127160+0000","last_change":"2024-09-12T00:02:50.069815+0000","last_active":"2024-09-12T01:14:04.127160+0000","last_peered":"2024-09-12T01:14:04.127160+0000","last_clean":"2024-09-12T01:14:04.127160+0000","last_became_active":"2024-09-12T00:02:50.069494+0000","last_became_peered":"2024-09-12T00:02:50.069494+0000","last_unstale":"2024-09-12T01:14:04.127160+0000","last_undegraded":"2024-09-12T01:14:04.127160+0000","last_fullsized":"2024-09-12T01:14:04.127160+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:18.542138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4355,"num_read_kb":3868,"num_write":1227,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'175","reported_seq":808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.202875+0000","last_change":"2024-09-12T00:04:21.225632+0000","last_active":"2024-09-12T01:15:48.202875+0000","last_peered":"2024-09-12T01:15:48.202875+0000","last_clean":"2024-09-12T01:15:48.202875+0000","last_became_active":"2024-09-12T00:04:21.225148+0000","last_became_peered":"2024-09-12T00:04:21.225148+0000","last_unstale":"2024-09-12T01:15:48.202875+0000","last_undegraded":"2024-09-12T01:15:48.202875+0000","last_fullsized":"2024-09-12T01:15:48.202875+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:11.655162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7533161,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":15843,"num_write":853,"num_write_kb":25246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'175","reported_seq":796,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.178507+0000","last_change":"2024-09-12T00:03:21.141209+0000","last_active":"2024-09-12T01:15:48.178507+0000","last_peered":"2024-09-12T01:15:48.178507+0000","last_clean":"2024-09-12T01:15:48.178507+0000","last_became_active":"2024-09-12T00:03:21.140871+0000","last_became_peered":"2024-09-12T00:03:21.140871+0000","last_unstale":"2024-09-12T01:15:48.178507+0000","last_undegraded":"2024-09-12T01:15:48.178507+0000","last_fullsized":"2024-09-12T01:15:48.178507+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.144813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2728229,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":36071,"num_write":841,"num_write_kb":27237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'834","reported_seq":2461,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749255+0000","last_change":"2024-09-12T00:02:50.076816+0000","last_active":"2024-09-12T01:15:09.749255+0000","last_peered":"2024-09-12T01:15:09.749255+0000","last_clean":"2024-09-12T01:15:09.749255+0000","last_became_active":"2024-09-12T00:02:50.076513+0000","last_became_peered":"2024-09-12T00:02:50.076513+0000","last_unstale":"2024-09-12T01:15:09.749255+0000","last_undegraded":"2024-09-12T01:15:09.749255+0000","last_fullsized":"2024-09-12T01:15:09.749255+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:15.455296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4096,"num_read_kb":3692,"num_write":1085,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'192","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.070415+0000","last_change":"2024-09-12T00:03:21.143529+0000","last_active":"2024-09-12T01:15:48.070415+0000","last_peered":"2024-09-12T01:15:48.070415+0000","last_clean":"2024-09-12T01:15:48.070415+0000","last_became_active":"2024-09-12T00:03:21.143160+0000","last_became_peered":"2024-09-12T00:03:21.143160+0000","last_unstale":"2024-09-12T01:15:48.070415+0000","last_undegraded":"2024-09-12T01:15:48.070415+0000","last_fullsized":"2024-09-12T01:15:48.070415+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:30.205902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242910,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":433,"num_read_kb":67077,"num_write":936,"num_write_kb":29840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.787449+0000","last_change":"2024-09-12T00:02:50.060740+0000","last_active":"2024-09-12T01:13:16.787449+0000","last_peered":"2024-09-12T01:13:16.787449+0000","last_clean":"2024-09-12T01:13:16.787449+0000","last_became_active":"2024-09-12T00:02:50.060457+0000","last_became_peered":"2024-09-12T00:02:50.060457+0000","last_unstale":"2024-09-12T01:13:16.787449+0000","last_undegraded":"2024-09-12T01:13:16.787449+0000","last_fullsized":"2024-09-12T01:13:16.787449+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:20.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2366,"num_read_kb":2209,"num_write":518,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5804,"num_read_kb":4071,"num_write":1920,"num_write_kb":818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1091,"ondisk_log_size":1091,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15077,"num_read_kb":14728,"num_write":16720,"num_write_kb":4882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":651,"ondisk_log_size":651,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":282194,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":10143,"num_read_kb":12207,"num_write":7073,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":44589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1856,"ondisk_log_size":1856,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212469,"num_read_kb":193861,"num_write":55201,"num_write_kb":18788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3960,"ondisk_log_size":3960,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":167873438,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":269,"num_whiteouts":0,"num_read":33148,"num_read_kb":2494324,"num_write":62055,"num_write_kb":2229204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":297668608,"data_stored":297668608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4483,"ondisk_log_size":4483,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24117248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":196988,"num_write":154,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41946250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":17865937,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":185720,"num_write":153,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510326,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364752,"kb_used_data":135040,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94007088,"statfs":{"total":96636764160,"available":96263258112,"internally_reserved":0,"allocated":138280960,"data_stored":136104256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510328,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255716,"kb_used_data":25968,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116124,"statfs":{"total":96636764160,"available":96374910976,"internally_reserved":0,"allocated":26591232,"data_stored":24503671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510330,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178644,"kb_used_data":80776,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94193196,"statfs":{"total":96636764160,"available":96453832704,"internally_reserved":0,"allocated":82714624,"data_stored":80531231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510325,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238316,"kb_used_data":157148,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94133524,"statfs":{"total":96636764160,"available":96392728576,"internally_reserved":0,"allocated":160919552,"data_stored":158845075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510324,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394924,"kb_used_data":165212,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93976916,"statfs":{"total":96636764160,"available":96232361984,"internally_reserved":0,"allocated":169177088,"data_stored":167005594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510322,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200192,"kb_used_data":124592,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94171648,"statfs":{"total":96636764160,"available":96431767552,"internally_reserved":0,"allocated":127582208,"data_stored":125513021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510323,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":219268,"kb_used_data":97888,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94152572,"statfs":{"total":96636764160,"available":96412233728,"internally_reserved":0,"allocated":100237312,"data_stored":98121776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575733,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423392,"kb_used_data":175696,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93948448,"statfs":{"total":96636764160,"available":96203210752,"internally_reserved":0,"allocated":179912704,"data_stored":177775047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":107704320,"data_stored":107704320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40677376,"data_stored":40677376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40558592,"data_stored":40558592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33263616,"data_stored":33263616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32108544,"data_stored":32108544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11759616,"data_stored":11759616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22204416,"data_stored":22204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":29720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":9053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41946250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:15:50.432 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:15:50.786 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:15:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T01:15:50.800 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":2462,"stamp":"2024-09-12T01:15:49.319941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210746866,"num_objects":777,"num_object_clones":0,"num_object_copies":1823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":777,"num_whiteouts":0,"num_read":279380,"num_read_kb":3104823,"num_write":143417,"num_write_kb":2513039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14182,"ondisk_log_size":14182,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2275204,"kb_used_data":962320,"kb_used_omap":12,"kb_used_meta":1312627,"kb_avail":752699516,"statfs":{"total":773094113280,"available":770764304384,"internally_reserved":0,"allocated":985415680,"data_stored":968399671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1344130609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-513064071,"num_objects":-230,"num_object_clones":0,"num_object_copies":-661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-230,"num_whiteouts":0,"num_read":486,"num_read_kb":515,"num_write":354,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005263"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502105+0000","last_change":"2024-09-12T00:39:26.642397+0000","last_active":"2024-09-12T01:11:58.502105+0000","last_peered":"2024-09-12T01:11:58.502105+0000","last_clean":"2024-09-12T01:11:58.502105+0000","last_became_active":"2024-09-12T00:39:26.642090+0000","last_became_peered":"2024-09-12T00:39:26.642090+0000","last_unstale":"2024-09-12T01:11:58.502105+0000","last_undegraded":"2024-09-12T01:11:58.502105+0000","last_fullsized":"2024-09-12T01:11:58.502105+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:54.374892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.502826+0000","last_change":"2024-09-12T00:22:02.424471+0000","last_active":"2024-09-12T01:12:03.502826+0000","last_peered":"2024-09-12T01:12:03.502826+0000","last_clean":"2024-09-12T01:12:03.502826+0000","last_became_active":"2024-09-12T00:22:02.423867+0000","last_became_peered":"2024-09-12T00:22:02.423867+0000","last_unstale":"2024-09-12T01:12:03.502826+0000","last_undegraded":"2024-09-12T01:12:03.502826+0000","last_fullsized":"2024-09-12T01:12:03.502826+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.940652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.246266+0000","last_change":"2024-09-12T00:21:58.336211+0000","last_active":"2024-09-12T01:14:28.246266+0000","last_peered":"2024-09-12T01:14:28.246266+0000","last_clean":"2024-09-12T01:14:28.246266+0000","last_became_active":"2024-09-12T00:21:58.335882+0000","last_became_peered":"2024-09-12T00:21:58.335882+0000","last_unstale":"2024-09-12T01:14:28.246266+0000","last_undegraded":"2024-09-12T01:14:28.246266+0000","last_fullsized":"2024-09-12T01:14:28.246266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:06.306799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":322,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'60","reported_seq":223,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238949+0000","last_change":"2024-09-12T00:17:58.354178+0000","last_active":"2024-09-12T01:12:10.238949+0000","last_peered":"2024-09-12T01:12:10.238949+0000","last_clean":"2024-09-12T01:12:10.238949+0000","last_became_active":"2024-09-12T00:17:58.353889+0000","last_became_peered":"2024-09-12T00:17:58.353889+0000","last_unstale":"2024-09-12T01:12:10.238949+0000","last_undegraded":"2024-09-12T01:12:10.238949+0000","last_fullsized":"2024-09-12T01:12:10.238949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.435699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":209,"num_write":117,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221699+0000","last_change":"2024-09-12T00:39:26.637541+0000","last_active":"2024-09-12T01:11:58.221699+0000","last_peered":"2024-09-12T01:11:58.221699+0000","last_clean":"2024-09-12T01:11:58.221699+0000","last_became_active":"2024-09-12T00:39:26.637244+0000","last_became_peered":"2024-09-12T00:39:26.637244+0000","last_unstale":"2024-09-12T01:11:58.221699+0000","last_undegraded":"2024-09-12T01:11:58.221699+0000","last_fullsized":"2024-09-12T01:11:58.221699+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:40.343211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.390545+0000","last_change":"2024-09-12T00:22:02.421061+0000","last_active":"2024-09-12T01:12:03.390545+0000","last_peered":"2024-09-12T01:12:03.390545+0000","last_clean":"2024-09-12T01:12:03.390545+0000","last_became_active":"2024-09-12T00:22:02.420774+0000","last_became_peered":"2024-09-12T00:22:02.420774+0000","last_unstale":"2024-09-12T01:12:03.390545+0000","last_undegraded":"2024-09-12T01:12:03.390545+0000","last_fullsized":"2024-09-12T01:12:03.390545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:12.865558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229707+0000","last_change":"2024-09-12T00:21:58.338086+0000","last_active":"2024-09-12T01:11:58.229707+0000","last_peered":"2024-09-12T01:11:58.229707+0000","last_clean":"2024-09-12T01:11:58.229707+0000","last_became_active":"2024-09-12T00:21:58.336723+0000","last_became_peered":"2024-09-12T00:21:58.336723+0000","last_unstale":"2024-09-12T01:11:58.229707+0000","last_undegraded":"2024-09-12T01:11:58.229707+0000","last_fullsized":"2024-09-12T01:11:58.229707+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:29.016179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.223001+0000","last_change":"2024-09-12T00:17:58.361616+0000","last_active":"2024-09-12T01:12:08.223001+0000","last_peered":"2024-09-12T01:12:08.223001+0000","last_clean":"2024-09-12T01:12:08.223001+0000","last_became_active":"2024-09-12T00:17:58.361306+0000","last_became_peered":"2024-09-12T00:17:58.361306+0000","last_unstale":"2024-09-12T01:12:08.223001+0000","last_undegraded":"2024-09-12T01:12:08.223001+0000","last_fullsized":"2024-09-12T01:12:08.223001+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:11.973986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618592+0000","last_change":"2024-09-12T00:39:26.625650+0000","last_active":"2024-09-12T01:13:18.618592+0000","last_peered":"2024-09-12T01:13:18.618592+0000","last_clean":"2024-09-12T01:13:18.618592+0000","last_became_active":"2024-09-12T00:39:26.625454+0000","last_became_peered":"2024-09-12T00:39:26.625454+0000","last_unstale":"2024-09-12T01:13:18.618592+0000","last_undegraded":"2024-09-12T01:13:18.618592+0000","last_fullsized":"2024-09-12T01:13:18.618592+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:07.891692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238405+0000","last_change":"2024-09-12T00:22:02.422000+0000","last_active":"2024-09-12T01:12:05.238405+0000","last_peered":"2024-09-12T01:12:05.238405+0000","last_clean":"2024-09-12T01:12:05.238405+0000","last_became_active":"2024-09-12T00:22:02.421689+0000","last_became_peered":"2024-09-12T00:22:02.421689+0000","last_unstale":"2024-09-12T01:12:05.238405+0000","last_undegraded":"2024-09-12T01:12:05.238405+0000","last_fullsized":"2024-09-12T01:12:05.238405+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:25.931614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222987+0000","last_change":"2024-09-12T00:21:58.333094+0000","last_active":"2024-09-12T01:12:08.222987+0000","last_peered":"2024-09-12T01:12:08.222987+0000","last_clean":"2024-09-12T01:12:08.222987+0000","last_became_active":"2024-09-12T00:21:58.332782+0000","last_became_peered":"2024-09-12T00:21:58.332782+0000","last_unstale":"2024-09-12T01:12:08.222987+0000","last_undegraded":"2024-09-12T01:12:08.222987+0000","last_fullsized":"2024-09-12T01:12:08.222987+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:03.474793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'34","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244636+0000","last_change":"2024-09-12T00:17:58.353482+0000","last_active":"2024-09-12T01:13:00.244636+0000","last_peered":"2024-09-12T01:13:00.244636+0000","last_clean":"2024-09-12T01:13:00.244636+0000","last_became_active":"2024-09-12T00:17:58.353045+0000","last_became_peered":"2024-09-12T00:17:58.353045+0000","last_unstale":"2024-09-12T01:13:00.244636+0000","last_undegraded":"2024-09-12T01:13:00.244636+0000","last_fullsized":"2024-09-12T01:13:00.244636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:52.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.237224+0000","last_change":"2024-09-12T00:39:26.637464+0000","last_active":"2024-09-12T01:13:23.237224+0000","last_peered":"2024-09-12T01:13:23.237224+0000","last_clean":"2024-09-12T01:13:23.237224+0000","last_became_active":"2024-09-12T00:39:26.637185+0000","last_became_peered":"2024-09-12T00:39:26.637185+0000","last_unstale":"2024-09-12T01:13:23.237224+0000","last_undegraded":"2024-09-12T01:13:23.237224+0000","last_fullsized":"2024-09-12T01:13:23.237224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:20.137461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449572+0000","last_change":"2024-09-12T00:22:02.428079+0000","last_active":"2024-09-12T01:12:08.449572+0000","last_peered":"2024-09-12T01:12:08.449572+0000","last_clean":"2024-09-12T01:12:08.449572+0000","last_became_active":"2024-09-12T00:22:02.427612+0000","last_became_peered":"2024-09-12T00:22:02.427612+0000","last_unstale":"2024-09-12T01:12:08.449572+0000","last_undegraded":"2024-09-12T01:12:08.449572+0000","last_fullsized":"2024-09-12T01:12:08.449572+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:46.790157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.389901+0000","last_change":"2024-09-12T00:21:58.335917+0000","last_active":"2024-09-12T01:11:58.389901+0000","last_peered":"2024-09-12T01:11:58.389901+0000","last_clean":"2024-09-12T01:11:58.389901+0000","last_became_active":"2024-09-12T00:21:58.335619+0000","last_became_peered":"2024-09-12T00:21:58.335619+0000","last_unstale":"2024-09-12T01:11:58.389901+0000","last_undegraded":"2024-09-12T01:11:58.389901+0000","last_fullsized":"2024-09-12T01:11:58.389901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.724726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455358+0000","last_change":"2024-09-12T00:17:58.356021+0000","last_active":"2024-09-12T01:12:58.455358+0000","last_peered":"2024-09-12T01:12:58.455358+0000","last_clean":"2024-09-12T01:12:58.455358+0000","last_became_active":"2024-09-12T00:17:58.355691+0000","last_became_peered":"2024-09-12T00:17:58.355691+0000","last_unstale":"2024-09-12T01:12:58.455358+0000","last_undegraded":"2024-09-12T01:12:58.455358+0000","last_fullsized":"2024-09-12T01:12:58.455358+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:23.027551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238400+0000","last_change":"2024-09-12T00:39:26.635830+0000","last_active":"2024-09-12T01:13:33.238400+0000","last_peered":"2024-09-12T01:13:33.238400+0000","last_clean":"2024-09-12T01:13:33.238400+0000","last_became_active":"2024-09-12T00:39:26.635537+0000","last_became_peered":"2024-09-12T00:39:26.635537+0000","last_unstale":"2024-09-12T01:13:33.238400+0000","last_undegraded":"2024-09-12T01:13:33.238400+0000","last_fullsized":"2024-09-12T01:13:33.238400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:16.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510161+0000","last_change":"2024-09-12T00:22:02.429586+0000","last_active":"2024-09-12T01:12:53.510161+0000","last_peered":"2024-09-12T01:12:53.510161+0000","last_clean":"2024-09-12T01:12:53.510161+0000","last_became_active":"2024-09-12T00:22:02.429230+0000","last_became_peered":"2024-09-12T00:22:02.429230+0000","last_unstale":"2024-09-12T01:12:53.510161+0000","last_undegraded":"2024-09-12T01:12:53.510161+0000","last_fullsized":"2024-09-12T01:12:53.510161+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:50.744822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242639+0000","last_change":"2024-09-12T00:21:58.338788+0000","last_active":"2024-09-12T01:12:45.242639+0000","last_peered":"2024-09-12T01:12:45.242639+0000","last_clean":"2024-09-12T01:12:45.242639+0000","last_became_active":"2024-09-12T00:21:58.338021+0000","last_became_peered":"2024-09-12T00:21:58.338021+0000","last_unstale":"2024-09-12T01:12:45.242639+0000","last_undegraded":"2024-09-12T01:12:45.242639+0000","last_fullsized":"2024-09-12T01:12:45.242639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:31.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'22","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455331+0000","last_change":"2024-09-12T00:17:58.358082+0000","last_active":"2024-09-12T01:12:58.455331+0000","last_peered":"2024-09-12T01:12:58.455331+0000","last_clean":"2024-09-12T01:12:58.455331+0000","last_became_active":"2024-09-12T00:17:58.357755+0000","last_became_peered":"2024-09-12T00:17:58.357755+0000","last_unstale":"2024-09-12T01:12:58.455331+0000","last_undegraded":"2024-09-12T01:12:58.455331+0000","last_fullsized":"2024-09-12T01:12:58.455331+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:17.853509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.235439+0000","last_change":"2024-09-12T00:39:26.631339+0000","last_active":"2024-09-12T01:12:48.235439+0000","last_peered":"2024-09-12T01:12:48.235439+0000","last_clean":"2024-09-12T01:12:48.235439+0000","last_became_active":"2024-09-12T00:39:26.630758+0000","last_became_peered":"2024-09-12T00:39:26.630758+0000","last_unstale":"2024-09-12T01:12:48.235439+0000","last_undegraded":"2024-09-12T01:12:48.235439+0000","last_fullsized":"2024-09-12T01:12:48.235439+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.184229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'5","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041261+0000","last_change":"2024-09-12T00:22:02.428161+0000","last_active":"2024-09-12T01:15:48.041261+0000","last_peered":"2024-09-12T01:15:48.041261+0000","last_clean":"2024-09-12T01:15:48.041261+0000","last_became_active":"2024-09-12T00:22:02.427863+0000","last_became_peered":"2024-09-12T00:22:02.427863+0000","last_unstale":"2024-09-12T01:15:48.041261+0000","last_undegraded":"2024-09-12T01:15:48.041261+0000","last_fullsized":"2024-09-12T01:15:48.041261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:46.107765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":40,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397371+0000","last_change":"2024-09-12T00:21:58.330893+0000","last_active":"2024-09-12T01:12:53.397371+0000","last_peered":"2024-09-12T01:12:53.397371+0000","last_clean":"2024-09-12T01:12:53.397371+0000","last_became_active":"2024-09-12T00:21:58.330308+0000","last_became_peered":"2024-09-12T00:21:58.330308+0000","last_unstale":"2024-09-12T01:12:53.397371+0000","last_undegraded":"2024-09-12T01:12:53.397371+0000","last_fullsized":"2024-09-12T01:12:53.397371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.864549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'33","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616030+0000","last_change":"2024-09-12T00:17:58.360675+0000","last_active":"2024-09-12T01:12:58.616030+0000","last_peered":"2024-09-12T01:12:58.616030+0000","last_clean":"2024-09-12T01:12:58.616030+0000","last_became_active":"2024-09-12T00:17:58.360394+0000","last_became_peered":"2024-09-12T00:17:58.360394+0000","last_unstale":"2024-09-12T01:12:58.616030+0000","last_undegraded":"2024-09-12T01:12:58.616030+0000","last_fullsized":"2024-09-12T01:12:58.616030+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:36.476994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":120,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391380+0000","last_change":"2024-09-12T00:39:26.638745+0000","last_active":"2024-09-12T01:11:58.391380+0000","last_peered":"2024-09-12T01:11:58.391380+0000","last_clean":"2024-09-12T01:11:58.391380+0000","last_became_active":"2024-09-12T00:39:26.638443+0000","last_became_peered":"2024-09-12T00:39:26.638443+0000","last_unstale":"2024-09-12T01:11:58.391380+0000","last_undegraded":"2024-09-12T01:11:58.391380+0000","last_fullsized":"2024-09-12T01:11:58.391380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:39.177058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"264'5","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608465+0000","last_change":"2024-09-12T00:22:02.420219+0000","last_active":"2024-09-12T01:12:03.608465+0000","last_peered":"2024-09-12T01:12:03.608465+0000","last_clean":"2024-09-12T01:12:03.608465+0000","last_became_active":"2024-09-12T00:22:02.419920+0000","last_became_peered":"2024-09-12T00:22:02.419920+0000","last_unstale":"2024-09-12T01:12:03.608465+0000","last_undegraded":"2024-09-12T01:12:03.608465+0000","last_fullsized":"2024-09-12T01:12:03.608465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.257546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6462,"num_write":5,"num_write_kb":6462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.057954+0000","last_change":"2024-09-12T00:21:58.334923+0000","last_active":"2024-09-12T01:15:48.057954+0000","last_peered":"2024-09-12T01:15:48.057954+0000","last_clean":"2024-09-12T01:15:48.057954+0000","last_became_active":"2024-09-12T00:21:58.334622+0000","last_became_peered":"2024-09-12T00:21:58.334622+0000","last_unstale":"2024-09-12T01:15:48.057954+0000","last_undegraded":"2024-09-12T01:15:48.057954+0000","last_fullsized":"2024-09-12T01:15:48.057954+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:27.246572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'18","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.233636+0000","last_change":"2024-09-12T00:17:58.362164+0000","last_active":"2024-09-12T01:11:25.233636+0000","last_peered":"2024-09-12T01:11:25.233636+0000","last_clean":"2024-09-12T01:11:25.233636+0000","last_became_active":"2024-09-12T00:17:58.361620+0000","last_became_peered":"2024-09-12T00:17:58.361620+0000","last_unstale":"2024-09-12T01:11:25.233636+0000","last_undegraded":"2024-09-12T01:11:25.233636+0000","last_fullsized":"2024-09-12T01:11:25.233636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:00.693430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391431+0000","last_change":"2024-09-12T00:39:26.643583+0000","last_active":"2024-09-12T01:11:58.391431+0000","last_peered":"2024-09-12T01:11:58.391431+0000","last_clean":"2024-09-12T01:11:58.391431+0000","last_became_active":"2024-09-12T00:39:26.643223+0000","last_became_peered":"2024-09-12T00:39:26.643223+0000","last_unstale":"2024-09-12T01:11:58.391431+0000","last_undegraded":"2024-09-12T01:11:58.391431+0000","last_fullsized":"2024-09-12T01:11:58.391431+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:18.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'5","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066478+0000","last_change":"2024-09-12T00:22:22.312042+0000","last_active":"2024-09-12T01:15:48.066478+0000","last_peered":"2024-09-12T01:15:48.066478+0000","last_clean":"2024-09-12T01:15:48.066478+0000","last_became_active":"2024-09-12T00:22:22.311701+0000","last_became_peered":"2024-09-12T00:22:22.311701+0000","last_unstale":"2024-09-12T01:15:48.066478+0000","last_undegraded":"2024-09-12T01:15:48.066478+0000","last_fullsized":"2024-09-12T01:15:48.066478+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.780165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":5,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237766+0000","last_change":"2024-09-12T00:21:58.339874+0000","last_active":"2024-09-12T01:12:00.237766+0000","last_peered":"2024-09-12T01:12:00.237766+0000","last_clean":"2024-09-12T01:12:00.237766+0000","last_became_active":"2024-09-12T00:21:58.339586+0000","last_became_peered":"2024-09-12T00:21:58.339586+0000","last_unstale":"2024-09-12T01:12:00.237766+0000","last_undegraded":"2024-09-12T01:12:00.237766+0000","last_fullsized":"2024-09-12T01:12:00.237766+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:27.131816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'26","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.223825+0000","last_change":"2024-09-12T00:17:58.352434+0000","last_active":"2024-09-12T01:11:08.223825+0000","last_peered":"2024-09-12T01:11:08.223825+0000","last_clean":"2024-09-12T01:11:08.223825+0000","last_became_active":"2024-09-12T00:17:58.352129+0000","last_became_peered":"2024-09-12T00:17:58.352129+0000","last_unstale":"2024-09-12T01:11:08.223825+0000","last_undegraded":"2024-09-12T01:11:08.223825+0000","last_fullsized":"2024-09-12T01:11:08.223825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:16.704935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230767+0000","last_change":"2024-09-12T00:39:26.636027+0000","last_active":"2024-09-12T01:12:08.230767+0000","last_peered":"2024-09-12T01:12:08.230767+0000","last_clean":"2024-09-12T01:12:08.230767+0000","last_became_active":"2024-09-12T00:39:26.635558+0000","last_became_peered":"2024-09-12T00:39:26.635558+0000","last_unstale":"2024-09-12T01:12:08.230767+0000","last_undegraded":"2024-09-12T01:12:08.230767+0000","last_fullsized":"2024-09-12T01:12:08.230767+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.105963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.252261+0000","last_change":"2024-09-12T00:22:02.427487+0000","last_active":"2024-09-12T01:15:13.252261+0000","last_peered":"2024-09-12T01:15:13.252261+0000","last_clean":"2024-09-12T01:15:13.252261+0000","last_became_active":"2024-09-12T00:22:02.427180+0000","last_became_peered":"2024-09-12T00:22:02.427180+0000","last_unstale":"2024-09-12T01:15:13.252261+0000","last_undegraded":"2024-09-12T01:15:13.252261+0000","last_fullsized":"2024-09-12T01:15:13.252261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:40.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.535314+0000","last_change":"2024-09-12T00:21:58.334729+0000","last_active":"2024-09-12T01:15:43.535314+0000","last_peered":"2024-09-12T01:15:43.535314+0000","last_clean":"2024-09-12T01:15:43.535314+0000","last_became_active":"2024-09-12T00:21:58.334446+0000","last_became_peered":"2024-09-12T00:21:58.334446+0000","last_unstale":"2024-09-12T01:15:43.535314+0000","last_undegraded":"2024-09-12T01:15:43.535314+0000","last_fullsized":"2024-09-12T01:15:43.535314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:37.568023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'14","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.232052+0000","last_change":"2024-09-12T00:17:58.360971+0000","last_active":"2024-09-12T01:11:10.232052+0000","last_peered":"2024-09-12T01:11:10.232052+0000","last_clean":"2024-09-12T01:11:10.232052+0000","last_became_active":"2024-09-12T00:17:58.360560+0000","last_became_peered":"2024-09-12T00:17:58.360560+0000","last_unstale":"2024-09-12T01:11:10.232052+0000","last_undegraded":"2024-09-12T01:11:10.232052+0000","last_fullsized":"2024-09-12T01:11:10.232052+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:20.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222918+0000","last_change":"2024-09-12T00:39:26.635643+0000","last_active":"2024-09-12T01:12:08.222918+0000","last_peered":"2024-09-12T01:12:08.222918+0000","last_clean":"2024-09-12T01:12:08.222918+0000","last_became_active":"2024-09-12T00:39:26.635359+0000","last_became_peered":"2024-09-12T00:39:26.635359+0000","last_unstale":"2024-09-12T01:12:08.222918+0000","last_undegraded":"2024-09-12T01:12:08.222918+0000","last_fullsized":"2024-09-12T01:12:08.222918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.949344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238347+0000","last_change":"2024-09-12T00:22:02.432403+0000","last_active":"2024-09-12T01:13:33.238347+0000","last_peered":"2024-09-12T01:13:33.238347+0000","last_clean":"2024-09-12T01:13:33.238347+0000","last_became_active":"2024-09-12T00:22:02.431994+0000","last_became_peered":"2024-09-12T00:22:02.431994+0000","last_unstale":"2024-09-12T01:13:33.238347+0000","last_undegraded":"2024-09-12T01:13:33.238347+0000","last_fullsized":"2024-09-12T01:13:33.238347+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.483552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397576+0000","last_change":"2024-09-12T00:21:58.327781+0000","last_active":"2024-09-12T01:12:43.397576+0000","last_peered":"2024-09-12T01:12:43.397576+0000","last_clean":"2024-09-12T01:12:43.397576+0000","last_became_active":"2024-09-12T00:21:58.327504+0000","last_became_peered":"2024-09-12T00:21:58.327504+0000","last_unstale":"2024-09-12T01:12:43.397576+0000","last_undegraded":"2024-09-12T01:12:43.397576+0000","last_fullsized":"2024-09-12T01:12:43.397576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:09.606355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'62","reported_seq":221,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.442193+0000","last_change":"2024-09-12T00:17:58.360373+0000","last_active":"2024-09-12T01:11:08.442193+0000","last_peered":"2024-09-12T01:11:08.442193+0000","last_clean":"2024-09-12T01:11:08.442193+0000","last_became_active":"2024-09-12T00:17:58.360095+0000","last_became_peered":"2024-09-12T00:17:58.360095+0000","last_unstale":"2024-09-12T01:11:08.442193+0000","last_undegraded":"2024-09-12T01:11:08.442193+0000","last_fullsized":"2024-09-12T01:11:08.442193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:39.437158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":213,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392762+0000","last_change":"2024-09-12T00:39:26.639982+0000","last_active":"2024-09-12T01:12:08.392762+0000","last_peered":"2024-09-12T01:12:08.392762+0000","last_clean":"2024-09-12T01:12:08.392762+0000","last_became_active":"2024-09-12T00:39:26.639681+0000","last_became_peered":"2024-09-12T00:39:26.639681+0000","last_unstale":"2024-09-12T01:12:08.392762+0000","last_undegraded":"2024-09-12T01:12:08.392762+0000","last_fullsized":"2024-09-12T01:12:08.392762+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:35.336644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.454200+0000","last_change":"2024-09-12T00:22:02.427581+0000","last_active":"2024-09-12T01:12:48.454200+0000","last_peered":"2024-09-12T01:12:48.454200+0000","last_clean":"2024-09-12T01:12:48.454200+0000","last_became_active":"2024-09-12T00:22:02.427285+0000","last_became_peered":"2024-09-12T00:22:02.427285+0000","last_unstale":"2024-09-12T01:12:48.454200+0000","last_undegraded":"2024-09-12T01:12:48.454200+0000","last_fullsized":"2024-09-12T01:12:48.454200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:22.119778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.227172+0000","last_change":"2024-09-12T00:21:58.335430+0000","last_active":"2024-09-12T01:12:43.227172+0000","last_peered":"2024-09-12T01:12:43.227172+0000","last_clean":"2024-09-12T01:12:43.227172+0000","last_became_active":"2024-09-12T00:21:58.335100+0000","last_became_peered":"2024-09-12T00:21:58.335100+0000","last_unstale":"2024-09-12T01:12:43.227172+0000","last_undegraded":"2024-09-12T01:12:43.227172+0000","last_fullsized":"2024-09-12T01:12:43.227172+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:24.939276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'91","reported_seq":369,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.216774+0000","last_change":"2024-09-12T00:17:58.350821+0000","last_active":"2024-09-12T01:11:08.216774+0000","last_peered":"2024-09-12T01:11:08.216774+0000","last_clean":"2024-09-12T01:11:08.216774+0000","last_became_active":"2024-09-12T00:17:58.350522+0000","last_became_peered":"2024-09-12T00:17:58.350522+0000","last_unstale":"2024-09-12T01:11:08.216774+0000","last_undegraded":"2024-09-12T01:11:08.216774+0000","last_fullsized":"2024-09-12T01:11:08.216774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.821787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":413,"num_write":129,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503487+0000","last_change":"2024-09-12T00:39:26.642765+0000","last_active":"2024-09-12T01:12:08.503487+0000","last_peered":"2024-09-12T01:12:08.503487+0000","last_clean":"2024-09-12T01:12:08.503487+0000","last_became_active":"2024-09-12T00:39:26.642486+0000","last_became_peered":"2024-09-12T00:39:26.642486+0000","last_unstale":"2024-09-12T01:12:08.503487+0000","last_undegraded":"2024-09-12T01:12:08.503487+0000","last_fullsized":"2024-09-12T01:12:08.503487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:37.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396598+0000","last_change":"2024-09-12T00:22:02.418272+0000","last_active":"2024-09-12T01:12:48.396598+0000","last_peered":"2024-09-12T01:12:48.396598+0000","last_clean":"2024-09-12T01:12:48.396598+0000","last_became_active":"2024-09-12T00:22:02.417518+0000","last_became_peered":"2024-09-12T00:22:02.417518+0000","last_unstale":"2024-09-12T01:12:48.396598+0000","last_undegraded":"2024-09-12T01:12:48.396598+0000","last_fullsized":"2024-09-12T01:12:48.396598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.931899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'10","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242751+0000","last_change":"2024-09-12T00:21:58.337365+0000","last_active":"2024-09-12T01:12:45.242751+0000","last_peered":"2024-09-12T01:12:45.242751+0000","last_clean":"2024-09-12T01:12:45.242751+0000","last_became_active":"2024-09-12T00:21:58.337079+0000","last_became_peered":"2024-09-12T00:21:58.337079+0000","last_unstale":"2024-09-12T01:12:45.242751+0000","last_undegraded":"2024-09-12T01:12:45.242751+0000","last_fullsized":"2024-09-12T01:12:45.242751+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.875541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":24618,"num_write":20,"num_write_kb":14376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'26","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390038+0000","last_change":"2024-09-12T00:17:58.360573+0000","last_active":"2024-09-12T01:11:48.390038+0000","last_peered":"2024-09-12T01:11:48.390038+0000","last_clean":"2024-09-12T01:11:48.390038+0000","last_became_active":"2024-09-12T00:17:58.360141+0000","last_became_peered":"2024-09-12T00:17:58.360141+0000","last_unstale":"2024-09-12T01:11:48.390038+0000","last_undegraded":"2024-09-12T01:11:48.390038+0000","last_fullsized":"2024-09-12T01:11:48.390038+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.883700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236768+0000","last_change":"2024-09-12T00:39:26.636792+0000","last_active":"2024-09-12T01:13:18.236768+0000","last_peered":"2024-09-12T01:13:18.236768+0000","last_clean":"2024-09-12T01:13:18.236768+0000","last_became_active":"2024-09-12T00:39:26.636434+0000","last_became_peered":"2024-09-12T00:39:26.636434+0000","last_unstale":"2024-09-12T01:13:18.236768+0000","last_undegraded":"2024-09-12T01:13:18.236768+0000","last_fullsized":"2024-09-12T01:13:18.236768+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:17.120295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256725+0000","last_change":"2024-09-12T00:22:02.420813+0000","last_active":"2024-09-12T01:15:43.256725+0000","last_peered":"2024-09-12T01:15:43.256725+0000","last_clean":"2024-09-12T01:15:43.256725+0000","last_became_active":"2024-09-12T00:22:02.420528+0000","last_became_peered":"2024-09-12T00:22:02.420528+0000","last_unstale":"2024-09-12T01:15:43.256725+0000","last_undegraded":"2024-09-12T01:15:43.256725+0000","last_fullsized":"2024-09-12T01:15:43.256725+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:36.557751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:38.274384+0000","last_change":"2024-09-12T00:21:58.337490+0000","last_active":"2024-09-12T01:15:38.274384+0000","last_peered":"2024-09-12T01:15:38.274384+0000","last_clean":"2024-09-12T01:15:38.274384+0000","last_became_active":"2024-09-12T00:21:58.337215+0000","last_became_peered":"2024-09-12T00:21:58.337215+0000","last_unstale":"2024-09-12T01:15:38.274384+0000","last_undegraded":"2024-09-12T01:15:38.274384+0000","last_fullsized":"2024-09-12T01:15:38.274384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.089070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.388739+0000","last_change":"2024-09-12T00:17:58.360965+0000","last_active":"2024-09-12T01:11:38.388739+0000","last_peered":"2024-09-12T01:11:38.388739+0000","last_clean":"2024-09-12T01:11:38.388739+0000","last_became_active":"2024-09-12T00:17:58.360592+0000","last_became_peered":"2024-09-12T00:17:58.360592+0000","last_unstale":"2024-09-12T01:11:38.388739+0000","last_undegraded":"2024-09-12T01:11:38.388739+0000","last_fullsized":"2024-09-12T01:11:38.388739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:45.213272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.247005+0000","last_change":"2024-09-12T00:39:26.641706+0000","last_active":"2024-09-12T01:13:20.247005+0000","last_peered":"2024-09-12T01:13:20.247005+0000","last_clean":"2024-09-12T01:13:20.247005+0000","last_became_active":"2024-09-12T00:39:26.641432+0000","last_became_peered":"2024-09-12T00:39:26.641432+0000","last_unstale":"2024-09-12T01:13:20.247005+0000","last_undegraded":"2024-09-12T01:13:20.247005+0000","last_fullsized":"2024-09-12T01:13:20.247005+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.345745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.239133+0000","last_change":"2024-09-12T00:22:02.423461+0000","last_active":"2024-09-12T01:13:23.239133+0000","last_peered":"2024-09-12T01:13:23.239133+0000","last_clean":"2024-09-12T01:13:23.239133+0000","last_became_active":"2024-09-12T00:22:02.423012+0000","last_became_peered":"2024-09-12T00:22:02.423012+0000","last_unstale":"2024-09-12T01:13:23.239133+0000","last_undegraded":"2024-09-12T01:13:23.239133+0000","last_fullsized":"2024-09-12T01:13:23.239133+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:14.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236682+0000","last_change":"2024-09-12T00:21:58.334875+0000","last_active":"2024-09-12T01:13:18.236682+0000","last_peered":"2024-09-12T01:13:18.236682+0000","last_clean":"2024-09-12T01:13:18.236682+0000","last_became_active":"2024-09-12T00:21:58.334493+0000","last_became_peered":"2024-09-12T00:21:58.334493+0000","last_unstale":"2024-09-12T01:13:18.236682+0000","last_undegraded":"2024-09-12T01:13:18.236682+0000","last_fullsized":"2024-09-12T01:13:18.236682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:46.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'39","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235549+0000","last_change":"2024-09-12T00:17:58.355241+0000","last_active":"2024-09-12T01:11:40.235549+0000","last_peered":"2024-09-12T01:11:40.235549+0000","last_clean":"2024-09-12T01:11:40.235549+0000","last_became_active":"2024-09-12T00:17:58.354989+0000","last_became_peered":"2024-09-12T00:17:58.354989+0000","last_unstale":"2024-09-12T01:11:40.235549+0000","last_undegraded":"2024-09-12T01:11:40.235549+0000","last_fullsized":"2024-09-12T01:11:40.235549+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:24.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":70,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240008+0000","last_change":"2024-09-12T00:39:26.630455+0000","last_active":"2024-09-12T01:12:20.240008+0000","last_peered":"2024-09-12T01:12:20.240008+0000","last_clean":"2024-09-12T01:12:20.240008+0000","last_became_active":"2024-09-12T00:39:26.627899+0000","last_became_peered":"2024-09-12T00:39:26.627899+0000","last_unstale":"2024-09-12T01:12:20.240008+0000","last_undegraded":"2024-09-12T01:12:20.240008+0000","last_fullsized":"2024-09-12T01:12:20.240008+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:19.704293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256860+0000","last_change":"2024-09-12T00:22:02.428036+0000","last_active":"2024-09-12T01:15:43.256860+0000","last_peered":"2024-09-12T01:15:43.256860+0000","last_clean":"2024-09-12T01:15:43.256860+0000","last_became_active":"2024-09-12T00:22:02.427322+0000","last_became_peered":"2024-09-12T00:22:02.427322+0000","last_unstale":"2024-09-12T01:15:43.256860+0000","last_undegraded":"2024-09-12T01:15:43.256860+0000","last_fullsized":"2024-09-12T01:15:43.256860+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:40.144405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618639+0000","last_change":"2024-09-12T00:21:58.329454+0000","last_active":"2024-09-12T01:13:18.618639+0000","last_peered":"2024-09-12T01:13:18.618639+0000","last_clean":"2024-09-12T01:13:18.618639+0000","last_became_active":"2024-09-12T00:21:58.329166+0000","last_became_peered":"2024-09-12T00:21:58.329166+0000","last_unstale":"2024-09-12T01:13:18.618639+0000","last_undegraded":"2024-09-12T01:13:18.618639+0000","last_fullsized":"2024-09-12T01:13:18.618639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:00.444000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'42","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386895+0000","last_change":"2024-09-12T00:17:58.355842+0000","last_active":"2024-09-12T01:11:38.386895+0000","last_peered":"2024-09-12T01:11:38.386895+0000","last_clean":"2024-09-12T01:11:38.386895+0000","last_became_active":"2024-09-12T00:17:58.355530+0000","last_became_peered":"2024-09-12T00:17:58.355530+0000","last_unstale":"2024-09-12T01:11:38.386895+0000","last_undegraded":"2024-09-12T01:11:38.386895+0000","last_fullsized":"2024-09-12T01:11:38.386895+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:00.979655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":155,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236747+0000","last_change":"2024-09-12T00:39:26.636645+0000","last_active":"2024-09-12T01:13:18.236747+0000","last_peered":"2024-09-12T01:13:18.236747+0000","last_clean":"2024-09-12T01:13:18.236747+0000","last_became_active":"2024-09-12T00:39:26.635996+0000","last_became_peered":"2024-09-12T00:39:26.635996+0000","last_unstale":"2024-09-12T01:13:18.236747+0000","last_undegraded":"2024-09-12T01:13:18.236747+0000","last_fullsized":"2024-09-12T01:13:18.236747+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:54.401173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.619395+0000","last_change":"2024-09-12T00:22:02.424107+0000","last_active":"2024-09-12T01:13:23.619395+0000","last_peered":"2024-09-12T01:13:23.619395+0000","last_clean":"2024-09-12T01:13:23.619395+0000","last_became_active":"2024-09-12T00:22:02.423766+0000","last_became_peered":"2024-09-12T00:22:02.423766+0000","last_unstale":"2024-09-12T01:13:23.619395+0000","last_undegraded":"2024-09-12T01:13:23.619395+0000","last_fullsized":"2024-09-12T01:13:23.619395+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:45.304079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.514151+0000","last_change":"2024-09-12T00:21:58.334763+0000","last_active":"2024-09-12T01:13:18.514151+0000","last_peered":"2024-09-12T01:13:18.514151+0000","last_clean":"2024-09-12T01:13:18.514151+0000","last_became_active":"2024-09-12T00:21:58.334482+0000","last_became_peered":"2024-09-12T00:21:58.334482+0000","last_unstale":"2024-09-12T01:13:18.514151+0000","last_undegraded":"2024-09-12T01:13:18.514151+0000","last_fullsized":"2024-09-12T01:13:18.514151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.615431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'8","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.445588+0000","last_change":"2024-09-12T00:17:58.357504+0000","last_active":"2024-09-12T01:11:38.445588+0000","last_peered":"2024-09-12T01:11:38.445588+0000","last_clean":"2024-09-12T01:11:38.445588+0000","last_became_active":"2024-09-12T00:17:58.357226+0000","last_became_peered":"2024-09-12T00:17:58.357226+0000","last_unstale":"2024-09-12T01:11:38.445588+0000","last_undegraded":"2024-09-12T01:11:38.445588+0000","last_fullsized":"2024-09-12T01:11:38.445588+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.150821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222890+0000","last_change":"2024-09-12T00:39:26.638504+0000","last_active":"2024-09-12T01:12:08.222890+0000","last_peered":"2024-09-12T01:12:08.222890+0000","last_clean":"2024-09-12T01:12:08.222890+0000","last_became_active":"2024-09-12T00:39:26.638202+0000","last_became_peered":"2024-09-12T00:39:26.638202+0000","last_unstale":"2024-09-12T01:12:08.222890+0000","last_undegraded":"2024-09-12T01:12:08.222890+0000","last_fullsized":"2024-09-12T01:12:08.222890+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:29.584845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.445007+0000","last_change":"2024-09-12T00:22:02.428671+0000","last_active":"2024-09-12T01:11:33.445007+0000","last_peered":"2024-09-12T01:11:33.445007+0000","last_clean":"2024-09-12T01:11:33.445007+0000","last_became_active":"2024-09-12T00:22:02.427762+0000","last_became_peered":"2024-09-12T00:22:02.427762+0000","last_unstale":"2024-09-12T01:11:33.445007+0000","last_undegraded":"2024-09-12T01:11:33.445007+0000","last_fullsized":"2024-09-12T01:11:33.445007+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:44.251003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"267'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010703+0000","last_change":"2024-09-12T00:21:58.338414+0000","last_active":"2024-09-12T01:15:48.010703+0000","last_peered":"2024-09-12T01:15:48.010703+0000","last_clean":"2024-09-12T01:15:48.010703+0000","last_became_active":"2024-09-12T00:21:58.338104+0000","last_became_peered":"2024-09-12T00:21:58.338104+0000","last_unstale":"2024-09-12T01:15:48.010703+0000","last_undegraded":"2024-09-12T01:15:48.010703+0000","last_fullsized":"2024-09-12T01:15:48.010703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:51.139680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10244,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'33","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.448982+0000","last_change":"2024-09-12T00:17:58.352171+0000","last_active":"2024-09-12T01:12:03.448982+0000","last_peered":"2024-09-12T01:12:03.448982+0000","last_clean":"2024-09-12T01:12:03.448982+0000","last_became_active":"2024-09-12T00:17:58.351876+0000","last_became_peered":"2024-09-12T00:17:58.351876+0000","last_unstale":"2024-09-12T01:12:03.448982+0000","last_undegraded":"2024-09-12T01:12:03.448982+0000","last_fullsized":"2024-09-12T01:12:03.448982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.992607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":110,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401591+0000","last_change":"2024-09-12T00:39:26.640188+0000","last_active":"2024-09-12T01:13:13.401591+0000","last_peered":"2024-09-12T01:13:13.401591+0000","last_clean":"2024-09-12T01:13:13.401591+0000","last_became_active":"2024-09-12T00:39:26.639704+0000","last_became_peered":"2024-09-12T00:39:26.639704+0000","last_unstale":"2024-09-12T01:13:13.401591+0000","last_undegraded":"2024-09-12T01:13:13.401591+0000","last_fullsized":"2024-09-12T01:13:13.401591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.680724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'6","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.009468+0000","last_change":"2024-09-12T00:22:02.430308+0000","last_active":"2024-09-12T01:15:48.009468+0000","last_peered":"2024-09-12T01:15:48.009468+0000","last_clean":"2024-09-12T01:15:48.009468+0000","last_became_active":"2024-09-12T00:22:02.430034+0000","last_became_peered":"2024-09-12T00:22:02.430034+0000","last_unstale":"2024-09-12T01:15:48.009468+0000","last_undegraded":"2024-09-12T01:15:48.009468+0000","last_fullsized":"2024-09-12T01:15:48.009468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.194625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'4","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.233384+0000","last_change":"2024-09-12T00:21:58.333427+0000","last_active":"2024-09-12T01:13:43.233384+0000","last_peered":"2024-09-12T01:13:43.233384+0000","last_clean":"2024-09-12T01:13:43.233384+0000","last_became_active":"2024-09-12T00:21:58.333135+0000","last_became_peered":"2024-09-12T00:21:58.333135+0000","last_unstale":"2024-09-12T01:13:43.233384+0000","last_undegraded":"2024-09-12T01:13:43.233384+0000","last_fullsized":"2024-09-12T01:13:43.233384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:11.164534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'34","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502186+0000","last_change":"2024-09-12T00:17:58.360392+0000","last_active":"2024-09-12T01:11:58.502186+0000","last_peered":"2024-09-12T01:11:58.502186+0000","last_clean":"2024-09-12T01:11:58.502186+0000","last_became_active":"2024-09-12T00:17:58.360064+0000","last_became_peered":"2024-09-12T00:17:58.360064+0000","last_unstale":"2024-09-12T01:11:58.502186+0000","last_undegraded":"2024-09-12T01:11:58.502186+0000","last_fullsized":"2024-09-12T01:11:58.502186+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:06.356739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":114,"num_write":67,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607743+0000","last_change":"2024-09-12T00:39:26.620334+0000","last_active":"2024-09-12T01:11:58.607743+0000","last_peered":"2024-09-12T01:11:58.607743+0000","last_clean":"2024-09-12T01:11:58.607743+0000","last_became_active":"2024-09-12T00:39:26.620012+0000","last_became_peered":"2024-09-12T00:39:26.620012+0000","last_unstale":"2024-09-12T01:11:58.607743+0000","last_undegraded":"2024-09-12T01:11:58.607743+0000","last_fullsized":"2024-09-12T01:11:58.607743+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.575760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.228663+0000","last_change":"2024-09-12T00:22:02.420815+0000","last_active":"2024-09-12T01:11:48.228663+0000","last_peered":"2024-09-12T01:11:48.228663+0000","last_clean":"2024-09-12T01:11:48.228663+0000","last_became_active":"2024-09-12T00:22:02.420536+0000","last_became_peered":"2024-09-12T00:22:02.420536+0000","last_unstale":"2024-09-12T01:11:48.228663+0000","last_undegraded":"2024-09-12T01:11:48.228663+0000","last_fullsized":"2024-09-12T01:11:48.228663+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:29.069188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.234276+0000","last_change":"2024-09-12T00:21:58.339677+0000","last_active":"2024-09-12T01:11:30.234276+0000","last_peered":"2024-09-12T01:11:30.234276+0000","last_clean":"2024-09-12T01:11:30.234276+0000","last_became_active":"2024-09-12T00:21:58.339390+0000","last_became_peered":"2024-09-12T00:21:58.339390+0000","last_unstale":"2024-09-12T01:11:30.234276+0000","last_undegraded":"2024-09-12T01:11:30.234276+0000","last_fullsized":"2024-09-12T01:11:30.234276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:52.122856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'22","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607816+0000","last_change":"2024-09-12T00:17:58.355891+0000","last_active":"2024-09-12T01:11:58.607816+0000","last_peered":"2024-09-12T01:11:58.607816+0000","last_clean":"2024-09-12T01:11:58.607816+0000","last_became_active":"2024-09-12T00:17:58.355602+0000","last_became_peered":"2024-09-12T00:17:58.355602+0000","last_unstale":"2024-09-12T01:11:58.607816+0000","last_undegraded":"2024-09-12T01:11:58.607816+0000","last_fullsized":"2024-09-12T01:11:58.607816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:26.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391317+0000","last_change":"2024-09-12T00:39:26.644546+0000","last_active":"2024-09-12T01:11:58.391317+0000","last_peered":"2024-09-12T01:11:58.391317+0000","last_clean":"2024-09-12T01:11:58.391317+0000","last_became_active":"2024-09-12T00:39:26.644190+0000","last_became_peered":"2024-09-12T00:39:26.644190+0000","last_unstale":"2024-09-12T01:11:58.391317+0000","last_undegraded":"2024-09-12T01:11:58.391317+0000","last_fullsized":"2024-09-12T01:11:58.391317+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:28.896406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.240192+0000","last_change":"2024-09-12T00:22:02.429622+0000","last_active":"2024-09-12T01:13:48.240192+0000","last_peered":"2024-09-12T01:13:48.240192+0000","last_clean":"2024-09-12T01:13:48.240192+0000","last_became_active":"2024-09-12T00:22:02.429289+0000","last_became_peered":"2024-09-12T00:22:02.429289+0000","last_unstale":"2024-09-12T01:13:48.240192+0000","last_undegraded":"2024-09-12T01:13:48.240192+0000","last_fullsized":"2024-09-12T01:13:48.240192+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:57.498730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.228080+0000","last_change":"2024-09-12T00:21:58.334628+0000","last_active":"2024-09-12T01:11:43.228080+0000","last_peered":"2024-09-12T01:11:43.228080+0000","last_clean":"2024-09-12T01:11:43.228080+0000","last_became_active":"2024-09-12T00:21:58.334362+0000","last_became_peered":"2024-09-12T00:21:58.334362+0000","last_unstale":"2024-09-12T01:11:43.228080+0000","last_undegraded":"2024-09-12T01:11:43.228080+0000","last_fullsized":"2024-09-12T01:11:43.228080+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:03.057103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'50","reported_seq":198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221741+0000","last_change":"2024-09-12T00:17:58.353550+0000","last_active":"2024-09-12T01:11:58.221741+0000","last_peered":"2024-09-12T01:11:58.221741+0000","last_clean":"2024-09-12T01:11:58.221741+0000","last_became_active":"2024-09-12T00:17:58.353253+0000","last_became_peered":"2024-09-12T00:17:58.353253+0000","last_unstale":"2024-09-12T01:11:58.221741+0000","last_undegraded":"2024-09-12T01:11:58.221741+0000","last_fullsized":"2024-09-12T01:11:58.221741+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":79,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.457321+0000","last_change":"2024-09-12T00:39:26.636163+0000","last_active":"2024-09-12T01:13:13.457321+0000","last_peered":"2024-09-12T01:13:13.457321+0000","last_clean":"2024-09-12T01:13:13.457321+0000","last_became_active":"2024-09-12T00:39:26.633295+0000","last_became_peered":"2024-09-12T00:39:26.633295+0000","last_unstale":"2024-09-12T01:13:13.457321+0000","last_undegraded":"2024-09-12T01:13:13.457321+0000","last_fullsized":"2024-09-12T01:13:13.457321+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:58.692850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.389134+0000","last_change":"2024-09-12T00:22:02.429406+0000","last_active":"2024-09-12T01:11:53.389134+0000","last_peered":"2024-09-12T01:11:53.389134+0000","last_clean":"2024-09-12T01:11:53.389134+0000","last_became_active":"2024-09-12T00:22:02.429088+0000","last_became_peered":"2024-09-12T00:22:02.429088+0000","last_unstale":"2024-09-12T01:11:53.389134+0000","last_undegraded":"2024-09-12T01:11:53.389134+0000","last_fullsized":"2024-09-12T01:11:53.389134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:06.418067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.236622+0000","last_change":"2024-09-12T00:21:58.338881+0000","last_active":"2024-09-12T01:11:50.236622+0000","last_peered":"2024-09-12T01:11:50.236622+0000","last_clean":"2024-09-12T01:11:50.236622+0000","last_became_active":"2024-09-12T00:21:58.338592+0000","last_became_peered":"2024-09-12T00:21:58.338592+0000","last_unstale":"2024-09-12T01:11:50.236622+0000","last_undegraded":"2024-09-12T01:11:50.236622+0000","last_fullsized":"2024-09-12T01:11:50.236622+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:24.783440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'20","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237791+0000","last_change":"2024-09-12T00:17:58.357513+0000","last_active":"2024-09-12T01:12:00.237791+0000","last_peered":"2024-09-12T01:12:00.237791+0000","last_clean":"2024-09-12T01:12:00.237791+0000","last_became_active":"2024-09-12T00:17:58.357219+0000","last_became_peered":"2024-09-12T00:17:58.357219+0000","last_unstale":"2024-09-12T01:12:00.237791+0000","last_undegraded":"2024-09-12T01:12:00.237791+0000","last_fullsized":"2024-09-12T01:12:00.237791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:44.097143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":69,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.402289+0000","last_change":"2024-09-12T00:39:26.643775+0000","last_active":"2024-09-12T01:13:18.402289+0000","last_peered":"2024-09-12T01:13:18.402289+0000","last_clean":"2024-09-12T01:13:18.402289+0000","last_became_active":"2024-09-12T00:39:26.643469+0000","last_became_peered":"2024-09-12T00:39:26.643469+0000","last_unstale":"2024-09-12T01:13:18.402289+0000","last_undegraded":"2024-09-12T01:13:18.402289+0000","last_fullsized":"2024-09-12T01:13:18.402289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:16.398681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390670+0000","last_change":"2024-09-12T00:22:02.422788+0000","last_active":"2024-09-12T01:11:53.390670+0000","last_peered":"2024-09-12T01:11:53.390670+0000","last_clean":"2024-09-12T01:11:53.390670+0000","last_became_active":"2024-09-12T00:22:02.422532+0000","last_became_peered":"2024-09-12T00:22:02.422532+0000","last_unstale":"2024-09-12T01:11:53.390670+0000","last_undegraded":"2024-09-12T01:11:53.390670+0000","last_fullsized":"2024-09-12T01:11:53.390670+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.940961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.242873+0000","last_change":"2024-09-12T00:21:58.333014+0000","last_active":"2024-09-12T01:13:58.242873+0000","last_peered":"2024-09-12T01:13:58.242873+0000","last_clean":"2024-09-12T01:13:58.242873+0000","last_became_active":"2024-09-12T00:21:58.332715+0000","last_became_peered":"2024-09-12T00:21:58.332715+0000","last_unstale":"2024-09-12T01:13:58.242873+0000","last_undegraded":"2024-09-12T01:13:58.242873+0000","last_fullsized":"2024-09-12T01:13:58.242873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.043720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'12","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394261+0000","last_change":"2024-09-12T00:17:58.348284+0000","last_active":"2024-09-12T01:12:18.394261+0000","last_peered":"2024-09-12T01:12:18.394261+0000","last_clean":"2024-09-12T01:12:18.394261+0000","last_became_active":"2024-09-12T00:17:58.347709+0000","last_became_peered":"2024-09-12T00:17:58.347709+0000","last_unstale":"2024-09-12T01:12:18.394261+0000","last_undegraded":"2024-09-12T01:12:18.394261+0000","last_fullsized":"2024-09-12T01:12:18.394261+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:50.010174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401624+0000","last_change":"2024-09-12T00:39:26.639353+0000","last_active":"2024-09-12T01:13:13.401624+0000","last_peered":"2024-09-12T01:13:13.401624+0000","last_clean":"2024-09-12T01:13:13.401624+0000","last_became_active":"2024-09-12T00:39:26.639094+0000","last_became_peered":"2024-09-12T00:39:26.639094+0000","last_unstale":"2024-09-12T01:13:13.401624+0000","last_undegraded":"2024-09-12T01:13:13.401624+0000","last_fullsized":"2024-09-12T01:13:13.401624+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.226749+0000","last_change":"2024-09-12T00:22:02.423237+0000","last_active":"2024-09-12T01:11:33.226749+0000","last_peered":"2024-09-12T01:11:33.226749+0000","last_clean":"2024-09-12T01:11:33.226749+0000","last_became_active":"2024-09-12T00:22:02.422922+0000","last_became_peered":"2024-09-12T00:22:02.422922+0000","last_unstale":"2024-09-12T01:11:33.226749+0000","last_undegraded":"2024-09-12T01:11:33.226749+0000","last_fullsized":"2024-09-12T01:11:33.226749+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:06.357213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238314+0000","last_change":"2024-09-12T00:21:58.341237+0000","last_active":"2024-09-12T01:12:05.238314+0000","last_peered":"2024-09-12T01:12:05.238314+0000","last_clean":"2024-09-12T01:12:05.238314+0000","last_became_active":"2024-09-12T00:21:58.340910+0000","last_became_peered":"2024-09-12T00:21:58.340910+0000","last_unstale":"2024-09-12T01:12:05.238314+0000","last_undegraded":"2024-09-12T01:12:05.238314+0000","last_fullsized":"2024-09-12T01:12:05.238314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:12.245684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'59","reported_seq":219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449466+0000","last_change":"2024-09-12T00:17:58.351895+0000","last_active":"2024-09-12T01:12:08.449466+0000","last_peered":"2024-09-12T01:12:08.449466+0000","last_clean":"2024-09-12T01:12:08.449466+0000","last_became_active":"2024-09-12T00:17:58.351362+0000","last_became_peered":"2024-09-12T00:17:58.351362+0000","last_unstale":"2024-09-12T01:12:08.449466+0000","last_undegraded":"2024-09-12T01:12:08.449466+0000","last_fullsized":"2024-09-12T01:12:08.449466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.054114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":214,"num_write":104,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:15.246472+0000","last_change":"2024-09-12T00:39:26.631761+0000","last_active":"2024-09-12T01:13:15.246472+0000","last_peered":"2024-09-12T01:13:15.246472+0000","last_clean":"2024-09-12T01:13:15.246472+0000","last_became_active":"2024-09-12T00:39:26.631491+0000","last_became_peered":"2024-09-12T00:39:26.631491+0000","last_unstale":"2024-09-12T01:13:15.246472+0000","last_undegraded":"2024-09-12T01:13:15.246472+0000","last_fullsized":"2024-09-12T01:13:15.246472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:37.091629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'3","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.410353+0000","last_change":"2024-09-12T00:22:02.430547+0000","last_active":"2024-09-12T01:14:13.410353+0000","last_peered":"2024-09-12T01:14:13.410353+0000","last_clean":"2024-09-12T01:14:13.410353+0000","last_became_active":"2024-09-12T00:22:02.430209+0000","last_became_peered":"2024-09-12T00:22:02.430209+0000","last_unstale":"2024-09-12T01:14:13.410353+0000","last_undegraded":"2024-09-12T01:14:13.410353+0000","last_fullsized":"2024-09-12T01:14:13.410353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:01.694638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.385332+0000","last_change":"2024-09-12T00:21:58.339483+0000","last_active":"2024-09-12T01:11:28.385332+0000","last_peered":"2024-09-12T01:11:28.385332+0000","last_clean":"2024-09-12T01:11:28.385332+0000","last_became_active":"2024-09-12T00:21:58.339248+0000","last_became_peered":"2024-09-12T00:21:58.339248+0000","last_unstale":"2024-09-12T01:11:28.385332+0000","last_undegraded":"2024-09-12T01:11:28.385332+0000","last_fullsized":"2024-09-12T01:11:28.385332+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:13.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'36","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609071+0000","last_change":"2024-09-12T00:17:58.358376+0000","last_active":"2024-09-12T01:12:08.609071+0000","last_peered":"2024-09-12T01:12:08.609071+0000","last_clean":"2024-09-12T01:12:08.609071+0000","last_became_active":"2024-09-12T00:17:58.358022+0000","last_became_peered":"2024-09-12T00:17:58.358022+0000","last_unstale":"2024-09-12T01:12:08.609071+0000","last_undegraded":"2024-09-12T01:12:08.609071+0000","last_fullsized":"2024-09-12T01:12:08.609071+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:18.456203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":54,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398216+0000","last_change":"2024-09-12T00:39:26.645252+0000","last_active":"2024-09-12T01:12:48.398216+0000","last_peered":"2024-09-12T01:12:48.398216+0000","last_clean":"2024-09-12T01:12:48.398216+0000","last_became_active":"2024-09-12T00:39:26.644935+0000","last_became_peered":"2024-09-12T00:39:26.644935+0000","last_unstale":"2024-09-12T01:12:48.398216+0000","last_undegraded":"2024-09-12T01:12:48.398216+0000","last_fullsized":"2024-09-12T01:12:48.398216+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:56.007971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240045+0000","last_change":"2024-09-12T00:22:02.424691+0000","last_active":"2024-09-12T01:12:20.240045+0000","last_peered":"2024-09-12T01:12:20.240045+0000","last_clean":"2024-09-12T01:12:20.240045+0000","last_became_active":"2024-09-12T00:22:02.424116+0000","last_became_peered":"2024-09-12T00:22:02.424116+0000","last_unstale":"2024-09-12T01:12:20.240045+0000","last_undegraded":"2024-09-12T01:12:20.240045+0000","last_fullsized":"2024-09-12T01:12:20.240045+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.947612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'6","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408732+0000","last_change":"2024-09-12T00:21:58.332119+0000","last_active":"2024-09-12T01:14:03.408732+0000","last_peered":"2024-09-12T01:14:03.408732+0000","last_clean":"2024-09-12T01:14:03.408732+0000","last_became_active":"2024-09-12T00:21:58.331839+0000","last_became_peered":"2024-09-12T00:21:58.331839+0000","last_unstale":"2024-09-12T01:14:03.408732+0000","last_undegraded":"2024-09-12T01:14:03.408732+0000","last_fullsized":"2024-09-12T01:14:03.408732+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:22.439701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238960+0000","last_change":"2024-09-12T00:17:58.354881+0000","last_active":"2024-09-12T01:12:10.238960+0000","last_peered":"2024-09-12T01:12:10.238960+0000","last_clean":"2024-09-12T01:12:10.238960+0000","last_became_active":"2024-09-12T00:17:58.354568+0000","last_became_peered":"2024-09-12T00:17:58.354568+0000","last_unstale":"2024-09-12T01:12:10.238960+0000","last_undegraded":"2024-09-12T01:12:10.238960+0000","last_fullsized":"2024-09-12T01:12:10.238960+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:54.500434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.509385+0000","last_change":"2024-09-12T00:39:26.640912+0000","last_active":"2024-09-12T01:12:48.509385+0000","last_peered":"2024-09-12T01:12:48.509385+0000","last_clean":"2024-09-12T01:12:48.509385+0000","last_became_active":"2024-09-12T00:39:26.635679+0000","last_became_peered":"2024-09-12T00:39:26.635679+0000","last_unstale":"2024-09-12T01:12:48.509385+0000","last_undegraded":"2024-09-12T01:12:48.509385+0000","last_fullsized":"2024-09-12T01:12:48.509385+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:19.017813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'11","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238367+0000","last_change":"2024-09-12T00:22:02.420520+0000","last_active":"2024-09-12T01:12:05.238367+0000","last_peered":"2024-09-12T01:12:05.238367+0000","last_clean":"2024-09-12T01:12:05.238367+0000","last_became_active":"2024-09-12T00:22:02.420246+0000","last_became_peered":"2024-09-12T00:22:02.420246+0000","last_unstale":"2024-09-12T01:12:05.238367+0000","last_undegraded":"2024-09-12T01:12:05.238367+0000","last_fullsized":"2024-09-12T01:12:05.238367+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:31.472875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":23552,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.236313+0000","last_change":"2024-09-12T00:21:58.332641+0000","last_active":"2024-09-12T01:14:13.236313+0000","last_peered":"2024-09-12T01:14:13.236313+0000","last_clean":"2024-09-12T01:14:13.236313+0000","last_became_active":"2024-09-12T00:21:58.332362+0000","last_became_peered":"2024-09-12T00:21:58.332362+0000","last_unstale":"2024-09-12T01:14:13.236313+0000","last_undegraded":"2024-09-12T01:14:13.236313+0000","last_fullsized":"2024-09-12T01:14:13.236313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:38.121091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'54","reported_seq":199,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609180+0000","last_change":"2024-09-12T00:17:58.356444+0000","last_active":"2024-09-12T01:12:08.609180+0000","last_peered":"2024-09-12T01:12:08.609180+0000","last_clean":"2024-09-12T01:12:08.609180+0000","last_became_active":"2024-09-12T00:17:58.356120+0000","last_became_peered":"2024-09-12T00:17:58.356120+0000","last_unstale":"2024-09-12T01:12:08.609180+0000","last_undegraded":"2024-09-12T01:12:08.609180+0000","last_fullsized":"2024-09-12T01:12:08.609180+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:56.553542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":175,"num_write":100,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.240729+0000","last_change":"2024-09-12T00:39:26.625293+0000","last_active":"2024-09-12T01:13:38.240729+0000","last_peered":"2024-09-12T01:13:38.240729+0000","last_clean":"2024-09-12T01:13:38.240729+0000","last_became_active":"2024-09-12T00:39:26.624994+0000","last_became_peered":"2024-09-12T00:39:26.624994+0000","last_unstale":"2024-09-12T01:13:38.240729+0000","last_undegraded":"2024-09-12T01:13:38.240729+0000","last_fullsized":"2024-09-12T01:13:38.240729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:56.114504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390791+0000","last_change":"2024-09-12T00:22:02.424780+0000","last_active":"2024-09-12T01:11:53.390791+0000","last_peered":"2024-09-12T01:11:53.390791+0000","last_clean":"2024-09-12T01:11:53.390791+0000","last_became_active":"2024-09-12T00:22:02.424412+0000","last_became_peered":"2024-09-12T00:22:02.424412+0000","last_unstale":"2024-09-12T01:11:53.390791+0000","last_undegraded":"2024-09-12T01:11:53.390791+0000","last_fullsized":"2024-09-12T01:11:53.390791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.074060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.500730+0000","last_change":"2024-09-12T00:21:58.334861+0000","last_active":"2024-09-12T01:11:48.500730+0000","last_peered":"2024-09-12T01:11:48.500730+0000","last_clean":"2024-09-12T01:11:48.500730+0000","last_became_active":"2024-09-12T00:21:58.334536+0000","last_became_peered":"2024-09-12T00:21:58.334536+0000","last_unstale":"2024-09-12T01:11:48.500730+0000","last_undegraded":"2024-09-12T01:11:48.500730+0000","last_fullsized":"2024-09-12T01:11:48.500730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:39.419871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394307+0000","last_change":"2024-09-12T00:17:58.353484+0000","last_active":"2024-09-12T01:12:18.394307+0000","last_peered":"2024-09-12T01:12:18.394307+0000","last_clean":"2024-09-12T01:12:18.394307+0000","last_became_active":"2024-09-12T00:17:58.353219+0000","last_became_peered":"2024-09-12T00:17:58.353219+0000","last_unstale":"2024-09-12T01:12:18.394307+0000","last_undegraded":"2024-09-12T01:12:18.394307+0000","last_fullsized":"2024-09-12T01:12:18.394307+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:54.015109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":151,"num_write":85,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396509+0000","last_change":"2024-09-12T00:39:26.638305+0000","last_active":"2024-09-12T01:12:48.396509+0000","last_peered":"2024-09-12T01:12:48.396509+0000","last_clean":"2024-09-12T01:12:48.396509+0000","last_became_active":"2024-09-12T00:39:26.638008+0000","last_became_peered":"2024-09-12T00:39:26.638008+0000","last_unstale":"2024-09-12T01:12:48.396509+0000","last_undegraded":"2024-09-12T01:12:48.396509+0000","last_fullsized":"2024-09-12T01:12:48.396509+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:10.696670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'3","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.260835+0000","last_change":"2024-09-12T00:22:02.419773+0000","last_active":"2024-09-12T01:14:03.260835+0000","last_peered":"2024-09-12T01:14:03.260835+0000","last_clean":"2024-09-12T01:14:03.260835+0000","last_became_active":"2024-09-12T00:22:02.419443+0000","last_became_peered":"2024-09-12T00:22:02.419443+0000","last_unstale":"2024-09-12T01:14:03.260835+0000","last_undegraded":"2024-09-12T01:14:03.260835+0000","last_fullsized":"2024-09-12T01:14:03.260835+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:01.383190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390111+0000","last_change":"2024-09-12T00:21:58.335735+0000","last_active":"2024-09-12T01:11:48.390111+0000","last_peered":"2024-09-12T01:11:48.390111+0000","last_clean":"2024-09-12T01:11:48.390111+0000","last_became_active":"2024-09-12T00:21:58.335360+0000","last_became_peered":"2024-09-12T00:21:58.335360+0000","last_unstale":"2024-09-12T01:11:48.390111+0000","last_undegraded":"2024-09-12T01:11:48.390111+0000","last_fullsized":"2024-09-12T01:11:48.390111+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:46.236982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'110","reported_seq":429,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230801+0000","last_change":"2024-09-12T00:17:58.356038+0000","last_active":"2024-09-12T01:12:08.230801+0000","last_peered":"2024-09-12T01:12:08.230801+0000","last_clean":"2024-09-12T01:12:08.230801+0000","last_became_active":"2024-09-12T00:17:58.355688+0000","last_became_peered":"2024-09-12T00:17:58.355688+0000","last_unstale":"2024-09-12T01:12:08.230801+0000","last_undegraded":"2024-09-12T01:12:08.230801+0000","last_fullsized":"2024-09-12T01:12:08.230801+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:17.662520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":717,"num_read_kb":507,"num_write":143,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221804+0000","last_change":"2024-09-12T00:39:26.637811+0000","last_active":"2024-09-12T01:11:58.221804+0000","last_peered":"2024-09-12T01:11:58.221804+0000","last_clean":"2024-09-12T01:11:58.221804+0000","last_became_active":"2024-09-12T00:39:26.637393+0000","last_became_peered":"2024-09-12T00:39:26.637393+0000","last_unstale":"2024-09-12T01:11:58.221804+0000","last_undegraded":"2024-09-12T01:11:58.221804+0000","last_fullsized":"2024-09-12T01:11:58.221804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:54.616369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.230233+0000","last_change":"2024-09-12T00:22:02.423927+0000","last_active":"2024-09-12T01:12:03.230233+0000","last_peered":"2024-09-12T01:12:03.230233+0000","last_clean":"2024-09-12T01:12:03.230233+0000","last_became_active":"2024-09-12T00:22:02.423601+0000","last_became_peered":"2024-09-12T00:22:02.423601+0000","last_unstale":"2024-09-12T01:12:03.230233+0000","last_undegraded":"2024-09-12T01:12:03.230233+0000","last_fullsized":"2024-09-12T01:12:03.230233+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:37.317770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392781+0000","last_change":"2024-09-12T00:21:58.339918+0000","last_active":"2024-09-12T01:12:08.392781+0000","last_peered":"2024-09-12T01:12:08.392781+0000","last_clean":"2024-09-12T01:12:08.392781+0000","last_became_active":"2024-09-12T00:21:58.339625+0000","last_became_peered":"2024-09-12T00:21:58.339625+0000","last_unstale":"2024-09-12T01:12:08.392781+0000","last_undegraded":"2024-09-12T01:12:08.392781+0000","last_fullsized":"2024-09-12T01:12:08.392781+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:55.567062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503535+0000","last_change":"2024-09-12T00:17:58.357264+0000","last_active":"2024-09-12T01:12:08.503535+0000","last_peered":"2024-09-12T01:12:08.503535+0000","last_clean":"2024-09-12T01:12:08.503535+0000","last_became_active":"2024-09-12T00:17:58.356906+0000","last_became_peered":"2024-09-12T00:17:58.356906+0000","last_unstale":"2024-09-12T01:12:08.503535+0000","last_undegraded":"2024-09-12T01:12:08.503535+0000","last_fullsized":"2024-09-12T01:12:08.503535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:35.900823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":164,"num_write":72,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237860+0000","last_change":"2024-09-12T00:39:26.628713+0000","last_active":"2024-09-12T01:12:00.237860+0000","last_peered":"2024-09-12T01:12:00.237860+0000","last_clean":"2024-09-12T01:12:00.237860+0000","last_became_active":"2024-09-12T00:39:26.628244+0000","last_became_peered":"2024-09-12T00:39:26.628244+0000","last_unstale":"2024-09-12T01:12:00.237860+0000","last_undegraded":"2024-09-12T01:12:00.237860+0000","last_fullsized":"2024-09-12T01:12:00.237860+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:04.390305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.521387+0000","last_change":"2024-09-12T00:22:02.417514+0000","last_active":"2024-09-12T01:14:08.521387+0000","last_peered":"2024-09-12T01:14:08.521387+0000","last_clean":"2024-09-12T01:14:08.521387+0000","last_became_active":"2024-09-12T00:22:02.417237+0000","last_became_peered":"2024-09-12T00:22:02.417237+0000","last_unstale":"2024-09-12T01:14:08.521387+0000","last_undegraded":"2024-09-12T01:14:08.521387+0000","last_fullsized":"2024-09-12T01:14:08.521387+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.844465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408682+0000","last_change":"2024-09-12T00:21:58.335825+0000","last_active":"2024-09-12T01:14:03.408682+0000","last_peered":"2024-09-12T01:14:03.408682+0000","last_clean":"2024-09-12T01:14:03.408682+0000","last_became_active":"2024-09-12T00:21:58.335541+0000","last_became_peered":"2024-09-12T00:21:58.335541+0000","last_unstale":"2024-09-12T01:14:03.408682+0000","last_undegraded":"2024-09-12T01:14:03.408682+0000","last_fullsized":"2024-09-12T01:14:03.408682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:13.185076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.391247+0000","last_change":"2024-09-12T00:17:58.349817+0000","last_active":"2024-09-12T01:12:08.391247+0000","last_peered":"2024-09-12T01:12:08.391247+0000","last_clean":"2024-09-12T01:12:08.391247+0000","last_became_active":"2024-09-12T00:17:58.349428+0000","last_became_peered":"2024-09-12T00:17:58.349428+0000","last_unstale":"2024-09-12T01:12:08.391247+0000","last_undegraded":"2024-09-12T01:12:08.391247+0000","last_fullsized":"2024-09-12T01:12:08.391247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:25.884859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":78,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243328+0000","last_change":"2024-09-12T00:39:26.641703+0000","last_active":"2024-09-12T01:12:50.243328+0000","last_peered":"2024-09-12T01:12:50.243328+0000","last_clean":"2024-09-12T01:12:50.243328+0000","last_became_active":"2024-09-12T00:39:26.641360+0000","last_became_peered":"2024-09-12T00:39:26.641360+0000","last_unstale":"2024-09-12T01:12:50.243328+0000","last_undegraded":"2024-09-12T01:12:50.243328+0000","last_fullsized":"2024-09-12T01:12:50.243328+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.843665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608437+0000","last_change":"2024-09-12T00:22:02.430353+0000","last_active":"2024-09-12T01:12:03.608437+0000","last_peered":"2024-09-12T01:12:03.608437+0000","last_clean":"2024-09-12T01:12:03.608437+0000","last_became_active":"2024-09-12T00:22:02.430041+0000","last_became_peered":"2024-09-12T00:22:02.430041+0000","last_unstale":"2024-09-12T01:12:03.608437+0000","last_undegraded":"2024-09-12T01:12:03.608437+0000","last_fullsized":"2024-09-12T01:12:03.608437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:01.886573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.243388+0000","last_change":"2024-09-12T00:21:58.327372+0000","last_active":"2024-09-12T01:14:03.243388+0000","last_peered":"2024-09-12T01:14:03.243388+0000","last_clean":"2024-09-12T01:14:03.243388+0000","last_became_active":"2024-09-12T00:21:58.327094+0000","last_became_peered":"2024-09-12T00:21:58.327094+0000","last_unstale":"2024-09-12T01:14:03.243388+0000","last_undegraded":"2024-09-12T01:14:03.243388+0000","last_fullsized":"2024-09-12T01:14:03.243388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.131588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'15","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609100+0000","last_change":"2024-09-12T00:17:58.355203+0000","last_active":"2024-09-12T01:12:08.609100+0000","last_peered":"2024-09-12T01:12:08.609100+0000","last_clean":"2024-09-12T01:12:08.609100+0000","last_became_active":"2024-09-12T00:17:58.354797+0000","last_became_peered":"2024-09-12T00:17:58.354797+0000","last_unstale":"2024-09-12T01:12:08.609100+0000","last_undegraded":"2024-09-12T01:12:08.609100+0000","last_fullsized":"2024-09-12T01:12:08.609100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.618609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399062+0000","last_change":"2024-09-12T00:39:26.641320+0000","last_active":"2024-09-12T01:12:53.399062+0000","last_peered":"2024-09-12T01:12:53.399062+0000","last_clean":"2024-09-12T01:12:53.399062+0000","last_became_active":"2024-09-12T00:39:26.640877+0000","last_became_peered":"2024-09-12T00:39:26.640877+0000","last_unstale":"2024-09-12T01:12:53.399062+0000","last_undegraded":"2024-09-12T01:12:53.399062+0000","last_fullsized":"2024-09-12T01:12:53.399062+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:44.522883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.261478+0000","last_change":"2024-09-12T00:22:02.418887+0000","last_active":"2024-09-12T01:14:08.261478+0000","last_peered":"2024-09-12T01:14:08.261478+0000","last_clean":"2024-09-12T01:14:08.261478+0000","last_became_active":"2024-09-12T00:22:02.418588+0000","last_became_peered":"2024-09-12T00:22:02.418588+0000","last_unstale":"2024-09-12T01:14:08.261478+0000","last_undegraded":"2024-09-12T01:14:08.261478+0000","last_fullsized":"2024-09-12T01:14:08.261478+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:23.078029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'7","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.625107+0000","last_change":"2024-09-12T00:21:58.332292+0000","last_active":"2024-09-12T01:14:03.625107+0000","last_peered":"2024-09-12T01:14:03.625107+0000","last_clean":"2024-09-12T01:14:03.625107+0000","last_became_active":"2024-09-12T00:21:58.331972+0000","last_became_peered":"2024-09-12T00:21:58.331972+0000","last_unstale":"2024-09-12T01:14:03.625107+0000","last_undegraded":"2024-09-12T01:14:03.625107+0000","last_fullsized":"2024-09-12T01:14:03.625107+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:41.270684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'16","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392791+0000","last_change":"2024-09-12T00:17:58.358230+0000","last_active":"2024-09-12T01:12:08.392791+0000","last_peered":"2024-09-12T01:12:08.392791+0000","last_clean":"2024-09-12T01:12:08.392791+0000","last_became_active":"2024-09-12T00:17:58.357689+0000","last_became_peered":"2024-09-12T00:17:58.357689+0000","last_unstale":"2024-09-12T01:12:08.392791+0000","last_undegraded":"2024-09-12T01:12:08.392791+0000","last_fullsized":"2024-09-12T01:12:08.392791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.417538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'204","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041492+0000","last_change":"2024-09-12T00:02:48.051469+0000","last_active":"2024-09-12T01:15:48.041492+0000","last_peered":"2024-09-12T01:15:48.041492+0000","last_clean":"2024-09-12T01:15:48.041492+0000","last_became_active":"2024-09-12T00:02:48.051117+0000","last_became_peered":"2024-09-12T00:02:48.051117+0000","last_unstale":"2024-09-12T01:15:48.041492+0000","last_undegraded":"2024-09-12T01:15:48.041492+0000","last_fullsized":"2024-09-12T01:15:48.041492+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:31.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342064,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":17555,"num_write":999,"num_write_kb":27178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'739","reported_seq":2130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061089+0000","last_change":"2024-09-12T00:02:50.065523+0000","last_active":"2024-09-12T01:13:06.061089+0000","last_peered":"2024-09-12T01:13:06.061089+0000","last_clean":"2024-09-12T01:13:06.061089+0000","last_became_active":"2024-09-12T00:02:50.065257+0000","last_became_peered":"2024-09-12T00:02:50.065257+0000","last_unstale":"2024-09-12T01:13:06.061089+0000","last_undegraded":"2024-09-12T01:13:06.061089+0000","last_fullsized":"2024-09-12T01:13:06.061089+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:22.262738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3376,"num_read_kb":3036,"num_write":968,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'285","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.186886+0000","last_change":"2024-09-12T00:02:48.049346+0000","last_active":"2024-09-12T01:15:48.186886+0000","last_peered":"2024-09-12T01:15:48.186886+0000","last_clean":"2024-09-12T01:15:48.186886+0000","last_became_active":"2024-09-12T00:02:48.049002+0000","last_became_peered":"2024-09-12T00:02:48.049002+0000","last_unstale":"2024-09-12T01:15:48.186886+0000","last_undegraded":"2024-09-12T01:15:48.186886+0000","last_fullsized":"2024-09-12T01:15:48.186886+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:20.073613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":975,"num_read_kb":18236,"num_write":1256,"num_write_kb":26545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'691","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398967+0000","last_change":"2024-09-12T00:02:50.063909+0000","last_active":"2024-09-12T01:12:53.398967+0000","last_peered":"2024-09-12T01:12:53.398967+0000","last_clean":"2024-09-12T01:12:53.398967+0000","last_became_active":"2024-09-12T00:02:50.063612+0000","last_became_peered":"2024-09-12T00:02:50.063612+0000","last_unstale":"2024-09-12T01:12:53.398967+0000","last_undegraded":"2024-09-12T01:12:53.398967+0000","last_fullsized":"2024-09-12T01:12:53.398967+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":600,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:00.810818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3358,"num_read_kb":3023,"num_write":921,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'218","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249550+0000","last_change":"2024-09-12T00:02:48.047754+0000","last_active":"2024-09-12T01:13:40.249550+0000","last_peered":"2024-09-12T01:13:40.249550+0000","last_clean":"2024-09-12T01:13:40.249550+0000","last_became_active":"2024-09-12T00:02:48.045960+0000","last_became_peered":"2024-09-12T00:02:48.045960+0000","last_unstale":"2024-09-12T01:13:40.249550+0000","last_undegraded":"2024-09-12T01:13:40.249550+0000","last_fullsized":"2024-09-12T01:13:40.249550+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:15.082870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119487,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":21329,"num_write":1071,"num_write_kb":32132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'460","reported_seq":2020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127768+0000","last_change":"2024-09-12T00:02:50.062684+0000","last_active":"2024-09-12T01:14:04.127768+0000","last_peered":"2024-09-12T01:14:04.127768+0000","last_clean":"2024-09-12T01:14:04.127768+0000","last_became_active":"2024-09-12T00:02:50.060902+0000","last_became_peered":"2024-09-12T00:02:50.060902+0000","last_unstale":"2024-09-12T01:14:04.127768+0000","last_undegraded":"2024-09-12T01:14:04.127768+0000","last_fullsized":"2024-09-12T01:14:04.127768+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:33.890960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2604,"num_read_kb":2455,"num_write":536,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'260","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.067359+0000","last_change":"2024-09-12T00:02:48.054237+0000","last_active":"2024-09-12T01:15:48.067359+0000","last_peered":"2024-09-12T01:15:48.067359+0000","last_clean":"2024-09-12T01:15:48.067359+0000","last_became_active":"2024-09-12T00:02:48.052802+0000","last_became_peered":"2024-09-12T00:02:48.052802+0000","last_unstale":"2024-09-12T01:15:48.067359+0000","last_undegraded":"2024-09-12T01:15:48.067359+0000","last_fullsized":"2024-09-12T01:15:48.067359+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:33.528197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":8609,"num_write":1124,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'1277","reported_seq":2864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863786+0000","last_change":"2024-09-12T00:02:50.072880+0000","last_active":"2024-09-12T01:13:20.863786+0000","last_peered":"2024-09-12T01:13:20.863786+0000","last_clean":"2024-09-12T01:13:20.863786+0000","last_became_active":"2024-09-12T00:02:50.072574+0000","last_became_peered":"2024-09-12T00:02:50.072574+0000","last_unstale":"2024-09-12T01:13:20.863786+0000","last_undegraded":"2024-09-12T01:13:20.863786+0000","last_fullsized":"2024-09-12T01:13:20.863786+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:18.343144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5797,"num_read_kb":5069,"num_write":1818,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'162","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:18.419930+0000","last_change":"2024-09-12T00:02:48.053474+0000","last_active":"2024-09-12T01:15:18.419930+0000","last_peered":"2024-09-12T01:15:18.419930+0000","last_clean":"2024-09-12T01:15:18.419930+0000","last_became_active":"2024-09-12T00:02:48.052778+0000","last_became_peered":"2024-09-12T00:02:48.052778+0000","last_unstale":"2024-09-12T01:15:18.419930+0000","last_undegraded":"2024-09-12T01:15:18.419930+0000","last_fullsized":"2024-09-12T01:15:18.419930+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:00.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":373,"num_read_kb":36558,"num_write":790,"num_write_kb":25424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'761","reported_seq":2171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.862249+0000","last_change":"2024-09-12T00:02:50.062543+0000","last_active":"2024-09-12T01:13:20.862249+0000","last_peered":"2024-09-12T01:13:20.862249+0000","last_clean":"2024-09-12T01:13:20.862249+0000","last_became_active":"2024-09-12T00:02:50.062257+0000","last_became_peered":"2024-09-12T00:02:50.062257+0000","last_unstale":"2024-09-12T01:13:20.862249+0000","last_undegraded":"2024-09-12T01:13:20.862249+0000","last_fullsized":"2024-09-12T01:13:20.862249+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:20.110214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3047,"num_write":970,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'225","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.259407+0000","last_change":"2024-09-12T00:02:48.056467+0000","last_active":"2024-09-12T01:15:48.259407+0000","last_peered":"2024-09-12T01:15:48.259407+0000","last_clean":"2024-09-12T01:15:48.259407+0000","last_became_active":"2024-09-12T00:02:48.052257+0000","last_became_peered":"2024-09-12T00:02:48.052257+0000","last_unstale":"2024-09-12T01:15:48.259407+0000","last_undegraded":"2024-09-12T01:15:48.259407+0000","last_fullsized":"2024-09-12T01:15:48.259407+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:42.352728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798278,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":39161,"num_write":992,"num_write_kb":40171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'407","reported_seq":1873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748758+0000","last_change":"2024-09-12T00:02:50.061476+0000","last_active":"2024-09-12T01:15:09.748758+0000","last_peered":"2024-09-12T01:15:09.748758+0000","last_clean":"2024-09-12T01:15:09.748758+0000","last_became_active":"2024-09-12T00:02:50.060756+0000","last_became_peered":"2024-09-12T00:02:50.060756+0000","last_unstale":"2024-09-12T01:15:09.748758+0000","last_undegraded":"2024-09-12T01:15:09.748758+0000","last_fullsized":"2024-09-12T01:15:09.748758+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:07.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2108,"num_read_kb":1993,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'193","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.213028+0000","last_change":"2024-09-12T00:03:21.144282+0000","last_active":"2024-09-12T01:15:48.213028+0000","last_peered":"2024-09-12T01:15:48.213028+0000","last_clean":"2024-09-12T01:15:48.213028+0000","last_became_active":"2024-09-12T00:03:21.143840+0000","last_became_peered":"2024-09-12T00:03:21.143840+0000","last_unstale":"2024-09-12T01:15:48.213028+0000","last_undegraded":"2024-09-12T01:15:48.213028+0000","last_fullsized":"2024-09-12T01:15:48.213028+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:25.883175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":20506,"num_write":998,"num_write_kb":32663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'432","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.517921+0000","last_change":"2024-09-12T00:02:50.065057+0000","last_active":"2024-09-12T01:13:43.517921+0000","last_peered":"2024-09-12T01:13:43.517921+0000","last_clean":"2024-09-12T01:13:43.517921+0000","last_became_active":"2024-09-12T00:02:50.064658+0000","last_became_peered":"2024-09-12T00:02:50.064658+0000","last_unstale":"2024-09-12T01:13:43.517921+0000","last_undegraded":"2024-09-12T01:13:43.517921+0000","last_fullsized":"2024-09-12T01:13:43.517921+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:42.210482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":488,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'181","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.071132+0000","last_change":"2024-09-12T00:02:48.059025+0000","last_active":"2024-09-12T01:15:48.071132+0000","last_peered":"2024-09-12T01:15:48.071132+0000","last_clean":"2024-09-12T01:15:48.071132+0000","last_became_active":"2024-09-12T00:02:48.058678+0000","last_became_peered":"2024-09-12T00:02:48.058678+0000","last_unstale":"2024-09-12T01:15:48.071132+0000","last_undegraded":"2024-09-12T01:15:48.071132+0000","last_fullsized":"2024-09-12T01:15:48.071132+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:51.470037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170390,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1879,"num_write":959,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'888","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.957023+0000","last_change":"2024-09-12T00:02:50.070198+0000","last_active":"2024-09-12T01:14:02.957023+0000","last_peered":"2024-09-12T01:14:02.957023+0000","last_clean":"2024-09-12T01:14:02.957023+0000","last_became_active":"2024-09-12T00:02:50.069840+0000","last_became_peered":"2024-09-12T00:02:50.069840+0000","last_unstale":"2024-09-12T01:14:02.957023+0000","last_undegraded":"2024-09-12T01:14:02.957023+0000","last_fullsized":"2024-09-12T01:14:02.957023+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.926054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4122,"num_read_kb":3699,"num_write":1233,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'596","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863098+0000","last_change":"2024-09-12T00:02:50.061218+0000","last_active":"2024-09-12T01:13:20.863098+0000","last_peered":"2024-09-12T01:13:20.863098+0000","last_clean":"2024-09-12T01:13:20.863098+0000","last_became_active":"2024-09-12T00:02:50.060919+0000","last_became_peered":"2024-09-12T00:02:50.060919+0000","last_unstale":"2024-09-12T01:13:20.863098+0000","last_undegraded":"2024-09-12T01:13:20.863098+0000","last_fullsized":"2024-09-12T01:13:20.863098+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:06.460607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3046,"num_read_kb":2788,"num_write":785,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'202","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.243046+0000","last_change":"2024-09-12T00:02:48.051390+0000","last_active":"2024-09-12T01:15:48.243046+0000","last_peered":"2024-09-12T01:15:48.243046+0000","last_clean":"2024-09-12T01:15:48.243046+0000","last_became_active":"2024-09-12T00:02:48.050909+0000","last_became_peered":"2024-09-12T00:02:48.050909+0000","last_unstale":"2024-09-12T01:15:48.243046+0000","last_undegraded":"2024-09-12T01:15:48.243046+0000","last_fullsized":"2024-09-12T01:15:48.243046+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:04.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":10751,"num_write":911,"num_write_kb":36355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'825","reported_seq":2313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863421+0000","last_change":"2024-09-12T00:02:50.073111+0000","last_active":"2024-09-12T01:13:20.863421+0000","last_peered":"2024-09-12T01:13:20.863421+0000","last_clean":"2024-09-12T01:13:20.863421+0000","last_became_active":"2024-09-12T00:02:50.072791+0000","last_became_peered":"2024-09-12T00:02:50.072791+0000","last_unstale":"2024-09-12T01:13:20.863421+0000","last_undegraded":"2024-09-12T01:13:20.863421+0000","last_fullsized":"2024-09-12T01:13:20.863421+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:30.271643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3382,"num_write":1095,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'201","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.222482+0000","last_change":"2024-09-12T00:02:48.053788+0000","last_active":"2024-09-12T01:15:48.222482+0000","last_peered":"2024-09-12T01:15:48.222482+0000","last_clean":"2024-09-12T01:15:48.222482+0000","last_became_active":"2024-09-12T00:02:48.053452+0000","last_became_peered":"2024-09-12T00:02:48.053452+0000","last_unstale":"2024-09-12T01:15:48.222482+0000","last_undegraded":"2024-09-12T01:15:48.222482+0000","last_fullsized":"2024-09-12T01:15:48.222482+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:23.267737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684145,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":6281,"num_write":1001,"num_write_kb":31607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'856","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956760+0000","last_change":"2024-09-12T00:02:50.072524+0000","last_active":"2024-09-12T01:14:02.956760+0000","last_peered":"2024-09-12T01:14:02.956760+0000","last_clean":"2024-09-12T01:14:02.956760+0000","last_became_active":"2024-09-12T00:02:50.072128+0000","last_became_peered":"2024-09-12T00:02:50.072128+0000","last_unstale":"2024-09-12T01:14:02.956760+0000","last_undegraded":"2024-09-12T01:14:02.956760+0000","last_fullsized":"2024-09-12T01:14:02.956760+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:10.120502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4255,"num_read_kb":3837,"num_write":1128,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'188","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.164834+0000","last_change":"2024-09-12T00:02:48.059802+0000","last_active":"2024-09-12T01:15:48.164834+0000","last_peered":"2024-09-12T01:15:48.164834+0000","last_clean":"2024-09-12T01:15:48.164834+0000","last_became_active":"2024-09-12T00:02:48.059289+0000","last_became_peered":"2024-09-12T00:02:48.059289+0000","last_unstale":"2024-09-12T01:15:48.164834+0000","last_undegraded":"2024-09-12T01:15:48.164834+0000","last_fullsized":"2024-09-12T01:15:48.164834+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:59.633157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342107,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":40439,"num_write":973,"num_write_kb":33156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'997","reported_seq":2680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956778+0000","last_change":"2024-09-12T00:02:50.070109+0000","last_active":"2024-09-12T01:14:02.956778+0000","last_peered":"2024-09-12T01:14:02.956778+0000","last_clean":"2024-09-12T01:14:02.956778+0000","last_became_active":"2024-09-12T00:02:50.069775+0000","last_became_peered":"2024-09-12T00:02:50.069775+0000","last_unstale":"2024-09-12T01:14:02.956778+0000","last_undegraded":"2024-09-12T01:14:02.956778+0000","last_fullsized":"2024-09-12T01:14:02.956778+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:30.986657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4692,"num_read_kb":4217,"num_write":1368,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'200","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.019994+0000","last_change":"2024-09-12T00:04:21.323388+0000","last_active":"2024-09-12T01:15:48.019994+0000","last_peered":"2024-09-12T01:15:48.019994+0000","last_clean":"2024-09-12T01:15:48.019994+0000","last_became_active":"2024-09-12T00:04:21.322881+0000","last_became_peered":"2024-09-12T00:04:21.322881+0000","last_unstale":"2024-09-12T01:15:48.019994+0000","last_undegraded":"2024-09-12T01:15:48.019994+0000","last_fullsized":"2024-09-12T01:15:48.019994+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.218601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15793517,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":543,"num_read_kb":44397,"num_write":1008,"num_write_kb":26074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"267'849","reported_seq":2416,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.284675+0000","last_change":"2024-09-12T00:02:50.061400+0000","last_active":"2024-09-12T01:12:58.284675+0000","last_peered":"2024-09-12T01:12:58.284675+0000","last_clean":"2024-09-12T01:12:58.284675+0000","last_became_active":"2024-09-12T00:02:50.061055+0000","last_became_peered":"2024-09-12T00:02:50.061055+0000","last_unstale":"2024-09-12T01:12:58.284675+0000","last_undegraded":"2024-09-12T01:12:58.284675+0000","last_fullsized":"2024-09-12T01:12:58.284675+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:36.257000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3601,"num_write":1146,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'245","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.114969+0000","last_change":"2024-09-12T00:03:22.073808+0000","last_active":"2024-09-12T01:15:48.114969+0000","last_peered":"2024-09-12T01:15:48.114969+0000","last_clean":"2024-09-12T01:15:48.114969+0000","last_became_active":"2024-09-12T00:03:22.073294+0000","last_became_peered":"2024-09-12T00:03:22.073294+0000","last_unstale":"2024-09-12T01:15:48.114969+0000","last_undegraded":"2024-09-12T01:15:48.114969+0000","last_fullsized":"2024-09-12T01:15:48.114969+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:48.679955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5615297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":9461,"num_write":1067,"num_write_kb":47816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"267'873","reported_seq":2497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.955537+0000","last_change":"2024-09-12T00:02:50.067613+0000","last_active":"2024-09-12T01:14:02.955537+0000","last_peered":"2024-09-12T01:14:02.955537+0000","last_clean":"2024-09-12T01:14:02.955537+0000","last_became_active":"2024-09-12T00:02:50.067334+0000","last_became_peered":"2024-09-12T00:02:50.067334+0000","last_unstale":"2024-09-12T01:14:02.955537+0000","last_undegraded":"2024-09-12T01:14:02.955537+0000","last_fullsized":"2024-09-12T01:14:02.955537+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:15.631907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4129,"num_read_kb":3712,"num_write":1142,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'240","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.835489+0000","last_change":"2024-09-12T00:02:48.050847+0000","last_active":"2024-09-12T01:15:08.835489+0000","last_peered":"2024-09-12T01:15:08.835489+0000","last_clean":"2024-09-12T01:15:08.835489+0000","last_became_active":"2024-09-12T00:02:48.049926+0000","last_became_peered":"2024-09-12T00:02:48.049926+0000","last_unstale":"2024-09-12T01:15:08.835489+0000","last_undegraded":"2024-09-12T01:15:08.835489+0000","last_fullsized":"2024-09-12T01:15:08.835489+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:56.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10884929,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":663,"num_read_kb":41400,"num_write":1179,"num_write_kb":37207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'135","reported_seq":652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.271975+0000","last_change":"2024-09-12T00:02:58.094744+0000","last_active":"2024-09-12T01:14:04.271975+0000","last_peered":"2024-09-12T01:14:04.271975+0000","last_clean":"2024-09-12T01:14:04.271975+0000","last_became_active":"2024-09-12T00:02:58.094271+0000","last_became_peered":"2024-09-12T00:02:58.094271+0000","last_unstale":"2024-09-12T01:14:04.271975+0000","last_undegraded":"2024-09-12T01:14:04.271975+0000","last_fullsized":"2024-09-12T01:14:04.271975+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:25.220277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":142,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'583","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.279891+0000","last_change":"2024-09-12T00:02:50.073678+0000","last_active":"2024-09-12T01:13:32.279891+0000","last_peered":"2024-09-12T01:13:32.279891+0000","last_clean":"2024-09-12T01:13:32.279891+0000","last_became_active":"2024-09-12T00:02:50.073327+0000","last_became_peered":"2024-09-12T00:02:50.073327+0000","last_unstale":"2024-09-12T01:13:32.279891+0000","last_undegraded":"2024-09-12T01:13:32.279891+0000","last_fullsized":"2024-09-12T01:13:32.279891+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:33.890960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3161,"num_read_kb":2955,"num_write":696,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'270","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.221731+0000","last_change":"2024-09-12T00:03:21.143983+0000","last_active":"2024-09-12T01:15:48.221731+0000","last_peered":"2024-09-12T01:15:48.221731+0000","last_clean":"2024-09-12T01:15:48.221731+0000","last_became_active":"2024-09-12T00:03:21.143543+0000","last_became_peered":"2024-09-12T00:03:21.143543+0000","last_unstale":"2024-09-12T01:15:48.221731+0000","last_undegraded":"2024-09-12T01:15:48.221731+0000","last_fullsized":"2024-09-12T01:15:48.221731+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:23.255657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":789,"num_read_kb":207403,"num_write":1277,"num_write_kb":65033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510971+0000","last_change":"2024-09-12T00:02:52.067537+0000","last_active":"2024-09-12T01:12:58.510971+0000","last_peered":"2024-09-12T01:12:58.510971+0000","last_clean":"2024-09-12T01:12:58.510971+0000","last_became_active":"2024-09-12T00:02:52.067288+0000","last_became_peered":"2024-09-12T00:02:52.067288+0000","last_unstale":"2024-09-12T01:12:58.510971+0000","last_undegraded":"2024-09-12T01:12:58.510971+0000","last_fullsized":"2024-09-12T01:12:58.510971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:59.660984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'232","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.876021+0000","last_change":"2024-09-12T00:02:54.070876+0000","last_active":"2024-09-12T01:15:10.876021+0000","last_peered":"2024-09-12T01:15:10.876021+0000","last_clean":"2024-09-12T01:15:10.876021+0000","last_became_active":"2024-09-12T00:02:54.070547+0000","last_became_peered":"2024-09-12T00:02:54.070547+0000","last_unstale":"2024-09-12T01:15:10.876021+0000","last_undegraded":"2024-09-12T01:15:10.876021+0000","last_fullsized":"2024-09-12T01:15:10.876021+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:55.618177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14585,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":395,"num_write":192,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.400430+0000","last_change":"2024-09-12T00:02:56.081347+0000","last_active":"2024-09-12T01:13:03.400430+0000","last_peered":"2024-09-12T01:13:03.400430+0000","last_clean":"2024-09-12T01:13:03.400430+0000","last_became_active":"2024-09-12T00:02:56.081086+0000","last_became_peered":"2024-09-12T00:02:56.081086+0000","last_unstale":"2024-09-12T01:13:03.400430+0000","last_undegraded":"2024-09-12T01:13:03.400430+0000","last_fullsized":"2024-09-12T01:13:03.400430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:59.050278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'2432","reported_seq":4341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.081005+0000","last_change":"2024-09-12T00:02:58.096284+0000","last_active":"2024-09-12T01:14:00.081005+0000","last_peered":"2024-09-12T01:14:00.081005+0000","last_clean":"2024-09-12T01:14:00.081005+0000","last_became_active":"2024-09-12T00:02:58.095948+0000","last_became_peered":"2024-09-12T00:02:58.095948+0000","last_unstale":"2024-09-12T01:14:00.081005+0000","last_undegraded":"2024-09-12T01:14:00.081005+0000","last_fullsized":"2024-09-12T01:14:00.081005+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6163,"num_read_kb":6149,"num_write":4865,"num_write_kb":1796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'433","reported_seq":1960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510948+0000","last_change":"2024-09-12T00:02:50.066811+0000","last_active":"2024-09-12T01:12:58.510948+0000","last_peered":"2024-09-12T01:12:58.510948+0000","last_clean":"2024-09-12T01:12:58.510948+0000","last_became_active":"2024-09-12T00:02:50.065654+0000","last_became_peered":"2024-09-12T00:02:50.065654+0000","last_unstale":"2024-09-12T01:12:58.510948+0000","last_undegraded":"2024-09-12T01:12:58.510948+0000","last_fullsized":"2024-09-12T01:12:58.510948+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:32.174985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2304,"num_read_kb":2172,"num_write":510,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'197","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243250+0000","last_change":"2024-09-12T00:02:48.052092+0000","last_active":"2024-09-12T01:12:50.243250+0000","last_peered":"2024-09-12T01:12:50.243250+0000","last_clean":"2024-09-12T01:12:50.243250+0000","last_became_active":"2024-09-12T00:02:48.050499+0000","last_became_peered":"2024-09-12T00:02:48.050499+0000","last_unstale":"2024-09-12T01:12:50.243250+0000","last_undegraded":"2024-09-12T01:12:50.243250+0000","last_fullsized":"2024-09-12T01:12:50.243250+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.925597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324673,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":413,"num_read_kb":23205,"num_write":929,"num_write_kb":52906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455377+0000","last_change":"2024-09-12T00:02:52.068820+0000","last_active":"2024-09-12T01:12:58.455377+0000","last_peered":"2024-09-12T01:12:58.455377+0000","last_clean":"2024-09-12T01:12:58.455377+0000","last_became_active":"2024-09-12T00:02:52.068519+0000","last_became_peered":"2024-09-12T00:02:52.068519+0000","last_unstale":"2024-09-12T01:12:58.455377+0000","last_undegraded":"2024-09-12T01:12:58.455377+0000","last_fullsized":"2024-09-12T01:12:58.455377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:41.402904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'115","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.479573+0000","last_change":"2024-09-12T00:02:54.060615+0000","last_active":"2024-09-12T01:13:29.479573+0000","last_peered":"2024-09-12T01:13:29.479573+0000","last_clean":"2024-09-12T01:13:29.479573+0000","last_became_active":"2024-09-12T00:02:54.060334+0000","last_became_peered":"2024-09-12T00:02:54.060334+0000","last_unstale":"2024-09-12T01:13:29.479573+0000","last_undegraded":"2024-09-12T01:13:29.479573+0000","last_fullsized":"2024-09-12T01:13:29.479573+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:06.270504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.399195+0000","last_change":"2024-09-12T00:02:56.085489+0000","last_active":"2024-09-12T01:13:03.399195+0000","last_peered":"2024-09-12T01:13:03.399195+0000","last_clean":"2024-09-12T01:13:03.399195+0000","last_became_active":"2024-09-12T00:02:56.085222+0000","last_became_peered":"2024-09-12T00:02:56.085222+0000","last_unstale":"2024-09-12T01:13:03.399195+0000","last_undegraded":"2024-09-12T01:13:03.399195+0000","last_fullsized":"2024-09-12T01:13:03.399195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:10.915396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'143","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244578+0000","last_change":"2024-09-12T00:02:58.094502+0000","last_active":"2024-09-12T01:13:00.244578+0000","last_peered":"2024-09-12T01:13:00.244578+0000","last_clean":"2024-09-12T01:13:00.244578+0000","last_became_active":"2024-09-12T00:02:58.094312+0000","last_became_peered":"2024-09-12T00:02:58.094312+0000","last_unstale":"2024-09-12T01:13:00.244578+0000","last_undegraded":"2024-09-12T01:13:00.244578+0000","last_fullsized":"2024-09-12T01:13:00.244578+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:05.995438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":193,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'829","reported_seq":2430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.964131+0000","last_change":"2024-09-12T00:02:50.071513+0000","last_active":"2024-09-12T01:13:13.964131+0000","last_peered":"2024-09-12T01:13:13.964131+0000","last_clean":"2024-09-12T01:13:13.964131+0000","last_became_active":"2024-09-12T00:02:50.071219+0000","last_became_peered":"2024-09-12T00:02:50.071219+0000","last_unstale":"2024-09-12T01:13:13.964131+0000","last_undegraded":"2024-09-12T01:13:13.964131+0000","last_fullsized":"2024-09-12T01:13:13.964131+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:42.605165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4069,"num_read_kb":3661,"num_write":1104,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'211","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.133404+0000","last_change":"2024-09-12T00:02:48.059794+0000","last_active":"2024-09-12T01:15:48.133404+0000","last_peered":"2024-09-12T01:15:48.133404+0000","last_clean":"2024-09-12T01:15:48.133404+0000","last_became_active":"2024-09-12T00:02:48.059132+0000","last_became_peered":"2024-09-12T00:02:48.059132+0000","last_unstale":"2024-09-12T01:15:48.133404+0000","last_undegraded":"2024-09-12T01:15:48.133404+0000","last_fullsized":"2024-09-12T01:15:48.133404+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.465348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":5763,"num_write":993,"num_write_kb":32529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455423+0000","last_change":"2024-09-12T00:02:52.064543+0000","last_active":"2024-09-12T01:12:58.455423+0000","last_peered":"2024-09-12T01:12:58.455423+0000","last_clean":"2024-09-12T01:12:58.455423+0000","last_became_active":"2024-09-12T00:02:52.064216+0000","last_became_peered":"2024-09-12T00:02:52.064216+0000","last_unstale":"2024-09-12T01:12:58.455423+0000","last_undegraded":"2024-09-12T01:12:58.455423+0000","last_fullsized":"2024-09-12T01:12:58.455423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:47.668439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'155","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.520130+0000","last_change":"2024-09-12T00:02:54.060808+0000","last_active":"2024-09-12T01:13:29.520130+0000","last_peered":"2024-09-12T01:13:29.520130+0000","last_clean":"2024-09-12T01:13:29.520130+0000","last_became_active":"2024-09-12T00:02:54.060501+0000","last_became_peered":"2024-09-12T00:02:54.060501+0000","last_unstale":"2024-09-12T01:13:29.520130+0000","last_undegraded":"2024-09-12T01:13:29.520130+0000","last_fullsized":"2024-09-12T01:13:29.520130+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.725874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":182,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'766","reported_seq":2662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.957227+0000","last_change":"2024-09-12T00:02:56.087899+0000","last_active":"2024-09-12T01:15:47.957227+0000","last_peered":"2024-09-12T01:15:47.957227+0000","last_clean":"2024-09-12T01:15:47.957227+0000","last_became_active":"2024-09-12T00:02:56.087506+0000","last_became_peered":"2024-09-12T00:02:56.087506+0000","last_unstale":"2024-09-12T01:15:47.957227+0000","last_undegraded":"2024-09-12T01:15:47.957227+0000","last_fullsized":"2024-09-12T01:15:47.957227+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.840099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'208","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.331265+0000","last_change":"2024-09-12T00:02:58.090727+0000","last_active":"2024-09-12T01:14:04.331265+0000","last_peered":"2024-09-12T01:14:04.331265+0000","last_clean":"2024-09-12T01:14:04.331265+0000","last_became_active":"2024-09-12T00:02:58.090424+0000","last_became_peered":"2024-09-12T00:02:58.090424+0000","last_unstale":"2024-09-12T01:14:04.331265+0000","last_undegraded":"2024-09-12T01:14:04.331265+0000","last_fullsized":"2024-09-12T01:14:04.331265+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:25.948169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":609,"num_read_kb":603,"num_write":442,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'493","reported_seq":2294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455414+0000","last_change":"2024-09-12T00:02:50.068236+0000","last_active":"2024-09-12T01:12:58.455414+0000","last_peered":"2024-09-12T01:12:58.455414+0000","last_clean":"2024-09-12T01:12:58.455414+0000","last_became_active":"2024-09-12T00:02:50.067933+0000","last_became_peered":"2024-09-12T00:02:50.067933+0000","last_unstale":"2024-09-12T01:12:58.455414+0000","last_undegraded":"2024-09-12T01:12:58.455414+0000","last_fullsized":"2024-09-12T01:12:58.455414+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:07.127880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2745,"num_read_kb":2618,"num_write":566,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'210","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.262322+0000","last_change":"2024-09-12T00:02:48.052920+0000","last_active":"2024-09-12T01:15:48.262322+0000","last_peered":"2024-09-12T01:15:48.262322+0000","last_clean":"2024-09-12T01:15:48.262322+0000","last_became_active":"2024-09-12T00:02:48.052566+0000","last_became_peered":"2024-09-12T00:02:48.052566+0000","last_unstale":"2024-09-12T01:15:48.262322+0000","last_undegraded":"2024-09-12T01:15:48.262322+0000","last_fullsized":"2024-09-12T01:15:48.262322+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:54.469835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":572,"num_read_kb":73907,"num_write":996,"num_write_kb":20895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.511011+0000","last_change":"2024-09-12T00:02:52.066484+0000","last_active":"2024-09-12T01:12:58.511011+0000","last_peered":"2024-09-12T01:12:58.511011+0000","last_clean":"2024-09-12T01:12:58.511011+0000","last_became_active":"2024-09-12T00:02:52.066171+0000","last_became_peered":"2024-09-12T00:02:52.066171+0000","last_unstale":"2024-09-12T01:12:58.511011+0000","last_undegraded":"2024-09-12T01:12:58.511011+0000","last_fullsized":"2024-09-12T01:12:58.511011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.617107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'168","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.074173+0000","last_change":"2024-09-12T00:02:54.239939+0000","last_active":"2024-09-12T01:15:48.074173+0000","last_peered":"2024-09-12T01:15:48.074173+0000","last_clean":"2024-09-12T01:15:48.074173+0000","last_became_active":"2024-09-12T00:02:54.239618+0000","last_became_peered":"2024-09-12T00:02:54.239618+0000","last_unstale":"2024-09-12T01:15:48.074173+0000","last_undegraded":"2024-09-12T01:15:48.074173+0000","last_fullsized":"2024-09-12T01:15:48.074173+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:03.054772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":308,"num_write":128,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'806","reported_seq":2629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.960735+0000","last_change":"2024-09-12T00:02:56.082933+0000","last_active":"2024-09-12T01:15:47.960735+0000","last_peered":"2024-09-12T01:15:47.960735+0000","last_clean":"2024-09-12T01:15:47.960735+0000","last_became_active":"2024-09-12T00:02:56.082567+0000","last_became_peered":"2024-09-12T00:02:56.082567+0000","last_unstale":"2024-09-12T01:15:47.960735+0000","last_undegraded":"2024-09-12T01:15:47.960735+0000","last_fullsized":"2024-09-12T01:15:47.960735+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:12.520817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'363","reported_seq":1779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.740706+0000","last_change":"2024-09-12T00:02:50.063983+0000","last_active":"2024-09-12T01:12:50.740706+0000","last_peered":"2024-09-12T01:12:50.740706+0000","last_clean":"2024-09-12T01:12:50.740706+0000","last_became_active":"2024-09-12T00:02:50.063707+0000","last_became_peered":"2024-09-12T00:02:50.063707+0000","last_unstale":"2024-09-12T01:12:50.740706+0000","last_undegraded":"2024-09-12T01:12:50.740706+0000","last_fullsized":"2024-09-12T01:12:50.740706+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:50.652404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1902,"num_write":425,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'196","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154808+0000","last_change":"2024-09-12T00:02:48.056458+0000","last_active":"2024-09-12T01:15:48.154808+0000","last_peered":"2024-09-12T01:15:48.154808+0000","last_clean":"2024-09-12T01:15:48.154808+0000","last_became_active":"2024-09-12T00:02:48.056135+0000","last_became_peered":"2024-09-12T00:02:48.056135+0000","last_unstale":"2024-09-12T01:15:48.154808+0000","last_undegraded":"2024-09-12T01:15:48.154808+0000","last_fullsized":"2024-09-12T01:15:48.154808+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:17.917949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":40539,"num_write":934,"num_write_kb":46911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.393561+0000","last_change":"2024-09-12T00:02:52.069040+0000","last_active":"2024-09-12T01:12:13.393561+0000","last_peered":"2024-09-12T01:12:13.393561+0000","last_clean":"2024-09-12T01:12:13.393561+0000","last_became_active":"2024-09-12T00:02:52.068747+0000","last_became_peered":"2024-09-12T00:02:52.068747+0000","last_unstale":"2024-09-12T01:12:13.393561+0000","last_undegraded":"2024-09-12T01:12:13.393561+0000","last_fullsized":"2024-09-12T01:12:13.393561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.948073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'275","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.157693+0000","last_change":"2024-09-12T00:02:54.239819+0000","last_active":"2024-09-12T01:15:48.157693+0000","last_peered":"2024-09-12T01:15:48.157693+0000","last_clean":"2024-09-12T01:15:48.157693+0000","last_became_active":"2024-09-12T00:02:54.239475+0000","last_became_peered":"2024-09-12T00:02:54.239475+0000","last_unstale":"2024-09-12T01:15:48.157693+0000","last_undegraded":"2024-09-12T01:15:48.157693+0000","last_fullsized":"2024-09-12T01:15:48.157693+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:54.855357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5743,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":380,"num_read_kb":454,"num_write":232,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.234848+0000","last_change":"2024-09-12T00:02:56.082064+0000","last_active":"2024-09-12T01:12:43.234848+0000","last_peered":"2024-09-12T01:12:43.234848+0000","last_clean":"2024-09-12T01:12:43.234848+0000","last_became_active":"2024-09-12T00:02:56.080748+0000","last_became_peered":"2024-09-12T00:02:56.080748+0000","last_unstale":"2024-09-12T01:12:43.234848+0000","last_undegraded":"2024-09-12T01:12:43.234848+0000","last_fullsized":"2024-09-12T01:12:43.234848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:53.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'526","reported_seq":1341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.895471+0000","last_change":"2024-09-12T00:02:58.095783+0000","last_active":"2024-09-12T01:15:10.895471+0000","last_peered":"2024-09-12T01:15:10.895471+0000","last_clean":"2024-09-12T01:15:10.895471+0000","last_became_active":"2024-09-12T00:02:58.095311+0000","last_became_peered":"2024-09-12T00:02:58.095311+0000","last_unstale":"2024-09-12T01:15:10.895471+0000","last_undegraded":"2024-09-12T01:15:10.895471+0000","last_fullsized":"2024-09-12T01:15:10.895471+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:26.606781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1247,"num_read_kb":1245,"num_write":1070,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'399","reported_seq":1701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.391883+0000","last_change":"2024-09-12T00:02:50.068582+0000","last_active":"2024-09-12T01:12:13.391883+0000","last_peered":"2024-09-12T01:12:13.391883+0000","last_clean":"2024-09-12T01:12:13.391883+0000","last_became_active":"2024-09-12T00:02:50.068223+0000","last_became_peered":"2024-09-12T00:02:50.068223+0000","last_unstale":"2024-09-12T01:12:13.391883+0000","last_undegraded":"2024-09-12T01:12:13.391883+0000","last_fullsized":"2024-09-12T01:12:13.391883+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:39.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1919,"num_read_kb":1778,"num_write":479,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'153","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.212769+0000","last_change":"2024-09-12T00:02:48.056639+0000","last_active":"2024-09-12T01:15:48.212769+0000","last_peered":"2024-09-12T01:15:48.212769+0000","last_clean":"2024-09-12T01:15:48.212769+0000","last_became_active":"2024-09-12T00:02:48.055480+0000","last_became_peered":"2024-09-12T00:02:48.055480+0000","last_unstale":"2024-09-12T01:15:48.212769+0000","last_undegraded":"2024-09-12T01:15:48.212769+0000","last_fullsized":"2024-09-12T01:15:48.212769+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:35.963894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250607,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":416,"num_read_kb":43431,"num_write":767,"num_write_kb":28983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.223502+0000","last_change":"2024-09-12T00:02:52.062537+0000","last_active":"2024-09-12T01:12:13.223502+0000","last_peered":"2024-09-12T01:12:13.223502+0000","last_clean":"2024-09-12T01:12:13.223502+0000","last_became_active":"2024-09-12T00:02:52.062219+0000","last_became_peered":"2024-09-12T00:02:52.062219+0000","last_unstale":"2024-09-12T01:12:13.223502+0000","last_undegraded":"2024-09-12T01:12:13.223502+0000","last_fullsized":"2024-09-12T01:12:13.223502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:37.629100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'154","reported_seq":742,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.857945+0000","last_change":"2024-09-12T00:02:54.069965+0000","last_active":"2024-09-12T01:15:10.857945+0000","last_peered":"2024-09-12T01:15:10.857945+0000","last_clean":"2024-09-12T01:15:10.857945+0000","last_became_active":"2024-09-12T00:02:54.069656+0000","last_became_peered":"2024-09-12T00:02:54.069656+0000","last_unstale":"2024-09-12T01:15:10.857945+0000","last_undegraded":"2024-09-12T01:15:10.857945+0000","last_fullsized":"2024-09-12T01:15:10.857945+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.543544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":256,"num_write":104,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.451158+0000","last_change":"2024-09-12T00:02:56.082127+0000","last_active":"2024-09-12T01:12:23.451158+0000","last_peered":"2024-09-12T01:12:23.451158+0000","last_clean":"2024-09-12T01:12:23.451158+0000","last_became_active":"2024-09-12T00:02:56.081804+0000","last_became_peered":"2024-09-12T00:02:56.081804+0000","last_unstale":"2024-09-12T01:12:23.451158+0000","last_undegraded":"2024-09-12T01:12:23.451158+0000","last_fullsized":"2024-09-12T01:12:23.451158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'120","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:53.623729+0000","last_change":"2024-09-12T00:02:58.095336+0000","last_active":"2024-09-12T01:13:53.623729+0000","last_peered":"2024-09-12T01:13:53.623729+0000","last_clean":"2024-09-12T01:13:53.623729+0000","last_became_active":"2024-09-12T00:02:58.095068+0000","last_became_peered":"2024-09-12T00:02:58.095068+0000","last_unstale":"2024-09-12T01:13:53.623729+0000","last_undegraded":"2024-09-12T01:13:53.623729+0000","last_fullsized":"2024-09-12T01:13:53.623729+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:41.572699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":135,"num_write":297,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'895","reported_seq":2417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956001+0000","last_change":"2024-09-12T00:02:50.078307+0000","last_active":"2024-09-12T01:14:02.956001+0000","last_peered":"2024-09-12T01:14:02.956001+0000","last_clean":"2024-09-12T01:14:02.956001+0000","last_became_active":"2024-09-12T00:02:50.078033+0000","last_became_peered":"2024-09-12T00:02:50.078033+0000","last_unstale":"2024-09-12T01:14:02.956001+0000","last_undegraded":"2024-09-12T01:14:02.956001+0000","last_fullsized":"2024-09-12T01:14:02.956001+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:39.344301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4128,"num_read_kb":3671,"num_write":1209,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'185","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010442+0000","last_change":"2024-09-12T00:02:48.050254+0000","last_active":"2024-09-12T01:15:48.010442+0000","last_peered":"2024-09-12T01:15:48.010442+0000","last_clean":"2024-09-12T01:15:48.010442+0000","last_became_active":"2024-09-12T00:02:48.048973+0000","last_became_peered":"2024-09-12T00:02:48.048973+0000","last_unstale":"2024-09-12T01:15:48.010442+0000","last_undegraded":"2024-09-12T01:15:48.010442+0000","last_fullsized":"2024-09-12T01:15:48.010442+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:37.674699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":6868,"num_write":918,"num_write_kb":34085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.226604+0000","last_change":"2024-09-12T00:02:52.066165+0000","last_active":"2024-09-12T01:12:38.226604+0000","last_peered":"2024-09-12T01:12:38.226604+0000","last_clean":"2024-09-12T01:12:38.226604+0000","last_became_active":"2024-09-12T00:02:52.065809+0000","last_became_peered":"2024-09-12T00:02:52.065809+0000","last_unstale":"2024-09-12T01:12:38.226604+0000","last_undegraded":"2024-09-12T01:12:38.226604+0000","last_fullsized":"2024-09-12T01:12:38.226604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:04.139647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'211","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.180814+0000","last_change":"2024-09-12T00:02:54.067330+0000","last_active":"2024-09-12T01:15:48.180814+0000","last_peered":"2024-09-12T01:15:48.180814+0000","last_clean":"2024-09-12T01:15:48.180814+0000","last_became_active":"2024-09-12T00:02:54.066781+0000","last_became_peered":"2024-09-12T00:02:54.066781+0000","last_unstale":"2024-09-12T01:15:48.180814+0000","last_undegraded":"2024-09-12T01:15:48.180814+0000","last_fullsized":"2024-09-12T01:15:48.180814+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:13.921060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":282,"num_read_kb":329,"num_write":166,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'791","reported_seq":2814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.937531+0000","last_change":"2024-09-12T00:02:56.086997+0000","last_active":"2024-09-12T01:15:13.937531+0000","last_peered":"2024-09-12T01:15:13.937531+0000","last_clean":"2024-09-12T01:15:13.937531+0000","last_became_active":"2024-09-12T00:02:56.086692+0000","last_became_peered":"2024-09-12T00:02:56.086692+0000","last_unstale":"2024-09-12T01:15:13.937531+0000","last_undegraded":"2024-09-12T01:15:13.937531+0000","last_fullsized":"2024-09-12T01:15:13.937531+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:43.673008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'116","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.570840+0000","last_change":"2024-09-12T00:02:58.093723+0000","last_active":"2024-09-12T01:15:09.570840+0000","last_peered":"2024-09-12T01:15:09.570840+0000","last_clean":"2024-09-12T01:15:09.570840+0000","last_became_active":"2024-09-12T00:02:58.093419+0000","last_became_peered":"2024-09-12T00:02:58.093419+0000","last_unstale":"2024-09-12T01:15:09.570840+0000","last_undegraded":"2024-09-12T01:15:09.570840+0000","last_fullsized":"2024-09-12T01:15:09.570840+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:27.505545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":298,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'399","reported_seq":1992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.655457+0000","last_change":"2024-09-12T00:02:50.074292+0000","last_active":"2024-09-12T01:12:55.655457+0000","last_peered":"2024-09-12T01:12:55.655457+0000","last_clean":"2024-09-12T01:12:55.655457+0000","last_became_active":"2024-09-12T00:02:50.073986+0000","last_became_peered":"2024-09-12T00:02:50.073986+0000","last_unstale":"2024-09-12T01:12:55.655457+0000","last_undegraded":"2024-09-12T01:12:55.655457+0000","last_fullsized":"2024-09-12T01:12:55.655457+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:10.242887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2369,"num_read_kb":2271,"num_write":449,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'218","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041533+0000","last_change":"2024-09-12T00:02:48.051538+0000","last_active":"2024-09-12T01:15:48.041533+0000","last_peered":"2024-09-12T01:15:48.041533+0000","last_clean":"2024-09-12T01:15:48.041533+0000","last_became_active":"2024-09-12T00:02:48.051190+0000","last_became_peered":"2024-09-12T00:02:48.051190+0000","last_unstale":"2024-09-12T01:15:48.041533+0000","last_undegraded":"2024-09-12T01:15:48.041533+0000","last_fullsized":"2024-09-12T01:15:48.041533+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:22.141104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":21060,"num_write":1056,"num_write_kb":24204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:28.225385+0000","last_change":"2024-09-12T00:02:52.057007+0000","last_active":"2024-09-12T01:12:28.225385+0000","last_peered":"2024-09-12T01:12:28.225385+0000","last_clean":"2024-09-12T01:12:28.225385+0000","last_became_active":"2024-09-12T00:02:52.056676+0000","last_became_peered":"2024-09-12T00:02:52.056676+0000","last_unstale":"2024-09-12T01:12:28.225385+0000","last_undegraded":"2024-09-12T01:12:28.225385+0000","last_fullsized":"2024-09-12T01:12:28.225385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:05.044357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'218","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.861291+0000","last_change":"2024-09-12T00:02:54.067361+0000","last_active":"2024-09-12T01:15:10.861291+0000","last_peered":"2024-09-12T01:15:10.861291+0000","last_clean":"2024-09-12T01:15:10.861291+0000","last_became_active":"2024-09-12T00:02:54.066994+0000","last_became_peered":"2024-09-12T00:02:54.066994+0000","last_unstale":"2024-09-12T01:15:10.861291+0000","last_undegraded":"2024-09-12T01:15:10.861291+0000","last_fullsized":"2024-09-12T01:15:10.861291+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:13.963065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":303,"num_read_kb":404,"num_write":158,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.224174+0000","last_change":"2024-09-12T00:02:56.079092+0000","last_active":"2024-09-12T01:12:18.224174+0000","last_peered":"2024-09-12T01:12:18.224174+0000","last_clean":"2024-09-12T01:12:18.224174+0000","last_became_active":"2024-09-12T00:02:56.078740+0000","last_became_peered":"2024-09-12T00:02:56.078740+0000","last_unstale":"2024-09-12T01:12:18.224174+0000","last_undegraded":"2024-09-12T01:12:18.224174+0000","last_fullsized":"2024-09-12T01:12:18.224174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.551797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'108","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.778285+0000","last_change":"2024-09-12T00:02:58.092860+0000","last_active":"2024-09-12T01:14:00.778285+0000","last_peered":"2024-09-12T01:14:00.778285+0000","last_clean":"2024-09-12T01:14:00.778285+0000","last_became_active":"2024-09-12T00:02:58.092520+0000","last_became_peered":"2024-09-12T00:02:58.092520+0000","last_unstale":"2024-09-12T01:14:00.778285+0000","last_undegraded":"2024-09-12T01:14:00.778285+0000","last_fullsized":"2024-09-12T01:14:00.778285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":241,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'520","reported_seq":2234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.281027+0000","last_change":"2024-09-12T00:02:50.069136+0000","last_active":"2024-09-12T01:13:32.281027+0000","last_peered":"2024-09-12T01:13:32.281027+0000","last_clean":"2024-09-12T01:13:32.281027+0000","last_became_active":"2024-09-12T00:02:50.068691+0000","last_became_peered":"2024-09-12T00:02:50.068691+0000","last_unstale":"2024-09-12T01:13:32.281027+0000","last_undegraded":"2024-09-12T01:13:32.281027+0000","last_fullsized":"2024-09-12T01:13:32.281027+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.229579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2837,"num_read_kb":2668,"num_write":620,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'203","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.230560+0000","last_change":"2024-09-12T00:02:48.052397+0000","last_active":"2024-09-12T01:15:48.230560+0000","last_peered":"2024-09-12T01:15:48.230560+0000","last_clean":"2024-09-12T01:15:48.230560+0000","last_became_active":"2024-09-12T00:02:48.050513+0000","last_became_peered":"2024-09-12T00:02:48.050513+0000","last_unstale":"2024-09-12T01:15:48.230560+0000","last_undegraded":"2024-09-12T01:15:48.230560+0000","last_fullsized":"2024-09-12T01:15:48.230560+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:38.868513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6584947,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":922,"num_read_kb":76851,"num_write":1039,"num_write_kb":50138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.226648+0000","last_change":"2024-09-12T00:02:52.064616+0000","last_active":"2024-09-12T01:12:38.226648+0000","last_peered":"2024-09-12T01:12:38.226648+0000","last_clean":"2024-09-12T01:12:38.226648+0000","last_became_active":"2024-09-12T00:02:52.064333+0000","last_became_peered":"2024-09-12T00:02:52.064333+0000","last_unstale":"2024-09-12T01:12:38.226648+0000","last_undegraded":"2024-09-12T01:12:38.226648+0000","last_fullsized":"2024-09-12T01:12:38.226648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:11.063949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'175","reported_seq":778,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.013426+0000","last_change":"2024-09-12T00:02:54.069072+0000","last_active":"2024-09-12T01:15:48.013426+0000","last_peered":"2024-09-12T01:15:48.013426+0000","last_clean":"2024-09-12T01:15:48.013426+0000","last_became_active":"2024-09-12T00:02:54.068732+0000","last_became_peered":"2024-09-12T00:02:54.068732+0000","last_unstale":"2024-09-12T01:15:48.013426+0000","last_undegraded":"2024-09-12T01:15:48.013426+0000","last_fullsized":"2024-09-12T01:15:48.013426+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:07.854071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":259,"num_read_kb":329,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.244035+0000","last_change":"2024-09-12T00:02:56.088885+0000","last_active":"2024-09-12T01:12:55.244035+0000","last_peered":"2024-09-12T01:12:55.244035+0000","last_clean":"2024-09-12T01:12:55.244035+0000","last_became_active":"2024-09-12T00:02:56.088527+0000","last_became_peered":"2024-09-12T00:02:56.088527+0000","last_unstale":"2024-09-12T01:12:55.244035+0000","last_undegraded":"2024-09-12T01:12:55.244035+0000","last_fullsized":"2024-09-12T01:12:55.244035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:43.640519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'110","reported_seq":616,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:00.159830+0000","last_change":"2024-09-12T00:02:58.101029+0000","last_active":"2024-09-12T01:15:00.159830+0000","last_peered":"2024-09-12T01:15:00.159830+0000","last_clean":"2024-09-12T01:15:00.159830+0000","last_became_active":"2024-09-12T00:02:58.100726+0000","last_became_peered":"2024-09-12T00:02:58.100726+0000","last_unstale":"2024-09-12T01:15:00.159830+0000","last_undegraded":"2024-09-12T01:15:00.159830+0000","last_fullsized":"2024-09-12T01:15:00.159830+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:32.362052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":109,"num_write":270,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'820","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.718982+0000","last_change":"2024-09-12T00:02:50.059930+0000","last_active":"2024-09-12T01:15:09.718982+0000","last_peered":"2024-09-12T01:15:09.718982+0000","last_clean":"2024-09-12T01:15:09.718982+0000","last_became_active":"2024-09-12T00:02:50.059646+0000","last_became_peered":"2024-09-12T00:02:50.059646+0000","last_unstale":"2024-09-12T01:15:09.718982+0000","last_undegraded":"2024-09-12T01:15:09.718982+0000","last_fullsized":"2024-09-12T01:15:09.718982+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:39.274084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3626,"num_write":1074,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'218","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.147170+0000","last_change":"2024-09-12T00:02:48.046764+0000","last_active":"2024-09-12T01:15:48.147170+0000","last_peered":"2024-09-12T01:15:48.147170+0000","last_clean":"2024-09-12T01:15:48.147170+0000","last_became_active":"2024-09-12T00:02:48.046424+0000","last_became_peered":"2024-09-12T00:02:48.046424+0000","last_unstale":"2024-09-12T01:15:48.147170+0000","last_undegraded":"2024-09-12T01:15:48.147170+0000","last_fullsized":"2024-09-12T01:15:48.147170+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.965456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":142057,"num_write":895,"num_write_kb":42631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.234273+0000","last_change":"2024-09-12T00:02:52.064194+0000","last_active":"2024-09-12T01:12:38.234273+0000","last_peered":"2024-09-12T01:12:38.234273+0000","last_clean":"2024-09-12T01:12:38.234273+0000","last_became_active":"2024-09-12T00:02:52.063641+0000","last_became_peered":"2024-09-12T00:02:52.063641+0000","last_unstale":"2024-09-12T01:12:38.234273+0000","last_undegraded":"2024-09-12T01:12:38.234273+0000","last_fullsized":"2024-09-12T01:12:38.234273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:26.679512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'186","reported_seq":806,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.244141+0000","last_change":"2024-09-12T00:02:54.067652+0000","last_active":"2024-09-12T01:15:48.244141+0000","last_peered":"2024-09-12T01:15:48.244141+0000","last_clean":"2024-09-12T01:15:48.244141+0000","last_became_active":"2024-09-12T00:02:54.067328+0000","last_became_peered":"2024-09-12T00:02:54.067328+0000","last_unstale":"2024-09-12T01:15:48.244141+0000","last_undegraded":"2024-09-12T01:15:48.244141+0000","last_fullsized":"2024-09-12T01:15:48.244141+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:44.430717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":308,"num_write":148,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'743","reported_seq":2617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.956961+0000","last_change":"2024-09-12T00:02:56.079479+0000","last_active":"2024-09-12T01:15:47.956961+0000","last_peered":"2024-09-12T01:15:47.956961+0000","last_clean":"2024-09-12T01:15:47.956961+0000","last_became_active":"2024-09-12T00:02:56.079167+0000","last_became_peered":"2024-09-12T00:02:56.079167+0000","last_unstale":"2024-09-12T01:15:47.956961+0000","last_undegraded":"2024-09-12T01:15:47.956961+0000","last_fullsized":"2024-09-12T01:15:47.956961+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:15.403409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'124","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.241818+0000","last_change":"2024-09-12T00:02:58.097685+0000","last_active":"2024-09-12T01:13:48.241818+0000","last_peered":"2024-09-12T01:13:48.241818+0000","last_clean":"2024-09-12T01:13:48.241818+0000","last_became_active":"2024-09-12T00:02:58.097332+0000","last_became_peered":"2024-09-12T00:02:58.097332+0000","last_unstale":"2024-09-12T01:13:48.241818+0000","last_undegraded":"2024-09-12T01:13:48.241818+0000","last_fullsized":"2024-09-12T01:13:48.241818+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'385","reported_seq":1995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127378+0000","last_change":"2024-09-12T00:02:50.064012+0000","last_active":"2024-09-12T01:14:04.127378+0000","last_peered":"2024-09-12T01:14:04.127378+0000","last_clean":"2024-09-12T01:14:04.127378+0000","last_became_active":"2024-09-12T00:02:50.063676+0000","last_became_peered":"2024-09-12T00:02:50.063676+0000","last_unstale":"2024-09-12T01:14:04.127378+0000","last_undegraded":"2024-09-12T01:14:04.127378+0000","last_fullsized":"2024-09-12T01:14:04.127378+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:48.138249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2187,"num_read_kb":2115,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'185","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.213869+0000","last_change":"2024-09-12T00:02:48.046773+0000","last_active":"2024-09-12T01:15:48.213869+0000","last_peered":"2024-09-12T01:15:48.213869+0000","last_clean":"2024-09-12T01:15:48.213869+0000","last_became_active":"2024-09-12T00:02:48.046457+0000","last_became_peered":"2024-09-12T00:02:48.046457+0000","last_unstale":"2024-09-12T01:15:48.213869+0000","last_undegraded":"2024-09-12T01:15:48.213869+0000","last_fullsized":"2024-09-12T01:15:48.213869+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:27.570957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":408,"num_read_kb":52839,"num_write":877,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.937718+0000","last_change":"2024-09-12T00:02:52.068801+0000","last_active":"2024-09-12T01:15:47.937718+0000","last_peered":"2024-09-12T01:15:47.937718+0000","last_clean":"2024-09-12T01:15:47.937718+0000","last_became_active":"2024-09-12T00:02:52.068535+0000","last_became_peered":"2024-09-12T00:02:52.068535+0000","last_unstale":"2024-09-12T01:15:47.937718+0000","last_undegraded":"2024-09-12T01:15:47.937718+0000","last_fullsized":"2024-09-12T01:15:47.937718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:14.683759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'103","reported_seq":644,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.447426+0000","last_change":"2024-09-12T00:02:54.240354+0000","last_active":"2024-09-12T01:13:29.447426+0000","last_peered":"2024-09-12T01:13:29.447426+0000","last_clean":"2024-09-12T01:13:29.447426+0000","last_became_active":"2024-09-12T00:02:54.239924+0000","last_became_peered":"2024-09-12T00:02:54.239924+0000","last_unstale":"2024-09-12T01:13:29.447426+0000","last_undegraded":"2024-09-12T01:13:29.447426+0000","last_fullsized":"2024-09-12T01:13:29.447426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:39.666122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":4496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.959587+0000","last_change":"2024-09-12T00:02:56.086976+0000","last_active":"2024-09-12T01:15:47.959587+0000","last_peered":"2024-09-12T01:15:47.959587+0000","last_clean":"2024-09-12T01:15:47.959587+0000","last_became_active":"2024-09-12T00:02:56.086668+0000","last_became_peered":"2024-09-12T00:02:56.086668+0000","last_unstale":"2024-09-12T01:15:47.959587+0000","last_undegraded":"2024-09-12T01:15:47.959587+0000","last_fullsized":"2024-09-12T01:15:47.959587+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:09.139717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'150","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.387710+0000","last_change":"2024-09-12T00:02:58.097729+0000","last_active":"2024-09-12T01:11:43.387710+0000","last_peered":"2024-09-12T01:11:43.387710+0000","last_clean":"2024-09-12T01:11:43.387710+0000","last_became_active":"2024-09-12T00:02:58.097435+0000","last_became_peered":"2024-09-12T00:02:58.097435+0000","last_unstale":"2024-09-12T01:11:43.387710+0000","last_undegraded":"2024-09-12T01:11:43.387710+0000","last_fullsized":"2024-09-12T01:11:43.387710+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:06.625906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":180,"num_write":378,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'757","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:21.039751+0000","last_change":"2024-09-12T00:02:50.069930+0000","last_active":"2024-09-12T01:13:21.039751+0000","last_peered":"2024-09-12T01:13:21.039751+0000","last_clean":"2024-09-12T01:13:21.039751+0000","last_became_active":"2024-09-12T00:02:50.069661+0000","last_became_peered":"2024-09-12T00:02:50.069661+0000","last_unstale":"2024-09-12T01:13:21.039751+0000","last_undegraded":"2024-09-12T01:13:21.039751+0000","last_fullsized":"2024-09-12T01:13:21.039751+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:29.419116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4159,"num_read_kb":3799,"num_write":1082,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'214","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167450+0000","last_change":"2024-09-12T00:02:48.047887+0000","last_active":"2024-09-12T01:15:48.167450+0000","last_peered":"2024-09-12T01:15:48.167450+0000","last_clean":"2024-09-12T01:15:48.167450+0000","last_became_active":"2024-09-12T00:02:48.046527+0000","last_became_peered":"2024-09-12T00:02:48.046527+0000","last_unstale":"2024-09-12T01:15:48.167450+0000","last_undegraded":"2024-09-12T01:15:48.167450+0000","last_fullsized":"2024-09-12T01:15:48.167450+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:11.514356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":898,"num_read_kb":26543,"num_write":1077,"num_write_kb":24642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"38'4","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.925616+0000","last_change":"2024-09-12T00:02:52.064448+0000","last_active":"2024-09-12T01:15:47.925616+0000","last_peered":"2024-09-12T01:15:47.925616+0000","last_clean":"2024-09-12T01:15:47.925616+0000","last_became_active":"2024-09-12T00:02:52.064186+0000","last_became_peered":"2024-09-12T00:02:52.064186+0000","last_unstale":"2024-09-12T01:15:47.925616+0000","last_undegraded":"2024-09-12T01:15:47.925616+0000","last_fullsized":"2024-09-12T01:15:47.925616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:57.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'295","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.124813+0000","last_change":"2024-09-12T00:02:54.072647+0000","last_active":"2024-09-12T01:15:48.124813+0000","last_peered":"2024-09-12T01:15:48.124813+0000","last_clean":"2024-09-12T01:15:48.124813+0000","last_became_active":"2024-09-12T00:02:54.072431+0000","last_became_peered":"2024-09-12T00:02:54.072431+0000","last_unstale":"2024-09-12T01:15:48.124813+0000","last_undegraded":"2024-09-12T01:15:48.124813+0000","last_fullsized":"2024-09-12T01:15:48.124813+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:22.191371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1000,"num_write":1544,"num_write_kb":1370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.613978+0000","last_change":"2024-09-12T00:02:56.083934+0000","last_active":"2024-09-12T01:12:43.613978+0000","last_peered":"2024-09-12T01:12:43.613978+0000","last_clean":"2024-09-12T01:12:43.613978+0000","last_became_active":"2024-09-12T00:02:56.083643+0000","last_became_peered":"2024-09-12T00:02:56.083643+0000","last_unstale":"2024-09-12T01:12:43.613978+0000","last_undegraded":"2024-09-12T01:12:43.613978+0000","last_fullsized":"2024-09-12T01:12:43.613978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:28.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'154","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.228014+0000","last_change":"2024-09-12T00:02:58.096803+0000","last_active":"2024-09-12T01:11:43.228014+0000","last_peered":"2024-09-12T01:11:43.228014+0000","last_clean":"2024-09-12T01:11:43.228014+0000","last_became_active":"2024-09-12T00:02:58.096337+0000","last_became_peered":"2024-09-12T00:02:58.096337+0000","last_unstale":"2024-09-12T01:11:43.228014+0000","last_undegraded":"2024-09-12T01:11:43.228014+0000","last_fullsized":"2024-09-12T01:11:43.228014+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":374,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'343","reported_seq":1738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.729659+0000","last_change":"2024-09-12T00:02:50.063532+0000","last_active":"2024-09-12T01:15:09.729659+0000","last_peered":"2024-09-12T01:15:09.729659+0000","last_clean":"2024-09-12T01:15:09.729659+0000","last_became_active":"2024-09-12T00:02:50.063141+0000","last_became_peered":"2024-09-12T00:02:50.063141+0000","last_unstale":"2024-09-12T01:15:09.729659+0000","last_undegraded":"2024-09-12T01:15:09.729659+0000","last_fullsized":"2024-09-12T01:15:09.729659+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:36.757516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1807,"num_write":392,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397459+0000","last_change":"2024-09-12T00:02:31.950306+0000","last_active":"2024-09-12T01:12:43.397459+0000","last_peered":"2024-09-12T01:12:43.397459+0000","last_clean":"2024-09-12T01:12:43.397459+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T01:12:43.397459+0000","last_undegraded":"2024-09-12T01:12:43.397459+0000","last_fullsized":"2024-09-12T01:12:43.397459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_clean_scrub_stamp":"2024-09-12T00:02:29.944268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.076017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.515515+0000","last_change":"2024-09-12T00:02:38.003392+0000","last_active":"2024-09-12T01:13:28.515515+0000","last_peered":"2024-09-12T01:13:28.515515+0000","last_clean":"2024-09-12T01:13:28.515515+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T01:13:28.515515+0000","last_undegraded":"2024-09-12T01:13:28.515515+0000","last_fullsized":"2024-09-12T01:13:28.515515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.472492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'199","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154708+0000","last_change":"2024-09-12T00:02:48.048426+0000","last_active":"2024-09-12T01:15:48.154708+0000","last_peered":"2024-09-12T01:15:48.154708+0000","last_clean":"2024-09-12T01:15:48.154708+0000","last_became_active":"2024-09-12T00:02:48.047739+0000","last_became_peered":"2024-09-12T00:02:48.047739+0000","last_unstale":"2024-09-12T01:15:48.154708+0000","last_undegraded":"2024-09-12T01:15:48.154708+0000","last_fullsized":"2024-09-12T01:15:48.154708+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:56.338442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":439,"num_read_kb":34702,"num_write":919,"num_write_kb":51263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.405908+0000","last_change":"2024-09-12T00:02:52.065910+0000","last_active":"2024-09-12T01:13:43.405908+0000","last_peered":"2024-09-12T01:13:43.405908+0000","last_clean":"2024-09-12T01:13:43.405908+0000","last_became_active":"2024-09-12T00:02:52.065587+0000","last_became_peered":"2024-09-12T00:02:52.065587+0000","last_unstale":"2024-09-12T01:13:43.405908+0000","last_undegraded":"2024-09-12T01:13:43.405908+0000","last_fullsized":"2024-09-12T01:13:43.405908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:58.876252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'333","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.224680+0000","last_change":"2024-09-12T00:02:54.069602+0000","last_active":"2024-09-12T01:15:48.224680+0000","last_peered":"2024-09-12T01:15:48.224680+0000","last_clean":"2024-09-12T01:15:48.224680+0000","last_became_active":"2024-09-12T00:02:54.069167+0000","last_became_peered":"2024-09-12T00:02:54.069167+0000","last_unstale":"2024-09-12T01:15:48.224680+0000","last_undegraded":"2024-09-12T01:15:48.224680+0000","last_fullsized":"2024-09-12T01:15:48.224680+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.314767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":868,"num_write":580,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.239491+0000","last_change":"2024-09-12T00:02:56.083312+0000","last_active":"2024-09-12T01:12:15.239491+0000","last_peered":"2024-09-12T01:12:15.239491+0000","last_clean":"2024-09-12T01:12:15.239491+0000","last_became_active":"2024-09-12T00:02:56.082981+0000","last_became_peered":"2024-09-12T00:02:56.082981+0000","last_unstale":"2024-09-12T01:12:15.239491+0000","last_undegraded":"2024-09-12T01:12:15.239491+0000","last_fullsized":"2024-09-12T01:12:15.239491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:01.810212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'220","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.154487+0000","last_change":"2024-09-12T00:02:58.099932+0000","last_active":"2024-09-12T01:14:04.154487+0000","last_peered":"2024-09-12T01:14:04.154487+0000","last_clean":"2024-09-12T01:14:04.154487+0000","last_became_active":"2024-09-12T00:02:58.099655+0000","last_became_peered":"2024-09-12T00:02:58.099655+0000","last_unstale":"2024-09-12T01:14:04.154487+0000","last_undegraded":"2024-09-12T01:14:04.154487+0000","last_fullsized":"2024-09-12T01:14:04.154487+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:49.539153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1237,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":468,"num_write":474,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'874","reported_seq":2624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127264+0000","last_change":"2024-09-12T00:02:50.076009+0000","last_active":"2024-09-12T01:14:04.127264+0000","last_peered":"2024-09-12T01:14:04.127264+0000","last_clean":"2024-09-12T01:14:04.127264+0000","last_became_active":"2024-09-12T00:02:50.075700+0000","last_became_peered":"2024-09-12T00:02:50.075700+0000","last_unstale":"2024-09-12T01:14:04.127264+0000","last_undegraded":"2024-09-12T01:14:04.127264+0000","last_fullsized":"2024-09-12T01:14:04.127264+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.088247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4451,"num_read_kb":4025,"num_write":1186,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398157+0000","last_change":"2024-09-12T00:02:37.999892+0000","last_active":"2024-09-12T01:12:48.398157+0000","last_peered":"2024-09-12T01:12:48.398157+0000","last_clean":"2024-09-12T01:12:48.398157+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T01:12:48.398157+0000","last_undegraded":"2024-09-12T01:12:48.398157+0000","last_fullsized":"2024-09-12T01:12:48.398157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.336025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'211","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249465+0000","last_change":"2024-09-12T00:02:48.058588+0000","last_active":"2024-09-12T01:13:40.249465+0000","last_peered":"2024-09-12T01:13:40.249465+0000","last_clean":"2024-09-12T01:13:40.249465+0000","last_became_active":"2024-09-12T00:02:48.057849+0000","last_became_peered":"2024-09-12T00:02:48.057849+0000","last_unstale":"2024-09-12T01:13:40.249465+0000","last_undegraded":"2024-09-12T01:13:40.249465+0000","last_fullsized":"2024-09-12T01:13:40.249465+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:26.461055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14266353,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":516,"num_read_kb":138068,"num_write":1052,"num_write_kb":57312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.504352+0000","last_change":"2024-09-12T00:02:52.066638+0000","last_active":"2024-09-12T01:12:13.504352+0000","last_peered":"2024-09-12T01:12:13.504352+0000","last_clean":"2024-09-12T01:12:13.504352+0000","last_became_active":"2024-09-12T00:02:52.066352+0000","last_became_peered":"2024-09-12T00:02:52.066352+0000","last_unstale":"2024-09-12T01:12:13.504352+0000","last_undegraded":"2024-09-12T01:12:13.504352+0000","last_fullsized":"2024-09-12T01:12:13.504352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:43.605378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'935","reported_seq":2771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.138847+0000","last_change":"2024-09-12T00:02:54.070381+0000","last_active":"2024-09-12T01:15:48.138847+0000","last_peered":"2024-09-12T01:15:48.138847+0000","last_clean":"2024-09-12T01:15:48.138847+0000","last_became_active":"2024-09-12T00:02:54.070061+0000","last_became_peered":"2024-09-12T00:02:54.070061+0000","last_unstale":"2024-09-12T01:15:48.138847+0000","last_undegraded":"2024-09-12T01:15:48.138847+0000","last_fullsized":"2024-09-12T01:15:48.138847+0000","mapping_epoch":32,"log_start":"267'901","ondisk_log_start":"267'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":901,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:23.921978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23657,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1272,"num_read_kb":1457,"num_write":388,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390773+0000","last_change":"2024-09-12T00:02:56.078956+0000","last_active":"2024-09-12T01:11:53.390773+0000","last_peered":"2024-09-12T01:11:53.390773+0000","last_clean":"2024-09-12T01:11:53.390773+0000","last_became_active":"2024-09-12T00:02:56.078658+0000","last_became_peered":"2024-09-12T00:02:56.078658+0000","last_unstale":"2024-09-12T01:11:53.390773+0000","last_undegraded":"2024-09-12T01:11:53.390773+0000","last_fullsized":"2024-09-12T01:11:53.390773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:42.358383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'171","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:33.233571+0000","last_change":"2024-09-12T00:02:58.089668+0000","last_active":"2024-09-12T01:12:33.233571+0000","last_peered":"2024-09-12T01:12:33.233571+0000","last_clean":"2024-09-12T01:12:33.233571+0000","last_became_active":"2024-09-12T00:02:58.089378+0000","last_became_peered":"2024-09-12T00:02:58.089378+0000","last_unstale":"2024-09-12T01:12:33.233571+0000","last_undegraded":"2024-09-12T01:12:33.233571+0000","last_fullsized":"2024-09-12T01:12:33.233571+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.424097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":336,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'1105","reported_seq":2822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128513+0000","last_change":"2024-09-12T00:02:50.069236+0000","last_active":"2024-09-12T01:14:04.128513+0000","last_peered":"2024-09-12T01:14:04.128513+0000","last_clean":"2024-09-12T01:14:04.128513+0000","last_became_active":"2024-09-12T00:02:50.067002+0000","last_became_peered":"2024-09-12T00:02:50.067002+0000","last_unstale":"2024-09-12T01:14:04.128513+0000","last_undegraded":"2024-09-12T01:14:04.128513+0000","last_fullsized":"2024-09-12T01:14:04.128513+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.055428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5247,"num_read_kb":4613,"num_write":1599,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.231834+0000","last_change":"2024-09-12T00:02:37.999935+0000","last_active":"2024-09-12T01:13:28.231834+0000","last_peered":"2024-09-12T01:13:28.231834+0000","last_clean":"2024-09-12T01:13:28.231834+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T01:13:28.231834+0000","last_undegraded":"2024-09-12T01:13:28.231834+0000","last_fullsized":"2024-09-12T01:13:28.231834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:36.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'185","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167361+0000","last_change":"2024-09-12T00:02:48.044496+0000","last_active":"2024-09-12T01:15:48.167361+0000","last_peered":"2024-09-12T01:15:48.167361+0000","last_clean":"2024-09-12T01:15:48.167361+0000","last_became_active":"2024-09-12T00:02:48.044126+0000","last_became_peered":"2024-09-12T00:02:48.044126+0000","last_unstale":"2024-09-12T01:15:48.167361+0000","last_undegraded":"2024-09-12T01:15:48.167361+0000","last_fullsized":"2024-09-12T01:15:48.167361+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:22.117737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4751719,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":400,"num_read_kb":27065,"num_write":781,"num_write_kb":40333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.223592+0000","last_change":"2024-09-12T00:02:52.068671+0000","last_active":"2024-09-12T01:12:13.223592+0000","last_peered":"2024-09-12T01:12:13.223592+0000","last_clean":"2024-09-12T01:12:13.223592+0000","last_became_active":"2024-09-12T00:02:52.068351+0000","last_became_peered":"2024-09-12T00:02:52.068351+0000","last_unstale":"2024-09-12T01:12:13.223592+0000","last_undegraded":"2024-09-12T01:12:13.223592+0000","last_fullsized":"2024-09-12T01:12:13.223592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:00.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'302","reported_seq":1732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.187593+0000","last_change":"2024-09-12T00:02:54.241862+0000","last_active":"2024-09-12T01:15:08.187593+0000","last_peered":"2024-09-12T01:15:08.187593+0000","last_clean":"2024-09-12T01:15:08.187593+0000","last_became_active":"2024-09-12T00:02:54.241581+0000","last_became_peered":"2024-09-12T00:02:54.241581+0000","last_unstale":"2024-09-12T01:15:08.187593+0000","last_undegraded":"2024-09-12T01:15:08.187593+0000","last_fullsized":"2024-09-12T01:15:08.187593+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:51.409146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":254,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235605+0000","last_change":"2024-09-12T00:02:56.081949+0000","last_active":"2024-09-12T01:11:40.235605+0000","last_peered":"2024-09-12T01:11:40.235605+0000","last_clean":"2024-09-12T01:11:40.235605+0000","last_became_active":"2024-09-12T00:02:56.081641+0000","last_became_peered":"2024-09-12T00:02:56.081641+0000","last_unstale":"2024-09-12T01:11:40.235605+0000","last_undegraded":"2024-09-12T01:11:40.235605+0000","last_fullsized":"2024-09-12T01:11:40.235605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:16.553415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'273","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.410516+0000","last_change":"2024-09-12T00:02:58.088758+0000","last_active":"2024-09-12T01:14:04.410516+0000","last_peered":"2024-09-12T01:14:04.410516+0000","last_clean":"2024-09-12T01:14:04.410516+0000","last_became_active":"2024-09-12T00:02:58.088442+0000","last_became_peered":"2024-09-12T00:02:58.088442+0000","last_unstale":"2024-09-12T01:14:04.410516+0000","last_undegraded":"2024-09-12T01:14:04.410516+0000","last_fullsized":"2024-09-12T01:14:04.410516+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:27.430742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":615,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'437","reported_seq":2013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061424+0000","last_change":"2024-09-12T00:03:21.140992+0000","last_active":"2024-09-12T01:13:06.061424+0000","last_peered":"2024-09-12T01:13:06.061424+0000","last_clean":"2024-09-12T01:13:06.061424+0000","last_became_active":"2024-09-12T00:03:21.140691+0000","last_became_peered":"2024-09-12T00:03:21.140691+0000","last_unstale":"2024-09-12T01:13:06.061424+0000","last_undegraded":"2024-09-12T01:13:06.061424+0000","last_fullsized":"2024-09-12T01:13:06.061424+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:09.243706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2439,"num_read_kb":2322,"num_write":494,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.515475+0000","last_change":"2024-09-12T00:02:38.004050+0000","last_active":"2024-09-12T01:13:28.515475+0000","last_peered":"2024-09-12T01:13:28.515475+0000","last_clean":"2024-09-12T01:13:28.515475+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T01:13:28.515475+0000","last_undegraded":"2024-09-12T01:13:28.515475+0000","last_fullsized":"2024-09-12T01:13:28.515475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:14.983821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'207","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.079182+0000","last_change":"2024-09-12T00:02:48.049579+0000","last_active":"2024-09-12T01:15:48.079182+0000","last_peered":"2024-09-12T01:15:48.079182+0000","last_clean":"2024-09-12T01:15:48.079182+0000","last_became_active":"2024-09-12T00:02:48.049260+0000","last_became_peered":"2024-09-12T00:02:48.049260+0000","last_unstale":"2024-09-12T01:15:48.079182+0000","last_undegraded":"2024-09-12T01:15:48.079182+0000","last_fullsized":"2024-09-12T01:15:48.079182+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:34.461974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":103584,"num_write":943,"num_write_kb":20218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.237256+0000","last_change":"2024-09-12T00:02:52.066733+0000","last_active":"2024-09-12T01:11:55.237256+0000","last_peered":"2024-09-12T01:11:55.237256+0000","last_clean":"2024-09-12T01:11:55.237256+0000","last_became_active":"2024-09-12T00:02:52.066289+0000","last_became_peered":"2024-09-12T00:02:52.066289+0000","last_unstale":"2024-09-12T01:11:55.237256+0000","last_undegraded":"2024-09-12T01:11:55.237256+0000","last_fullsized":"2024-09-12T01:11:55.237256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:55.049376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'159","reported_seq":725,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:02.202549+0000","last_change":"2024-09-12T00:02:54.067179+0000","last_active":"2024-09-12T01:15:02.202549+0000","last_peered":"2024-09-12T01:15:02.202549+0000","last_clean":"2024-09-12T01:15:02.202549+0000","last_became_active":"2024-09-12T00:02:54.066864+0000","last_became_peered":"2024-09-12T00:02:54.066864+0000","last_unstale":"2024-09-12T01:15:02.202549+0000","last_undegraded":"2024-09-12T01:15:02.202549+0000","last_fullsized":"2024-09-12T01:15:02.202549+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:34.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":203,"num_read_kb":195,"num_write":150,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.610434+0000","last_change":"2024-09-12T00:02:56.085732+0000","last_active":"2024-09-12T01:12:18.610434+0000","last_peered":"2024-09-12T01:12:18.610434+0000","last_clean":"2024-09-12T01:12:18.610434+0000","last_became_active":"2024-09-12T00:02:56.085437+0000","last_became_peered":"2024-09-12T00:02:56.085437+0000","last_unstale":"2024-09-12T01:12:18.610434+0000","last_undegraded":"2024-09-12T01:12:18.610434+0000","last_fullsized":"2024-09-12T01:12:18.610434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:41.321446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'109","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.524360+0000","last_change":"2024-09-12T00:02:58.095790+0000","last_active":"2024-09-12T01:14:28.524360+0000","last_peered":"2024-09-12T01:14:28.524360+0000","last_clean":"2024-09-12T01:14:28.524360+0000","last_became_active":"2024-09-12T00:02:58.095419+0000","last_became_peered":"2024-09-12T00:02:58.095419+0000","last_unstale":"2024-09-12T01:14:28.524360+0000","last_undegraded":"2024-09-12T01:14:28.524360+0000","last_fullsized":"2024-09-12T01:14:28.524360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":189,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'415","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.241281+0000","last_change":"2024-09-12T00:02:50.075586+0000","last_active":"2024-09-12T01:13:43.241281+0000","last_peered":"2024-09-12T01:13:43.241281+0000","last_clean":"2024-09-12T01:13:43.241281+0000","last_became_active":"2024-09-12T00:02:50.075209+0000","last_became_peered":"2024-09-12T00:02:50.075209+0000","last_unstale":"2024-09-12T01:13:43.241281+0000","last_undegraded":"2024-09-12T01:13:43.241281+0000","last_fullsized":"2024-09-12T01:13:43.241281+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:32.991455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2214,"num_read_kb":2093,"num_write":483,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'191","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.259489+0000","last_change":"2024-09-12T00:02:48.054875+0000","last_active":"2024-09-12T01:15:48.259489+0000","last_peered":"2024-09-12T01:15:48.259489+0000","last_clean":"2024-09-12T01:15:48.259489+0000","last_became_active":"2024-09-12T00:02:48.052751+0000","last_became_peered":"2024-09-12T00:02:48.052751+0000","last_unstale":"2024-09-12T01:15:48.259489+0000","last_undegraded":"2024-09-12T01:15:48.259489+0000","last_fullsized":"2024-09-12T01:15:48.259489+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493417,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":26295,"num_write":910,"num_write_kb":36863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.239685+0000","last_change":"2024-09-12T00:02:38.007657+0000","last_active":"2024-09-12T01:13:28.239685+0000","last_peered":"2024-09-12T01:13:28.239685+0000","last_clean":"2024-09-12T01:13:28.239685+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T01:13:28.239685+0000","last_undegraded":"2024-09-12T01:13:28.239685+0000","last_fullsized":"2024-09-12T01:13:28.239685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:40.382288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235592+0000","last_change":"2024-09-12T00:02:52.067482+0000","last_active":"2024-09-12T01:11:40.235592+0000","last_peered":"2024-09-12T01:11:40.235592+0000","last_clean":"2024-09-12T01:11:40.235592+0000","last_became_active":"2024-09-12T00:02:52.067200+0000","last_became_peered":"2024-09-12T00:02:52.067200+0000","last_unstale":"2024-09-12T01:11:40.235592+0000","last_undegraded":"2024-09-12T01:11:40.235592+0000","last_fullsized":"2024-09-12T01:11:40.235592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:28.955322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'299","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.870818+0000","last_change":"2024-09-12T00:02:54.069403+0000","last_active":"2024-09-12T01:15:10.870818+0000","last_peered":"2024-09-12T01:15:10.870818+0000","last_clean":"2024-09-12T01:15:10.870818+0000","last_became_active":"2024-09-12T00:02:54.069071+0000","last_became_peered":"2024-09-12T00:02:54.069071+0000","last_unstale":"2024-09-12T01:15:10.870818+0000","last_undegraded":"2024-09-12T01:15:10.870818+0000","last_fullsized":"2024-09-12T01:15:10.870818+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:01.293660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":432,"num_read_kb":552,"num_write":250,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.387679+0000","last_change":"2024-09-12T00:02:56.082353+0000","last_active":"2024-09-12T01:11:43.387679+0000","last_peered":"2024-09-12T01:11:43.387679+0000","last_clean":"2024-09-12T01:11:43.387679+0000","last_became_active":"2024-09-12T00:02:56.082046+0000","last_became_peered":"2024-09-12T00:02:56.082046+0000","last_unstale":"2024-09-12T01:11:43.387679+0000","last_undegraded":"2024-09-12T01:11:43.387679+0000","last_fullsized":"2024-09-12T01:11:43.387679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:22.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'163","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.352871+0000","last_change":"2024-09-12T00:02:58.091879+0000","last_active":"2024-09-12T01:14:00.352871+0000","last_peered":"2024-09-12T01:14:00.352871+0000","last_clean":"2024-09-12T01:14:00.352871+0000","last_became_active":"2024-09-12T00:02:58.091590+0000","last_became_peered":"2024-09-12T00:02:58.091590+0000","last_unstale":"2024-09-12T01:14:00.352871+0000","last_undegraded":"2024-09-12T01:14:00.352871+0000","last_fullsized":"2024-09-12T01:14:00.352871+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:04.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1150,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":174,"num_write":425,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'450","reported_seq":1993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249513+0000","last_change":"2024-09-12T00:02:50.073492+0000","last_active":"2024-09-12T01:13:40.249513+0000","last_peered":"2024-09-12T01:13:40.249513+0000","last_clean":"2024-09-12T01:13:40.249513+0000","last_became_active":"2024-09-12T00:02:50.073262+0000","last_became_peered":"2024-09-12T00:02:50.073262+0000","last_unstale":"2024-09-12T01:13:40.249513+0000","last_undegraded":"2024-09-12T01:13:40.249513+0000","last_fullsized":"2024-09-12T01:13:40.249513+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.830556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2298,"num_read_kb":2165,"num_write":516,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'158","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.234561+0000","last_change":"2024-09-12T00:02:48.053125+0000","last_active":"2024-09-12T01:15:48.234561+0000","last_peered":"2024-09-12T01:15:48.234561+0000","last_clean":"2024-09-12T01:15:48.234561+0000","last_became_active":"2024-09-12T00:02:48.052768+0000","last_became_peered":"2024-09-12T00:02:48.052768+0000","last_unstale":"2024-09-12T01:15:48.234561+0000","last_undegraded":"2024-09-12T01:15:48.234561+0000","last_fullsized":"2024-09-12T01:15:48.234561+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:37.886716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3687654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":16851,"num_write":770,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.405106+0000","last_change":"2024-09-12T00:02:37.999991+0000","last_active":"2024-09-12T01:13:38.405106+0000","last_peered":"2024-09-12T01:13:38.405106+0000","last_clean":"2024-09-12T01:13:38.405106+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T01:13:38.405106+0000","last_undegraded":"2024-09-12T01:13:38.405106+0000","last_fullsized":"2024-09-12T01:13:38.405106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622249+0000","last_change":"2024-09-12T00:02:52.069738+0000","last_active":"2024-09-12T01:13:43.622249+0000","last_peered":"2024-09-12T01:13:43.622249+0000","last_clean":"2024-09-12T01:13:43.622249+0000","last_became_active":"2024-09-12T00:02:52.069469+0000","last_became_peered":"2024-09-12T00:02:52.069469+0000","last_unstale":"2024-09-12T01:13:43.622249+0000","last_undegraded":"2024-09-12T01:13:43.622249+0000","last_fullsized":"2024-09-12T01:13:43.622249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:53.012401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'259","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.188900+0000","last_change":"2024-09-12T00:02:54.240228+0000","last_active":"2024-09-12T01:14:02.188900+0000","last_peered":"2024-09-12T01:14:02.188900+0000","last_clean":"2024-09-12T01:14:02.188900+0000","last_became_active":"2024-09-12T00:02:54.239879+0000","last_became_peered":"2024-09-12T00:02:54.239879+0000","last_unstale":"2024-09-12T01:14:02.188900+0000","last_undegraded":"2024-09-12T01:14:02.188900+0000","last_fullsized":"2024-09-12T01:14:02.188900+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:03.113532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":332,"num_read_kb":322,"num_write":304,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'793","reported_seq":5263,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.252240+0000","last_change":"2024-09-12T00:02:56.087559+0000","last_active":"2024-09-12T01:15:48.252240+0000","last_peered":"2024-09-12T01:15:48.252240+0000","last_clean":"2024-09-12T01:15:48.252240+0000","last_became_active":"2024-09-12T00:02:56.086704+0000","last_became_peered":"2024-09-12T00:02:56.086704+0000","last_unstale":"2024-09-12T01:15:48.252240+0000","last_undegraded":"2024-09-12T01:15:48.252240+0000","last_fullsized":"2024-09-12T01:15:48.252240+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:41.420237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'152","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.251702+0000","last_change":"2024-09-12T00:02:58.091748+0000","last_active":"2024-09-12T01:15:08.251702+0000","last_peered":"2024-09-12T01:15:08.251702+0000","last_clean":"2024-09-12T01:15:08.251702+0000","last_became_active":"2024-09-12T00:02:58.091466+0000","last_became_peered":"2024-09-12T00:02:58.091466+0000","last_unstale":"2024-09-12T01:15:08.251702+0000","last_undegraded":"2024-09-12T01:15:08.251702+0000","last_fullsized":"2024-09-12T01:15:08.251702+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":335,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'989","reported_seq":2652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.864836+0000","last_change":"2024-09-12T00:02:50.068181+0000","last_active":"2024-09-12T01:13:20.864836+0000","last_peered":"2024-09-12T01:13:20.864836+0000","last_clean":"2024-09-12T01:13:20.864836+0000","last_became_active":"2024-09-12T00:02:50.067868+0000","last_became_peered":"2024-09-12T00:02:50.067868+0000","last_unstale":"2024-09-12T01:13:20.864836+0000","last_undegraded":"2024-09-12T01:13:20.864836+0000","last_fullsized":"2024-09-12T01:13:20.864836+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":900,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:02.445799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4764,"num_read_kb":4246,"num_write":1341,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'173","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.244938+0000","last_change":"2024-09-12T00:02:48.052760+0000","last_active":"2024-09-12T01:14:18.244938+0000","last_peered":"2024-09-12T01:14:18.244938+0000","last_clean":"2024-09-12T01:14:18.244938+0000","last_became_active":"2024-09-12T00:02:48.052431+0000","last_became_peered":"2024-09-12T00:02:48.052431+0000","last_unstale":"2024-09-12T01:14:18.244938+0000","last_undegraded":"2024-09-12T01:14:18.244938+0000","last_fullsized":"2024-09-12T01:14:18.244938+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:51.003972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1212092,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":121623,"num_write":831,"num_write_kb":33084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229731+0000","last_change":"2024-09-12T00:02:38.007684+0000","last_active":"2024-09-12T01:11:58.229731+0000","last_peered":"2024-09-12T01:11:58.229731+0000","last_clean":"2024-09-12T01:11:58.229731+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T01:11:58.229731+0000","last_undegraded":"2024-09-12T01:11:58.229731+0000","last_fullsized":"2024-09-12T01:11:58.229731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.596959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257884+0000","last_change":"2024-09-12T00:02:52.062924+0000","last_active":"2024-09-12T01:13:43.257884+0000","last_peered":"2024-09-12T01:13:43.257884+0000","last_clean":"2024-09-12T01:13:43.257884+0000","last_became_active":"2024-09-12T00:02:52.062631+0000","last_became_peered":"2024-09-12T00:02:52.062631+0000","last_unstale":"2024-09-12T01:13:43.257884+0000","last_undegraded":"2024-09-12T01:13:43.257884+0000","last_fullsized":"2024-09-12T01:13:43.257884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:03.938023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'137","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257905+0000","last_change":"2024-09-12T00:02:54.069239+0000","last_active":"2024-09-12T01:13:43.257905+0000","last_peered":"2024-09-12T01:13:43.257905+0000","last_clean":"2024-09-12T01:13:43.257905+0000","last_became_active":"2024-09-12T00:02:54.068812+0000","last_became_peered":"2024-09-12T00:02:54.068812+0000","last_unstale":"2024-09-12T01:13:43.257905+0000","last_undegraded":"2024-09-12T01:13:43.257905+0000","last_fullsized":"2024-09-12T01:13:43.257905+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:58.060604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":169,"num_write":118,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'807","reported_seq":2608,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.959102+0000","last_change":"2024-09-12T00:02:56.084227+0000","last_active":"2024-09-12T01:15:47.959102+0000","last_peered":"2024-09-12T01:15:47.959102+0000","last_clean":"2024-09-12T01:15:47.959102+0000","last_became_active":"2024-09-12T00:02:56.083894+0000","last_became_peered":"2024-09-12T00:02:56.083894+0000","last_unstale":"2024-09-12T01:15:47.959102+0000","last_undegraded":"2024-09-12T01:15:47.959102+0000","last_fullsized":"2024-09-12T01:15:47.959102+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:40.096034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'273","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242702+0000","last_change":"2024-09-12T00:02:58.093731+0000","last_active":"2024-09-12T01:12:45.242702+0000","last_peered":"2024-09-12T01:12:45.242702+0000","last_clean":"2024-09-12T01:12:45.242702+0000","last_became_active":"2024-09-12T00:02:58.093442+0000","last_became_peered":"2024-09-12T00:02:58.093442+0000","last_unstale":"2024-09-12T01:12:45.242702+0000","last_undegraded":"2024-09-12T01:12:45.242702+0000","last_fullsized":"2024-09-12T01:12:45.242702+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:58.495113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":340,"num_read_kb":339,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'411","reported_seq":1918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956504+0000","last_change":"2024-09-12T00:02:50.058382+0000","last_active":"2024-09-12T01:14:02.956504+0000","last_peered":"2024-09-12T01:14:02.956504+0000","last_clean":"2024-09-12T01:14:02.956504+0000","last_became_active":"2024-09-12T00:02:50.057999+0000","last_became_peered":"2024-09-12T00:02:50.057999+0000","last_unstale":"2024-09-12T01:14:02.956504+0000","last_undegraded":"2024-09-12T01:14:02.956504+0000","last_fullsized":"2024-09-12T01:14:02.956504+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:37.001555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2267,"num_read_kb":2133,"num_write":493,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'268","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:46.122696+0000","last_change":"2024-09-12T00:02:48.051832+0000","last_active":"2024-09-12T01:13:46.122696+0000","last_peered":"2024-09-12T01:13:46.122696+0000","last_clean":"2024-09-12T01:13:46.122696+0000","last_became_active":"2024-09-12T00:02:48.051495+0000","last_became_peered":"2024-09-12T00:02:48.051495+0000","last_unstale":"2024-09-12T01:13:46.122696+0000","last_undegraded":"2024-09-12T01:13:46.122696+0000","last_fullsized":"2024-09-12T01:13:46.122696+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:15.411092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864181,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":668,"num_read_kb":18611,"num_write":1218,"num_write_kb":43211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607868+0000","last_change":"2024-09-12T00:02:38.760426+0000","last_active":"2024-09-12T01:11:58.607868+0000","last_peered":"2024-09-12T01:11:58.607868+0000","last_clean":"2024-09-12T01:11:58.607868+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T01:11:58.607868+0000","last_undegraded":"2024-09-12T01:11:58.607868+0000","last_fullsized":"2024-09-12T01:11:58.607868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:03.698275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455282+0000","last_change":"2024-09-12T00:02:52.062908+0000","last_active":"2024-09-12T01:12:58.455282+0000","last_peered":"2024-09-12T01:12:58.455282+0000","last_clean":"2024-09-12T01:12:58.455282+0000","last_became_active":"2024-09-12T00:02:52.062544+0000","last_became_peered":"2024-09-12T00:02:52.062544+0000","last_unstale":"2024-09-12T01:12:58.455282+0000","last_undegraded":"2024-09-12T01:12:58.455282+0000","last_fullsized":"2024-09-12T01:12:58.455282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:54.138905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'358","reported_seq":1105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.290569+0000","last_change":"2024-09-12T00:02:54.239678+0000","last_active":"2024-09-12T01:15:48.290569+0000","last_peered":"2024-09-12T01:15:48.290569+0000","last_clean":"2024-09-12T01:15:48.290569+0000","last_became_active":"2024-09-12T00:02:54.239355+0000","last_became_peered":"2024-09-12T00:02:54.239355+0000","last_unstale":"2024-09-12T01:15:48.290569+0000","last_undegraded":"2024-09-12T01:15:48.290569+0000","last_fullsized":"2024-09-12T01:15:48.290569+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:10.540534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":736,"num_write":272,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.446391+0000","last_change":"2024-09-12T00:02:56.087894+0000","last_active":"2024-09-12T01:11:43.446391+0000","last_peered":"2024-09-12T01:11:43.446391+0000","last_clean":"2024-09-12T01:11:43.446391+0000","last_became_active":"2024-09-12T00:02:56.087448+0000","last_became_peered":"2024-09-12T00:02:56.087448+0000","last_unstale":"2024-09-12T01:11:43.446391+0000","last_undegraded":"2024-09-12T01:11:43.446391+0000","last_fullsized":"2024-09-12T01:11:43.446391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:19.357528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'125","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.291357+0000","last_change":"2024-09-12T00:02:58.100159+0000","last_active":"2024-09-12T01:12:58.291357+0000","last_peered":"2024-09-12T01:12:58.291357+0000","last_clean":"2024-09-12T01:12:58.291357+0000","last_became_active":"2024-09-12T00:02:58.099906+0000","last_became_peered":"2024-09-12T00:02:58.099906+0000","last_unstale":"2024-09-12T01:12:58.291357+0000","last_undegraded":"2024-09-12T01:12:58.291357+0000","last_fullsized":"2024-09-12T01:12:58.291357+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:36.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":140,"num_write":299,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'130","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.571352+0000","last_change":"2024-09-12T00:02:58.099964+0000","last_active":"2024-09-12T01:15:09.571352+0000","last_peered":"2024-09-12T01:15:09.571352+0000","last_clean":"2024-09-12T01:15:09.571352+0000","last_became_active":"2024-09-12T00:02:58.099564+0000","last_became_peered":"2024-09-12T00:02:58.099564+0000","last_unstale":"2024-09-12T01:15:09.571352+0000","last_undegraded":"2024-09-12T01:15:09.571352+0000","last_fullsized":"2024-09-12T01:15:09.571352+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:10.174347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":201,"num_write":295,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'827","reported_seq":2372,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.862987+0000","last_change":"2024-09-12T00:02:50.064386+0000","last_active":"2024-09-12T01:13:20.862987+0000","last_peered":"2024-09-12T01:13:20.862987+0000","last_clean":"2024-09-12T01:13:20.862987+0000","last_became_active":"2024-09-12T00:02:50.063351+0000","last_became_peered":"2024-09-12T00:02:50.063351+0000","last_unstale":"2024-09-12T01:13:20.862987+0000","last_undegraded":"2024-09-12T01:13:20.862987+0000","last_fullsized":"2024-09-12T01:13:20.862987+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:44.265606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3851,"num_read_kb":3457,"num_write":1080,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'158","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.079218+0000","last_change":"2024-09-12T00:02:48.048545+0000","last_active":"2024-09-12T01:15:48.079218+0000","last_peered":"2024-09-12T01:15:48.079218+0000","last_clean":"2024-09-12T01:15:48.079218+0000","last_became_active":"2024-09-12T00:02:48.047723+0000","last_became_peered":"2024-09-12T00:02:48.047723+0000","last_unstale":"2024-09-12T01:15:48.079218+0000","last_undegraded":"2024-09-12T01:15:48.079218+0000","last_fullsized":"2024-09-12T01:15:48.079218+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:13.827704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":26182,"num_write":818,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.235888+0000","last_change":"2024-09-12T00:02:52.067136+0000","last_active":"2024-09-12T01:12:53.235888+0000","last_peered":"2024-09-12T01:12:53.235888+0000","last_clean":"2024-09-12T01:12:53.235888+0000","last_became_active":"2024-09-12T00:02:52.066702+0000","last_became_peered":"2024-09-12T00:02:52.066702+0000","last_unstale":"2024-09-12T01:12:53.235888+0000","last_undegraded":"2024-09-12T01:12:53.235888+0000","last_fullsized":"2024-09-12T01:12:53.235888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:51.618720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'196","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.171053+0000","last_change":"2024-09-12T00:02:54.067156+0000","last_active":"2024-09-12T01:15:48.171053+0000","last_peered":"2024-09-12T01:15:48.171053+0000","last_clean":"2024-09-12T01:15:48.171053+0000","last_became_active":"2024-09-12T00:02:54.066679+0000","last_became_peered":"2024-09-12T00:02:54.066679+0000","last_unstale":"2024-09-12T01:15:48.171053+0000","last_undegraded":"2024-09-12T01:15:48.171053+0000","last_fullsized":"2024-09-12T01:15:48.171053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:44.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":343,"num_write":152,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455258+0000","last_change":"2024-09-12T00:02:56.081781+0000","last_active":"2024-09-12T01:12:58.455258+0000","last_peered":"2024-09-12T01:12:58.455258+0000","last_clean":"2024-09-12T01:12:58.455258+0000","last_became_active":"2024-09-12T00:02:56.081445+0000","last_became_peered":"2024-09-12T00:02:56.081445+0000","last_unstale":"2024-09-12T01:12:58.455258+0000","last_undegraded":"2024-09-12T01:12:58.455258+0000","last_fullsized":"2024-09-12T01:12:58.455258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.185278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'151","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.456004+0000","last_change":"2024-09-12T00:02:58.097284+0000","last_active":"2024-09-12T01:13:03.456004+0000","last_peered":"2024-09-12T01:13:03.456004+0000","last_clean":"2024-09-12T01:13:03.456004+0000","last_became_active":"2024-09-12T00:02:58.096979+0000","last_became_peered":"2024-09-12T00:02:58.096979+0000","last_unstale":"2024-09-12T01:13:03.456004+0000","last_undegraded":"2024-09-12T01:13:03.456004+0000","last_fullsized":"2024-09-12T01:13:03.456004+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:10.194576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":142,"num_write":377,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'428","reported_seq":1977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.278516+0000","last_change":"2024-09-12T00:02:50.066578+0000","last_active":"2024-09-12T01:13:32.278516+0000","last_peered":"2024-09-12T01:13:32.278516+0000","last_clean":"2024-09-12T01:13:32.278516+0000","last_became_active":"2024-09-12T00:02:50.065307+0000","last_became_peered":"2024-09-12T00:02:50.065307+0000","last_unstale":"2024-09-12T01:13:32.278516+0000","last_undegraded":"2024-09-12T01:13:32.278516+0000","last_fullsized":"2024-09-12T01:13:32.278516+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:31.996369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2299,"num_read_kb":2174,"num_write":505,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'162","reported_seq":774,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.163753+0000","last_change":"2024-09-12T00:02:48.051718+0000","last_active":"2024-09-12T01:15:48.163753+0000","last_peered":"2024-09-12T01:15:48.163753+0000","last_clean":"2024-09-12T01:15:48.163753+0000","last_became_active":"2024-09-12T00:02:48.048506+0000","last_became_peered":"2024-09-12T00:02:48.048506+0000","last_unstale":"2024-09-12T01:15:48.163753+0000","last_undegraded":"2024-09-12T01:15:48.163753+0000","last_fullsized":"2024-09-12T01:15:48.163753+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:49.124459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":321,"num_read_kb":61867,"num_write":777,"num_write_kb":44911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.454749+0000","last_change":"2024-09-12T00:02:52.065265+0000","last_active":"2024-09-12T01:12:53.454749+0000","last_peered":"2024-09-12T01:12:53.454749+0000","last_clean":"2024-09-12T01:12:53.454749+0000","last_became_active":"2024-09-12T00:02:52.064967+0000","last_became_peered":"2024-09-12T00:02:52.064967+0000","last_unstale":"2024-09-12T01:12:53.454749+0000","last_undegraded":"2024-09-12T01:12:53.454749+0000","last_fullsized":"2024-09-12T01:12:53.454749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.210086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'59","reported_seq":576,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.171183+0000","last_change":"2024-09-12T00:02:54.067540+0000","last_active":"2024-09-12T01:13:29.171183+0000","last_peered":"2024-09-12T01:13:29.171183+0000","last_clean":"2024-09-12T01:13:29.171183+0000","last_became_active":"2024-09-12T00:02:54.067255+0000","last_became_peered":"2024-09-12T00:02:54.067255+0000","last_unstale":"2024-09-12T01:13:29.171183+0000","last_undegraded":"2024-09-12T01:13:29.171183+0000","last_fullsized":"2024-09-12T01:13:29.171183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:18.453952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399626+0000","last_change":"2024-09-12T00:02:56.079344+0000","last_active":"2024-09-12T01:12:58.399626+0000","last_peered":"2024-09-12T01:12:58.399626+0000","last_clean":"2024-09-12T01:12:58.399626+0000","last_became_active":"2024-09-12T00:02:56.079057+0000","last_became_peered":"2024-09-12T00:02:56.079057+0000","last_unstale":"2024-09-12T01:12:58.399626+0000","last_undegraded":"2024-09-12T01:12:58.399626+0000","last_fullsized":"2024-09-12T01:12:58.399626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:17.425376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'185","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.012822+0000","last_change":"2024-09-12T00:02:58.091784+0000","last_active":"2024-09-12T01:14:03.012822+0000","last_peered":"2024-09-12T01:14:03.012822+0000","last_clean":"2024-09-12T01:14:03.012822+0000","last_became_active":"2024-09-12T00:02:58.091505+0000","last_became_peered":"2024-09-12T00:02:58.091505+0000","last_unstale":"2024-09-12T01:14:03.012822+0000","last_undegraded":"2024-09-12T01:14:03.012822+0000","last_fullsized":"2024-09-12T01:14:03.012822+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:32.965615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":268,"num_read_kb":263,"num_write":396,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'443","reported_seq":1915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.057934+0000","last_change":"2024-09-12T00:02:50.068429+0000","last_active":"2024-09-12T01:13:06.057934+0000","last_peered":"2024-09-12T01:13:06.057934+0000","last_clean":"2024-09-12T01:13:06.057934+0000","last_became_active":"2024-09-12T00:02:50.068129+0000","last_became_peered":"2024-09-12T00:02:50.068129+0000","last_unstale":"2024-09-12T01:13:06.057934+0000","last_undegraded":"2024-09-12T01:13:06.057934+0000","last_fullsized":"2024-09-12T01:13:06.057934+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:38.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2203,"num_read_kb":2070,"num_write":514,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'206","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.261460+0000","last_change":"2024-09-12T00:02:48.050120+0000","last_active":"2024-09-12T01:15:48.261460+0000","last_peered":"2024-09-12T01:15:48.261460+0000","last_clean":"2024-09-12T01:15:48.261460+0000","last_became_active":"2024-09-12T00:02:48.049791+0000","last_became_peered":"2024-09-12T00:02:48.049791+0000","last_unstale":"2024-09-12T01:15:48.261460+0000","last_undegraded":"2024-09-12T01:15:48.261460+0000","last_fullsized":"2024-09-12T01:15:48.261460+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:02.402223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":116478,"num_write":1001,"num_write_kb":35286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398938+0000","last_change":"2024-09-12T00:02:52.071771+0000","last_active":"2024-09-12T01:12:53.398938+0000","last_peered":"2024-09-12T01:12:53.398938+0000","last_clean":"2024-09-12T01:12:53.398938+0000","last_became_active":"2024-09-12T00:02:52.071502+0000","last_became_peered":"2024-09-12T00:02:52.071502+0000","last_unstale":"2024-09-12T01:12:53.398938+0000","last_undegraded":"2024-09-12T01:12:53.398938+0000","last_fullsized":"2024-09-12T01:12:53.398938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:36.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'203","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.061053+0000","last_change":"2024-09-12T00:02:54.069300+0000","last_active":"2024-09-12T01:15:48.061053+0000","last_peered":"2024-09-12T01:15:48.061053+0000","last_clean":"2024-09-12T01:15:48.061053+0000","last_became_active":"2024-09-12T00:02:54.067314+0000","last_became_peered":"2024-09-12T00:02:54.067314+0000","last_unstale":"2024-09-12T01:15:48.061053+0000","last_undegraded":"2024-09-12T01:15:48.061053+0000","last_fullsized":"2024-09-12T01:15:48.061053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:25.593409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18955,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":388,"num_write":160,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616059+0000","last_change":"2024-09-12T00:02:56.084951+0000","last_active":"2024-09-12T01:12:58.616059+0000","last_peered":"2024-09-12T01:12:58.616059+0000","last_clean":"2024-09-12T01:12:58.616059+0000","last_became_active":"2024-09-12T00:02:56.084651+0000","last_became_peered":"2024-09-12T00:02:56.084651+0000","last_unstale":"2024-09-12T01:12:58.616059+0000","last_undegraded":"2024-09-12T01:12:58.616059+0000","last_fullsized":"2024-09-12T01:12:58.616059+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.763159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'155","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:05.706621+0000","last_change":"2024-09-12T00:02:58.100001+0000","last_active":"2024-09-12T01:13:05.706621+0000","last_peered":"2024-09-12T01:13:05.706621+0000","last_clean":"2024-09-12T01:13:05.706621+0000","last_became_active":"2024-09-12T00:02:58.099635+0000","last_became_peered":"2024-09-12T00:02:58.099635+0000","last_unstale":"2024-09-12T01:13:05.706621+0000","last_undegraded":"2024-09-12T01:13:05.706621+0000","last_fullsized":"2024-09-12T01:13:05.706621+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":359,"num_read_kb":309,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'637","reported_seq":2521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749291+0000","last_change":"2024-09-12T00:02:50.068821+0000","last_active":"2024-09-12T01:15:09.749291+0000","last_peered":"2024-09-12T01:15:09.749291+0000","last_clean":"2024-09-12T01:15:09.749291+0000","last_became_active":"2024-09-12T00:02:50.068518+0000","last_became_peered":"2024-09-12T00:02:50.068518+0000","last_unstale":"2024-09-12T01:15:09.749291+0000","last_undegraded":"2024-09-12T01:15:09.749291+0000","last_fullsized":"2024-09-12T01:15:09.749291+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:48.137188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3685,"num_read_kb":3433,"num_write":846,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'192","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.244021+0000","last_change":"2024-09-12T00:02:48.055024+0000","last_active":"2024-09-12T01:12:55.244021+0000","last_peered":"2024-09-12T01:12:55.244021+0000","last_clean":"2024-09-12T01:12:55.244021+0000","last_became_active":"2024-09-12T00:02:48.054056+0000","last_became_peered":"2024-09-12T00:02:48.054056+0000","last_unstale":"2024-09-12T01:12:55.244021+0000","last_undegraded":"2024-09-12T01:12:55.244021+0000","last_fullsized":"2024-09-12T01:12:55.244021+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:26.535088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":523085,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":463,"num_read_kb":69874,"num_write":895,"num_write_kb":25144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.615384+0000","last_change":"2024-09-12T00:02:52.064704+0000","last_active":"2024-09-12T01:12:53.615384+0000","last_peered":"2024-09-12T01:12:53.615384+0000","last_clean":"2024-09-12T01:12:53.615384+0000","last_became_active":"2024-09-12T00:02:52.064441+0000","last_became_peered":"2024-09-12T00:02:52.064441+0000","last_unstale":"2024-09-12T01:12:53.615384+0000","last_undegraded":"2024-09-12T01:12:53.615384+0000","last_fullsized":"2024-09-12T01:12:53.615384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:59.801795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'141","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.035158+0000","last_change":"2024-09-12T00:02:54.067331+0000","last_active":"2024-09-12T01:15:48.035158+0000","last_peered":"2024-09-12T01:15:48.035158+0000","last_clean":"2024-09-12T01:15:48.035158+0000","last_became_active":"2024-09-12T00:02:54.066900+0000","last_became_peered":"2024-09-12T00:02:54.066900+0000","last_unstale":"2024-09-12T01:15:48.035158+0000","last_undegraded":"2024-09-12T01:15:48.035158+0000","last_fullsized":"2024-09-12T01:15:48.035158+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:20.920036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243955+0000","last_change":"2024-09-12T00:02:56.085678+0000","last_active":"2024-09-12T01:12:55.243955+0000","last_peered":"2024-09-12T01:12:55.243955+0000","last_clean":"2024-09-12T01:12:55.243955+0000","last_became_active":"2024-09-12T00:02:56.084454+0000","last_became_peered":"2024-09-12T00:02:56.084454+0000","last_unstale":"2024-09-12T01:12:55.243955+0000","last_undegraded":"2024-09-12T01:12:55.243955+0000","last_fullsized":"2024-09-12T01:12:55.243955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.942660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'810","reported_seq":2284,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128303+0000","last_change":"2024-09-12T00:02:50.072883+0000","last_active":"2024-09-12T01:14:04.128303+0000","last_peered":"2024-09-12T01:14:04.128303+0000","last_clean":"2024-09-12T01:14:04.128303+0000","last_became_active":"2024-09-12T00:02:50.072570+0000","last_became_peered":"2024-09-12T00:02:50.072570+0000","last_unstale":"2024-09-12T01:14:04.128303+0000","last_undegraded":"2024-09-12T01:14:04.128303+0000","last_fullsized":"2024-09-12T01:14:04.128303+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:59.471970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3795,"num_read_kb":3393,"num_write":1092,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'152","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.115853+0000","last_change":"2024-09-12T00:02:48.050380+0000","last_active":"2024-09-12T01:15:48.115853+0000","last_peered":"2024-09-12T01:15:48.115853+0000","last_clean":"2024-09-12T01:15:48.115853+0000","last_became_active":"2024-09-12T00:02:48.050025+0000","last_became_peered":"2024-09-12T00:02:48.050025+0000","last_unstale":"2024-09-12T01:15:48.115853+0000","last_undegraded":"2024-09-12T01:15:48.115853+0000","last_fullsized":"2024-09-12T01:15:48.115853+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:32.062297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":278,"num_read_kb":9330,"num_write":746,"num_write_kb":34876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:10.245905+0000","last_change":"2024-09-12T00:02:52.071470+0000","last_active":"2024-09-12T01:13:10.245905+0000","last_peered":"2024-09-12T01:13:10.245905+0000","last_clean":"2024-09-12T01:13:10.245905+0000","last_became_active":"2024-09-12T00:02:52.071201+0000","last_became_peered":"2024-09-12T00:02:52.071201+0000","last_unstale":"2024-09-12T01:13:10.245905+0000","last_undegraded":"2024-09-12T01:13:10.245905+0000","last_fullsized":"2024-09-12T01:13:10.245905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.887009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'225","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.215655+0000","last_change":"2024-09-12T00:02:54.073975+0000","last_active":"2024-09-12T01:15:48.215655+0000","last_peered":"2024-09-12T01:15:48.215655+0000","last_clean":"2024-09-12T01:15:48.215655+0000","last_became_active":"2024-09-12T00:02:54.073541+0000","last_became_peered":"2024-09-12T00:02:54.073541+0000","last_unstale":"2024-09-12T01:15:48.215655+0000","last_undegraded":"2024-09-12T01:15:48.215655+0000","last_fullsized":"2024-09-12T01:15:48.215655+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.658572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15168,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":358,"num_read_kb":528,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510916+0000","last_change":"2024-09-12T00:02:56.084926+0000","last_active":"2024-09-12T01:12:58.510916+0000","last_peered":"2024-09-12T01:12:58.510916+0000","last_clean":"2024-09-12T01:12:58.510916+0000","last_became_active":"2024-09-12T00:02:56.084627+0000","last_became_peered":"2024-09-12T00:02:56.084627+0000","last_unstale":"2024-09-12T01:12:58.510916+0000","last_undegraded":"2024-09-12T01:12:58.510916+0000","last_fullsized":"2024-09-12T01:12:58.510916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:48.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'184","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.259373+0000","last_change":"2024-09-12T00:02:58.090856+0000","last_active":"2024-09-12T01:14:04.259373+0000","last_peered":"2024-09-12T01:14:04.259373+0000","last_clean":"2024-09-12T01:14:04.259373+0000","last_became_active":"2024-09-12T00:02:58.089750+0000","last_became_peered":"2024-09-12T00:02:58.089750+0000","last_unstale":"2024-09-12T01:14:04.259373+0000","last_undegraded":"2024-09-12T01:14:04.259373+0000","last_fullsized":"2024-09-12T01:14:04.259373+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:39.825708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":234,"num_read_kb":235,"num_write":422,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'478","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.723839+0000","last_change":"2024-09-12T00:02:50.064457+0000","last_active":"2024-09-12T01:15:09.723839+0000","last_peered":"2024-09-12T01:15:09.723839+0000","last_clean":"2024-09-12T01:15:09.723839+0000","last_became_active":"2024-09-12T00:02:50.064157+0000","last_became_peered":"2024-09-12T00:02:50.064157+0000","last_unstale":"2024-09-12T01:15:09.723839+0000","last_undegraded":"2024-09-12T01:15:09.723839+0000","last_fullsized":"2024-09-12T01:15:09.723839+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:29.208142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2183,"num_write":585,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'252","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041430+0000","last_change":"2024-09-12T00:02:48.053735+0000","last_active":"2024-09-12T01:15:48.041430+0000","last_peered":"2024-09-12T01:15:48.041430+0000","last_clean":"2024-09-12T01:15:48.041430+0000","last_became_active":"2024-09-12T00:02:48.053055+0000","last_became_peered":"2024-09-12T00:02:48.053055+0000","last_unstale":"2024-09-12T01:15:48.041430+0000","last_undegraded":"2024-09-12T01:15:48.041430+0000","last_fullsized":"2024-09-12T01:15:48.041430+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:59.588429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":662,"num_read_kb":2689,"num_write":1334,"num_write_kb":25481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622306+0000","last_change":"2024-09-12T00:02:52.060376+0000","last_active":"2024-09-12T01:13:43.622306+0000","last_peered":"2024-09-12T01:13:43.622306+0000","last_clean":"2024-09-12T01:13:43.622306+0000","last_became_active":"2024-09-12T00:02:52.060034+0000","last_became_peered":"2024-09-12T00:02:52.060034+0000","last_unstale":"2024-09-12T01:13:43.622306+0000","last_undegraded":"2024-09-12T01:13:43.622306+0000","last_fullsized":"2024-09-12T01:13:43.622306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.319586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'197","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.045639+0000","last_change":"2024-09-12T00:02:54.067256+0000","last_active":"2024-09-12T01:15:48.045639+0000","last_peered":"2024-09-12T01:15:48.045639+0000","last_clean":"2024-09-12T01:15:48.045639+0000","last_became_active":"2024-09-12T00:02:54.066854+0000","last_became_peered":"2024-09-12T00:02:54.066854+0000","last_unstale":"2024-09-12T01:15:48.045639+0000","last_undegraded":"2024-09-12T01:15:48.045639+0000","last_fullsized":"2024-09-12T01:15:48.045639+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:56.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":290,"num_read_kb":407,"num_write":194,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.236453+0000","last_change":"2024-09-12T00:02:56.086661+0000","last_active":"2024-09-12T01:12:58.236453+0000","last_peered":"2024-09-12T01:12:58.236453+0000","last_clean":"2024-09-12T01:12:58.236453+0000","last_became_active":"2024-09-12T00:02:56.086349+0000","last_became_peered":"2024-09-12T00:02:56.086349+0000","last_unstale":"2024-09-12T01:12:58.236453+0000","last_undegraded":"2024-09-12T01:12:58.236453+0000","last_fullsized":"2024-09-12T01:12:58.236453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:32.352621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'169","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.265206+0000","last_change":"2024-09-12T00:02:58.100935+0000","last_active":"2024-09-12T01:14:04.265206+0000","last_peered":"2024-09-12T01:14:04.265206+0000","last_clean":"2024-09-12T01:14:04.265206+0000","last_became_active":"2024-09-12T00:02:58.100646+0000","last_became_peered":"2024-09-12T00:02:58.100646+0000","last_unstale":"2024-09-12T01:14:04.265206+0000","last_undegraded":"2024-09-12T01:14:04.265206+0000","last_fullsized":"2024-09-12T01:14:04.265206+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:32.687456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":591,"num_write":465,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'695","reported_seq":2038,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127708+0000","last_change":"2024-09-12T00:02:50.072964+0000","last_active":"2024-09-12T01:14:04.127708+0000","last_peered":"2024-09-12T01:14:04.127708+0000","last_clean":"2024-09-12T01:14:04.127708+0000","last_became_active":"2024-09-12T00:02:50.072665+0000","last_became_peered":"2024-09-12T00:02:50.072665+0000","last_unstale":"2024-09-12T01:14:04.127708+0000","last_undegraded":"2024-09-12T01:14:04.127708+0000","last_fullsized":"2024-09-12T01:14:04.127708+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.757307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3202,"num_read_kb":2877,"num_write":917,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'240","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.211007+0000","last_change":"2024-09-12T00:03:21.140521+0000","last_active":"2024-09-12T01:15:48.211007+0000","last_peered":"2024-09-12T01:15:48.211007+0000","last_clean":"2024-09-12T01:15:48.211007+0000","last_became_active":"2024-09-12T00:03:21.140095+0000","last_became_peered":"2024-09-12T00:03:21.140095+0000","last_unstale":"2024-09-12T01:15:48.211007+0000","last_undegraded":"2024-09-12T01:15:48.211007+0000","last_fullsized":"2024-09-12T01:15:48.211007+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.899923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322785,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":39289,"num_write":1008,"num_write_kb":58524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397483+0000","last_change":"2024-09-12T00:02:52.063849+0000","last_active":"2024-09-12T01:12:53.397483+0000","last_peered":"2024-09-12T01:12:53.397483+0000","last_clean":"2024-09-12T01:12:53.397483+0000","last_became_active":"2024-09-12T00:02:52.063334+0000","last_became_peered":"2024-09-12T00:02:52.063334+0000","last_unstale":"2024-09-12T01:12:53.397483+0000","last_undegraded":"2024-09-12T01:12:53.397483+0000","last_fullsized":"2024-09-12T01:12:53.397483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:03.747256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.197503+0000","last_change":"2024-09-12T00:02:54.240449+0000","last_active":"2024-09-12T01:15:48.197503+0000","last_peered":"2024-09-12T01:15:48.197503+0000","last_clean":"2024-09-12T01:15:48.197503+0000","last_became_active":"2024-09-12T00:02:54.240007+0000","last_became_peered":"2024-09-12T00:02:54.240007+0000","last_unstale":"2024-09-12T01:15:48.197503+0000","last_undegraded":"2024-09-12T01:15:48.197503+0000","last_fullsized":"2024-09-12T01:15:48.197503+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:58.601042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":288,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.238159+0000","last_change":"2024-09-12T00:02:56.087660+0000","last_active":"2024-09-12T01:13:13.238159+0000","last_peered":"2024-09-12T01:13:13.238159+0000","last_clean":"2024-09-12T01:13:13.238159+0000","last_became_active":"2024-09-12T00:02:56.087317+0000","last_became_peered":"2024-09-12T00:02:56.087317+0000","last_unstale":"2024-09-12T01:13:13.238159+0000","last_undegraded":"2024-09-12T01:13:13.238159+0000","last_fullsized":"2024-09-12T01:13:13.238159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:30.847202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'148","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.905755+0000","last_change":"2024-09-12T00:02:58.099988+0000","last_active":"2024-09-12T01:15:10.905755+0000","last_peered":"2024-09-12T01:15:10.905755+0000","last_clean":"2024-09-12T01:15:10.905755+0000","last_became_active":"2024-09-12T00:02:58.099712+0000","last_became_peered":"2024-09-12T00:02:58.099712+0000","last_unstale":"2024-09-12T01:15:10.905755+0000","last_undegraded":"2024-09-12T01:15:10.905755+0000","last_fullsized":"2024-09-12T01:15:10.905755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.021756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'706","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.058665+0000","last_change":"2024-09-12T00:02:50.062196+0000","last_active":"2024-09-12T01:13:06.058665+0000","last_peered":"2024-09-12T01:13:06.058665+0000","last_clean":"2024-09-12T01:13:06.058665+0000","last_became_active":"2024-09-12T00:02:50.061909+0000","last_became_peered":"2024-09-12T00:02:50.061909+0000","last_unstale":"2024-09-12T01:13:06.058665+0000","last_undegraded":"2024-09-12T01:13:06.058665+0000","last_fullsized":"2024-09-12T01:13:06.058665+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":600,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:59.811798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3690,"num_read_kb":3334,"num_write":961,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'196","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243290+0000","last_change":"2024-09-12T00:02:48.051220+0000","last_active":"2024-09-12T01:12:50.243290+0000","last_peered":"2024-09-12T01:12:50.243290+0000","last_clean":"2024-09-12T01:12:50.243290+0000","last_became_active":"2024-09-12T00:02:48.050894+0000","last_became_peered":"2024-09-12T00:02:48.050894+0000","last_unstale":"2024-09-12T01:12:50.243290+0000","last_undegraded":"2024-09-12T01:12:50.243290+0000","last_fullsized":"2024-09-12T01:12:50.243290+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:06.067280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19167861,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":20890,"num_write":1007,"num_write_kb":39832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.235936+0000","last_change":"2024-09-12T00:02:52.064983+0000","last_active":"2024-09-12T01:12:53.235936+0000","last_peered":"2024-09-12T01:12:53.235936+0000","last_clean":"2024-09-12T01:12:53.235936+0000","last_became_active":"2024-09-12T00:02:52.064125+0000","last_became_peered":"2024-09-12T00:02:52.064125+0000","last_unstale":"2024-09-12T01:12:53.235936+0000","last_undegraded":"2024-09-12T01:12:53.235936+0000","last_fullsized":"2024-09-12T01:12:53.235936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:32.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'111","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.555449+0000","last_change":"2024-09-12T00:02:54.239923+0000","last_active":"2024-09-12T01:13:29.555449+0000","last_peered":"2024-09-12T01:13:29.555449+0000","last_clean":"2024-09-12T01:13:29.555449+0000","last_became_active":"2024-09-12T00:02:54.239412+0000","last_became_peered":"2024-09-12T00:02:54.239412+0000","last_unstale":"2024-09-12T01:13:29.555449+0000","last_undegraded":"2024-09-12T01:13:29.555449+0000","last_fullsized":"2024-09-12T01:13:29.555449+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.570833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'772","reported_seq":2645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.954676+0000","last_change":"2024-09-12T00:02:56.080694+0000","last_active":"2024-09-12T01:15:47.954676+0000","last_peered":"2024-09-12T01:15:47.954676+0000","last_clean":"2024-09-12T01:15:47.954676+0000","last_became_active":"2024-09-12T00:02:56.080374+0000","last_became_peered":"2024-09-12T00:02:56.080374+0000","last_unstale":"2024-09-12T01:15:47.954676+0000","last_undegraded":"2024-09-12T01:15:47.954676+0000","last_fullsized":"2024-09-12T01:15:47.954676+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:02.095265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'116","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399596+0000","last_change":"2024-09-12T00:02:58.101477+0000","last_active":"2024-09-12T01:12:58.399596+0000","last_peered":"2024-09-12T01:12:58.399596+0000","last_clean":"2024-09-12T01:12:58.399596+0000","last_became_active":"2024-09-12T00:02:58.100777+0000","last_became_peered":"2024-09-12T00:02:58.100777+0000","last_unstale":"2024-09-12T01:12:58.399596+0000","last_undegraded":"2024-09-12T01:12:58.399596+0000","last_fullsized":"2024-09-12T01:12:58.399596+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:03.981795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'472","reported_seq":2034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127865+0000","last_change":"2024-09-12T00:02:50.070545+0000","last_active":"2024-09-12T01:14:04.127865+0000","last_peered":"2024-09-12T01:14:04.127865+0000","last_clean":"2024-09-12T01:14:04.127865+0000","last_became_active":"2024-09-12T00:02:50.070186+0000","last_became_peered":"2024-09-12T00:02:50.070186+0000","last_unstale":"2024-09-12T01:14:04.127865+0000","last_undegraded":"2024-09-12T01:14:04.127865+0000","last_fullsized":"2024-09-12T01:14:04.127865+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:36.641202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2560,"num_read_kb":2381,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'280","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.257256+0000","last_change":"2024-09-12T00:02:48.055180+0000","last_active":"2024-09-12T01:15:48.257256+0000","last_peered":"2024-09-12T01:15:48.257256+0000","last_clean":"2024-09-12T01:15:48.257256+0000","last_became_active":"2024-09-12T00:02:48.054303+0000","last_became_peered":"2024-09-12T00:02:48.054303+0000","last_unstale":"2024-09-12T01:15:48.257256+0000","last_undegraded":"2024-09-12T01:15:48.257256+0000","last_fullsized":"2024-09-12T01:15:48.257256+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:53.174386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":47582,"num_write":1191,"num_write_kb":28572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399009+0000","last_change":"2024-09-12T00:02:52.071857+0000","last_active":"2024-09-12T01:12:53.399009+0000","last_peered":"2024-09-12T01:12:53.399009+0000","last_clean":"2024-09-12T01:12:53.399009+0000","last_became_active":"2024-09-12T00:02:52.071580+0000","last_became_peered":"2024-09-12T00:02:52.071580+0000","last_unstale":"2024-09-12T01:12:53.399009+0000","last_undegraded":"2024-09-12T01:12:53.399009+0000","last_fullsized":"2024-09-12T01:12:53.399009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:15.575099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'229","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.250455+0000","last_change":"2024-09-12T00:02:54.069107+0000","last_active":"2024-09-12T01:15:48.250455+0000","last_peered":"2024-09-12T01:15:48.250455+0000","last_clean":"2024-09-12T01:15:48.250455+0000","last_became_active":"2024-09-12T00:02:54.068806+0000","last_became_peered":"2024-09-12T00:02:54.068806+0000","last_unstale":"2024-09-12T01:15:48.250455+0000","last_undegraded":"2024-09-12T01:15:48.250455+0000","last_fullsized":"2024-09-12T01:15:48.250455+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:03.065780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9605,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":355,"num_write":182,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244538+0000","last_change":"2024-09-12T00:02:56.083225+0000","last_active":"2024-09-12T01:13:00.244538+0000","last_peered":"2024-09-12T01:13:00.244538+0000","last_clean":"2024-09-12T01:13:00.244538+0000","last_became_active":"2024-09-12T00:02:56.082924+0000","last_became_peered":"2024-09-12T00:02:56.082924+0000","last_unstale":"2024-09-12T01:13:00.244538+0000","last_undegraded":"2024-09-12T01:13:00.244538+0000","last_fullsized":"2024-09-12T01:13:00.244538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:14.433764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'109","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.113160+0000","last_change":"2024-09-12T00:02:58.099967+0000","last_active":"2024-09-12T01:14:04.113160+0000","last_peered":"2024-09-12T01:14:04.113160+0000","last_clean":"2024-09-12T01:14:04.113160+0000","last_became_active":"2024-09-12T00:02:58.099683+0000","last_became_peered":"2024-09-12T00:02:58.099683+0000","last_unstale":"2024-09-12T01:14:04.113160+0000","last_undegraded":"2024-09-12T01:14:04.113160+0000","last_fullsized":"2024-09-12T01:14:04.113160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:14.241268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":199,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'538","reported_seq":2265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748583+0000","last_change":"2024-09-12T00:02:50.070201+0000","last_active":"2024-09-12T01:15:09.748583+0000","last_peered":"2024-09-12T01:15:09.748583+0000","last_clean":"2024-09-12T01:15:09.748583+0000","last_became_active":"2024-09-12T00:02:50.069907+0000","last_became_peered":"2024-09-12T00:02:50.069907+0000","last_unstale":"2024-09-12T01:15:09.748583+0000","last_undegraded":"2024-09-12T01:15:09.748583+0000","last_fullsized":"2024-09-12T01:15:09.748583+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:16.483724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2946,"num_read_kb":2752,"num_write":643,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'210","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203279+0000","last_change":"2024-09-12T00:02:48.054530+0000","last_active":"2024-09-12T01:15:48.203279+0000","last_peered":"2024-09-12T01:15:48.203279+0000","last_clean":"2024-09-12T01:15:48.203279+0000","last_became_active":"2024-09-12T00:02:48.052303+0000","last_became_peered":"2024-09-12T00:02:48.052303+0000","last_unstale":"2024-09-12T01:15:48.203279+0000","last_undegraded":"2024-09-12T01:15:48.203279+0000","last_fullsized":"2024-09-12T01:15:48.203279+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:02.915896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":51729,"num_write":985,"num_write_kb":45446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510194+0000","last_change":"2024-09-12T00:02:52.066240+0000","last_active":"2024-09-12T01:12:53.510194+0000","last_peered":"2024-09-12T01:12:53.510194+0000","last_clean":"2024-09-12T01:12:53.510194+0000","last_became_active":"2024-09-12T00:02:52.065653+0000","last_became_peered":"2024-09-12T00:02:52.065653+0000","last_unstale":"2024-09-12T01:12:53.510194+0000","last_undegraded":"2024-09-12T01:12:53.510194+0000","last_fullsized":"2024-09-12T01:12:53.510194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'148","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.856789+0000","last_change":"2024-09-12T00:02:54.074579+0000","last_active":"2024-09-12T01:15:10.856789+0000","last_peered":"2024-09-12T01:15:10.856789+0000","last_clean":"2024-09-12T01:15:10.856789+0000","last_became_active":"2024-09-12T00:02:54.073930+0000","last_became_peered":"2024-09-12T00:02:54.073930+0000","last_unstale":"2024-09-12T01:15:10.856789+0000","last_undegraded":"2024-09-12T01:15:10.856789+0000","last_fullsized":"2024-09-12T01:15:10.856789+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.507632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10183,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":191,"num_read_kb":242,"num_write":106,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.617272+0000","last_change":"2024-09-12T00:02:56.078803+0000","last_active":"2024-09-12T01:13:08.617272+0000","last_peered":"2024-09-12T01:13:08.617272+0000","last_clean":"2024-09-12T01:13:08.617272+0000","last_became_active":"2024-09-12T00:02:56.078528+0000","last_became_peered":"2024-09-12T00:02:56.078528+0000","last_unstale":"2024-09-12T01:13:08.617272+0000","last_undegraded":"2024-09-12T01:13:08.617272+0000","last_fullsized":"2024-09-12T01:13:08.617272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:32.315601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'99","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.947976+0000","last_change":"2024-09-12T00:02:58.087504+0000","last_active":"2024-09-12T01:14:02.947976+0000","last_peered":"2024-09-12T01:14:02.947976+0000","last_clean":"2024-09-12T01:14:02.947976+0000","last_became_active":"2024-09-12T00:02:58.087199+0000","last_became_peered":"2024-09-12T00:02:58.087199+0000","last_unstale":"2024-09-12T01:14:02.947976+0000","last_undegraded":"2024-09-12T01:14:02.947976+0000","last_fullsized":"2024-09-12T01:14:02.947976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:03.468020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":246,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'466","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749348+0000","last_change":"2024-09-12T00:02:50.073193+0000","last_active":"2024-09-12T01:15:09.749348+0000","last_peered":"2024-09-12T01:15:09.749348+0000","last_clean":"2024-09-12T01:15:09.749348+0000","last_became_active":"2024-09-12T00:02:50.072920+0000","last_became_peered":"2024-09-12T00:02:50.072920+0000","last_unstale":"2024-09-12T01:15:09.749348+0000","last_undegraded":"2024-09-12T01:15:09.749348+0000","last_fullsized":"2024-09-12T01:15:09.749348+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.921031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2371,"num_write":566,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'211","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.195443+0000","last_change":"2024-09-12T00:02:48.048693+0000","last_active":"2024-09-12T01:15:48.195443+0000","last_peered":"2024-09-12T01:15:48.195443+0000","last_clean":"2024-09-12T01:15:48.195443+0000","last_became_active":"2024-09-12T00:02:48.048308+0000","last_became_peered":"2024-09-12T00:02:48.048308+0000","last_unstale":"2024-09-12T01:15:48.195443+0000","last_undegraded":"2024-09-12T01:15:48.195443+0000","last_fullsized":"2024-09-12T01:15:48.195443+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:27.341399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2092,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":37398,"num_write":996,"num_write_kb":57972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398220+0000","last_change":"2024-09-12T00:02:52.060575+0000","last_active":"2024-09-12T01:12:58.398220+0000","last_peered":"2024-09-12T01:12:58.398220+0000","last_clean":"2024-09-12T01:12:58.398220+0000","last_became_active":"2024-09-12T00:02:52.060283+0000","last_became_peered":"2024-09-12T00:02:52.060283+0000","last_unstale":"2024-09-12T01:12:58.398220+0000","last_undegraded":"2024-09-12T01:12:58.398220+0000","last_fullsized":"2024-09-12T01:12:58.398220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.734208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'126","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.188246+0000","last_change":"2024-09-12T00:02:54.068064+0000","last_active":"2024-09-12T01:15:48.188246+0000","last_peered":"2024-09-12T01:15:48.188246+0000","last_clean":"2024-09-12T01:15:48.188246+0000","last_became_active":"2024-09-12T00:02:54.067770+0000","last_became_peered":"2024-09-12T00:02:54.067770+0000","last_unstale":"2024-09-12T01:15:48.188246+0000","last_undegraded":"2024-09-12T01:15:48.188246+0000","last_fullsized":"2024-09-12T01:15:48.188246+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:35.379645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4641,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":72,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398279+0000","last_change":"2024-09-12T00:02:56.078599+0000","last_active":"2024-09-12T01:12:58.398279+0000","last_peered":"2024-09-12T01:12:58.398279+0000","last_clean":"2024-09-12T01:12:58.398279+0000","last_became_active":"2024-09-12T00:02:56.077573+0000","last_became_peered":"2024-09-12T00:02:56.077573+0000","last_unstale":"2024-09-12T01:12:58.398279+0000","last_undegraded":"2024-09-12T01:12:58.398279+0000","last_fullsized":"2024-09-12T01:12:58.398279+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.485844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'149","reported_seq":1250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.171046+0000","last_change":"2024-09-12T00:02:58.099809+0000","last_active":"2024-09-12T01:14:00.171046+0000","last_peered":"2024-09-12T01:14:00.171046+0000","last_clean":"2024-09-12T01:14:00.171046+0000","last_became_active":"2024-09-12T00:02:58.099426+0000","last_became_peered":"2024-09-12T00:02:58.099426+0000","last_unstale":"2024-09-12T01:14:00.171046+0000","last_undegraded":"2024-09-12T01:14:00.171046+0000","last_fullsized":"2024-09-12T01:14:00.171046+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:47.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":755,"num_read_kb":754,"num_write":338,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'470","reported_seq":1958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.281149+0000","last_change":"2024-09-12T00:02:50.064387+0000","last_active":"2024-09-12T01:13:32.281149+0000","last_peered":"2024-09-12T01:13:32.281149+0000","last_clean":"2024-09-12T01:13:32.281149+0000","last_became_active":"2024-09-12T00:02:50.063959+0000","last_became_peered":"2024-09-12T00:02:50.063959+0000","last_unstale":"2024-09-12T01:13:32.281149+0000","last_undegraded":"2024-09-12T01:13:32.281149+0000","last_fullsized":"2024-09-12T01:13:32.281149+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:18.236963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2471,"num_read_kb":2277,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'189","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249606+0000","last_change":"2024-09-12T00:02:48.055373+0000","last_active":"2024-09-12T01:13:40.249606+0000","last_peered":"2024-09-12T01:13:40.249606+0000","last_clean":"2024-09-12T01:13:40.249606+0000","last_became_active":"2024-09-12T00:02:48.054650+0000","last_became_peered":"2024-09-12T00:02:48.054650+0000","last_unstale":"2024-09-12T01:13:40.249606+0000","last_undegraded":"2024-09-12T01:13:40.249606+0000","last_fullsized":"2024-09-12T01:13:40.249606+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:13.706061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9667457,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":855,"num_read_kb":59687,"num_write":950,"num_write_kb":41766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.926078+0000","last_change":"2024-09-12T00:02:52.066201+0000","last_active":"2024-09-12T01:15:47.926078+0000","last_peered":"2024-09-12T01:15:47.926078+0000","last_clean":"2024-09-12T01:15:47.926078+0000","last_became_active":"2024-09-12T00:02:52.065804+0000","last_became_peered":"2024-09-12T00:02:52.065804+0000","last_unstale":"2024-09-12T01:15:47.926078+0000","last_undegraded":"2024-09-12T01:15:47.926078+0000","last_fullsized":"2024-09-12T01:15:47.926078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:39.988981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'181","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.205498+0000","last_change":"2024-09-12T00:02:54.067254+0000","last_active":"2024-09-12T01:15:48.205498+0000","last_peered":"2024-09-12T01:15:48.205498+0000","last_clean":"2024-09-12T01:15:48.205498+0000","last_became_active":"2024-09-12T00:02:54.066918+0000","last_became_peered":"2024-09-12T00:02:54.066918+0000","last_unstale":"2024-09-12T01:15:48.205498+0000","last_undegraded":"2024-09-12T01:15:48.205498+0000","last_fullsized":"2024-09-12T01:15:48.205498+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:12.059169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":266,"num_write":140,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243946+0000","last_change":"2024-09-12T00:02:56.085398+0000","last_active":"2024-09-12T01:12:55.243946+0000","last_peered":"2024-09-12T01:12:55.243946+0000","last_clean":"2024-09-12T01:12:55.243946+0000","last_became_active":"2024-09-12T00:02:56.084768+0000","last_became_peered":"2024-09-12T00:02:56.084768+0000","last_unstale":"2024-09-12T01:12:55.243946+0000","last_undegraded":"2024-09-12T01:12:55.243946+0000","last_fullsized":"2024-09-12T01:12:55.243946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:48.456473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'155","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.758350+0000","last_change":"2024-09-12T00:02:58.097950+0000","last_active":"2024-09-12T01:15:09.758350+0000","last_peered":"2024-09-12T01:15:09.758350+0000","last_clean":"2024-09-12T01:15:09.758350+0000","last_became_active":"2024-09-12T00:02:58.097725+0000","last_became_peered":"2024-09-12T00:02:58.097725+0000","last_unstale":"2024-09-12T01:15:09.758350+0000","last_undegraded":"2024-09-12T01:15:09.758350+0000","last_fullsized":"2024-09-12T01:15:09.758350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:53.001751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":109,"num_write":343,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'690","reported_seq":2193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.278553+0000","last_change":"2024-09-12T00:02:50.064639+0000","last_active":"2024-09-12T01:13:32.278553+0000","last_peered":"2024-09-12T01:13:32.278553+0000","last_clean":"2024-09-12T01:13:32.278553+0000","last_became_active":"2024-09-12T00:02:50.064354+0000","last_became_peered":"2024-09-12T00:02:50.064354+0000","last_unstale":"2024-09-12T01:13:32.278553+0000","last_undegraded":"2024-09-12T01:13:32.278553+0000","last_fullsized":"2024-09-12T01:13:32.278553+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:47.800598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3412,"num_read_kb":3118,"num_write":870,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'187","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154216+0000","last_change":"2024-09-12T00:02:48.049912+0000","last_active":"2024-09-12T01:15:48.154216+0000","last_peered":"2024-09-12T01:15:48.154216+0000","last_clean":"2024-09-12T01:15:48.154216+0000","last_became_active":"2024-09-12T00:02:48.049242+0000","last_became_peered":"2024-09-12T00:02:48.049242+0000","last_unstale":"2024-09-12T01:15:48.154216+0000","last_undegraded":"2024-09-12T01:15:48.154216+0000","last_fullsized":"2024-09-12T01:15:48.154216+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:23.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":39372,"num_write":875,"num_write_kb":46728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'350","reported_seq":1687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128431+0000","last_change":"2024-09-12T00:02:50.066620+0000","last_active":"2024-09-12T01:14:04.128431+0000","last_peered":"2024-09-12T01:14:04.128431+0000","last_clean":"2024-09-12T01:14:04.128431+0000","last_became_active":"2024-09-12T00:02:50.065060+0000","last_became_peered":"2024-09-12T00:02:50.065060+0000","last_unstale":"2024-09-12T01:14:04.128431+0000","last_undegraded":"2024-09-12T01:14:04.128431+0000","last_fullsized":"2024-09-12T01:14:04.128431+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:29.932545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1806,"num_read_kb":1710,"num_write":413,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'203","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.232859+0000","last_change":"2024-09-12T00:02:48.042203+0000","last_active":"2024-09-12T01:13:38.232859+0000","last_peered":"2024-09-12T01:13:38.232859+0000","last_clean":"2024-09-12T01:13:38.232859+0000","last_became_active":"2024-09-12T00:02:48.041842+0000","last_became_peered":"2024-09-12T00:02:48.041842+0000","last_unstale":"2024-09-12T01:13:38.232859+0000","last_undegraded":"2024-09-12T01:13:38.232859+0000","last_fullsized":"2024-09-12T01:13:38.232859+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.057094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":13124,"num_write":1044,"num_write_kb":38354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'456","reported_seq":2064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.953879+0000","last_change":"2024-09-12T00:02:50.066620+0000","last_active":"2024-09-12T01:14:02.953879+0000","last_peered":"2024-09-12T01:14:02.953879+0000","last_clean":"2024-09-12T01:14:02.953879+0000","last_became_active":"2024-09-12T00:02:50.066341+0000","last_became_peered":"2024-09-12T00:02:50.066341+0000","last_unstale":"2024-09-12T01:14:02.953879+0000","last_undegraded":"2024-09-12T01:14:02.953879+0000","last_fullsized":"2024-09-12T01:14:02.953879+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:24.335215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2383,"num_read_kb":2262,"num_write":523,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'185","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203656+0000","last_change":"2024-09-12T00:02:48.053321+0000","last_active":"2024-09-12T01:15:48.203656+0000","last_peered":"2024-09-12T01:15:48.203656+0000","last_clean":"2024-09-12T01:15:48.203656+0000","last_became_active":"2024-09-12T00:02:48.052205+0000","last_became_peered":"2024-09-12T00:02:48.052205+0000","last_unstale":"2024-09-12T01:15:48.203656+0000","last_undegraded":"2024-09-12T01:15:48.203656+0000","last_fullsized":"2024-09-12T01:15:48.203656+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:46.259191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":389,"num_read_kb":19493,"num_write":855,"num_write_kb":24928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'366","reported_seq":1876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.726506+0000","last_change":"2024-09-12T00:02:50.066198+0000","last_active":"2024-09-12T01:15:09.726506+0000","last_peered":"2024-09-12T01:15:09.726506+0000","last_clean":"2024-09-12T01:15:09.726506+0000","last_became_active":"2024-09-12T00:02:50.065534+0000","last_became_peered":"2024-09-12T00:02:50.065534+0000","last_unstale":"2024-09-12T01:15:09.726506+0000","last_undegraded":"2024-09-12T01:15:09.726506+0000","last_fullsized":"2024-09-12T01:15:09.726506+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:03.014135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1966,"num_read_kb":1903,"num_write":390,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'155","reported_seq":751,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.238188+0000","last_change":"2024-09-12T00:03:21.720945+0000","last_active":"2024-09-12T01:14:28.238188+0000","last_peered":"2024-09-12T01:14:28.238188+0000","last_clean":"2024-09-12T01:14:28.238188+0000","last_became_active":"2024-09-12T00:03:21.720441+0000","last_became_peered":"2024-09-12T00:03:21.720441+0000","last_unstale":"2024-09-12T01:14:28.238188+0000","last_undegraded":"2024-09-12T01:14:28.238188+0000","last_fullsized":"2024-09-12T01:14:28.238188+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:43.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":16297,"num_write":778,"num_write_kb":33256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"267'1239","reported_seq":3053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.279664+0000","last_change":"2024-09-12T00:02:50.070807+0000","last_active":"2024-09-12T01:13:32.279664+0000","last_peered":"2024-09-12T01:13:32.279664+0000","last_clean":"2024-09-12T01:13:32.279664+0000","last_became_active":"2024-09-12T00:02:50.070406+0000","last_became_peered":"2024-09-12T00:02:50.070406+0000","last_unstale":"2024-09-12T01:13:32.279664+0000","last_undegraded":"2024-09-12T01:13:32.279664+0000","last_fullsized":"2024-09-12T01:13:32.279664+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:02.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5822,"num_read_kb":5176,"num_write":1694,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'194","reported_seq":841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.244888+0000","last_change":"2024-09-12T00:02:48.051785+0000","last_active":"2024-09-12T01:14:18.244888+0000","last_peered":"2024-09-12T01:14:18.244888+0000","last_clean":"2024-09-12T01:14:18.244888+0000","last_became_active":"2024-09-12T00:02:48.051454+0000","last_became_peered":"2024-09-12T00:02:48.051454+0000","last_unstale":"2024-09-12T01:14:18.244888+0000","last_undegraded":"2024-09-12T01:14:18.244888+0000","last_fullsized":"2024-09-12T01:14:18.244888+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:03.729498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22651,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":459,"num_read_kb":27281,"num_write":912,"num_write_kb":43596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'808","reported_seq":2264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257926+0000","last_change":"2024-09-12T00:02:50.065953+0000","last_active":"2024-09-12T01:13:43.257926+0000","last_peered":"2024-09-12T01:13:43.257926+0000","last_clean":"2024-09-12T01:13:43.257926+0000","last_became_active":"2024-09-12T00:02:50.065615+0000","last_became_peered":"2024-09-12T00:02:50.065615+0000","last_unstale":"2024-09-12T01:13:43.257926+0000","last_undegraded":"2024-09-12T01:13:43.257926+0000","last_fullsized":"2024-09-12T01:13:43.257926+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:10.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3886,"num_read_kb":3508,"num_write":1123,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'222","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.245194+0000","last_change":"2024-09-12T00:02:48.047922+0000","last_active":"2024-09-12T01:14:18.245194+0000","last_peered":"2024-09-12T01:14:18.245194+0000","last_clean":"2024-09-12T01:14:18.245194+0000","last_became_active":"2024-09-12T00:02:48.047357+0000","last_became_peered":"2024-09-12T00:02:48.047357+0000","last_unstale":"2024-09-12T01:14:18.245194+0000","last_undegraded":"2024-09-12T01:14:18.245194+0000","last_fullsized":"2024-09-12T01:14:18.245194+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:00.961888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2112,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":474,"num_read_kb":6089,"num_write":1091,"num_write_kb":27766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1102","reported_seq":2609,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.239495+0000","last_change":"2024-09-12T00:02:50.076287+0000","last_active":"2024-09-12T01:13:43.239495+0000","last_peered":"2024-09-12T01:13:43.239495+0000","last_clean":"2024-09-12T01:13:43.239495+0000","last_became_active":"2024-09-12T00:02:50.075265+0000","last_became_peered":"2024-09-12T00:02:50.075265+0000","last_unstale":"2024-09-12T01:13:43.239495+0000","last_undegraded":"2024-09-12T01:13:43.239495+0000","last_fullsized":"2024-09-12T01:13:43.239495+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":1000,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:28.198469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4403,"num_write":1512,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'200","reported_seq":822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.177090+0000","last_change":"2024-09-12T00:02:48.047911+0000","last_active":"2024-09-12T01:15:48.177090+0000","last_peered":"2024-09-12T01:15:48.177090+0000","last_clean":"2024-09-12T01:15:48.177090+0000","last_became_active":"2024-09-12T00:02:48.047266+0000","last_became_peered":"2024-09-12T00:02:48.047266+0000","last_unstale":"2024-09-12T01:15:48.177090+0000","last_undegraded":"2024-09-12T01:15:48.177090+0000","last_fullsized":"2024-09-12T01:15:48.177090+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.110547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":23654,"num_write":912,"num_write_kb":39021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'475","reported_seq":2121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622203+0000","last_change":"2024-09-12T00:02:50.068176+0000","last_active":"2024-09-12T01:13:43.622203+0000","last_peered":"2024-09-12T01:13:43.622203+0000","last_clean":"2024-09-12T01:13:43.622203+0000","last_became_active":"2024-09-12T00:02:50.067919+0000","last_became_peered":"2024-09-12T00:02:50.067919+0000","last_unstale":"2024-09-12T01:13:43.622203+0000","last_undegraded":"2024-09-12T01:13:43.622203+0000","last_fullsized":"2024-09-12T01:13:43.622203+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:55.966361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2453,"num_write":580,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:53.249785+0000","last_change":"2024-09-12T00:03:21.143532+0000","last_active":"2024-09-12T01:14:53.249785+0000","last_peered":"2024-09-12T01:14:53.249785+0000","last_clean":"2024-09-12T01:14:53.249785+0000","last_became_active":"2024-09-12T00:03:21.143091+0000","last_became_peered":"2024-09-12T00:03:21.143091+0000","last_unstale":"2024-09-12T01:14:53.249785+0000","last_undegraded":"2024-09-12T01:14:53.249785+0000","last_fullsized":"2024-09-12T01:14:53.249785+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:15.405828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":6539,"num_write":770,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'874","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863508+0000","last_change":"2024-09-12T00:02:50.076474+0000","last_active":"2024-09-12T01:13:20.863508+0000","last_peered":"2024-09-12T01:13:20.863508+0000","last_clean":"2024-09-12T01:13:20.863508+0000","last_became_active":"2024-09-12T00:02:50.076097+0000","last_became_peered":"2024-09-12T00:02:50.076097+0000","last_unstale":"2024-09-12T01:13:20.863508+0000","last_undegraded":"2024-09-12T01:13:20.863508+0000","last_fullsized":"2024-09-12T01:13:20.863508+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:53.760772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3804,"num_write":1206,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'185","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:23.523597+0000","last_change":"2024-09-12T00:02:48.058120+0000","last_active":"2024-09-12T01:14:23.523597+0000","last_peered":"2024-09-12T01:14:23.523597+0000","last_clean":"2024-09-12T01:14:23.523597+0000","last_became_active":"2024-09-12T00:02:48.057693+0000","last_became_peered":"2024-09-12T00:02:48.057693+0000","last_unstale":"2024-09-12T01:14:23.523597+0000","last_undegraded":"2024-09-12T01:14:23.523597+0000","last_fullsized":"2024-09-12T01:14:23.523597+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:03.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":352,"num_read_kb":5525,"num_write":905,"num_write_kb":35074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'837","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.955489+0000","last_change":"2024-09-12T00:02:50.062788+0000","last_active":"2024-09-12T01:14:02.955489+0000","last_peered":"2024-09-12T01:14:02.955489+0000","last_clean":"2024-09-12T01:14:02.955489+0000","last_became_active":"2024-09-12T00:02:50.062524+0000","last_became_peered":"2024-09-12T00:02:50.062524+0000","last_unstale":"2024-09-12T01:14:02.955489+0000","last_undegraded":"2024-09-12T01:14:02.955489+0000","last_fullsized":"2024-09-12T01:14:02.955489+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:00.117674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4232,"num_read_kb":3859,"num_write":1078,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'257","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.214002+0000","last_change":"2024-09-12T00:02:48.050975+0000","last_active":"2024-09-12T01:15:48.214002+0000","last_peered":"2024-09-12T01:15:48.214002+0000","last_clean":"2024-09-12T01:15:48.214002+0000","last_became_active":"2024-09-12T00:02:48.050574+0000","last_became_peered":"2024-09-12T00:02:48.050574+0000","last_unstale":"2024-09-12T01:15:48.214002+0000","last_undegraded":"2024-09-12T01:15:48.214002+0000","last_fullsized":"2024-09-12T01:15:48.214002+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:18.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68583,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":597,"num_read_kb":15341,"num_write":1131,"num_write_kb":29230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'811","reported_seq":2278,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.722532+0000","last_change":"2024-09-12T00:02:50.063982+0000","last_active":"2024-09-12T01:15:09.722532+0000","last_peered":"2024-09-12T01:15:09.722532+0000","last_clean":"2024-09-12T01:15:09.722532+0000","last_became_active":"2024-09-12T00:02:50.063668+0000","last_became_peered":"2024-09-12T00:02:50.063668+0000","last_unstale":"2024-09-12T01:15:09.722532+0000","last_undegraded":"2024-09-12T01:15:09.722532+0000","last_fullsized":"2024-09-12T01:15:09.722532+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.340207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3770,"num_read_kb":3367,"num_write":1118,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'211","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.231252+0000","last_change":"2024-09-12T00:02:48.049176+0000","last_active":"2024-09-12T01:15:48.231252+0000","last_peered":"2024-09-12T01:15:48.231252+0000","last_clean":"2024-09-12T01:15:48.231252+0000","last_became_active":"2024-09-12T00:02:48.048851+0000","last_became_peered":"2024-09-12T00:02:48.048851+0000","last_unstale":"2024-09-12T01:15:48.231252+0000","last_undegraded":"2024-09-12T01:15:48.231252+0000","last_fullsized":"2024-09-12T01:15:48.231252+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:48.606466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":48639,"num_write":1072,"num_write_kb":41735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'811","reported_seq":2269,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.790333+0000","last_change":"2024-09-12T00:02:50.064007+0000","last_active":"2024-09-12T01:13:16.790333+0000","last_peered":"2024-09-12T01:13:16.790333+0000","last_clean":"2024-09-12T01:13:16.790333+0000","last_became_active":"2024-09-12T00:02:50.063615+0000","last_became_peered":"2024-09-12T00:02:50.063615+0000","last_unstale":"2024-09-12T01:13:16.790333+0000","last_undegraded":"2024-09-12T01:13:16.790333+0000","last_fullsized":"2024-09-12T01:13:16.790333+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:42.699086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3747,"num_read_kb":3346,"num_write":1068,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'283","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:35.241622+0000","last_change":"2024-09-12T00:02:48.047449+0000","last_active":"2024-09-12T01:12:35.241622+0000","last_peered":"2024-09-12T01:12:35.241622+0000","last_clean":"2024-09-12T01:12:35.241622+0000","last_became_active":"2024-09-12T00:02:48.046828+0000","last_became_peered":"2024-09-12T00:02:48.046828+0000","last_unstale":"2024-09-12T01:12:35.241622+0000","last_undegraded":"2024-09-12T01:12:35.241622+0000","last_fullsized":"2024-09-12T01:12:35.241622+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.302266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508432,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":715,"num_read_kb":12026,"num_write":1073,"num_write_kb":33544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'751","reported_seq":2258,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127565+0000","last_change":"2024-09-12T00:02:50.070132+0000","last_active":"2024-09-12T01:14:04.127565+0000","last_peered":"2024-09-12T01:14:04.127565+0000","last_clean":"2024-09-12T01:14:04.127565+0000","last_became_active":"2024-09-12T00:02:50.069844+0000","last_became_peered":"2024-09-12T00:02:50.069844+0000","last_unstale":"2024-09-12T01:14:04.127565+0000","last_undegraded":"2024-09-12T01:14:04.127565+0000","last_fullsized":"2024-09-12T01:14:04.127565+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:41.241382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3535,"num_read_kb":3209,"num_write":983,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'198","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154781+0000","last_change":"2024-09-12T00:02:48.046768+0000","last_active":"2024-09-12T01:15:48.154781+0000","last_peered":"2024-09-12T01:15:48.154781+0000","last_clean":"2024-09-12T01:15:48.154781+0000","last_became_active":"2024-09-12T00:02:48.046397+0000","last_became_peered":"2024-09-12T00:02:48.046397+0000","last_unstale":"2024-09-12T01:15:48.154781+0000","last_undegraded":"2024-09-12T01:15:48.154781+0000","last_fullsized":"2024-09-12T01:15:48.154781+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:20.073613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":38047,"num_write":933,"num_write_kb":24740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'852","reported_seq":2476,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.727874+0000","last_change":"2024-09-12T00:02:50.078323+0000","last_active":"2024-09-12T01:15:09.727874+0000","last_peered":"2024-09-12T01:15:09.727874+0000","last_clean":"2024-09-12T01:15:09.727874+0000","last_became_active":"2024-09-12T00:02:50.078018+0000","last_became_peered":"2024-09-12T00:02:50.078018+0000","last_unstale":"2024-09-12T01:15:09.727874+0000","last_undegraded":"2024-09-12T01:15:09.727874+0000","last_fullsized":"2024-09-12T01:15:09.727874+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.331727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4154,"num_read_kb":3748,"num_write":1160,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'171","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.248955+0000","last_change":"2024-09-12T00:02:48.049824+0000","last_active":"2024-09-12T01:15:48.248955+0000","last_peered":"2024-09-12T01:15:48.248955+0000","last_clean":"2024-09-12T01:15:48.248955+0000","last_became_active":"2024-09-12T00:02:48.047945+0000","last_became_peered":"2024-09-12T00:02:48.047945+0000","last_unstale":"2024-09-12T01:15:48.248955+0000","last_undegraded":"2024-09-12T01:15:48.248955+0000","last_fullsized":"2024-09-12T01:15:48.248955+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:07.052258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":324,"num_read_kb":25981,"num_write":829,"num_write_kb":31809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'530","reported_seq":2291,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.229835+0000","last_change":"2024-09-12T00:03:21.133800+0000","last_active":"2024-09-12T01:13:08.229835+0000","last_peered":"2024-09-12T01:13:08.229835+0000","last_clean":"2024-09-12T01:13:08.229835+0000","last_became_active":"2024-09-12T00:03:21.133475+0000","last_became_peered":"2024-09-12T00:03:21.133475+0000","last_unstale":"2024-09-12T01:13:08.229835+0000","last_undegraded":"2024-09-12T01:13:08.229835+0000","last_fullsized":"2024-09-12T01:13:08.229835+0000","mapping_epoch":39,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:12.713868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2976,"num_read_kb":2811,"num_write":614,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"267'233","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.059488+0000","last_change":"2024-09-12T00:02:48.049475+0000","last_active":"2024-09-12T01:15:48.059488+0000","last_peered":"2024-09-12T01:15:48.059488+0000","last_clean":"2024-09-12T01:15:48.059488+0000","last_became_active":"2024-09-12T00:02:48.049104+0000","last_became_peered":"2024-09-12T00:02:48.049104+0000","last_unstale":"2024-09-12T01:15:48.059488+0000","last_undegraded":"2024-09-12T01:15:48.059488+0000","last_fullsized":"2024-09-12T01:15:48.059488+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:30.113842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456491,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":11103,"num_write":1027,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'905","reported_seq":2496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127160+0000","last_change":"2024-09-12T00:02:50.069815+0000","last_active":"2024-09-12T01:14:04.127160+0000","last_peered":"2024-09-12T01:14:04.127160+0000","last_clean":"2024-09-12T01:14:04.127160+0000","last_became_active":"2024-09-12T00:02:50.069494+0000","last_became_peered":"2024-09-12T00:02:50.069494+0000","last_unstale":"2024-09-12T01:14:04.127160+0000","last_undegraded":"2024-09-12T01:14:04.127160+0000","last_fullsized":"2024-09-12T01:14:04.127160+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:18.542138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4355,"num_read_kb":3868,"num_write":1227,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'175","reported_seq":808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.202875+0000","last_change":"2024-09-12T00:04:21.225632+0000","last_active":"2024-09-12T01:15:48.202875+0000","last_peered":"2024-09-12T01:15:48.202875+0000","last_clean":"2024-09-12T01:15:48.202875+0000","last_became_active":"2024-09-12T00:04:21.225148+0000","last_became_peered":"2024-09-12T00:04:21.225148+0000","last_unstale":"2024-09-12T01:15:48.202875+0000","last_undegraded":"2024-09-12T01:15:48.202875+0000","last_fullsized":"2024-09-12T01:15:48.202875+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:11.655162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7533161,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":15843,"num_write":853,"num_write_kb":25246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'175","reported_seq":796,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.178507+0000","last_change":"2024-09-12T00:03:21.141209+0000","last_active":"2024-09-12T01:15:48.178507+0000","last_peered":"2024-09-12T01:15:48.178507+0000","last_clean":"2024-09-12T01:15:48.178507+0000","last_became_active":"2024-09-12T00:03:21.140871+0000","last_became_peered":"2024-09-12T00:03:21.140871+0000","last_unstale":"2024-09-12T01:15:48.178507+0000","last_undegraded":"2024-09-12T01:15:48.178507+0000","last_fullsized":"2024-09-12T01:15:48.178507+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.144813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2728229,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":36071,"num_write":841,"num_write_kb":27237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'834","reported_seq":2461,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749255+0000","last_change":"2024-09-12T00:02:50.076816+0000","last_active":"2024-09-12T01:15:09.749255+0000","last_peered":"2024-09-12T01:15:09.749255+0000","last_clean":"2024-09-12T01:15:09.749255+0000","last_became_active":"2024-09-12T00:02:50.076513+0000","last_became_peered":"2024-09-12T00:02:50.076513+0000","last_unstale":"2024-09-12T01:15:09.749255+0000","last_undegraded":"2024-09-12T01:15:09.749255+0000","last_fullsized":"2024-09-12T01:15:09.749255+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:15.455296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4096,"num_read_kb":3692,"num_write":1085,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'192","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.070415+0000","last_change":"2024-09-12T00:03:21.143529+0000","last_active":"2024-09-12T01:15:48.070415+0000","last_peered":"2024-09-12T01:15:48.070415+0000","last_clean":"2024-09-12T01:15:48.070415+0000","last_became_active":"2024-09-12T00:03:21.143160+0000","last_became_peered":"2024-09-12T00:03:21.143160+0000","last_unstale":"2024-09-12T01:15:48.070415+0000","last_undegraded":"2024-09-12T01:15:48.070415+0000","last_fullsized":"2024-09-12T01:15:48.070415+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:30.205902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242910,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":433,"num_read_kb":67077,"num_write":936,"num_write_kb":29840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.787449+0000","last_change":"2024-09-12T00:02:50.060740+0000","last_active":"2024-09-12T01:13:16.787449+0000","last_peered":"2024-09-12T01:13:16.787449+0000","last_clean":"2024-09-12T01:13:16.787449+0000","last_became_active":"2024-09-12T00:02:50.060457+0000","last_became_peered":"2024-09-12T00:02:50.060457+0000","last_unstale":"2024-09-12T01:13:16.787449+0000","last_undegraded":"2024-09-12T01:13:16.787449+0000","last_fullsized":"2024-09-12T01:13:16.787449+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:20.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2366,"num_read_kb":2209,"num_write":518,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5804,"num_read_kb":4071,"num_write":1920,"num_write_kb":818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1091,"ondisk_log_size":1091,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15077,"num_read_kb":14728,"num_write":16720,"num_write_kb":4882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":651,"ondisk_log_size":651,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":282194,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":10143,"num_read_kb":12207,"num_write":7073,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":44589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1856,"ondisk_log_size":1856,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212469,"num_read_kb":193861,"num_write":55201,"num_write_kb":18788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3960,"ondisk_log_size":3960,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":167873438,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":269,"num_whiteouts":0,"num_read":33148,"num_read_kb":2494324,"num_write":62055,"num_write_kb":2229204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":297668608,"data_stored":297668608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4483,"ondisk_log_size":4483,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24117248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":196988,"num_write":154,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41946250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":17865937,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":185720,"num_write":153,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510326,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364752,"kb_used_data":135040,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94007088,"statfs":{"total":96636764160,"available":96263258112,"internally_reserved":0,"allocated":138280960,"data_stored":136104256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510328,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255716,"kb_used_data":25968,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116124,"statfs":{"total":96636764160,"available":96374910976,"internally_reserved":0,"allocated":26591232,"data_stored":24503671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510330,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178644,"kb_used_data":80776,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94193196,"statfs":{"total":96636764160,"available":96453832704,"internally_reserved":0,"allocated":82714624,"data_stored":80531231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510325,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238316,"kb_used_data":157148,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94133524,"statfs":{"total":96636764160,"available":96392728576,"internally_reserved":0,"allocated":160919552,"data_stored":158845075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510324,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394924,"kb_used_data":165212,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93976916,"statfs":{"total":96636764160,"available":96232361984,"internally_reserved":0,"allocated":169177088,"data_stored":167005594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510322,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200192,"kb_used_data":124592,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94171648,"statfs":{"total":96636764160,"available":96431767552,"internally_reserved":0,"allocated":127582208,"data_stored":125513021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510323,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":219268,"kb_used_data":97888,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94152572,"statfs":{"total":96636764160,"available":96412233728,"internally_reserved":0,"allocated":100237312,"data_stored":98121776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575733,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423392,"kb_used_data":175696,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93948448,"statfs":{"total":96636764160,"available":96203210752,"internally_reserved":0,"allocated":179912704,"data_stored":177775047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":107704320,"data_stored":107704320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40677376,"data_stored":40677376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40558592,"data_stored":40558592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33263616,"data_stored":33263616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32108544,"data_stored":32108544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11759616,"data_stored":11759616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22204416,"data_stored":22204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":29720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":9053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41946250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:15:50.815 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:15:50.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:15:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:15:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":2462,"stamp":"2024-09-12T01:15:49.319941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210746866,"num_objects":777,"num_object_clones":0,"num_object_copies":1823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":777,"num_whiteouts":0,"num_read":279380,"num_read_kb":3104823,"num_write":143417,"num_write_kb":2513039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14182,"ondisk_log_size":14182,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2275204,"kb_used_data":962320,"kb_used_omap":12,"kb_used_meta":1312627,"kb_avail":752699516,"statfs":{"total":773094113280,"available":770764304384,"internally_reserved":0,"allocated":985415680,"data_stored":968399671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1344130609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-513064071,"num_objects":-230,"num_object_clones":0,"num_object_copies":-661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-230,"num_whiteouts":0,"num_read":486,"num_read_kb":515,"num_write":354,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005263"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502105+0000","last_change":"2024-09-12T00:39:26.642397+0000","last_active":"2024-09-12T01:11:58.502105+0000","last_peered":"2024-09-12T01:11:58.502105+0000","last_clean":"2024-09-12T01:11:58.502105+0000","last_became_active":"2024-09-12T00:39:26.642090+0000","last_became_peered":"2024-09-12T00:39:26.642090+0000","last_unstale":"2024-09-12T01:11:58.502105+0000","last_undegraded":"2024-09-12T01:11:58.502105+0000","last_fullsized":"2024-09-12T01:11:58.502105+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:54.374892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.502826+0000","last_change":"2024-09-12T00:22:02.424471+0000","last_active":"2024-09-12T01:12:03.502826+0000","last_peered":"2024-09-12T01:12:03.502826+0000","last_clean":"2024-09-12T01:12:03.502826+0000","last_became_active":"2024-09-12T00:22:02.423867+0000","last_became_peered":"2024-09-12T00:22:02.423867+0000","last_unstale":"2024-09-12T01:12:03.502826+0000","last_undegraded":"2024-09-12T01:12:03.502826+0000","last_fullsized":"2024-09-12T01:12:03.502826+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.940652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.246266+0000","last_change":"2024-09-12T00:21:58.336211+0000","last_active":"2024-09-12T01:14:28.246266+0000","last_peered":"2024-09-12T01:14:28.246266+0000","last_clean":"2024-09-12T01:14:28.246266+0000","last_became_active":"2024-09-12T00:21:58.335882+0000","last_became_peered":"2024-09-12T00:21:58.335882+0000","last_unstale":"2024-09-12T01:14:28.246266+0000","last_undegraded":"2024-09-12T01:14:28.246266+0000","last_fullsized":"2024-09-12T01:14:28.246266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:06.306799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":322,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'60","reported_seq":223,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238949+0000","last_change":"2024-09-12T00:17:58.354178+0000","last_active":"2024-09-12T01:12:10.238949+0000","last_peered":"2024-09-12T01:12:10.238949+0000","last_clean":"2024-09-12T01:12:10.238949+0000","last_became_active":"2024-09-12T00:17:58.353889+0000","last_became_peered":"2024-09-12T00:17:58.353889+0000","last_unstale":"2024-09-12T01:12:10.238949+0000","last_undegraded":"2024-09-12T01:12:10.238949+0000","last_fullsized":"2024-09-12T01:12:10.238949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.435699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":209,"num_write":117,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221699+0000","last_change":"2024-09-12T00:39:26.637541+0000","last_active":"2024-09-12T01:11:58.221699+0000","last_peered":"2024-09-12T01:11:58.221699+0000","last_clean":"2024-09-12T01:11:58.221699+0000","last_became_active":"2024-09-12T00:39:26.637244+0000","last_became_peered":"2024-09-12T00:39:26.637244+0000","last_unstale":"2024-09-12T01:11:58.221699+0000","last_undegraded":"2024-09-12T01:11:58.221699+0000","last_fullsized":"2024-09-12T01:11:58.221699+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:40.343211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.390545+0000","last_change":"2024-09-12T00:22:02.421061+0000","last_active":"2024-09-12T01:12:03.390545+0000","last_peered":"2024-09-12T01:12:03.390545+0000","last_clean":"2024-09-12T01:12:03.390545+0000","last_became_active":"2024-09-12T00:22:02.420774+0000","last_became_peered":"2024-09-12T00:22:02.420774+0000","last_unstale":"2024-09-12T01:12:03.390545+0000","last_undegraded":"2024-09-12T01:12:03.390545+0000","last_fullsized":"2024-09-12T01:12:03.390545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:12.865558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229707+0000","last_change":"2024-09-12T00:21:58.338086+0000","last_active":"2024-09-12T01:11:58.229707+0000","last_peered":"2024-09-12T01:11:58.229707+0000","last_clean":"2024-09-12T01:11:58.229707+0000","last_became_active":"2024-09-12T00:21:58.336723+0000","last_became_peered":"2024-09-12T00:21:58.336723+0000","last_unstale":"2024-09-12T01:11:58.229707+0000","last_undegraded":"2024-09-12T01:11:58.229707+0000","last_fullsized":"2024-09-12T01:11:58.229707+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:29.016179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.223001+0000","last_change":"2024-09-12T00:17:58.361616+0000","last_active":"2024-09-12T01:12:08.223001+0000","last_peered":"2024-09-12T01:12:08.223001+0000","last_clean":"2024-09-12T01:12:08.223001+0000","last_became_active":"2024-09-12T00:17:58.361306+0000","last_became_peered":"2024-09-12T00:17:58.361306+0000","last_unstale":"2024-09-12T01:12:08.223001+0000","last_undegraded":"2024-09-12T01:12:08.223001+0000","last_fullsized":"2024-09-12T01:12:08.223001+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:11.973986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618592+0000","last_change":"2024-09-12T00:39:26.625650+0000","last_active":"2024-09-12T01:13:18.618592+0000","last_peered":"2024-09-12T01:13:18.618592+0000","last_clean":"2024-09-12T01:13:18.618592+0000","last_became_active":"2024-09-12T00:39:26.625454+0000","last_became_peered":"2024-09-12T00:39:26.625454+0000","last_unstale":"2024-09-12T01:13:18.618592+0000","last_undegraded":"2024-09-12T01:13:18.618592+0000","last_fullsized":"2024-09-12T01:13:18.618592+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:07.891692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238405+0000","last_change":"2024-09-12T00:22:02.422000+0000","last_active":"2024-09-12T01:12:05.238405+0000","last_peered":"2024-09-12T01:12:05.238405+0000","last_clean":"2024-09-12T01:12:05.238405+0000","last_became_active":"2024-09-12T00:22:02.421689+0000","last_became_peered":"2024-09-12T00:22:02.421689+0000","last_unstale":"2024-09-12T01:12:05.238405+0000","last_undegraded":"2024-09-12T01:12:05.238405+0000","last_fullsized":"2024-09-12T01:12:05.238405+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:25.931614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222987+0000","last_change":"2024-09-12T00:21:58.333094+0000","last_active":"2024-09-12T01:12:08.222987+0000","last_peered":"2024-09-12T01:12:08.222987+0000","last_clean":"2024-09-12T01:12:08.222987+0000","last_became_active":"2024-09-12T00:21:58.332782+0000","last_became_peered":"2024-09-12T00:21:58.332782+0000","last_unstale":"2024-09-12T01:12:08.222987+0000","last_undegraded":"2024-09-12T01:12:08.222987+0000","last_fullsized":"2024-09-12T01:12:08.222987+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:03.474793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'34","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244636+0000","last_change":"2024-09-12T00:17:58.353482+0000","last_active":"2024-09-12T01:13:00.244636+0000","last_peered":"2024-09-12T01:13:00.244636+0000","last_clean":"2024-09-12T01:13:00.244636+0000","last_became_active":"2024-09-12T00:17:58.353045+0000","last_became_peered":"2024-09-12T00:17:58.353045+0000","last_unstale":"2024-09-12T01:13:00.244636+0000","last_undegraded":"2024-09-12T01:13:00.244636+0000","last_fullsized":"2024-09-12T01:13:00.244636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:52.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.237224+0000","last_change":"2024-09-12T00:39:26.637464+0000","last_active":"2024-09-12T01:13:23.237224+0000","last_peered":"2024-09-12T01:13:23.237224+0000","last_clean":"2024-09-12T01:13:23.237224+0000","last_became_active":"2024-09-12T00:39:26.637185+0000","last_became_peered":"2024-09-12T00:39:26.637185+0000","last_unstale":"2024-09-12T01:13:23.237224+0000","last_undegraded":"2024-09-12T01:13:23.237224+0000","last_fullsized":"2024-09-12T01:13:23.237224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:20.137461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449572+0000","last_change":"2024-09-12T00:22:02.428079+0000","last_active":"2024-09-12T01:12:08.449572+0000","last_peered":"2024-09-12T01:12:08.449572+0000","last_clean":"2024-09-12T01:12:08.449572+0000","last_became_active":"2024-09-12T00:22:02.427612+0000","last_became_peered":"2024-09-12T00:22:02.427612+0000","last_unstale":"2024-09-12T01:12:08.449572+0000","last_undegraded":"2024-09-12T01:12:08.449572+0000","last_fullsized":"2024-09-12T01:12:08.449572+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:46.790157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.389901+0000","last_change":"2024-09-12T00:21:58.335917+0000","last_active":"2024-09-12T01:11:58.389901+0000","last_peered":"2024-09-12T01:11:58.389901+0000","last_clean":"2024-09-12T01:11:58.389901+0000","last_became_active":"2024-09-12T00:21:58.335619+0000","last_became_peered":"2024-09-12T00:21:58.335619+0000","last_unstale":"2024-09-12T01:11:58.389901+0000","last_undegraded":"2024-09-12T01:11:58.389901+0000","last_fullsized":"2024-09-12T01:11:58.389901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.724726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455358+0000","last_change":"2024-09-12T00:17:58.356021+0000","last_active":"2024-09-12T01:12:58.455358+0000","last_peered":"2024-09-12T01:12:58.455358+0000","last_clean":"2024-09-12T01:12:58.455358+0000","last_became_active":"2024-09-12T00:17:58.355691+0000","last_became_peered":"2024-09-12T00:17:58.355691+0000","last_unstale":"2024-09-12T01:12:58.455358+0000","last_undegraded":"2024-09-12T01:12:58.455358+0000","last_fullsized":"2024-09-12T01:12:58.455358+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:23.027551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238400+0000","last_change":"2024-09-12T00:39:26.635830+0000","last_active":"2024-09-12T01:13:33.238400+0000","last_peered":"2024-09-12T01:13:33.238400+0000","last_clean":"2024-09-12T01:13:33.238400+0000","last_became_active":"2024-09-12T00:39:26.635537+0000","last_became_peered":"2024-09-12T00:39:26.635537+0000","last_unstale":"2024-09-12T01:13:33.238400+0000","last_undegraded":"2024-09-12T01:13:33.238400+0000","last_fullsized":"2024-09-12T01:13:33.238400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:16.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510161+0000","last_change":"2024-09-12T00:22:02.429586+0000","last_active":"2024-09-12T01:12:53.510161+0000","last_peered":"2024-09-12T01:12:53.510161+0000","last_clean":"2024-09-12T01:12:53.510161+0000","last_became_active":"2024-09-12T00:22:02.429230+0000","last_became_peered":"2024-09-12T00:22:02.429230+0000","last_unstale":"2024-09-12T01:12:53.510161+0000","last_undegraded":"2024-09-12T01:12:53.510161+0000","last_fullsized":"2024-09-12T01:12:53.510161+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:50.744822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242639+0000","last_change":"2024-09-12T00:21:58.338788+0000","last_active":"2024-09-12T01:12:45.242639+0000","last_peered":"2024-09-12T01:12:45.242639+0000","last_clean":"2024-09-12T01:12:45.242639+0000","last_became_active":"2024-09-12T00:21:58.338021+0000","last_became_peered":"2024-09-12T00:21:58.338021+0000","last_unstale":"2024-09-12T01:12:45.242639+0000","last_undegraded":"2024-09-12T01:12:45.242639+0000","last_fullsized":"2024-09-12T01:12:45.242639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:31.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'22","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455331+0000","last_change":"2024-09-12T00:17:58.358082+0000","last_active":"2024-09-12T01:12:58.455331+0000","last_peered":"2024-09-12T01:12:58.455331+0000","last_clean":"2024-09-12T01:12:58.455331+0000","last_became_active":"2024-09-12T00:17:58.357755+0000","last_became_peered":"2024-09-12T00:17:58.357755+0000","last_unstale":"2024-09-12T01:12:58.455331+0000","last_undegraded":"2024-09-12T01:12:58.455331+0000","last_fullsized":"2024-09-12T01:12:58.455331+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:17.853509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.235439+0000","last_change":"2024-09-12T00:39:26.631339+0000","last_active":"2024-09-12T01:12:48.235439+0000","last_peered":"2024-09-12T01:12:48.235439+0000","last_clean":"2024-09-12T01:12:48.235439+0000","last_became_active":"2024-09-12T00:39:26.630758+0000","last_became_peered":"2024-09-12T00:39:26.630758+0000","last_unstale":"2024-09-12T01:12:48.235439+0000","last_undegraded":"2024-09-12T01:12:48.235439+0000","last_fullsized":"2024-09-12T01:12:48.235439+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.184229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'5","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041261+0000","last_change":"2024-09-12T00:22:02.428161+0000","last_active":"2024-09-12T01:15:48.041261+0000","last_peered":"2024-09-12T01:15:48.041261+0000","last_clean":"2024-09-12T01:15:48.041261+0000","last_became_active":"2024-09-12T00:22:02.427863+0000","last_became_peered":"2024-09-12T00:22:02.427863+0000","last_unstale":"2024-09-12T01:15:48.041261+0000","last_undegraded":"2024-09-12T01:15:48.041261+0000","last_fullsized":"2024-09-12T01:15:48.041261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:46.107765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":40,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397371+0000","last_change":"2024-09-12T00:21:58.330893+0000","last_active":"2024-09-12T01:12:53.397371+0000","last_peered":"2024-09-12T01:12:53.397371+0000","last_clean":"2024-09-12T01:12:53.397371+0000","last_became_active":"2024-09-12T00:21:58.330308+0000","last_became_peered":"2024-09-12T00:21:58.330308+0000","last_unstale":"2024-09-12T01:12:53.397371+0000","last_undegraded":"2024-09-12T01:12:53.397371+0000","last_fullsized":"2024-09-12T01:12:53.397371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.864549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'33","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616030+0000","last_change":"2024-09-12T00:17:58.360675+0000","last_active":"2024-09-12T01:12:58.616030+0000","last_peered":"2024-09-12T01:12:58.616030+0000","last_clean":"2024-09-12T01:12:58.616030+0000","last_became_active":"2024-09-12T00:17:58.360394+0000","last_became_peered":"2024-09-12T00:17:58.360394+0000","last_unstale":"2024-09-12T01:12:58.616030+0000","last_undegraded":"2024-09-12T01:12:58.616030+0000","last_fullsized":"2024-09-12T01:12:58.616030+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:36.476994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":120,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391380+0000","last_change":"2024-09-12T00:39:26.638745+0000","last_active":"2024-09-12T01:11:58.391380+0000","last_peered":"2024-09-12T01:11:58.391380+0000","last_clean":"2024-09-12T01:11:58.391380+0000","last_became_active":"2024-09-12T00:39:26.638443+0000","last_became_peered":"2024-09-12T00:39:26.638443+0000","last_unstale":"2024-09-12T01:11:58.391380+0000","last_undegraded":"2024-09-12T01:11:58.391380+0000","last_fullsized":"2024-09-12T01:11:58.391380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:39.177058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"264'5","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608465+0000","last_change":"2024-09-12T00:22:02.420219+0000","last_active":"2024-09-12T01:12:03.608465+0000","last_peered":"2024-09-12T01:12:03.608465+0000","last_clean":"2024-09-12T01:12:03.608465+0000","last_became_active":"2024-09-12T00:22:02.419920+0000","last_became_peered":"2024-09-12T00:22:02.419920+0000","last_unstale":"2024-09-12T01:12:03.608465+0000","last_undegraded":"2024-09-12T01:12:03.608465+0000","last_fullsized":"2024-09-12T01:12:03.608465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.257546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6462,"num_write":5,"num_write_kb":6462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.057954+0000","last_change":"2024-09-12T00:21:58.334923+0000","last_active":"2024-09-12T01:15:48.057954+0000","last_peered":"2024-09-12T01:15:48.057954+0000","last_clean":"2024-09-12T01:15:48.057954+0000","last_became_active":"2024-09-12T00:21:58.334622+0000","last_became_peered":"2024-09-12T00:21:58.334622+0000","last_unstale":"2024-09-12T01:15:48.057954+0000","last_undegraded":"2024-09-12T01:15:48.057954+0000","last_fullsized":"2024-09-12T01:15:48.057954+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:27.246572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'18","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.233636+0000","last_change":"2024-09-12T00:17:58.362164+0000","last_active":"2024-09-12T01:11:25.233636+0000","last_peered":"2024-09-12T01:11:25.233636+0000","last_clean":"2024-09-12T01:11:25.233636+0000","last_became_active":"2024-09-12T00:17:58.361620+0000","last_became_peered":"2024-09-12T00:17:58.361620+0000","last_unstale":"2024-09-12T01:11:25.233636+0000","last_undegraded":"2024-09-12T01:11:25.233636+0000","last_fullsized":"2024-09-12T01:11:25.233636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:00.693430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391431+0000","last_change":"2024-09-12T00:39:26.643583+0000","last_active":"2024-09-12T01:11:58.391431+0000","last_peered":"2024-09-12T01:11:58.391431+0000","last_clean":"2024-09-12T01:11:58.391431+0000","last_became_active":"2024-09-12T00:39:26.643223+0000","last_became_peered":"2024-09-12T00:39:26.643223+0000","last_unstale":"2024-09-12T01:11:58.391431+0000","last_undegraded":"2024-09-12T01:11:58.391431+0000","last_fullsized":"2024-09-12T01:11:58.391431+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:18.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'5","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066478+0000","last_change":"2024-09-12T00:22:22.312042+0000","last_active":"2024-09-12T01:15:48.066478+0000","last_peered":"2024-09-12T01:15:48.066478+0000","last_clean":"2024-09-12T01:15:48.066478+0000","last_became_active":"2024-09-12T00:22:22.311701+0000","last_became_peered":"2024-09-12T00:22:22.311701+0000","last_unstale":"2024-09-12T01:15:48.066478+0000","last_undegraded":"2024-09-12T01:15:48.066478+0000","last_fullsized":"2024-09-12T01:15:48.066478+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.780165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":5,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237766+0000","last_change":"2024-09-12T00:21:58.339874+0000","last_active":"2024-09-12T01:12:00.237766+0000","last_peered":"2024-09-12T01:12:00.237766+0000","last_clean":"2024-09-12T01:12:00.237766+0000","last_became_active":"2024-09-12T00:21:58.339586+0000","last_became_peered":"2024-09-12T00:21:58.339586+0000","last_unstale":"2024-09-12T01:12:00.237766+0000","last_undegraded":"2024-09-12T01:12:00.237766+0000","last_fullsized":"2024-09-12T01:12:00.237766+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:27.131816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'26","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.223825+0000","last_change":"2024-09-12T00:17:58.352434+0000","last_active":"2024-09-12T01:11:08.223825+0000","last_peered":"2024-09-12T01:11:08.223825+0000","last_clean":"2024-09-12T01:11:08.223825+0000","last_became_active":"2024-09-12T00:17:58.352129+0000","last_became_peered":"2024-09-12T00:17:58.352129+0000","last_unstale":"2024-09-12T01:11:08.223825+0000","last_undegraded":"2024-09-12T01:11:08.223825+0000","last_fullsized":"2024-09-12T01:11:08.223825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:16.704935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230767+0000","last_change":"2024-09-12T00:39:26.636027+0000","last_active":"2024-09-12T01:12:08.230767+0000","last_peered":"2024-09-12T01:12:08.230767+0000","last_clean":"2024-09-12T01:12:08.230767+0000","last_became_active":"2024-09-12T00:39:26.635558+0000","last_became_peered":"2024-09-12T00:39:26.635558+0000","last_unstale":"2024-09-12T01:12:08.230767+0000","last_undegraded":"2024-09-12T01:12:08.230767+0000","last_fullsized":"2024-09-12T01:12:08.230767+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.105963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.252261+0000","last_change":"2024-09-12T00:22:02.427487+0000","last_active":"2024-09-12T01:15:13.252261+0000","last_peered":"2024-09-12T01:15:13.252261+0000","last_clean":"2024-09-12T01:15:13.252261+0000","last_became_active":"2024-09-12T00:22:02.427180+0000","last_became_peered":"2024-09-12T00:22:02.427180+0000","last_unstale":"2024-09-12T01:15:13.252261+0000","last_undegraded":"2024-09-12T01:15:13.252261+0000","last_fullsized":"2024-09-12T01:15:13.252261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:40.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.535314+0000","last_change":"2024-09-12T00:21:58.334729+0000","last_active":"2024-09-12T01:15:43.535314+0000","last_peered":"2024-09-12T01:15:43.535314+0000","last_clean":"2024-09-12T01:15:43.535314+0000","last_became_active":"2024-09-12T00:21:58.334446+0000","last_became_peered":"2024-09-12T00:21:58.334446+0000","last_unstale":"2024-09-12T01:15:43.535314+0000","last_undegraded":"2024-09-12T01:15:43.535314+0000","last_fullsized":"2024-09-12T01:15:43.535314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:37.568023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'14","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.232052+0000","last_change":"2024-09-12T00:17:58.360971+0000","last_active":"2024-09-12T01:11:10.232052+0000","last_peered":"2024-09-12T01:11:10.232052+0000","last_clean":"2024-09-12T01:11:10.232052+0000","last_became_active":"2024-09-12T00:17:58.360560+0000","last_became_peered":"2024-09-12T00:17:58.360560+0000","last_unstale":"2024-09-12T01:11:10.232052+0000","last_undegraded":"2024-09-12T01:11:10.232052+0000","last_fullsized":"2024-09-12T01:11:10.232052+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:20.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222918+0000","last_change":"2024-09-12T00:39:26.635643+0000","last_active":"2024-09-12T01:12:08.222918+0000","last_peered":"2024-09-12T01:12:08.222918+0000","last_clean":"2024-09-12T01:12:08.222918+0000","last_became_active":"2024-09-12T00:39:26.635359+0000","last_became_peered":"2024-09-12T00:39:26.635359+0000","last_unstale":"2024-09-12T01:12:08.222918+0000","last_undegraded":"2024-09-12T01:12:08.222918+0000","last_fullsized":"2024-09-12T01:12:08.222918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.949344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238347+0000","last_change":"2024-09-12T00:22:02.432403+0000","last_active":"2024-09-12T01:13:33.238347+0000","last_peered":"2024-09-12T01:13:33.238347+0000","last_clean":"2024-09-12T01:13:33.238347+0000","last_became_active":"2024-09-12T00:22:02.431994+0000","last_became_peered":"2024-09-12T00:22:02.431994+0000","last_unstale":"2024-09-12T01:13:33.238347+0000","last_undegraded":"2024-09-12T01:13:33.238347+0000","last_fullsized":"2024-09-12T01:13:33.238347+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.483552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397576+0000","last_change":"2024-09-12T00:21:58.327781+0000","last_active":"2024-09-12T01:12:43.397576+0000","last_peered":"2024-09-12T01:12:43.397576+0000","last_clean":"2024-09-12T01:12:43.397576+0000","last_became_active":"2024-09-12T00:21:58.327504+0000","last_became_peered":"2024-09-12T00:21:58.327504+0000","last_unstale":"2024-09-12T01:12:43.397576+0000","last_undegraded":"2024-09-12T01:12:43.397576+0000","last_fullsized":"2024-09-12T01:12:43.397576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:09.606355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'62","reported_seq":221,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.442193+0000","last_change":"2024-09-12T00:17:58.360373+0000","last_active":"2024-09-12T01:11:08.442193+0000","last_peered":"2024-09-12T01:11:08.442193+0000","last_clean":"2024-09-12T01:11:08.442193+0000","last_became_active":"2024-09-12T00:17:58.360095+0000","last_became_peered":"2024-09-12T00:17:58.360095+0000","last_unstale":"2024-09-12T01:11:08.442193+0000","last_undegraded":"2024-09-12T01:11:08.442193+0000","last_fullsized":"2024-09-12T01:11:08.442193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:39.437158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":213,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392762+0000","last_change":"2024-09-12T00:39:26.639982+0000","last_active":"2024-09-12T01:12:08.392762+0000","last_peered":"2024-09-12T01:12:08.392762+0000","last_clean":"2024-09-12T01:12:08.392762+0000","last_became_active":"2024-09-12T00:39:26.639681+0000","last_became_peered":"2024-09-12T00:39:26.639681+0000","last_unstale":"2024-09-12T01:12:08.392762+0000","last_undegraded":"2024-09-12T01:12:08.392762+0000","last_fullsized":"2024-09-12T01:12:08.392762+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:35.336644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.454200+0000","last_change":"2024-09-12T00:22:02.427581+0000","last_active":"2024-09-12T01:12:48.454200+0000","last_peered":"2024-09-12T01:12:48.454200+0000","last_clean":"2024-09-12T01:12:48.454200+0000","last_became_active":"2024-09-12T00:22:02.427285+0000","last_became_peered":"2024-09-12T00:22:02.427285+0000","last_unstale":"2024-09-12T01:12:48.454200+0000","last_undegraded":"2024-09-12T01:12:48.454200+0000","last_fullsized":"2024-09-12T01:12:48.454200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:22.119778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.227172+0000","last_change":"2024-09-12T00:21:58.335430+0000","last_active":"2024-09-12T01:12:43.227172+0000","last_peered":"2024-09-12T01:12:43.227172+0000","last_clean":"2024-09-12T01:12:43.227172+0000","last_became_active":"2024-09-12T00:21:58.335100+0000","last_became_peered":"2024-09-12T00:21:58.335100+0000","last_unstale":"2024-09-12T01:12:43.227172+0000","last_undegraded":"2024-09-12T01:12:43.227172+0000","last_fullsized":"2024-09-12T01:12:43.227172+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:24.939276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'91","reported_seq":369,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.216774+0000","last_change":"2024-09-12T00:17:58.350821+0000","last_active":"2024-09-12T01:11:08.216774+0000","last_peered":"2024-09-12T01:11:08.216774+0000","last_clean":"2024-09-12T01:11:08.216774+0000","last_became_active":"2024-09-12T00:17:58.350522+0000","last_became_peered":"2024-09-12T00:17:58.350522+0000","last_unstale":"2024-09-12T01:11:08.216774+0000","last_undegraded":"2024-09-12T01:11:08.216774+0000","last_fullsized":"2024-09-12T01:11:08.216774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.821787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":413,"num_write":129,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503487+0000","last_change":"2024-09-12T00:39:26.642765+0000","last_active":"2024-09-12T01:12:08.503487+0000","last_peered":"2024-09-12T01:12:08.503487+0000","last_clean":"2024-09-12T01:12:08.503487+0000","last_became_active":"2024-09-12T00:39:26.642486+0000","last_became_peered":"2024-09-12T00:39:26.642486+0000","last_unstale":"2024-09-12T01:12:08.503487+0000","last_undegraded":"2024-09-12T01:12:08.503487+0000","last_fullsized":"2024-09-12T01:12:08.503487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:37.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396598+0000","last_change":"2024-09-12T00:22:02.418272+0000","last_active":"2024-09-12T01:12:48.396598+0000","last_peered":"2024-09-12T01:12:48.396598+0000","last_clean":"2024-09-12T01:12:48.396598+0000","last_became_active":"2024-09-12T00:22:02.417518+0000","last_became_peered":"2024-09-12T00:22:02.417518+0000","last_unstale":"2024-09-12T01:12:48.396598+0000","last_undegraded":"2024-09-12T01:12:48.396598+0000","last_fullsized":"2024-09-12T01:12:48.396598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.931899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'10","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242751+0000","last_change":"2024-09-12T00:21:58.337365+0000","last_active":"2024-09-12T01:12:45.242751+0000","last_peered":"2024-09-12T01:12:45.242751+0000","last_clean":"2024-09-12T01:12:45.242751+0000","last_became_active":"2024-09-12T00:21:58.337079+0000","last_became_peered":"2024-09-12T00:21:58.337079+0000","last_unstale":"2024-09-12T01:12:45.242751+0000","last_undegraded":"2024-09-12T01:12:45.242751+0000","last_fullsized":"2024-09-12T01:12:45.242751+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.875541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":24618,"num_write":20,"num_write_kb":14376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'26","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390038+0000","last_change":"2024-09-12T00:17:58.360573+0000","last_active":"2024-09-12T01:11:48.390038+0000","last_peered":"2024-09-12T01:11:48.390038+0000","last_clean":"2024-09-12T01:11:48.390038+0000","last_became_active":"2024-09-12T00:17:58.360141+0000","last_became_peered":"2024-09-12T00:17:58.360141+0000","last_unstale":"2024-09-12T01:11:48.390038+0000","last_undegraded":"2024-09-12T01:11:48.390038+0000","last_fullsized":"2024-09-12T01:11:48.390038+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.883700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236768+0000","last_change":"2024-09-12T00:39:26.636792+0000","last_active":"2024-09-12T01:13:18.236768+0000","last_peered":"2024-09-12T01:13:18.236768+0000","last_clean":"2024-09-12T01:13:18.236768+0000","last_became_active":"2024-09-12T00:39:26.636434+0000","last_became_peered":"2024-09-12T00:39:26.636434+0000","last_unstale":"2024-09-12T01:13:18.236768+0000","last_undegraded":"2024-09-12T01:13:18.236768+0000","last_fullsized":"2024-09-12T01:13:18.236768+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:17.120295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256725+0000","last_change":"2024-09-12T00:22:02.420813+0000","last_active":"2024-09-12T01:15:43.256725+0000","last_peered":"2024-09-12T01:15:43.256725+0000","last_clean":"2024-09-12T01:15:43.256725+0000","last_became_active":"2024-09-12T00:22:02.420528+0000","last_became_peered":"2024-09-12T00:22:02.420528+0000","last_unstale":"2024-09-12T01:15:43.256725+0000","last_undegraded":"2024-09-12T01:15:43.256725+0000","last_fullsized":"2024-09-12T01:15:43.256725+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:36.557751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:38.274384+0000","last_change":"2024-09-12T00:21:58.337490+0000","last_active":"2024-09-12T01:15:38.274384+0000","last_peered":"2024-09-12T01:15:38.274384+0000","last_clean":"2024-09-12T01:15:38.274384+0000","last_became_active":"2024-09-12T00:21:58.337215+0000","last_became_peered":"2024-09-12T00:21:58.337215+0000","last_unstale":"2024-09-12T01:15:38.274384+0000","last_undegraded":"2024-09-12T01:15:38.274384+0000","last_fullsized":"2024-09-12T01:15:38.274384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.089070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.388739+0000","last_change":"2024-09-12T00:17:58.360965+0000","last_active":"2024-09-12T01:11:38.388739+0000","last_peered":"2024-09-12T01:11:38.388739+0000","last_clean":"2024-09-12T01:11:38.388739+0000","last_became_active":"2024-09-12T00:17:58.360592+0000","last_became_peered":"2024-09-12T00:17:58.360592+0000","last_unstale":"2024-09-12T01:11:38.388739+0000","last_undegraded":"2024-09-12T01:11:38.388739+0000","last_fullsized":"2024-09-12T01:11:38.388739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:45.213272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.247005+0000","last_change":"2024-09-12T00:39:26.641706+0000","last_active":"2024-09-12T01:13:20.247005+0000","last_peered":"2024-09-12T01:13:20.247005+0000","last_clean":"2024-09-12T01:13:20.247005+0000","last_became_active":"2024-09-12T00:39:26.641432+0000","last_became_peered":"2024-09-12T00:39:26.641432+0000","last_unstale":"2024-09-12T01:13:20.247005+0000","last_undegraded":"2024-09-12T01:13:20.247005+0000","last_fullsized":"2024-09-12T01:13:20.247005+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.345745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.239133+0000","last_change":"2024-09-12T00:22:02.423461+0000","last_active":"2024-09-12T01:13:23.239133+0000","last_peered":"2024-09-12T01:13:23.239133+0000","last_clean":"2024-09-12T01:13:23.239133+0000","last_became_active":"2024-09-12T00:22:02.423012+0000","last_became_peered":"2024-09-12T00:22:02.423012+0000","last_unstale":"2024-09-12T01:13:23.239133+0000","last_undegraded":"2024-09-12T01:13:23.239133+0000","last_fullsized":"2024-09-12T01:13:23.239133+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:14.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236682+0000","last_change":"2024-09-12T00:21:58.334875+0000","last_active":"2024-09-12T01:13:18.236682+0000","last_peered":"2024-09-12T01:13:18.236682+0000","last_clean":"2024-09-12T01:13:18.236682+0000","last_became_active":"2024-09-12T00:21:58.334493+0000","last_became_peered":"2024-09-12T00:21:58.334493+0000","last_unstale":"2024-09-12T01:13:18.236682+0000","last_undegraded":"2024-09-12T01:13:18.236682+0000","last_fullsized":"2024-09-12T01:13:18.236682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:46.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'39","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235549+0000","last_change":"2024-09-12T00:17:58.355241+0000","last_active":"2024-09-12T01:11:40.235549+0000","last_peered":"2024-09-12T01:11:40.235549+0000","last_clean":"2024-09-12T01:11:40.235549+0000","last_became_active":"2024-09-12T00:17:58.354989+0000","last_became_peered":"2024-09-12T00:17:58.354989+0000","last_unstale":"2024-09-12T01:11:40.235549+0000","last_undegraded":"2024-09-12T01:11:40.235549+0000","last_fullsized":"2024-09-12T01:11:40.235549+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:24.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":70,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240008+0000","last_change":"2024-09-12T00:39:26.630455+0000","last_active":"2024-09-12T01:12:20.240008+0000","last_peered":"2024-09-12T01:12:20.240008+0000","last_clean":"2024-09-12T01:12:20.240008+0000","last_became_active":"2024-09-12T00:39:26.627899+0000","last_became_peered":"2024-09-12T00:39:26.627899+0000","last_unstale":"2024-09-12T01:12:20.240008+0000","last_undegraded":"2024-09-12T01:12:20.240008+0000","last_fullsized":"2024-09-12T01:12:20.240008+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:19.704293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256860+0000","last_change":"2024-09-12T00:22:02.428036+0000","last_active":"2024-09-12T01:15:43.256860+0000","last_peered":"2024-09-12T01:15:43.256860+0000","last_clean":"2024-09-12T01:15:43.256860+0000","last_became_active":"2024-09-12T00:22:02.427322+0000","last_became_peered":"2024-09-12T00:22:02.427322+0000","last_unstale":"2024-09-12T01:15:43.256860+0000","last_undegraded":"2024-09-12T01:15:43.256860+0000","last_fullsized":"2024-09-12T01:15:43.256860+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:40.144405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618639+0000","last_change":"2024-09-12T00:21:58.329454+0000","last_active":"2024-09-12T01:13:18.618639+0000","last_peered":"2024-09-12T01:13:18.618639+0000","last_clean":"2024-09-12T01:13:18.618639+0000","last_became_active":"2024-09-12T00:21:58.329166+0000","last_became_peered":"2024-09-12T00:21:58.329166+0000","last_unstale":"2024-09-12T01:13:18.618639+0000","last_undegraded":"2024-09-12T01:13:18.618639+0000","last_fullsized":"2024-09-12T01:13:18.618639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:00.444000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'42","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386895+0000","last_change":"2024-09-12T00:17:58.355842+0000","last_active":"2024-09-12T01:11:38.386895+0000","last_peered":"2024-09-12T01:11:38.386895+0000","last_clean":"2024-09-12T01:11:38.386895+0000","last_became_active":"2024-09-12T00:17:58.355530+0000","last_became_peered":"2024-09-12T00:17:58.355530+0000","last_unstale":"2024-09-12T01:11:38.386895+0000","last_undegraded":"2024-09-12T01:11:38.386895+0000","last_fullsized":"2024-09-12T01:11:38.386895+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:00.979655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":155,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236747+0000","last_change":"2024-09-12T00:39:26.636645+0000","last_active":"2024-09-12T01:13:18.236747+0000","last_peered":"2024-09-12T01:13:18.236747+0000","last_clean":"2024-09-12T01:13:18.236747+0000","last_became_active":"2024-09-12T00:39:26.635996+0000","last_became_peered":"2024-09-12T00:39:26.635996+0000","last_unstale":"2024-09-12T01:13:18.236747+0000","last_undegraded":"2024-09-12T01:13:18.236747+0000","last_fullsized":"2024-09-12T01:13:18.236747+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:54.401173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.619395+0000","last_change":"2024-09-12T00:22:02.424107+0000","last_active":"2024-09-12T01:13:23.619395+0000","last_peered":"2024-09-12T01:13:23.619395+0000","last_clean":"2024-09-12T01:13:23.619395+0000","last_became_active":"2024-09-12T00:22:02.423766+0000","last_became_peered":"2024-09-12T00:22:02.423766+0000","last_unstale":"2024-09-12T01:13:23.619395+0000","last_undegraded":"2024-09-12T01:13:23.619395+0000","last_fullsized":"2024-09-12T01:13:23.619395+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:45.304079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.514151+0000","last_change":"2024-09-12T00:21:58.334763+0000","last_active":"2024-09-12T01:13:18.514151+0000","last_peered":"2024-09-12T01:13:18.514151+0000","last_clean":"2024-09-12T01:13:18.514151+0000","last_became_active":"2024-09-12T00:21:58.334482+0000","last_became_peered":"2024-09-12T00:21:58.334482+0000","last_unstale":"2024-09-12T01:13:18.514151+0000","last_undegraded":"2024-09-12T01:13:18.514151+0000","last_fullsized":"2024-09-12T01:13:18.514151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.615431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'8","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.445588+0000","last_change":"2024-09-12T00:17:58.357504+0000","last_active":"2024-09-12T01:11:38.445588+0000","last_peered":"2024-09-12T01:11:38.445588+0000","last_clean":"2024-09-12T01:11:38.445588+0000","last_became_active":"2024-09-12T00:17:58.357226+0000","last_became_peered":"2024-09-12T00:17:58.357226+0000","last_unstale":"2024-09-12T01:11:38.445588+0000","last_undegraded":"2024-09-12T01:11:38.445588+0000","last_fullsized":"2024-09-12T01:11:38.445588+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.150821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222890+0000","last_change":"2024-09-12T00:39:26.638504+0000","last_active":"2024-09-12T01:12:08.222890+0000","last_peered":"2024-09-12T01:12:08.222890+0000","last_clean":"2024-09-12T01:12:08.222890+0000","last_became_active":"2024-09-12T00:39:26.638202+0000","last_became_peered":"2024-09-12T00:39:26.638202+0000","last_unstale":"2024-09-12T01:12:08.222890+0000","last_undegraded":"2024-09-12T01:12:08.222890+0000","last_fullsized":"2024-09-12T01:12:08.222890+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:29.584845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.445007+0000","last_change":"2024-09-12T00:22:02.428671+0000","last_active":"2024-09-12T01:11:33.445007+0000","last_peered":"2024-09-12T01:11:33.445007+0000","last_clean":"2024-09-12T01:11:33.445007+0000","last_became_active":"2024-09-12T00:22:02.427762+0000","last_became_peered":"2024-09-12T00:22:02.427762+0000","last_unstale":"2024-09-12T01:11:33.445007+0000","last_undegraded":"2024-09-12T01:11:33.445007+0000","last_fullsized":"2024-09-12T01:11:33.445007+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:44.251003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"267'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010703+0000","last_change":"2024-09-12T00:21:58.338414+0000","last_active":"2024-09-12T01:15:48.010703+0000","last_peered":"2024-09-12T01:15:48.010703+0000","last_clean":"2024-09-12T01:15:48.010703+0000","last_became_active":"2024-09-12T00:21:58.338104+0000","last_became_peered":"2024-09-12T00:21:58.338104+0000","last_unstale":"2024-09-12T01:15:48.010703+0000","last_undegraded":"2024-09-12T01:15:48.010703+0000","last_fullsized":"2024-09-12T01:15:48.010703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:51.139680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10244,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'33","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.448982+0000","last_change":"2024-09-12T00:17:58.352171+0000","last_active":"2024-09-12T01:12:03.448982+0000","last_peered":"2024-09-12T01:12:03.448982+0000","last_clean":"2024-09-12T01:12:03.448982+0000","last_became_active":"2024-09-12T00:17:58.351876+0000","last_became_peered":"2024-09-12T00:17:58.351876+0000","last_unstale":"2024-09-12T01:12:03.448982+0000","last_undegraded":"2024-09-12T01:12:03.448982+0000","last_fullsized":"2024-09-12T01:12:03.448982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.992607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":110,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401591+0000","last_change":"2024-09-12T00:39:26.640188+0000","last_active":"2024-09-12T01:13:13.401591+0000","last_peered":"2024-09-12T01:13:13.401591+0000","last_clean":"2024-09-12T01:13:13.401591+0000","last_became_active":"2024-09-12T00:39:26.639704+0000","last_became_peered":"2024-09-12T00:39:26.639704+0000","last_unstale":"2024-09-12T01:13:13.401591+0000","last_undegraded":"2024-09-12T01:13:13.401591+0000","last_fullsized":"2024-09-12T01:13:13.401591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.680724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'6","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.009468+0000","last_change":"2024-09-12T00:22:02.430308+0000","last_active":"2024-09-12T01:15:48.009468+0000","last_peered":"2024-09-12T01:15:48.009468+0000","last_clean":"2024-09-12T01:15:48.009468+0000","last_became_active":"2024-09-12T00:22:02.430034+0000","last_became_peered":"2024-09-12T00:22:02.430034+0000","last_unstale":"2024-09-12T01:15:48.009468+0000","last_undegraded":"2024-09-12T01:15:48.009468+0000","last_fullsized":"2024-09-12T01:15:48.009468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.194625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'4","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.233384+0000","last_change":"2024-09-12T00:21:58.333427+0000","last_active":"2024-09-12T01:13:43.233384+0000","last_peered":"2024-09-12T01:13:43.233384+0000","last_clean":"2024-09-12T01:13:43.233384+0000","last_became_active":"2024-09-12T00:21:58.333135+0000","last_became_peered":"2024-09-12T00:21:58.333135+0000","last_unstale":"2024-09-12T01:13:43.233384+0000","last_undegraded":"2024-09-12T01:13:43.233384+0000","last_fullsized":"2024-09-12T01:13:43.233384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:11.164534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'34","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502186+0000","last_change":"2024-09-12T00:17:58.360392+0000","last_active":"2024-09-12T01:11:58.502186+0000","last_peered":"2024-09-12T01:11:58.502186+0000","last_clean":"2024-09-12T01:11:58.502186+0000","last_became_active":"2024-09-12T00:17:58.360064+0000","last_became_peered":"2024-09-12T00:17:58.360064+0000","last_unstale":"2024-09-12T01:11:58.502186+0000","last_undegraded":"2024-09-12T01:11:58.502186+0000","last_fullsized":"2024-09-12T01:11:58.502186+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:06.356739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":114,"num_write":67,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607743+0000","last_change":"2024-09-12T00:39:26.620334+0000","last_active":"2024-09-12T01:11:58.607743+0000","last_peered":"2024-09-12T01:11:58.607743+0000","last_clean":"2024-09-12T01:11:58.607743+0000","last_became_active":"2024-09-12T00:39:26.620012+0000","last_became_peered":"2024-09-12T00:39:26.620012+0000","last_unstale":"2024-09-12T01:11:58.607743+0000","last_undegraded":"2024-09-12T01:11:58.607743+0000","last_fullsized":"2024-09-12T01:11:58.607743+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.575760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.228663+0000","last_change":"2024-09-12T00:22:02.420815+0000","last_active":"2024-09-12T01:11:48.228663+0000","last_peered":"2024-09-12T01:11:48.228663+0000","last_clean":"2024-09-12T01:11:48.228663+0000","last_became_active":"2024-09-12T00:22:02.420536+0000","last_became_peered":"2024-09-12T00:22:02.420536+0000","last_unstale":"2024-09-12T01:11:48.228663+0000","last_undegraded":"2024-09-12T01:11:48.228663+0000","last_fullsized":"2024-09-12T01:11:48.228663+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:29.069188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.234276+0000","last_change":"2024-09-12T00:21:58.339677+0000","last_active":"2024-09-12T01:11:30.234276+0000","last_peered":"2024-09-12T01:11:30.234276+0000","last_clean":"2024-09-12T01:11:30.234276+0000","last_became_active":"2024-09-12T00:21:58.339390+0000","last_became_peered":"2024-09-12T00:21:58.339390+0000","last_unstale":"2024-09-12T01:11:30.234276+0000","last_undegraded":"2024-09-12T01:11:30.234276+0000","last_fullsized":"2024-09-12T01:11:30.234276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:52.122856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'22","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607816+0000","last_change":"2024-09-12T00:17:58.355891+0000","last_active":"2024-09-12T01:11:58.607816+0000","last_peered":"2024-09-12T01:11:58.607816+0000","last_clean":"2024-09-12T01:11:58.607816+0000","last_became_active":"2024-09-12T00:17:58.355602+0000","last_became_peered":"2024-09-12T00:17:58.355602+0000","last_unstale":"2024-09-12T01:11:58.607816+0000","last_undegraded":"2024-09-12T01:11:58.607816+0000","last_fullsized":"2024-09-12T01:11:58.607816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:26.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391317+0000","last_change":"2024-09-12T00:39:26.644546+0000","last_active":"2024-09-12T01:11:58.391317+0000","last_peered":"2024-09-12T01:11:58.391317+0000","last_clean":"2024-09-12T01:11:58.391317+0000","last_became_active":"2024-09-12T00:39:26.644190+0000","last_became_peered":"2024-09-12T00:39:26.644190+0000","last_unstale":"2024-09-12T01:11:58.391317+0000","last_undegraded":"2024-09-12T01:11:58.391317+0000","last_fullsized":"2024-09-12T01:11:58.391317+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:28.896406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.240192+0000","last_change":"2024-09-12T00:22:02.429622+0000","last_active":"2024-09-12T01:13:48.240192+0000","last_peered":"2024-09-12T01:13:48.240192+0000","last_clean":"2024-09-12T01:13:48.240192+0000","last_became_active":"2024-09-12T00:22:02.429289+0000","last_became_peered":"2024-09-12T00:22:02.429289+0000","last_unstale":"2024-09-12T01:13:48.240192+0000","last_undegraded":"2024-09-12T01:13:48.240192+0000","last_fullsized":"2024-09-12T01:13:48.240192+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:57.498730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.228080+0000","last_change":"2024-09-12T00:21:58.334628+0000","last_active":"2024-09-12T01:11:43.228080+0000","last_peered":"2024-09-12T01:11:43.228080+0000","last_clean":"2024-09-12T01:11:43.228080+0000","last_became_active":"2024-09-12T00:21:58.334362+0000","last_became_peered":"2024-09-12T00:21:58.334362+0000","last_unstale":"2024-09-12T01:11:43.228080+0000","last_undegraded":"2024-09-12T01:11:43.228080+0000","last_fullsized":"2024-09-12T01:11:43.228080+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:03.057103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'50","reported_seq":198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221741+0000","last_change":"2024-09-12T00:17:58.353550+0000","last_active":"2024-09-12T01:11:58.221741+0000","last_peered":"2024-09-12T01:11:58.221741+0000","last_clean":"2024-09-12T01:11:58.221741+0000","last_became_active":"2024-09-12T00:17:58.353253+0000","last_became_peered":"2024-09-12T00:17:58.353253+0000","last_unstale":"2024-09-12T01:11:58.221741+0000","last_undegraded":"2024-09-12T01:11:58.221741+0000","last_fullsized":"2024-09-12T01:11:58.221741+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":79,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.457321+0000","last_change":"2024-09-12T00:39:26.636163+0000","last_active":"2024-09-12T01:13:13.457321+0000","last_peered":"2024-09-12T01:13:13.457321+0000","last_clean":"2024-09-12T01:13:13.457321+0000","last_became_active":"2024-09-12T00:39:26.633295+0000","last_became_peered":"2024-09-12T00:39:26.633295+0000","last_unstale":"2024-09-12T01:13:13.457321+0000","last_undegraded":"2024-09-12T01:13:13.457321+0000","last_fullsized":"2024-09-12T01:13:13.457321+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:58.692850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.389134+0000","last_change":"2024-09-12T00:22:02.429406+0000","last_active":"2024-09-12T01:11:53.389134+0000","last_peered":"2024-09-12T01:11:53.389134+0000","last_clean":"2024-09-12T01:11:53.389134+0000","last_became_active":"2024-09-12T00:22:02.429088+0000","last_became_peered":"2024-09-12T00:22:02.429088+0000","last_unstale":"2024-09-12T01:11:53.389134+0000","last_undegraded":"2024-09-12T01:11:53.389134+0000","last_fullsized":"2024-09-12T01:11:53.389134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:06.418067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.236622+0000","last_change":"2024-09-12T00:21:58.338881+0000","last_active":"2024-09-12T01:11:50.236622+0000","last_peered":"2024-09-12T01:11:50.236622+0000","last_clean":"2024-09-12T01:11:50.236622+0000","last_became_active":"2024-09-12T00:21:58.338592+0000","last_became_peered":"2024-09-12T00:21:58.338592+0000","last_unstale":"2024-09-12T01:11:50.236622+0000","last_undegraded":"2024-09-12T01:11:50.236622+0000","last_fullsized":"2024-09-12T01:11:50.236622+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:24.783440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'20","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237791+0000","last_change":"2024-09-12T00:17:58.357513+0000","last_active":"2024-09-12T01:12:00.237791+0000","last_peered":"2024-09-12T01:12:00.237791+0000","last_clean":"2024-09-12T01:12:00.237791+0000","last_became_active":"2024-09-12T00:17:58.357219+0000","last_became_peered":"2024-09-12T00:17:58.357219+0000","last_unstale":"2024-09-12T01:12:00.237791+0000","last_undegraded":"2024-09-12T01:12:00.237791+0000","last_fullsized":"2024-09-12T01:12:00.237791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:44.097143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":69,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.402289+0000","last_change":"2024-09-12T00:39:26.643775+0000","last_active":"2024-09-12T01:13:18.402289+0000","last_peered":"2024-09-12T01:13:18.402289+0000","last_clean":"2024-09-12T01:13:18.402289+0000","last_became_active":"2024-09-12T00:39:26.643469+0000","last_became_peered":"2024-09-12T00:39:26.643469+0000","last_unstale":"2024-09-12T01:13:18.402289+0000","last_undegraded":"2024-09-12T01:13:18.402289+0000","last_fullsized":"2024-09-12T01:13:18.402289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:16.398681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390670+0000","last_change":"2024-09-12T00:22:02.422788+0000","last_active":"2024-09-12T01:11:53.390670+0000","last_peered":"2024-09-12T01:11:53.390670+0000","last_clean":"2024-09-12T01:11:53.390670+0000","last_became_active":"2024-09-12T00:22:02.422532+0000","last_became_peered":"2024-09-12T00:22:02.422532+0000","last_unstale":"2024-09-12T01:11:53.390670+0000","last_undegraded":"2024-09-12T01:11:53.390670+0000","last_fullsized":"2024-09-12T01:11:53.390670+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.940961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.242873+0000","last_change":"2024-09-12T00:21:58.333014+0000","last_active":"2024-09-12T01:13:58.242873+0000","last_peered":"2024-09-12T01:13:58.242873+0000","last_clean":"2024-09-12T01:13:58.242873+0000","last_became_active":"2024-09-12T00:21:58.332715+0000","last_became_peered":"2024-09-12T00:21:58.332715+0000","last_unstale":"2024-09-12T01:13:58.242873+0000","last_undegraded":"2024-09-12T01:13:58.242873+0000","last_fullsized":"2024-09-12T01:13:58.242873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.043720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'12","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394261+0000","last_change":"2024-09-12T00:17:58.348284+0000","last_active":"2024-09-12T01:12:18.394261+0000","last_peered":"2024-09-12T01:12:18.394261+0000","last_clean":"2024-09-12T01:12:18.394261+0000","last_became_active":"2024-09-12T00:17:58.347709+0000","last_became_peered":"2024-09-12T00:17:58.347709+0000","last_unstale":"2024-09-12T01:12:18.394261+0000","last_undegraded":"2024-09-12T01:12:18.394261+0000","last_fullsized":"2024-09-12T01:12:18.394261+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:50.010174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401624+0000","last_change":"2024-09-12T00:39:26.639353+0000","last_active":"2024-09-12T01:13:13.401624+0000","last_peered":"2024-09-12T01:13:13.401624+0000","last_clean":"2024-09-12T01:13:13.401624+0000","last_became_active":"2024-09-12T00:39:26.639094+0000","last_became_peered":"2024-09-12T00:39:26.639094+0000","last_unstale":"2024-09-12T01:13:13.401624+0000","last_undegraded":"2024-09-12T01:13:13.401624+0000","last_fullsized":"2024-09-12T01:13:13.401624+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.226749+0000","last_change":"2024-09-12T00:22:02.423237+0000","last_active":"2024-09-12T01:11:33.226749+0000","last_peered":"2024-09-12T01:11:33.226749+0000","last_clean":"2024-09-12T01:11:33.226749+0000","last_became_active":"2024-09-12T00:22:02.422922+0000","last_became_peered":"2024-09-12T00:22:02.422922+0000","last_unstale":"2024-09-12T01:11:33.226749+0000","last_undegraded":"2024-09-12T01:11:33.226749+0000","last_fullsized":"2024-09-12T01:11:33.226749+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:06.357213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238314+0000","last_change":"2024-09-12T00:21:58.341237+0000","last_active":"2024-09-12T01:12:05.238314+0000","last_peered":"2024-09-12T01:12:05.238314+0000","last_clean":"2024-09-12T01:12:05.238314+0000","last_became_active":"2024-09-12T00:21:58.340910+0000","last_became_peered":"2024-09-12T00:21:58.340910+0000","last_unstale":"2024-09-12T01:12:05.238314+0000","last_undegraded":"2024-09-12T01:12:05.238314+0000","last_fullsized":"2024-09-12T01:12:05.238314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:12.245684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'59","reported_seq":219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449466+0000","last_change":"2024-09-12T00:17:58.351895+0000","last_active":"2024-09-12T01:12:08.449466+0000","last_peered":"2024-09-12T01:12:08.449466+0000","last_clean":"2024-09-12T01:12:08.449466+0000","last_became_active":"2024-09-12T00:17:58.351362+0000","last_became_peered":"2024-09-12T00:17:58.351362+0000","last_unstale":"2024-09-12T01:12:08.449466+0000","last_undegraded":"2024-09-12T01:12:08.449466+0000","last_fullsized":"2024-09-12T01:12:08.449466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.054114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":214,"num_write":104,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:15.246472+0000","last_change":"2024-09-12T00:39:26.631761+0000","last_active":"2024-09-12T01:13:15.246472+0000","last_peered":"2024-09-12T01:13:15.246472+0000","last_clean":"2024-09-12T01:13:15.246472+0000","last_became_active":"2024-09-12T00:39:26.631491+0000","last_became_peered":"2024-09-12T00:39:26.631491+0000","last_unstale":"2024-09-12T01:13:15.246472+0000","last_undegraded":"2024-09-12T01:13:15.246472+0000","last_fullsized":"2024-09-12T01:13:15.246472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:37.091629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'3","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.410353+0000","last_change":"2024-09-12T00:22:02.430547+0000","last_active":"2024-09-12T01:14:13.410353+0000","last_peered":"2024-09-12T01:14:13.410353+0000","last_clean":"2024-09-12T01:14:13.410353+0000","last_became_active":"2024-09-12T00:22:02.430209+0000","last_became_peered":"2024-09-12T00:22:02.430209+0000","last_unstale":"2024-09-12T01:14:13.410353+0000","last_undegraded":"2024-09-12T01:14:13.410353+0000","last_fullsized":"2024-09-12T01:14:13.410353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:01.694638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.385332+0000","last_change":"2024-09-12T00:21:58.339483+0000","last_active":"2024-09-12T01:11:28.385332+0000","last_peered":"2024-09-12T01:11:28.385332+0000","last_clean":"2024-09-12T01:11:28.385332+0000","last_became_active":"2024-09-12T00:21:58.339248+0000","last_became_peered":"2024-09-12T00:21:58.339248+0000","last_unstale":"2024-09-12T01:11:28.385332+0000","last_undegraded":"2024-09-12T01:11:28.385332+0000","last_fullsized":"2024-09-12T01:11:28.385332+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:13.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'36","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609071+0000","last_change":"2024-09-12T00:17:58.358376+0000","last_active":"2024-09-12T01:12:08.609071+0000","last_peered":"2024-09-12T01:12:08.609071+0000","last_clean":"2024-09-12T01:12:08.609071+0000","last_became_active":"2024-09-12T00:17:58.358022+0000","last_became_peered":"2024-09-12T00:17:58.358022+0000","last_unstale":"2024-09-12T01:12:08.609071+0000","last_undegraded":"2024-09-12T01:12:08.609071+0000","last_fullsized":"2024-09-12T01:12:08.609071+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:18.456203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":54,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398216+0000","last_change":"2024-09-12T00:39:26.645252+0000","last_active":"2024-09-12T01:12:48.398216+0000","last_peered":"2024-09-12T01:12:48.398216+0000","last_clean":"2024-09-12T01:12:48.398216+0000","last_became_active":"2024-09-12T00:39:26.644935+0000","last_became_peered":"2024-09-12T00:39:26.644935+0000","last_unstale":"2024-09-12T01:12:48.398216+0000","last_undegraded":"2024-09-12T01:12:48.398216+0000","last_fullsized":"2024-09-12T01:12:48.398216+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:56.007971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240045+0000","last_change":"2024-09-12T00:22:02.424691+0000","last_active":"2024-09-12T01:12:20.240045+0000","last_peered":"2024-09-12T01:12:20.240045+0000","last_clean":"2024-09-12T01:12:20.240045+0000","last_became_active":"2024-09-12T00:22:02.424116+0000","last_became_peered":"2024-09-12T00:22:02.424116+0000","last_unstale":"2024-09-12T01:12:20.240045+0000","last_undegraded":"2024-09-12T01:12:20.240045+0000","last_fullsized":"2024-09-12T01:12:20.240045+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.947612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'6","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408732+0000","last_change":"2024-09-12T00:21:58.332119+0000","last_active":"2024-09-12T01:14:03.408732+0000","last_peered":"2024-09-12T01:14:03.408732+0000","last_clean":"2024-09-12T01:14:03.408732+0000","last_became_active":"2024-09-12T00:21:58.331839+0000","last_became_peered":"2024-09-12T00:21:58.331839+0000","last_unstale":"2024-09-12T01:14:03.408732+0000","last_undegraded":"2024-09-12T01:14:03.408732+0000","last_fullsized":"2024-09-12T01:14:03.408732+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:22.439701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238960+0000","last_change":"2024-09-12T00:17:58.354881+0000","last_active":"2024-09-12T01:12:10.238960+0000","last_peered":"2024-09-12T01:12:10.238960+0000","last_clean":"2024-09-12T01:12:10.238960+0000","last_became_active":"2024-09-12T00:17:58.354568+0000","last_became_peered":"2024-09-12T00:17:58.354568+0000","last_unstale":"2024-09-12T01:12:10.238960+0000","last_undegraded":"2024-09-12T01:12:10.238960+0000","last_fullsized":"2024-09-12T01:12:10.238960+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:54.500434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.509385+0000","last_change":"2024-09-12T00:39:26.640912+0000","last_active":"2024-09-12T01:12:48.509385+0000","last_peered":"2024-09-12T01:12:48.509385+0000","last_clean":"2024-09-12T01:12:48.509385+0000","last_became_active":"2024-09-12T00:39:26.635679+0000","last_became_peered":"2024-09-12T00:39:26.635679+0000","last_unstale":"2024-09-12T01:12:48.509385+0000","last_undegraded":"2024-09-12T01:12:48.509385+0000","last_fullsized":"2024-09-12T01:12:48.509385+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:19.017813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'11","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238367+0000","last_change":"2024-09-12T00:22:02.420520+0000","last_active":"2024-09-12T01:12:05.238367+0000","last_peered":"2024-09-12T01:12:05.238367+0000","last_clean":"2024-09-12T01:12:05.238367+0000","last_became_active":"2024-09-12T00:22:02.420246+0000","last_became_peered":"2024-09-12T00:22:02.420246+0000","last_unstale":"2024-09-12T01:12:05.238367+0000","last_undegraded":"2024-09-12T01:12:05.238367+0000","last_fullsized":"2024-09-12T01:12:05.238367+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:31.472875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":23552,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.236313+0000","last_change":"2024-09-12T00:21:58.332641+0000","last_active":"2024-09-12T01:14:13.236313+0000","last_peered":"2024-09-12T01:14:13.236313+0000","last_clean":"2024-09-12T01:14:13.236313+0000","last_became_active":"2024-09-12T00:21:58.332362+0000","last_became_peered":"2024-09-12T00:21:58.332362+0000","last_unstale":"2024-09-12T01:14:13.236313+0000","last_undegraded":"2024-09-12T01:14:13.236313+0000","last_fullsized":"2024-09-12T01:14:13.236313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:38.121091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'54","reported_seq":199,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609180+0000","last_change":"2024-09-12T00:17:58.356444+0000","last_active":"2024-09-12T01:12:08.609180+0000","last_peered":"2024-09-12T01:12:08.609180+0000","last_clean":"2024-09-12T01:12:08.609180+0000","last_became_active":"2024-09-12T00:17:58.356120+0000","last_became_peered":"2024-09-12T00:17:58.356120+0000","last_unstale":"2024-09-12T01:12:08.609180+0000","last_undegraded":"2024-09-12T01:12:08.609180+0000","last_fullsized":"2024-09-12T01:12:08.609180+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:56.553542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":175,"num_write":100,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.240729+0000","last_change":"2024-09-12T00:39:26.625293+0000","last_active":"2024-09-12T01:13:38.240729+0000","last_peered":"2024-09-12T01:13:38.240729+0000","last_clean":"2024-09-12T01:13:38.240729+0000","last_became_active":"2024-09-12T00:39:26.624994+0000","last_became_peered":"2024-09-12T00:39:26.624994+0000","last_unstale":"2024-09-12T01:13:38.240729+0000","last_undegraded":"2024-09-12T01:13:38.240729+0000","last_fullsized":"2024-09-12T01:13:38.240729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:56.114504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390791+0000","last_change":"2024-09-12T00:22:02.424780+0000","last_active":"2024-09-12T01:11:53.390791+0000","last_peered":"2024-09-12T01:11:53.390791+0000","last_clean":"2024-09-12T01:11:53.390791+0000","last_became_active":"2024-09-12T00:22:02.424412+0000","last_became_peered":"2024-09-12T00:22:02.424412+0000","last_unstale":"2024-09-12T01:11:53.390791+0000","last_undegraded":"2024-09-12T01:11:53.390791+0000","last_fullsized":"2024-09-12T01:11:53.390791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.074060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.500730+0000","last_change":"2024-09-12T00:21:58.334861+0000","last_active":"2024-09-12T01:11:48.500730+0000","last_peered":"2024-09-12T01:11:48.500730+0000","last_clean":"2024-09-12T01:11:48.500730+0000","last_became_active":"2024-09-12T00:21:58.334536+0000","last_became_peered":"2024-09-12T00:21:58.334536+0000","last_unstale":"2024-09-12T01:11:48.500730+0000","last_undegraded":"2024-09-12T01:11:48.500730+0000","last_fullsized":"2024-09-12T01:11:48.500730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:39.419871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394307+0000","last_change":"2024-09-12T00:17:58.353484+0000","last_active":"2024-09-12T01:12:18.394307+0000","last_peered":"2024-09-12T01:12:18.394307+0000","last_clean":"2024-09-12T01:12:18.394307+0000","last_became_active":"2024-09-12T00:17:58.353219+0000","last_became_peered":"2024-09-12T00:17:58.353219+0000","last_unstale":"2024-09-12T01:12:18.394307+0000","last_undegraded":"2024-09-12T01:12:18.394307+0000","last_fullsized":"2024-09-12T01:12:18.394307+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:54.015109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":151,"num_write":85,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396509+0000","last_change":"2024-09-12T00:39:26.638305+0000","last_active":"2024-09-12T01:12:48.396509+0000","last_peered":"2024-09-12T01:12:48.396509+0000","last_clean":"2024-09-12T01:12:48.396509+0000","last_became_active":"2024-09-12T00:39:26.638008+0000","last_became_peered":"2024-09-12T00:39:26.638008+0000","last_unstale":"2024-09-12T01:12:48.396509+0000","last_undegraded":"2024-09-12T01:12:48.396509+0000","last_fullsized":"2024-09-12T01:12:48.396509+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:10.696670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'3","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.260835+0000","last_change":"2024-09-12T00:22:02.419773+0000","last_active":"2024-09-12T01:14:03.260835+0000","last_peered":"2024-09-12T01:14:03.260835+0000","last_clean":"2024-09-12T01:14:03.260835+0000","last_became_active":"2024-09-12T00:22:02.419443+0000","last_became_peered":"2024-09-12T00:22:02.419443+0000","last_unstale":"2024-09-12T01:14:03.260835+0000","last_undegraded":"2024-09-12T01:14:03.260835+0000","last_fullsized":"2024-09-12T01:14:03.260835+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:01.383190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390111+0000","last_change":"2024-09-12T00:21:58.335735+0000","last_active":"2024-09-12T01:11:48.390111+0000","last_peered":"2024-09-12T01:11:48.390111+0000","last_clean":"2024-09-12T01:11:48.390111+0000","last_became_active":"2024-09-12T00:21:58.335360+0000","last_became_peered":"2024-09-12T00:21:58.335360+0000","last_unstale":"2024-09-12T01:11:48.390111+0000","last_undegraded":"2024-09-12T01:11:48.390111+0000","last_fullsized":"2024-09-12T01:11:48.390111+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:46.236982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'110","reported_seq":429,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230801+0000","last_change":"2024-09-12T00:17:58.356038+0000","last_active":"2024-09-12T01:12:08.230801+0000","last_peered":"2024-09-12T01:12:08.230801+0000","last_clean":"2024-09-12T01:12:08.230801+0000","last_became_active":"2024-09-12T00:17:58.355688+0000","last_became_peered":"2024-09-12T00:17:58.355688+0000","last_unstale":"2024-09-12T01:12:08.230801+0000","last_undegraded":"2024-09-12T01:12:08.230801+0000","last_fullsized":"2024-09-12T01:12:08.230801+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:17.662520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":717,"num_read_kb":507,"num_write":143,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221804+0000","last_change":"2024-09-12T00:39:26.637811+0000","last_active":"2024-09-12T01:11:58.221804+0000","last_peered":"2024-09-12T01:11:58.221804+0000","last_clean":"2024-09-12T01:11:58.221804+0000","last_became_active":"2024-09-12T00:39:26.637393+0000","last_became_peered":"2024-09-12T00:39:26.637393+0000","last_unstale":"2024-09-12T01:11:58.221804+0000","last_undegraded":"2024-09-12T01:11:58.221804+0000","last_fullsized":"2024-09-12T01:11:58.221804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:54.616369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.230233+0000","last_change":"2024-09-12T00:22:02.423927+0000","last_active":"2024-09-12T01:12:03.230233+0000","last_peered":"2024-09-12T01:12:03.230233+0000","last_clean":"2024-09-12T01:12:03.230233+0000","last_became_active":"2024-09-12T00:22:02.423601+0000","last_became_peered":"2024-09-12T00:22:02.423601+0000","last_unstale":"2024-09-12T01:12:03.230233+0000","last_undegraded":"2024-09-12T01:12:03.230233+0000","last_fullsized":"2024-09-12T01:12:03.230233+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:37.317770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392781+0000","last_change":"2024-09-12T00:21:58.339918+0000","last_active":"2024-09-12T01:12:08.392781+0000","last_peered":"2024-09-12T01:12:08.392781+0000","last_clean":"2024-09-12T01:12:08.392781+0000","last_became_active":"2024-09-12T00:21:58.339625+0000","last_became_peered":"2024-09-12T00:21:58.339625+0000","last_unstale":"2024-09-12T01:12:08.392781+0000","last_undegraded":"2024-09-12T01:12:08.392781+0000","last_fullsized":"2024-09-12T01:12:08.392781+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:55.567062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503535+0000","last_change":"2024-09-12T00:17:58.357264+0000","last_active":"2024-09-12T01:12:08.503535+0000","last_peered":"2024-09-12T01:12:08.503535+0000","last_clean":"2024-09-12T01:12:08.503535+0000","last_became_active":"2024-09-12T00:17:58.356906+0000","last_became_peered":"2024-09-12T00:17:58.356906+0000","last_unstale":"2024-09-12T01:12:08.503535+0000","last_undegraded":"2024-09-12T01:12:08.503535+0000","last_fullsized":"2024-09-12T01:12:08.503535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:35.900823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":164,"num_write":72,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237860+0000","last_change":"2024-09-12T00:39:26.628713+0000","last_active":"2024-09-12T01:12:00.237860+0000","last_peered":"2024-09-12T01:12:00.237860+0000","last_clean":"2024-09-12T01:12:00.237860+0000","last_became_active":"2024-09-12T00:39:26.628244+0000","last_became_peered":"2024-09-12T00:39:26.628244+0000","last_unstale":"2024-09-12T01:12:00.237860+0000","last_undegraded":"2024-09-12T01:12:00.237860+0000","last_fullsized":"2024-09-12T01:12:00.237860+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:04.390305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.521387+0000","last_change":"2024-09-12T00:22:02.417514+0000","last_active":"2024-09-12T01:14:08.521387+0000","last_peered":"2024-09-12T01:14:08.521387+0000","last_clean":"2024-09-12T01:14:08.521387+0000","last_became_active":"2024-09-12T00:22:02.417237+0000","last_became_peered":"2024-09-12T00:22:02.417237+0000","last_unstale":"2024-09-12T01:14:08.521387+0000","last_undegraded":"2024-09-12T01:14:08.521387+0000","last_fullsized":"2024-09-12T01:14:08.521387+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.844465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408682+0000","last_change":"2024-09-12T00:21:58.335825+0000","last_active":"2024-09-12T01:14:03.408682+0000","last_peered":"2024-09-12T01:14:03.408682+0000","last_clean":"2024-09-12T01:14:03.408682+0000","last_became_active":"2024-09-12T00:21:58.335541+0000","last_became_peered":"2024-09-12T00:21:58.335541+0000","last_unstale":"2024-09-12T01:14:03.408682+0000","last_undegraded":"2024-09-12T01:14:03.408682+0000","last_fullsized":"2024-09-12T01:14:03.408682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:13.185076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.391247+0000","last_change":"2024-09-12T00:17:58.349817+0000","last_active":"2024-09-12T01:12:08.391247+0000","last_peered":"2024-09-12T01:12:08.391247+0000","last_clean":"2024-09-12T01:12:08.391247+0000","last_became_active":"2024-09-12T00:17:58.349428+0000","last_became_peered":"2024-09-12T00:17:58.349428+0000","last_unstale":"2024-09-12T01:12:08.391247+0000","last_undegraded":"2024-09-12T01:12:08.391247+0000","last_fullsized":"2024-09-12T01:12:08.391247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:25.884859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":78,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243328+0000","last_change":"2024-09-12T00:39:26.641703+0000","last_active":"2024-09-12T01:12:50.243328+0000","last_peered":"2024-09-12T01:12:50.243328+0000","last_clean":"2024-09-12T01:12:50.243328+0000","last_became_active":"2024-09-12T00:39:26.641360+0000","last_became_peered":"2024-09-12T00:39:26.641360+0000","last_unstale":"2024-09-12T01:12:50.243328+0000","last_undegraded":"2024-09-12T01:12:50.243328+0000","last_fullsized":"2024-09-12T01:12:50.243328+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.843665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608437+0000","last_change":"2024-09-12T00:22:02.430353+0000","last_active":"2024-09-12T01:12:03.608437+0000","last_peered":"2024-09-12T01:12:03.608437+0000","last_clean":"2024-09-12T01:12:03.608437+0000","last_became_active":"2024-09-12T00:22:02.430041+0000","last_became_peered":"2024-09-12T00:22:02.430041+0000","last_unstale":"2024-09-12T01:12:03.608437+0000","last_undegraded":"2024-09-12T01:12:03.608437+0000","last_fullsized":"2024-09-12T01:12:03.608437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:01.886573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.243388+0000","last_change":"2024-09-12T00:21:58.327372+0000","last_active":"2024-09-12T01:14:03.243388+0000","last_peered":"2024-09-12T01:14:03.243388+0000","last_clean":"2024-09-12T01:14:03.243388+0000","last_became_active":"2024-09-12T00:21:58.327094+0000","last_became_peered":"2024-09-12T00:21:58.327094+0000","last_unstale":"2024-09-12T01:14:03.243388+0000","last_undegraded":"2024-09-12T01:14:03.243388+0000","last_fullsized":"2024-09-12T01:14:03.243388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.131588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'15","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609100+0000","last_change":"2024-09-12T00:17:58.355203+0000","last_active":"2024-09-12T01:12:08.609100+0000","last_peered":"2024-09-12T01:12:08.609100+0000","last_clean":"2024-09-12T01:12:08.609100+0000","last_became_active":"2024-09-12T00:17:58.354797+0000","last_became_peered":"2024-09-12T00:17:58.354797+0000","last_unstale":"2024-09-12T01:12:08.609100+0000","last_undegraded":"2024-09-12T01:12:08.609100+0000","last_fullsized":"2024-09-12T01:12:08.609100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.618609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399062+0000","last_change":"2024-09-12T00:39:26.641320+0000","last_active":"2024-09-12T01:12:53.399062+0000","last_peered":"2024-09-12T01:12:53.399062+0000","last_clean":"2024-09-12T01:12:53.399062+0000","last_became_active":"2024-09-12T00:39:26.640877+0000","last_became_peered":"2024-09-12T00:39:26.640877+0000","last_unstale":"2024-09-12T01:12:53.399062+0000","last_undegraded":"2024-09-12T01:12:53.399062+0000","last_fullsized":"2024-09-12T01:12:53.399062+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:44.522883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.261478+0000","last_change":"2024-09-12T00:22:02.418887+0000","last_active":"2024-09-12T01:14:08.261478+0000","last_peered":"2024-09-12T01:14:08.261478+0000","last_clean":"2024-09-12T01:14:08.261478+0000","last_became_active":"2024-09-12T00:22:02.418588+0000","last_became_peered":"2024-09-12T00:22:02.418588+0000","last_unstale":"2024-09-12T01:14:08.261478+0000","last_undegraded":"2024-09-12T01:14:08.261478+0000","last_fullsized":"2024-09-12T01:14:08.261478+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:23.078029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'7","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.625107+0000","last_change":"2024-09-12T00:21:58.332292+0000","last_active":"2024-09-12T01:14:03.625107+0000","last_peered":"2024-09-12T01:14:03.625107+0000","last_clean":"2024-09-12T01:14:03.625107+0000","last_became_active":"2024-09-12T00:21:58.331972+0000","last_became_peered":"2024-09-12T00:21:58.331972+0000","last_unstale":"2024-09-12T01:14:03.625107+0000","last_undegraded":"2024-09-12T01:14:03.625107+0000","last_fullsized":"2024-09-12T01:14:03.625107+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:41.270684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'16","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392791+0000","last_change":"2024-09-12T00:17:58.358230+0000","last_active":"2024-09-12T01:12:08.392791+0000","last_peered":"2024-09-12T01:12:08.392791+0000","last_clean":"2024-09-12T01:12:08.392791+0000","last_became_active":"2024-09-12T00:17:58.357689+0000","last_became_peered":"2024-09-12T00:17:58.357689+0000","last_unstale":"2024-09-12T01:12:08.392791+0000","last_undegraded":"2024-09-12T01:12:08.392791+0000","last_fullsized":"2024-09-12T01:12:08.392791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.417538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'204","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041492+0000","last_change":"2024-09-12T00:02:48.051469+0000","last_active":"2024-09-12T01:15:48.041492+0000","last_peered":"2024-09-12T01:15:48.041492+0000","last_clean":"2024-09-12T01:15:48.041492+0000","last_became_active":"2024-09-12T00:02:48.051117+0000","last_became_peered":"2024-09-12T00:02:48.051117+0000","last_unstale":"2024-09-12T01:15:48.041492+0000","last_undegraded":"2024-09-12T01:15:48.041492+0000","last_fullsized":"2024-09-12T01:15:48.041492+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:31.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342064,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":17555,"num_write":999,"num_write_kb":27178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'739","reported_seq":2130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061089+0000","last_change":"2024-09-12T00:02:50.065523+0000","last_active":"2024-09-12T01:13:06.061089+0000","last_peered":"2024-09-12T01:13:06.061089+0000","last_clean":"2024-09-12T01:13:06.061089+0000","last_became_active":"2024-09-12T00:02:50.065257+0000","last_became_peered":"2024-09-12T00:02:50.065257+0000","last_unstale":"2024-09-12T01:13:06.061089+0000","last_undegraded":"2024-09-12T01:13:06.061089+0000","last_fullsized":"2024-09-12T01:13:06.061089+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:22.262738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3376,"num_read_kb":3036,"num_write":968,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'285","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.186886+0000","last_change":"2024-09-12T00:02:48.049346+0000","last_active":"2024-09-12T01:15:48.186886+0000","last_peered":"2024-09-12T01:15:48.186886+0000","last_clean":"2024-09-12T01:15:48.186886+0000","last_became_active":"2024-09-12T00:02:48.049002+0000","last_became_peered":"2024-09-12T00:02:48.049002+0000","last_unstale":"2024-09-12T01:15:48.186886+0000","last_undegraded":"2024-09-12T01:15:48.186886+0000","last_fullsized":"2024-09-12T01:15:48.186886+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:20.073613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":975,"num_read_kb":18236,"num_write":1256,"num_write_kb":26545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'691","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398967+0000","last_change":"2024-09-12T00:02:50.063909+0000","last_active":"2024-09-12T01:12:53.398967+0000","last_peered":"2024-09-12T01:12:53.398967+0000","last_clean":"2024-09-12T01:12:53.398967+0000","last_became_active":"2024-09-12T00:02:50.063612+0000","last_became_peered":"2024-09-12T00:02:50.063612+0000","last_unstale":"2024-09-12T01:12:53.398967+0000","last_undegraded":"2024-09-12T01:12:53.398967+0000","last_fullsized":"2024-09-12T01:12:53.398967+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":600,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:00.810818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3358,"num_read_kb":3023,"num_write":921,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'218","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249550+0000","last_change":"2024-09-12T00:02:48.047754+0000","last_active":"2024-09-12T01:13:40.249550+0000","last_peered":"2024-09-12T01:13:40.249550+0000","last_clean":"2024-09-12T01:13:40.249550+0000","last_became_active":"2024-09-12T00:02:48.045960+0000","last_became_peered":"2024-09-12T00:02:48.045960+0000","last_unstale":"2024-09-12T01:13:40.249550+0000","last_undegraded":"2024-09-12T01:13:40.249550+0000","last_fullsized":"2024-09-12T01:13:40.249550+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:15.082870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119487,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":21329,"num_write":1071,"num_write_kb":32132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'460","reported_seq":2020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127768+0000","last_change":"2024-09-12T00:02:50.062684+0000","last_active":"2024-09-12T01:14:04.127768+0000","last_peered":"2024-09-12T01:14:04.127768+0000","last_clean":"2024-09-12T01:14:04.127768+0000","last_became_active":"2024-09-12T00:02:50.060902+0000","last_became_peered":"2024-09-12T00:02:50.060902+0000","last_unstale":"2024-09-12T01:14:04.127768+0000","last_undegraded":"2024-09-12T01:14:04.127768+0000","last_fullsized":"2024-09-12T01:14:04.127768+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:33.890960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2604,"num_read_kb":2455,"num_write":536,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'260","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.067359+0000","last_change":"2024-09-12T00:02:48.054237+0000","last_active":"2024-09-12T01:15:48.067359+0000","last_peered":"2024-09-12T01:15:48.067359+0000","last_clean":"2024-09-12T01:15:48.067359+0000","last_became_active":"2024-09-12T00:02:48.052802+0000","last_became_peered":"2024-09-12T00:02:48.052802+0000","last_unstale":"2024-09-12T01:15:48.067359+0000","last_undegraded":"2024-09-12T01:15:48.067359+0000","last_fullsized":"2024-09-12T01:15:48.067359+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:33.528197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":8609,"num_write":1124,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'1277","reported_seq":2864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863786+0000","last_change":"2024-09-12T00:02:50.072880+0000","last_active":"2024-09-12T01:13:20.863786+0000","last_peered":"2024-09-12T01:13:20.863786+0000","last_clean":"2024-09-12T01:13:20.863786+0000","last_became_active":"2024-09-12T00:02:50.072574+0000","last_became_peered":"2024-09-12T00:02:50.072574+0000","last_unstale":"2024-09-12T01:13:20.863786+0000","last_undegraded":"2024-09-12T01:13:20.863786+0000","last_fullsized":"2024-09-12T01:13:20.863786+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:18.343144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5797,"num_read_kb":5069,"num_write":1818,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'162","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:18.419930+0000","last_change":"2024-09-12T00:02:48.053474+0000","last_active":"2024-09-12T01:15:18.419930+0000","last_peered":"2024-09-12T01:15:18.419930+0000","last_clean":"2024-09-12T01:15:18.419930+0000","last_became_active":"2024-09-12T00:02:48.052778+0000","last_became_peered":"2024-09-12T00:02:48.052778+0000","last_unstale":"2024-09-12T01:15:18.419930+0000","last_undegraded":"2024-09-12T01:15:18.419930+0000","last_fullsized":"2024-09-12T01:15:18.419930+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:00.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":373,"num_read_kb":36558,"num_write":790,"num_write_kb":25424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'761","reported_seq":2171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.862249+0000","last_change":"2024-09-12T00:02:50.062543+0000","last_active":"2024-09-12T01:13:20.862249+0000","last_peered":"2024-09-12T01:13:20.862249+0000","last_clean":"2024-09-12T01:13:20.862249+0000","last_became_active":"2024-09-12T00:02:50.062257+0000","last_became_peered":"2024-09-12T00:02:50.062257+0000","last_unstale":"2024-09-12T01:13:20.862249+0000","last_undegraded":"2024-09-12T01:13:20.862249+0000","last_fullsized":"2024-09-12T01:13:20.862249+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:20.110214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3047,"num_write":970,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'225","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.259407+0000","last_change":"2024-09-12T00:02:48.056467+0000","last_active":"2024-09-12T01:15:48.259407+0000","last_peered":"2024-09-12T01:15:48.259407+0000","last_clean":"2024-09-12T01:15:48.259407+0000","last_became_active":"2024-09-12T00:02:48.052257+0000","last_became_peered":"2024-09-12T00:02:48.052257+0000","last_unstale":"2024-09-12T01:15:48.259407+0000","last_undegraded":"2024-09-12T01:15:48.259407+0000","last_fullsized":"2024-09-12T01:15:48.259407+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:42.352728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798278,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":39161,"num_write":992,"num_write_kb":40171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'407","reported_seq":1873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748758+0000","last_change":"2024-09-12T00:02:50.061476+0000","last_active":"2024-09-12T01:15:09.748758+0000","last_peered":"2024-09-12T01:15:09.748758+0000","last_clean":"2024-09-12T01:15:09.748758+0000","last_became_active":"2024-09-12T00:02:50.060756+0000","last_became_peered":"2024-09-12T00:02:50.060756+0000","last_unstale":"2024-09-12T01:15:09.748758+0000","last_undegraded":"2024-09-12T01:15:09.748758+0000","last_fullsized":"2024-09-12T01:15:09.748758+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:07.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2108,"num_read_kb":1993,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'193","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.213028+0000","last_change":"2024-09-12T00:03:21.144282+0000","last_active":"2024-09-12T01:15:48.213028+0000","last_peered":"2024-09-12T01:15:48.213028+0000","last_clean":"2024-09-12T01:15:48.213028+0000","last_became_active":"2024-09-12T00:03:21.143840+0000","last_became_peered":"2024-09-12T00:03:21.143840+0000","last_unstale":"2024-09-12T01:15:48.213028+0000","last_undegraded":"2024-09-12T01:15:48.213028+0000","last_fullsized":"2024-09-12T01:15:48.213028+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:25.883175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":20506,"num_write":998,"num_write_kb":32663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'432","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.517921+0000","last_change":"2024-09-12T00:02:50.065057+0000","last_active":"2024-09-12T01:13:43.517921+0000","last_peered":"2024-09-12T01:13:43.517921+0000","last_clean":"2024-09-12T01:13:43.517921+0000","last_became_active":"2024-09-12T00:02:50.064658+0000","last_became_peered":"2024-09-12T00:02:50.064658+0000","last_unstale":"2024-09-12T01:13:43.517921+0000","last_undegraded":"2024-09-12T01:13:43.517921+0000","last_fullsized":"2024-09-12T01:13:43.517921+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:42.210482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":488,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'181","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.071132+0000","last_change":"2024-09-12T00:02:48.059025+0000","last_active":"2024-09-12T01:15:48.071132+0000","last_peered":"2024-09-12T01:15:48.071132+0000","last_clean":"2024-09-12T01:15:48.071132+0000","last_became_active":"2024-09-12T00:02:48.058678+0000","last_became_peered":"2024-09-12T00:02:48.058678+0000","last_unstale":"2024-09-12T01:15:48.071132+0000","last_undegraded":"2024-09-12T01:15:48.071132+0000","last_fullsized":"2024-09-12T01:15:48.071132+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:51.470037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170390,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1879,"num_write":959,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'888","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.957023+0000","last_change":"2024-09-12T00:02:50.070198+0000","last_active":"2024-09-12T01:14:02.957023+0000","last_peered":"2024-09-12T01:14:02.957023+0000","last_clean":"2024-09-12T01:14:02.957023+0000","last_became_active":"2024-09-12T00:02:50.069840+0000","last_became_peered":"2024-09-12T00:02:50.069840+0000","last_unstale":"2024-09-12T01:14:02.957023+0000","last_undegraded":"2024-09-12T01:14:02.957023+0000","last_fullsized":"2024-09-12T01:14:02.957023+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.926054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4122,"num_read_kb":3699,"num_write":1233,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'596","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863098+0000","last_change":"2024-09-12T00:02:50.061218+0000","last_active":"2024-09-12T01:13:20.863098+0000","last_peered":"2024-09-12T01:13:20.863098+0000","last_clean":"2024-09-12T01:13:20.863098+0000","last_became_active":"2024-09-12T00:02:50.060919+0000","last_became_peered":"2024-09-12T00:02:50.060919+0000","last_unstale":"2024-09-12T01:13:20.863098+0000","last_undegraded":"2024-09-12T01:13:20.863098+0000","last_fullsized":"2024-09-12T01:13:20.863098+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:06.460607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3046,"num_read_kb":2788,"num_write":785,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'202","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.243046+0000","last_change":"2024-09-12T00:02:48.051390+0000","last_active":"2024-09-12T01:15:48.243046+0000","last_peered":"2024-09-12T01:15:48.243046+0000","last_clean":"2024-09-12T01:15:48.243046+0000","last_became_active":"2024-09-12T00:02:48.050909+0000","last_became_peered":"2024-09-12T00:02:48.050909+0000","last_unstale":"2024-09-12T01:15:48.243046+0000","last_undegraded":"2024-09-12T01:15:48.243046+0000","last_fullsized":"2024-09-12T01:15:48.243046+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:04.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":10751,"num_write":911,"num_write_kb":36355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'825","reported_seq":2313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863421+0000","last_change":"2024-09-12T00:02:50.073111+0000","last_active":"2024-09-12T01:13:20.863421+0000","last_peered":"2024-09-12T01:13:20.863421+0000","last_clean":"2024-09-12T01:13:20.863421+0000","last_became_active":"2024-09-12T00:02:50.072791+0000","last_became_peered":"2024-09-12T00:02:50.072791+0000","last_unstale":"2024-09-12T01:13:20.863421+0000","last_undegraded":"2024-09-12T01:13:20.863421+0000","last_fullsized":"2024-09-12T01:13:20.863421+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:30.271643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3382,"num_write":1095,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'201","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.222482+0000","last_change":"2024-09-12T00:02:48.053788+0000","last_active":"2024-09-12T01:15:48.222482+0000","last_peered":"2024-09-12T01:15:48.222482+0000","last_clean":"2024-09-12T01:15:48.222482+0000","last_became_active":"2024-09-12T00:02:48.053452+0000","last_became_peered":"2024-09-12T00:02:48.053452+0000","last_unstale":"2024-09-12T01:15:48.222482+0000","last_undegraded":"2024-09-12T01:15:48.222482+0000","last_fullsized":"2024-09-12T01:15:48.222482+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:23.267737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684145,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":6281,"num_write":1001,"num_write_kb":31607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'856","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956760+0000","last_change":"2024-09-12T00:02:50.072524+0000","last_active":"2024-09-12T01:14:02.956760+0000","last_peered":"2024-09-12T01:14:02.956760+0000","last_clean":"2024-09-12T01:14:02.956760+0000","last_became_active":"2024-09-12T00:02:50.072128+0000","last_became_peered":"2024-09-12T00:02:50.072128+0000","last_unstale":"2024-09-12T01:14:02.956760+0000","last_undegraded":"2024-09-12T01:14:02.956760+0000","last_fullsized":"2024-09-12T01:14:02.956760+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:10.120502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4255,"num_read_kb":3837,"num_write":1128,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'188","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.164834+0000","last_change":"2024-09-12T00:02:48.059802+0000","last_active":"2024-09-12T01:15:48.164834+0000","last_peered":"2024-09-12T01:15:48.164834+0000","last_clean":"2024-09-12T01:15:48.164834+0000","last_became_active":"2024-09-12T00:02:48.059289+0000","last_became_peered":"2024-09-12T00:02:48.059289+0000","last_unstale":"2024-09-12T01:15:48.164834+0000","last_undegraded":"2024-09-12T01:15:48.164834+0000","last_fullsized":"2024-09-12T01:15:48.164834+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:59.633157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342107,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":40439,"num_write":973,"num_write_kb":33156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'997","reported_seq":2680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956778+0000","last_change":"2024-09-12T00:02:50.070109+0000","last_active":"2024-09-12T01:14:02.956778+0000","last_peered":"2024-09-12T01:14:02.956778+0000","last_clean":"2024-09-12T01:14:02.956778+0000","last_became_active":"2024-09-12T00:02:50.069775+0000","last_became_peered":"2024-09-12T00:02:50.069775+0000","last_unstale":"2024-09-12T01:14:02.956778+0000","last_undegraded":"2024-09-12T01:14:02.956778+0000","last_fullsized":"2024-09-12T01:14:02.956778+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:30.986657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4692,"num_read_kb":4217,"num_write":1368,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'200","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.019994+0000","last_change":"2024-09-12T00:04:21.323388+0000","last_active":"2024-09-12T01:15:48.019994+0000","last_peered":"2024-09-12T01:15:48.019994+0000","last_clean":"2024-09-12T01:15:48.019994+0000","last_became_active":"2024-09-12T00:04:21.322881+0000","last_became_peered":"2024-09-12T00:04:21.322881+0000","last_unstale":"2024-09-12T01:15:48.019994+0000","last_undegraded":"2024-09-12T01:15:48.019994+0000","last_fullsized":"2024-09-12T01:15:48.019994+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.218601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15793517,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":543,"num_read_kb":44397,"num_write":1008,"num_write_kb":26074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"267'849","reported_seq":2416,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.284675+0000","last_change":"2024-09-12T00:02:50.061400+0000","last_active":"2024-09-12T01:12:58.284675+0000","last_peered":"2024-09-12T01:12:58.284675+0000","last_clean":"2024-09-12T01:12:58.284675+0000","last_became_active":"2024-09-12T00:02:50.061055+0000","last_became_peered":"2024-09-12T00:02:50.061055+0000","last_unstale":"2024-09-12T01:12:58.284675+0000","last_undegraded":"2024-09-12T01:12:58.284675+0000","last_fullsized":"2024-09-12T01:12:58.284675+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:36.257000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3601,"num_write":1146,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'245","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.114969+0000","last_change":"2024-09-12T00:03:22.073808+0000","last_active":"2024-09-12T01:15:48.114969+0000","last_peered":"2024-09-12T01:15:48.114969+0000","last_clean":"2024-09-12T01:15:48.114969+0000","last_became_active":"2024-09-12T00:03:22.073294+0000","last_became_peered":"2024-09-12T00:03:22.073294+0000","last_unstale":"2024-09-12T01:15:48.114969+0000","last_undegraded":"2024-09-12T01:15:48.114969+0000","last_fullsized":"2024-09-12T01:15:48.114969+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:48.679955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5615297,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":9461,"num_write":1067,"num_write_kb":47816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"267'873","reported_seq":2497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.955537+0000","last_change":"2024-09-12T00:02:50.067613+0000","last_active":"2024-09-12T01:14:02.955537+0000","last_peered":"2024-09-12T01:14:02.955537+0000","last_clean":"2024-09-12T01:14:02.955537+0000","last_became_active":"2024-09-12T00:02:50.067334+0000","last_became_peered":"2024-09-12T00:02:50.067334+0000","last_unstale":"2024-09-12T01:14:02.955537+0000","last_undegraded":"2024-09-12T01:14:02.955537+0000","last_fullsized":"2024-09-12T01:14:02.955537+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:15.631907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4129,"num_read_kb":3712,"num_write":1142,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'240","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.835489+0000","last_change":"2024-09-12T00:02:48.050847+0000","last_active":"2024-09-12T01:15:08.835489+0000","last_peered":"2024-09-12T01:15:08.835489+0000","last_clean":"2024-09-12T01:15:08.835489+0000","last_became_active":"2024-09-12T00:02:48.049926+0000","last_became_peered":"2024-09-12T00:02:48.049926+0000","last_unstale":"2024-09-12T01:15:08.835489+0000","last_undegraded":"2024-09-12T01:15:08.835489+0000","last_fullsized":"2024-09-12T01:15:08.835489+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:56.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10884929,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":663,"num_read_kb":41400,"num_write":1179,"num_write_kb":37207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'135","reported_seq":652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.271975+0000","last_change":"2024-09-12T00:02:58.094744+0000","last_active":"2024-09-12T01:14:04.271975+0000","last_peered":"2024-09-12T01:14:04.271975+0000","last_clean":"2024-09-12T01:14:04.271975+0000","last_became_active":"2024-09-12T00:02:58.094271+0000","last_became_peered":"2024-09-12T00:02:58.094271+0000","last_unstale":"2024-09-12T01:14:04.271975+0000","last_undegraded":"2024-09-12T01:14:04.271975+0000","last_fullsized":"2024-09-12T01:14:04.271975+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:25.220277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":142,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'583","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.279891+0000","last_change":"2024-09-12T00:02:50.073678+0000","last_active":"2024-09-12T01:13:32.279891+0000","last_peered":"2024-09-12T01:13:32.279891+0000","last_clean":"2024-09-12T01:13:32.279891+0000","last_became_active":"2024-09-12T00:02:50.073327+0000","last_became_peered":"2024-09-12T00:02:50.073327+0000","last_unstale":"2024-09-12T01:13:32.279891+0000","last_undegraded":"2024-09-12T01:13:32.279891+0000","last_fullsized":"2024-09-12T01:13:32.279891+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:33.890960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3161,"num_read_kb":2955,"num_write":696,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'270","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.221731+0000","last_change":"2024-09-12T00:03:21.143983+0000","last_active":"2024-09-12T01:15:48.221731+0000","last_peered":"2024-09-12T01:15:48.221731+0000","last_clean":"2024-09-12T01:15:48.221731+0000","last_became_active":"2024-09-12T00:03:21.143543+0000","last_became_peered":"2024-09-12T00:03:21.143543+0000","last_unstale":"2024-09-12T01:15:48.221731+0000","last_undegraded":"2024-09-12T01:15:48.221731+0000","last_fullsized":"2024-09-12T01:15:48.221731+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:23.255657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":789,"num_read_kb":207403,"num_write":1277,"num_write_kb":65033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510971+0000","last_change":"2024-09-12T00:02:52.067537+0000","last_active":"2024-09-12T01:12:58.510971+0000","last_peered":"2024-09-12T01:12:58.510971+0000","last_clean":"2024-09-12T01:12:58.510971+0000","last_became_active":"2024-09-12T00:02:52.067288+0000","last_became_peered":"2024-09-12T00:02:52.067288+0000","last_unstale":"2024-09-12T01:12:58.510971+0000","last_undegraded":"2024-09-12T01:12:58.510971+0000","last_fullsized":"2024-09-12T01:12:58.510971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:59.660984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'232","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.876021+0000","last_change":"2024-09-12T00:02:54.070876+0000","last_active":"2024-09-12T01:15:10.876021+0000","last_peered":"2024-09-12T01:15:10.876021+0000","last_clean":"2024-09-12T01:15:10.876021+0000","last_became_active":"2024-09-12T00:02:54.070547+0000","last_became_peered":"2024-09-12T00:02:54.070547+0000","last_unstale":"2024-09-12T01:15:10.876021+0000","last_undegraded":"2024-09-12T01:15:10.876021+0000","last_fullsized":"2024-09-12T01:15:10.876021+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:55.618177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14585,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":311,"num_read_kb":395,"num_write":192,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.400430+0000","last_change":"2024-09-12T00:02:56.081347+0000","last_active":"2024-09-12T01:13:03.400430+0000","last_peered":"2024-09-12T01:13:03.400430+0000","last_clean":"2024-09-12T01:13:03.400430+0000","last_became_active":"2024-09-12T00:02:56.081086+0000","last_became_peered":"2024-09-12T00:02:56.081086+0000","last_unstale":"2024-09-12T01:13:03.400430+0000","last_undegraded":"2024-09-12T01:13:03.400430+0000","last_fullsized":"2024-09-12T01:13:03.400430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:59.050278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'2432","reported_seq":4341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.081005+0000","last_change":"2024-09-12T00:02:58.096284+0000","last_active":"2024-09-12T01:14:00.081005+0000","last_peered":"2024-09-12T01:14:00.081005+0000","last_clean":"2024-09-12T01:14:00.081005+0000","last_became_active":"2024-09-12T00:02:58.095948+0000","last_became_peered":"2024-09-12T00:02:58.095948+0000","last_unstale":"2024-09-12T01:14:00.081005+0000","last_undegraded":"2024-09-12T01:14:00.081005+0000","last_fullsized":"2024-09-12T01:14:00.081005+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6163,"num_read_kb":6149,"num_write":4865,"num_write_kb":1796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'433","reported_seq":1960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510948+0000","last_change":"2024-09-12T00:02:50.066811+0000","last_active":"2024-09-12T01:12:58.510948+0000","last_peered":"2024-09-12T01:12:58.510948+0000","last_clean":"2024-09-12T01:12:58.510948+0000","last_became_active":"2024-09-12T00:02:50.065654+0000","last_became_peered":"2024-09-12T00:02:50.065654+0000","last_unstale":"2024-09-12T01:12:58.510948+0000","last_undegraded":"2024-09-12T01:12:58.510948+0000","last_fullsized":"2024-09-12T01:12:58.510948+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:32.174985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2304,"num_read_kb":2172,"num_write":510,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'197","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243250+0000","last_change":"2024-09-12T00:02:48.052092+0000","last_active":"2024-09-12T01:12:50.243250+0000","last_peered":"2024-09-12T01:12:50.243250+0000","last_clean":"2024-09-12T01:12:50.243250+0000","last_became_active":"2024-09-12T00:02:48.050499+0000","last_became_peered":"2024-09-12T00:02:48.050499+0000","last_unstale":"2024-09-12T01:12:50.243250+0000","last_undegraded":"2024-09-12T01:12:50.243250+0000","last_fullsized":"2024-09-12T01:12:50.243250+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.925597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324673,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":413,"num_read_kb":23205,"num_write":929,"num_write_kb":52906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455377+0000","last_change":"2024-09-12T00:02:52.068820+0000","last_active":"2024-09-12T01:12:58.455377+0000","last_peered":"2024-09-12T01:12:58.455377+0000","last_clean":"2024-09-12T01:12:58.455377+0000","last_became_active":"2024-09-12T00:02:52.068519+0000","last_became_peered":"2024-09-12T00:02:52.068519+0000","last_unstale":"2024-09-12T01:12:58.455377+0000","last_undegraded":"2024-09-12T01:12:58.455377+0000","last_fullsized":"2024-09-12T01:12:58.455377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:41.402904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'115","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.479573+0000","last_change":"2024-09-12T00:02:54.060615+0000","last_active":"2024-09-12T01:13:29.479573+0000","last_peered":"2024-09-12T01:13:29.479573+0000","last_clean":"2024-09-12T01:13:29.479573+0000","last_became_active":"2024-09-12T00:02:54.060334+0000","last_became_peered":"2024-09-12T00:02:54.060334+0000","last_unstale":"2024-09-12T01:13:29.479573+0000","last_undegraded":"2024-09-12T01:13:29.479573+0000","last_fullsized":"2024-09-12T01:13:29.479573+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:06.270504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.399195+0000","last_change":"2024-09-12T00:02:56.085489+0000","last_active":"2024-09-12T01:13:03.399195+0000","last_peered":"2024-09-12T01:13:03.399195+0000","last_clean":"2024-09-12T01:13:03.399195+0000","last_became_active":"2024-09-12T00:02:56.085222+0000","last_became_peered":"2024-09-12T00:02:56.085222+0000","last_unstale":"2024-09-12T01:13:03.399195+0000","last_undegraded":"2024-09-12T01:13:03.399195+0000","last_fullsized":"2024-09-12T01:13:03.399195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:10.915396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'143","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244578+0000","last_change":"2024-09-12T00:02:58.094502+0000","last_active":"2024-09-12T01:13:00.244578+0000","last_peered":"2024-09-12T01:13:00.244578+0000","last_clean":"2024-09-12T01:13:00.244578+0000","last_became_active":"2024-09-12T00:02:58.094312+0000","last_became_peered":"2024-09-12T00:02:58.094312+0000","last_unstale":"2024-09-12T01:13:00.244578+0000","last_undegraded":"2024-09-12T01:13:00.244578+0000","last_fullsized":"2024-09-12T01:13:00.244578+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:05.995438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":193,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'829","reported_seq":2430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.964131+0000","last_change":"2024-09-12T00:02:50.071513+0000","last_active":"2024-09-12T01:13:13.964131+0000","last_peered":"2024-09-12T01:13:13.964131+0000","last_clean":"2024-09-12T01:13:13.964131+0000","last_became_active":"2024-09-12T00:02:50.071219+0000","last_became_peered":"2024-09-12T00:02:50.071219+0000","last_unstale":"2024-09-12T01:13:13.964131+0000","last_undegraded":"2024-09-12T01:13:13.964131+0000","last_fullsized":"2024-09-12T01:13:13.964131+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:42.605165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4069,"num_read_kb":3661,"num_write":1104,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'211","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.133404+0000","last_change":"2024-09-12T00:02:48.059794+0000","last_active":"2024-09-12T01:15:48.133404+0000","last_peered":"2024-09-12T01:15:48.133404+0000","last_clean":"2024-09-12T01:15:48.133404+0000","last_became_active":"2024-09-12T00:02:48.059132+0000","last_became_peered":"2024-09-12T00:02:48.059132+0000","last_unstale":"2024-09-12T01:15:48.133404+0000","last_undegraded":"2024-09-12T01:15:48.133404+0000","last_fullsized":"2024-09-12T01:15:48.133404+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.465348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":5763,"num_write":993,"num_write_kb":32529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455423+0000","last_change":"2024-09-12T00:02:52.064543+0000","last_active":"2024-09-12T01:12:58.455423+0000","last_peered":"2024-09-12T01:12:58.455423+0000","last_clean":"2024-09-12T01:12:58.455423+0000","last_became_active":"2024-09-12T00:02:52.064216+0000","last_became_peered":"2024-09-12T00:02:52.064216+0000","last_unstale":"2024-09-12T01:12:58.455423+0000","last_undegraded":"2024-09-12T01:12:58.455423+0000","last_fullsized":"2024-09-12T01:12:58.455423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:47.668439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'155","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.520130+0000","last_change":"2024-09-12T00:02:54.060808+0000","last_active":"2024-09-12T01:13:29.520130+0000","last_peered":"2024-09-12T01:13:29.520130+0000","last_clean":"2024-09-12T01:13:29.520130+0000","last_became_active":"2024-09-12T00:02:54.060501+0000","last_became_peered":"2024-09-12T00:02:54.060501+0000","last_unstale":"2024-09-12T01:13:29.520130+0000","last_undegraded":"2024-09-12T01:13:29.520130+0000","last_fullsized":"2024-09-12T01:13:29.520130+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.725874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":182,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'766","reported_seq":2662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.957227+0000","last_change":"2024-09-12T00:02:56.087899+0000","last_active":"2024-09-12T01:15:47.957227+0000","last_peered":"2024-09-12T01:15:47.957227+0000","last_clean":"2024-09-12T01:15:47.957227+0000","last_became_active":"2024-09-12T00:02:56.087506+0000","last_became_peered":"2024-09-12T00:02:56.087506+0000","last_unstale":"2024-09-12T01:15:47.957227+0000","last_undegraded":"2024-09-12T01:15:47.957227+0000","last_fullsized":"2024-09-12T01:15:47.957227+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.840099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'208","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.331265+0000","last_change":"2024-09-12T00:02:58.090727+0000","last_active":"2024-09-12T01:14:04.331265+0000","last_peered":"2024-09-12T01:14:04.331265+0000","last_clean":"2024-09-12T01:14:04.331265+0000","last_became_active":"2024-09-12T00:02:58.090424+0000","last_became_peered":"2024-09-12T00:02:58.090424+0000","last_unstale":"2024-09-12T01:14:04.331265+0000","last_undegraded":"2024-09-12T01:14:04.331265+0000","last_fullsized":"2024-09-12T01:14:04.331265+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:25.948169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":609,"num_read_kb":603,"num_write":442,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'493","reported_seq":2294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455414+0000","last_change":"2024-09-12T00:02:50.068236+0000","last_active":"2024-09-12T01:12:58.455414+0000","last_peered":"2024-09-12T01:12:58.455414+0000","last_clean":"2024-09-12T01:12:58.455414+0000","last_became_active":"2024-09-12T00:02:50.067933+0000","last_became_peered":"2024-09-12T00:02:50.067933+0000","last_unstale":"2024-09-12T01:12:58.455414+0000","last_undegraded":"2024-09-12T01:12:58.455414+0000","last_fullsized":"2024-09-12T01:12:58.455414+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:07.127880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2745,"num_read_kb":2618,"num_write":566,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'210","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.262322+0000","last_change":"2024-09-12T00:02:48.052920+0000","last_active":"2024-09-12T01:15:48.262322+0000","last_peered":"2024-09-12T01:15:48.262322+0000","last_clean":"2024-09-12T01:15:48.262322+0000","last_became_active":"2024-09-12T00:02:48.052566+0000","last_became_peered":"2024-09-12T00:02:48.052566+0000","last_unstale":"2024-09-12T01:15:48.262322+0000","last_undegraded":"2024-09-12T01:15:48.262322+0000","last_fullsized":"2024-09-12T01:15:48.262322+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:54.469835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":572,"num_read_kb":73907,"num_write":996,"num_write_kb":20895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.511011+0000","last_change":"2024-09-12T00:02:52.066484+0000","last_active":"2024-09-12T01:12:58.511011+0000","last_peered":"2024-09-12T01:12:58.511011+0000","last_clean":"2024-09-12T01:12:58.511011+0000","last_became_active":"2024-09-12T00:02:52.066171+0000","last_became_peered":"2024-09-12T00:02:52.066171+0000","last_unstale":"2024-09-12T01:12:58.511011+0000","last_undegraded":"2024-09-12T01:12:58.511011+0000","last_fullsized":"2024-09-12T01:12:58.511011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.617107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'168","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.074173+0000","last_change":"2024-09-12T00:02:54.239939+0000","last_active":"2024-09-12T01:15:48.074173+0000","last_peered":"2024-09-12T01:15:48.074173+0000","last_clean":"2024-09-12T01:15:48.074173+0000","last_became_active":"2024-09-12T00:02:54.239618+0000","last_became_peered":"2024-09-12T00:02:54.239618+0000","last_unstale":"2024-09-12T01:15:48.074173+0000","last_undegraded":"2024-09-12T01:15:48.074173+0000","last_fullsized":"2024-09-12T01:15:48.074173+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:03.054772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":308,"num_write":128,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'806","reported_seq":2629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.960735+0000","last_change":"2024-09-12T00:02:56.082933+0000","last_active":"2024-09-12T01:15:47.960735+0000","last_peered":"2024-09-12T01:15:47.960735+0000","last_clean":"2024-09-12T01:15:47.960735+0000","last_became_active":"2024-09-12T00:02:56.082567+0000","last_became_peered":"2024-09-12T00:02:56.082567+0000","last_unstale":"2024-09-12T01:15:47.960735+0000","last_undegraded":"2024-09-12T01:15:47.960735+0000","last_fullsized":"2024-09-12T01:15:47.960735+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:12.520817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'363","reported_seq":1779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.740706+0000","last_change":"2024-09-12T00:02:50.063983+0000","last_active":"2024-09-12T01:12:50.740706+0000","last_peered":"2024-09-12T01:12:50.740706+0000","last_clean":"2024-09-12T01:12:50.740706+0000","last_became_active":"2024-09-12T00:02:50.063707+0000","last_became_peered":"2024-09-12T00:02:50.063707+0000","last_unstale":"2024-09-12T01:12:50.740706+0000","last_undegraded":"2024-09-12T01:12:50.740706+0000","last_fullsized":"2024-09-12T01:12:50.740706+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:50.652404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1902,"num_write":425,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'196","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154808+0000","last_change":"2024-09-12T00:02:48.056458+0000","last_active":"2024-09-12T01:15:48.154808+0000","last_peered":"2024-09-12T01:15:48.154808+0000","last_clean":"2024-09-12T01:15:48.154808+0000","last_became_active":"2024-09-12T00:02:48.056135+0000","last_became_peered":"2024-09-12T00:02:48.056135+0000","last_unstale":"2024-09-12T01:15:48.154808+0000","last_undegraded":"2024-09-12T01:15:48.154808+0000","last_fullsized":"2024-09-12T01:15:48.154808+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:17.917949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":40539,"num_write":934,"num_write_kb":46911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.393561+0000","last_change":"2024-09-12T00:02:52.069040+0000","last_active":"2024-09-12T01:12:13.393561+0000","last_peered":"2024-09-12T01:12:13.393561+0000","last_clean":"2024-09-12T01:12:13.393561+0000","last_became_active":"2024-09-12T00:02:52.068747+0000","last_became_peered":"2024-09-12T00:02:52.068747+0000","last_unstale":"2024-09-12T01:12:13.393561+0000","last_undegraded":"2024-09-12T01:12:13.393561+0000","last_fullsized":"2024-09-12T01:12:13.393561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.948073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'275","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.157693+0000","last_change":"2024-09-12T00:02:54.239819+0000","last_active":"2024-09-12T01:15:48.157693+0000","last_peered":"2024-09-12T01:15:48.157693+0000","last_clean":"2024-09-12T01:15:48.157693+0000","last_became_active":"2024-09-12T00:02:54.239475+0000","last_became_peered":"2024-09-12T00:02:54.239475+0000","last_unstale":"2024-09-12T01:15:48.157693+0000","last_undegraded":"2024-09-12T01:15:48.157693+0000","last_fullsized":"2024-09-12T01:15:48.157693+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:54.855357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5743,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":380,"num_read_kb":454,"num_write":232,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.234848+0000","last_change":"2024-09-12T00:02:56.082064+0000","last_active":"2024-09-12T01:12:43.234848+0000","last_peered":"2024-09-12T01:12:43.234848+0000","last_clean":"2024-09-12T01:12:43.234848+0000","last_became_active":"2024-09-12T00:02:56.080748+0000","last_became_peered":"2024-09-12T00:02:56.080748+0000","last_unstale":"2024-09-12T01:12:43.234848+0000","last_undegraded":"2024-09-12T01:12:43.234848+0000","last_fullsized":"2024-09-12T01:12:43.234848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:53.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'526","reported_seq":1341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.895471+0000","last_change":"2024-09-12T00:02:58.095783+0000","last_active":"2024-09-12T01:15:10.895471+0000","last_peered":"2024-09-12T01:15:10.895471+0000","last_clean":"2024-09-12T01:15:10.895471+0000","last_became_active":"2024-09-12T00:02:58.095311+0000","last_became_peered":"2024-09-12T00:02:58.095311+0000","last_unstale":"2024-09-12T01:15:10.895471+0000","last_undegraded":"2024-09-12T01:15:10.895471+0000","last_fullsized":"2024-09-12T01:15:10.895471+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:26.606781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1247,"num_read_kb":1245,"num_write":1070,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'399","reported_seq":1701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.391883+0000","last_change":"2024-09-12T00:02:50.068582+0000","last_active":"2024-09-12T01:12:13.391883+0000","last_peered":"2024-09-12T01:12:13.391883+0000","last_clean":"2024-09-12T01:12:13.391883+0000","last_became_active":"2024-09-12T00:02:50.068223+0000","last_became_peered":"2024-09-12T00:02:50.068223+0000","last_unstale":"2024-09-12T01:12:13.391883+0000","last_undegraded":"2024-09-12T01:12:13.391883+0000","last_fullsized":"2024-09-12T01:12:13.391883+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:39.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1919,"num_read_kb":1778,"num_write":479,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'153","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.212769+0000","last_change":"2024-09-12T00:02:48.056639+0000","last_active":"2024-09-12T01:15:48.212769+0000","last_peered":"2024-09-12T01:15:48.212769+0000","last_clean":"2024-09-12T01:15:48.212769+0000","last_became_active":"2024-09-12T00:02:48.055480+0000","last_became_peered":"2024-09-12T00:02:48.055480+0000","last_unstale":"2024-09-12T01:15:48.212769+0000","last_undegraded":"2024-09-12T01:15:48.212769+0000","last_fullsized":"2024-09-12T01:15:48.212769+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:35.963894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250607,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":416,"num_read_kb":43431,"num_write":767,"num_write_kb":28983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.223502+0000","last_change":"2024-09-12T00:02:52.062537+0000","last_active":"2024-09-12T01:12:13.223502+0000","last_peered":"2024-09-12T01:12:13.223502+0000","last_clean":"2024-09-12T01:12:13.223502+0000","last_became_active":"2024-09-12T00:02:52.062219+0000","last_became_peered":"2024-09-12T00:02:52.062219+0000","last_unstale":"2024-09-12T01:12:13.223502+0000","last_undegraded":"2024-09-12T01:12:13.223502+0000","last_fullsized":"2024-09-12T01:12:13.223502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:37.629100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'154","reported_seq":742,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.857945+0000","last_change":"2024-09-12T00:02:54.069965+0000","last_active":"2024-09-12T01:15:10.857945+0000","last_peered":"2024-09-12T01:15:10.857945+0000","last_clean":"2024-09-12T01:15:10.857945+0000","last_became_active":"2024-09-12T00:02:54.069656+0000","last_became_peered":"2024-09-12T00:02:54.069656+0000","last_unstale":"2024-09-12T01:15:10.857945+0000","last_undegraded":"2024-09-12T01:15:10.857945+0000","last_fullsized":"2024-09-12T01:15:10.857945+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.543544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":256,"num_write":104,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.451158+0000","last_change":"2024-09-12T00:02:56.082127+0000","last_active":"2024-09-12T01:12:23.451158+0000","last_peered":"2024-09-12T01:12:23.451158+0000","last_clean":"2024-09-12T01:12:23.451158+0000","last_became_active":"2024-09-12T00:02:56.081804+0000","last_became_peered":"2024-09-12T00:02:56.081804+0000","last_unstale":"2024-09-12T01:12:23.451158+0000","last_undegraded":"2024-09-12T01:12:23.451158+0000","last_fullsized":"2024-09-12T01:12:23.451158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'120","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:53.623729+0000","last_change":"2024-09-12T00:02:58.095336+0000","last_active":"2024-09-12T01:13:53.623729+0000","last_peered":"2024-09-12T01:13:53.623729+0000","last_clean":"2024-09-12T01:13:53.623729+0000","last_became_active":"2024-09-12T00:02:58.095068+0000","last_became_peered":"2024-09-12T00:02:58.095068+0000","last_unstale":"2024-09-12T01:13:53.623729+0000","last_undegraded":"2024-09-12T01:13:53.623729+0000","last_fullsized":"2024-09-12T01:13:53.623729+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:41.572699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":135,"num_write":297,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'895","reported_seq":2417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956001+0000","last_change":"2024-09-12T00:02:50.078307+0000","last_active":"2024-09-12T01:14:02.956001+0000","last_peered":"2024-09-12T01:14:02.956001+0000","last_clean":"2024-09-12T01:14:02.956001+0000","last_became_active":"2024-09-12T00:02:50.078033+0000","last_became_peered":"2024-09-12T00:02:50.078033+0000","last_unstale":"2024-09-12T01:14:02.956001+0000","last_undegraded":"2024-09-12T01:14:02.956001+0000","last_fullsized":"2024-09-12T01:14:02.956001+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:39.344301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4128,"num_read_kb":3671,"num_write":1209,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'185","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010442+0000","last_change":"2024-09-12T00:02:48.050254+0000","last_active":"2024-09-12T01:15:48.010442+0000","last_peered":"2024-09-12T01:15:48.010442+0000","last_clean":"2024-09-12T01:15:48.010442+0000","last_became_active":"2024-09-12T00:02:48.048973+0000","last_became_peered":"2024-09-12T00:02:48.048973+0000","last_unstale":"2024-09-12T01:15:48.010442+0000","last_undegraded":"2024-09-12T01:15:48.010442+0000","last_fullsized":"2024-09-12T01:15:48.010442+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:37.674699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":6868,"num_write":918,"num_write_kb":34085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.226604+0000","last_change":"2024-09-12T00:02:52.066165+0000","last_active":"2024-09-12T01:12:38.226604+0000","last_peered":"2024-09-12T01:12:38.226604+0000","last_clean":"2024-09-12T01:12:38.226604+0000","last_became_active":"2024-09-12T00:02:52.065809+0000","last_became_peered":"2024-09-12T00:02:52.065809+0000","last_unstale":"2024-09-12T01:12:38.226604+0000","last_undegraded":"2024-09-12T01:12:38.226604+0000","last_fullsized":"2024-09-12T01:12:38.226604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:04.139647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'211","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.180814+0000","last_change":"2024-09-12T00:02:54.067330+0000","last_active":"2024-09-12T01:15:48.180814+0000","last_peered":"2024-09-12T01:15:48.180814+0000","last_clean":"2024-09-12T01:15:48.180814+0000","last_became_active":"2024-09-12T00:02:54.066781+0000","last_became_peered":"2024-09-12T00:02:54.066781+0000","last_unstale":"2024-09-12T01:15:48.180814+0000","last_undegraded":"2024-09-12T01:15:48.180814+0000","last_fullsized":"2024-09-12T01:15:48.180814+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:13.921060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":282,"num_read_kb":329,"num_write":166,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'791","reported_seq":2814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.937531+0000","last_change":"2024-09-12T00:02:56.086997+0000","last_active":"2024-09-12T01:15:13.937531+0000","last_peered":"2024-09-12T01:15:13.937531+0000","last_clean":"2024-09-12T01:15:13.937531+0000","last_became_active":"2024-09-12T00:02:56.086692+0000","last_became_peered":"2024-09-12T00:02:56.086692+0000","last_unstale":"2024-09-12T01:15:13.937531+0000","last_undegraded":"2024-09-12T01:15:13.937531+0000","last_fullsized":"2024-09-12T01:15:13.937531+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:43.673008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'116","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.570840+0000","last_change":"2024-09-12T00:02:58.093723+0000","last_active":"2024-09-12T01:15:09.570840+0000","last_peered":"2024-09-12T01:15:09.570840+0000","last_clean":"2024-09-12T01:15:09.570840+0000","last_became_active":"2024-09-12T00:02:58.093419+0000","last_became_peered":"2024-09-12T00:02:58.093419+0000","last_unstale":"2024-09-12T01:15:09.570840+0000","last_undegraded":"2024-09-12T01:15:09.570840+0000","last_fullsized":"2024-09-12T01:15:09.570840+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:27.505545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":298,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'399","reported_seq":1992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.655457+0000","last_change":"2024-09-12T00:02:50.074292+0000","last_active":"2024-09-12T01:12:55.655457+0000","last_peered":"2024-09-12T01:12:55.655457+0000","last_clean":"2024-09-12T01:12:55.655457+0000","last_became_active":"2024-09-12T00:02:50.073986+0000","last_became_peered":"2024-09-12T00:02:50.073986+0000","last_unstale":"2024-09-12T01:12:55.655457+0000","last_undegraded":"2024-09-12T01:12:55.655457+0000","last_fullsized":"2024-09-12T01:12:55.655457+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:10.242887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2369,"num_read_kb":2271,"num_write":449,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'218","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041533+0000","last_change":"2024-09-12T00:02:48.051538+0000","last_active":"2024-09-12T01:15:48.041533+0000","last_peered":"2024-09-12T01:15:48.041533+0000","last_clean":"2024-09-12T01:15:48.041533+0000","last_became_active":"2024-09-12T00:02:48.051190+0000","last_became_peered":"2024-09-12T00:02:48.051190+0000","last_unstale":"2024-09-12T01:15:48.041533+0000","last_undegraded":"2024-09-12T01:15:48.041533+0000","last_fullsized":"2024-09-12T01:15:48.041533+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:22.141104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":21060,"num_write":1056,"num_write_kb":24204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:28.225385+0000","last_change":"2024-09-12T00:02:52.057007+0000","last_active":"2024-09-12T01:12:28.225385+0000","last_peered":"2024-09-12T01:12:28.225385+0000","last_clean":"2024-09-12T01:12:28.225385+0000","last_became_active":"2024-09-12T00:02:52.056676+0000","last_became_peered":"2024-09-12T00:02:52.056676+0000","last_unstale":"2024-09-12T01:12:28.225385+0000","last_undegraded":"2024-09-12T01:12:28.225385+0000","last_fullsized":"2024-09-12T01:12:28.225385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:05.044357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'218","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.861291+0000","last_change":"2024-09-12T00:02:54.067361+0000","last_active":"2024-09-12T01:15:10.861291+0000","last_peered":"2024-09-12T01:15:10.861291+0000","last_clean":"2024-09-12T01:15:10.861291+0000","last_became_active":"2024-09-12T00:02:54.066994+0000","last_became_peered":"2024-09-12T00:02:54.066994+0000","last_unstale":"2024-09-12T01:15:10.861291+0000","last_undegraded":"2024-09-12T01:15:10.861291+0000","last_fullsized":"2024-09-12T01:15:10.861291+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:13.963065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":303,"num_read_kb":404,"num_write":158,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.224174+0000","last_change":"2024-09-12T00:02:56.079092+0000","last_active":"2024-09-12T01:12:18.224174+0000","last_peered":"2024-09-12T01:12:18.224174+0000","last_clean":"2024-09-12T01:12:18.224174+0000","last_became_active":"2024-09-12T00:02:56.078740+0000","last_became_peered":"2024-09-12T00:02:56.078740+0000","last_unstale":"2024-09-12T01:12:18.224174+0000","last_undegraded":"2024-09-12T01:12:18.224174+0000","last_fullsized":"2024-09-12T01:12:18.224174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.551797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'108","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.778285+0000","last_change":"2024-09-12T00:02:58.092860+0000","last_active":"2024-09-12T01:14:00.778285+0000","last_peered":"2024-09-12T01:14:00.778285+0000","last_clean":"2024-09-12T01:14:00.778285+0000","last_became_active":"2024-09-12T00:02:58.092520+0000","last_became_peered":"2024-09-12T00:02:58.092520+0000","last_unstale":"2024-09-12T01:14:00.778285+0000","last_undegraded":"2024-09-12T01:14:00.778285+0000","last_fullsized":"2024-09-12T01:14:00.778285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":241,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'520","reported_seq":2234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.281027+0000","last_change":"2024-09-12T00:02:50.069136+0000","last_active":"2024-09-12T01:13:32.281027+0000","last_peered":"2024-09-12T01:13:32.281027+0000","last_clean":"2024-09-12T01:13:32.281027+0000","last_became_active":"2024-09-12T00:02:50.068691+0000","last_became_peered":"2024-09-12T00:02:50.068691+0000","last_unstale":"2024-09-12T01:13:32.281027+0000","last_undegraded":"2024-09-12T01:13:32.281027+0000","last_fullsized":"2024-09-12T01:13:32.281027+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.229579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2837,"num_read_kb":2668,"num_write":620,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'203","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.230560+0000","last_change":"2024-09-12T00:02:48.052397+0000","last_active":"2024-09-12T01:15:48.230560+0000","last_peered":"2024-09-12T01:15:48.230560+0000","last_clean":"2024-09-12T01:15:48.230560+0000","last_became_active":"2024-09-12T00:02:48.050513+0000","last_became_peered":"2024-09-12T00:02:48.050513+0000","last_unstale":"2024-09-12T01:15:48.230560+0000","last_undegraded":"2024-09-12T01:15:48.230560+0000","last_fullsized":"2024-09-12T01:15:48.230560+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:38.868513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6584947,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":922,"num_read_kb":76851,"num_write":1039,"num_write_kb":50138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.226648+0000","last_change":"2024-09-12T00:02:52.064616+0000","last_active":"2024-09-12T01:12:38.226648+0000","last_peered":"2024-09-12T01:12:38.226648+0000","last_clean":"2024-09-12T01:12:38.226648+0000","last_became_active":"2024-09-12T00:02:52.064333+0000","last_became_peered":"2024-09-12T00:02:52.064333+0000","last_unstale":"2024-09-12T01:12:38.226648+0000","last_undegraded":"2024-09-12T01:12:38.226648+0000","last_fullsized":"2024-09-12T01:12:38.226648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:11.063949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'175","reported_seq":778,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.013426+0000","last_change":"2024-09-12T00:02:54.069072+0000","last_active":"2024-09-12T01:15:48.013426+0000","last_peered":"2024-09-12T01:15:48.013426+0000","last_clean":"2024-09-12T01:15:48.013426+0000","last_became_active":"2024-09-12T00:02:54.068732+0000","last_became_peered":"2024-09-12T00:02:54.068732+0000","last_unstale":"2024-09-12T01:15:48.013426+0000","last_undegraded":"2024-09-12T01:15:48.013426+0000","last_fullsized":"2024-09-12T01:15:48.013426+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:07.854071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":259,"num_read_kb":329,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.244035+0000","last_change":"2024-09-12T00:02:56.088885+0000","last_active":"2024-09-12T01:12:55.244035+0000","last_peered":"2024-09-12T01:12:55.244035+0000","last_clean":"2024-09-12T01:12:55.244035+0000","last_became_active":"2024-09-12T00:02:56.088527+0000","last_became_peered":"2024-09-12T00:02:56.088527+0000","last_unstale":"2024-09-12T01:12:55.244035+0000","last_undegraded":"2024-09-12T01:12:55.244035+0000","last_fullsized":"2024-09-12T01:12:55.244035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:43.640519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'110","reported_seq":616,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:00.159830+0000","last_change":"2024-09-12T00:02:58.101029+0000","last_active":"2024-09-12T01:15:00.159830+0000","last_peered":"2024-09-12T01:15:00.159830+0000","last_clean":"2024-09-12T01:15:00.159830+0000","last_became_active":"2024-09-12T00:02:58.100726+0000","last_became_peered":"2024-09-12T00:02:58.100726+0000","last_unstale":"2024-09-12T01:15:00.159830+0000","last_undegraded":"2024-09-12T01:15:00.159830+0000","last_fullsized":"2024-09-12T01:15:00.159830+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:32.362052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":109,"num_write":270,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'820","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.718982+0000","last_change":"2024-09-12T00:02:50.059930+0000","last_active":"2024-09-12T01:15:09.718982+0000","last_peered":"2024-09-12T01:15:09.718982+0000","last_clean":"2024-09-12T01:15:09.718982+0000","last_became_active":"2024-09-12T00:02:50.059646+0000","last_became_peered":"2024-09-12T00:02:50.059646+0000","last_unstale":"2024-09-12T01:15:09.718982+0000","last_undegraded":"2024-09-12T01:15:09.718982+0000","last_fullsized":"2024-09-12T01:15:09.718982+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:39.274084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3626,"num_write":1074,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'218","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.147170+0000","last_change":"2024-09-12T00:02:48.046764+0000","last_active":"2024-09-12T01:15:48.147170+0000","last_peered":"2024-09-12T01:15:48.147170+0000","last_clean":"2024-09-12T01:15:48.147170+0000","last_became_active":"2024-09-12T00:02:48.046424+0000","last_became_peered":"2024-09-12T00:02:48.046424+0000","last_unstale":"2024-09-12T01:15:48.147170+0000","last_undegraded":"2024-09-12T01:15:48.147170+0000","last_fullsized":"2024-09-12T01:15:48.147170+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.965456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":142057,"num_write":895,"num_write_kb":42631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.234273+0000","last_change":"2024-09-12T00:02:52.064194+0000","last_active":"2024-09-12T01:12:38.234273+0000","last_peered":"2024-09-12T01:12:38.234273+0000","last_clean":"2024-09-12T01:12:38.234273+0000","last_became_active":"2024-09-12T00:02:52.063641+0000","last_became_peered":"2024-09-12T00:02:52.063641+0000","last_unstale":"2024-09-12T01:12:38.234273+0000","last_undegraded":"2024-09-12T01:12:38.234273+0000","last_fullsized":"2024-09-12T01:12:38.234273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:26.679512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'186","reported_seq":806,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.244141+0000","last_change":"2024-09-12T00:02:54.067652+0000","last_active":"2024-09-12T01:15:48.244141+0000","last_peered":"2024-09-12T01:15:48.244141+0000","last_clean":"2024-09-12T01:15:48.244141+0000","last_became_active":"2024-09-12T00:02:54.067328+0000","last_became_peered":"2024-09-12T00:02:54.067328+0000","last_unstale":"2024-09-12T01:15:48.244141+0000","last_undegraded":"2024-09-12T01:15:48.244141+0000","last_fullsized":"2024-09-12T01:15:48.244141+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:44.430717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":308,"num_write":148,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'743","reported_seq":2617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.956961+0000","last_change":"2024-09-12T00:02:56.079479+0000","last_active":"2024-09-12T01:15:47.956961+0000","last_peered":"2024-09-12T01:15:47.956961+0000","last_clean":"2024-09-12T01:15:47.956961+0000","last_became_active":"2024-09-12T00:02:56.079167+0000","last_became_peered":"2024-09-12T00:02:56.079167+0000","last_unstale":"2024-09-12T01:15:47.956961+0000","last_undegraded":"2024-09-12T01:15:47.956961+0000","last_fullsized":"2024-09-12T01:15:47.956961+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:15.403409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'124","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.241818+0000","last_change":"2024-09-12T00:02:58.097685+0000","last_active":"2024-09-12T01:13:48.241818+0000","last_peered":"2024-09-12T01:13:48.241818+0000","last_clean":"2024-09-12T01:13:48.241818+0000","last_became_active":"2024-09-12T00:02:58.097332+0000","last_became_peered":"2024-09-12T00:02:58.097332+0000","last_unstale":"2024-09-12T01:13:48.241818+0000","last_undegraded":"2024-09-12T01:13:48.241818+0000","last_fullsized":"2024-09-12T01:13:48.241818+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'385","reported_seq":1995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127378+0000","last_change":"2024-09-12T00:02:50.064012+0000","last_active":"2024-09-12T01:14:04.127378+0000","last_peered":"2024-09-12T01:14:04.127378+0000","last_clean":"2024-09-12T01:14:04.127378+0000","last_became_active":"2024-09-12T00:02:50.063676+0000","last_became_peered":"2024-09-12T00:02:50.063676+0000","last_unstale":"2024-09-12T01:14:04.127378+0000","last_undegraded":"2024-09-12T01:14:04.127378+0000","last_fullsized":"2024-09-12T01:14:04.127378+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:48.138249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2187,"num_read_kb":2115,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'185","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.213869+0000","last_change":"2024-09-12T00:02:48.046773+0000","last_active":"2024-09-12T01:15:48.213869+0000","last_peered":"2024-09-12T01:15:48.213869+0000","last_clean":"2024-09-12T01:15:48.213869+0000","last_became_active":"2024-09-12T00:02:48.046457+0000","last_became_peered":"2024-09-12T00:02:48.046457+0000","last_unstale":"2024-09-12T01:15:48.213869+0000","last_undegraded":"2024-09-12T01:15:48.213869+0000","last_fullsized":"2024-09-12T01:15:48.213869+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:27.570957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":408,"num_read_kb":52839,"num_write":877,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.937718+0000","last_change":"2024-09-12T00:02:52.068801+0000","last_active":"2024-09-12T01:15:47.937718+0000","last_peered":"2024-09-12T01:15:47.937718+0000","last_clean":"2024-09-12T01:15:47.937718+0000","last_became_active":"2024-09-12T00:02:52.068535+0000","last_became_peered":"2024-09-12T00:02:52.068535+0000","last_unstale":"2024-09-12T01:15:47.937718+0000","last_undegraded":"2024-09-12T01:15:47.937718+0000","last_fullsized":"2024-09-12T01:15:47.937718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:14.683759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'103","reported_seq":644,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.447426+0000","last_change":"2024-09-12T00:02:54.240354+0000","last_active":"2024-09-12T01:13:29.447426+0000","last_peered":"2024-09-12T01:13:29.447426+0000","last_clean":"2024-09-12T01:13:29.447426+0000","last_became_active":"2024-09-12T00:02:54.239924+0000","last_became_peered":"2024-09-12T00:02:54.239924+0000","last_unstale":"2024-09-12T01:13:29.447426+0000","last_undegraded":"2024-09-12T01:13:29.447426+0000","last_fullsized":"2024-09-12T01:13:29.447426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:39.666122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":4496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.959587+0000","last_change":"2024-09-12T00:02:56.086976+0000","last_active":"2024-09-12T01:15:47.959587+0000","last_peered":"2024-09-12T01:15:47.959587+0000","last_clean":"2024-09-12T01:15:47.959587+0000","last_became_active":"2024-09-12T00:02:56.086668+0000","last_became_peered":"2024-09-12T00:02:56.086668+0000","last_unstale":"2024-09-12T01:15:47.959587+0000","last_undegraded":"2024-09-12T01:15:47.959587+0000","last_fullsized":"2024-09-12T01:15:47.959587+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:09.139717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'150","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.387710+0000","last_change":"2024-09-12T00:02:58.097729+0000","last_active":"2024-09-12T01:11:43.387710+0000","last_peered":"2024-09-12T01:11:43.387710+0000","last_clean":"2024-09-12T01:11:43.387710+0000","last_became_active":"2024-09-12T00:02:58.097435+0000","last_became_peered":"2024-09-12T00:02:58.097435+0000","last_unstale":"2024-09-12T01:11:43.387710+0000","last_undegraded":"2024-09-12T01:11:43.387710+0000","last_fullsized":"2024-09-12T01:11:43.387710+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:06.625906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":180,"num_write":378,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'757","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:21.039751+0000","last_change":"2024-09-12T00:02:50.069930+0000","last_active":"2024-09-12T01:13:21.039751+0000","last_peered":"2024-09-12T01:13:21.039751+0000","last_clean":"2024-09-12T01:13:21.039751+0000","last_became_active":"2024-09-12T00:02:50.069661+0000","last_became_peered":"2024-09-12T00:02:50.069661+0000","last_unstale":"2024-09-12T01:13:21.039751+0000","last_undegraded":"2024-09-12T01:13:21.039751+0000","last_fullsized":"2024-09-12T01:13:21.039751+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:29.419116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4159,"num_read_kb":3799,"num_write":1082,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'214","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167450+0000","last_change":"2024-09-12T00:02:48.047887+0000","last_active":"2024-09-12T01:15:48.167450+0000","last_peered":"2024-09-12T01:15:48.167450+0000","last_clean":"2024-09-12T01:15:48.167450+0000","last_became_active":"2024-09-12T00:02:48.046527+0000","last_became_peered":"2024-09-12T00:02:48.046527+0000","last_unstale":"2024-09-12T01:15:48.167450+0000","last_undegraded":"2024-09-12T01:15:48.167450+0000","last_fullsized":"2024-09-12T01:15:48.167450+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:11.514356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":898,"num_read_kb":26543,"num_write":1077,"num_write_kb":24642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"38'4","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.925616+0000","last_change":"2024-09-12T00:02:52.064448+0000","last_active":"2024-09-12T01:15:47.925616+0000","last_peered":"2024-09-12T01:15:47.925616+0000","last_clean":"2024-09-12T01:15:47.925616+0000","last_became_active":"2024-09-12T00:02:52.064186+0000","last_became_peered":"2024-09-12T00:02:52.064186+0000","last_unstale":"2024-09-12T01:15:47.925616+0000","last_undegraded":"2024-09-12T01:15:47.925616+0000","last_fullsized":"2024-09-12T01:15:47.925616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:57.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'295","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.124813+0000","last_change":"2024-09-12T00:02:54.072647+0000","last_active":"2024-09-12T01:15:48.124813+0000","last_peered":"2024-09-12T01:15:48.124813+0000","last_clean":"2024-09-12T01:15:48.124813+0000","last_became_active":"2024-09-12T00:02:54.072431+0000","last_became_peered":"2024-09-12T00:02:54.072431+0000","last_unstale":"2024-09-12T01:15:48.124813+0000","last_undegraded":"2024-09-12T01:15:48.124813+0000","last_fullsized":"2024-09-12T01:15:48.124813+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:22.191371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1000,"num_write":1544,"num_write_kb":1370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.613978+0000","last_change":"2024-09-12T00:02:56.083934+0000","last_active":"2024-09-12T01:12:43.613978+0000","last_peered":"2024-09-12T01:12:43.613978+0000","last_clean":"2024-09-12T01:12:43.613978+0000","last_became_active":"2024-09-12T00:02:56.083643+0000","last_became_peered":"2024-09-12T00:02:56.083643+0000","last_unstale":"2024-09-12T01:12:43.613978+0000","last_undegraded":"2024-09-12T01:12:43.613978+0000","last_fullsized":"2024-09-12T01:12:43.613978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:28.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'154","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.228014+0000","last_change":"2024-09-12T00:02:58.096803+0000","last_active":"2024-09-12T01:11:43.228014+0000","last_peered":"2024-09-12T01:11:43.228014+0000","last_clean":"2024-09-12T01:11:43.228014+0000","last_became_active":"2024-09-12T00:02:58.096337+0000","last_became_peered":"2024-09-12T00:02:58.096337+0000","last_unstale":"2024-09-12T01:11:43.228014+0000","last_undegraded":"2024-09-12T01:11:43.228014+0000","last_fullsized":"2024-09-12T01:11:43.228014+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":374,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'343","reported_seq":1738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.729659+0000","last_change":"2024-09-12T00:02:50.063532+0000","last_active":"2024-09-12T01:15:09.729659+0000","last_peered":"2024-09-12T01:15:09.729659+0000","last_clean":"2024-09-12T01:15:09.729659+0000","last_became_active":"2024-09-12T00:02:50.063141+0000","last_became_peered":"2024-09-12T00:02:50.063141+0000","last_unstale":"2024-09-12T01:15:09.729659+0000","last_undegraded":"2024-09-12T01:15:09.729659+0000","last_fullsized":"2024-09-12T01:15:09.729659+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:36.757516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1807,"num_write":392,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397459+0000","last_change":"2024-09-12T00:02:31.950306+0000","last_active":"2024-09-12T01:12:43.397459+0000","last_peered":"2024-09-12T01:12:43.397459+0000","last_clean":"2024-09-12T01:12:43.397459+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T01:12:43.397459+0000","last_undegraded":"2024-09-12T01:12:43.397459+0000","last_fullsized":"2024-09-12T01:12:43.397459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_clean_scrub_stamp":"2024-09-12T00:02:29.944268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.076017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.515515+0000","last_change":"2024-09-12T00:02:38.003392+0000","last_active":"2024-09-12T01:13:28.515515+0000","last_peered":"2024-09-12T01:13:28.515515+0000","last_clean":"2024-09-12T01:13:28.515515+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T01:13:28.515515+0000","last_undegraded":"2024-09-12T01:13:28.515515+0000","last_fullsized":"2024-09-12T01:13:28.515515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.472492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'199","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154708+0000","last_change":"2024-09-12T00:02:48.048426+0000","last_active":"2024-09-12T01:15:48.154708+0000","last_peered":"2024-09-12T01:15:48.154708+0000","last_clean":"2024-09-12T01:15:48.154708+0000","last_became_active":"2024-09-12T00:02:48.047739+0000","last_became_peered":"2024-09-12T00:02:48.047739+0000","last_unstale":"2024-09-12T01:15:48.154708+0000","last_undegraded":"2024-09-12T01:15:48.154708+0000","last_fullsized":"2024-09-12T01:15:48.154708+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:56.338442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":439,"num_read_kb":34702,"num_write":919,"num_write_kb":51263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.405908+0000","last_change":"2024-09-12T00:02:52.065910+0000","last_active":"2024-09-12T01:13:43.405908+0000","last_peered":"2024-09-12T01:13:43.405908+0000","last_clean":"2024-09-12T01:13:43.405908+0000","last_became_active":"2024-09-12T00:02:52.065587+0000","last_became_peered":"2024-09-12T00:02:52.065587+0000","last_unstale":"2024-09-12T01:13:43.405908+0000","last_undegraded":"2024-09-12T01:13:43.405908+0000","last_fullsized":"2024-09-12T01:13:43.405908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:58.876252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'333","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.224680+0000","last_change":"2024-09-12T00:02:54.069602+0000","last_active":"2024-09-12T01:15:48.224680+0000","last_peered":"2024-09-12T01:15:48.224680+0000","last_clean":"2024-09-12T01:15:48.224680+0000","last_became_active":"2024-09-12T00:02:54.069167+0000","last_became_peered":"2024-09-12T00:02:54.069167+0000","last_unstale":"2024-09-12T01:15:48.224680+0000","last_undegraded":"2024-09-12T01:15:48.224680+0000","last_fullsized":"2024-09-12T01:15:48.224680+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.314767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":868,"num_write":580,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.239491+0000","last_change":"2024-09-12T00:02:56.083312+0000","last_active":"2024-09-12T01:12:15.239491+0000","last_peered":"2024-09-12T01:12:15.239491+0000","last_clean":"2024-09-12T01:12:15.239491+0000","last_became_active":"2024-09-12T00:02:56.082981+0000","last_became_peered":"2024-09-12T00:02:56.082981+0000","last_unstale":"2024-09-12T01:12:15.239491+0000","last_undegraded":"2024-09-12T01:12:15.239491+0000","last_fullsized":"2024-09-12T01:12:15.239491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:01.810212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'220","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.154487+0000","last_change":"2024-09-12T00:02:58.099932+0000","last_active":"2024-09-12T01:14:04.154487+0000","last_peered":"2024-09-12T01:14:04.154487+0000","last_clean":"2024-09-12T01:14:04.154487+0000","last_became_active":"2024-09-12T00:02:58.099655+0000","last_became_peered":"2024-09-12T00:02:58.099655+0000","last_unstale":"2024-09-12T01:14:04.154487+0000","last_undegraded":"2024-09-12T01:14:04.154487+0000","last_fullsized":"2024-09-12T01:14:04.154487+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:49.539153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1237,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":468,"num_write":474,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'874","reported_seq":2624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127264+0000","last_change":"2024-09-12T00:02:50.076009+0000","last_active":"2024-09-12T01:14:04.127264+0000","last_peered":"2024-09-12T01:14:04.127264+0000","last_clean":"2024-09-12T01:14:04.127264+0000","last_became_active":"2024-09-12T00:02:50.075700+0000","last_became_peered":"2024-09-12T00:02:50.075700+0000","last_unstale":"2024-09-12T01:14:04.127264+0000","last_undegraded":"2024-09-12T01:14:04.127264+0000","last_fullsized":"2024-09-12T01:14:04.127264+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.088247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4451,"num_read_kb":4025,"num_write":1186,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398157+0000","last_change":"2024-09-12T00:02:37.999892+0000","last_active":"2024-09-12T01:12:48.398157+0000","last_peered":"2024-09-12T01:12:48.398157+0000","last_clean":"2024-09-12T01:12:48.398157+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T01:12:48.398157+0000","last_undegraded":"2024-09-12T01:12:48.398157+0000","last_fullsized":"2024-09-12T01:12:48.398157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.336025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'211","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249465+0000","last_change":"2024-09-12T00:02:48.058588+0000","last_active":"2024-09-12T01:13:40.249465+0000","last_peered":"2024-09-12T01:13:40.249465+0000","last_clean":"2024-09-12T01:13:40.249465+0000","last_became_active":"2024-09-12T00:02:48.057849+0000","last_became_peered":"2024-09-12T00:02:48.057849+0000","last_unstale":"2024-09-12T01:13:40.249465+0000","last_undegraded":"2024-09-12T01:13:40.249465+0000","last_fullsized":"2024-09-12T01:13:40.249465+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:26.461055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14266353,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":516,"num_read_kb":138068,"num_write":1052,"num_write_kb":57312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.504352+0000","last_change":"2024-09-12T00:02:52.066638+0000","last_active":"2024-09-12T01:12:13.504352+0000","last_peered":"2024-09-12T01:12:13.504352+0000","last_clean":"2024-09-12T01:12:13.504352+0000","last_became_active":"2024-09-12T00:02:52.066352+0000","last_became_peered":"2024-09-12T00:02:52.066352+0000","last_unstale":"2024-09-12T01:12:13.504352+0000","last_undegraded":"2024-09-12T01:12:13.504352+0000","last_fullsized":"2024-09-12T01:12:13.504352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:43.605378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'935","reported_seq":2771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.138847+0000","last_change":"2024-09-12T00:02:54.070381+0000","last_active":"2024-09-12T01:15:48.138847+0000","last_peered":"2024-09-12T01:15:48.138847+0000","last_clean":"2024-09-12T01:15:48.138847+0000","last_became_active":"2024-09-12T00:02:54.070061+0000","last_became_peered":"2024-09-12T00:02:54.070061+0000","last_unstale":"2024-09-12T01:15:48.138847+0000","last_undegraded":"2024-09-12T01:15:48.138847+0000","last_fullsized":"2024-09-12T01:15:48.138847+0000","mapping_epoch":32,"log_start":"267'901","ondisk_log_start":"267'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":901,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:23.921978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23657,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1272,"num_read_kb":1457,"num_write":388,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390773+0000","last_change":"2024-09-12T00:02:56.078956+0000","last_active":"2024-09-12T01:11:53.390773+0000","last_peered":"2024-09-12T01:11:53.390773+0000","last_clean":"2024-09-12T01:11:53.390773+0000","last_became_active":"2024-09-12T00:02:56.078658+0000","last_became_peered":"2024-09-12T00:02:56.078658+0000","last_unstale":"2024-09-12T01:11:53.390773+0000","last_undegraded":"2024-09-12T01:11:53.390773+0000","last_fullsized":"2024-09-12T01:11:53.390773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:42.358383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'171","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:33.233571+0000","last_change":"2024-09-12T00:02:58.089668+0000","last_active":"2024-09-12T01:12:33.233571+0000","last_peered":"2024-09-12T01:12:33.233571+0000","last_clean":"2024-09-12T01:12:33.233571+0000","last_became_active":"2024-09-12T00:02:58.089378+0000","last_became_peered":"2024-09-12T00:02:58.089378+0000","last_unstale":"2024-09-12T01:12:33.233571+0000","last_undegraded":"2024-09-12T01:12:33.233571+0000","last_fullsized":"2024-09-12T01:12:33.233571+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.424097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":336,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'1105","reported_seq":2822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128513+0000","last_change":"2024-09-12T00:02:50.069236+0000","last_active":"2024-09-12T01:14:04.128513+0000","last_peered":"2024-09-12T01:14:04.128513+0000","last_clean":"2024-09-12T01:14:04.128513+0000","last_became_active":"2024-09-12T00:02:50.067002+0000","last_became_peered":"2024-09-12T00:02:50.067002+0000","last_unstale":"2024-09-12T01:14:04.128513+0000","last_undegraded":"2024-09-12T01:14:04.128513+0000","last_fullsized":"2024-09-12T01:14:04.128513+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.055428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5247,"num_read_kb":4613,"num_write":1599,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.231834+0000","last_change":"2024-09-12T00:02:37.999935+0000","last_active":"2024-09-12T01:13:28.231834+0000","last_peered":"2024-09-12T01:13:28.231834+0000","last_clean":"2024-09-12T01:13:28.231834+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T01:13:28.231834+0000","last_undegraded":"2024-09-12T01:13:28.231834+0000","last_fullsized":"2024-09-12T01:13:28.231834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:36.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'185","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167361+0000","last_change":"2024-09-12T00:02:48.044496+0000","last_active":"2024-09-12T01:15:48.167361+0000","last_peered":"2024-09-12T01:15:48.167361+0000","last_clean":"2024-09-12T01:15:48.167361+0000","last_became_active":"2024-09-12T00:02:48.044126+0000","last_became_peered":"2024-09-12T00:02:48.044126+0000","last_unstale":"2024-09-12T01:15:48.167361+0000","last_undegraded":"2024-09-12T01:15:48.167361+0000","last_fullsized":"2024-09-12T01:15:48.167361+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:22.117737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4751719,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":400,"num_read_kb":27065,"num_write":781,"num_write_kb":40333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.223592+0000","last_change":"2024-09-12T00:02:52.068671+0000","last_active":"2024-09-12T01:12:13.223592+0000","last_peered":"2024-09-12T01:12:13.223592+0000","last_clean":"2024-09-12T01:12:13.223592+0000","last_became_active":"2024-09-12T00:02:52.068351+0000","last_became_peered":"2024-09-12T00:02:52.068351+0000","last_unstale":"2024-09-12T01:12:13.223592+0000","last_undegraded":"2024-09-12T01:12:13.223592+0000","last_fullsized":"2024-09-12T01:12:13.223592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:00.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'302","reported_seq":1732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.187593+0000","last_change":"2024-09-12T00:02:54.241862+0000","last_active":"2024-09-12T01:15:08.187593+0000","last_peered":"2024-09-12T01:15:08.187593+0000","last_clean":"2024-09-12T01:15:08.187593+0000","last_became_active":"2024-09-12T00:02:54.241581+0000","last_became_peered":"2024-09-12T00:02:54.241581+0000","last_unstale":"2024-09-12T01:15:08.187593+0000","last_undegraded":"2024-09-12T01:15:08.187593+0000","last_fullsized":"2024-09-12T01:15:08.187593+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:51.409146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":254,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235605+0000","last_change":"2024-09-12T00:02:56.081949+0000","last_active":"2024-09-12T01:11:40.235605+0000","last_peered":"2024-09-12T01:11:40.235605+0000","last_clean":"2024-09-12T01:11:40.235605+0000","last_became_active":"2024-09-12T00:02:56.081641+0000","last_became_peered":"2024-09-12T00:02:56.081641+0000","last_unstale":"2024-09-12T01:11:40.235605+0000","last_undegraded":"2024-09-12T01:11:40.235605+0000","last_fullsized":"2024-09-12T01:11:40.235605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:16.553415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'273","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.410516+0000","last_change":"2024-09-12T00:02:58.088758+0000","last_active":"2024-09-12T01:14:04.410516+0000","last_peered":"2024-09-12T01:14:04.410516+0000","last_clean":"2024-09-12T01:14:04.410516+0000","last_became_active":"2024-09-12T00:02:58.088442+0000","last_became_peered":"2024-09-12T00:02:58.088442+0000","last_unstale":"2024-09-12T01:14:04.410516+0000","last_undegraded":"2024-09-12T01:14:04.410516+0000","last_fullsized":"2024-09-12T01:14:04.410516+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:27.430742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":615,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'437","reported_seq":2013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061424+0000","last_change":"2024-09-12T00:03:21.140992+0000","last_active":"2024-09-12T01:13:06.061424+0000","last_peered":"2024-09-12T01:13:06.061424+0000","last_clean":"2024-09-12T01:13:06.061424+0000","last_became_active":"2024-09-12T00:03:21.140691+0000","last_became_peered":"2024-09-12T00:03:21.140691+0000","last_unstale":"2024-09-12T01:13:06.061424+0000","last_undegraded":"2024-09-12T01:13:06.061424+0000","last_fullsized":"2024-09-12T01:13:06.061424+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:09.243706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2439,"num_read_kb":2322,"num_write":494,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.515475+0000","last_change":"2024-09-12T00:02:38.004050+0000","last_active":"2024-09-12T01:13:28.515475+0000","last_peered":"2024-09-12T01:13:28.515475+0000","last_clean":"2024-09-12T01:13:28.515475+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T01:13:28.515475+0000","last_undegraded":"2024-09-12T01:13:28.515475+0000","last_fullsized":"2024-09-12T01:13:28.515475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:14.983821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'207","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.079182+0000","last_change":"2024-09-12T00:02:48.049579+0000","last_active":"2024-09-12T01:15:48.079182+0000","last_peered":"2024-09-12T01:15:48.079182+0000","last_clean":"2024-09-12T01:15:48.079182+0000","last_became_active":"2024-09-12T00:02:48.049260+0000","last_became_peered":"2024-09-12T00:02:48.049260+0000","last_unstale":"2024-09-12T01:15:48.079182+0000","last_undegraded":"2024-09-12T01:15:48.079182+0000","last_fullsized":"2024-09-12T01:15:48.079182+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:34.461974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":103584,"num_write":943,"num_write_kb":20218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.237256+0000","last_change":"2024-09-12T00:02:52.066733+0000","last_active":"2024-09-12T01:11:55.237256+0000","last_peered":"2024-09-12T01:11:55.237256+0000","last_clean":"2024-09-12T01:11:55.237256+0000","last_became_active":"2024-09-12T00:02:52.066289+0000","last_became_peered":"2024-09-12T00:02:52.066289+0000","last_unstale":"2024-09-12T01:11:55.237256+0000","last_undegraded":"2024-09-12T01:11:55.237256+0000","last_fullsized":"2024-09-12T01:11:55.237256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:55.049376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'159","reported_seq":725,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:02.202549+0000","last_change":"2024-09-12T00:02:54.067179+0000","last_active":"2024-09-12T01:15:02.202549+0000","last_peered":"2024-09-12T01:15:02.202549+0000","last_clean":"2024-09-12T01:15:02.202549+0000","last_became_active":"2024-09-12T00:02:54.066864+0000","last_became_peered":"2024-09-12T00:02:54.066864+0000","last_unstale":"2024-09-12T01:15:02.202549+0000","last_undegraded":"2024-09-12T01:15:02.202549+0000","last_fullsized":"2024-09-12T01:15:02.202549+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:34.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":203,"num_read_kb":195,"num_write":150,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.610434+0000","last_change":"2024-09-12T00:02:56.085732+0000","last_active":"2024-09-12T01:12:18.610434+0000","last_peered":"2024-09-12T01:12:18.610434+0000","last_clean":"2024-09-12T01:12:18.610434+0000","last_became_active":"2024-09-12T00:02:56.085437+0000","last_became_peered":"2024-09-12T00:02:56.085437+0000","last_unstale":"2024-09-12T01:12:18.610434+0000","last_undegraded":"2024-09-12T01:12:18.610434+0000","last_fullsized":"2024-09-12T01:12:18.610434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:41.321446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'109","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.524360+0000","last_change":"2024-09-12T00:02:58.095790+0000","last_active":"2024-09-12T01:14:28.524360+0000","last_peered":"2024-09-12T01:14:28.524360+0000","last_clean":"2024-09-12T01:14:28.524360+0000","last_became_active":"2024-09-12T00:02:58.095419+0000","last_became_peered":"2024-09-12T00:02:58.095419+0000","last_unstale":"2024-09-12T01:14:28.524360+0000","last_undegraded":"2024-09-12T01:14:28.524360+0000","last_fullsized":"2024-09-12T01:14:28.524360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":189,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'415","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.241281+0000","last_change":"2024-09-12T00:02:50.075586+0000","last_active":"2024-09-12T01:13:43.241281+0000","last_peered":"2024-09-12T01:13:43.241281+0000","last_clean":"2024-09-12T01:13:43.241281+0000","last_became_active":"2024-09-12T00:02:50.075209+0000","last_became_peered":"2024-09-12T00:02:50.075209+0000","last_unstale":"2024-09-12T01:13:43.241281+0000","last_undegraded":"2024-09-12T01:13:43.241281+0000","last_fullsized":"2024-09-12T01:13:43.241281+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:32.991455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2214,"num_read_kb":2093,"num_write":483,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'191","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.259489+0000","last_change":"2024-09-12T00:02:48.054875+0000","last_active":"2024-09-12T01:15:48.259489+0000","last_peered":"2024-09-12T01:15:48.259489+0000","last_clean":"2024-09-12T01:15:48.259489+0000","last_became_active":"2024-09-12T00:02:48.052751+0000","last_became_peered":"2024-09-12T00:02:48.052751+0000","last_unstale":"2024-09-12T01:15:48.259489+0000","last_undegraded":"2024-09-12T01:15:48.259489+0000","last_fullsized":"2024-09-12T01:15:48.259489+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493417,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":26295,"num_write":910,"num_write_kb":36863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.239685+0000","last_change":"2024-09-12T00:02:38.007657+0000","last_active":"2024-09-12T01:13:28.239685+0000","last_peered":"2024-09-12T01:13:28.239685+0000","last_clean":"2024-09-12T01:13:28.239685+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T01:13:28.239685+0000","last_undegraded":"2024-09-12T01:13:28.239685+0000","last_fullsized":"2024-09-12T01:13:28.239685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:40.382288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235592+0000","last_change":"2024-09-12T00:02:52.067482+0000","last_active":"2024-09-12T01:11:40.235592+0000","last_peered":"2024-09-12T01:11:40.235592+0000","last_clean":"2024-09-12T01:11:40.235592+0000","last_became_active":"2024-09-12T00:02:52.067200+0000","last_became_peered":"2024-09-12T00:02:52.067200+0000","last_unstale":"2024-09-12T01:11:40.235592+0000","last_undegraded":"2024-09-12T01:11:40.235592+0000","last_fullsized":"2024-09-12T01:11:40.235592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:28.955322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'299","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.870818+0000","last_change":"2024-09-12T00:02:54.069403+0000","last_active":"2024-09-12T01:15:10.870818+0000","last_peered":"2024-09-12T01:15:10.870818+0000","last_clean":"2024-09-12T01:15:10.870818+0000","last_became_active":"2024-09-12T00:02:54.069071+0000","last_became_peered":"2024-09-12T00:02:54.069071+0000","last_unstale":"2024-09-12T01:15:10.870818+0000","last_undegraded":"2024-09-12T01:15:10.870818+0000","last_fullsized":"2024-09-12T01:15:10.870818+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:01.293660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":432,"num_read_kb":552,"num_write":250,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.387679+0000","last_change":"2024-09-12T00:02:56.082353+0000","last_active":"2024-09-12T01:11:43.387679+0000","last_peered":"2024-09-12T01:11:43.387679+0000","last_clean":"2024-09-12T01:11:43.387679+0000","last_became_active":"2024-09-12T00:02:56.082046+0000","last_became_peered":"2024-09-12T00:02:56.082046+0000","last_unstale":"2024-09-12T01:11:43.387679+0000","last_undegraded":"2024-09-12T01:11:43.387679+0000","last_fullsized":"2024-09-12T01:11:43.387679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:22.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'163","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.352871+0000","last_change":"2024-09-12T00:02:58.091879+0000","last_active":"2024-09-12T01:14:00.352871+0000","last_peered":"2024-09-12T01:14:00.352871+0000","last_clean":"2024-09-12T01:14:00.352871+0000","last_became_active":"2024-09-12T00:02:58.091590+0000","last_became_peered":"2024-09-12T00:02:58.091590+0000","last_unstale":"2024-09-12T01:14:00.352871+0000","last_undegraded":"2024-09-12T01:14:00.352871+0000","last_fullsized":"2024-09-12T01:14:00.352871+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:04.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1150,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":174,"num_write":425,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'450","reported_seq":1993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249513+0000","last_change":"2024-09-12T00:02:50.073492+0000","last_active":"2024-09-12T01:13:40.249513+0000","last_peered":"2024-09-12T01:13:40.249513+0000","last_clean":"2024-09-12T01:13:40.249513+0000","last_became_active":"2024-09-12T00:02:50.073262+0000","last_became_peered":"2024-09-12T00:02:50.073262+0000","last_unstale":"2024-09-12T01:13:40.249513+0000","last_undegraded":"2024-09-12T01:13:40.249513+0000","last_fullsized":"2024-09-12T01:13:40.249513+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.830556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2298,"num_read_kb":2165,"num_write":516,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'158","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.234561+0000","last_change":"2024-09-12T00:02:48.053125+0000","last_active":"2024-09-12T01:15:48.234561+0000","last_peered":"2024-09-12T01:15:48.234561+0000","last_clean":"2024-09-12T01:15:48.234561+0000","last_became_active":"2024-09-12T00:02:48.052768+0000","last_became_peered":"2024-09-12T00:02:48.052768+0000","last_unstale":"2024-09-12T01:15:48.234561+0000","last_undegraded":"2024-09-12T01:15:48.234561+0000","last_fullsized":"2024-09-12T01:15:48.234561+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:37.886716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3687654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":16851,"num_write":770,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.405106+0000","last_change":"2024-09-12T00:02:37.999991+0000","last_active":"2024-09-12T01:13:38.405106+0000","last_peered":"2024-09-12T01:13:38.405106+0000","last_clean":"2024-09-12T01:13:38.405106+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T01:13:38.405106+0000","last_undegraded":"2024-09-12T01:13:38.405106+0000","last_fullsized":"2024-09-12T01:13:38.405106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622249+0000","last_change":"2024-09-12T00:02:52.069738+0000","last_active":"2024-09-12T01:13:43.622249+0000","last_peered":"2024-09-12T01:13:43.622249+0000","last_clean":"2024-09-12T01:13:43.622249+0000","last_became_active":"2024-09-12T00:02:52.069469+0000","last_became_peered":"2024-09-12T00:02:52.069469+0000","last_unstale":"2024-09-12T01:13:43.622249+0000","last_undegraded":"2024-09-12T01:13:43.622249+0000","last_fullsized":"2024-09-12T01:13:43.622249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:53.012401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'259","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.188900+0000","last_change":"2024-09-12T00:02:54.240228+0000","last_active":"2024-09-12T01:14:02.188900+0000","last_peered":"2024-09-12T01:14:02.188900+0000","last_clean":"2024-09-12T01:14:02.188900+0000","last_became_active":"2024-09-12T00:02:54.239879+0000","last_became_peered":"2024-09-12T00:02:54.239879+0000","last_unstale":"2024-09-12T01:14:02.188900+0000","last_undegraded":"2024-09-12T01:14:02.188900+0000","last_fullsized":"2024-09-12T01:14:02.188900+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:03.113532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":332,"num_read_kb":322,"num_write":304,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'793","reported_seq":5263,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.252240+0000","last_change":"2024-09-12T00:02:56.087559+0000","last_active":"2024-09-12T01:15:48.252240+0000","last_peered":"2024-09-12T01:15:48.252240+0000","last_clean":"2024-09-12T01:15:48.252240+0000","last_became_active":"2024-09-12T00:02:56.086704+0000","last_became_peered":"2024-09-12T00:02:56.086704+0000","last_unstale":"2024-09-12T01:15:48.252240+0000","last_undegraded":"2024-09-12T01:15:48.252240+0000","last_fullsized":"2024-09-12T01:15:48.252240+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:41.420237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'152","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.251702+0000","last_change":"2024-09-12T00:02:58.091748+0000","last_active":"2024-09-12T01:15:08.251702+0000","last_peered":"2024-09-12T01:15:08.251702+0000","last_clean":"2024-09-12T01:15:08.251702+0000","last_became_active":"2024-09-12T00:02:58.091466+0000","last_became_peered":"2024-09-12T00:02:58.091466+0000","last_unstale":"2024-09-12T01:15:08.251702+0000","last_undegraded":"2024-09-12T01:15:08.251702+0000","last_fullsized":"2024-09-12T01:15:08.251702+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":335,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'989","reported_seq":2652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.864836+0000","last_change":"2024-09-12T00:02:50.068181+0000","last_active":"2024-09-12T01:13:20.864836+0000","last_peered":"2024-09-12T01:13:20.864836+0000","last_clean":"2024-09-12T01:13:20.864836+0000","last_became_active":"2024-09-12T00:02:50.067868+0000","last_became_peered":"2024-09-12T00:02:50.067868+0000","last_unstale":"2024-09-12T01:13:20.864836+0000","last_undegraded":"2024-09-12T01:13:20.864836+0000","last_fullsized":"2024-09-12T01:13:20.864836+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":900,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:02.445799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4764,"num_read_kb":4246,"num_write":1341,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'173","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.244938+0000","last_change":"2024-09-12T00:02:48.052760+0000","last_active":"2024-09-12T01:14:18.244938+0000","last_peered":"2024-09-12T01:14:18.244938+0000","last_clean":"2024-09-12T01:14:18.244938+0000","last_became_active":"2024-09-12T00:02:48.052431+0000","last_became_peered":"2024-09-12T00:02:48.052431+0000","last_unstale":"2024-09-12T01:14:18.244938+0000","last_undegraded":"2024-09-12T01:14:18.244938+0000","last_fullsized":"2024-09-12T01:14:18.244938+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:51.003972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1212092,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":121623,"num_write":831,"num_write_kb":33084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229731+0000","last_change":"2024-09-12T00:02:38.007684+0000","last_active":"2024-09-12T01:11:58.229731+0000","last_peered":"2024-09-12T01:11:58.229731+0000","last_clean":"2024-09-12T01:11:58.229731+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T01:11:58.229731+0000","last_undegraded":"2024-09-12T01:11:58.229731+0000","last_fullsized":"2024-09-12T01:11:58.229731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.596959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257884+0000","last_change":"2024-09-12T00:02:52.062924+0000","last_active":"2024-09-12T01:13:43.257884+0000","last_peered":"2024-09-12T01:13:43.257884+0000","last_clean":"2024-09-12T01:13:43.257884+0000","last_became_active":"2024-09-12T00:02:52.062631+0000","last_became_peered":"2024-09-12T00:02:52.062631+0000","last_unstale":"2024-09-12T01:13:43.257884+0000","last_undegraded":"2024-09-12T01:13:43.257884+0000","last_fullsized":"2024-09-12T01:13:43.257884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:03.938023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'137","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257905+0000","last_change":"2024-09-12T00:02:54.069239+0000","last_active":"2024-09-12T01:13:43.257905+0000","last_peered":"2024-09-12T01:13:43.257905+0000","last_clean":"2024-09-12T01:13:43.257905+0000","last_became_active":"2024-09-12T00:02:54.068812+0000","last_became_peered":"2024-09-12T00:02:54.068812+0000","last_unstale":"2024-09-12T01:13:43.257905+0000","last_undegraded":"2024-09-12T01:13:43.257905+0000","last_fullsized":"2024-09-12T01:13:43.257905+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:58.060604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":169,"num_write":118,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'807","reported_seq":2608,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.959102+0000","last_change":"2024-09-12T00:02:56.084227+0000","last_active":"2024-09-12T01:15:47.959102+0000","last_peered":"2024-09-12T01:15:47.959102+0000","last_clean":"2024-09-12T01:15:47.959102+0000","last_became_active":"2024-09-12T00:02:56.083894+0000","last_became_peered":"2024-09-12T00:02:56.083894+0000","last_unstale":"2024-09-12T01:15:47.959102+0000","last_undegraded":"2024-09-12T01:15:47.959102+0000","last_fullsized":"2024-09-12T01:15:47.959102+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:40.096034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'273","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242702+0000","last_change":"2024-09-12T00:02:58.093731+0000","last_active":"2024-09-12T01:12:45.242702+0000","last_peered":"2024-09-12T01:12:45.242702+0000","last_clean":"2024-09-12T01:12:45.242702+0000","last_became_active":"2024-09-12T00:02:58.093442+0000","last_became_peered":"2024-09-12T00:02:58.093442+0000","last_unstale":"2024-09-12T01:12:45.242702+0000","last_undegraded":"2024-09-12T01:12:45.242702+0000","last_fullsized":"2024-09-12T01:12:45.242702+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:58.495113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":340,"num_read_kb":339,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'411","reported_seq":1918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956504+0000","last_change":"2024-09-12T00:02:50.058382+0000","last_active":"2024-09-12T01:14:02.956504+0000","last_peered":"2024-09-12T01:14:02.956504+0000","last_clean":"2024-09-12T01:14:02.956504+0000","last_became_active":"2024-09-12T00:02:50.057999+0000","last_became_peered":"2024-09-12T00:02:50.057999+0000","last_unstale":"2024-09-12T01:14:02.956504+0000","last_undegraded":"2024-09-12T01:14:02.956504+0000","last_fullsized":"2024-09-12T01:14:02.956504+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:37.001555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2267,"num_read_kb":2133,"num_write":493,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'268","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:46.122696+0000","last_change":"2024-09-12T00:02:48.051832+0000","last_active":"2024-09-12T01:13:46.122696+0000","last_peered":"2024-09-12T01:13:46.122696+0000","last_clean":"2024-09-12T01:13:46.122696+0000","last_became_active":"2024-09-12T00:02:48.051495+0000","last_became_peered":"2024-09-12T00:02:48.051495+0000","last_unstale":"2024-09-12T01:13:46.122696+0000","last_undegraded":"2024-09-12T01:13:46.122696+0000","last_fullsized":"2024-09-12T01:13:46.122696+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:15.411092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864181,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":668,"num_read_kb":18611,"num_write":1218,"num_write_kb":43211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607868+0000","last_change":"2024-09-12T00:02:38.760426+0000","last_active":"2024-09-12T01:11:58.607868+0000","last_peered":"2024-09-12T01:11:58.607868+0000","last_clean":"2024-09-12T01:11:58.607868+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T01:11:58.607868+0000","last_undegraded":"2024-09-12T01:11:58.607868+0000","last_fullsized":"2024-09-12T01:11:58.607868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:03.698275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455282+0000","last_change":"2024-09-12T00:02:52.062908+0000","last_active":"2024-09-12T01:12:58.455282+0000","last_peered":"2024-09-12T01:12:58.455282+0000","last_clean":"2024-09-12T01:12:58.455282+0000","last_became_active":"2024-09-12T00:02:52.062544+0000","last_became_peered":"2024-09-12T00:02:52.062544+0000","last_unstale":"2024-09-12T01:12:58.455282+0000","last_undegraded":"2024-09-12T01:12:58.455282+0000","last_fullsized":"2024-09-12T01:12:58.455282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:54.138905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'358","reported_seq":1105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.290569+0000","last_change":"2024-09-12T00:02:54.239678+0000","last_active":"2024-09-12T01:15:48.290569+0000","last_peered":"2024-09-12T01:15:48.290569+0000","last_clean":"2024-09-12T01:15:48.290569+0000","last_became_active":"2024-09-12T00:02:54.239355+0000","last_became_peered":"2024-09-12T00:02:54.239355+0000","last_unstale":"2024-09-12T01:15:48.290569+0000","last_undegraded":"2024-09-12T01:15:48.290569+0000","last_fullsized":"2024-09-12T01:15:48.290569+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:10.540534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":736,"num_write":272,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.446391+0000","last_change":"2024-09-12T00:02:56.087894+0000","last_active":"2024-09-12T01:11:43.446391+0000","last_peered":"2024-09-12T01:11:43.446391+0000","last_clean":"2024-09-12T01:11:43.446391+0000","last_became_active":"2024-09-12T00:02:56.087448+0000","last_became_peered":"2024-09-12T00:02:56.087448+0000","last_unstale":"2024-09-12T01:11:43.446391+0000","last_undegraded":"2024-09-12T01:11:43.446391+0000","last_fullsized":"2024-09-12T01:11:43.446391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:19.357528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'125","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.291357+0000","last_change":"2024-09-12T00:02:58.100159+0000","last_active":"2024-09-12T01:12:58.291357+0000","last_peered":"2024-09-12T01:12:58.291357+0000","last_clean":"2024-09-12T01:12:58.291357+0000","last_became_active":"2024-09-12T00:02:58.099906+0000","last_became_peered":"2024-09-12T00:02:58.099906+0000","last_unstale":"2024-09-12T01:12:58.291357+0000","last_undegraded":"2024-09-12T01:12:58.291357+0000","last_fullsized":"2024-09-12T01:12:58.291357+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:36.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":140,"num_write":299,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'130","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.571352+0000","last_change":"2024-09-12T00:02:58.099964+0000","last_active":"2024-09-12T01:15:09.571352+0000","last_peered":"2024-09-12T01:15:09.571352+0000","last_clean":"2024-09-12T01:15:09.571352+0000","last_became_active":"2024-09-12T00:02:58.099564+0000","last_became_peered":"2024-09-12T00:02:58.099564+0000","last_unstale":"2024-09-12T01:15:09.571352+0000","last_undegraded":"2024-09-12T01:15:09.571352+0000","last_fullsized":"2024-09-12T01:15:09.571352+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:10.174347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":201,"num_write":295,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'827","reported_seq":2372,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.862987+0000","last_change":"2024-09-12T00:02:50.064386+0000","last_active":"2024-09-12T01:13:20.862987+0000","last_peered":"2024-09-12T01:13:20.862987+0000","last_clean":"2024-09-12T01:13:20.862987+0000","last_became_active":"2024-09-12T00:02:50.063351+0000","last_became_peered":"2024-09-12T00:02:50.063351+0000","last_unstale":"2024-09-12T01:13:20.862987+0000","last_undegraded":"2024-09-12T01:13:20.862987+0000","last_fullsized":"2024-09-12T01:13:20.862987+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:44.265606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3851,"num_read_kb":3457,"num_write":1080,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'158","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.079218+0000","last_change":"2024-09-12T00:02:48.048545+0000","last_active":"2024-09-12T01:15:48.079218+0000","last_peered":"2024-09-12T01:15:48.079218+0000","last_clean":"2024-09-12T01:15:48.079218+0000","last_became_active":"2024-09-12T00:02:48.047723+0000","last_became_peered":"2024-09-12T00:02:48.047723+0000","last_unstale":"2024-09-12T01:15:48.079218+0000","last_undegraded":"2024-09-12T01:15:48.079218+0000","last_fullsized":"2024-09-12T01:15:48.079218+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:13.827704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":26182,"num_write":818,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.235888+0000","last_change":"2024-09-12T00:02:52.067136+0000","last_active":"2024-09-12T01:12:53.235888+0000","last_peered":"2024-09-12T01:12:53.235888+0000","last_clean":"2024-09-12T01:12:53.235888+0000","last_became_active":"2024-09-12T00:02:52.066702+0000","last_became_peered":"2024-09-12T00:02:52.066702+0000","last_unstale":"2024-09-12T01:12:53.235888+0000","last_undegraded":"2024-09-12T01:12:53.235888+0000","last_fullsized":"2024-09-12T01:12:53.235888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:51.618720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'196","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.171053+0000","last_change":"2024-09-12T00:02:54.067156+0000","last_active":"2024-09-12T01:15:48.171053+0000","last_peered":"2024-09-12T01:15:48.171053+0000","last_clean":"2024-09-12T01:15:48.171053+0000","last_became_active":"2024-09-12T00:02:54.066679+0000","last_became_peered":"2024-09-12T00:02:54.066679+0000","last_unstale":"2024-09-12T01:15:48.171053+0000","last_undegraded":"2024-09-12T01:15:48.171053+0000","last_fullsized":"2024-09-12T01:15:48.171053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:44.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":343,"num_write":152,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455258+0000","last_change":"2024-09-12T00:02:56.081781+0000","last_active":"2024-09-12T01:12:58.455258+0000","last_peered":"2024-09-12T01:12:58.455258+0000","last_clean":"2024-09-12T01:12:58.455258+0000","last_became_active":"2024-09-12T00:02:56.081445+0000","last_became_peered":"2024-09-12T00:02:56.081445+0000","last_unstale":"2024-09-12T01:12:58.455258+0000","last_undegraded":"2024-09-12T01:12:58.455258+0000","last_fullsized":"2024-09-12T01:12:58.455258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.185278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'151","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.456004+0000","last_change":"2024-09-12T00:02:58.097284+0000","last_active":"2024-09-12T01:13:03.456004+0000","last_peered":"2024-09-12T01:13:03.456004+0000","last_clean":"2024-09-12T01:13:03.456004+0000","last_became_active":"2024-09-12T00:02:58.096979+0000","last_became_peered":"2024-09-12T00:02:58.096979+0000","last_unstale":"2024-09-12T01:13:03.456004+0000","last_undegraded":"2024-09-12T01:13:03.456004+0000","last_fullsized":"2024-09-12T01:13:03.456004+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:10.194576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":142,"num_write":377,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'428","reported_seq":1977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.278516+0000","last_change":"2024-09-12T00:02:50.066578+0000","last_active":"2024-09-12T01:13:32.278516+0000","last_peered":"2024-09-12T01:13:32.278516+0000","last_clean":"2024-09-12T01:13:32.278516+0000","last_became_active":"2024-09-12T00:02:50.065307+0000","last_became_peered":"2024-09-12T00:02:50.065307+0000","last_unstale":"2024-09-12T01:13:32.278516+0000","last_undegraded":"2024-09-12T01:13:32.278516+0000","last_fullsized":"2024-09-12T01:13:32.278516+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:31.996369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2299,"num_read_kb":2174,"num_write":505,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'162","reported_seq":774,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.163753+0000","last_change":"2024-09-12T00:02:48.051718+0000","last_active":"2024-09-12T01:15:48.163753+0000","last_peered":"2024-09-12T01:15:48.163753+0000","last_clean":"2024-09-12T01:15:48.163753+0000","last_became_active":"2024-09-12T00:02:48.048506+0000","last_became_peered":"2024-09-12T00:02:48.048506+0000","last_unstale":"2024-09-12T01:15:48.163753+0000","last_undegraded":"2024-09-12T01:15:48.163753+0000","last_fullsized":"2024-09-12T01:15:48.163753+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:49.124459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":321,"num_read_kb":61867,"num_write":777,"num_write_kb":44911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.454749+0000","last_change":"2024-09-12T00:02:52.065265+0000","last_active":"2024-09-12T01:12:53.454749+0000","last_peered":"2024-09-12T01:12:53.454749+0000","last_clean":"2024-09-12T01:12:53.454749+0000","last_became_active":"2024-09-12T00:02:52.064967+0000","last_became_peered":"2024-09-12T00:02:52.064967+0000","last_unstale":"2024-09-12T01:12:53.454749+0000","last_undegraded":"2024-09-12T01:12:53.454749+0000","last_fullsized":"2024-09-12T01:12:53.454749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.210086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'59","reported_seq":576,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.171183+0000","last_change":"2024-09-12T00:02:54.067540+0000","last_active":"2024-09-12T01:13:29.171183+0000","last_peered":"2024-09-12T01:13:29.171183+0000","last_clean":"2024-09-12T01:13:29.171183+0000","last_became_active":"2024-09-12T00:02:54.067255+0000","last_became_peered":"2024-09-12T00:02:54.067255+0000","last_unstale":"2024-09-12T01:13:29.171183+0000","last_undegraded":"2024-09-12T01:13:29.171183+0000","last_fullsized":"2024-09-12T01:13:29.171183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:18.453952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399626+0000","last_change":"2024-09-12T00:02:56.079344+0000","last_active":"2024-09-12T01:12:58.399626+0000","last_peered":"2024-09-12T01:12:58.399626+0000","last_clean":"2024-09-12T01:12:58.399626+0000","last_became_active":"2024-09-12T00:02:56.079057+0000","last_became_peered":"2024-09-12T00:02:56.079057+0000","last_unstale":"2024-09-12T01:12:58.399626+0000","last_undegraded":"2024-09-12T01:12:58.399626+0000","last_fullsized":"2024-09-12T01:12:58.399626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:17.425376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'185","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.012822+0000","last_change":"2024-09-12T00:02:58.091784+0000","last_active":"2024-09-12T01:14:03.012822+0000","last_peered":"2024-09-12T01:14:03.012822+0000","last_clean":"2024-09-12T01:14:03.012822+0000","last_became_active":"2024-09-12T00:02:58.091505+0000","last_became_peered":"2024-09-12T00:02:58.091505+0000","last_unstale":"2024-09-12T01:14:03.012822+0000","last_undegraded":"2024-09-12T01:14:03.012822+0000","last_fullsized":"2024-09-12T01:14:03.012822+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:32.965615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":268,"num_read_kb":263,"num_write":396,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'443","reported_seq":1915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.057934+0000","last_change":"2024-09-12T00:02:50.068429+0000","last_active":"2024-09-12T01:13:06.057934+0000","last_peered":"2024-09-12T01:13:06.057934+0000","last_clean":"2024-09-12T01:13:06.057934+0000","last_became_active":"2024-09-12T00:02:50.068129+0000","last_became_peered":"2024-09-12T00:02:50.068129+0000","last_unstale":"2024-09-12T01:13:06.057934+0000","last_undegraded":"2024-09-12T01:13:06.057934+0000","last_fullsized":"2024-09-12T01:13:06.057934+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:38.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2203,"num_read_kb":2070,"num_write":514,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'206","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.261460+0000","last_change":"2024-09-12T00:02:48.050120+0000","last_active":"2024-09-12T01:15:48.261460+0000","last_peered":"2024-09-12T01:15:48.261460+0000","last_clean":"2024-09-12T01:15:48.261460+0000","last_became_active":"2024-09-12T00:02:48.049791+0000","last_became_peered":"2024-09-12T00:02:48.049791+0000","last_unstale":"2024-09-12T01:15:48.261460+0000","last_undegraded":"2024-09-12T01:15:48.261460+0000","last_fullsized":"2024-09-12T01:15:48.261460+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:02.402223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":116478,"num_write":1001,"num_write_kb":35286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398938+0000","last_change":"2024-09-12T00:02:52.071771+0000","last_active":"2024-09-12T01:12:53.398938+0000","last_peered":"2024-09-12T01:12:53.398938+0000","last_clean":"2024-09-12T01:12:53.398938+0000","last_became_active":"2024-09-12T00:02:52.071502+0000","last_became_peered":"2024-09-12T00:02:52.071502+0000","last_unstale":"2024-09-12T01:12:53.398938+0000","last_undegraded":"2024-09-12T01:12:53.398938+0000","last_fullsized":"2024-09-12T01:12:53.398938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:36.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'203","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.061053+0000","last_change":"2024-09-12T00:02:54.069300+0000","last_active":"2024-09-12T01:15:48.061053+0000","last_peered":"2024-09-12T01:15:48.061053+0000","last_clean":"2024-09-12T01:15:48.061053+0000","last_became_active":"2024-09-12T00:02:54.067314+0000","last_became_peered":"2024-09-12T00:02:54.067314+0000","last_unstale":"2024-09-12T01:15:48.061053+0000","last_undegraded":"2024-09-12T01:15:48.061053+0000","last_fullsized":"2024-09-12T01:15:48.061053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:25.593409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18955,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":388,"num_write":160,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616059+0000","last_change":"2024-09-12T00:02:56.084951+0000","last_active":"2024-09-12T01:12:58.616059+0000","last_peered":"2024-09-12T01:12:58.616059+0000","last_clean":"2024-09-12T01:12:58.616059+0000","last_became_active":"2024-09-12T00:02:56.084651+0000","last_became_peered":"2024-09-12T00:02:56.084651+0000","last_unstale":"2024-09-12T01:12:58.616059+0000","last_undegraded":"2024-09-12T01:12:58.616059+0000","last_fullsized":"2024-09-12T01:12:58.616059+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.763159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'155","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:05.706621+0000","last_change":"2024-09-12T00:02:58.100001+0000","last_active":"2024-09-12T01:13:05.706621+0000","last_peered":"2024-09-12T01:13:05.706621+0000","last_clean":"2024-09-12T01:13:05.706621+0000","last_became_active":"2024-09-12T00:02:58.099635+0000","last_became_peered":"2024-09-12T00:02:58.099635+0000","last_unstale":"2024-09-12T01:13:05.706621+0000","last_undegraded":"2024-09-12T01:13:05.706621+0000","last_fullsized":"2024-09-12T01:13:05.706621+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":359,"num_read_kb":309,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'637","reported_seq":2521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749291+0000","last_change":"2024-09-12T00:02:50.068821+0000","last_active":"2024-09-12T01:15:09.749291+0000","last_peered":"2024-09-12T01:15:09.749291+0000","last_clean":"2024-09-12T01:15:09.749291+0000","last_became_active":"2024-09-12T00:02:50.068518+0000","last_became_peered":"2024-09-12T00:02:50.068518+0000","last_unstale":"2024-09-12T01:15:09.749291+0000","last_undegraded":"2024-09-12T01:15:09.749291+0000","last_fullsized":"2024-09-12T01:15:09.749291+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:48.137188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3685,"num_read_kb":3433,"num_write":846,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'192","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.244021+0000","last_change":"2024-09-12T00:02:48.055024+0000","last_active":"2024-09-12T01:12:55.244021+0000","last_peered":"2024-09-12T01:12:55.244021+0000","last_clean":"2024-09-12T01:12:55.244021+0000","last_became_active":"2024-09-12T00:02:48.054056+0000","last_became_peered":"2024-09-12T00:02:48.054056+0000","last_unstale":"2024-09-12T01:12:55.244021+0000","last_undegraded":"2024-09-12T01:12:55.244021+0000","last_fullsized":"2024-09-12T01:12:55.244021+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:26.535088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":523085,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":463,"num_read_kb":69874,"num_write":895,"num_write_kb":25144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.615384+0000","last_change":"2024-09-12T00:02:52.064704+0000","last_active":"2024-09-12T01:12:53.615384+0000","last_peered":"2024-09-12T01:12:53.615384+0000","last_clean":"2024-09-12T01:12:53.615384+0000","last_became_active":"2024-09-12T00:02:52.064441+0000","last_became_peered":"2024-09-12T00:02:52.064441+0000","last_unstale":"2024-09-12T01:12:53.615384+0000","last_undegraded":"2024-09-12T01:12:53.615384+0000","last_fullsized":"2024-09-12T01:12:53.615384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:59.801795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'141","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.035158+0000","last_change":"2024-09-12T00:02:54.067331+0000","last_active":"2024-09-12T01:15:48.035158+0000","last_peered":"2024-09-12T01:15:48.035158+0000","last_clean":"2024-09-12T01:15:48.035158+0000","last_became_active":"2024-09-12T00:02:54.066900+0000","last_became_peered":"2024-09-12T00:02:54.066900+0000","last_unstale":"2024-09-12T01:15:48.035158+0000","last_undegraded":"2024-09-12T01:15:48.035158+0000","last_fullsized":"2024-09-12T01:15:48.035158+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:20.920036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243955+0000","last_change":"2024-09-12T00:02:56.085678+0000","last_active":"2024-09-12T01:12:55.243955+0000","last_peered":"2024-09-12T01:12:55.243955+0000","last_clean":"2024-09-12T01:12:55.243955+0000","last_became_active":"2024-09-12T00:02:56.084454+0000","last_became_peered":"2024-09-12T00:02:56.084454+0000","last_unstale":"2024-09-12T01:12:55.243955+0000","last_undegraded":"2024-09-12T01:12:55.243955+0000","last_fullsized":"2024-09-12T01:12:55.243955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.942660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'810","reported_seq":2284,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128303+0000","last_change":"2024-09-12T00:02:50.072883+0000","last_active":"2024-09-12T01:14:04.128303+0000","last_peered":"2024-09-12T01:14:04.128303+0000","last_clean":"2024-09-12T01:14:04.128303+0000","last_became_active":"2024-09-12T00:02:50.072570+0000","last_became_peered":"2024-09-12T00:02:50.072570+0000","last_unstale":"2024-09-12T01:14:04.128303+0000","last_undegraded":"2024-09-12T01:14:04.128303+0000","last_fullsized":"2024-09-12T01:14:04.128303+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:59.471970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3795,"num_read_kb":3393,"num_write":1092,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'152","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.115853+0000","last_change":"2024-09-12T00:02:48.050380+0000","last_active":"2024-09-12T01:15:48.115853+0000","last_peered":"2024-09-12T01:15:48.115853+0000","last_clean":"2024-09-12T01:15:48.115853+0000","last_became_active":"2024-09-12T00:02:48.050025+0000","last_became_peered":"2024-09-12T00:02:48.050025+0000","last_unstale":"2024-09-12T01:15:48.115853+0000","last_undegraded":"2024-09-12T01:15:48.115853+0000","last_fullsized":"2024-09-12T01:15:48.115853+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:32.062297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":278,"num_read_kb":9330,"num_write":746,"num_write_kb":34876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:10.245905+0000","last_change":"2024-09-12T00:02:52.071470+0000","last_active":"2024-09-12T01:13:10.245905+0000","last_peered":"2024-09-12T01:13:10.245905+0000","last_clean":"2024-09-12T01:13:10.245905+0000","last_became_active":"2024-09-12T00:02:52.071201+0000","last_became_peered":"2024-09-12T00:02:52.071201+0000","last_unstale":"2024-09-12T01:13:10.245905+0000","last_undegraded":"2024-09-12T01:13:10.245905+0000","last_fullsized":"2024-09-12T01:13:10.245905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.887009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'225","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.215655+0000","last_change":"2024-09-12T00:02:54.073975+0000","last_active":"2024-09-12T01:15:48.215655+0000","last_peered":"2024-09-12T01:15:48.215655+0000","last_clean":"2024-09-12T01:15:48.215655+0000","last_became_active":"2024-09-12T00:02:54.073541+0000","last_became_peered":"2024-09-12T00:02:54.073541+0000","last_unstale":"2024-09-12T01:15:48.215655+0000","last_undegraded":"2024-09-12T01:15:48.215655+0000","last_fullsized":"2024-09-12T01:15:48.215655+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.658572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15168,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":358,"num_read_kb":528,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510916+0000","last_change":"2024-09-12T00:02:56.084926+0000","last_active":"2024-09-12T01:12:58.510916+0000","last_peered":"2024-09-12T01:12:58.510916+0000","last_clean":"2024-09-12T01:12:58.510916+0000","last_became_active":"2024-09-12T00:02:56.084627+0000","last_became_peered":"2024-09-12T00:02:56.084627+0000","last_unstale":"2024-09-12T01:12:58.510916+0000","last_undegraded":"2024-09-12T01:12:58.510916+0000","last_fullsized":"2024-09-12T01:12:58.510916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:48.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'184","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.259373+0000","last_change":"2024-09-12T00:02:58.090856+0000","last_active":"2024-09-12T01:14:04.259373+0000","last_peered":"2024-09-12T01:14:04.259373+0000","last_clean":"2024-09-12T01:14:04.259373+0000","last_became_active":"2024-09-12T00:02:58.089750+0000","last_became_peered":"2024-09-12T00:02:58.089750+0000","last_unstale":"2024-09-12T01:14:04.259373+0000","last_undegraded":"2024-09-12T01:14:04.259373+0000","last_fullsized":"2024-09-12T01:14:04.259373+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:39.825708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":234,"num_read_kb":235,"num_write":422,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'478","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.723839+0000","last_change":"2024-09-12T00:02:50.064457+0000","last_active":"2024-09-12T01:15:09.723839+0000","last_peered":"2024-09-12T01:15:09.723839+0000","last_clean":"2024-09-12T01:15:09.723839+0000","last_became_active":"2024-09-12T00:02:50.064157+0000","last_became_peered":"2024-09-12T00:02:50.064157+0000","last_unstale":"2024-09-12T01:15:09.723839+0000","last_undegraded":"2024-09-12T01:15:09.723839+0000","last_fullsized":"2024-09-12T01:15:09.723839+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:29.208142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2183,"num_write":585,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'252","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041430+0000","last_change":"2024-09-12T00:02:48.053735+0000","last_active":"2024-09-12T01:15:48.041430+0000","last_peered":"2024-09-12T01:15:48.041430+0000","last_clean":"2024-09-12T01:15:48.041430+0000","last_became_active":"2024-09-12T00:02:48.053055+0000","last_became_peered":"2024-09-12T00:02:48.053055+0000","last_unstale":"2024-09-12T01:15:48.041430+0000","last_undegraded":"2024-09-12T01:15:48.041430+0000","last_fullsized":"2024-09-12T01:15:48.041430+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:59.588429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":662,"num_read_kb":2689,"num_write":1334,"num_write_kb":25481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622306+0000","last_change":"2024-09-12T00:02:52.060376+0000","last_active":"2024-09-12T01:13:43.622306+0000","last_peered":"2024-09-12T01:13:43.622306+0000","last_clean":"2024-09-12T01:13:43.622306+0000","last_became_active":"2024-09-12T00:02:52.060034+0000","last_became_peered":"2024-09-12T00:02:52.060034+0000","last_unstale":"2024-09-12T01:13:43.622306+0000","last_undegraded":"2024-09-12T01:13:43.622306+0000","last_fullsized":"2024-09-12T01:13:43.622306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.319586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'197","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.045639+0000","last_change":"2024-09-12T00:02:54.067256+0000","last_active":"2024-09-12T01:15:48.045639+0000","last_peered":"2024-09-12T01:15:48.045639+0000","last_clean":"2024-09-12T01:15:48.045639+0000","last_became_active":"2024-09-12T00:02:54.066854+0000","last_became_peered":"2024-09-12T00:02:54.066854+0000","last_unstale":"2024-09-12T01:15:48.045639+0000","last_undegraded":"2024-09-12T01:15:48.045639+0000","last_fullsized":"2024-09-12T01:15:48.045639+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:56.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":290,"num_read_kb":407,"num_write":194,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.236453+0000","last_change":"2024-09-12T00:02:56.086661+0000","last_active":"2024-09-12T01:12:58.236453+0000","last_peered":"2024-09-12T01:12:58.236453+0000","last_clean":"2024-09-12T01:12:58.236453+0000","last_became_active":"2024-09-12T00:02:56.086349+0000","last_became_peered":"2024-09-12T00:02:56.086349+0000","last_unstale":"2024-09-12T01:12:58.236453+0000","last_undegraded":"2024-09-12T01:12:58.236453+0000","last_fullsized":"2024-09-12T01:12:58.236453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:32.352621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'169","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.265206+0000","last_change":"2024-09-12T00:02:58.100935+0000","last_active":"2024-09-12T01:14:04.265206+0000","last_peered":"2024-09-12T01:14:04.265206+0000","last_clean":"2024-09-12T01:14:04.265206+0000","last_became_active":"2024-09-12T00:02:58.100646+0000","last_became_peered":"2024-09-12T00:02:58.100646+0000","last_unstale":"2024-09-12T01:14:04.265206+0000","last_undegraded":"2024-09-12T01:14:04.265206+0000","last_fullsized":"2024-09-12T01:14:04.265206+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:32.687456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":591,"num_write":465,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'695","reported_seq":2038,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127708+0000","last_change":"2024-09-12T00:02:50.072964+0000","last_active":"2024-09-12T01:14:04.127708+0000","last_peered":"2024-09-12T01:14:04.127708+0000","last_clean":"2024-09-12T01:14:04.127708+0000","last_became_active":"2024-09-12T00:02:50.072665+0000","last_became_peered":"2024-09-12T00:02:50.072665+0000","last_unstale":"2024-09-12T01:14:04.127708+0000","last_undegraded":"2024-09-12T01:14:04.127708+0000","last_fullsized":"2024-09-12T01:14:04.127708+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.757307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3202,"num_read_kb":2877,"num_write":917,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'240","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.211007+0000","last_change":"2024-09-12T00:03:21.140521+0000","last_active":"2024-09-12T01:15:48.211007+0000","last_peered":"2024-09-12T01:15:48.211007+0000","last_clean":"2024-09-12T01:15:48.211007+0000","last_became_active":"2024-09-12T00:03:21.140095+0000","last_became_peered":"2024-09-12T00:03:21.140095+0000","last_unstale":"2024-09-12T01:15:48.211007+0000","last_undegraded":"2024-09-12T01:15:48.211007+0000","last_fullsized":"2024-09-12T01:15:48.211007+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.899923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322785,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":39289,"num_write":1008,"num_write_kb":58524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397483+0000","last_change":"2024-09-12T00:02:52.063849+0000","last_active":"2024-09-12T01:12:53.397483+0000","last_peered":"2024-09-12T01:12:53.397483+0000","last_clean":"2024-09-12T01:12:53.397483+0000","last_became_active":"2024-09-12T00:02:52.063334+0000","last_became_peered":"2024-09-12T00:02:52.063334+0000","last_unstale":"2024-09-12T01:12:53.397483+0000","last_undegraded":"2024-09-12T01:12:53.397483+0000","last_fullsized":"2024-09-12T01:12:53.397483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:03.747256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.197503+0000","last_change":"2024-09-12T00:02:54.240449+0000","last_active":"2024-09-12T01:15:48.197503+0000","last_peered":"2024-09-12T01:15:48.197503+0000","last_clean":"2024-09-12T01:15:48.197503+0000","last_became_active":"2024-09-12T00:02:54.240007+0000","last_became_peered":"2024-09-12T00:02:54.240007+0000","last_unstale":"2024-09-12T01:15:48.197503+0000","last_undegraded":"2024-09-12T01:15:48.197503+0000","last_fullsized":"2024-09-12T01:15:48.197503+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:58.601042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":288,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.238159+0000","last_change":"2024-09-12T00:02:56.087660+0000","last_active":"2024-09-12T01:13:13.238159+0000","last_peered":"2024-09-12T01:13:13.238159+0000","last_clean":"2024-09-12T01:13:13.238159+0000","last_became_active":"2024-09-12T00:02:56.087317+0000","last_became_peered":"2024-09-12T00:02:56.087317+0000","last_unstale":"2024-09-12T01:13:13.238159+0000","last_undegraded":"2024-09-12T01:13:13.238159+0000","last_fullsized":"2024-09-12T01:13:13.238159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:30.847202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'148","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.905755+0000","last_change":"2024-09-12T00:02:58.099988+0000","last_active":"2024-09-12T01:15:10.905755+0000","last_peered":"2024-09-12T01:15:10.905755+0000","last_clean":"2024-09-12T01:15:10.905755+0000","last_became_active":"2024-09-12T00:02:58.099712+0000","last_became_peered":"2024-09-12T00:02:58.099712+0000","last_unstale":"2024-09-12T01:15:10.905755+0000","last_undegraded":"2024-09-12T01:15:10.905755+0000","last_fullsized":"2024-09-12T01:15:10.905755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.021756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'706","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.058665+0000","last_change":"2024-09-12T00:02:50.062196+0000","last_active":"2024-09-12T01:13:06.058665+0000","last_peered":"2024-09-12T01:13:06.058665+0000","last_clean":"2024-09-12T01:13:06.058665+0000","last_became_active":"2024-09-12T00:02:50.061909+0000","last_became_peered":"2024-09-12T00:02:50.061909+0000","last_unstale":"2024-09-12T01:13:06.058665+0000","last_undegraded":"2024-09-12T01:13:06.058665+0000","last_fullsized":"2024-09-12T01:13:06.058665+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":600,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:59.811798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3690,"num_read_kb":3334,"num_write":961,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'196","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243290+0000","last_change":"2024-09-12T00:02:48.051220+0000","last_active":"2024-09-12T01:12:50.243290+0000","last_peered":"2024-09-12T01:12:50.243290+0000","last_clean":"2024-09-12T01:12:50.243290+0000","last_became_active":"2024-09-12T00:02:48.050894+0000","last_became_peered":"2024-09-12T00:02:48.050894+0000","last_unstale":"2024-09-12T01:12:50.243290+0000","last_undegraded":"2024-09-12T01:12:50.243290+0000","last_fullsized":"2024-09-12T01:12:50.243290+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:06.067280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19167861,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":20890,"num_write":1007,"num_write_kb":39832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.235936+0000","last_change":"2024-09-12T00:02:52.064983+0000","last_active":"2024-09-12T01:12:53.235936+0000","last_peered":"2024-09-12T01:12:53.235936+0000","last_clean":"2024-09-12T01:12:53.235936+0000","last_became_active":"2024-09-12T00:02:52.064125+0000","last_became_peered":"2024-09-12T00:02:52.064125+0000","last_unstale":"2024-09-12T01:12:53.235936+0000","last_undegraded":"2024-09-12T01:12:53.235936+0000","last_fullsized":"2024-09-12T01:12:53.235936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:32.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'111","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.555449+0000","last_change":"2024-09-12T00:02:54.239923+0000","last_active":"2024-09-12T01:13:29.555449+0000","last_peered":"2024-09-12T01:13:29.555449+0000","last_clean":"2024-09-12T01:13:29.555449+0000","last_became_active":"2024-09-12T00:02:54.239412+0000","last_became_peered":"2024-09-12T00:02:54.239412+0000","last_unstale":"2024-09-12T01:13:29.555449+0000","last_undegraded":"2024-09-12T01:13:29.555449+0000","last_fullsized":"2024-09-12T01:13:29.555449+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.570833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'772","reported_seq":2645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.954676+0000","last_change":"2024-09-12T00:02:56.080694+0000","last_active":"2024-09-12T01:15:47.954676+0000","last_peered":"2024-09-12T01:15:47.954676+0000","last_clean":"2024-09-12T01:15:47.954676+0000","last_became_active":"2024-09-12T00:02:56.080374+0000","last_became_peered":"2024-09-12T00:02:56.080374+0000","last_unstale":"2024-09-12T01:15:47.954676+0000","last_undegraded":"2024-09-12T01:15:47.954676+0000","last_fullsized":"2024-09-12T01:15:47.954676+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:02.095265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'116","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399596+0000","last_change":"2024-09-12T00:02:58.101477+0000","last_active":"2024-09-12T01:12:58.399596+0000","last_peered":"2024-09-12T01:12:58.399596+0000","last_clean":"2024-09-12T01:12:58.399596+0000","last_became_active":"2024-09-12T00:02:58.100777+0000","last_became_peered":"2024-09-12T00:02:58.100777+0000","last_unstale":"2024-09-12T01:12:58.399596+0000","last_undegraded":"2024-09-12T01:12:58.399596+0000","last_fullsized":"2024-09-12T01:12:58.399596+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:03.981795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'472","reported_seq":2034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127865+0000","last_change":"2024-09-12T00:02:50.070545+0000","last_active":"2024-09-12T01:14:04.127865+0000","last_peered":"2024-09-12T01:14:04.127865+0000","last_clean":"2024-09-12T01:14:04.127865+0000","last_became_active":"2024-09-12T00:02:50.070186+0000","last_became_peered":"2024-09-12T00:02:50.070186+0000","last_unstale":"2024-09-12T01:14:04.127865+0000","last_undegraded":"2024-09-12T01:14:04.127865+0000","last_fullsized":"2024-09-12T01:14:04.127865+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:36.641202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2560,"num_read_kb":2381,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'280","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.257256+0000","last_change":"2024-09-12T00:02:48.055180+0000","last_active":"2024-09-12T01:15:48.257256+0000","last_peered":"2024-09-12T01:15:48.257256+0000","last_clean":"2024-09-12T01:15:48.257256+0000","last_became_active":"2024-09-12T00:02:48.054303+0000","last_became_peered":"2024-09-12T00:02:48.054303+0000","last_unstale":"2024-09-12T01:15:48.257256+0000","last_undegraded":"2024-09-12T01:15:48.257256+0000","last_fullsized":"2024-09-12T01:15:48.257256+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:53.174386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":47582,"num_write":1191,"num_write_kb":28572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399009+0000","last_change":"2024-09-12T00:02:52.071857+0000","last_active":"2024-09-12T01:12:53.399009+0000","last_peered":"2024-09-12T01:12:53.399009+0000","last_clean":"2024-09-12T01:12:53.399009+0000","last_became_active":"2024-09-12T00:02:52.071580+0000","last_became_peered":"2024-09-12T00:02:52.071580+0000","last_unstale":"2024-09-12T01:12:53.399009+0000","last_undegraded":"2024-09-12T01:12:53.399009+0000","last_fullsized":"2024-09-12T01:12:53.399009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:15.575099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'229","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.250455+0000","last_change":"2024-09-12T00:02:54.069107+0000","last_active":"2024-09-12T01:15:48.250455+0000","last_peered":"2024-09-12T01:15:48.250455+0000","last_clean":"2024-09-12T01:15:48.250455+0000","last_became_active":"2024-09-12T00:02:54.068806+0000","last_became_peered":"2024-09-12T00:02:54.068806+0000","last_unstale":"2024-09-12T01:15:48.250455+0000","last_undegraded":"2024-09-12T01:15:48.250455+0000","last_fullsized":"2024-09-12T01:15:48.250455+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:03.065780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9605,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":355,"num_write":182,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244538+0000","last_change":"2024-09-12T00:02:56.083225+0000","last_active":"2024-09-12T01:13:00.244538+0000","last_peered":"2024-09-12T01:13:00.244538+0000","last_clean":"2024-09-12T01:13:00.244538+0000","last_became_active":"2024-09-12T00:02:56.082924+0000","last_became_peered":"2024-09-12T00:02:56.082924+0000","last_unstale":"2024-09-12T01:13:00.244538+0000","last_undegraded":"2024-09-12T01:13:00.244538+0000","last_fullsized":"2024-09-12T01:13:00.244538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:14.433764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'109","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.113160+0000","last_change":"2024-09-12T00:02:58.099967+0000","last_active":"2024-09-12T01:14:04.113160+0000","last_peered":"2024-09-12T01:14:04.113160+0000","last_clean":"2024-09-12T01:14:04.113160+0000","last_became_active":"2024-09-12T00:02:58.099683+0000","last_became_peered":"2024-09-12T00:02:58.099683+0000","last_unstale":"2024-09-12T01:14:04.113160+0000","last_undegraded":"2024-09-12T01:14:04.113160+0000","last_fullsized":"2024-09-12T01:14:04.113160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:14.241268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":199,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'538","reported_seq":2265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748583+0000","last_change":"2024-09-12T00:02:50.070201+0000","last_active":"2024-09-12T01:15:09.748583+0000","last_peered":"2024-09-12T01:15:09.748583+0000","last_clean":"2024-09-12T01:15:09.748583+0000","last_became_active":"2024-09-12T00:02:50.069907+0000","last_became_peered":"2024-09-12T00:02:50.069907+0000","last_unstale":"2024-09-12T01:15:09.748583+0000","last_undegraded":"2024-09-12T01:15:09.748583+0000","last_fullsized":"2024-09-12T01:15:09.748583+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:16.483724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2946,"num_read_kb":2752,"num_write":643,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'210","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203279+0000","last_change":"2024-09-12T00:02:48.054530+0000","last_active":"2024-09-12T01:15:48.203279+0000","last_peered":"2024-09-12T01:15:48.203279+0000","last_clean":"2024-09-12T01:15:48.203279+0000","last_became_active":"2024-09-12T00:02:48.052303+0000","last_became_peered":"2024-09-12T00:02:48.052303+0000","last_unstale":"2024-09-12T01:15:48.203279+0000","last_undegraded":"2024-09-12T01:15:48.203279+0000","last_fullsized":"2024-09-12T01:15:48.203279+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:02.915896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":51729,"num_write":985,"num_write_kb":45446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510194+0000","last_change":"2024-09-12T00:02:52.066240+0000","last_active":"2024-09-12T01:12:53.510194+0000","last_peered":"2024-09-12T01:12:53.510194+0000","last_clean":"2024-09-12T01:12:53.510194+0000","last_became_active":"2024-09-12T00:02:52.065653+0000","last_became_peered":"2024-09-12T00:02:52.065653+0000","last_unstale":"2024-09-12T01:12:53.510194+0000","last_undegraded":"2024-09-12T01:12:53.510194+0000","last_fullsized":"2024-09-12T01:12:53.510194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'148","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.856789+0000","last_change":"2024-09-12T00:02:54.074579+0000","last_active":"2024-09-12T01:15:10.856789+0000","last_peered":"2024-09-12T01:15:10.856789+0000","last_clean":"2024-09-12T01:15:10.856789+0000","last_became_active":"2024-09-12T00:02:54.073930+0000","last_became_peered":"2024-09-12T00:02:54.073930+0000","last_unstale":"2024-09-12T01:15:10.856789+0000","last_undegraded":"2024-09-12T01:15:10.856789+0000","last_fullsized":"2024-09-12T01:15:10.856789+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.507632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10183,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":191,"num_read_kb":242,"num_write":106,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.617272+0000","last_change":"2024-09-12T00:02:56.078803+0000","last_active":"2024-09-12T01:13:08.617272+0000","last_peered":"2024-09-12T01:13:08.617272+0000","last_clean":"2024-09-12T01:13:08.617272+0000","last_became_active":"2024-09-12T00:02:56.078528+0000","last_became_peered":"2024-09-12T00:02:56.078528+0000","last_unstale":"2024-09-12T01:13:08.617272+0000","last_undegraded":"2024-09-12T01:13:08.617272+0000","last_fullsized":"2024-09-12T01:13:08.617272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:32.315601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'99","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.947976+0000","last_change":"2024-09-12T00:02:58.087504+0000","last_active":"2024-09-12T01:14:02.947976+0000","last_peered":"2024-09-12T01:14:02.947976+0000","last_clean":"2024-09-12T01:14:02.947976+0000","last_became_active":"2024-09-12T00:02:58.087199+0000","last_became_peered":"2024-09-12T00:02:58.087199+0000","last_unstale":"2024-09-12T01:14:02.947976+0000","last_undegraded":"2024-09-12T01:14:02.947976+0000","last_fullsized":"2024-09-12T01:14:02.947976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:03.468020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":246,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'466","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749348+0000","last_change":"2024-09-12T00:02:50.073193+0000","last_active":"2024-09-12T01:15:09.749348+0000","last_peered":"2024-09-12T01:15:09.749348+0000","last_clean":"2024-09-12T01:15:09.749348+0000","last_became_active":"2024-09-12T00:02:50.072920+0000","last_became_peered":"2024-09-12T00:02:50.072920+0000","last_unstale":"2024-09-12T01:15:09.749348+0000","last_undegraded":"2024-09-12T01:15:09.749348+0000","last_fullsized":"2024-09-12T01:15:09.749348+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.921031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2371,"num_write":566,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'211","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.195443+0000","last_change":"2024-09-12T00:02:48.048693+0000","last_active":"2024-09-12T01:15:48.195443+0000","last_peered":"2024-09-12T01:15:48.195443+0000","last_clean":"2024-09-12T01:15:48.195443+0000","last_became_active":"2024-09-12T00:02:48.048308+0000","last_became_peered":"2024-09-12T00:02:48.048308+0000","last_unstale":"2024-09-12T01:15:48.195443+0000","last_undegraded":"2024-09-12T01:15:48.195443+0000","last_fullsized":"2024-09-12T01:15:48.195443+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:27.341399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2092,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":37398,"num_write":996,"num_write_kb":57972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398220+0000","last_change":"2024-09-12T00:02:52.060575+0000","last_active":"2024-09-12T01:12:58.398220+0000","last_peered":"2024-09-12T01:12:58.398220+0000","last_clean":"2024-09-12T01:12:58.398220+0000","last_became_active":"2024-09-12T00:02:52.060283+0000","last_became_peered":"2024-09-12T00:02:52.060283+0000","last_unstale":"2024-09-12T01:12:58.398220+0000","last_undegraded":"2024-09-12T01:12:58.398220+0000","last_fullsized":"2024-09-12T01:12:58.398220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.734208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'126","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.188246+0000","last_change":"2024-09-12T00:02:54.068064+0000","last_active":"2024-09-12T01:15:48.188246+0000","last_peered":"2024-09-12T01:15:48.188246+0000","last_clean":"2024-09-12T01:15:48.188246+0000","last_became_active":"2024-09-12T00:02:54.067770+0000","last_became_peered":"2024-09-12T00:02:54.067770+0000","last_unstale":"2024-09-12T01:15:48.188246+0000","last_undegraded":"2024-09-12T01:15:48.188246+0000","last_fullsized":"2024-09-12T01:15:48.188246+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:35.379645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4641,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":72,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398279+0000","last_change":"2024-09-12T00:02:56.078599+0000","last_active":"2024-09-12T01:12:58.398279+0000","last_peered":"2024-09-12T01:12:58.398279+0000","last_clean":"2024-09-12T01:12:58.398279+0000","last_became_active":"2024-09-12T00:02:56.077573+0000","last_became_peered":"2024-09-12T00:02:56.077573+0000","last_unstale":"2024-09-12T01:12:58.398279+0000","last_undegraded":"2024-09-12T01:12:58.398279+0000","last_fullsized":"2024-09-12T01:12:58.398279+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.485844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'149","reported_seq":1250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.171046+0000","last_change":"2024-09-12T00:02:58.099809+0000","last_active":"2024-09-12T01:14:00.171046+0000","last_peered":"2024-09-12T01:14:00.171046+0000","last_clean":"2024-09-12T01:14:00.171046+0000","last_became_active":"2024-09-12T00:02:58.099426+0000","last_became_peered":"2024-09-12T00:02:58.099426+0000","last_unstale":"2024-09-12T01:14:00.171046+0000","last_undegraded":"2024-09-12T01:14:00.171046+0000","last_fullsized":"2024-09-12T01:14:00.171046+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:47.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":755,"num_read_kb":754,"num_write":338,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'470","reported_seq":1958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.281149+0000","last_change":"2024-09-12T00:02:50.064387+0000","last_active":"2024-09-12T01:13:32.281149+0000","last_peered":"2024-09-12T01:13:32.281149+0000","last_clean":"2024-09-12T01:13:32.281149+0000","last_became_active":"2024-09-12T00:02:50.063959+0000","last_became_peered":"2024-09-12T00:02:50.063959+0000","last_unstale":"2024-09-12T01:13:32.281149+0000","last_undegraded":"2024-09-12T01:13:32.281149+0000","last_fullsized":"2024-09-12T01:13:32.281149+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:18.236963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2471,"num_read_kb":2277,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'189","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249606+0000","last_change":"2024-09-12T00:02:48.055373+0000","last_active":"2024-09-12T01:13:40.249606+0000","last_peered":"2024-09-12T01:13:40.249606+0000","last_clean":"2024-09-12T01:13:40.249606+0000","last_became_active":"2024-09-12T00:02:48.054650+0000","last_became_peered":"2024-09-12T00:02:48.054650+0000","last_unstale":"2024-09-12T01:13:40.249606+0000","last_undegraded":"2024-09-12T01:13:40.249606+0000","last_fullsized":"2024-09-12T01:13:40.249606+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:13.706061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9667457,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":855,"num_read_kb":59687,"num_write":950,"num_write_kb":41766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.926078+0000","last_change":"2024-09-12T00:02:52.066201+0000","last_active":"2024-09-12T01:15:47.926078+0000","last_peered":"2024-09-12T01:15:47.926078+0000","last_clean":"2024-09-12T01:15:47.926078+0000","last_became_active":"2024-09-12T00:02:52.065804+0000","last_became_peered":"2024-09-12T00:02:52.065804+0000","last_unstale":"2024-09-12T01:15:47.926078+0000","last_undegraded":"2024-09-12T01:15:47.926078+0000","last_fullsized":"2024-09-12T01:15:47.926078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:39.988981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'181","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.205498+0000","last_change":"2024-09-12T00:02:54.067254+0000","last_active":"2024-09-12T01:15:48.205498+0000","last_peered":"2024-09-12T01:15:48.205498+0000","last_clean":"2024-09-12T01:15:48.205498+0000","last_became_active":"2024-09-12T00:02:54.066918+0000","last_became_peered":"2024-09-12T00:02:54.066918+0000","last_unstale":"2024-09-12T01:15:48.205498+0000","last_undegraded":"2024-09-12T01:15:48.205498+0000","last_fullsized":"2024-09-12T01:15:48.205498+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:12.059169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":266,"num_write":140,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243946+0000","last_change":"2024-09-12T00:02:56.085398+0000","last_active":"2024-09-12T01:12:55.243946+0000","last_peered":"2024-09-12T01:12:55.243946+0000","last_clean":"2024-09-12T01:12:55.243946+0000","last_became_active":"2024-09-12T00:02:56.084768+0000","last_became_peered":"2024-09-12T00:02:56.084768+0000","last_unstale":"2024-09-12T01:12:55.243946+0000","last_undegraded":"2024-09-12T01:12:55.243946+0000","last_fullsized":"2024-09-12T01:12:55.243946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:48.456473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'155","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.758350+0000","last_change":"2024-09-12T00:02:58.097950+0000","last_active":"2024-09-12T01:15:09.758350+0000","last_peered":"2024-09-12T01:15:09.758350+0000","last_clean":"2024-09-12T01:15:09.758350+0000","last_became_active":"2024-09-12T00:02:58.097725+0000","last_became_peered":"2024-09-12T00:02:58.097725+0000","last_unstale":"2024-09-12T01:15:09.758350+0000","last_undegraded":"2024-09-12T01:15:09.758350+0000","last_fullsized":"2024-09-12T01:15:09.758350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:53.001751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":109,"num_write":343,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'690","reported_seq":2193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.278553+0000","last_change":"2024-09-12T00:02:50.064639+0000","last_active":"2024-09-12T01:13:32.278553+0000","last_peered":"2024-09-12T01:13:32.278553+0000","last_clean":"2024-09-12T01:13:32.278553+0000","last_became_active":"2024-09-12T00:02:50.064354+0000","last_became_peered":"2024-09-12T00:02:50.064354+0000","last_unstale":"2024-09-12T01:13:32.278553+0000","last_undegraded":"2024-09-12T01:13:32.278553+0000","last_fullsized":"2024-09-12T01:13:32.278553+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:47.800598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3412,"num_read_kb":3118,"num_write":870,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'187","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154216+0000","last_change":"2024-09-12T00:02:48.049912+0000","last_active":"2024-09-12T01:15:48.154216+0000","last_peered":"2024-09-12T01:15:48.154216+0000","last_clean":"2024-09-12T01:15:48.154216+0000","last_became_active":"2024-09-12T00:02:48.049242+0000","last_became_peered":"2024-09-12T00:02:48.049242+0000","last_unstale":"2024-09-12T01:15:48.154216+0000","last_undegraded":"2024-09-12T01:15:48.154216+0000","last_fullsized":"2024-09-12T01:15:48.154216+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:23.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":39372,"num_write":875,"num_write_kb":46728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'350","reported_seq":1687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128431+0000","last_change":"2024-09-12T00:02:50.066620+0000","last_active":"2024-09-12T01:14:04.128431+0000","last_peered":"2024-09-12T01:14:04.128431+0000","last_clean":"2024-09-12T01:14:04.128431+0000","last_became_active":"2024-09-12T00:02:50.065060+0000","last_became_peered":"2024-09-12T00:02:50.065060+0000","last_unstale":"2024-09-12T01:14:04.128431+0000","last_undegraded":"2024-09-12T01:14:04.128431+0000","last_fullsized":"2024-09-12T01:14:04.128431+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:29.932545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1806,"num_read_kb":1710,"num_write":413,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'203","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.232859+0000","last_change":"2024-09-12T00:02:48.042203+0000","last_active":"2024-09-12T01:13:38.232859+0000","last_peered":"2024-09-12T01:13:38.232859+0000","last_clean":"2024-09-12T01:13:38.232859+0000","last_became_active":"2024-09-12T00:02:48.041842+0000","last_became_peered":"2024-09-12T00:02:48.041842+0000","last_unstale":"2024-09-12T01:13:38.232859+0000","last_undegraded":"2024-09-12T01:13:38.232859+0000","last_fullsized":"2024-09-12T01:13:38.232859+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.057094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":13124,"num_write":1044,"num_write_kb":38354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'456","reported_seq":2064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.953879+0000","last_change":"2024-09-12T00:02:50.066620+0000","last_active":"2024-09-12T01:14:02.953879+0000","last_peered":"2024-09-12T01:14:02.953879+0000","last_clean":"2024-09-12T01:14:02.953879+0000","last_became_active":"2024-09-12T00:02:50.066341+0000","last_became_peered":"2024-09-12T00:02:50.066341+0000","last_unstale":"2024-09-12T01:14:02.953879+0000","last_undegraded":"2024-09-12T01:14:02.953879+0000","last_fullsized":"2024-09-12T01:14:02.953879+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:24.335215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2383,"num_read_kb":2262,"num_write":523,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'185","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203656+0000","last_change":"2024-09-12T00:02:48.053321+0000","last_active":"2024-09-12T01:15:48.203656+0000","last_peered":"2024-09-12T01:15:48.203656+0000","last_clean":"2024-09-12T01:15:48.203656+0000","last_became_active":"2024-09-12T00:02:48.052205+0000","last_became_peered":"2024-09-12T00:02:48.052205+0000","last_unstale":"2024-09-12T01:15:48.203656+0000","last_undegraded":"2024-09-12T01:15:48.203656+0000","last_fullsized":"2024-09-12T01:15:48.203656+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:46.259191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":389,"num_read_kb":19493,"num_write":855,"num_write_kb":24928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'366","reported_seq":1876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.726506+0000","last_change":"2024-09-12T00:02:50.066198+0000","last_active":"2024-09-12T01:15:09.726506+0000","last_peered":"2024-09-12T01:15:09.726506+0000","last_clean":"2024-09-12T01:15:09.726506+0000","last_became_active":"2024-09-12T00:02:50.065534+0000","last_became_peered":"2024-09-12T00:02:50.065534+0000","last_unstale":"2024-09-12T01:15:09.726506+0000","last_undegraded":"2024-09-12T01:15:09.726506+0000","last_fullsized":"2024-09-12T01:15:09.726506+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:03.014135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1966,"num_read_kb":1903,"num_write":390,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'155","reported_seq":751,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.238188+0000","last_change":"2024-09-12T00:03:21.720945+0000","last_active":"2024-09-12T01:14:28.238188+0000","last_peered":"2024-09-12T01:14:28.238188+0000","last_clean":"2024-09-12T01:14:28.238188+0000","last_became_active":"2024-09-12T00:03:21.720441+0000","last_became_peered":"2024-09-12T00:03:21.720441+0000","last_unstale":"2024-09-12T01:14:28.238188+0000","last_undegraded":"2024-09-12T01:14:28.238188+0000","last_fullsized":"2024-09-12T01:14:28.238188+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:43.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":16297,"num_write":778,"num_write_kb":33256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"267'1239","reported_seq":3053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.279664+0000","last_change":"2024-09-12T00:02:50.070807+0000","last_active":"2024-09-12T01:13:32.279664+0000","last_peered":"2024-09-12T01:13:32.279664+0000","last_clean":"2024-09-12T01:13:32.279664+0000","last_became_active":"2024-09-12T00:02:50.070406+0000","last_became_peered":"2024-09-12T00:02:50.070406+0000","last_unstale":"2024-09-12T01:13:32.279664+0000","last_undegraded":"2024-09-12T01:13:32.279664+0000","last_fullsized":"2024-09-12T01:13:32.279664+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:02.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5822,"num_read_kb":5176,"num_write":1694,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'194","reported_seq":841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.244888+0000","last_change":"2024-09-12T00:02:48.051785+0000","last_active":"2024-09-12T01:14:18.244888+0000","last_peered":"2024-09-12T01:14:18.244888+0000","last_clean":"2024-09-12T01:14:18.244888+0000","last_became_active":"2024-09-12T00:02:48.051454+0000","last_became_peered":"2024-09-12T00:02:48.051454+0000","last_unstale":"2024-09-12T01:14:18.244888+0000","last_undegraded":"2024-09-12T01:14:18.244888+0000","last_fullsized":"2024-09-12T01:14:18.244888+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:03.729498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22651,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":459,"num_read_kb":27281,"num_write":912,"num_write_kb":43596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'808","reported_seq":2264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257926+0000","last_change":"2024-09-12T00:02:50.065953+0000","last_active":"2024-09-12T01:13:43.257926+0000","last_peered":"2024-09-12T01:13:43.257926+0000","last_clean":"2024-09-12T01:13:43.257926+0000","last_became_active":"2024-09-12T00:02:50.065615+0000","last_became_peered":"2024-09-12T00:02:50.065615+0000","last_unstale":"2024-09-12T01:13:43.257926+0000","last_undegraded":"2024-09-12T01:13:43.257926+0000","last_fullsized":"2024-09-12T01:13:43.257926+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:10.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3886,"num_read_kb":3508,"num_write":1123,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'222","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.245194+0000","last_change":"2024-09-12T00:02:48.047922+0000","last_active":"2024-09-12T01:14:18.245194+0000","last_peered":"2024-09-12T01:14:18.245194+0000","last_clean":"2024-09-12T01:14:18.245194+0000","last_became_active":"2024-09-12T00:02:48.047357+0000","last_became_peered":"2024-09-12T00:02:48.047357+0000","last_unstale":"2024-09-12T01:14:18.245194+0000","last_undegraded":"2024-09-12T01:14:18.245194+0000","last_fullsized":"2024-09-12T01:14:18.245194+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:00.961888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2112,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":474,"num_read_kb":6089,"num_write":1091,"num_write_kb":27766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1102","reported_seq":2609,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.239495+0000","last_change":"2024-09-12T00:02:50.076287+0000","last_active":"2024-09-12T01:13:43.239495+0000","last_peered":"2024-09-12T01:13:43.239495+0000","last_clean":"2024-09-12T01:13:43.239495+0000","last_became_active":"2024-09-12T00:02:50.075265+0000","last_became_peered":"2024-09-12T00:02:50.075265+0000","last_unstale":"2024-09-12T01:13:43.239495+0000","last_undegraded":"2024-09-12T01:13:43.239495+0000","last_fullsized":"2024-09-12T01:13:43.239495+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":1000,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:28.198469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4403,"num_write":1512,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'200","reported_seq":822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.177090+0000","last_change":"2024-09-12T00:02:48.047911+0000","last_active":"2024-09-12T01:15:48.177090+0000","last_peered":"2024-09-12T01:15:48.177090+0000","last_clean":"2024-09-12T01:15:48.177090+0000","last_became_active":"2024-09-12T00:02:48.047266+0000","last_became_peered":"2024-09-12T00:02:48.047266+0000","last_unstale":"2024-09-12T01:15:48.177090+0000","last_undegraded":"2024-09-12T01:15:48.177090+0000","last_fullsized":"2024-09-12T01:15:48.177090+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.110547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":23654,"num_write":912,"num_write_kb":39021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'475","reported_seq":2121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622203+0000","last_change":"2024-09-12T00:02:50.068176+0000","last_active":"2024-09-12T01:13:43.622203+0000","last_peered":"2024-09-12T01:13:43.622203+0000","last_clean":"2024-09-12T01:13:43.622203+0000","last_became_active":"2024-09-12T00:02:50.067919+0000","last_became_peered":"2024-09-12T00:02:50.067919+0000","last_unstale":"2024-09-12T01:13:43.622203+0000","last_undegraded":"2024-09-12T01:13:43.622203+0000","last_fullsized":"2024-09-12T01:13:43.622203+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:55.966361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2453,"num_write":580,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:53.249785+0000","last_change":"2024-09-12T00:03:21.143532+0000","last_active":"2024-09-12T01:14:53.249785+0000","last_peered":"2024-09-12T01:14:53.249785+0000","last_clean":"2024-09-12T01:14:53.249785+0000","last_became_active":"2024-09-12T00:03:21.143091+0000","last_became_peered":"2024-09-12T00:03:21.143091+0000","last_unstale":"2024-09-12T01:14:53.249785+0000","last_undegraded":"2024-09-12T01:14:53.249785+0000","last_fullsized":"2024-09-12T01:14:53.249785+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:15.405828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":6539,"num_write":770,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'874","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863508+0000","last_change":"2024-09-12T00:02:50.076474+0000","last_active":"2024-09-12T01:13:20.863508+0000","last_peered":"2024-09-12T01:13:20.863508+0000","last_clean":"2024-09-12T01:13:20.863508+0000","last_became_active":"2024-09-12T00:02:50.076097+0000","last_became_peered":"2024-09-12T00:02:50.076097+0000","last_unstale":"2024-09-12T01:13:20.863508+0000","last_undegraded":"2024-09-12T01:13:20.863508+0000","last_fullsized":"2024-09-12T01:13:20.863508+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:53.760772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3804,"num_write":1206,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'185","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:23.523597+0000","last_change":"2024-09-12T00:02:48.058120+0000","last_active":"2024-09-12T01:14:23.523597+0000","last_peered":"2024-09-12T01:14:23.523597+0000","last_clean":"2024-09-12T01:14:23.523597+0000","last_became_active":"2024-09-12T00:02:48.057693+0000","last_became_peered":"2024-09-12T00:02:48.057693+0000","last_unstale":"2024-09-12T01:14:23.523597+0000","last_undegraded":"2024-09-12T01:14:23.523597+0000","last_fullsized":"2024-09-12T01:14:23.523597+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:03.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":352,"num_read_kb":5525,"num_write":905,"num_write_kb":35074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'837","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.955489+0000","last_change":"2024-09-12T00:02:50.062788+0000","last_active":"2024-09-12T01:14:02.955489+0000","last_peered":"2024-09-12T01:14:02.955489+0000","last_clean":"2024-09-12T01:14:02.955489+0000","last_became_active":"2024-09-12T00:02:50.062524+0000","last_became_peered":"2024-09-12T00:02:50.062524+0000","last_unstale":"2024-09-12T01:14:02.955489+0000","last_undegraded":"2024-09-12T01:14:02.955489+0000","last_fullsized":"2024-09-12T01:14:02.955489+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:00.117674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4232,"num_read_kb":3859,"num_write":1078,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'257","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.214002+0000","last_change":"2024-09-12T00:02:48.050975+0000","last_active":"2024-09-12T01:15:48.214002+0000","last_peered":"2024-09-12T01:15:48.214002+0000","last_clean":"2024-09-12T01:15:48.214002+0000","last_became_active":"2024-09-12T00:02:48.050574+0000","last_became_peered":"2024-09-12T00:02:48.050574+0000","last_unstale":"2024-09-12T01:15:48.214002+0000","last_undegraded":"2024-09-12T01:15:48.214002+0000","last_fullsized":"2024-09-12T01:15:48.214002+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:18.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68583,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":597,"num_read_kb":15341,"num_write":1131,"num_write_kb":29230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'811","reported_seq":2278,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.722532+0000","last_change":"2024-09-12T00:02:50.063982+0000","last_active":"2024-09-12T01:15:09.722532+0000","last_peered":"2024-09-12T01:15:09.722532+0000","last_clean":"2024-09-12T01:15:09.722532+0000","last_became_active":"2024-09-12T00:02:50.063668+0000","last_became_peered":"2024-09-12T00:02:50.063668+0000","last_unstale":"2024-09-12T01:15:09.722532+0000","last_undegraded":"2024-09-12T01:15:09.722532+0000","last_fullsized":"2024-09-12T01:15:09.722532+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.340207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3770,"num_read_kb":3367,"num_write":1118,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'211","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.231252+0000","last_change":"2024-09-12T00:02:48.049176+0000","last_active":"2024-09-12T01:15:48.231252+0000","last_peered":"2024-09-12T01:15:48.231252+0000","last_clean":"2024-09-12T01:15:48.231252+0000","last_became_active":"2024-09-12T00:02:48.048851+0000","last_became_peered":"2024-09-12T00:02:48.048851+0000","last_unstale":"2024-09-12T01:15:48.231252+0000","last_undegraded":"2024-09-12T01:15:48.231252+0000","last_fullsized":"2024-09-12T01:15:48.231252+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:48.606466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":48639,"num_write":1072,"num_write_kb":41735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'811","reported_seq":2269,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.790333+0000","last_change":"2024-09-12T00:02:50.064007+0000","last_active":"2024-09-12T01:13:16.790333+0000","last_peered":"2024-09-12T01:13:16.790333+0000","last_clean":"2024-09-12T01:13:16.790333+0000","last_became_active":"2024-09-12T00:02:50.063615+0000","last_became_peered":"2024-09-12T00:02:50.063615+0000","last_unstale":"2024-09-12T01:13:16.790333+0000","last_undegraded":"2024-09-12T01:13:16.790333+0000","last_fullsized":"2024-09-12T01:13:16.790333+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:42.699086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3747,"num_read_kb":3346,"num_write":1068,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'283","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:35.241622+0000","last_change":"2024-09-12T00:02:48.047449+0000","last_active":"2024-09-12T01:12:35.241622+0000","last_peered":"2024-09-12T01:12:35.241622+0000","last_clean":"2024-09-12T01:12:35.241622+0000","last_became_active":"2024-09-12T00:02:48.046828+0000","last_became_peered":"2024-09-12T00:02:48.046828+0000","last_unstale":"2024-09-12T01:12:35.241622+0000","last_undegraded":"2024-09-12T01:12:35.241622+0000","last_fullsized":"2024-09-12T01:12:35.241622+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.302266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508432,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":715,"num_read_kb":12026,"num_write":1073,"num_write_kb":33544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'751","reported_seq":2258,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127565+0000","last_change":"2024-09-12T00:02:50.070132+0000","last_active":"2024-09-12T01:14:04.127565+0000","last_peered":"2024-09-12T01:14:04.127565+0000","last_clean":"2024-09-12T01:14:04.127565+0000","last_became_active":"2024-09-12T00:02:50.069844+0000","last_became_peered":"2024-09-12T00:02:50.069844+0000","last_unstale":"2024-09-12T01:14:04.127565+0000","last_undegraded":"2024-09-12T01:14:04.127565+0000","last_fullsized":"2024-09-12T01:14:04.127565+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:41.241382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3535,"num_read_kb":3209,"num_write":983,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'198","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154781+0000","last_change":"2024-09-12T00:02:48.046768+0000","last_active":"2024-09-12T01:15:48.154781+0000","last_peered":"2024-09-12T01:15:48.154781+0000","last_clean":"2024-09-12T01:15:48.154781+0000","last_became_active":"2024-09-12T00:02:48.046397+0000","last_became_peered":"2024-09-12T00:02:48.046397+0000","last_unstale":"2024-09-12T01:15:48.154781+0000","last_undegraded":"2024-09-12T01:15:48.154781+0000","last_fullsized":"2024-09-12T01:15:48.154781+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:20.073613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":38047,"num_write":933,"num_write_kb":24740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'852","reported_seq":2476,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.727874+0000","last_change":"2024-09-12T00:02:50.078323+0000","last_active":"2024-09-12T01:15:09.727874+0000","last_peered":"2024-09-12T01:15:09.727874+0000","last_clean":"2024-09-12T01:15:09.727874+0000","last_became_active":"2024-09-12T00:02:50.078018+0000","last_became_peered":"2024-09-12T00:02:50.078018+0000","last_unstale":"2024-09-12T01:15:09.727874+0000","last_undegraded":"2024-09-12T01:15:09.727874+0000","last_fullsized":"2024-09-12T01:15:09.727874+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.331727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4154,"num_read_kb":3748,"num_write":1160,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'171","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.248955+0000","last_change":"2024-09-12T00:02:48.049824+0000","last_active":"2024-09-12T01:15:48.248955+0000","last_peered":"2024-09-12T01:15:48.248955+0000","last_clean":"2024-09-12T01:15:48.248955+0000","last_became_active":"2024-09-12T00:02:48.047945+0000","last_became_peered":"2024-09-12T00:02:48.047945+0000","last_unstale":"2024-09-12T01:15:48.248955+0000","last_undegraded":"2024-09-12T01:15:48.248955+0000","last_fullsized":"2024-09-12T01:15:48.248955+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:07.052258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":324,"num_read_kb":25981,"num_write":829,"num_write_kb":31809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'530","reported_seq":2291,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.229835+0000","last_change":"2024-09-12T00:03:21.133800+0000","last_active":"2024-09-12T01:13:08.229835+0000","last_peered":"2024-09-12T01:13:08.229835+0000","last_clean":"2024-09-12T01:13:08.229835+0000","last_became_active":"2024-09-12T00:03:21.133475+0000","last_became_peered":"2024-09-12T00:03:21.133475+0000","last_unstale":"2024-09-12T01:13:08.229835+0000","last_undegraded":"2024-09-12T01:13:08.229835+0000","last_fullsized":"2024-09-12T01:13:08.229835+0000","mapping_epoch":39,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:12.713868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2976,"num_read_kb":2811,"num_write":614,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"267'233","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.059488+0000","last_change":"2024-09-12T00:02:48.049475+0000","last_active":"2024-09-12T01:15:48.059488+0000","last_peered":"2024-09-12T01:15:48.059488+0000","last_clean":"2024-09-12T01:15:48.059488+0000","last_became_active":"2024-09-12T00:02:48.049104+0000","last_became_peered":"2024-09-12T00:02:48.049104+0000","last_unstale":"2024-09-12T01:15:48.059488+0000","last_undegraded":"2024-09-12T01:15:48.059488+0000","last_fullsized":"2024-09-12T01:15:48.059488+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:30.113842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456491,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":11103,"num_write":1027,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'905","reported_seq":2496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127160+0000","last_change":"2024-09-12T00:02:50.069815+0000","last_active":"2024-09-12T01:14:04.127160+0000","last_peered":"2024-09-12T01:14:04.127160+0000","last_clean":"2024-09-12T01:14:04.127160+0000","last_became_active":"2024-09-12T00:02:50.069494+0000","last_became_peered":"2024-09-12T00:02:50.069494+0000","last_unstale":"2024-09-12T01:14:04.127160+0000","last_undegraded":"2024-09-12T01:14:04.127160+0000","last_fullsized":"2024-09-12T01:14:04.127160+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:18.542138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4355,"num_read_kb":3868,"num_write":1227,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'175","reported_seq":808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.202875+0000","last_change":"2024-09-12T00:04:21.225632+0000","last_active":"2024-09-12T01:15:48.202875+0000","last_peered":"2024-09-12T01:15:48.202875+0000","last_clean":"2024-09-12T01:15:48.202875+0000","last_became_active":"2024-09-12T00:04:21.225148+0000","last_became_peered":"2024-09-12T00:04:21.225148+0000","last_unstale":"2024-09-12T01:15:48.202875+0000","last_undegraded":"2024-09-12T01:15:48.202875+0000","last_fullsized":"2024-09-12T01:15:48.202875+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:11.655162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7533161,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":15843,"num_write":853,"num_write_kb":25246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'175","reported_seq":796,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.178507+0000","last_change":"2024-09-12T00:03:21.141209+0000","last_active":"2024-09-12T01:15:48.178507+0000","last_peered":"2024-09-12T01:15:48.178507+0000","last_clean":"2024-09-12T01:15:48.178507+0000","last_became_active":"2024-09-12T00:03:21.140871+0000","last_became_peered":"2024-09-12T00:03:21.140871+0000","last_unstale":"2024-09-12T01:15:48.178507+0000","last_undegraded":"2024-09-12T01:15:48.178507+0000","last_fullsized":"2024-09-12T01:15:48.178507+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.144813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2728229,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":36071,"num_write":841,"num_write_kb":27237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'834","reported_seq":2461,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749255+0000","last_change":"2024-09-12T00:02:50.076816+0000","last_active":"2024-09-12T01:15:09.749255+0000","last_peered":"2024-09-12T01:15:09.749255+0000","last_clean":"2024-09-12T01:15:09.749255+0000","last_became_active":"2024-09-12T00:02:50.076513+0000","last_became_peered":"2024-09-12T00:02:50.076513+0000","last_unstale":"2024-09-12T01:15:09.749255+0000","last_undegraded":"2024-09-12T01:15:09.749255+0000","last_fullsized":"2024-09-12T01:15:09.749255+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:15.455296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4096,"num_read_kb":3692,"num_write":1085,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'192","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.070415+0000","last_change":"2024-09-12T00:03:21.143529+0000","last_active":"2024-09-12T01:15:48.070415+0000","last_peered":"2024-09-12T01:15:48.070415+0000","last_clean":"2024-09-12T01:15:48.070415+0000","last_became_active":"2024-09-12T00:03:21.143160+0000","last_became_peered":"2024-09-12T00:03:21.143160+0000","last_unstale":"2024-09-12T01:15:48.070415+0000","last_undegraded":"2024-09-12T01:15:48.070415+0000","last_fullsized":"2024-09-12T01:15:48.070415+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:30.205902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242910,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":433,"num_read_kb":67077,"num_write":936,"num_write_kb":29840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.787449+0000","last_change":"2024-09-12T00:02:50.060740+0000","last_active":"2024-09-12T01:13:16.787449+0000","last_peered":"2024-09-12T01:13:16.787449+0000","last_clean":"2024-09-12T01:13:16.787449+0000","last_became_active":"2024-09-12T00:02:50.060457+0000","last_became_peered":"2024-09-12T00:02:50.060457+0000","last_unstale":"2024-09-12T01:13:16.787449+0000","last_undegraded":"2024-09-12T01:13:16.787449+0000","last_fullsized":"2024-09-12T01:13:16.787449+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:20.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2366,"num_read_kb":2209,"num_write":518,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5804,"num_read_kb":4071,"num_write":1920,"num_write_kb":818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1091,"ondisk_log_size":1091,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15077,"num_read_kb":14728,"num_write":16720,"num_write_kb":4882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":651,"ondisk_log_size":651,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":282194,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":10143,"num_read_kb":12207,"num_write":7073,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":44589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1856,"ondisk_log_size":1856,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212469,"num_read_kb":193861,"num_write":55201,"num_write_kb":18788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3960,"ondisk_log_size":3960,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":167873438,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":269,"num_whiteouts":0,"num_read":33148,"num_read_kb":2494324,"num_write":62055,"num_write_kb":2229204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":297668608,"data_stored":297668608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4483,"ondisk_log_size":4483,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24117248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":196988,"num_write":154,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41946250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":17865937,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":185720,"num_write":153,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510326,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364752,"kb_used_data":135040,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94007088,"statfs":{"total":96636764160,"available":96263258112,"internally_reserved":0,"allocated":138280960,"data_stored":136104256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510328,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255716,"kb_used_data":25968,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116124,"statfs":{"total":96636764160,"available":96374910976,"internally_reserved":0,"allocated":26591232,"data_stored":24503671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510330,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178644,"kb_used_data":80776,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94193196,"statfs":{"total":96636764160,"available":96453832704,"internally_reserved":0,"allocated":82714624,"data_stored":80531231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510325,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238316,"kb_used_data":157148,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94133524,"statfs":{"total":96636764160,"available":96392728576,"internally_reserved":0,"allocated":160919552,"data_stored":158845075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510324,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394924,"kb_used_data":165212,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93976916,"statfs":{"total":96636764160,"available":96232361984,"internally_reserved":0,"allocated":169177088,"data_stored":167005594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510322,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200192,"kb_used_data":124592,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94171648,"statfs":{"total":96636764160,"available":96431767552,"internally_reserved":0,"allocated":127582208,"data_stored":125513021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510323,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":219268,"kb_used_data":97888,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94152572,"statfs":{"total":96636764160,"available":96412233728,"internally_reserved":0,"allocated":100237312,"data_stored":98121776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575733,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423392,"kb_used_data":175696,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93948448,"statfs":{"total":96636764160,"available":96203210752,"internally_reserved":0,"allocated":179912704,"data_stored":177775047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":107704320,"data_stored":107704320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40677376,"data_stored":40677376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40558592,"data_stored":40558592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33263616,"data_stored":33263616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32108544,"data_stored":32108544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11759616,"data_stored":11759616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22204416,"data_stored":22204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":29720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":9053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41946250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:15:51.199 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:15:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:15:51.536 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":267,"fsid":"69d022f9-3312-45e8-ade0-937e32c87c81","created":"2024-09-12T00:02:15.117539+0000","modified":"2024-09-12T00:39:27.609511+0000","last_up_change":"2024-09-12T00:02:27.935891+0000","last_in_change":"2024-09-12T00:02:18.335955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:02:29.761733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:02:34.408783+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:02:46.023319+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:02:48.389390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:02:50.227364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:02:52.124577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:02:54.075066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:02:56.149701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:17:56.548788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:21:56.929727+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:22:01.333587+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T00:39:25.585037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"267","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"50767dc8-4c58-4765-bf1e-43835790e3b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6801","nonce":659192624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6803","nonce":659192624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6807","nonce":659192624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":659192624},{"type":"v1","addr":"172.21.15.33:6805","nonce":659192624}]},"public_addr":"172.21.15.33:6801/659192624","cluster_addr":"172.21.15.33:6803/659192624","heartbeat_back_addr":"172.21.15.33:6807/659192624","heartbeat_front_addr":"172.21.15.33:6805/659192624","state":["exists","up"]},{"osd":1,"uuid":"ad7bf85b-fc8a-4331-a594-3bbb3a650d65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6817","nonce":3131120991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6819","nonce":3131120991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6827","nonce":3131120991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":3131120991},{"type":"v1","addr":"172.21.15.33:6823","nonce":3131120991}]},"public_addr":"172.21.15.33:6817/3131120991","cluster_addr":"172.21.15.33:6819/3131120991","heartbeat_back_addr":"172.21.15.33:6827/3131120991","heartbeat_front_addr":"172.21.15.33:6823/3131120991","state":["exists","up"]},{"osd":2,"uuid":"d5b4c9d7-bfbb-42ee-91c1-6d5af5370e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6809","nonce":2826150194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6811","nonce":2826150194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6815","nonce":2826150194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2826150194},{"type":"v1","addr":"172.21.15.33:6813","nonce":2826150194}]},"public_addr":"172.21.15.33:6809/2826150194","cluster_addr":"172.21.15.33:6811/2826150194","heartbeat_back_addr":"172.21.15.33:6815/2826150194","heartbeat_front_addr":"172.21.15.33:6813/2826150194","state":["exists","up"]},{"osd":3,"uuid":"c0ee6c10-9d80-496d-8494-d28fda128cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6822","nonce":1243170537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6826","nonce":1243170537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6831","nonce":1243170537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1243170537},{"type":"v1","addr":"172.21.15.33:6829","nonce":1243170537}]},"public_addr":"172.21.15.33:6822/1243170537","cluster_addr":"172.21.15.33:6826/1243170537","heartbeat_back_addr":"172.21.15.33:6831/1243170537","heartbeat_front_addr":"172.21.15.33:6829/1243170537","state":["exists","up"]},{"osd":4,"uuid":"fc605b1b-c3c9-476c-a907-cc77fcef4ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6817","nonce":3412691534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6819","nonce":3412691534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6823","nonce":3412691534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3412691534},{"type":"v1","addr":"172.21.15.162:6821","nonce":3412691534}]},"public_addr":"172.21.15.162:6817/3412691534","cluster_addr":"172.21.15.162:6819/3412691534","heartbeat_back_addr":"172.21.15.162:6823/3412691534","heartbeat_front_addr":"172.21.15.162:6821/3412691534","state":["exists","up"]},{"osd":5,"uuid":"41f07182-4c0f-486e-a0a0-3405ba5d17f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6801","nonce":85576769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6803","nonce":85576769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6807","nonce":85576769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":85576769},{"type":"v1","addr":"172.21.15.162:6805","nonce":85576769}]},"public_addr":"172.21.15.162:6801/85576769","cluster_addr":"172.21.15.162:6803/85576769","heartbeat_back_addr":"172.21.15.162:6807/85576769","heartbeat_front_addr":"172.21.15.162:6805/85576769","state":["exists","up"]},{"osd":6,"uuid":"f260a4ee-a1f9-4def-809a-76b7bdf7ff24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6825","nonce":3281183708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6827","nonce":3281183708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6831","nonce":3281183708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3281183708},{"type":"v1","addr":"172.21.15.162:6829","nonce":3281183708}]},"public_addr":"172.21.15.162:6825/3281183708","cluster_addr":"172.21.15.162:6827/3281183708","heartbeat_back_addr":"172.21.15.162:6831/3281183708","heartbeat_front_addr":"172.21.15.162:6829/3281183708","state":["exists","up"]},{"osd":7,"uuid":"b71d17e0-f235-4987-aaf6-19d832f74366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6809","nonce":3549921352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6811","nonce":3549921352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6815","nonce":3549921352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3549921352},{"type":"v1","addr":"172.21.15.162:6813","nonce":3549921352}]},"public_addr":"172.21.15.162:6809/3549921352","cluster_addr":"172.21.15.162:6811/3549921352","heartbeat_back_addr":"172.21.15.162:6815/3549921352","heartbeat_front_addr":"172.21.15.162:6813/3549921352","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.134226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.677635+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.201058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.927137+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:25.075067+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.446938+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:25.141076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:02:24.654872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":6,"to":1}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":4,"to":2}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":0,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"67.1a","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:15:52.552 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:15:52.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:15:52.710 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T01:15:52.710 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:15:52.711 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T01:15:52.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:15:53.034 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:15:53.048 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:15:53.048 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:15:53.190 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T01:15:53.190 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:15:53.190 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T01:15:53.201 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:15:53.516 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:15:53.530 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:15:53.530 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:15:53.672 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T01:15:53.673 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:15:53.673 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T01:15:53.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:15:53.999 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:15:54.013 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:15:54.013 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:15:54.158 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T01:15:54.158 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:15:54.158 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T01:15:54.169 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:15:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:15:54.498 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:15:54.499 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:15:54.641 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T01:15:54.641 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:15:54.641 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T01:15:54.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:15:54.972 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:15:54.985 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:15:54.985 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T01:15:55.139 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:15:55.454 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:15:55.467 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:15:55.468 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:15:55.611 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T01:15:55.611 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:15:55.611 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T01:15:55.621 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:15:55.938 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:15:55.951 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:15:55.951 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:15:56.095 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-12T01:15:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:15:56.095 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-12T01:15:56.106 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:15:56.417 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:15:56.431 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:15:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:15:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T01:15:56.787 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":2465,"stamp":"2024-09-12T01:15:55.322291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":94005387,"num_objects":732,"num_object_clones":0,"num_object_copies":1697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":279494,"num_read_kb":3104975,"num_write":143492,"num_write_kb":2513046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14263,"ondisk_log_size":14263,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1470272,"kb_used_data":173804,"kb_used_omap":12,"kb_used_meta":1295987,"kb_avail":753504448,"statfs":{"total":773094113280,"available":771588554752,"internally_reserved":0,"allocated":177975296,"data_stored":161121310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1327091249},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-629805550,"num_objects":-275,"num_object_clones":0,"num_object_copies":-787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-275,"num_whiteouts":0,"num_read":600,"num_read_kb":667,"num_write":429,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004726"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502105+0000","last_change":"2024-09-12T00:39:26.642397+0000","last_active":"2024-09-12T01:11:58.502105+0000","last_peered":"2024-09-12T01:11:58.502105+0000","last_clean":"2024-09-12T01:11:58.502105+0000","last_became_active":"2024-09-12T00:39:26.642090+0000","last_became_peered":"2024-09-12T00:39:26.642090+0000","last_unstale":"2024-09-12T01:11:58.502105+0000","last_undegraded":"2024-09-12T01:11:58.502105+0000","last_fullsized":"2024-09-12T01:11:58.502105+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:54.374892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.502826+0000","last_change":"2024-09-12T00:22:02.424471+0000","last_active":"2024-09-12T01:12:03.502826+0000","last_peered":"2024-09-12T01:12:03.502826+0000","last_clean":"2024-09-12T01:12:03.502826+0000","last_became_active":"2024-09-12T00:22:02.423867+0000","last_became_peered":"2024-09-12T00:22:02.423867+0000","last_unstale":"2024-09-12T01:12:03.502826+0000","last_undegraded":"2024-09-12T01:12:03.502826+0000","last_fullsized":"2024-09-12T01:12:03.502826+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.940652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.246266+0000","last_change":"2024-09-12T00:21:58.336211+0000","last_active":"2024-09-12T01:14:28.246266+0000","last_peered":"2024-09-12T01:14:28.246266+0000","last_clean":"2024-09-12T01:14:28.246266+0000","last_became_active":"2024-09-12T00:21:58.335882+0000","last_became_peered":"2024-09-12T00:21:58.335882+0000","last_unstale":"2024-09-12T01:14:28.246266+0000","last_undegraded":"2024-09-12T01:14:28.246266+0000","last_fullsized":"2024-09-12T01:14:28.246266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:06.306799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":322,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'60","reported_seq":223,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238949+0000","last_change":"2024-09-12T00:17:58.354178+0000","last_active":"2024-09-12T01:12:10.238949+0000","last_peered":"2024-09-12T01:12:10.238949+0000","last_clean":"2024-09-12T01:12:10.238949+0000","last_became_active":"2024-09-12T00:17:58.353889+0000","last_became_peered":"2024-09-12T00:17:58.353889+0000","last_unstale":"2024-09-12T01:12:10.238949+0000","last_undegraded":"2024-09-12T01:12:10.238949+0000","last_fullsized":"2024-09-12T01:12:10.238949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.435699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":209,"num_write":117,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221699+0000","last_change":"2024-09-12T00:39:26.637541+0000","last_active":"2024-09-12T01:11:58.221699+0000","last_peered":"2024-09-12T01:11:58.221699+0000","last_clean":"2024-09-12T01:11:58.221699+0000","last_became_active":"2024-09-12T00:39:26.637244+0000","last_became_peered":"2024-09-12T00:39:26.637244+0000","last_unstale":"2024-09-12T01:11:58.221699+0000","last_undegraded":"2024-09-12T01:11:58.221699+0000","last_fullsized":"2024-09-12T01:11:58.221699+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:40.343211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.390545+0000","last_change":"2024-09-12T00:22:02.421061+0000","last_active":"2024-09-12T01:12:03.390545+0000","last_peered":"2024-09-12T01:12:03.390545+0000","last_clean":"2024-09-12T01:12:03.390545+0000","last_became_active":"2024-09-12T00:22:02.420774+0000","last_became_peered":"2024-09-12T00:22:02.420774+0000","last_unstale":"2024-09-12T01:12:03.390545+0000","last_undegraded":"2024-09-12T01:12:03.390545+0000","last_fullsized":"2024-09-12T01:12:03.390545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:12.865558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229707+0000","last_change":"2024-09-12T00:21:58.338086+0000","last_active":"2024-09-12T01:11:58.229707+0000","last_peered":"2024-09-12T01:11:58.229707+0000","last_clean":"2024-09-12T01:11:58.229707+0000","last_became_active":"2024-09-12T00:21:58.336723+0000","last_became_peered":"2024-09-12T00:21:58.336723+0000","last_unstale":"2024-09-12T01:11:58.229707+0000","last_undegraded":"2024-09-12T01:11:58.229707+0000","last_fullsized":"2024-09-12T01:11:58.229707+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:29.016179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.223001+0000","last_change":"2024-09-12T00:17:58.361616+0000","last_active":"2024-09-12T01:12:08.223001+0000","last_peered":"2024-09-12T01:12:08.223001+0000","last_clean":"2024-09-12T01:12:08.223001+0000","last_became_active":"2024-09-12T00:17:58.361306+0000","last_became_peered":"2024-09-12T00:17:58.361306+0000","last_unstale":"2024-09-12T01:12:08.223001+0000","last_undegraded":"2024-09-12T01:12:08.223001+0000","last_fullsized":"2024-09-12T01:12:08.223001+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:11.973986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618592+0000","last_change":"2024-09-12T00:39:26.625650+0000","last_active":"2024-09-12T01:13:18.618592+0000","last_peered":"2024-09-12T01:13:18.618592+0000","last_clean":"2024-09-12T01:13:18.618592+0000","last_became_active":"2024-09-12T00:39:26.625454+0000","last_became_peered":"2024-09-12T00:39:26.625454+0000","last_unstale":"2024-09-12T01:13:18.618592+0000","last_undegraded":"2024-09-12T01:13:18.618592+0000","last_fullsized":"2024-09-12T01:13:18.618592+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:07.891692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238405+0000","last_change":"2024-09-12T00:22:02.422000+0000","last_active":"2024-09-12T01:12:05.238405+0000","last_peered":"2024-09-12T01:12:05.238405+0000","last_clean":"2024-09-12T01:12:05.238405+0000","last_became_active":"2024-09-12T00:22:02.421689+0000","last_became_peered":"2024-09-12T00:22:02.421689+0000","last_unstale":"2024-09-12T01:12:05.238405+0000","last_undegraded":"2024-09-12T01:12:05.238405+0000","last_fullsized":"2024-09-12T01:12:05.238405+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:25.931614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222987+0000","last_change":"2024-09-12T00:21:58.333094+0000","last_active":"2024-09-12T01:12:08.222987+0000","last_peered":"2024-09-12T01:12:08.222987+0000","last_clean":"2024-09-12T01:12:08.222987+0000","last_became_active":"2024-09-12T00:21:58.332782+0000","last_became_peered":"2024-09-12T00:21:58.332782+0000","last_unstale":"2024-09-12T01:12:08.222987+0000","last_undegraded":"2024-09-12T01:12:08.222987+0000","last_fullsized":"2024-09-12T01:12:08.222987+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:03.474793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'34","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244636+0000","last_change":"2024-09-12T00:17:58.353482+0000","last_active":"2024-09-12T01:13:00.244636+0000","last_peered":"2024-09-12T01:13:00.244636+0000","last_clean":"2024-09-12T01:13:00.244636+0000","last_became_active":"2024-09-12T00:17:58.353045+0000","last_became_peered":"2024-09-12T00:17:58.353045+0000","last_unstale":"2024-09-12T01:13:00.244636+0000","last_undegraded":"2024-09-12T01:13:00.244636+0000","last_fullsized":"2024-09-12T01:13:00.244636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:52.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.237224+0000","last_change":"2024-09-12T00:39:26.637464+0000","last_active":"2024-09-12T01:13:23.237224+0000","last_peered":"2024-09-12T01:13:23.237224+0000","last_clean":"2024-09-12T01:13:23.237224+0000","last_became_active":"2024-09-12T00:39:26.637185+0000","last_became_peered":"2024-09-12T00:39:26.637185+0000","last_unstale":"2024-09-12T01:13:23.237224+0000","last_undegraded":"2024-09-12T01:13:23.237224+0000","last_fullsized":"2024-09-12T01:13:23.237224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:20.137461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449572+0000","last_change":"2024-09-12T00:22:02.428079+0000","last_active":"2024-09-12T01:12:08.449572+0000","last_peered":"2024-09-12T01:12:08.449572+0000","last_clean":"2024-09-12T01:12:08.449572+0000","last_became_active":"2024-09-12T00:22:02.427612+0000","last_became_peered":"2024-09-12T00:22:02.427612+0000","last_unstale":"2024-09-12T01:12:08.449572+0000","last_undegraded":"2024-09-12T01:12:08.449572+0000","last_fullsized":"2024-09-12T01:12:08.449572+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:46.790157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.389901+0000","last_change":"2024-09-12T00:21:58.335917+0000","last_active":"2024-09-12T01:11:58.389901+0000","last_peered":"2024-09-12T01:11:58.389901+0000","last_clean":"2024-09-12T01:11:58.389901+0000","last_became_active":"2024-09-12T00:21:58.335619+0000","last_became_peered":"2024-09-12T00:21:58.335619+0000","last_unstale":"2024-09-12T01:11:58.389901+0000","last_undegraded":"2024-09-12T01:11:58.389901+0000","last_fullsized":"2024-09-12T01:11:58.389901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.724726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455358+0000","last_change":"2024-09-12T00:17:58.356021+0000","last_active":"2024-09-12T01:12:58.455358+0000","last_peered":"2024-09-12T01:12:58.455358+0000","last_clean":"2024-09-12T01:12:58.455358+0000","last_became_active":"2024-09-12T00:17:58.355691+0000","last_became_peered":"2024-09-12T00:17:58.355691+0000","last_unstale":"2024-09-12T01:12:58.455358+0000","last_undegraded":"2024-09-12T01:12:58.455358+0000","last_fullsized":"2024-09-12T01:12:58.455358+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:23.027551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238400+0000","last_change":"2024-09-12T00:39:26.635830+0000","last_active":"2024-09-12T01:13:33.238400+0000","last_peered":"2024-09-12T01:13:33.238400+0000","last_clean":"2024-09-12T01:13:33.238400+0000","last_became_active":"2024-09-12T00:39:26.635537+0000","last_became_peered":"2024-09-12T00:39:26.635537+0000","last_unstale":"2024-09-12T01:13:33.238400+0000","last_undegraded":"2024-09-12T01:13:33.238400+0000","last_fullsized":"2024-09-12T01:13:33.238400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:16.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510161+0000","last_change":"2024-09-12T00:22:02.429586+0000","last_active":"2024-09-12T01:12:53.510161+0000","last_peered":"2024-09-12T01:12:53.510161+0000","last_clean":"2024-09-12T01:12:53.510161+0000","last_became_active":"2024-09-12T00:22:02.429230+0000","last_became_peered":"2024-09-12T00:22:02.429230+0000","last_unstale":"2024-09-12T01:12:53.510161+0000","last_undegraded":"2024-09-12T01:12:53.510161+0000","last_fullsized":"2024-09-12T01:12:53.510161+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:50.744822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.221802+0000","last_change":"2024-09-12T00:21:58.338788+0000","last_active":"2024-09-12T01:15:48.221802+0000","last_peered":"2024-09-12T01:15:48.221802+0000","last_clean":"2024-09-12T01:15:48.221802+0000","last_became_active":"2024-09-12T00:21:58.338021+0000","last_became_peered":"2024-09-12T00:21:58.338021+0000","last_unstale":"2024-09-12T01:15:48.221802+0000","last_undegraded":"2024-09-12T01:15:48.221802+0000","last_fullsized":"2024-09-12T01:15:48.221802+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:31.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'22","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455331+0000","last_change":"2024-09-12T00:17:58.358082+0000","last_active":"2024-09-12T01:12:58.455331+0000","last_peered":"2024-09-12T01:12:58.455331+0000","last_clean":"2024-09-12T01:12:58.455331+0000","last_became_active":"2024-09-12T00:17:58.357755+0000","last_became_peered":"2024-09-12T00:17:58.357755+0000","last_unstale":"2024-09-12T01:12:58.455331+0000","last_undegraded":"2024-09-12T01:12:58.455331+0000","last_fullsized":"2024-09-12T01:12:58.455331+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:17.853509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.235439+0000","last_change":"2024-09-12T00:39:26.631339+0000","last_active":"2024-09-12T01:12:48.235439+0000","last_peered":"2024-09-12T01:12:48.235439+0000","last_clean":"2024-09-12T01:12:48.235439+0000","last_became_active":"2024-09-12T00:39:26.630758+0000","last_became_peered":"2024-09-12T00:39:26.630758+0000","last_unstale":"2024-09-12T01:12:48.235439+0000","last_undegraded":"2024-09-12T01:12:48.235439+0000","last_fullsized":"2024-09-12T01:12:48.235439+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.184229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'5","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041261+0000","last_change":"2024-09-12T00:22:02.428161+0000","last_active":"2024-09-12T01:15:48.041261+0000","last_peered":"2024-09-12T01:15:48.041261+0000","last_clean":"2024-09-12T01:15:48.041261+0000","last_became_active":"2024-09-12T00:22:02.427863+0000","last_became_peered":"2024-09-12T00:22:02.427863+0000","last_unstale":"2024-09-12T01:15:48.041261+0000","last_undegraded":"2024-09-12T01:15:48.041261+0000","last_fullsized":"2024-09-12T01:15:48.041261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:46.107765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":40,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397371+0000","last_change":"2024-09-12T00:21:58.330893+0000","last_active":"2024-09-12T01:12:53.397371+0000","last_peered":"2024-09-12T01:12:53.397371+0000","last_clean":"2024-09-12T01:12:53.397371+0000","last_became_active":"2024-09-12T00:21:58.330308+0000","last_became_peered":"2024-09-12T00:21:58.330308+0000","last_unstale":"2024-09-12T01:12:53.397371+0000","last_undegraded":"2024-09-12T01:12:53.397371+0000","last_fullsized":"2024-09-12T01:12:53.397371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.864549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'33","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616030+0000","last_change":"2024-09-12T00:17:58.360675+0000","last_active":"2024-09-12T01:12:58.616030+0000","last_peered":"2024-09-12T01:12:58.616030+0000","last_clean":"2024-09-12T01:12:58.616030+0000","last_became_active":"2024-09-12T00:17:58.360394+0000","last_became_peered":"2024-09-12T00:17:58.360394+0000","last_unstale":"2024-09-12T01:12:58.616030+0000","last_undegraded":"2024-09-12T01:12:58.616030+0000","last_fullsized":"2024-09-12T01:12:58.616030+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:36.476994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":120,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391380+0000","last_change":"2024-09-12T00:39:26.638745+0000","last_active":"2024-09-12T01:11:58.391380+0000","last_peered":"2024-09-12T01:11:58.391380+0000","last_clean":"2024-09-12T01:11:58.391380+0000","last_became_active":"2024-09-12T00:39:26.638443+0000","last_became_peered":"2024-09-12T00:39:26.638443+0000","last_unstale":"2024-09-12T01:11:58.391380+0000","last_undegraded":"2024-09-12T01:11:58.391380+0000","last_fullsized":"2024-09-12T01:11:58.391380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:39.177058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"264'5","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608465+0000","last_change":"2024-09-12T00:22:02.420219+0000","last_active":"2024-09-12T01:12:03.608465+0000","last_peered":"2024-09-12T01:12:03.608465+0000","last_clean":"2024-09-12T01:12:03.608465+0000","last_became_active":"2024-09-12T00:22:02.419920+0000","last_became_peered":"2024-09-12T00:22:02.419920+0000","last_unstale":"2024-09-12T01:12:03.608465+0000","last_undegraded":"2024-09-12T01:12:03.608465+0000","last_fullsized":"2024-09-12T01:12:03.608465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.257546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6462,"num_write":5,"num_write_kb":6462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.057954+0000","last_change":"2024-09-12T00:21:58.334923+0000","last_active":"2024-09-12T01:15:48.057954+0000","last_peered":"2024-09-12T01:15:48.057954+0000","last_clean":"2024-09-12T01:15:48.057954+0000","last_became_active":"2024-09-12T00:21:58.334622+0000","last_became_peered":"2024-09-12T00:21:58.334622+0000","last_unstale":"2024-09-12T01:15:48.057954+0000","last_undegraded":"2024-09-12T01:15:48.057954+0000","last_fullsized":"2024-09-12T01:15:48.057954+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:27.246572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'18","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.233636+0000","last_change":"2024-09-12T00:17:58.362164+0000","last_active":"2024-09-12T01:11:25.233636+0000","last_peered":"2024-09-12T01:11:25.233636+0000","last_clean":"2024-09-12T01:11:25.233636+0000","last_became_active":"2024-09-12T00:17:58.361620+0000","last_became_peered":"2024-09-12T00:17:58.361620+0000","last_unstale":"2024-09-12T01:11:25.233636+0000","last_undegraded":"2024-09-12T01:11:25.233636+0000","last_fullsized":"2024-09-12T01:11:25.233636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:00.693430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391431+0000","last_change":"2024-09-12T00:39:26.643583+0000","last_active":"2024-09-12T01:11:58.391431+0000","last_peered":"2024-09-12T01:11:58.391431+0000","last_clean":"2024-09-12T01:11:58.391431+0000","last_became_active":"2024-09-12T00:39:26.643223+0000","last_became_peered":"2024-09-12T00:39:26.643223+0000","last_unstale":"2024-09-12T01:11:58.391431+0000","last_undegraded":"2024-09-12T01:11:58.391431+0000","last_fullsized":"2024-09-12T01:11:58.391431+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:18.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'5","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066478+0000","last_change":"2024-09-12T00:22:22.312042+0000","last_active":"2024-09-12T01:15:48.066478+0000","last_peered":"2024-09-12T01:15:48.066478+0000","last_clean":"2024-09-12T01:15:48.066478+0000","last_became_active":"2024-09-12T00:22:22.311701+0000","last_became_peered":"2024-09-12T00:22:22.311701+0000","last_unstale":"2024-09-12T01:15:48.066478+0000","last_undegraded":"2024-09-12T01:15:48.066478+0000","last_fullsized":"2024-09-12T01:15:48.066478+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.780165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":5,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237766+0000","last_change":"2024-09-12T00:21:58.339874+0000","last_active":"2024-09-12T01:12:00.237766+0000","last_peered":"2024-09-12T01:12:00.237766+0000","last_clean":"2024-09-12T01:12:00.237766+0000","last_became_active":"2024-09-12T00:21:58.339586+0000","last_became_peered":"2024-09-12T00:21:58.339586+0000","last_unstale":"2024-09-12T01:12:00.237766+0000","last_undegraded":"2024-09-12T01:12:00.237766+0000","last_fullsized":"2024-09-12T01:12:00.237766+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:27.131816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'26","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.223825+0000","last_change":"2024-09-12T00:17:58.352434+0000","last_active":"2024-09-12T01:11:08.223825+0000","last_peered":"2024-09-12T01:11:08.223825+0000","last_clean":"2024-09-12T01:11:08.223825+0000","last_became_active":"2024-09-12T00:17:58.352129+0000","last_became_peered":"2024-09-12T00:17:58.352129+0000","last_unstale":"2024-09-12T01:11:08.223825+0000","last_undegraded":"2024-09-12T01:11:08.223825+0000","last_fullsized":"2024-09-12T01:11:08.223825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:16.704935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230767+0000","last_change":"2024-09-12T00:39:26.636027+0000","last_active":"2024-09-12T01:12:08.230767+0000","last_peered":"2024-09-12T01:12:08.230767+0000","last_clean":"2024-09-12T01:12:08.230767+0000","last_became_active":"2024-09-12T00:39:26.635558+0000","last_became_peered":"2024-09-12T00:39:26.635558+0000","last_unstale":"2024-09-12T01:12:08.230767+0000","last_undegraded":"2024-09-12T01:12:08.230767+0000","last_fullsized":"2024-09-12T01:12:08.230767+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.105963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.252261+0000","last_change":"2024-09-12T00:22:02.427487+0000","last_active":"2024-09-12T01:15:13.252261+0000","last_peered":"2024-09-12T01:15:13.252261+0000","last_clean":"2024-09-12T01:15:13.252261+0000","last_became_active":"2024-09-12T00:22:02.427180+0000","last_became_peered":"2024-09-12T00:22:02.427180+0000","last_unstale":"2024-09-12T01:15:13.252261+0000","last_undegraded":"2024-09-12T01:15:13.252261+0000","last_fullsized":"2024-09-12T01:15:13.252261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:40.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.535314+0000","last_change":"2024-09-12T00:21:58.334729+0000","last_active":"2024-09-12T01:15:43.535314+0000","last_peered":"2024-09-12T01:15:43.535314+0000","last_clean":"2024-09-12T01:15:43.535314+0000","last_became_active":"2024-09-12T00:21:58.334446+0000","last_became_peered":"2024-09-12T00:21:58.334446+0000","last_unstale":"2024-09-12T01:15:43.535314+0000","last_undegraded":"2024-09-12T01:15:43.535314+0000","last_fullsized":"2024-09-12T01:15:43.535314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:37.568023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'14","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.232052+0000","last_change":"2024-09-12T00:17:58.360971+0000","last_active":"2024-09-12T01:11:10.232052+0000","last_peered":"2024-09-12T01:11:10.232052+0000","last_clean":"2024-09-12T01:11:10.232052+0000","last_became_active":"2024-09-12T00:17:58.360560+0000","last_became_peered":"2024-09-12T00:17:58.360560+0000","last_unstale":"2024-09-12T01:11:10.232052+0000","last_undegraded":"2024-09-12T01:11:10.232052+0000","last_fullsized":"2024-09-12T01:11:10.232052+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:20.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222918+0000","last_change":"2024-09-12T00:39:26.635643+0000","last_active":"2024-09-12T01:12:08.222918+0000","last_peered":"2024-09-12T01:12:08.222918+0000","last_clean":"2024-09-12T01:12:08.222918+0000","last_became_active":"2024-09-12T00:39:26.635359+0000","last_became_peered":"2024-09-12T00:39:26.635359+0000","last_unstale":"2024-09-12T01:12:08.222918+0000","last_undegraded":"2024-09-12T01:12:08.222918+0000","last_fullsized":"2024-09-12T01:12:08.222918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.949344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066730+0000","last_change":"2024-09-12T00:22:02.432403+0000","last_active":"2024-09-12T01:15:48.066730+0000","last_peered":"2024-09-12T01:15:48.066730+0000","last_clean":"2024-09-12T01:15:48.066730+0000","last_became_active":"2024-09-12T00:22:02.431994+0000","last_became_peered":"2024-09-12T00:22:02.431994+0000","last_unstale":"2024-09-12T01:15:48.066730+0000","last_undegraded":"2024-09-12T01:15:48.066730+0000","last_fullsized":"2024-09-12T01:15:48.066730+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.483552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397576+0000","last_change":"2024-09-12T00:21:58.327781+0000","last_active":"2024-09-12T01:12:43.397576+0000","last_peered":"2024-09-12T01:12:43.397576+0000","last_clean":"2024-09-12T01:12:43.397576+0000","last_became_active":"2024-09-12T00:21:58.327504+0000","last_became_peered":"2024-09-12T00:21:58.327504+0000","last_unstale":"2024-09-12T01:12:43.397576+0000","last_undegraded":"2024-09-12T01:12:43.397576+0000","last_fullsized":"2024-09-12T01:12:43.397576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:09.606355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'62","reported_seq":221,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.442193+0000","last_change":"2024-09-12T00:17:58.360373+0000","last_active":"2024-09-12T01:11:08.442193+0000","last_peered":"2024-09-12T01:11:08.442193+0000","last_clean":"2024-09-12T01:11:08.442193+0000","last_became_active":"2024-09-12T00:17:58.360095+0000","last_became_peered":"2024-09-12T00:17:58.360095+0000","last_unstale":"2024-09-12T01:11:08.442193+0000","last_undegraded":"2024-09-12T01:11:08.442193+0000","last_fullsized":"2024-09-12T01:11:08.442193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:39.437158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":213,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392762+0000","last_change":"2024-09-12T00:39:26.639982+0000","last_active":"2024-09-12T01:12:08.392762+0000","last_peered":"2024-09-12T01:12:08.392762+0000","last_clean":"2024-09-12T01:12:08.392762+0000","last_became_active":"2024-09-12T00:39:26.639681+0000","last_became_peered":"2024-09-12T00:39:26.639681+0000","last_unstale":"2024-09-12T01:12:08.392762+0000","last_undegraded":"2024-09-12T01:12:08.392762+0000","last_fullsized":"2024-09-12T01:12:08.392762+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:35.336644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.454200+0000","last_change":"2024-09-12T00:22:02.427581+0000","last_active":"2024-09-12T01:12:48.454200+0000","last_peered":"2024-09-12T01:12:48.454200+0000","last_clean":"2024-09-12T01:12:48.454200+0000","last_became_active":"2024-09-12T00:22:02.427285+0000","last_became_peered":"2024-09-12T00:22:02.427285+0000","last_unstale":"2024-09-12T01:12:48.454200+0000","last_undegraded":"2024-09-12T01:12:48.454200+0000","last_fullsized":"2024-09-12T01:12:48.454200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:22.119778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.227172+0000","last_change":"2024-09-12T00:21:58.335430+0000","last_active":"2024-09-12T01:12:43.227172+0000","last_peered":"2024-09-12T01:12:43.227172+0000","last_clean":"2024-09-12T01:12:43.227172+0000","last_became_active":"2024-09-12T00:21:58.335100+0000","last_became_peered":"2024-09-12T00:21:58.335100+0000","last_unstale":"2024-09-12T01:12:43.227172+0000","last_undegraded":"2024-09-12T01:12:43.227172+0000","last_fullsized":"2024-09-12T01:12:43.227172+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:24.939276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'91","reported_seq":369,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.216774+0000","last_change":"2024-09-12T00:17:58.350821+0000","last_active":"2024-09-12T01:11:08.216774+0000","last_peered":"2024-09-12T01:11:08.216774+0000","last_clean":"2024-09-12T01:11:08.216774+0000","last_became_active":"2024-09-12T00:17:58.350522+0000","last_became_peered":"2024-09-12T00:17:58.350522+0000","last_unstale":"2024-09-12T01:11:08.216774+0000","last_undegraded":"2024-09-12T01:11:08.216774+0000","last_fullsized":"2024-09-12T01:11:08.216774+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:17.821787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":413,"num_write":129,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503487+0000","last_change":"2024-09-12T00:39:26.642765+0000","last_active":"2024-09-12T01:12:08.503487+0000","last_peered":"2024-09-12T01:12:08.503487+0000","last_clean":"2024-09-12T01:12:08.503487+0000","last_became_active":"2024-09-12T00:39:26.642486+0000","last_became_peered":"2024-09-12T00:39:26.642486+0000","last_unstale":"2024-09-12T01:12:08.503487+0000","last_undegraded":"2024-09-12T01:12:08.503487+0000","last_fullsized":"2024-09-12T01:12:08.503487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:37.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396598+0000","last_change":"2024-09-12T00:22:02.418272+0000","last_active":"2024-09-12T01:12:48.396598+0000","last_peered":"2024-09-12T01:12:48.396598+0000","last_clean":"2024-09-12T01:12:48.396598+0000","last_became_active":"2024-09-12T00:22:02.417518+0000","last_became_peered":"2024-09-12T00:22:02.417518+0000","last_unstale":"2024-09-12T01:12:48.396598+0000","last_undegraded":"2024-09-12T01:12:48.396598+0000","last_fullsized":"2024-09-12T01:12:48.396598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.931899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.211527+0000","last_change":"2024-09-12T00:21:58.337365+0000","last_active":"2024-09-12T01:15:48.211527+0000","last_peered":"2024-09-12T01:15:48.211527+0000","last_clean":"2024-09-12T01:15:48.211527+0000","last_became_active":"2024-09-12T00:21:58.337079+0000","last_became_peered":"2024-09-12T00:21:58.337079+0000","last_unstale":"2024-09-12T01:15:48.211527+0000","last_undegraded":"2024-09-12T01:15:48.211527+0000","last_fullsized":"2024-09-12T01:15:48.211527+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.875541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24618,"num_write":22,"num_write_kb":14376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'26","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390038+0000","last_change":"2024-09-12T00:17:58.360573+0000","last_active":"2024-09-12T01:11:48.390038+0000","last_peered":"2024-09-12T01:11:48.390038+0000","last_clean":"2024-09-12T01:11:48.390038+0000","last_became_active":"2024-09-12T00:17:58.360141+0000","last_became_peered":"2024-09-12T00:17:58.360141+0000","last_unstale":"2024-09-12T01:11:48.390038+0000","last_undegraded":"2024-09-12T01:11:48.390038+0000","last_fullsized":"2024-09-12T01:11:48.390038+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.883700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236768+0000","last_change":"2024-09-12T00:39:26.636792+0000","last_active":"2024-09-12T01:13:18.236768+0000","last_peered":"2024-09-12T01:13:18.236768+0000","last_clean":"2024-09-12T01:13:18.236768+0000","last_became_active":"2024-09-12T00:39:26.636434+0000","last_became_peered":"2024-09-12T00:39:26.636434+0000","last_unstale":"2024-09-12T01:13:18.236768+0000","last_undegraded":"2024-09-12T01:13:18.236768+0000","last_fullsized":"2024-09-12T01:13:18.236768+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:17.120295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256725+0000","last_change":"2024-09-12T00:22:02.420813+0000","last_active":"2024-09-12T01:15:43.256725+0000","last_peered":"2024-09-12T01:15:43.256725+0000","last_clean":"2024-09-12T01:15:43.256725+0000","last_became_active":"2024-09-12T00:22:02.420528+0000","last_became_peered":"2024-09-12T00:22:02.420528+0000","last_unstale":"2024-09-12T01:15:43.256725+0000","last_undegraded":"2024-09-12T01:15:43.256725+0000","last_fullsized":"2024-09-12T01:15:43.256725+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:36.557751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:38.274384+0000","last_change":"2024-09-12T00:21:58.337490+0000","last_active":"2024-09-12T01:15:38.274384+0000","last_peered":"2024-09-12T01:15:38.274384+0000","last_clean":"2024-09-12T01:15:38.274384+0000","last_became_active":"2024-09-12T00:21:58.337215+0000","last_became_peered":"2024-09-12T00:21:58.337215+0000","last_unstale":"2024-09-12T01:15:38.274384+0000","last_undegraded":"2024-09-12T01:15:38.274384+0000","last_fullsized":"2024-09-12T01:15:38.274384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.089070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.388739+0000","last_change":"2024-09-12T00:17:58.360965+0000","last_active":"2024-09-12T01:11:38.388739+0000","last_peered":"2024-09-12T01:11:38.388739+0000","last_clean":"2024-09-12T01:11:38.388739+0000","last_became_active":"2024-09-12T00:17:58.360592+0000","last_became_peered":"2024-09-12T00:17:58.360592+0000","last_unstale":"2024-09-12T01:11:38.388739+0000","last_undegraded":"2024-09-12T01:11:38.388739+0000","last_fullsized":"2024-09-12T01:11:38.388739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:45.213272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.247005+0000","last_change":"2024-09-12T00:39:26.641706+0000","last_active":"2024-09-12T01:13:20.247005+0000","last_peered":"2024-09-12T01:13:20.247005+0000","last_clean":"2024-09-12T01:13:20.247005+0000","last_became_active":"2024-09-12T00:39:26.641432+0000","last_became_peered":"2024-09-12T00:39:26.641432+0000","last_unstale":"2024-09-12T01:13:20.247005+0000","last_undegraded":"2024-09-12T01:13:20.247005+0000","last_fullsized":"2024-09-12T01:13:20.247005+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.345745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.239133+0000","last_change":"2024-09-12T00:22:02.423461+0000","last_active":"2024-09-12T01:13:23.239133+0000","last_peered":"2024-09-12T01:13:23.239133+0000","last_clean":"2024-09-12T01:13:23.239133+0000","last_became_active":"2024-09-12T00:22:02.423012+0000","last_became_peered":"2024-09-12T00:22:02.423012+0000","last_unstale":"2024-09-12T01:13:23.239133+0000","last_undegraded":"2024-09-12T01:13:23.239133+0000","last_fullsized":"2024-09-12T01:13:23.239133+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:14.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236682+0000","last_change":"2024-09-12T00:21:58.334875+0000","last_active":"2024-09-12T01:13:18.236682+0000","last_peered":"2024-09-12T01:13:18.236682+0000","last_clean":"2024-09-12T01:13:18.236682+0000","last_became_active":"2024-09-12T00:21:58.334493+0000","last_became_peered":"2024-09-12T00:21:58.334493+0000","last_unstale":"2024-09-12T01:13:18.236682+0000","last_undegraded":"2024-09-12T01:13:18.236682+0000","last_fullsized":"2024-09-12T01:13:18.236682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:46.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'39","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235549+0000","last_change":"2024-09-12T00:17:58.355241+0000","last_active":"2024-09-12T01:11:40.235549+0000","last_peered":"2024-09-12T01:11:40.235549+0000","last_clean":"2024-09-12T01:11:40.235549+0000","last_became_active":"2024-09-12T00:17:58.354989+0000","last_became_peered":"2024-09-12T00:17:58.354989+0000","last_unstale":"2024-09-12T01:11:40.235549+0000","last_undegraded":"2024-09-12T01:11:40.235549+0000","last_fullsized":"2024-09-12T01:11:40.235549+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:24.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":70,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240008+0000","last_change":"2024-09-12T00:39:26.630455+0000","last_active":"2024-09-12T01:12:20.240008+0000","last_peered":"2024-09-12T01:12:20.240008+0000","last_clean":"2024-09-12T01:12:20.240008+0000","last_became_active":"2024-09-12T00:39:26.627899+0000","last_became_peered":"2024-09-12T00:39:26.627899+0000","last_unstale":"2024-09-12T01:12:20.240008+0000","last_undegraded":"2024-09-12T01:12:20.240008+0000","last_fullsized":"2024-09-12T01:12:20.240008+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:19.704293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256860+0000","last_change":"2024-09-12T00:22:02.428036+0000","last_active":"2024-09-12T01:15:43.256860+0000","last_peered":"2024-09-12T01:15:43.256860+0000","last_clean":"2024-09-12T01:15:43.256860+0000","last_became_active":"2024-09-12T00:22:02.427322+0000","last_became_peered":"2024-09-12T00:22:02.427322+0000","last_unstale":"2024-09-12T01:15:43.256860+0000","last_undegraded":"2024-09-12T01:15:43.256860+0000","last_fullsized":"2024-09-12T01:15:43.256860+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:40.144405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618639+0000","last_change":"2024-09-12T00:21:58.329454+0000","last_active":"2024-09-12T01:13:18.618639+0000","last_peered":"2024-09-12T01:13:18.618639+0000","last_clean":"2024-09-12T01:13:18.618639+0000","last_became_active":"2024-09-12T00:21:58.329166+0000","last_became_peered":"2024-09-12T00:21:58.329166+0000","last_unstale":"2024-09-12T01:13:18.618639+0000","last_undegraded":"2024-09-12T01:13:18.618639+0000","last_fullsized":"2024-09-12T01:13:18.618639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:00.444000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'42","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386895+0000","last_change":"2024-09-12T00:17:58.355842+0000","last_active":"2024-09-12T01:11:38.386895+0000","last_peered":"2024-09-12T01:11:38.386895+0000","last_clean":"2024-09-12T01:11:38.386895+0000","last_became_active":"2024-09-12T00:17:58.355530+0000","last_became_peered":"2024-09-12T00:17:58.355530+0000","last_unstale":"2024-09-12T01:11:38.386895+0000","last_undegraded":"2024-09-12T01:11:38.386895+0000","last_fullsized":"2024-09-12T01:11:38.386895+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:00.979655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":155,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236747+0000","last_change":"2024-09-12T00:39:26.636645+0000","last_active":"2024-09-12T01:13:18.236747+0000","last_peered":"2024-09-12T01:13:18.236747+0000","last_clean":"2024-09-12T01:13:18.236747+0000","last_became_active":"2024-09-12T00:39:26.635996+0000","last_became_peered":"2024-09-12T00:39:26.635996+0000","last_unstale":"2024-09-12T01:13:18.236747+0000","last_undegraded":"2024-09-12T01:13:18.236747+0000","last_fullsized":"2024-09-12T01:13:18.236747+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:54.401173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.619395+0000","last_change":"2024-09-12T00:22:02.424107+0000","last_active":"2024-09-12T01:13:23.619395+0000","last_peered":"2024-09-12T01:13:23.619395+0000","last_clean":"2024-09-12T01:13:23.619395+0000","last_became_active":"2024-09-12T00:22:02.423766+0000","last_became_peered":"2024-09-12T00:22:02.423766+0000","last_unstale":"2024-09-12T01:13:23.619395+0000","last_undegraded":"2024-09-12T01:13:23.619395+0000","last_fullsized":"2024-09-12T01:13:23.619395+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:45.304079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.514151+0000","last_change":"2024-09-12T00:21:58.334763+0000","last_active":"2024-09-12T01:13:18.514151+0000","last_peered":"2024-09-12T01:13:18.514151+0000","last_clean":"2024-09-12T01:13:18.514151+0000","last_became_active":"2024-09-12T00:21:58.334482+0000","last_became_peered":"2024-09-12T00:21:58.334482+0000","last_unstale":"2024-09-12T01:13:18.514151+0000","last_undegraded":"2024-09-12T01:13:18.514151+0000","last_fullsized":"2024-09-12T01:13:18.514151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.615431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'8","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.445588+0000","last_change":"2024-09-12T00:17:58.357504+0000","last_active":"2024-09-12T01:11:38.445588+0000","last_peered":"2024-09-12T01:11:38.445588+0000","last_clean":"2024-09-12T01:11:38.445588+0000","last_became_active":"2024-09-12T00:17:58.357226+0000","last_became_peered":"2024-09-12T00:17:58.357226+0000","last_unstale":"2024-09-12T01:11:38.445588+0000","last_undegraded":"2024-09-12T01:11:38.445588+0000","last_fullsized":"2024-09-12T01:11:38.445588+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.150821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222890+0000","last_change":"2024-09-12T00:39:26.638504+0000","last_active":"2024-09-12T01:12:08.222890+0000","last_peered":"2024-09-12T01:12:08.222890+0000","last_clean":"2024-09-12T01:12:08.222890+0000","last_became_active":"2024-09-12T00:39:26.638202+0000","last_became_peered":"2024-09-12T00:39:26.638202+0000","last_unstale":"2024-09-12T01:12:08.222890+0000","last_undegraded":"2024-09-12T01:12:08.222890+0000","last_fullsized":"2024-09-12T01:12:08.222890+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:29.584845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.445007+0000","last_change":"2024-09-12T00:22:02.428671+0000","last_active":"2024-09-12T01:11:33.445007+0000","last_peered":"2024-09-12T01:11:33.445007+0000","last_clean":"2024-09-12T01:11:33.445007+0000","last_became_active":"2024-09-12T00:22:02.427762+0000","last_became_peered":"2024-09-12T00:22:02.427762+0000","last_unstale":"2024-09-12T01:11:33.445007+0000","last_undegraded":"2024-09-12T01:11:33.445007+0000","last_fullsized":"2024-09-12T01:11:33.445007+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:44.251003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"267'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010703+0000","last_change":"2024-09-12T00:21:58.338414+0000","last_active":"2024-09-12T01:15:48.010703+0000","last_peered":"2024-09-12T01:15:48.010703+0000","last_clean":"2024-09-12T01:15:48.010703+0000","last_became_active":"2024-09-12T00:21:58.338104+0000","last_became_peered":"2024-09-12T00:21:58.338104+0000","last_unstale":"2024-09-12T01:15:48.010703+0000","last_undegraded":"2024-09-12T01:15:48.010703+0000","last_fullsized":"2024-09-12T01:15:48.010703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:51.139680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10244,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'33","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.448982+0000","last_change":"2024-09-12T00:17:58.352171+0000","last_active":"2024-09-12T01:12:03.448982+0000","last_peered":"2024-09-12T01:12:03.448982+0000","last_clean":"2024-09-12T01:12:03.448982+0000","last_became_active":"2024-09-12T00:17:58.351876+0000","last_became_peered":"2024-09-12T00:17:58.351876+0000","last_unstale":"2024-09-12T01:12:03.448982+0000","last_undegraded":"2024-09-12T01:12:03.448982+0000","last_fullsized":"2024-09-12T01:12:03.448982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.992607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":110,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401591+0000","last_change":"2024-09-12T00:39:26.640188+0000","last_active":"2024-09-12T01:13:13.401591+0000","last_peered":"2024-09-12T01:13:13.401591+0000","last_clean":"2024-09-12T01:13:13.401591+0000","last_became_active":"2024-09-12T00:39:26.639704+0000","last_became_peered":"2024-09-12T00:39:26.639704+0000","last_unstale":"2024-09-12T01:13:13.401591+0000","last_undegraded":"2024-09-12T01:13:13.401591+0000","last_fullsized":"2024-09-12T01:13:13.401591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.680724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'6","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.009468+0000","last_change":"2024-09-12T00:22:02.430308+0000","last_active":"2024-09-12T01:15:48.009468+0000","last_peered":"2024-09-12T01:15:48.009468+0000","last_clean":"2024-09-12T01:15:48.009468+0000","last_became_active":"2024-09-12T00:22:02.430034+0000","last_became_peered":"2024-09-12T00:22:02.430034+0000","last_unstale":"2024-09-12T01:15:48.009468+0000","last_undegraded":"2024-09-12T01:15:48.009468+0000","last_fullsized":"2024-09-12T01:15:48.009468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.194625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.057529+0000","last_change":"2024-09-12T00:21:58.333427+0000","last_active":"2024-09-12T01:15:48.057529+0000","last_peered":"2024-09-12T01:15:48.057529+0000","last_clean":"2024-09-12T01:15:48.057529+0000","last_became_active":"2024-09-12T00:21:58.333135+0000","last_became_peered":"2024-09-12T00:21:58.333135+0000","last_unstale":"2024-09-12T01:15:48.057529+0000","last_undegraded":"2024-09-12T01:15:48.057529+0000","last_fullsized":"2024-09-12T01:15:48.057529+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:11.164534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'34","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502186+0000","last_change":"2024-09-12T00:17:58.360392+0000","last_active":"2024-09-12T01:11:58.502186+0000","last_peered":"2024-09-12T01:11:58.502186+0000","last_clean":"2024-09-12T01:11:58.502186+0000","last_became_active":"2024-09-12T00:17:58.360064+0000","last_became_peered":"2024-09-12T00:17:58.360064+0000","last_unstale":"2024-09-12T01:11:58.502186+0000","last_undegraded":"2024-09-12T01:11:58.502186+0000","last_fullsized":"2024-09-12T01:11:58.502186+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:06.356739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":114,"num_write":67,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607743+0000","last_change":"2024-09-12T00:39:26.620334+0000","last_active":"2024-09-12T01:11:58.607743+0000","last_peered":"2024-09-12T01:11:58.607743+0000","last_clean":"2024-09-12T01:11:58.607743+0000","last_became_active":"2024-09-12T00:39:26.620012+0000","last_became_peered":"2024-09-12T00:39:26.620012+0000","last_unstale":"2024-09-12T01:11:58.607743+0000","last_undegraded":"2024-09-12T01:11:58.607743+0000","last_fullsized":"2024-09-12T01:11:58.607743+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.575760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.228663+0000","last_change":"2024-09-12T00:22:02.420815+0000","last_active":"2024-09-12T01:11:48.228663+0000","last_peered":"2024-09-12T01:11:48.228663+0000","last_clean":"2024-09-12T01:11:48.228663+0000","last_became_active":"2024-09-12T00:22:02.420536+0000","last_became_peered":"2024-09-12T00:22:02.420536+0000","last_unstale":"2024-09-12T01:11:48.228663+0000","last_undegraded":"2024-09-12T01:11:48.228663+0000","last_fullsized":"2024-09-12T01:11:48.228663+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:29.069188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.234276+0000","last_change":"2024-09-12T00:21:58.339677+0000","last_active":"2024-09-12T01:11:30.234276+0000","last_peered":"2024-09-12T01:11:30.234276+0000","last_clean":"2024-09-12T01:11:30.234276+0000","last_became_active":"2024-09-12T00:21:58.339390+0000","last_became_peered":"2024-09-12T00:21:58.339390+0000","last_unstale":"2024-09-12T01:11:30.234276+0000","last_undegraded":"2024-09-12T01:11:30.234276+0000","last_fullsized":"2024-09-12T01:11:30.234276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:52.122856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'22","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607816+0000","last_change":"2024-09-12T00:17:58.355891+0000","last_active":"2024-09-12T01:11:58.607816+0000","last_peered":"2024-09-12T01:11:58.607816+0000","last_clean":"2024-09-12T01:11:58.607816+0000","last_became_active":"2024-09-12T00:17:58.355602+0000","last_became_peered":"2024-09-12T00:17:58.355602+0000","last_unstale":"2024-09-12T01:11:58.607816+0000","last_undegraded":"2024-09-12T01:11:58.607816+0000","last_fullsized":"2024-09-12T01:11:58.607816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:26.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391317+0000","last_change":"2024-09-12T00:39:26.644546+0000","last_active":"2024-09-12T01:11:58.391317+0000","last_peered":"2024-09-12T01:11:58.391317+0000","last_clean":"2024-09-12T01:11:58.391317+0000","last_became_active":"2024-09-12T00:39:26.644190+0000","last_became_peered":"2024-09-12T00:39:26.644190+0000","last_unstale":"2024-09-12T01:11:58.391317+0000","last_undegraded":"2024-09-12T01:11:58.391317+0000","last_fullsized":"2024-09-12T01:11:58.391317+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:28.896406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.240192+0000","last_change":"2024-09-12T00:22:02.429622+0000","last_active":"2024-09-12T01:13:48.240192+0000","last_peered":"2024-09-12T01:13:48.240192+0000","last_clean":"2024-09-12T01:13:48.240192+0000","last_became_active":"2024-09-12T00:22:02.429289+0000","last_became_peered":"2024-09-12T00:22:02.429289+0000","last_unstale":"2024-09-12T01:13:48.240192+0000","last_undegraded":"2024-09-12T01:13:48.240192+0000","last_fullsized":"2024-09-12T01:13:48.240192+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:57.498730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.228080+0000","last_change":"2024-09-12T00:21:58.334628+0000","last_active":"2024-09-12T01:11:43.228080+0000","last_peered":"2024-09-12T01:11:43.228080+0000","last_clean":"2024-09-12T01:11:43.228080+0000","last_became_active":"2024-09-12T00:21:58.334362+0000","last_became_peered":"2024-09-12T00:21:58.334362+0000","last_unstale":"2024-09-12T01:11:43.228080+0000","last_undegraded":"2024-09-12T01:11:43.228080+0000","last_fullsized":"2024-09-12T01:11:43.228080+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:03.057103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'50","reported_seq":198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221741+0000","last_change":"2024-09-12T00:17:58.353550+0000","last_active":"2024-09-12T01:11:58.221741+0000","last_peered":"2024-09-12T01:11:58.221741+0000","last_clean":"2024-09-12T01:11:58.221741+0000","last_became_active":"2024-09-12T00:17:58.353253+0000","last_became_peered":"2024-09-12T00:17:58.353253+0000","last_unstale":"2024-09-12T01:11:58.221741+0000","last_undegraded":"2024-09-12T01:11:58.221741+0000","last_fullsized":"2024-09-12T01:11:58.221741+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":79,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.457321+0000","last_change":"2024-09-12T00:39:26.636163+0000","last_active":"2024-09-12T01:13:13.457321+0000","last_peered":"2024-09-12T01:13:13.457321+0000","last_clean":"2024-09-12T01:13:13.457321+0000","last_became_active":"2024-09-12T00:39:26.633295+0000","last_became_peered":"2024-09-12T00:39:26.633295+0000","last_unstale":"2024-09-12T01:13:13.457321+0000","last_undegraded":"2024-09-12T01:13:13.457321+0000","last_fullsized":"2024-09-12T01:13:13.457321+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:58.692850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.389134+0000","last_change":"2024-09-12T00:22:02.429406+0000","last_active":"2024-09-12T01:11:53.389134+0000","last_peered":"2024-09-12T01:11:53.389134+0000","last_clean":"2024-09-12T01:11:53.389134+0000","last_became_active":"2024-09-12T00:22:02.429088+0000","last_became_peered":"2024-09-12T00:22:02.429088+0000","last_unstale":"2024-09-12T01:11:53.389134+0000","last_undegraded":"2024-09-12T01:11:53.389134+0000","last_fullsized":"2024-09-12T01:11:53.389134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:06.418067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.236622+0000","last_change":"2024-09-12T00:21:58.338881+0000","last_active":"2024-09-12T01:11:50.236622+0000","last_peered":"2024-09-12T01:11:50.236622+0000","last_clean":"2024-09-12T01:11:50.236622+0000","last_became_active":"2024-09-12T00:21:58.338592+0000","last_became_peered":"2024-09-12T00:21:58.338592+0000","last_unstale":"2024-09-12T01:11:50.236622+0000","last_undegraded":"2024-09-12T01:11:50.236622+0000","last_fullsized":"2024-09-12T01:11:50.236622+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:24.783440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'20","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237791+0000","last_change":"2024-09-12T00:17:58.357513+0000","last_active":"2024-09-12T01:12:00.237791+0000","last_peered":"2024-09-12T01:12:00.237791+0000","last_clean":"2024-09-12T01:12:00.237791+0000","last_became_active":"2024-09-12T00:17:58.357219+0000","last_became_peered":"2024-09-12T00:17:58.357219+0000","last_unstale":"2024-09-12T01:12:00.237791+0000","last_undegraded":"2024-09-12T01:12:00.237791+0000","last_fullsized":"2024-09-12T01:12:00.237791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:44.097143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":69,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.402289+0000","last_change":"2024-09-12T00:39:26.643775+0000","last_active":"2024-09-12T01:13:18.402289+0000","last_peered":"2024-09-12T01:13:18.402289+0000","last_clean":"2024-09-12T01:13:18.402289+0000","last_became_active":"2024-09-12T00:39:26.643469+0000","last_became_peered":"2024-09-12T00:39:26.643469+0000","last_unstale":"2024-09-12T01:13:18.402289+0000","last_undegraded":"2024-09-12T01:13:18.402289+0000","last_fullsized":"2024-09-12T01:13:18.402289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:16.398681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390670+0000","last_change":"2024-09-12T00:22:02.422788+0000","last_active":"2024-09-12T01:11:53.390670+0000","last_peered":"2024-09-12T01:11:53.390670+0000","last_clean":"2024-09-12T01:11:53.390670+0000","last_became_active":"2024-09-12T00:22:02.422532+0000","last_became_peered":"2024-09-12T00:22:02.422532+0000","last_unstale":"2024-09-12T01:11:53.390670+0000","last_undegraded":"2024-09-12T01:11:53.390670+0000","last_fullsized":"2024-09-12T01:11:53.390670+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.940961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'3","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.242873+0000","last_change":"2024-09-12T00:21:58.333014+0000","last_active":"2024-09-12T01:13:58.242873+0000","last_peered":"2024-09-12T01:13:58.242873+0000","last_clean":"2024-09-12T01:13:58.242873+0000","last_became_active":"2024-09-12T00:21:58.332715+0000","last_became_peered":"2024-09-12T00:21:58.332715+0000","last_unstale":"2024-09-12T01:13:58.242873+0000","last_undegraded":"2024-09-12T01:13:58.242873+0000","last_fullsized":"2024-09-12T01:13:58.242873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.043720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'12","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394261+0000","last_change":"2024-09-12T00:17:58.348284+0000","last_active":"2024-09-12T01:12:18.394261+0000","last_peered":"2024-09-12T01:12:18.394261+0000","last_clean":"2024-09-12T01:12:18.394261+0000","last_became_active":"2024-09-12T00:17:58.347709+0000","last_became_peered":"2024-09-12T00:17:58.347709+0000","last_unstale":"2024-09-12T01:12:18.394261+0000","last_undegraded":"2024-09-12T01:12:18.394261+0000","last_fullsized":"2024-09-12T01:12:18.394261+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:50.010174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401624+0000","last_change":"2024-09-12T00:39:26.639353+0000","last_active":"2024-09-12T01:13:13.401624+0000","last_peered":"2024-09-12T01:13:13.401624+0000","last_clean":"2024-09-12T01:13:13.401624+0000","last_became_active":"2024-09-12T00:39:26.639094+0000","last_became_peered":"2024-09-12T00:39:26.639094+0000","last_unstale":"2024-09-12T01:13:13.401624+0000","last_undegraded":"2024-09-12T01:13:13.401624+0000","last_fullsized":"2024-09-12T01:13:13.401624+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.226749+0000","last_change":"2024-09-12T00:22:02.423237+0000","last_active":"2024-09-12T01:11:33.226749+0000","last_peered":"2024-09-12T01:11:33.226749+0000","last_clean":"2024-09-12T01:11:33.226749+0000","last_became_active":"2024-09-12T00:22:02.422922+0000","last_became_peered":"2024-09-12T00:22:02.422922+0000","last_unstale":"2024-09-12T01:11:33.226749+0000","last_undegraded":"2024-09-12T01:11:33.226749+0000","last_fullsized":"2024-09-12T01:11:33.226749+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:06.357213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238314+0000","last_change":"2024-09-12T00:21:58.341237+0000","last_active":"2024-09-12T01:12:05.238314+0000","last_peered":"2024-09-12T01:12:05.238314+0000","last_clean":"2024-09-12T01:12:05.238314+0000","last_became_active":"2024-09-12T00:21:58.340910+0000","last_became_peered":"2024-09-12T00:21:58.340910+0000","last_unstale":"2024-09-12T01:12:05.238314+0000","last_undegraded":"2024-09-12T01:12:05.238314+0000","last_fullsized":"2024-09-12T01:12:05.238314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:12.245684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'59","reported_seq":219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449466+0000","last_change":"2024-09-12T00:17:58.351895+0000","last_active":"2024-09-12T01:12:08.449466+0000","last_peered":"2024-09-12T01:12:08.449466+0000","last_clean":"2024-09-12T01:12:08.449466+0000","last_became_active":"2024-09-12T00:17:58.351362+0000","last_became_peered":"2024-09-12T00:17:58.351362+0000","last_unstale":"2024-09-12T01:12:08.449466+0000","last_undegraded":"2024-09-12T01:12:08.449466+0000","last_fullsized":"2024-09-12T01:12:08.449466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.054114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":214,"num_write":104,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:15.246472+0000","last_change":"2024-09-12T00:39:26.631761+0000","last_active":"2024-09-12T01:13:15.246472+0000","last_peered":"2024-09-12T01:13:15.246472+0000","last_clean":"2024-09-12T01:13:15.246472+0000","last_became_active":"2024-09-12T00:39:26.631491+0000","last_became_peered":"2024-09-12T00:39:26.631491+0000","last_unstale":"2024-09-12T01:13:15.246472+0000","last_undegraded":"2024-09-12T01:13:15.246472+0000","last_fullsized":"2024-09-12T01:13:15.246472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:37.091629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'3","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.410353+0000","last_change":"2024-09-12T00:22:02.430547+0000","last_active":"2024-09-12T01:14:13.410353+0000","last_peered":"2024-09-12T01:14:13.410353+0000","last_clean":"2024-09-12T01:14:13.410353+0000","last_became_active":"2024-09-12T00:22:02.430209+0000","last_became_peered":"2024-09-12T00:22:02.430209+0000","last_unstale":"2024-09-12T01:14:13.410353+0000","last_undegraded":"2024-09-12T01:14:13.410353+0000","last_fullsized":"2024-09-12T01:14:13.410353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:01.694638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.385332+0000","last_change":"2024-09-12T00:21:58.339483+0000","last_active":"2024-09-12T01:11:28.385332+0000","last_peered":"2024-09-12T01:11:28.385332+0000","last_clean":"2024-09-12T01:11:28.385332+0000","last_became_active":"2024-09-12T00:21:58.339248+0000","last_became_peered":"2024-09-12T00:21:58.339248+0000","last_unstale":"2024-09-12T01:11:28.385332+0000","last_undegraded":"2024-09-12T01:11:28.385332+0000","last_fullsized":"2024-09-12T01:11:28.385332+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:13.072602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'36","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609071+0000","last_change":"2024-09-12T00:17:58.358376+0000","last_active":"2024-09-12T01:12:08.609071+0000","last_peered":"2024-09-12T01:12:08.609071+0000","last_clean":"2024-09-12T01:12:08.609071+0000","last_became_active":"2024-09-12T00:17:58.358022+0000","last_became_peered":"2024-09-12T00:17:58.358022+0000","last_unstale":"2024-09-12T01:12:08.609071+0000","last_undegraded":"2024-09-12T01:12:08.609071+0000","last_fullsized":"2024-09-12T01:12:08.609071+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:18.456203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":54,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398216+0000","last_change":"2024-09-12T00:39:26.645252+0000","last_active":"2024-09-12T01:12:48.398216+0000","last_peered":"2024-09-12T01:12:48.398216+0000","last_clean":"2024-09-12T01:12:48.398216+0000","last_became_active":"2024-09-12T00:39:26.644935+0000","last_became_peered":"2024-09-12T00:39:26.644935+0000","last_unstale":"2024-09-12T01:12:48.398216+0000","last_undegraded":"2024-09-12T01:12:48.398216+0000","last_fullsized":"2024-09-12T01:12:48.398216+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:56.007971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240045+0000","last_change":"2024-09-12T00:22:02.424691+0000","last_active":"2024-09-12T01:12:20.240045+0000","last_peered":"2024-09-12T01:12:20.240045+0000","last_clean":"2024-09-12T01:12:20.240045+0000","last_became_active":"2024-09-12T00:22:02.424116+0000","last_became_peered":"2024-09-12T00:22:02.424116+0000","last_unstale":"2024-09-12T01:12:20.240045+0000","last_undegraded":"2024-09-12T01:12:20.240045+0000","last_fullsized":"2024-09-12T01:12:20.240045+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.947612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'6","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408732+0000","last_change":"2024-09-12T00:21:58.332119+0000","last_active":"2024-09-12T01:14:03.408732+0000","last_peered":"2024-09-12T01:14:03.408732+0000","last_clean":"2024-09-12T01:14:03.408732+0000","last_became_active":"2024-09-12T00:21:58.331839+0000","last_became_peered":"2024-09-12T00:21:58.331839+0000","last_unstale":"2024-09-12T01:14:03.408732+0000","last_undegraded":"2024-09-12T01:14:03.408732+0000","last_fullsized":"2024-09-12T01:14:03.408732+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:22.439701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238960+0000","last_change":"2024-09-12T00:17:58.354881+0000","last_active":"2024-09-12T01:12:10.238960+0000","last_peered":"2024-09-12T01:12:10.238960+0000","last_clean":"2024-09-12T01:12:10.238960+0000","last_became_active":"2024-09-12T00:17:58.354568+0000","last_became_peered":"2024-09-12T00:17:58.354568+0000","last_unstale":"2024-09-12T01:12:10.238960+0000","last_undegraded":"2024-09-12T01:12:10.238960+0000","last_fullsized":"2024-09-12T01:12:10.238960+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:54.500434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.509385+0000","last_change":"2024-09-12T00:39:26.640912+0000","last_active":"2024-09-12T01:12:48.509385+0000","last_peered":"2024-09-12T01:12:48.509385+0000","last_clean":"2024-09-12T01:12:48.509385+0000","last_became_active":"2024-09-12T00:39:26.635679+0000","last_became_peered":"2024-09-12T00:39:26.635679+0000","last_unstale":"2024-09-12T01:12:48.509385+0000","last_undegraded":"2024-09-12T01:12:48.509385+0000","last_fullsized":"2024-09-12T01:12:48.509385+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:19.017813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'15","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.112421+0000","last_change":"2024-09-12T00:22:02.420520+0000","last_active":"2024-09-12T01:15:48.112421+0000","last_peered":"2024-09-12T01:15:48.112421+0000","last_clean":"2024-09-12T01:15:48.112421+0000","last_became_active":"2024-09-12T00:22:02.420246+0000","last_became_peered":"2024-09-12T00:22:02.420246+0000","last_unstale":"2024-09-12T01:15:48.112421+0000","last_undegraded":"2024-09-12T01:15:48.112421+0000","last_fullsized":"2024-09-12T01:15:48.112421+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:31.472875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.236313+0000","last_change":"2024-09-12T00:21:58.332641+0000","last_active":"2024-09-12T01:14:13.236313+0000","last_peered":"2024-09-12T01:14:13.236313+0000","last_clean":"2024-09-12T01:14:13.236313+0000","last_became_active":"2024-09-12T00:21:58.332362+0000","last_became_peered":"2024-09-12T00:21:58.332362+0000","last_unstale":"2024-09-12T01:14:13.236313+0000","last_undegraded":"2024-09-12T01:14:13.236313+0000","last_fullsized":"2024-09-12T01:14:13.236313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:38.121091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'54","reported_seq":199,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609180+0000","last_change":"2024-09-12T00:17:58.356444+0000","last_active":"2024-09-12T01:12:08.609180+0000","last_peered":"2024-09-12T01:12:08.609180+0000","last_clean":"2024-09-12T01:12:08.609180+0000","last_became_active":"2024-09-12T00:17:58.356120+0000","last_became_peered":"2024-09-12T00:17:58.356120+0000","last_unstale":"2024-09-12T01:12:08.609180+0000","last_undegraded":"2024-09-12T01:12:08.609180+0000","last_fullsized":"2024-09-12T01:12:08.609180+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:56.553542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":175,"num_write":100,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.240729+0000","last_change":"2024-09-12T00:39:26.625293+0000","last_active":"2024-09-12T01:13:38.240729+0000","last_peered":"2024-09-12T01:13:38.240729+0000","last_clean":"2024-09-12T01:13:38.240729+0000","last_became_active":"2024-09-12T00:39:26.624994+0000","last_became_peered":"2024-09-12T00:39:26.624994+0000","last_unstale":"2024-09-12T01:13:38.240729+0000","last_undegraded":"2024-09-12T01:13:38.240729+0000","last_fullsized":"2024-09-12T01:13:38.240729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:56.114504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390791+0000","last_change":"2024-09-12T00:22:02.424780+0000","last_active":"2024-09-12T01:11:53.390791+0000","last_peered":"2024-09-12T01:11:53.390791+0000","last_clean":"2024-09-12T01:11:53.390791+0000","last_became_active":"2024-09-12T00:22:02.424412+0000","last_became_peered":"2024-09-12T00:22:02.424412+0000","last_unstale":"2024-09-12T01:11:53.390791+0000","last_undegraded":"2024-09-12T01:11:53.390791+0000","last_fullsized":"2024-09-12T01:11:53.390791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.074060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.500730+0000","last_change":"2024-09-12T00:21:58.334861+0000","last_active":"2024-09-12T01:11:48.500730+0000","last_peered":"2024-09-12T01:11:48.500730+0000","last_clean":"2024-09-12T01:11:48.500730+0000","last_became_active":"2024-09-12T00:21:58.334536+0000","last_became_peered":"2024-09-12T00:21:58.334536+0000","last_unstale":"2024-09-12T01:11:48.500730+0000","last_undegraded":"2024-09-12T01:11:48.500730+0000","last_fullsized":"2024-09-12T01:11:48.500730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:39.419871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394307+0000","last_change":"2024-09-12T00:17:58.353484+0000","last_active":"2024-09-12T01:12:18.394307+0000","last_peered":"2024-09-12T01:12:18.394307+0000","last_clean":"2024-09-12T01:12:18.394307+0000","last_became_active":"2024-09-12T00:17:58.353219+0000","last_became_peered":"2024-09-12T00:17:58.353219+0000","last_unstale":"2024-09-12T01:12:18.394307+0000","last_undegraded":"2024-09-12T01:12:18.394307+0000","last_fullsized":"2024-09-12T01:12:18.394307+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:54.015109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":151,"num_write":85,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396509+0000","last_change":"2024-09-12T00:39:26.638305+0000","last_active":"2024-09-12T01:12:48.396509+0000","last_peered":"2024-09-12T01:12:48.396509+0000","last_clean":"2024-09-12T01:12:48.396509+0000","last_became_active":"2024-09-12T00:39:26.638008+0000","last_became_peered":"2024-09-12T00:39:26.638008+0000","last_unstale":"2024-09-12T01:12:48.396509+0000","last_undegraded":"2024-09-12T01:12:48.396509+0000","last_fullsized":"2024-09-12T01:12:48.396509+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:10.696670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'3","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.260835+0000","last_change":"2024-09-12T00:22:02.419773+0000","last_active":"2024-09-12T01:14:03.260835+0000","last_peered":"2024-09-12T01:14:03.260835+0000","last_clean":"2024-09-12T01:14:03.260835+0000","last_became_active":"2024-09-12T00:22:02.419443+0000","last_became_peered":"2024-09-12T00:22:02.419443+0000","last_unstale":"2024-09-12T01:14:03.260835+0000","last_undegraded":"2024-09-12T01:14:03.260835+0000","last_fullsized":"2024-09-12T01:14:03.260835+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:01.383190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390111+0000","last_change":"2024-09-12T00:21:58.335735+0000","last_active":"2024-09-12T01:11:48.390111+0000","last_peered":"2024-09-12T01:11:48.390111+0000","last_clean":"2024-09-12T01:11:48.390111+0000","last_became_active":"2024-09-12T00:21:58.335360+0000","last_became_peered":"2024-09-12T00:21:58.335360+0000","last_unstale":"2024-09-12T01:11:48.390111+0000","last_undegraded":"2024-09-12T01:11:48.390111+0000","last_fullsized":"2024-09-12T01:11:48.390111+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:46.236982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'110","reported_seq":429,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230801+0000","last_change":"2024-09-12T00:17:58.356038+0000","last_active":"2024-09-12T01:12:08.230801+0000","last_peered":"2024-09-12T01:12:08.230801+0000","last_clean":"2024-09-12T01:12:08.230801+0000","last_became_active":"2024-09-12T00:17:58.355688+0000","last_became_peered":"2024-09-12T00:17:58.355688+0000","last_unstale":"2024-09-12T01:12:08.230801+0000","last_undegraded":"2024-09-12T01:12:08.230801+0000","last_fullsized":"2024-09-12T01:12:08.230801+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:17.662520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":717,"num_read_kb":507,"num_write":143,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221804+0000","last_change":"2024-09-12T00:39:26.637811+0000","last_active":"2024-09-12T01:11:58.221804+0000","last_peered":"2024-09-12T01:11:58.221804+0000","last_clean":"2024-09-12T01:11:58.221804+0000","last_became_active":"2024-09-12T00:39:26.637393+0000","last_became_peered":"2024-09-12T00:39:26.637393+0000","last_unstale":"2024-09-12T01:11:58.221804+0000","last_undegraded":"2024-09-12T01:11:58.221804+0000","last_fullsized":"2024-09-12T01:11:58.221804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:54.616369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.230233+0000","last_change":"2024-09-12T00:22:02.423927+0000","last_active":"2024-09-12T01:12:03.230233+0000","last_peered":"2024-09-12T01:12:03.230233+0000","last_clean":"2024-09-12T01:12:03.230233+0000","last_became_active":"2024-09-12T00:22:02.423601+0000","last_became_peered":"2024-09-12T00:22:02.423601+0000","last_unstale":"2024-09-12T01:12:03.230233+0000","last_undegraded":"2024-09-12T01:12:03.230233+0000","last_fullsized":"2024-09-12T01:12:03.230233+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:37.317770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392781+0000","last_change":"2024-09-12T00:21:58.339918+0000","last_active":"2024-09-12T01:12:08.392781+0000","last_peered":"2024-09-12T01:12:08.392781+0000","last_clean":"2024-09-12T01:12:08.392781+0000","last_became_active":"2024-09-12T00:21:58.339625+0000","last_became_peered":"2024-09-12T00:21:58.339625+0000","last_unstale":"2024-09-12T01:12:08.392781+0000","last_undegraded":"2024-09-12T01:12:08.392781+0000","last_fullsized":"2024-09-12T01:12:08.392781+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:55.567062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503535+0000","last_change":"2024-09-12T00:17:58.357264+0000","last_active":"2024-09-12T01:12:08.503535+0000","last_peered":"2024-09-12T01:12:08.503535+0000","last_clean":"2024-09-12T01:12:08.503535+0000","last_became_active":"2024-09-12T00:17:58.356906+0000","last_became_peered":"2024-09-12T00:17:58.356906+0000","last_unstale":"2024-09-12T01:12:08.503535+0000","last_undegraded":"2024-09-12T01:12:08.503535+0000","last_fullsized":"2024-09-12T01:12:08.503535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:35.900823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":164,"num_write":72,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237860+0000","last_change":"2024-09-12T00:39:26.628713+0000","last_active":"2024-09-12T01:12:00.237860+0000","last_peered":"2024-09-12T01:12:00.237860+0000","last_clean":"2024-09-12T01:12:00.237860+0000","last_became_active":"2024-09-12T00:39:26.628244+0000","last_became_peered":"2024-09-12T00:39:26.628244+0000","last_unstale":"2024-09-12T01:12:00.237860+0000","last_undegraded":"2024-09-12T01:12:00.237860+0000","last_fullsized":"2024-09-12T01:12:00.237860+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:04.390305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.521387+0000","last_change":"2024-09-12T00:22:02.417514+0000","last_active":"2024-09-12T01:14:08.521387+0000","last_peered":"2024-09-12T01:14:08.521387+0000","last_clean":"2024-09-12T01:14:08.521387+0000","last_became_active":"2024-09-12T00:22:02.417237+0000","last_became_peered":"2024-09-12T00:22:02.417237+0000","last_unstale":"2024-09-12T01:14:08.521387+0000","last_undegraded":"2024-09-12T01:14:08.521387+0000","last_fullsized":"2024-09-12T01:14:08.521387+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:50.844465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408682+0000","last_change":"2024-09-12T00:21:58.335825+0000","last_active":"2024-09-12T01:14:03.408682+0000","last_peered":"2024-09-12T01:14:03.408682+0000","last_clean":"2024-09-12T01:14:03.408682+0000","last_became_active":"2024-09-12T00:21:58.335541+0000","last_became_peered":"2024-09-12T00:21:58.335541+0000","last_unstale":"2024-09-12T01:14:03.408682+0000","last_undegraded":"2024-09-12T01:14:03.408682+0000","last_fullsized":"2024-09-12T01:14:03.408682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:13.185076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.391247+0000","last_change":"2024-09-12T00:17:58.349817+0000","last_active":"2024-09-12T01:12:08.391247+0000","last_peered":"2024-09-12T01:12:08.391247+0000","last_clean":"2024-09-12T01:12:08.391247+0000","last_became_active":"2024-09-12T00:17:58.349428+0000","last_became_peered":"2024-09-12T00:17:58.349428+0000","last_unstale":"2024-09-12T01:12:08.391247+0000","last_undegraded":"2024-09-12T01:12:08.391247+0000","last_fullsized":"2024-09-12T01:12:08.391247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:25.884859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":78,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243328+0000","last_change":"2024-09-12T00:39:26.641703+0000","last_active":"2024-09-12T01:12:50.243328+0000","last_peered":"2024-09-12T01:12:50.243328+0000","last_clean":"2024-09-12T01:12:50.243328+0000","last_became_active":"2024-09-12T00:39:26.641360+0000","last_became_peered":"2024-09-12T00:39:26.641360+0000","last_unstale":"2024-09-12T01:12:50.243328+0000","last_undegraded":"2024-09-12T01:12:50.243328+0000","last_fullsized":"2024-09-12T01:12:50.243328+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.843665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608437+0000","last_change":"2024-09-12T00:22:02.430353+0000","last_active":"2024-09-12T01:12:03.608437+0000","last_peered":"2024-09-12T01:12:03.608437+0000","last_clean":"2024-09-12T01:12:03.608437+0000","last_became_active":"2024-09-12T00:22:02.430041+0000","last_became_peered":"2024-09-12T00:22:02.430041+0000","last_unstale":"2024-09-12T01:12:03.608437+0000","last_undegraded":"2024-09-12T01:12:03.608437+0000","last_fullsized":"2024-09-12T01:12:03.608437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:01.886573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.243388+0000","last_change":"2024-09-12T00:21:58.327372+0000","last_active":"2024-09-12T01:14:03.243388+0000","last_peered":"2024-09-12T01:14:03.243388+0000","last_clean":"2024-09-12T01:14:03.243388+0000","last_became_active":"2024-09-12T00:21:58.327094+0000","last_became_peered":"2024-09-12T00:21:58.327094+0000","last_unstale":"2024-09-12T01:14:03.243388+0000","last_undegraded":"2024-09-12T01:14:03.243388+0000","last_fullsized":"2024-09-12T01:14:03.243388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:12.131588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'15","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609100+0000","last_change":"2024-09-12T00:17:58.355203+0000","last_active":"2024-09-12T01:12:08.609100+0000","last_peered":"2024-09-12T01:12:08.609100+0000","last_clean":"2024-09-12T01:12:08.609100+0000","last_became_active":"2024-09-12T00:17:58.354797+0000","last_became_peered":"2024-09-12T00:17:58.354797+0000","last_unstale":"2024-09-12T01:12:08.609100+0000","last_undegraded":"2024-09-12T01:12:08.609100+0000","last_fullsized":"2024-09-12T01:12:08.609100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.618609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399062+0000","last_change":"2024-09-12T00:39:26.641320+0000","last_active":"2024-09-12T01:12:53.399062+0000","last_peered":"2024-09-12T01:12:53.399062+0000","last_clean":"2024-09-12T01:12:53.399062+0000","last_became_active":"2024-09-12T00:39:26.640877+0000","last_became_peered":"2024-09-12T00:39:26.640877+0000","last_unstale":"2024-09-12T01:12:53.399062+0000","last_undegraded":"2024-09-12T01:12:53.399062+0000","last_fullsized":"2024-09-12T01:12:53.399062+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:44.522883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.261478+0000","last_change":"2024-09-12T00:22:02.418887+0000","last_active":"2024-09-12T01:14:08.261478+0000","last_peered":"2024-09-12T01:14:08.261478+0000","last_clean":"2024-09-12T01:14:08.261478+0000","last_became_active":"2024-09-12T00:22:02.418588+0000","last_became_peered":"2024-09-12T00:22:02.418588+0000","last_unstale":"2024-09-12T01:14:08.261478+0000","last_undegraded":"2024-09-12T01:14:08.261478+0000","last_fullsized":"2024-09-12T01:14:08.261478+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:23.078029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'7","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.625107+0000","last_change":"2024-09-12T00:21:58.332292+0000","last_active":"2024-09-12T01:14:03.625107+0000","last_peered":"2024-09-12T01:14:03.625107+0000","last_clean":"2024-09-12T01:14:03.625107+0000","last_became_active":"2024-09-12T00:21:58.331972+0000","last_became_peered":"2024-09-12T00:21:58.331972+0000","last_unstale":"2024-09-12T01:14:03.625107+0000","last_undegraded":"2024-09-12T01:14:03.625107+0000","last_fullsized":"2024-09-12T01:14:03.625107+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:41.270684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'16","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392791+0000","last_change":"2024-09-12T00:17:58.358230+0000","last_active":"2024-09-12T01:12:08.392791+0000","last_peered":"2024-09-12T01:12:08.392791+0000","last_clean":"2024-09-12T01:12:08.392791+0000","last_became_active":"2024-09-12T00:17:58.357689+0000","last_became_peered":"2024-09-12T00:17:58.357689+0000","last_unstale":"2024-09-12T01:12:08.392791+0000","last_undegraded":"2024-09-12T01:12:08.392791+0000","last_fullsized":"2024-09-12T01:12:08.392791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:42.417538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'204","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041492+0000","last_change":"2024-09-12T00:02:48.051469+0000","last_active":"2024-09-12T01:15:48.041492+0000","last_peered":"2024-09-12T01:15:48.041492+0000","last_clean":"2024-09-12T01:15:48.041492+0000","last_became_active":"2024-09-12T00:02:48.051117+0000","last_became_peered":"2024-09-12T00:02:48.051117+0000","last_unstale":"2024-09-12T01:15:48.041492+0000","last_undegraded":"2024-09-12T01:15:48.041492+0000","last_fullsized":"2024-09-12T01:15:48.041492+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:31.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342064,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":17555,"num_write":999,"num_write_kb":27178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'739","reported_seq":2130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061089+0000","last_change":"2024-09-12T00:02:50.065523+0000","last_active":"2024-09-12T01:13:06.061089+0000","last_peered":"2024-09-12T01:13:06.061089+0000","last_clean":"2024-09-12T01:13:06.061089+0000","last_became_active":"2024-09-12T00:02:50.065257+0000","last_became_peered":"2024-09-12T00:02:50.065257+0000","last_unstale":"2024-09-12T01:13:06.061089+0000","last_undegraded":"2024-09-12T01:13:06.061089+0000","last_fullsized":"2024-09-12T01:13:06.061089+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:22.262738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3376,"num_read_kb":3036,"num_write":968,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'285","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.186886+0000","last_change":"2024-09-12T00:02:48.049346+0000","last_active":"2024-09-12T01:15:48.186886+0000","last_peered":"2024-09-12T01:15:48.186886+0000","last_clean":"2024-09-12T01:15:48.186886+0000","last_became_active":"2024-09-12T00:02:48.049002+0000","last_became_peered":"2024-09-12T00:02:48.049002+0000","last_unstale":"2024-09-12T01:15:48.186886+0000","last_undegraded":"2024-09-12T01:15:48.186886+0000","last_fullsized":"2024-09-12T01:15:48.186886+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:20.073613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":975,"num_read_kb":18236,"num_write":1256,"num_write_kb":26545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'691","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398967+0000","last_change":"2024-09-12T00:02:50.063909+0000","last_active":"2024-09-12T01:12:53.398967+0000","last_peered":"2024-09-12T01:12:53.398967+0000","last_clean":"2024-09-12T01:12:53.398967+0000","last_became_active":"2024-09-12T00:02:50.063612+0000","last_became_peered":"2024-09-12T00:02:50.063612+0000","last_unstale":"2024-09-12T01:12:53.398967+0000","last_undegraded":"2024-09-12T01:12:53.398967+0000","last_fullsized":"2024-09-12T01:12:53.398967+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":600,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:00.810818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3358,"num_read_kb":3023,"num_write":921,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'219","reported_seq":860,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:45.266303+0000","last_change":"2024-09-12T00:02:48.047754+0000","last_active":"2024-09-12T01:15:45.266303+0000","last_peered":"2024-09-12T01:15:45.266303+0000","last_clean":"2024-09-12T01:15:45.266303+0000","last_became_active":"2024-09-12T00:02:48.045960+0000","last_became_peered":"2024-09-12T00:02:48.045960+0000","last_unstale":"2024-09-12T01:15:45.266303+0000","last_undegraded":"2024-09-12T01:15:45.266303+0000","last_fullsized":"2024-09-12T01:15:45.266303+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:15.082870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1118647,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":21329,"num_write":1072,"num_write_kb":32132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'460","reported_seq":2020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127768+0000","last_change":"2024-09-12T00:02:50.062684+0000","last_active":"2024-09-12T01:14:04.127768+0000","last_peered":"2024-09-12T01:14:04.127768+0000","last_clean":"2024-09-12T01:14:04.127768+0000","last_became_active":"2024-09-12T00:02:50.060902+0000","last_became_peered":"2024-09-12T00:02:50.060902+0000","last_unstale":"2024-09-12T01:14:04.127768+0000","last_undegraded":"2024-09-12T01:14:04.127768+0000","last_fullsized":"2024-09-12T01:14:04.127768+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:33.890960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2604,"num_read_kb":2455,"num_write":536,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'260","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.067359+0000","last_change":"2024-09-12T00:02:48.054237+0000","last_active":"2024-09-12T01:15:48.067359+0000","last_peered":"2024-09-12T01:15:48.067359+0000","last_clean":"2024-09-12T01:15:48.067359+0000","last_became_active":"2024-09-12T00:02:48.052802+0000","last_became_peered":"2024-09-12T00:02:48.052802+0000","last_unstale":"2024-09-12T01:15:48.067359+0000","last_undegraded":"2024-09-12T01:15:48.067359+0000","last_fullsized":"2024-09-12T01:15:48.067359+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:33.528197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":8609,"num_write":1124,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'1277","reported_seq":2864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863786+0000","last_change":"2024-09-12T00:02:50.072880+0000","last_active":"2024-09-12T01:13:20.863786+0000","last_peered":"2024-09-12T01:13:20.863786+0000","last_clean":"2024-09-12T01:13:20.863786+0000","last_became_active":"2024-09-12T00:02:50.072574+0000","last_became_peered":"2024-09-12T00:02:50.072574+0000","last_unstale":"2024-09-12T01:13:20.863786+0000","last_undegraded":"2024-09-12T01:13:20.863786+0000","last_fullsized":"2024-09-12T01:13:20.863786+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:18.343144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5797,"num_read_kb":5069,"num_write":1818,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'162","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:18.419930+0000","last_change":"2024-09-12T00:02:48.053474+0000","last_active":"2024-09-12T01:15:18.419930+0000","last_peered":"2024-09-12T01:15:18.419930+0000","last_clean":"2024-09-12T01:15:18.419930+0000","last_became_active":"2024-09-12T00:02:48.052778+0000","last_became_peered":"2024-09-12T00:02:48.052778+0000","last_unstale":"2024-09-12T01:15:18.419930+0000","last_undegraded":"2024-09-12T01:15:18.419930+0000","last_fullsized":"2024-09-12T01:15:18.419930+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:00.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":373,"num_read_kb":36558,"num_write":790,"num_write_kb":25424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'761","reported_seq":2171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.862249+0000","last_change":"2024-09-12T00:02:50.062543+0000","last_active":"2024-09-12T01:13:20.862249+0000","last_peered":"2024-09-12T01:13:20.862249+0000","last_clean":"2024-09-12T01:13:20.862249+0000","last_became_active":"2024-09-12T00:02:50.062257+0000","last_became_peered":"2024-09-12T00:02:50.062257+0000","last_unstale":"2024-09-12T01:13:20.862249+0000","last_undegraded":"2024-09-12T01:13:20.862249+0000","last_fullsized":"2024-09-12T01:13:20.862249+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:20.110214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3047,"num_write":970,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'225","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.259407+0000","last_change":"2024-09-12T00:02:48.056467+0000","last_active":"2024-09-12T01:15:48.259407+0000","last_peered":"2024-09-12T01:15:48.259407+0000","last_clean":"2024-09-12T01:15:48.259407+0000","last_became_active":"2024-09-12T00:02:48.052257+0000","last_became_peered":"2024-09-12T00:02:48.052257+0000","last_unstale":"2024-09-12T01:15:48.259407+0000","last_undegraded":"2024-09-12T01:15:48.259407+0000","last_fullsized":"2024-09-12T01:15:48.259407+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:42.352728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798278,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":39161,"num_write":992,"num_write_kb":40171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'407","reported_seq":1873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748758+0000","last_change":"2024-09-12T00:02:50.061476+0000","last_active":"2024-09-12T01:15:09.748758+0000","last_peered":"2024-09-12T01:15:09.748758+0000","last_clean":"2024-09-12T01:15:09.748758+0000","last_became_active":"2024-09-12T00:02:50.060756+0000","last_became_peered":"2024-09-12T00:02:50.060756+0000","last_unstale":"2024-09-12T01:15:09.748758+0000","last_undegraded":"2024-09-12T01:15:09.748758+0000","last_fullsized":"2024-09-12T01:15:09.748758+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:07.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2108,"num_read_kb":1993,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'193","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.213028+0000","last_change":"2024-09-12T00:03:21.144282+0000","last_active":"2024-09-12T01:15:48.213028+0000","last_peered":"2024-09-12T01:15:48.213028+0000","last_clean":"2024-09-12T01:15:48.213028+0000","last_became_active":"2024-09-12T00:03:21.143840+0000","last_became_peered":"2024-09-12T00:03:21.143840+0000","last_unstale":"2024-09-12T01:15:48.213028+0000","last_undegraded":"2024-09-12T01:15:48.213028+0000","last_fullsized":"2024-09-12T01:15:48.213028+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:25.883175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":20506,"num_write":998,"num_write_kb":32663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'432","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.517921+0000","last_change":"2024-09-12T00:02:50.065057+0000","last_active":"2024-09-12T01:13:43.517921+0000","last_peered":"2024-09-12T01:13:43.517921+0000","last_clean":"2024-09-12T01:13:43.517921+0000","last_became_active":"2024-09-12T00:02:50.064658+0000","last_became_peered":"2024-09-12T00:02:50.064658+0000","last_unstale":"2024-09-12T01:13:43.517921+0000","last_undegraded":"2024-09-12T01:13:43.517921+0000","last_fullsized":"2024-09-12T01:13:43.517921+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:42.210482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":488,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'181","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.071132+0000","last_change":"2024-09-12T00:02:48.059025+0000","last_active":"2024-09-12T01:15:48.071132+0000","last_peered":"2024-09-12T01:15:48.071132+0000","last_clean":"2024-09-12T01:15:48.071132+0000","last_became_active":"2024-09-12T00:02:48.058678+0000","last_became_peered":"2024-09-12T00:02:48.058678+0000","last_unstale":"2024-09-12T01:15:48.071132+0000","last_undegraded":"2024-09-12T01:15:48.071132+0000","last_fullsized":"2024-09-12T01:15:48.071132+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:51.470037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170390,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1879,"num_write":959,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'888","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.957023+0000","last_change":"2024-09-12T00:02:50.070198+0000","last_active":"2024-09-12T01:14:02.957023+0000","last_peered":"2024-09-12T01:14:02.957023+0000","last_clean":"2024-09-12T01:14:02.957023+0000","last_became_active":"2024-09-12T00:02:50.069840+0000","last_became_peered":"2024-09-12T00:02:50.069840+0000","last_unstale":"2024-09-12T01:14:02.957023+0000","last_undegraded":"2024-09-12T01:14:02.957023+0000","last_fullsized":"2024-09-12T01:14:02.957023+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.926054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4122,"num_read_kb":3699,"num_write":1233,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'596","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863098+0000","last_change":"2024-09-12T00:02:50.061218+0000","last_active":"2024-09-12T01:13:20.863098+0000","last_peered":"2024-09-12T01:13:20.863098+0000","last_clean":"2024-09-12T01:13:20.863098+0000","last_became_active":"2024-09-12T00:02:50.060919+0000","last_became_peered":"2024-09-12T00:02:50.060919+0000","last_unstale":"2024-09-12T01:13:20.863098+0000","last_undegraded":"2024-09-12T01:13:20.863098+0000","last_fullsized":"2024-09-12T01:13:20.863098+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:06.460607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3046,"num_read_kb":2788,"num_write":785,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'202","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.243046+0000","last_change":"2024-09-12T00:02:48.051390+0000","last_active":"2024-09-12T01:15:48.243046+0000","last_peered":"2024-09-12T01:15:48.243046+0000","last_clean":"2024-09-12T01:15:48.243046+0000","last_became_active":"2024-09-12T00:02:48.050909+0000","last_became_peered":"2024-09-12T00:02:48.050909+0000","last_unstale":"2024-09-12T01:15:48.243046+0000","last_undegraded":"2024-09-12T01:15:48.243046+0000","last_fullsized":"2024-09-12T01:15:48.243046+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:04.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":10751,"num_write":911,"num_write_kb":36355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'825","reported_seq":2313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863421+0000","last_change":"2024-09-12T00:02:50.073111+0000","last_active":"2024-09-12T01:13:20.863421+0000","last_peered":"2024-09-12T01:13:20.863421+0000","last_clean":"2024-09-12T01:13:20.863421+0000","last_became_active":"2024-09-12T00:02:50.072791+0000","last_became_peered":"2024-09-12T00:02:50.072791+0000","last_unstale":"2024-09-12T01:13:20.863421+0000","last_undegraded":"2024-09-12T01:13:20.863421+0000","last_fullsized":"2024-09-12T01:13:20.863421+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:30.271643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3382,"num_write":1095,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'201","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.222482+0000","last_change":"2024-09-12T00:02:48.053788+0000","last_active":"2024-09-12T01:15:48.222482+0000","last_peered":"2024-09-12T01:15:48.222482+0000","last_clean":"2024-09-12T01:15:48.222482+0000","last_became_active":"2024-09-12T00:02:48.053452+0000","last_became_peered":"2024-09-12T00:02:48.053452+0000","last_unstale":"2024-09-12T01:15:48.222482+0000","last_undegraded":"2024-09-12T01:15:48.222482+0000","last_fullsized":"2024-09-12T01:15:48.222482+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:23.267737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684145,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":6281,"num_write":1001,"num_write_kb":31607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'856","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956760+0000","last_change":"2024-09-12T00:02:50.072524+0000","last_active":"2024-09-12T01:14:02.956760+0000","last_peered":"2024-09-12T01:14:02.956760+0000","last_clean":"2024-09-12T01:14:02.956760+0000","last_became_active":"2024-09-12T00:02:50.072128+0000","last_became_peered":"2024-09-12T00:02:50.072128+0000","last_unstale":"2024-09-12T01:14:02.956760+0000","last_undegraded":"2024-09-12T01:14:02.956760+0000","last_fullsized":"2024-09-12T01:14:02.956760+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:10.120502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4255,"num_read_kb":3837,"num_write":1128,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'188","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.164834+0000","last_change":"2024-09-12T00:02:48.059802+0000","last_active":"2024-09-12T01:15:48.164834+0000","last_peered":"2024-09-12T01:15:48.164834+0000","last_clean":"2024-09-12T01:15:48.164834+0000","last_became_active":"2024-09-12T00:02:48.059289+0000","last_became_peered":"2024-09-12T00:02:48.059289+0000","last_unstale":"2024-09-12T01:15:48.164834+0000","last_undegraded":"2024-09-12T01:15:48.164834+0000","last_fullsized":"2024-09-12T01:15:48.164834+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:59.633157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342107,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":40439,"num_write":973,"num_write_kb":33156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'997","reported_seq":2680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956778+0000","last_change":"2024-09-12T00:02:50.070109+0000","last_active":"2024-09-12T01:14:02.956778+0000","last_peered":"2024-09-12T01:14:02.956778+0000","last_clean":"2024-09-12T01:14:02.956778+0000","last_became_active":"2024-09-12T00:02:50.069775+0000","last_became_peered":"2024-09-12T00:02:50.069775+0000","last_unstale":"2024-09-12T01:14:02.956778+0000","last_undegraded":"2024-09-12T01:14:02.956778+0000","last_fullsized":"2024-09-12T01:14:02.956778+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:30.986657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4692,"num_read_kb":4217,"num_write":1368,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'201","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.123127+0000","last_change":"2024-09-12T00:04:21.323388+0000","last_active":"2024-09-12T01:15:48.123127+0000","last_peered":"2024-09-12T01:15:48.123127+0000","last_clean":"2024-09-12T01:15:48.123127+0000","last_became_active":"2024-09-12T00:04:21.322881+0000","last_became_peered":"2024-09-12T00:04:21.322881+0000","last_unstale":"2024-09-12T01:15:48.123127+0000","last_undegraded":"2024-09-12T01:15:48.123127+0000","last_fullsized":"2024-09-12T01:15:48.123127+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.218601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10550637,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":44397,"num_write":1009,"num_write_kb":26074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"267'849","reported_seq":2416,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.284675+0000","last_change":"2024-09-12T00:02:50.061400+0000","last_active":"2024-09-12T01:12:58.284675+0000","last_peered":"2024-09-12T01:12:58.284675+0000","last_clean":"2024-09-12T01:12:58.284675+0000","last_became_active":"2024-09-12T00:02:50.061055+0000","last_became_peered":"2024-09-12T00:02:50.061055+0000","last_unstale":"2024-09-12T01:12:58.284675+0000","last_undegraded":"2024-09-12T01:12:58.284675+0000","last_fullsized":"2024-09-12T01:12:58.284675+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:36.257000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3601,"num_write":1146,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'246","reported_seq":888,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.276203+0000","last_change":"2024-09-12T00:03:22.073808+0000","last_active":"2024-09-12T01:15:48.276203+0000","last_peered":"2024-09-12T01:15:48.276203+0000","last_clean":"2024-09-12T01:15:48.276203+0000","last_became_active":"2024-09-12T00:03:22.073294+0000","last_became_peered":"2024-09-12T00:03:22.073294+0000","last_unstale":"2024-09-12T01:15:48.276203+0000","last_undegraded":"2024-09-12T01:15:48.276203+0000","last_fullsized":"2024-09-12T01:15:48.276203+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:48.679955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5592646,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":9461,"num_write":1068,"num_write_kb":47816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"267'873","reported_seq":2497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.955537+0000","last_change":"2024-09-12T00:02:50.067613+0000","last_active":"2024-09-12T01:14:02.955537+0000","last_peered":"2024-09-12T01:14:02.955537+0000","last_clean":"2024-09-12T01:14:02.955537+0000","last_became_active":"2024-09-12T00:02:50.067334+0000","last_became_peered":"2024-09-12T00:02:50.067334+0000","last_unstale":"2024-09-12T01:14:02.955537+0000","last_undegraded":"2024-09-12T01:14:02.955537+0000","last_fullsized":"2024-09-12T01:14:02.955537+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:15.631907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4129,"num_read_kb":3712,"num_write":1142,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'242","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.178704+0000","last_change":"2024-09-12T00:02:48.050847+0000","last_active":"2024-09-12T01:15:48.178704+0000","last_peered":"2024-09-12T01:15:48.178704+0000","last_clean":"2024-09-12T01:15:48.178704+0000","last_became_active":"2024-09-12T00:02:48.049926+0000","last_became_peered":"2024-09-12T00:02:48.049926+0000","last_unstale":"2024-09-12T01:15:48.178704+0000","last_undegraded":"2024-09-12T01:15:48.178704+0000","last_fullsized":"2024-09-12T01:15:48.178704+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:56.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399169,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":41400,"num_write":1181,"num_write_kb":37207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'135","reported_seq":652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.271975+0000","last_change":"2024-09-12T00:02:58.094744+0000","last_active":"2024-09-12T01:14:04.271975+0000","last_peered":"2024-09-12T01:14:04.271975+0000","last_clean":"2024-09-12T01:14:04.271975+0000","last_became_active":"2024-09-12T00:02:58.094271+0000","last_became_peered":"2024-09-12T00:02:58.094271+0000","last_unstale":"2024-09-12T01:14:04.271975+0000","last_undegraded":"2024-09-12T01:14:04.271975+0000","last_fullsized":"2024-09-12T01:14:04.271975+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:25.220277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":142,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'583","reported_seq":2349,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.279891+0000","last_change":"2024-09-12T00:02:50.073678+0000","last_active":"2024-09-12T01:13:32.279891+0000","last_peered":"2024-09-12T01:13:32.279891+0000","last_clean":"2024-09-12T01:13:32.279891+0000","last_became_active":"2024-09-12T00:02:50.073327+0000","last_became_peered":"2024-09-12T00:02:50.073327+0000","last_unstale":"2024-09-12T01:13:32.279891+0000","last_undegraded":"2024-09-12T01:13:32.279891+0000","last_fullsized":"2024-09-12T01:13:32.279891+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:33.890960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3161,"num_read_kb":2955,"num_write":696,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'270","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.221731+0000","last_change":"2024-09-12T00:03:21.143983+0000","last_active":"2024-09-12T01:15:48.221731+0000","last_peered":"2024-09-12T01:15:48.221731+0000","last_clean":"2024-09-12T01:15:48.221731+0000","last_became_active":"2024-09-12T00:03:21.143543+0000","last_became_peered":"2024-09-12T00:03:21.143543+0000","last_unstale":"2024-09-12T01:15:48.221731+0000","last_undegraded":"2024-09-12T01:15:48.221731+0000","last_fullsized":"2024-09-12T01:15:48.221731+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:23.255657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":789,"num_read_kb":207403,"num_write":1277,"num_write_kb":65033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510971+0000","last_change":"2024-09-12T00:02:52.067537+0000","last_active":"2024-09-12T01:12:58.510971+0000","last_peered":"2024-09-12T01:12:58.510971+0000","last_clean":"2024-09-12T01:12:58.510971+0000","last_became_active":"2024-09-12T00:02:52.067288+0000","last_became_peered":"2024-09-12T00:02:52.067288+0000","last_unstale":"2024-09-12T01:12:58.510971+0000","last_undegraded":"2024-09-12T01:12:58.510971+0000","last_fullsized":"2024-09-12T01:12:58.510971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:59.660984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'236","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.118412+0000","last_change":"2024-09-12T00:02:54.070876+0000","last_active":"2024-09-12T01:15:48.118412+0000","last_peered":"2024-09-12T01:15:48.118412+0000","last_clean":"2024-09-12T01:15:48.118412+0000","last_became_active":"2024-09-12T00:02:54.070547+0000","last_became_peered":"2024-09-12T00:02:54.070547+0000","last_unstale":"2024-09-12T01:15:48.118412+0000","last_undegraded":"2024-09-12T01:15:48.118412+0000","last_fullsized":"2024-09-12T01:15:48.118412+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:55.618177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9977,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":320,"num_read_kb":418,"num_write":196,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.400430+0000","last_change":"2024-09-12T00:02:56.081347+0000","last_active":"2024-09-12T01:13:03.400430+0000","last_peered":"2024-09-12T01:13:03.400430+0000","last_clean":"2024-09-12T01:13:03.400430+0000","last_became_active":"2024-09-12T00:02:56.081086+0000","last_became_peered":"2024-09-12T00:02:56.081086+0000","last_unstale":"2024-09-12T01:13:03.400430+0000","last_undegraded":"2024-09-12T01:13:03.400430+0000","last_fullsized":"2024-09-12T01:13:03.400430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:59.050278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'2432","reported_seq":4341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.081005+0000","last_change":"2024-09-12T00:02:58.096284+0000","last_active":"2024-09-12T01:14:00.081005+0000","last_peered":"2024-09-12T01:14:00.081005+0000","last_clean":"2024-09-12T01:14:00.081005+0000","last_became_active":"2024-09-12T00:02:58.095948+0000","last_became_peered":"2024-09-12T00:02:58.095948+0000","last_unstale":"2024-09-12T01:14:00.081005+0000","last_undegraded":"2024-09-12T01:14:00.081005+0000","last_fullsized":"2024-09-12T01:14:00.081005+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6163,"num_read_kb":6149,"num_write":4865,"num_write_kb":1796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'433","reported_seq":1960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510948+0000","last_change":"2024-09-12T00:02:50.066811+0000","last_active":"2024-09-12T01:12:58.510948+0000","last_peered":"2024-09-12T01:12:58.510948+0000","last_clean":"2024-09-12T01:12:58.510948+0000","last_became_active":"2024-09-12T00:02:50.065654+0000","last_became_peered":"2024-09-12T00:02:50.065654+0000","last_unstale":"2024-09-12T01:12:58.510948+0000","last_undegraded":"2024-09-12T01:12:58.510948+0000","last_fullsized":"2024-09-12T01:12:58.510948+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:32.174985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2304,"num_read_kb":2172,"num_write":510,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'198","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.260769+0000","last_change":"2024-09-12T00:02:48.052092+0000","last_active":"2024-09-12T01:15:10.260769+0000","last_peered":"2024-09-12T01:15:10.260769+0000","last_clean":"2024-09-12T01:15:10.260769+0000","last_became_active":"2024-09-12T00:02:48.050499+0000","last_became_peered":"2024-09-12T00:02:48.050499+0000","last_unstale":"2024-09-12T01:15:10.260769+0000","last_undegraded":"2024-09-12T01:15:10.260769+0000","last_fullsized":"2024-09-12T01:15:10.260769+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:12.925597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":23205,"num_write":930,"num_write_kb":52906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455377+0000","last_change":"2024-09-12T00:02:52.068820+0000","last_active":"2024-09-12T01:12:58.455377+0000","last_peered":"2024-09-12T01:12:58.455377+0000","last_clean":"2024-09-12T01:12:58.455377+0000","last_became_active":"2024-09-12T00:02:52.068519+0000","last_became_peered":"2024-09-12T00:02:52.068519+0000","last_unstale":"2024-09-12T01:12:58.455377+0000","last_undegraded":"2024-09-12T01:12:58.455377+0000","last_fullsized":"2024-09-12T01:12:58.455377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:41.402904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'115","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.479573+0000","last_change":"2024-09-12T00:02:54.060615+0000","last_active":"2024-09-12T01:13:29.479573+0000","last_peered":"2024-09-12T01:13:29.479573+0000","last_clean":"2024-09-12T01:13:29.479573+0000","last_became_active":"2024-09-12T00:02:54.060334+0000","last_became_peered":"2024-09-12T00:02:54.060334+0000","last_unstale":"2024-09-12T01:13:29.479573+0000","last_undegraded":"2024-09-12T01:13:29.479573+0000","last_fullsized":"2024-09-12T01:13:29.479573+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:06.270504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.399195+0000","last_change":"2024-09-12T00:02:56.085489+0000","last_active":"2024-09-12T01:13:03.399195+0000","last_peered":"2024-09-12T01:13:03.399195+0000","last_clean":"2024-09-12T01:13:03.399195+0000","last_became_active":"2024-09-12T00:02:56.085222+0000","last_became_peered":"2024-09-12T00:02:56.085222+0000","last_unstale":"2024-09-12T01:13:03.399195+0000","last_undegraded":"2024-09-12T01:13:03.399195+0000","last_fullsized":"2024-09-12T01:13:03.399195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:10.915396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'143","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244578+0000","last_change":"2024-09-12T00:02:58.094502+0000","last_active":"2024-09-12T01:13:00.244578+0000","last_peered":"2024-09-12T01:13:00.244578+0000","last_clean":"2024-09-12T01:13:00.244578+0000","last_became_active":"2024-09-12T00:02:58.094312+0000","last_became_peered":"2024-09-12T00:02:58.094312+0000","last_unstale":"2024-09-12T01:13:00.244578+0000","last_undegraded":"2024-09-12T01:13:00.244578+0000","last_fullsized":"2024-09-12T01:13:00.244578+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:05.995438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":193,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'829","reported_seq":2430,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.964131+0000","last_change":"2024-09-12T00:02:50.071513+0000","last_active":"2024-09-12T01:13:13.964131+0000","last_peered":"2024-09-12T01:13:13.964131+0000","last_clean":"2024-09-12T01:13:13.964131+0000","last_became_active":"2024-09-12T00:02:50.071219+0000","last_became_peered":"2024-09-12T00:02:50.071219+0000","last_unstale":"2024-09-12T01:13:13.964131+0000","last_undegraded":"2024-09-12T01:13:13.964131+0000","last_fullsized":"2024-09-12T01:13:13.964131+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:42.605165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4069,"num_read_kb":3661,"num_write":1104,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'211","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.133404+0000","last_change":"2024-09-12T00:02:48.059794+0000","last_active":"2024-09-12T01:15:48.133404+0000","last_peered":"2024-09-12T01:15:48.133404+0000","last_clean":"2024-09-12T01:15:48.133404+0000","last_became_active":"2024-09-12T00:02:48.059132+0000","last_became_peered":"2024-09-12T00:02:48.059132+0000","last_unstale":"2024-09-12T01:15:48.133404+0000","last_undegraded":"2024-09-12T01:15:48.133404+0000","last_fullsized":"2024-09-12T01:15:48.133404+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:49.465348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":5763,"num_write":993,"num_write_kb":32529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455423+0000","last_change":"2024-09-12T00:02:52.064543+0000","last_active":"2024-09-12T01:12:58.455423+0000","last_peered":"2024-09-12T01:12:58.455423+0000","last_clean":"2024-09-12T01:12:58.455423+0000","last_became_active":"2024-09-12T00:02:52.064216+0000","last_became_peered":"2024-09-12T00:02:52.064216+0000","last_unstale":"2024-09-12T01:12:58.455423+0000","last_undegraded":"2024-09-12T01:12:58.455423+0000","last_fullsized":"2024-09-12T01:12:58.455423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:47.668439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'155","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.520130+0000","last_change":"2024-09-12T00:02:54.060808+0000","last_active":"2024-09-12T01:13:29.520130+0000","last_peered":"2024-09-12T01:13:29.520130+0000","last_clean":"2024-09-12T01:13:29.520130+0000","last_became_active":"2024-09-12T00:02:54.060501+0000","last_became_peered":"2024-09-12T00:02:54.060501+0000","last_unstale":"2024-09-12T01:13:29.520130+0000","last_undegraded":"2024-09-12T01:13:29.520130+0000","last_fullsized":"2024-09-12T01:13:29.520130+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.725874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":182,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'766","reported_seq":2662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.957227+0000","last_change":"2024-09-12T00:02:56.087899+0000","last_active":"2024-09-12T01:15:47.957227+0000","last_peered":"2024-09-12T01:15:47.957227+0000","last_clean":"2024-09-12T01:15:47.957227+0000","last_became_active":"2024-09-12T00:02:56.087506+0000","last_became_peered":"2024-09-12T00:02:56.087506+0000","last_unstale":"2024-09-12T01:15:47.957227+0000","last_undegraded":"2024-09-12T01:15:47.957227+0000","last_fullsized":"2024-09-12T01:15:47.957227+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.840099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'208","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.331265+0000","last_change":"2024-09-12T00:02:58.090727+0000","last_active":"2024-09-12T01:14:04.331265+0000","last_peered":"2024-09-12T01:14:04.331265+0000","last_clean":"2024-09-12T01:14:04.331265+0000","last_became_active":"2024-09-12T00:02:58.090424+0000","last_became_peered":"2024-09-12T00:02:58.090424+0000","last_unstale":"2024-09-12T01:14:04.331265+0000","last_undegraded":"2024-09-12T01:14:04.331265+0000","last_fullsized":"2024-09-12T01:14:04.331265+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:25.948169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":609,"num_read_kb":603,"num_write":442,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'493","reported_seq":2294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455414+0000","last_change":"2024-09-12T00:02:50.068236+0000","last_active":"2024-09-12T01:12:58.455414+0000","last_peered":"2024-09-12T01:12:58.455414+0000","last_clean":"2024-09-12T01:12:58.455414+0000","last_became_active":"2024-09-12T00:02:50.067933+0000","last_became_peered":"2024-09-12T00:02:50.067933+0000","last_unstale":"2024-09-12T01:12:58.455414+0000","last_undegraded":"2024-09-12T01:12:58.455414+0000","last_fullsized":"2024-09-12T01:12:58.455414+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:07.127880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2745,"num_read_kb":2618,"num_write":566,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'210","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.262322+0000","last_change":"2024-09-12T00:02:48.052920+0000","last_active":"2024-09-12T01:15:48.262322+0000","last_peered":"2024-09-12T01:15:48.262322+0000","last_clean":"2024-09-12T01:15:48.262322+0000","last_became_active":"2024-09-12T00:02:48.052566+0000","last_became_peered":"2024-09-12T00:02:48.052566+0000","last_unstale":"2024-09-12T01:15:48.262322+0000","last_undegraded":"2024-09-12T01:15:48.262322+0000","last_fullsized":"2024-09-12T01:15:48.262322+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:54.469835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":572,"num_read_kb":73907,"num_write":996,"num_write_kb":20895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.511011+0000","last_change":"2024-09-12T00:02:52.066484+0000","last_active":"2024-09-12T01:12:58.511011+0000","last_peered":"2024-09-12T01:12:58.511011+0000","last_clean":"2024-09-12T01:12:58.511011+0000","last_became_active":"2024-09-12T00:02:52.066171+0000","last_became_peered":"2024-09-12T00:02:52.066171+0000","last_unstale":"2024-09-12T01:12:58.511011+0000","last_undegraded":"2024-09-12T01:12:58.511011+0000","last_fullsized":"2024-09-12T01:12:58.511011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.617107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'168","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.074173+0000","last_change":"2024-09-12T00:02:54.239939+0000","last_active":"2024-09-12T01:15:48.074173+0000","last_peered":"2024-09-12T01:15:48.074173+0000","last_clean":"2024-09-12T01:15:48.074173+0000","last_became_active":"2024-09-12T00:02:54.239618+0000","last_became_peered":"2024-09-12T00:02:54.239618+0000","last_unstale":"2024-09-12T01:15:48.074173+0000","last_undegraded":"2024-09-12T01:15:48.074173+0000","last_fullsized":"2024-09-12T01:15:48.074173+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:03.054772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":308,"num_write":128,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'807","reported_seq":2630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.961786+0000","last_change":"2024-09-12T00:02:56.082933+0000","last_active":"2024-09-12T01:15:47.961786+0000","last_peered":"2024-09-12T01:15:47.961786+0000","last_clean":"2024-09-12T01:15:47.961786+0000","last_became_active":"2024-09-12T00:02:56.082567+0000","last_became_peered":"2024-09-12T00:02:56.082567+0000","last_unstale":"2024-09-12T01:15:47.961786+0000","last_undegraded":"2024-09-12T01:15:47.961786+0000","last_fullsized":"2024-09-12T01:15:47.961786+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:12.520817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'363","reported_seq":1779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.740706+0000","last_change":"2024-09-12T00:02:50.063983+0000","last_active":"2024-09-12T01:12:50.740706+0000","last_peered":"2024-09-12T01:12:50.740706+0000","last_clean":"2024-09-12T01:12:50.740706+0000","last_became_active":"2024-09-12T00:02:50.063707+0000","last_became_peered":"2024-09-12T00:02:50.063707+0000","last_unstale":"2024-09-12T01:12:50.740706+0000","last_undegraded":"2024-09-12T01:12:50.740706+0000","last_fullsized":"2024-09-12T01:12:50.740706+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:50.652404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1902,"num_write":425,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'196","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154808+0000","last_change":"2024-09-12T00:02:48.056458+0000","last_active":"2024-09-12T01:15:48.154808+0000","last_peered":"2024-09-12T01:15:48.154808+0000","last_clean":"2024-09-12T01:15:48.154808+0000","last_became_active":"2024-09-12T00:02:48.056135+0000","last_became_peered":"2024-09-12T00:02:48.056135+0000","last_unstale":"2024-09-12T01:15:48.154808+0000","last_undegraded":"2024-09-12T01:15:48.154808+0000","last_fullsized":"2024-09-12T01:15:48.154808+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:17.917949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":40539,"num_write":934,"num_write_kb":46911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.393561+0000","last_change":"2024-09-12T00:02:52.069040+0000","last_active":"2024-09-12T01:12:13.393561+0000","last_peered":"2024-09-12T01:12:13.393561+0000","last_clean":"2024-09-12T01:12:13.393561+0000","last_became_active":"2024-09-12T00:02:52.068747+0000","last_became_peered":"2024-09-12T00:02:52.068747+0000","last_unstale":"2024-09-12T01:12:13.393561+0000","last_undegraded":"2024-09-12T01:12:13.393561+0000","last_fullsized":"2024-09-12T01:12:13.393561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.948073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'275","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.157693+0000","last_change":"2024-09-12T00:02:54.239819+0000","last_active":"2024-09-12T01:15:48.157693+0000","last_peered":"2024-09-12T01:15:48.157693+0000","last_clean":"2024-09-12T01:15:48.157693+0000","last_became_active":"2024-09-12T00:02:54.239475+0000","last_became_peered":"2024-09-12T00:02:54.239475+0000","last_unstale":"2024-09-12T01:15:48.157693+0000","last_undegraded":"2024-09-12T01:15:48.157693+0000","last_fullsized":"2024-09-12T01:15:48.157693+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:54.855357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5743,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":380,"num_read_kb":454,"num_write":232,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.234848+0000","last_change":"2024-09-12T00:02:56.082064+0000","last_active":"2024-09-12T01:12:43.234848+0000","last_peered":"2024-09-12T01:12:43.234848+0000","last_clean":"2024-09-12T01:12:43.234848+0000","last_became_active":"2024-09-12T00:02:56.080748+0000","last_became_peered":"2024-09-12T00:02:56.080748+0000","last_unstale":"2024-09-12T01:12:43.234848+0000","last_undegraded":"2024-09-12T01:12:43.234848+0000","last_fullsized":"2024-09-12T01:12:43.234848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:53.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'526","reported_seq":1342,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.903053+0000","last_change":"2024-09-12T00:02:58.095783+0000","last_active":"2024-09-12T01:15:10.903053+0000","last_peered":"2024-09-12T01:15:10.903053+0000","last_clean":"2024-09-12T01:15:10.903053+0000","last_became_active":"2024-09-12T00:02:58.095311+0000","last_became_peered":"2024-09-12T00:02:58.095311+0000","last_unstale":"2024-09-12T01:15:10.903053+0000","last_undegraded":"2024-09-12T01:15:10.903053+0000","last_fullsized":"2024-09-12T01:15:10.903053+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:26.606781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1247,"num_read_kb":1245,"num_write":1070,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'399","reported_seq":1701,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.391883+0000","last_change":"2024-09-12T00:02:50.068582+0000","last_active":"2024-09-12T01:12:13.391883+0000","last_peered":"2024-09-12T01:12:13.391883+0000","last_clean":"2024-09-12T01:12:13.391883+0000","last_became_active":"2024-09-12T00:02:50.068223+0000","last_became_peered":"2024-09-12T00:02:50.068223+0000","last_unstale":"2024-09-12T01:12:13.391883+0000","last_undegraded":"2024-09-12T01:12:13.391883+0000","last_fullsized":"2024-09-12T01:12:13.391883+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:39.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1919,"num_read_kb":1778,"num_write":479,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'153","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.212769+0000","last_change":"2024-09-12T00:02:48.056639+0000","last_active":"2024-09-12T01:15:48.212769+0000","last_peered":"2024-09-12T01:15:48.212769+0000","last_clean":"2024-09-12T01:15:48.212769+0000","last_became_active":"2024-09-12T00:02:48.055480+0000","last_became_peered":"2024-09-12T00:02:48.055480+0000","last_unstale":"2024-09-12T01:15:48.212769+0000","last_undegraded":"2024-09-12T01:15:48.212769+0000","last_fullsized":"2024-09-12T01:15:48.212769+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:35.963894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250607,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":416,"num_read_kb":43431,"num_write":767,"num_write_kb":28983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.223502+0000","last_change":"2024-09-12T00:02:52.062537+0000","last_active":"2024-09-12T01:12:13.223502+0000","last_peered":"2024-09-12T01:12:13.223502+0000","last_clean":"2024-09-12T01:12:13.223502+0000","last_became_active":"2024-09-12T00:02:52.062219+0000","last_became_peered":"2024-09-12T00:02:52.062219+0000","last_unstale":"2024-09-12T01:12:13.223502+0000","last_undegraded":"2024-09-12T01:12:13.223502+0000","last_fullsized":"2024-09-12T01:12:13.223502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:37.629100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'157","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.271575+0000","last_change":"2024-09-12T00:02:54.069965+0000","last_active":"2024-09-12T01:15:48.271575+0000","last_peered":"2024-09-12T01:15:48.271575+0000","last_clean":"2024-09-12T01:15:48.271575+0000","last_became_active":"2024-09-12T00:02:54.069656+0000","last_became_peered":"2024-09-12T00:02:54.069656+0000","last_unstale":"2024-09-12T01:15:48.271575+0000","last_undegraded":"2024-09-12T01:15:48.271575+0000","last_fullsized":"2024-09-12T01:15:48.271575+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.543544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9092,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":201,"num_read_kb":271,"num_write":108,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.451158+0000","last_change":"2024-09-12T00:02:56.082127+0000","last_active":"2024-09-12T01:12:23.451158+0000","last_peered":"2024-09-12T01:12:23.451158+0000","last_clean":"2024-09-12T01:12:23.451158+0000","last_became_active":"2024-09-12T00:02:56.081804+0000","last_became_peered":"2024-09-12T00:02:56.081804+0000","last_unstale":"2024-09-12T01:12:23.451158+0000","last_undegraded":"2024-09-12T01:12:23.451158+0000","last_fullsized":"2024-09-12T01:12:23.451158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'120","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:53.623729+0000","last_change":"2024-09-12T00:02:58.095336+0000","last_active":"2024-09-12T01:13:53.623729+0000","last_peered":"2024-09-12T01:13:53.623729+0000","last_clean":"2024-09-12T01:13:53.623729+0000","last_became_active":"2024-09-12T00:02:58.095068+0000","last_became_peered":"2024-09-12T00:02:58.095068+0000","last_unstale":"2024-09-12T01:13:53.623729+0000","last_undegraded":"2024-09-12T01:13:53.623729+0000","last_fullsized":"2024-09-12T01:13:53.623729+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:41.572699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":135,"num_write":297,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'895","reported_seq":2417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956001+0000","last_change":"2024-09-12T00:02:50.078307+0000","last_active":"2024-09-12T01:14:02.956001+0000","last_peered":"2024-09-12T01:14:02.956001+0000","last_clean":"2024-09-12T01:14:02.956001+0000","last_became_active":"2024-09-12T00:02:50.078033+0000","last_became_peered":"2024-09-12T00:02:50.078033+0000","last_unstale":"2024-09-12T01:14:02.956001+0000","last_undegraded":"2024-09-12T01:14:02.956001+0000","last_fullsized":"2024-09-12T01:14:02.956001+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:39.344301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4128,"num_read_kb":3671,"num_write":1209,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'185","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010442+0000","last_change":"2024-09-12T00:02:48.050254+0000","last_active":"2024-09-12T01:15:48.010442+0000","last_peered":"2024-09-12T01:15:48.010442+0000","last_clean":"2024-09-12T01:15:48.010442+0000","last_became_active":"2024-09-12T00:02:48.048973+0000","last_became_peered":"2024-09-12T00:02:48.048973+0000","last_unstale":"2024-09-12T01:15:48.010442+0000","last_undegraded":"2024-09-12T01:15:48.010442+0000","last_fullsized":"2024-09-12T01:15:48.010442+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:37.674699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":6868,"num_write":918,"num_write_kb":34085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.226604+0000","last_change":"2024-09-12T00:02:52.066165+0000","last_active":"2024-09-12T01:12:38.226604+0000","last_peered":"2024-09-12T01:12:38.226604+0000","last_clean":"2024-09-12T01:12:38.226604+0000","last_became_active":"2024-09-12T00:02:52.065809+0000","last_became_peered":"2024-09-12T00:02:52.065809+0000","last_unstale":"2024-09-12T01:12:38.226604+0000","last_undegraded":"2024-09-12T01:12:38.226604+0000","last_fullsized":"2024-09-12T01:12:38.226604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:04.139647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'211","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.180814+0000","last_change":"2024-09-12T00:02:54.067330+0000","last_active":"2024-09-12T01:15:48.180814+0000","last_peered":"2024-09-12T01:15:48.180814+0000","last_clean":"2024-09-12T01:15:48.180814+0000","last_became_active":"2024-09-12T00:02:54.066781+0000","last_became_peered":"2024-09-12T00:02:54.066781+0000","last_unstale":"2024-09-12T01:15:48.180814+0000","last_undegraded":"2024-09-12T01:15:48.180814+0000","last_fullsized":"2024-09-12T01:15:48.180814+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:13.921060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":282,"num_read_kb":329,"num_write":166,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'794","reported_seq":2817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.962907+0000","last_change":"2024-09-12T00:02:56.086997+0000","last_active":"2024-09-12T01:15:47.962907+0000","last_peered":"2024-09-12T01:15:47.962907+0000","last_clean":"2024-09-12T01:15:47.962907+0000","last_became_active":"2024-09-12T00:02:56.086692+0000","last_became_peered":"2024-09-12T00:02:56.086692+0000","last_unstale":"2024-09-12T01:15:47.962907+0000","last_undegraded":"2024-09-12T01:15:47.962907+0000","last_fullsized":"2024-09-12T01:15:47.962907+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:43.673008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'116","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.570840+0000","last_change":"2024-09-12T00:02:58.093723+0000","last_active":"2024-09-12T01:15:09.570840+0000","last_peered":"2024-09-12T01:15:09.570840+0000","last_clean":"2024-09-12T01:15:09.570840+0000","last_became_active":"2024-09-12T00:02:58.093419+0000","last_became_peered":"2024-09-12T00:02:58.093419+0000","last_unstale":"2024-09-12T01:15:09.570840+0000","last_undegraded":"2024-09-12T01:15:09.570840+0000","last_fullsized":"2024-09-12T01:15:09.570840+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:27.505545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":298,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'399","reported_seq":1992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.655457+0000","last_change":"2024-09-12T00:02:50.074292+0000","last_active":"2024-09-12T01:12:55.655457+0000","last_peered":"2024-09-12T01:12:55.655457+0000","last_clean":"2024-09-12T01:12:55.655457+0000","last_became_active":"2024-09-12T00:02:50.073986+0000","last_became_peered":"2024-09-12T00:02:50.073986+0000","last_unstale":"2024-09-12T01:12:55.655457+0000","last_undegraded":"2024-09-12T01:12:55.655457+0000","last_fullsized":"2024-09-12T01:12:55.655457+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:10.242887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2369,"num_read_kb":2271,"num_write":449,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'218","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041533+0000","last_change":"2024-09-12T00:02:48.051538+0000","last_active":"2024-09-12T01:15:48.041533+0000","last_peered":"2024-09-12T01:15:48.041533+0000","last_clean":"2024-09-12T01:15:48.041533+0000","last_became_active":"2024-09-12T00:02:48.051190+0000","last_became_peered":"2024-09-12T00:02:48.051190+0000","last_unstale":"2024-09-12T01:15:48.041533+0000","last_undegraded":"2024-09-12T01:15:48.041533+0000","last_fullsized":"2024-09-12T01:15:48.041533+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:22.141104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":21060,"num_write":1056,"num_write_kb":24204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:28.225385+0000","last_change":"2024-09-12T00:02:52.057007+0000","last_active":"2024-09-12T01:12:28.225385+0000","last_peered":"2024-09-12T01:12:28.225385+0000","last_clean":"2024-09-12T01:12:28.225385+0000","last_became_active":"2024-09-12T00:02:52.056676+0000","last_became_peered":"2024-09-12T00:02:52.056676+0000","last_unstale":"2024-09-12T01:12:28.225385+0000","last_undegraded":"2024-09-12T01:12:28.225385+0000","last_fullsized":"2024-09-12T01:12:28.225385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:05.044357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'225","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.297507+0000","last_change":"2024-09-12T00:02:54.067361+0000","last_active":"2024-09-12T01:15:48.297507+0000","last_peered":"2024-09-12T01:15:48.297507+0000","last_clean":"2024-09-12T01:15:48.297507+0000","last_became_active":"2024-09-12T00:02:54.066994+0000","last_became_peered":"2024-09-12T00:02:54.066994+0000","last_unstale":"2024-09-12T01:15:48.297507+0000","last_undegraded":"2024-09-12T01:15:48.297507+0000","last_fullsized":"2024-09-12T01:15:48.297507+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:13.963065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10683,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":318,"num_read_kb":432,"num_write":164,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.224174+0000","last_change":"2024-09-12T00:02:56.079092+0000","last_active":"2024-09-12T01:12:18.224174+0000","last_peered":"2024-09-12T01:12:18.224174+0000","last_clean":"2024-09-12T01:12:18.224174+0000","last_became_active":"2024-09-12T00:02:56.078740+0000","last_became_peered":"2024-09-12T00:02:56.078740+0000","last_unstale":"2024-09-12T01:12:18.224174+0000","last_undegraded":"2024-09-12T01:12:18.224174+0000","last_fullsized":"2024-09-12T01:12:18.224174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.551797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'108","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.778285+0000","last_change":"2024-09-12T00:02:58.092860+0000","last_active":"2024-09-12T01:14:00.778285+0000","last_peered":"2024-09-12T01:14:00.778285+0000","last_clean":"2024-09-12T01:14:00.778285+0000","last_became_active":"2024-09-12T00:02:58.092520+0000","last_became_peered":"2024-09-12T00:02:58.092520+0000","last_unstale":"2024-09-12T01:14:00.778285+0000","last_undegraded":"2024-09-12T01:14:00.778285+0000","last_fullsized":"2024-09-12T01:14:00.778285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":241,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'520","reported_seq":2234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.281027+0000","last_change":"2024-09-12T00:02:50.069136+0000","last_active":"2024-09-12T01:13:32.281027+0000","last_peered":"2024-09-12T01:13:32.281027+0000","last_clean":"2024-09-12T01:13:32.281027+0000","last_became_active":"2024-09-12T00:02:50.068691+0000","last_became_peered":"2024-09-12T00:02:50.068691+0000","last_unstale":"2024-09-12T01:13:32.281027+0000","last_undegraded":"2024-09-12T01:13:32.281027+0000","last_fullsized":"2024-09-12T01:13:32.281027+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.229579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2837,"num_read_kb":2668,"num_write":620,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'204","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.230838+0000","last_change":"2024-09-12T00:02:48.052397+0000","last_active":"2024-09-12T01:15:48.230838+0000","last_peered":"2024-09-12T01:15:48.230838+0000","last_clean":"2024-09-12T01:15:48.230838+0000","last_became_active":"2024-09-12T00:02:48.050513+0000","last_became_peered":"2024-09-12T00:02:48.050513+0000","last_unstale":"2024-09-12T01:15:48.230838+0000","last_undegraded":"2024-09-12T01:15:48.230838+0000","last_fullsized":"2024-09-12T01:15:48.230838+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:38.868513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342067,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":923,"num_read_kb":76851,"num_write":1040,"num_write_kb":50138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.226648+0000","last_change":"2024-09-12T00:02:52.064616+0000","last_active":"2024-09-12T01:12:38.226648+0000","last_peered":"2024-09-12T01:12:38.226648+0000","last_clean":"2024-09-12T01:12:38.226648+0000","last_became_active":"2024-09-12T00:02:52.064333+0000","last_became_peered":"2024-09-12T00:02:52.064333+0000","last_unstale":"2024-09-12T01:12:38.226648+0000","last_undegraded":"2024-09-12T01:12:38.226648+0000","last_fullsized":"2024-09-12T01:12:38.226648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:11.063949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'175","reported_seq":778,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.013426+0000","last_change":"2024-09-12T00:02:54.069072+0000","last_active":"2024-09-12T01:15:48.013426+0000","last_peered":"2024-09-12T01:15:48.013426+0000","last_clean":"2024-09-12T01:15:48.013426+0000","last_became_active":"2024-09-12T00:02:54.068732+0000","last_became_peered":"2024-09-12T00:02:54.068732+0000","last_unstale":"2024-09-12T01:15:48.013426+0000","last_undegraded":"2024-09-12T01:15:48.013426+0000","last_fullsized":"2024-09-12T01:15:48.013426+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:07.854071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":259,"num_read_kb":329,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.244035+0000","last_change":"2024-09-12T00:02:56.088885+0000","last_active":"2024-09-12T01:12:55.244035+0000","last_peered":"2024-09-12T01:12:55.244035+0000","last_clean":"2024-09-12T01:12:55.244035+0000","last_became_active":"2024-09-12T00:02:56.088527+0000","last_became_peered":"2024-09-12T00:02:56.088527+0000","last_unstale":"2024-09-12T01:12:55.244035+0000","last_undegraded":"2024-09-12T01:12:55.244035+0000","last_fullsized":"2024-09-12T01:12:55.244035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:43.640519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'110","reported_seq":616,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:00.159830+0000","last_change":"2024-09-12T00:02:58.101029+0000","last_active":"2024-09-12T01:15:00.159830+0000","last_peered":"2024-09-12T01:15:00.159830+0000","last_clean":"2024-09-12T01:15:00.159830+0000","last_became_active":"2024-09-12T00:02:58.100726+0000","last_became_peered":"2024-09-12T00:02:58.100726+0000","last_unstale":"2024-09-12T01:15:00.159830+0000","last_undegraded":"2024-09-12T01:15:00.159830+0000","last_fullsized":"2024-09-12T01:15:00.159830+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:32.362052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":109,"num_write":270,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'820","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.718982+0000","last_change":"2024-09-12T00:02:50.059930+0000","last_active":"2024-09-12T01:15:09.718982+0000","last_peered":"2024-09-12T01:15:09.718982+0000","last_clean":"2024-09-12T01:15:09.718982+0000","last_became_active":"2024-09-12T00:02:50.059646+0000","last_became_peered":"2024-09-12T00:02:50.059646+0000","last_unstale":"2024-09-12T01:15:09.718982+0000","last_undegraded":"2024-09-12T01:15:09.718982+0000","last_fullsized":"2024-09-12T01:15:09.718982+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:39.274084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3626,"num_write":1074,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'218","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.147170+0000","last_change":"2024-09-12T00:02:48.046764+0000","last_active":"2024-09-12T01:15:48.147170+0000","last_peered":"2024-09-12T01:15:48.147170+0000","last_clean":"2024-09-12T01:15:48.147170+0000","last_became_active":"2024-09-12T00:02:48.046424+0000","last_became_peered":"2024-09-12T00:02:48.046424+0000","last_unstale":"2024-09-12T01:15:48.147170+0000","last_undegraded":"2024-09-12T01:15:48.147170+0000","last_fullsized":"2024-09-12T01:15:48.147170+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.965456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":142057,"num_write":895,"num_write_kb":42631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.234273+0000","last_change":"2024-09-12T00:02:52.064194+0000","last_active":"2024-09-12T01:12:38.234273+0000","last_peered":"2024-09-12T01:12:38.234273+0000","last_clean":"2024-09-12T01:12:38.234273+0000","last_became_active":"2024-09-12T00:02:52.063641+0000","last_became_peered":"2024-09-12T00:02:52.063641+0000","last_unstale":"2024-09-12T01:12:38.234273+0000","last_undegraded":"2024-09-12T01:12:38.234273+0000","last_fullsized":"2024-09-12T01:12:38.234273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:26.679512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'186","reported_seq":806,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.244141+0000","last_change":"2024-09-12T00:02:54.067652+0000","last_active":"2024-09-12T01:15:48.244141+0000","last_peered":"2024-09-12T01:15:48.244141+0000","last_clean":"2024-09-12T01:15:48.244141+0000","last_became_active":"2024-09-12T00:02:54.067328+0000","last_became_peered":"2024-09-12T00:02:54.067328+0000","last_unstale":"2024-09-12T01:15:48.244141+0000","last_undegraded":"2024-09-12T01:15:48.244141+0000","last_fullsized":"2024-09-12T01:15:48.244141+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:44.430717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":308,"num_write":148,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'744","reported_seq":2618,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.957993+0000","last_change":"2024-09-12T00:02:56.079479+0000","last_active":"2024-09-12T01:15:47.957993+0000","last_peered":"2024-09-12T01:15:47.957993+0000","last_clean":"2024-09-12T01:15:47.957993+0000","last_became_active":"2024-09-12T00:02:56.079167+0000","last_became_peered":"2024-09-12T00:02:56.079167+0000","last_unstale":"2024-09-12T01:15:47.957993+0000","last_undegraded":"2024-09-12T01:15:47.957993+0000","last_fullsized":"2024-09-12T01:15:47.957993+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:15.403409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'124","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:01.459991+0000","last_change":"2024-09-12T00:02:58.097685+0000","last_active":"2024-09-12T01:14:01.459991+0000","last_peered":"2024-09-12T01:14:01.459991+0000","last_clean":"2024-09-12T01:14:01.459991+0000","last_became_active":"2024-09-12T00:02:58.097332+0000","last_became_peered":"2024-09-12T00:02:58.097332+0000","last_unstale":"2024-09-12T01:14:01.459991+0000","last_undegraded":"2024-09-12T01:14:01.459991+0000","last_fullsized":"2024-09-12T01:14:01.459991+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'385","reported_seq":1995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127378+0000","last_change":"2024-09-12T00:02:50.064012+0000","last_active":"2024-09-12T01:14:04.127378+0000","last_peered":"2024-09-12T01:14:04.127378+0000","last_clean":"2024-09-12T01:14:04.127378+0000","last_became_active":"2024-09-12T00:02:50.063676+0000","last_became_peered":"2024-09-12T00:02:50.063676+0000","last_unstale":"2024-09-12T01:14:04.127378+0000","last_undegraded":"2024-09-12T01:14:04.127378+0000","last_fullsized":"2024-09-12T01:14:04.127378+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:48.138249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2187,"num_read_kb":2115,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'185","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.213869+0000","last_change":"2024-09-12T00:02:48.046773+0000","last_active":"2024-09-12T01:15:48.213869+0000","last_peered":"2024-09-12T01:15:48.213869+0000","last_clean":"2024-09-12T01:15:48.213869+0000","last_became_active":"2024-09-12T00:02:48.046457+0000","last_became_peered":"2024-09-12T00:02:48.046457+0000","last_unstale":"2024-09-12T01:15:48.213869+0000","last_undegraded":"2024-09-12T01:15:48.213869+0000","last_fullsized":"2024-09-12T01:15:48.213869+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:27.570957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":408,"num_read_kb":52839,"num_write":877,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.937718+0000","last_change":"2024-09-12T00:02:52.068801+0000","last_active":"2024-09-12T01:15:47.937718+0000","last_peered":"2024-09-12T01:15:47.937718+0000","last_clean":"2024-09-12T01:15:47.937718+0000","last_became_active":"2024-09-12T00:02:52.068535+0000","last_became_peered":"2024-09-12T00:02:52.068535+0000","last_unstale":"2024-09-12T01:15:47.937718+0000","last_undegraded":"2024-09-12T01:15:47.937718+0000","last_fullsized":"2024-09-12T01:15:47.937718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:14.683759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'103","reported_seq":644,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.447426+0000","last_change":"2024-09-12T00:02:54.240354+0000","last_active":"2024-09-12T01:13:29.447426+0000","last_peered":"2024-09-12T01:13:29.447426+0000","last_clean":"2024-09-12T01:13:29.447426+0000","last_became_active":"2024-09-12T00:02:54.239924+0000","last_became_peered":"2024-09-12T00:02:54.239924+0000","last_unstale":"2024-09-12T01:13:29.447426+0000","last_undegraded":"2024-09-12T01:13:29.447426+0000","last_fullsized":"2024-09-12T01:13:29.447426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:39.666122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":4496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.959587+0000","last_change":"2024-09-12T00:02:56.086976+0000","last_active":"2024-09-12T01:15:47.959587+0000","last_peered":"2024-09-12T01:15:47.959587+0000","last_clean":"2024-09-12T01:15:47.959587+0000","last_became_active":"2024-09-12T00:02:56.086668+0000","last_became_peered":"2024-09-12T00:02:56.086668+0000","last_unstale":"2024-09-12T01:15:47.959587+0000","last_undegraded":"2024-09-12T01:15:47.959587+0000","last_fullsized":"2024-09-12T01:15:47.959587+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:09.139717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'150","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.258589+0000","last_change":"2024-09-12T00:02:58.097729+0000","last_active":"2024-09-12T01:13:48.258589+0000","last_peered":"2024-09-12T01:13:48.258589+0000","last_clean":"2024-09-12T01:13:48.258589+0000","last_became_active":"2024-09-12T00:02:58.097435+0000","last_became_peered":"2024-09-12T00:02:58.097435+0000","last_unstale":"2024-09-12T01:13:48.258589+0000","last_undegraded":"2024-09-12T01:13:48.258589+0000","last_fullsized":"2024-09-12T01:13:48.258589+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:06.625906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":180,"num_write":378,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'757","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:21.039751+0000","last_change":"2024-09-12T00:02:50.069930+0000","last_active":"2024-09-12T01:13:21.039751+0000","last_peered":"2024-09-12T01:13:21.039751+0000","last_clean":"2024-09-12T01:13:21.039751+0000","last_became_active":"2024-09-12T00:02:50.069661+0000","last_became_peered":"2024-09-12T00:02:50.069661+0000","last_unstale":"2024-09-12T01:13:21.039751+0000","last_undegraded":"2024-09-12T01:13:21.039751+0000","last_fullsized":"2024-09-12T01:13:21.039751+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:29.419116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4159,"num_read_kb":3799,"num_write":1082,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'214","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167450+0000","last_change":"2024-09-12T00:02:48.047887+0000","last_active":"2024-09-12T01:15:48.167450+0000","last_peered":"2024-09-12T01:15:48.167450+0000","last_clean":"2024-09-12T01:15:48.167450+0000","last_became_active":"2024-09-12T00:02:48.046527+0000","last_became_peered":"2024-09-12T00:02:48.046527+0000","last_unstale":"2024-09-12T01:15:48.167450+0000","last_undegraded":"2024-09-12T01:15:48.167450+0000","last_fullsized":"2024-09-12T01:15:48.167450+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:11.514356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":898,"num_read_kb":26543,"num_write":1077,"num_write_kb":24642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"38'4","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.925616+0000","last_change":"2024-09-12T00:02:52.064448+0000","last_active":"2024-09-12T01:15:47.925616+0000","last_peered":"2024-09-12T01:15:47.925616+0000","last_clean":"2024-09-12T01:15:47.925616+0000","last_became_active":"2024-09-12T00:02:52.064186+0000","last_became_peered":"2024-09-12T00:02:52.064186+0000","last_unstale":"2024-09-12T01:15:47.925616+0000","last_undegraded":"2024-09-12T01:15:47.925616+0000","last_fullsized":"2024-09-12T01:15:47.925616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:57.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'295","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.124813+0000","last_change":"2024-09-12T00:02:54.072647+0000","last_active":"2024-09-12T01:15:48.124813+0000","last_peered":"2024-09-12T01:15:48.124813+0000","last_clean":"2024-09-12T01:15:48.124813+0000","last_became_active":"2024-09-12T00:02:54.072431+0000","last_became_peered":"2024-09-12T00:02:54.072431+0000","last_unstale":"2024-09-12T01:15:48.124813+0000","last_undegraded":"2024-09-12T01:15:48.124813+0000","last_fullsized":"2024-09-12T01:15:48.124813+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:22.191371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1000,"num_write":1544,"num_write_kb":1370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.613978+0000","last_change":"2024-09-12T00:02:56.083934+0000","last_active":"2024-09-12T01:12:43.613978+0000","last_peered":"2024-09-12T01:12:43.613978+0000","last_clean":"2024-09-12T01:12:43.613978+0000","last_became_active":"2024-09-12T00:02:56.083643+0000","last_became_peered":"2024-09-12T00:02:56.083643+0000","last_unstale":"2024-09-12T01:12:43.613978+0000","last_undegraded":"2024-09-12T01:12:43.613978+0000","last_fullsized":"2024-09-12T01:12:43.613978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:28.266388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'154","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.241850+0000","last_change":"2024-09-12T00:02:58.096803+0000","last_active":"2024-09-12T01:13:48.241850+0000","last_peered":"2024-09-12T01:13:48.241850+0000","last_clean":"2024-09-12T01:13:48.241850+0000","last_became_active":"2024-09-12T00:02:58.096337+0000","last_became_peered":"2024-09-12T00:02:58.096337+0000","last_unstale":"2024-09-12T01:13:48.241850+0000","last_undegraded":"2024-09-12T01:13:48.241850+0000","last_fullsized":"2024-09-12T01:13:48.241850+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":374,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'343","reported_seq":1739,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.747674+0000","last_change":"2024-09-12T00:02:50.063532+0000","last_active":"2024-09-12T01:15:09.747674+0000","last_peered":"2024-09-12T01:15:09.747674+0000","last_clean":"2024-09-12T01:15:09.747674+0000","last_became_active":"2024-09-12T00:02:50.063141+0000","last_became_peered":"2024-09-12T00:02:50.063141+0000","last_unstale":"2024-09-12T01:15:09.747674+0000","last_undegraded":"2024-09-12T01:15:09.747674+0000","last_fullsized":"2024-09-12T01:15:09.747674+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:36.757516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1807,"num_write":392,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397459+0000","last_change":"2024-09-12T00:02:31.950306+0000","last_active":"2024-09-12T01:12:43.397459+0000","last_peered":"2024-09-12T01:12:43.397459+0000","last_clean":"2024-09-12T01:12:43.397459+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T01:12:43.397459+0000","last_undegraded":"2024-09-12T01:12:43.397459+0000","last_fullsized":"2024-09-12T01:12:43.397459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:29.944268+0000","last_clean_scrub_stamp":"2024-09-12T00:02:29.944268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.076017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.515515+0000","last_change":"2024-09-12T00:02:38.003392+0000","last_active":"2024-09-12T01:13:28.515515+0000","last_peered":"2024-09-12T01:13:28.515515+0000","last_clean":"2024-09-12T01:13:28.515515+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T01:13:28.515515+0000","last_undegraded":"2024-09-12T01:13:28.515515+0000","last_fullsized":"2024-09-12T01:13:28.515515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.472492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'199","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154708+0000","last_change":"2024-09-12T00:02:48.048426+0000","last_active":"2024-09-12T01:15:48.154708+0000","last_peered":"2024-09-12T01:15:48.154708+0000","last_clean":"2024-09-12T01:15:48.154708+0000","last_became_active":"2024-09-12T00:02:48.047739+0000","last_became_peered":"2024-09-12T00:02:48.047739+0000","last_unstale":"2024-09-12T01:15:48.154708+0000","last_undegraded":"2024-09-12T01:15:48.154708+0000","last_fullsized":"2024-09-12T01:15:48.154708+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:56.338442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":439,"num_read_kb":34702,"num_write":919,"num_write_kb":51263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.405908+0000","last_change":"2024-09-12T00:02:52.065910+0000","last_active":"2024-09-12T01:13:43.405908+0000","last_peered":"2024-09-12T01:13:43.405908+0000","last_clean":"2024-09-12T01:13:43.405908+0000","last_became_active":"2024-09-12T00:02:52.065587+0000","last_became_peered":"2024-09-12T00:02:52.065587+0000","last_unstale":"2024-09-12T01:13:43.405908+0000","last_undegraded":"2024-09-12T01:13:43.405908+0000","last_fullsized":"2024-09-12T01:13:43.405908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:58.876252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'333","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.224680+0000","last_change":"2024-09-12T00:02:54.069602+0000","last_active":"2024-09-12T01:15:48.224680+0000","last_peered":"2024-09-12T01:15:48.224680+0000","last_clean":"2024-09-12T01:15:48.224680+0000","last_became_active":"2024-09-12T00:02:54.069167+0000","last_became_peered":"2024-09-12T00:02:54.069167+0000","last_unstale":"2024-09-12T01:15:48.224680+0000","last_undegraded":"2024-09-12T01:15:48.224680+0000","last_fullsized":"2024-09-12T01:15:48.224680+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.314767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":868,"num_write":580,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.239491+0000","last_change":"2024-09-12T00:02:56.083312+0000","last_active":"2024-09-12T01:12:15.239491+0000","last_peered":"2024-09-12T01:12:15.239491+0000","last_clean":"2024-09-12T01:12:15.239491+0000","last_became_active":"2024-09-12T00:02:56.082981+0000","last_became_peered":"2024-09-12T00:02:56.082981+0000","last_unstale":"2024-09-12T01:12:15.239491+0000","last_undegraded":"2024-09-12T01:12:15.239491+0000","last_fullsized":"2024-09-12T01:12:15.239491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:01.810212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'220","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.154487+0000","last_change":"2024-09-12T00:02:58.099932+0000","last_active":"2024-09-12T01:14:04.154487+0000","last_peered":"2024-09-12T01:14:04.154487+0000","last_clean":"2024-09-12T01:14:04.154487+0000","last_became_active":"2024-09-12T00:02:58.099655+0000","last_became_peered":"2024-09-12T00:02:58.099655+0000","last_unstale":"2024-09-12T01:14:04.154487+0000","last_undegraded":"2024-09-12T01:14:04.154487+0000","last_fullsized":"2024-09-12T01:14:04.154487+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:49.539153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1237,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":468,"num_write":474,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'874","reported_seq":2624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127264+0000","last_change":"2024-09-12T00:02:50.076009+0000","last_active":"2024-09-12T01:14:04.127264+0000","last_peered":"2024-09-12T01:14:04.127264+0000","last_clean":"2024-09-12T01:14:04.127264+0000","last_became_active":"2024-09-12T00:02:50.075700+0000","last_became_peered":"2024-09-12T00:02:50.075700+0000","last_unstale":"2024-09-12T01:14:04.127264+0000","last_undegraded":"2024-09-12T01:14:04.127264+0000","last_fullsized":"2024-09-12T01:14:04.127264+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.088247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4451,"num_read_kb":4025,"num_write":1186,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398157+0000","last_change":"2024-09-12T00:02:37.999892+0000","last_active":"2024-09-12T01:12:48.398157+0000","last_peered":"2024-09-12T01:12:48.398157+0000","last_clean":"2024-09-12T01:12:48.398157+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T01:12:48.398157+0000","last_undegraded":"2024-09-12T01:12:48.398157+0000","last_fullsized":"2024-09-12T01:12:48.398157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.336025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'216","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.934809+0000","last_change":"2024-09-12T01:15:54.934809+0000","last_active":"2024-09-12T01:15:54.934809+0000","last_peered":"2024-09-12T01:15:54.934809+0000","last_clean":"2024-09-12T01:15:54.934809+0000","last_became_active":"2024-09-12T00:02:48.057849+0000","last_became_peered":"2024-09-12T00:02:48.057849+0000","last_unstale":"2024-09-12T01:15:54.934809+0000","last_undegraded":"2024-09-12T01:15:54.934809+0000","last_fullsized":"2024-09-12T01:15:54.934809+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'216","last_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_deep_scrub":"267'216","last_deep_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.934711+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.315677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079943,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":138068,"num_write":1057,"num_write_kb":57312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.504352+0000","last_change":"2024-09-12T00:02:52.066638+0000","last_active":"2024-09-12T01:12:13.504352+0000","last_peered":"2024-09-12T01:12:13.504352+0000","last_clean":"2024-09-12T01:12:13.504352+0000","last_became_active":"2024-09-12T00:02:52.066352+0000","last_became_peered":"2024-09-12T00:02:52.066352+0000","last_unstale":"2024-09-12T01:12:13.504352+0000","last_undegraded":"2024-09-12T01:12:13.504352+0000","last_fullsized":"2024-09-12T01:12:13.504352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:43.605378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'939","reported_seq":2779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.281957+0000","last_change":"2024-09-12T00:02:54.070381+0000","last_active":"2024-09-12T01:15:48.281957+0000","last_peered":"2024-09-12T01:15:48.281957+0000","last_clean":"2024-09-12T01:15:48.281957+0000","last_became_active":"2024-09-12T00:02:54.070061+0000","last_became_peered":"2024-09-12T00:02:54.070061+0000","last_unstale":"2024-09-12T01:15:48.281957+0000","last_undegraded":"2024-09-12T01:15:48.281957+0000","last_fullsized":"2024-09-12T01:15:48.281957+0000","mapping_epoch":32,"log_start":"267'901","ondisk_log_start":"267'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":901,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:23.921978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20817,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1281,"num_read_kb":1476,"num_write":392,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.390773+0000","last_change":"2024-09-12T00:02:56.078956+0000","last_active":"2024-09-12T01:11:53.390773+0000","last_peered":"2024-09-12T01:11:53.390773+0000","last_clean":"2024-09-12T01:11:53.390773+0000","last_became_active":"2024-09-12T00:02:56.078658+0000","last_became_peered":"2024-09-12T00:02:56.078658+0000","last_unstale":"2024-09-12T01:11:53.390773+0000","last_undegraded":"2024-09-12T01:11:53.390773+0000","last_fullsized":"2024-09-12T01:11:53.390773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:42.358383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'171","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:33.233571+0000","last_change":"2024-09-12T00:02:58.089668+0000","last_active":"2024-09-12T01:12:33.233571+0000","last_peered":"2024-09-12T01:12:33.233571+0000","last_clean":"2024-09-12T01:12:33.233571+0000","last_became_active":"2024-09-12T00:02:58.089378+0000","last_became_peered":"2024-09-12T00:02:58.089378+0000","last_unstale":"2024-09-12T01:12:33.233571+0000","last_undegraded":"2024-09-12T01:12:33.233571+0000","last_fullsized":"2024-09-12T01:12:33.233571+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.424097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":336,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'1105","reported_seq":2822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128513+0000","last_change":"2024-09-12T00:02:50.069236+0000","last_active":"2024-09-12T01:14:04.128513+0000","last_peered":"2024-09-12T01:14:04.128513+0000","last_clean":"2024-09-12T01:14:04.128513+0000","last_became_active":"2024-09-12T00:02:50.067002+0000","last_became_peered":"2024-09-12T00:02:50.067002+0000","last_unstale":"2024-09-12T01:14:04.128513+0000","last_undegraded":"2024-09-12T01:14:04.128513+0000","last_fullsized":"2024-09-12T01:14:04.128513+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.055428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5247,"num_read_kb":4613,"num_write":1599,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.231834+0000","last_change":"2024-09-12T00:02:37.999935+0000","last_active":"2024-09-12T01:13:28.231834+0000","last_peered":"2024-09-12T01:13:28.231834+0000","last_clean":"2024-09-12T01:13:28.231834+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T01:13:28.231834+0000","last_undegraded":"2024-09-12T01:13:28.231834+0000","last_fullsized":"2024-09-12T01:13:28.231834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:36.560973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'185","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167361+0000","last_change":"2024-09-12T00:02:48.044496+0000","last_active":"2024-09-12T01:15:48.167361+0000","last_peered":"2024-09-12T01:15:48.167361+0000","last_clean":"2024-09-12T01:15:48.167361+0000","last_became_active":"2024-09-12T00:02:48.044126+0000","last_became_peered":"2024-09-12T00:02:48.044126+0000","last_unstale":"2024-09-12T01:15:48.167361+0000","last_undegraded":"2024-09-12T01:15:48.167361+0000","last_fullsized":"2024-09-12T01:15:48.167361+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:22.117737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4751719,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":400,"num_read_kb":27065,"num_write":781,"num_write_kb":40333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.223592+0000","last_change":"2024-09-12T00:02:52.068671+0000","last_active":"2024-09-12T01:12:13.223592+0000","last_peered":"2024-09-12T01:12:13.223592+0000","last_clean":"2024-09-12T01:12:13.223592+0000","last_became_active":"2024-09-12T00:02:52.068351+0000","last_became_peered":"2024-09-12T00:02:52.068351+0000","last_unstale":"2024-09-12T01:12:13.223592+0000","last_undegraded":"2024-09-12T01:12:13.223592+0000","last_fullsized":"2024-09-12T01:12:13.223592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:00.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'302","reported_seq":1732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.187593+0000","last_change":"2024-09-12T00:02:54.241862+0000","last_active":"2024-09-12T01:15:08.187593+0000","last_peered":"2024-09-12T01:15:08.187593+0000","last_clean":"2024-09-12T01:15:08.187593+0000","last_became_active":"2024-09-12T00:02:54.241581+0000","last_became_peered":"2024-09-12T00:02:54.241581+0000","last_unstale":"2024-09-12T01:15:08.187593+0000","last_undegraded":"2024-09-12T01:15:08.187593+0000","last_fullsized":"2024-09-12T01:15:08.187593+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:51.409146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":254,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:45.250159+0000","last_change":"2024-09-12T00:02:56.081949+0000","last_active":"2024-09-12T01:13:45.250159+0000","last_peered":"2024-09-12T01:13:45.250159+0000","last_clean":"2024-09-12T01:13:45.250159+0000","last_became_active":"2024-09-12T00:02:56.081641+0000","last_became_peered":"2024-09-12T00:02:56.081641+0000","last_unstale":"2024-09-12T01:13:45.250159+0000","last_undegraded":"2024-09-12T01:13:45.250159+0000","last_fullsized":"2024-09-12T01:13:45.250159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:16.553415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'273","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.410516+0000","last_change":"2024-09-12T00:02:58.088758+0000","last_active":"2024-09-12T01:14:04.410516+0000","last_peered":"2024-09-12T01:14:04.410516+0000","last_clean":"2024-09-12T01:14:04.410516+0000","last_became_active":"2024-09-12T00:02:58.088442+0000","last_became_peered":"2024-09-12T00:02:58.088442+0000","last_unstale":"2024-09-12T01:14:04.410516+0000","last_undegraded":"2024-09-12T01:14:04.410516+0000","last_fullsized":"2024-09-12T01:14:04.410516+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:27.430742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":615,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'437","reported_seq":2013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061424+0000","last_change":"2024-09-12T00:03:21.140992+0000","last_active":"2024-09-12T01:13:06.061424+0000","last_peered":"2024-09-12T01:13:06.061424+0000","last_clean":"2024-09-12T01:13:06.061424+0000","last_became_active":"2024-09-12T00:03:21.140691+0000","last_became_peered":"2024-09-12T00:03:21.140691+0000","last_unstale":"2024-09-12T01:13:06.061424+0000","last_undegraded":"2024-09-12T01:13:06.061424+0000","last_fullsized":"2024-09-12T01:13:06.061424+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:09.243706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2439,"num_read_kb":2322,"num_write":494,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.515475+0000","last_change":"2024-09-12T00:02:38.004050+0000","last_active":"2024-09-12T01:13:28.515475+0000","last_peered":"2024-09-12T01:13:28.515475+0000","last_clean":"2024-09-12T01:13:28.515475+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T01:13:28.515475+0000","last_undegraded":"2024-09-12T01:13:28.515475+0000","last_fullsized":"2024-09-12T01:13:28.515475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:14.983821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'207","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.079182+0000","last_change":"2024-09-12T00:02:48.049579+0000","last_active":"2024-09-12T01:15:48.079182+0000","last_peered":"2024-09-12T01:15:48.079182+0000","last_clean":"2024-09-12T01:15:48.079182+0000","last_became_active":"2024-09-12T00:02:48.049260+0000","last_became_peered":"2024-09-12T00:02:48.049260+0000","last_unstale":"2024-09-12T01:15:48.079182+0000","last_undegraded":"2024-09-12T01:15:48.079182+0000","last_fullsized":"2024-09-12T01:15:48.079182+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:34.461974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":103584,"num_write":943,"num_write_kb":20218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.237256+0000","last_change":"2024-09-12T00:02:52.066733+0000","last_active":"2024-09-12T01:11:55.237256+0000","last_peered":"2024-09-12T01:11:55.237256+0000","last_clean":"2024-09-12T01:11:55.237256+0000","last_became_active":"2024-09-12T00:02:52.066289+0000","last_became_peered":"2024-09-12T00:02:52.066289+0000","last_unstale":"2024-09-12T01:11:55.237256+0000","last_undegraded":"2024-09-12T01:11:55.237256+0000","last_fullsized":"2024-09-12T01:11:55.237256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:55.049376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'159","reported_seq":725,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:02.202549+0000","last_change":"2024-09-12T00:02:54.067179+0000","last_active":"2024-09-12T01:15:02.202549+0000","last_peered":"2024-09-12T01:15:02.202549+0000","last_clean":"2024-09-12T01:15:02.202549+0000","last_became_active":"2024-09-12T00:02:54.066864+0000","last_became_peered":"2024-09-12T00:02:54.066864+0000","last_unstale":"2024-09-12T01:15:02.202549+0000","last_undegraded":"2024-09-12T01:15:02.202549+0000","last_fullsized":"2024-09-12T01:15:02.202549+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:34.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":203,"num_read_kb":195,"num_write":150,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.610434+0000","last_change":"2024-09-12T00:02:56.085732+0000","last_active":"2024-09-12T01:12:18.610434+0000","last_peered":"2024-09-12T01:12:18.610434+0000","last_clean":"2024-09-12T01:12:18.610434+0000","last_became_active":"2024-09-12T00:02:56.085437+0000","last_became_peered":"2024-09-12T00:02:56.085437+0000","last_unstale":"2024-09-12T01:12:18.610434+0000","last_undegraded":"2024-09-12T01:12:18.610434+0000","last_fullsized":"2024-09-12T01:12:18.610434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:41.321446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'109","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.524360+0000","last_change":"2024-09-12T00:02:58.095790+0000","last_active":"2024-09-12T01:14:28.524360+0000","last_peered":"2024-09-12T01:14:28.524360+0000","last_clean":"2024-09-12T01:14:28.524360+0000","last_became_active":"2024-09-12T00:02:58.095419+0000","last_became_peered":"2024-09-12T00:02:58.095419+0000","last_unstale":"2024-09-12T01:14:28.524360+0000","last_undegraded":"2024-09-12T01:14:28.524360+0000","last_fullsized":"2024-09-12T01:14:28.524360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":189,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'415","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.241281+0000","last_change":"2024-09-12T00:02:50.075586+0000","last_active":"2024-09-12T01:13:43.241281+0000","last_peered":"2024-09-12T01:13:43.241281+0000","last_clean":"2024-09-12T01:13:43.241281+0000","last_became_active":"2024-09-12T00:02:50.075209+0000","last_became_peered":"2024-09-12T00:02:50.075209+0000","last_unstale":"2024-09-12T01:13:43.241281+0000","last_undegraded":"2024-09-12T01:13:43.241281+0000","last_fullsized":"2024-09-12T01:13:43.241281+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:32.991455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2214,"num_read_kb":2093,"num_write":483,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'191","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.259489+0000","last_change":"2024-09-12T00:02:48.054875+0000","last_active":"2024-09-12T01:15:48.259489+0000","last_peered":"2024-09-12T01:15:48.259489+0000","last_clean":"2024-09-12T01:15:48.259489+0000","last_became_active":"2024-09-12T00:02:48.052751+0000","last_became_peered":"2024-09-12T00:02:48.052751+0000","last_unstale":"2024-09-12T01:15:48.259489+0000","last_undegraded":"2024-09-12T01:15:48.259489+0000","last_fullsized":"2024-09-12T01:15:48.259489+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.303430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493417,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":26295,"num_write":910,"num_write_kb":36863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:28.239685+0000","last_change":"2024-09-12T00:02:38.007657+0000","last_active":"2024-09-12T01:13:28.239685+0000","last_peered":"2024-09-12T01:13:28.239685+0000","last_clean":"2024-09-12T01:13:28.239685+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T01:13:28.239685+0000","last_undegraded":"2024-09-12T01:13:28.239685+0000","last_fullsized":"2024-09-12T01:13:28.239685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:40.382288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:45.250137+0000","last_change":"2024-09-12T00:02:52.067482+0000","last_active":"2024-09-12T01:13:45.250137+0000","last_peered":"2024-09-12T01:13:45.250137+0000","last_clean":"2024-09-12T01:13:45.250137+0000","last_became_active":"2024-09-12T00:02:52.067200+0000","last_became_peered":"2024-09-12T00:02:52.067200+0000","last_unstale":"2024-09-12T01:13:45.250137+0000","last_undegraded":"2024-09-12T01:13:45.250137+0000","last_fullsized":"2024-09-12T01:13:45.250137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:28.955322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'307","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.237894+0000","last_change":"2024-09-12T00:02:54.069403+0000","last_active":"2024-09-12T01:15:48.237894+0000","last_peered":"2024-09-12T01:15:48.237894+0000","last_clean":"2024-09-12T01:15:48.237894+0000","last_became_active":"2024-09-12T00:02:54.069071+0000","last_became_peered":"2024-09-12T00:02:54.069071+0000","last_unstale":"2024-09-12T01:15:48.237894+0000","last_undegraded":"2024-09-12T01:15:48.237894+0000","last_fullsized":"2024-09-12T01:15:48.237894+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:01.293660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":450,"num_read_kb":594,"num_write":258,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.258551+0000","last_change":"2024-09-12T00:02:56.082353+0000","last_active":"2024-09-12T01:13:48.258551+0000","last_peered":"2024-09-12T01:13:48.258551+0000","last_clean":"2024-09-12T01:13:48.258551+0000","last_became_active":"2024-09-12T00:02:56.082046+0000","last_became_peered":"2024-09-12T00:02:56.082046+0000","last_unstale":"2024-09-12T01:13:48.258551+0000","last_undegraded":"2024-09-12T01:13:48.258551+0000","last_fullsized":"2024-09-12T01:13:48.258551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:22.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'163","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.352871+0000","last_change":"2024-09-12T00:02:58.091879+0000","last_active":"2024-09-12T01:14:00.352871+0000","last_peered":"2024-09-12T01:14:00.352871+0000","last_clean":"2024-09-12T01:14:00.352871+0000","last_became_active":"2024-09-12T00:02:58.091590+0000","last_became_peered":"2024-09-12T00:02:58.091590+0000","last_unstale":"2024-09-12T01:14:00.352871+0000","last_undegraded":"2024-09-12T01:14:00.352871+0000","last_fullsized":"2024-09-12T01:14:00.352871+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:04.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1150,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":174,"num_write":425,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'450","reported_seq":1993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:40.249513+0000","last_change":"2024-09-12T00:02:50.073492+0000","last_active":"2024-09-12T01:13:40.249513+0000","last_peered":"2024-09-12T01:13:40.249513+0000","last_clean":"2024-09-12T01:13:40.249513+0000","last_became_active":"2024-09-12T00:02:50.073262+0000","last_became_peered":"2024-09-12T00:02:50.073262+0000","last_unstale":"2024-09-12T01:13:40.249513+0000","last_undegraded":"2024-09-12T01:13:40.249513+0000","last_fullsized":"2024-09-12T01:13:40.249513+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.830556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2298,"num_read_kb":2165,"num_write":516,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'158","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.234561+0000","last_change":"2024-09-12T00:02:48.053125+0000","last_active":"2024-09-12T01:15:48.234561+0000","last_peered":"2024-09-12T01:15:48.234561+0000","last_clean":"2024-09-12T01:15:48.234561+0000","last_became_active":"2024-09-12T00:02:48.052768+0000","last_became_peered":"2024-09-12T00:02:48.052768+0000","last_unstale":"2024-09-12T01:15:48.234561+0000","last_undegraded":"2024-09-12T01:15:48.234561+0000","last_fullsized":"2024-09-12T01:15:48.234561+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:37.886716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3687654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":16851,"num_write":770,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.405106+0000","last_change":"2024-09-12T00:02:37.999991+0000","last_active":"2024-09-12T01:13:38.405106+0000","last_peered":"2024-09-12T01:13:38.405106+0000","last_clean":"2024-09-12T01:13:38.405106+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T01:13:38.405106+0000","last_undegraded":"2024-09-12T01:13:38.405106+0000","last_fullsized":"2024-09-12T01:13:38.405106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622249+0000","last_change":"2024-09-12T00:02:52.069738+0000","last_active":"2024-09-12T01:13:43.622249+0000","last_peered":"2024-09-12T01:13:43.622249+0000","last_clean":"2024-09-12T01:13:43.622249+0000","last_became_active":"2024-09-12T00:02:52.069469+0000","last_became_peered":"2024-09-12T00:02:52.069469+0000","last_unstale":"2024-09-12T01:13:43.622249+0000","last_undegraded":"2024-09-12T01:13:43.622249+0000","last_fullsized":"2024-09-12T01:13:43.622249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:53.012401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'259","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.188900+0000","last_change":"2024-09-12T00:02:54.240228+0000","last_active":"2024-09-12T01:14:02.188900+0000","last_peered":"2024-09-12T01:14:02.188900+0000","last_clean":"2024-09-12T01:14:02.188900+0000","last_became_active":"2024-09-12T00:02:54.239879+0000","last_became_peered":"2024-09-12T00:02:54.239879+0000","last_unstale":"2024-09-12T01:14:02.188900+0000","last_undegraded":"2024-09-12T01:14:02.188900+0000","last_fullsized":"2024-09-12T01:14:02.188900+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:03.113532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":332,"num_read_kb":322,"num_write":304,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'793","reported_seq":5263,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.252240+0000","last_change":"2024-09-12T00:02:56.087559+0000","last_active":"2024-09-12T01:15:48.252240+0000","last_peered":"2024-09-12T01:15:48.252240+0000","last_clean":"2024-09-12T01:15:48.252240+0000","last_became_active":"2024-09-12T00:02:56.086704+0000","last_became_peered":"2024-09-12T00:02:56.086704+0000","last_unstale":"2024-09-12T01:15:48.252240+0000","last_undegraded":"2024-09-12T01:15:48.252240+0000","last_fullsized":"2024-09-12T01:15:48.252240+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:41.420237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'152","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.251702+0000","last_change":"2024-09-12T00:02:58.091748+0000","last_active":"2024-09-12T01:15:08.251702+0000","last_peered":"2024-09-12T01:15:08.251702+0000","last_clean":"2024-09-12T01:15:08.251702+0000","last_became_active":"2024-09-12T00:02:58.091466+0000","last_became_peered":"2024-09-12T00:02:58.091466+0000","last_unstale":"2024-09-12T01:15:08.251702+0000","last_undegraded":"2024-09-12T01:15:08.251702+0000","last_fullsized":"2024-09-12T01:15:08.251702+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":335,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'989","reported_seq":2652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.864836+0000","last_change":"2024-09-12T00:02:50.068181+0000","last_active":"2024-09-12T01:13:20.864836+0000","last_peered":"2024-09-12T01:13:20.864836+0000","last_clean":"2024-09-12T01:13:20.864836+0000","last_became_active":"2024-09-12T00:02:50.067868+0000","last_became_peered":"2024-09-12T00:02:50.067868+0000","last_unstale":"2024-09-12T01:13:20.864836+0000","last_undegraded":"2024-09-12T01:13:20.864836+0000","last_fullsized":"2024-09-12T01:13:20.864836+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":900,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:02.445799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4764,"num_read_kb":4246,"num_write":1341,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'174","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.168115+0000","last_change":"2024-09-12T00:02:48.052760+0000","last_active":"2024-09-12T01:15:48.168115+0000","last_peered":"2024-09-12T01:15:48.168115+0000","last_clean":"2024-09-12T01:15:48.168115+0000","last_became_active":"2024-09-12T00:02:48.052431+0000","last_became_peered":"2024-09-12T00:02:48.052431+0000","last_unstale":"2024-09-12T01:15:48.168115+0000","last_undegraded":"2024-09-12T01:15:48.168115+0000","last_fullsized":"2024-09-12T01:15:48.168115+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:51.003972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1211576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":121623,"num_write":832,"num_write_kb":33084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229731+0000","last_change":"2024-09-12T00:02:38.007684+0000","last_active":"2024-09-12T01:11:58.229731+0000","last_peered":"2024-09-12T01:11:58.229731+0000","last_clean":"2024-09-12T01:11:58.229731+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T01:11:58.229731+0000","last_undegraded":"2024-09-12T01:11:58.229731+0000","last_fullsized":"2024-09-12T01:11:58.229731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.596959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257884+0000","last_change":"2024-09-12T00:02:52.062924+0000","last_active":"2024-09-12T01:13:43.257884+0000","last_peered":"2024-09-12T01:13:43.257884+0000","last_clean":"2024-09-12T01:13:43.257884+0000","last_became_active":"2024-09-12T00:02:52.062631+0000","last_became_peered":"2024-09-12T00:02:52.062631+0000","last_unstale":"2024-09-12T01:13:43.257884+0000","last_undegraded":"2024-09-12T01:13:43.257884+0000","last_fullsized":"2024-09-12T01:13:43.257884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:03.938023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'137","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257905+0000","last_change":"2024-09-12T00:02:54.069239+0000","last_active":"2024-09-12T01:13:43.257905+0000","last_peered":"2024-09-12T01:13:43.257905+0000","last_clean":"2024-09-12T01:13:43.257905+0000","last_became_active":"2024-09-12T00:02:54.068812+0000","last_became_peered":"2024-09-12T00:02:54.068812+0000","last_unstale":"2024-09-12T01:13:43.257905+0000","last_undegraded":"2024-09-12T01:13:43.257905+0000","last_fullsized":"2024-09-12T01:13:43.257905+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:58.060604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":169,"num_write":118,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'808","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.306703+0000","last_change":"2024-09-12T00:02:56.084227+0000","last_active":"2024-09-12T01:15:48.306703+0000","last_peered":"2024-09-12T01:15:48.306703+0000","last_clean":"2024-09-12T01:15:48.306703+0000","last_became_active":"2024-09-12T00:02:56.083894+0000","last_became_peered":"2024-09-12T00:02:56.083894+0000","last_unstale":"2024-09-12T01:15:48.306703+0000","last_undegraded":"2024-09-12T01:15:48.306703+0000","last_fullsized":"2024-09-12T01:15:48.306703+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:40.096034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'273","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242702+0000","last_change":"2024-09-12T00:02:58.093731+0000","last_active":"2024-09-12T01:12:45.242702+0000","last_peered":"2024-09-12T01:12:45.242702+0000","last_clean":"2024-09-12T01:12:45.242702+0000","last_became_active":"2024-09-12T00:02:58.093442+0000","last_became_peered":"2024-09-12T00:02:58.093442+0000","last_unstale":"2024-09-12T01:12:45.242702+0000","last_undegraded":"2024-09-12T01:12:45.242702+0000","last_fullsized":"2024-09-12T01:12:45.242702+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:58.495113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":340,"num_read_kb":339,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'411","reported_seq":1918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956504+0000","last_change":"2024-09-12T00:02:50.058382+0000","last_active":"2024-09-12T01:14:02.956504+0000","last_peered":"2024-09-12T01:14:02.956504+0000","last_clean":"2024-09-12T01:14:02.956504+0000","last_became_active":"2024-09-12T00:02:50.057999+0000","last_became_peered":"2024-09-12T00:02:50.057999+0000","last_unstale":"2024-09-12T01:14:02.956504+0000","last_undegraded":"2024-09-12T01:14:02.956504+0000","last_fullsized":"2024-09-12T01:14:02.956504+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:37.001555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2267,"num_read_kb":2133,"num_write":493,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'270","reported_seq":960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:53.943324+0000","last_change":"2024-09-12T01:15:53.943324+0000","last_active":"2024-09-12T01:15:53.943324+0000","last_peered":"2024-09-12T01:15:53.943324+0000","last_clean":"2024-09-12T01:15:53.943324+0000","last_became_active":"2024-09-12T00:02:48.051495+0000","last_became_peered":"2024-09-12T00:02:48.051495+0000","last_unstale":"2024-09-12T01:15:53.943324+0000","last_undegraded":"2024-09-12T01:15:53.943324+0000","last_fullsized":"2024-09-12T01:15:53.943324+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_clean_scrub_stamp":"2024-09-12T01:15:53.943232+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:48.709674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598650,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":670,"num_read_kb":18611,"num_write":1220,"num_write_kb":43211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607868+0000","last_change":"2024-09-12T00:02:38.760426+0000","last_active":"2024-09-12T01:11:58.607868+0000","last_peered":"2024-09-12T01:11:58.607868+0000","last_clean":"2024-09-12T01:11:58.607868+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T01:11:58.607868+0000","last_undegraded":"2024-09-12T01:11:58.607868+0000","last_fullsized":"2024-09-12T01:11:58.607868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:34.971635+0000","last_clean_scrub_stamp":"2024-09-12T00:02:34.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:03.698275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455282+0000","last_change":"2024-09-12T00:02:52.062908+0000","last_active":"2024-09-12T01:12:58.455282+0000","last_peered":"2024-09-12T01:12:58.455282+0000","last_clean":"2024-09-12T01:12:58.455282+0000","last_became_active":"2024-09-12T00:02:52.062544+0000","last_became_peered":"2024-09-12T00:02:52.062544+0000","last_unstale":"2024-09-12T01:12:58.455282+0000","last_undegraded":"2024-09-12T01:12:58.455282+0000","last_fullsized":"2024-09-12T01:12:58.455282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:54.138905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'358","reported_seq":1105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.290569+0000","last_change":"2024-09-12T00:02:54.239678+0000","last_active":"2024-09-12T01:15:48.290569+0000","last_peered":"2024-09-12T01:15:48.290569+0000","last_clean":"2024-09-12T01:15:48.290569+0000","last_became_active":"2024-09-12T00:02:54.239355+0000","last_became_peered":"2024-09-12T00:02:54.239355+0000","last_unstale":"2024-09-12T01:15:48.290569+0000","last_undegraded":"2024-09-12T01:15:48.290569+0000","last_fullsized":"2024-09-12T01:15:48.290569+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:10.540534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":736,"num_write":272,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.240098+0000","last_change":"2024-09-12T00:02:56.087894+0000","last_active":"2024-09-12T01:13:48.240098+0000","last_peered":"2024-09-12T01:13:48.240098+0000","last_clean":"2024-09-12T01:13:48.240098+0000","last_became_active":"2024-09-12T00:02:56.087448+0000","last_became_peered":"2024-09-12T00:02:56.087448+0000","last_unstale":"2024-09-12T01:13:48.240098+0000","last_undegraded":"2024-09-12T01:13:48.240098+0000","last_fullsized":"2024-09-12T01:13:48.240098+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:19.357528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'125","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.291357+0000","last_change":"2024-09-12T00:02:58.100159+0000","last_active":"2024-09-12T01:12:58.291357+0000","last_peered":"2024-09-12T01:12:58.291357+0000","last_clean":"2024-09-12T01:12:58.291357+0000","last_became_active":"2024-09-12T00:02:58.099906+0000","last_became_peered":"2024-09-12T00:02:58.099906+0000","last_unstale":"2024-09-12T01:12:58.291357+0000","last_undegraded":"2024-09-12T01:12:58.291357+0000","last_fullsized":"2024-09-12T01:12:58.291357+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:36.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":140,"num_write":299,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'130","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.739979+0000","last_change":"2024-09-12T00:02:58.099964+0000","last_active":"2024-09-12T01:15:09.739979+0000","last_peered":"2024-09-12T01:15:09.739979+0000","last_clean":"2024-09-12T01:15:09.739979+0000","last_became_active":"2024-09-12T00:02:58.099564+0000","last_became_peered":"2024-09-12T00:02:58.099564+0000","last_unstale":"2024-09-12T01:15:09.739979+0000","last_undegraded":"2024-09-12T01:15:09.739979+0000","last_fullsized":"2024-09-12T01:15:09.739979+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":201,"num_write":295,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'827","reported_seq":2372,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.862987+0000","last_change":"2024-09-12T00:02:50.064386+0000","last_active":"2024-09-12T01:13:20.862987+0000","last_peered":"2024-09-12T01:13:20.862987+0000","last_clean":"2024-09-12T01:13:20.862987+0000","last_became_active":"2024-09-12T00:02:50.063351+0000","last_became_peered":"2024-09-12T00:02:50.063351+0000","last_unstale":"2024-09-12T01:13:20.862987+0000","last_undegraded":"2024-09-12T01:13:20.862987+0000","last_fullsized":"2024-09-12T01:13:20.862987+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:44.265606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3851,"num_read_kb":3457,"num_write":1080,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'158","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.079218+0000","last_change":"2024-09-12T00:02:48.048545+0000","last_active":"2024-09-12T01:15:48.079218+0000","last_peered":"2024-09-12T01:15:48.079218+0000","last_clean":"2024-09-12T01:15:48.079218+0000","last_became_active":"2024-09-12T00:02:48.047723+0000","last_became_peered":"2024-09-12T00:02:48.047723+0000","last_unstale":"2024-09-12T01:15:48.079218+0000","last_undegraded":"2024-09-12T01:15:48.079218+0000","last_fullsized":"2024-09-12T01:15:48.079218+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:13.827704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":26182,"num_write":818,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.235888+0000","last_change":"2024-09-12T00:02:52.067136+0000","last_active":"2024-09-12T01:12:53.235888+0000","last_peered":"2024-09-12T01:12:53.235888+0000","last_clean":"2024-09-12T01:12:53.235888+0000","last_became_active":"2024-09-12T00:02:52.066702+0000","last_became_peered":"2024-09-12T00:02:52.066702+0000","last_unstale":"2024-09-12T01:12:53.235888+0000","last_undegraded":"2024-09-12T01:12:53.235888+0000","last_fullsized":"2024-09-12T01:12:53.235888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:51.618720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'196","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.171053+0000","last_change":"2024-09-12T00:02:54.067156+0000","last_active":"2024-09-12T01:15:48.171053+0000","last_peered":"2024-09-12T01:15:48.171053+0000","last_clean":"2024-09-12T01:15:48.171053+0000","last_became_active":"2024-09-12T00:02:54.066679+0000","last_became_peered":"2024-09-12T00:02:54.066679+0000","last_unstale":"2024-09-12T01:15:48.171053+0000","last_undegraded":"2024-09-12T01:15:48.171053+0000","last_fullsized":"2024-09-12T01:15:48.171053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:44.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":343,"num_write":152,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455258+0000","last_change":"2024-09-12T00:02:56.081781+0000","last_active":"2024-09-12T01:12:58.455258+0000","last_peered":"2024-09-12T01:12:58.455258+0000","last_clean":"2024-09-12T01:12:58.455258+0000","last_became_active":"2024-09-12T00:02:56.081445+0000","last_became_peered":"2024-09-12T00:02:56.081445+0000","last_unstale":"2024-09-12T01:12:58.455258+0000","last_undegraded":"2024-09-12T01:12:58.455258+0000","last_fullsized":"2024-09-12T01:12:58.455258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.185278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'151","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.456004+0000","last_change":"2024-09-12T00:02:58.097284+0000","last_active":"2024-09-12T01:13:03.456004+0000","last_peered":"2024-09-12T01:13:03.456004+0000","last_clean":"2024-09-12T01:13:03.456004+0000","last_became_active":"2024-09-12T00:02:58.096979+0000","last_became_peered":"2024-09-12T00:02:58.096979+0000","last_unstale":"2024-09-12T01:13:03.456004+0000","last_undegraded":"2024-09-12T01:13:03.456004+0000","last_fullsized":"2024-09-12T01:13:03.456004+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:10.194576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":142,"num_write":377,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'428","reported_seq":1977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.278516+0000","last_change":"2024-09-12T00:02:50.066578+0000","last_active":"2024-09-12T01:13:32.278516+0000","last_peered":"2024-09-12T01:13:32.278516+0000","last_clean":"2024-09-12T01:13:32.278516+0000","last_became_active":"2024-09-12T00:02:50.065307+0000","last_became_peered":"2024-09-12T00:02:50.065307+0000","last_unstale":"2024-09-12T01:13:32.278516+0000","last_undegraded":"2024-09-12T01:13:32.278516+0000","last_fullsized":"2024-09-12T01:13:32.278516+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:31.996369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2299,"num_read_kb":2174,"num_write":505,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'162","reported_seq":774,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.163753+0000","last_change":"2024-09-12T00:02:48.051718+0000","last_active":"2024-09-12T01:15:48.163753+0000","last_peered":"2024-09-12T01:15:48.163753+0000","last_clean":"2024-09-12T01:15:48.163753+0000","last_became_active":"2024-09-12T00:02:48.048506+0000","last_became_peered":"2024-09-12T00:02:48.048506+0000","last_unstale":"2024-09-12T01:15:48.163753+0000","last_undegraded":"2024-09-12T01:15:48.163753+0000","last_fullsized":"2024-09-12T01:15:48.163753+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:49.124459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":321,"num_read_kb":61867,"num_write":777,"num_write_kb":44911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.454749+0000","last_change":"2024-09-12T00:02:52.065265+0000","last_active":"2024-09-12T01:12:53.454749+0000","last_peered":"2024-09-12T01:12:53.454749+0000","last_clean":"2024-09-12T01:12:53.454749+0000","last_became_active":"2024-09-12T00:02:52.064967+0000","last_became_peered":"2024-09-12T00:02:52.064967+0000","last_unstale":"2024-09-12T01:12:53.454749+0000","last_undegraded":"2024-09-12T01:12:53.454749+0000","last_fullsized":"2024-09-12T01:12:53.454749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.210086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'59","reported_seq":576,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.171183+0000","last_change":"2024-09-12T00:02:54.067540+0000","last_active":"2024-09-12T01:13:29.171183+0000","last_peered":"2024-09-12T01:13:29.171183+0000","last_clean":"2024-09-12T01:13:29.171183+0000","last_became_active":"2024-09-12T00:02:54.067255+0000","last_became_peered":"2024-09-12T00:02:54.067255+0000","last_unstale":"2024-09-12T01:13:29.171183+0000","last_undegraded":"2024-09-12T01:13:29.171183+0000","last_fullsized":"2024-09-12T01:13:29.171183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:18.453952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399626+0000","last_change":"2024-09-12T00:02:56.079344+0000","last_active":"2024-09-12T01:12:58.399626+0000","last_peered":"2024-09-12T01:12:58.399626+0000","last_clean":"2024-09-12T01:12:58.399626+0000","last_became_active":"2024-09-12T00:02:56.079057+0000","last_became_peered":"2024-09-12T00:02:56.079057+0000","last_unstale":"2024-09-12T01:12:58.399626+0000","last_undegraded":"2024-09-12T01:12:58.399626+0000","last_fullsized":"2024-09-12T01:12:58.399626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:17.425376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'185","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.012822+0000","last_change":"2024-09-12T00:02:58.091784+0000","last_active":"2024-09-12T01:14:03.012822+0000","last_peered":"2024-09-12T01:14:03.012822+0000","last_clean":"2024-09-12T01:14:03.012822+0000","last_became_active":"2024-09-12T00:02:58.091505+0000","last_became_peered":"2024-09-12T00:02:58.091505+0000","last_unstale":"2024-09-12T01:14:03.012822+0000","last_undegraded":"2024-09-12T01:14:03.012822+0000","last_fullsized":"2024-09-12T01:14:03.012822+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:32.965615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":268,"num_read_kb":263,"num_write":396,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'443","reported_seq":1915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.057934+0000","last_change":"2024-09-12T00:02:50.068429+0000","last_active":"2024-09-12T01:13:06.057934+0000","last_peered":"2024-09-12T01:13:06.057934+0000","last_clean":"2024-09-12T01:13:06.057934+0000","last_became_active":"2024-09-12T00:02:50.068129+0000","last_became_peered":"2024-09-12T00:02:50.068129+0000","last_unstale":"2024-09-12T01:13:06.057934+0000","last_undegraded":"2024-09-12T01:13:06.057934+0000","last_fullsized":"2024-09-12T01:13:06.057934+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:38.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2203,"num_read_kb":2070,"num_write":514,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'206","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.261460+0000","last_change":"2024-09-12T00:02:48.050120+0000","last_active":"2024-09-12T01:15:48.261460+0000","last_peered":"2024-09-12T01:15:48.261460+0000","last_clean":"2024-09-12T01:15:48.261460+0000","last_became_active":"2024-09-12T00:02:48.049791+0000","last_became_peered":"2024-09-12T00:02:48.049791+0000","last_unstale":"2024-09-12T01:15:48.261460+0000","last_undegraded":"2024-09-12T01:15:48.261460+0000","last_fullsized":"2024-09-12T01:15:48.261460+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:02.402223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":116478,"num_write":1001,"num_write_kb":35286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398938+0000","last_change":"2024-09-12T00:02:52.071771+0000","last_active":"2024-09-12T01:12:53.398938+0000","last_peered":"2024-09-12T01:12:53.398938+0000","last_clean":"2024-09-12T01:12:53.398938+0000","last_became_active":"2024-09-12T00:02:52.071502+0000","last_became_peered":"2024-09-12T00:02:52.071502+0000","last_unstale":"2024-09-12T01:12:53.398938+0000","last_undegraded":"2024-09-12T01:12:53.398938+0000","last_fullsized":"2024-09-12T01:12:53.398938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:36.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'203","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.061053+0000","last_change":"2024-09-12T00:02:54.069300+0000","last_active":"2024-09-12T01:15:48.061053+0000","last_peered":"2024-09-12T01:15:48.061053+0000","last_clean":"2024-09-12T01:15:48.061053+0000","last_became_active":"2024-09-12T00:02:54.067314+0000","last_became_peered":"2024-09-12T00:02:54.067314+0000","last_unstale":"2024-09-12T01:15:48.061053+0000","last_undegraded":"2024-09-12T01:15:48.061053+0000","last_fullsized":"2024-09-12T01:15:48.061053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:25.593409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18955,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":388,"num_write":160,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616059+0000","last_change":"2024-09-12T00:02:56.084951+0000","last_active":"2024-09-12T01:12:58.616059+0000","last_peered":"2024-09-12T01:12:58.616059+0000","last_clean":"2024-09-12T01:12:58.616059+0000","last_became_active":"2024-09-12T00:02:56.084651+0000","last_became_peered":"2024-09-12T00:02:56.084651+0000","last_unstale":"2024-09-12T01:12:58.616059+0000","last_undegraded":"2024-09-12T01:12:58.616059+0000","last_fullsized":"2024-09-12T01:12:58.616059+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.763159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'155","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:05.706621+0000","last_change":"2024-09-12T00:02:58.100001+0000","last_active":"2024-09-12T01:13:05.706621+0000","last_peered":"2024-09-12T01:13:05.706621+0000","last_clean":"2024-09-12T01:13:05.706621+0000","last_became_active":"2024-09-12T00:02:58.099635+0000","last_became_peered":"2024-09-12T00:02:58.099635+0000","last_unstale":"2024-09-12T01:13:05.706621+0000","last_undegraded":"2024-09-12T01:13:05.706621+0000","last_fullsized":"2024-09-12T01:13:05.706621+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":359,"num_read_kb":309,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'637","reported_seq":2521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749291+0000","last_change":"2024-09-12T00:02:50.068821+0000","last_active":"2024-09-12T01:15:09.749291+0000","last_peered":"2024-09-12T01:15:09.749291+0000","last_clean":"2024-09-12T01:15:09.749291+0000","last_became_active":"2024-09-12T00:02:50.068518+0000","last_became_peered":"2024-09-12T00:02:50.068518+0000","last_unstale":"2024-09-12T01:15:09.749291+0000","last_undegraded":"2024-09-12T01:15:09.749291+0000","last_fullsized":"2024-09-12T01:15:09.749291+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":600,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:48.137188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3685,"num_read_kb":3433,"num_write":846,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'197","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.278567+0000","last_change":"2024-09-12T00:02:48.055024+0000","last_active":"2024-09-12T01:15:48.278567+0000","last_peered":"2024-09-12T01:15:48.278567+0000","last_clean":"2024-09-12T01:15:48.278567+0000","last_became_active":"2024-09-12T00:02:48.054056+0000","last_became_peered":"2024-09-12T00:02:48.054056+0000","last_unstale":"2024-09-12T01:15:48.278567+0000","last_undegraded":"2024-09-12T01:15:48.278567+0000","last_fullsized":"2024-09-12T01:15:48.278567+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:26.535088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493919,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":69874,"num_write":900,"num_write_kb":25144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.615384+0000","last_change":"2024-09-12T00:02:52.064704+0000","last_active":"2024-09-12T01:12:53.615384+0000","last_peered":"2024-09-12T01:12:53.615384+0000","last_clean":"2024-09-12T01:12:53.615384+0000","last_became_active":"2024-09-12T00:02:52.064441+0000","last_became_peered":"2024-09-12T00:02:52.064441+0000","last_unstale":"2024-09-12T01:12:53.615384+0000","last_undegraded":"2024-09-12T01:12:53.615384+0000","last_fullsized":"2024-09-12T01:12:53.615384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:59.801795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'141","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.035158+0000","last_change":"2024-09-12T00:02:54.067331+0000","last_active":"2024-09-12T01:15:48.035158+0000","last_peered":"2024-09-12T01:15:48.035158+0000","last_clean":"2024-09-12T01:15:48.035158+0000","last_became_active":"2024-09-12T00:02:54.066900+0000","last_became_peered":"2024-09-12T00:02:54.066900+0000","last_unstale":"2024-09-12T01:15:48.035158+0000","last_undegraded":"2024-09-12T01:15:48.035158+0000","last_fullsized":"2024-09-12T01:15:48.035158+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:20.920036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243955+0000","last_change":"2024-09-12T00:02:56.085678+0000","last_active":"2024-09-12T01:12:55.243955+0000","last_peered":"2024-09-12T01:12:55.243955+0000","last_clean":"2024-09-12T01:12:55.243955+0000","last_became_active":"2024-09-12T00:02:56.084454+0000","last_became_peered":"2024-09-12T00:02:56.084454+0000","last_unstale":"2024-09-12T01:12:55.243955+0000","last_undegraded":"2024-09-12T01:12:55.243955+0000","last_fullsized":"2024-09-12T01:12:55.243955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.942660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'810","reported_seq":2284,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128303+0000","last_change":"2024-09-12T00:02:50.072883+0000","last_active":"2024-09-12T01:14:04.128303+0000","last_peered":"2024-09-12T01:14:04.128303+0000","last_clean":"2024-09-12T01:14:04.128303+0000","last_became_active":"2024-09-12T00:02:50.072570+0000","last_became_peered":"2024-09-12T00:02:50.072570+0000","last_unstale":"2024-09-12T01:14:04.128303+0000","last_undegraded":"2024-09-12T01:14:04.128303+0000","last_fullsized":"2024-09-12T01:14:04.128303+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:59.471970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3795,"num_read_kb":3393,"num_write":1092,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'152","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.115853+0000","last_change":"2024-09-12T00:02:48.050380+0000","last_active":"2024-09-12T01:15:48.115853+0000","last_peered":"2024-09-12T01:15:48.115853+0000","last_clean":"2024-09-12T01:15:48.115853+0000","last_became_active":"2024-09-12T00:02:48.050025+0000","last_became_peered":"2024-09-12T00:02:48.050025+0000","last_unstale":"2024-09-12T01:15:48.115853+0000","last_undegraded":"2024-09-12T01:15:48.115853+0000","last_fullsized":"2024-09-12T01:15:48.115853+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:32.062297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":278,"num_read_kb":9330,"num_write":746,"num_write_kb":34876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:10.245905+0000","last_change":"2024-09-12T00:02:52.071470+0000","last_active":"2024-09-12T01:13:10.245905+0000","last_peered":"2024-09-12T01:13:10.245905+0000","last_clean":"2024-09-12T01:13:10.245905+0000","last_became_active":"2024-09-12T00:02:52.071201+0000","last_became_peered":"2024-09-12T00:02:52.071201+0000","last_unstale":"2024-09-12T01:13:10.245905+0000","last_undegraded":"2024-09-12T01:13:10.245905+0000","last_fullsized":"2024-09-12T01:13:10.245905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.887009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'225","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.215655+0000","last_change":"2024-09-12T00:02:54.073975+0000","last_active":"2024-09-12T01:15:48.215655+0000","last_peered":"2024-09-12T01:15:48.215655+0000","last_clean":"2024-09-12T01:15:48.215655+0000","last_became_active":"2024-09-12T00:02:54.073541+0000","last_became_peered":"2024-09-12T00:02:54.073541+0000","last_unstale":"2024-09-12T01:15:48.215655+0000","last_undegraded":"2024-09-12T01:15:48.215655+0000","last_fullsized":"2024-09-12T01:15:48.215655+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.658572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15168,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":358,"num_read_kb":528,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510916+0000","last_change":"2024-09-12T00:02:56.084926+0000","last_active":"2024-09-12T01:12:58.510916+0000","last_peered":"2024-09-12T01:12:58.510916+0000","last_clean":"2024-09-12T01:12:58.510916+0000","last_became_active":"2024-09-12T00:02:56.084627+0000","last_became_peered":"2024-09-12T00:02:56.084627+0000","last_unstale":"2024-09-12T01:12:58.510916+0000","last_undegraded":"2024-09-12T01:12:58.510916+0000","last_fullsized":"2024-09-12T01:12:58.510916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:48.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'184","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.259373+0000","last_change":"2024-09-12T00:02:58.090856+0000","last_active":"2024-09-12T01:14:04.259373+0000","last_peered":"2024-09-12T01:14:04.259373+0000","last_clean":"2024-09-12T01:14:04.259373+0000","last_became_active":"2024-09-12T00:02:58.089750+0000","last_became_peered":"2024-09-12T00:02:58.089750+0000","last_unstale":"2024-09-12T01:14:04.259373+0000","last_undegraded":"2024-09-12T01:14:04.259373+0000","last_fullsized":"2024-09-12T01:14:04.259373+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:39.825708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":234,"num_read_kb":235,"num_write":422,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'478","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.723839+0000","last_change":"2024-09-12T00:02:50.064457+0000","last_active":"2024-09-12T01:15:09.723839+0000","last_peered":"2024-09-12T01:15:09.723839+0000","last_clean":"2024-09-12T01:15:09.723839+0000","last_became_active":"2024-09-12T00:02:50.064157+0000","last_became_peered":"2024-09-12T00:02:50.064157+0000","last_unstale":"2024-09-12T01:15:09.723839+0000","last_undegraded":"2024-09-12T01:15:09.723839+0000","last_fullsized":"2024-09-12T01:15:09.723839+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:29.208142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2183,"num_write":585,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'252","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041430+0000","last_change":"2024-09-12T00:02:48.053735+0000","last_active":"2024-09-12T01:15:48.041430+0000","last_peered":"2024-09-12T01:15:48.041430+0000","last_clean":"2024-09-12T01:15:48.041430+0000","last_became_active":"2024-09-12T00:02:48.053055+0000","last_became_peered":"2024-09-12T00:02:48.053055+0000","last_unstale":"2024-09-12T01:15:48.041430+0000","last_undegraded":"2024-09-12T01:15:48.041430+0000","last_fullsized":"2024-09-12T01:15:48.041430+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:59.588429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":662,"num_read_kb":2689,"num_write":1334,"num_write_kb":25481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622306+0000","last_change":"2024-09-12T00:02:52.060376+0000","last_active":"2024-09-12T01:13:43.622306+0000","last_peered":"2024-09-12T01:13:43.622306+0000","last_clean":"2024-09-12T01:13:43.622306+0000","last_became_active":"2024-09-12T00:02:52.060034+0000","last_became_peered":"2024-09-12T00:02:52.060034+0000","last_unstale":"2024-09-12T01:13:43.622306+0000","last_undegraded":"2024-09-12T01:13:43.622306+0000","last_fullsized":"2024-09-12T01:13:43.622306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:47.319586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'197","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.045639+0000","last_change":"2024-09-12T00:02:54.067256+0000","last_active":"2024-09-12T01:15:48.045639+0000","last_peered":"2024-09-12T01:15:48.045639+0000","last_clean":"2024-09-12T01:15:48.045639+0000","last_became_active":"2024-09-12T00:02:54.066854+0000","last_became_peered":"2024-09-12T00:02:54.066854+0000","last_unstale":"2024-09-12T01:15:48.045639+0000","last_undegraded":"2024-09-12T01:15:48.045639+0000","last_fullsized":"2024-09-12T01:15:48.045639+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:56.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":290,"num_read_kb":407,"num_write":194,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.236453+0000","last_change":"2024-09-12T00:02:56.086661+0000","last_active":"2024-09-12T01:12:58.236453+0000","last_peered":"2024-09-12T01:12:58.236453+0000","last_clean":"2024-09-12T01:12:58.236453+0000","last_became_active":"2024-09-12T00:02:56.086349+0000","last_became_peered":"2024-09-12T00:02:56.086349+0000","last_unstale":"2024-09-12T01:12:58.236453+0000","last_undegraded":"2024-09-12T01:12:58.236453+0000","last_fullsized":"2024-09-12T01:12:58.236453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:32.352621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'169","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.265206+0000","last_change":"2024-09-12T00:02:58.100935+0000","last_active":"2024-09-12T01:14:04.265206+0000","last_peered":"2024-09-12T01:14:04.265206+0000","last_clean":"2024-09-12T01:14:04.265206+0000","last_became_active":"2024-09-12T00:02:58.100646+0000","last_became_peered":"2024-09-12T00:02:58.100646+0000","last_unstale":"2024-09-12T01:14:04.265206+0000","last_undegraded":"2024-09-12T01:14:04.265206+0000","last_fullsized":"2024-09-12T01:14:04.265206+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:32.687456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":591,"num_write":465,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'695","reported_seq":2038,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127708+0000","last_change":"2024-09-12T00:02:50.072964+0000","last_active":"2024-09-12T01:14:04.127708+0000","last_peered":"2024-09-12T01:14:04.127708+0000","last_clean":"2024-09-12T01:14:04.127708+0000","last_became_active":"2024-09-12T00:02:50.072665+0000","last_became_peered":"2024-09-12T00:02:50.072665+0000","last_unstale":"2024-09-12T01:14:04.127708+0000","last_undegraded":"2024-09-12T01:14:04.127708+0000","last_fullsized":"2024-09-12T01:14:04.127708+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.757307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3202,"num_read_kb":2877,"num_write":917,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'241","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.257333+0000","last_change":"2024-09-12T00:03:21.140521+0000","last_active":"2024-09-12T01:15:48.257333+0000","last_peered":"2024-09-12T01:15:48.257333+0000","last_clean":"2024-09-12T01:15:48.257333+0000","last_became_active":"2024-09-12T00:03:21.140095+0000","last_became_peered":"2024-09-12T00:03:21.140095+0000","last_unstale":"2024-09-12T01:15:48.257333+0000","last_undegraded":"2024-09-12T01:15:48.257333+0000","last_fullsized":"2024-09-12T01:15:48.257333+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:55.899923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":39289,"num_write":1009,"num_write_kb":58524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397483+0000","last_change":"2024-09-12T00:02:52.063849+0000","last_active":"2024-09-12T01:12:53.397483+0000","last_peered":"2024-09-12T01:12:53.397483+0000","last_clean":"2024-09-12T01:12:53.397483+0000","last_became_active":"2024-09-12T00:02:52.063334+0000","last_became_peered":"2024-09-12T00:02:52.063334+0000","last_unstale":"2024-09-12T01:12:53.397483+0000","last_undegraded":"2024-09-12T01:12:53.397483+0000","last_fullsized":"2024-09-12T01:12:53.397483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:03.747256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.197503+0000","last_change":"2024-09-12T00:02:54.240449+0000","last_active":"2024-09-12T01:15:48.197503+0000","last_peered":"2024-09-12T01:15:48.197503+0000","last_clean":"2024-09-12T01:15:48.197503+0000","last_became_active":"2024-09-12T00:02:54.240007+0000","last_became_peered":"2024-09-12T00:02:54.240007+0000","last_unstale":"2024-09-12T01:15:48.197503+0000","last_undegraded":"2024-09-12T01:15:48.197503+0000","last_fullsized":"2024-09-12T01:15:48.197503+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:58.601042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":288,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.238159+0000","last_change":"2024-09-12T00:02:56.087660+0000","last_active":"2024-09-12T01:13:13.238159+0000","last_peered":"2024-09-12T01:13:13.238159+0000","last_clean":"2024-09-12T01:13:13.238159+0000","last_became_active":"2024-09-12T00:02:56.087317+0000","last_became_peered":"2024-09-12T00:02:56.087317+0000","last_unstale":"2024-09-12T01:13:13.238159+0000","last_undegraded":"2024-09-12T01:13:13.238159+0000","last_fullsized":"2024-09-12T01:13:13.238159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:30.847202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'148","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.905755+0000","last_change":"2024-09-12T00:02:58.099988+0000","last_active":"2024-09-12T01:15:10.905755+0000","last_peered":"2024-09-12T01:15:10.905755+0000","last_clean":"2024-09-12T01:15:10.905755+0000","last_became_active":"2024-09-12T00:02:58.099712+0000","last_became_peered":"2024-09-12T00:02:58.099712+0000","last_unstale":"2024-09-12T01:15:10.905755+0000","last_undegraded":"2024-09-12T01:15:10.905755+0000","last_fullsized":"2024-09-12T01:15:10.905755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.021756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'706","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.058665+0000","last_change":"2024-09-12T00:02:50.062196+0000","last_active":"2024-09-12T01:13:06.058665+0000","last_peered":"2024-09-12T01:13:06.058665+0000","last_clean":"2024-09-12T01:13:06.058665+0000","last_became_active":"2024-09-12T00:02:50.061909+0000","last_became_peered":"2024-09-12T00:02:50.061909+0000","last_unstale":"2024-09-12T01:13:06.058665+0000","last_undegraded":"2024-09-12T01:13:06.058665+0000","last_fullsized":"2024-09-12T01:13:06.058665+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":600,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:59.811798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3690,"num_read_kb":3334,"num_write":961,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'201","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.212146+0000","last_change":"2024-09-12T00:02:48.051220+0000","last_active":"2024-09-12T01:15:48.212146+0000","last_peered":"2024-09-12T01:15:48.212146+0000","last_clean":"2024-09-12T01:15:48.212146+0000","last_became_active":"2024-09-12T00:02:48.050894+0000","last_became_peered":"2024-09-12T00:02:48.050894+0000","last_unstale":"2024-09-12T01:15:48.212146+0000","last_undegraded":"2024-09-12T01:15:48.212146+0000","last_fullsized":"2024-09-12T01:15:48.212146+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:06.067280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409979,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":20890,"num_write":1012,"num_write_kb":39832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.235936+0000","last_change":"2024-09-12T00:02:52.064983+0000","last_active":"2024-09-12T01:12:53.235936+0000","last_peered":"2024-09-12T01:12:53.235936+0000","last_clean":"2024-09-12T01:12:53.235936+0000","last_became_active":"2024-09-12T00:02:52.064125+0000","last_became_peered":"2024-09-12T00:02:52.064125+0000","last_unstale":"2024-09-12T01:12:53.235936+0000","last_undegraded":"2024-09-12T01:12:53.235936+0000","last_fullsized":"2024-09-12T01:12:53.235936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:32.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'111","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.555449+0000","last_change":"2024-09-12T00:02:54.239923+0000","last_active":"2024-09-12T01:13:29.555449+0000","last_peered":"2024-09-12T01:13:29.555449+0000","last_clean":"2024-09-12T01:13:29.555449+0000","last_became_active":"2024-09-12T00:02:54.239412+0000","last_became_peered":"2024-09-12T00:02:54.239412+0000","last_unstale":"2024-09-12T01:13:29.555449+0000","last_undegraded":"2024-09-12T01:13:29.555449+0000","last_fullsized":"2024-09-12T01:13:29.555449+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.570833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'772","reported_seq":2646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.301474+0000","last_change":"2024-09-12T00:02:56.080694+0000","last_active":"2024-09-12T01:15:48.301474+0000","last_peered":"2024-09-12T01:15:48.301474+0000","last_clean":"2024-09-12T01:15:48.301474+0000","last_became_active":"2024-09-12T00:02:56.080374+0000","last_became_peered":"2024-09-12T00:02:56.080374+0000","last_unstale":"2024-09-12T01:15:48.301474+0000","last_undegraded":"2024-09-12T01:15:48.301474+0000","last_fullsized":"2024-09-12T01:15:48.301474+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:02.095265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'116","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399596+0000","last_change":"2024-09-12T00:02:58.101477+0000","last_active":"2024-09-12T01:12:58.399596+0000","last_peered":"2024-09-12T01:12:58.399596+0000","last_clean":"2024-09-12T01:12:58.399596+0000","last_became_active":"2024-09-12T00:02:58.100777+0000","last_became_peered":"2024-09-12T00:02:58.100777+0000","last_unstale":"2024-09-12T01:12:58.399596+0000","last_undegraded":"2024-09-12T01:12:58.399596+0000","last_fullsized":"2024-09-12T01:12:58.399596+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:03.981795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'472","reported_seq":2034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127865+0000","last_change":"2024-09-12T00:02:50.070545+0000","last_active":"2024-09-12T01:14:04.127865+0000","last_peered":"2024-09-12T01:14:04.127865+0000","last_clean":"2024-09-12T01:14:04.127865+0000","last_became_active":"2024-09-12T00:02:50.070186+0000","last_became_peered":"2024-09-12T00:02:50.070186+0000","last_unstale":"2024-09-12T01:14:04.127865+0000","last_undegraded":"2024-09-12T01:14:04.127865+0000","last_fullsized":"2024-09-12T01:14:04.127865+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:36.641202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2560,"num_read_kb":2381,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'280","reported_seq":956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.257256+0000","last_change":"2024-09-12T00:02:48.055180+0000","last_active":"2024-09-12T01:15:48.257256+0000","last_peered":"2024-09-12T01:15:48.257256+0000","last_clean":"2024-09-12T01:15:48.257256+0000","last_became_active":"2024-09-12T00:02:48.054303+0000","last_became_peered":"2024-09-12T00:02:48.054303+0000","last_unstale":"2024-09-12T01:15:48.257256+0000","last_undegraded":"2024-09-12T01:15:48.257256+0000","last_fullsized":"2024-09-12T01:15:48.257256+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:53.174386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":47582,"num_write":1191,"num_write_kb":28572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399009+0000","last_change":"2024-09-12T00:02:52.071857+0000","last_active":"2024-09-12T01:12:53.399009+0000","last_peered":"2024-09-12T01:12:53.399009+0000","last_clean":"2024-09-12T01:12:53.399009+0000","last_became_active":"2024-09-12T00:02:52.071580+0000","last_became_peered":"2024-09-12T00:02:52.071580+0000","last_unstale":"2024-09-12T01:12:53.399009+0000","last_undegraded":"2024-09-12T01:12:53.399009+0000","last_fullsized":"2024-09-12T01:12:53.399009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:15.575099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'229","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.250455+0000","last_change":"2024-09-12T00:02:54.069107+0000","last_active":"2024-09-12T01:15:48.250455+0000","last_peered":"2024-09-12T01:15:48.250455+0000","last_clean":"2024-09-12T01:15:48.250455+0000","last_became_active":"2024-09-12T00:02:54.068806+0000","last_became_peered":"2024-09-12T00:02:54.068806+0000","last_unstale":"2024-09-12T01:15:48.250455+0000","last_undegraded":"2024-09-12T01:15:48.250455+0000","last_fullsized":"2024-09-12T01:15:48.250455+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:03.065780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9605,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":355,"num_write":182,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244538+0000","last_change":"2024-09-12T00:02:56.083225+0000","last_active":"2024-09-12T01:13:00.244538+0000","last_peered":"2024-09-12T01:13:00.244538+0000","last_clean":"2024-09-12T01:13:00.244538+0000","last_became_active":"2024-09-12T00:02:56.082924+0000","last_became_peered":"2024-09-12T00:02:56.082924+0000","last_unstale":"2024-09-12T01:13:00.244538+0000","last_undegraded":"2024-09-12T01:13:00.244538+0000","last_fullsized":"2024-09-12T01:13:00.244538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:14.433764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'109","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.113160+0000","last_change":"2024-09-12T00:02:58.099967+0000","last_active":"2024-09-12T01:14:04.113160+0000","last_peered":"2024-09-12T01:14:04.113160+0000","last_clean":"2024-09-12T01:14:04.113160+0000","last_became_active":"2024-09-12T00:02:58.099683+0000","last_became_peered":"2024-09-12T00:02:58.099683+0000","last_unstale":"2024-09-12T01:14:04.113160+0000","last_undegraded":"2024-09-12T01:14:04.113160+0000","last_fullsized":"2024-09-12T01:14:04.113160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:14.241268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":199,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'538","reported_seq":2265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748583+0000","last_change":"2024-09-12T00:02:50.070201+0000","last_active":"2024-09-12T01:15:09.748583+0000","last_peered":"2024-09-12T01:15:09.748583+0000","last_clean":"2024-09-12T01:15:09.748583+0000","last_became_active":"2024-09-12T00:02:50.069907+0000","last_became_peered":"2024-09-12T00:02:50.069907+0000","last_unstale":"2024-09-12T01:15:09.748583+0000","last_undegraded":"2024-09-12T01:15:09.748583+0000","last_fullsized":"2024-09-12T01:15:09.748583+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:16.483724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2946,"num_read_kb":2752,"num_write":643,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'210","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203279+0000","last_change":"2024-09-12T00:02:48.054530+0000","last_active":"2024-09-12T01:15:48.203279+0000","last_peered":"2024-09-12T01:15:48.203279+0000","last_clean":"2024-09-12T01:15:48.203279+0000","last_became_active":"2024-09-12T00:02:48.052303+0000","last_became_peered":"2024-09-12T00:02:48.052303+0000","last_unstale":"2024-09-12T01:15:48.203279+0000","last_undegraded":"2024-09-12T01:15:48.203279+0000","last_fullsized":"2024-09-12T01:15:48.203279+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:02.915896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":51729,"num_write":985,"num_write_kb":45446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510194+0000","last_change":"2024-09-12T00:02:52.066240+0000","last_active":"2024-09-12T01:12:53.510194+0000","last_peered":"2024-09-12T01:12:53.510194+0000","last_clean":"2024-09-12T01:12:53.510194+0000","last_became_active":"2024-09-12T00:02:52.065653+0000","last_became_peered":"2024-09-12T00:02:52.065653+0000","last_unstale":"2024-09-12T01:12:53.510194+0000","last_undegraded":"2024-09-12T01:12:53.510194+0000","last_fullsized":"2024-09-12T01:12:53.510194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'152","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.266147+0000","last_change":"2024-09-12T00:02:54.074579+0000","last_active":"2024-09-12T01:15:48.266147+0000","last_peered":"2024-09-12T01:15:48.266147+0000","last_clean":"2024-09-12T01:15:48.266147+0000","last_became_active":"2024-09-12T00:02:54.073930+0000","last_became_peered":"2024-09-12T00:02:54.073930+0000","last_unstale":"2024-09-12T01:15:48.266147+0000","last_undegraded":"2024-09-12T01:15:48.266147+0000","last_fullsized":"2024-09-12T01:15:48.266147+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.507632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4988,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":267,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.617272+0000","last_change":"2024-09-12T00:02:56.078803+0000","last_active":"2024-09-12T01:13:08.617272+0000","last_peered":"2024-09-12T01:13:08.617272+0000","last_clean":"2024-09-12T01:13:08.617272+0000","last_became_active":"2024-09-12T00:02:56.078528+0000","last_became_peered":"2024-09-12T00:02:56.078528+0000","last_unstale":"2024-09-12T01:13:08.617272+0000","last_undegraded":"2024-09-12T01:13:08.617272+0000","last_fullsized":"2024-09-12T01:13:08.617272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:32.315601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'99","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.947976+0000","last_change":"2024-09-12T00:02:58.087504+0000","last_active":"2024-09-12T01:14:02.947976+0000","last_peered":"2024-09-12T01:14:02.947976+0000","last_clean":"2024-09-12T01:14:02.947976+0000","last_became_active":"2024-09-12T00:02:58.087199+0000","last_became_peered":"2024-09-12T00:02:58.087199+0000","last_unstale":"2024-09-12T01:14:02.947976+0000","last_undegraded":"2024-09-12T01:14:02.947976+0000","last_fullsized":"2024-09-12T01:14:02.947976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:03.468020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":246,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'466","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749348+0000","last_change":"2024-09-12T00:02:50.073193+0000","last_active":"2024-09-12T01:15:09.749348+0000","last_peered":"2024-09-12T01:15:09.749348+0000","last_clean":"2024-09-12T01:15:09.749348+0000","last_became_active":"2024-09-12T00:02:50.072920+0000","last_became_peered":"2024-09-12T00:02:50.072920+0000","last_unstale":"2024-09-12T01:15:09.749348+0000","last_undegraded":"2024-09-12T01:15:09.749348+0000","last_fullsized":"2024-09-12T01:15:09.749348+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:16.921031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2371,"num_write":566,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'212","reported_seq":872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203318+0000","last_change":"2024-09-12T00:02:48.048693+0000","last_active":"2024-09-12T01:15:48.203318+0000","last_peered":"2024-09-12T01:15:48.203318+0000","last_clean":"2024-09-12T01:15:48.203318+0000","last_became_active":"2024-09-12T00:02:48.048308+0000","last_became_peered":"2024-09-12T00:02:48.048308+0000","last_unstale":"2024-09-12T01:15:48.203318+0000","last_undegraded":"2024-09-12T01:15:48.203318+0000","last_fullsized":"2024-09-12T01:15:48.203318+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:27.341399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":37398,"num_write":997,"num_write_kb":57972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398220+0000","last_change":"2024-09-12T00:02:52.060575+0000","last_active":"2024-09-12T01:12:58.398220+0000","last_peered":"2024-09-12T01:12:58.398220+0000","last_clean":"2024-09-12T01:12:58.398220+0000","last_became_active":"2024-09-12T00:02:52.060283+0000","last_became_peered":"2024-09-12T00:02:52.060283+0000","last_unstale":"2024-09-12T01:12:58.398220+0000","last_undegraded":"2024-09-12T01:12:58.398220+0000","last_fullsized":"2024-09-12T01:12:58.398220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.734208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'126","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.188246+0000","last_change":"2024-09-12T00:02:54.068064+0000","last_active":"2024-09-12T01:15:48.188246+0000","last_peered":"2024-09-12T01:15:48.188246+0000","last_clean":"2024-09-12T01:15:48.188246+0000","last_became_active":"2024-09-12T00:02:54.067770+0000","last_became_peered":"2024-09-12T00:02:54.067770+0000","last_unstale":"2024-09-12T01:15:48.188246+0000","last_undegraded":"2024-09-12T01:15:48.188246+0000","last_fullsized":"2024-09-12T01:15:48.188246+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:35.379645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4641,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":72,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398279+0000","last_change":"2024-09-12T00:02:56.078599+0000","last_active":"2024-09-12T01:12:58.398279+0000","last_peered":"2024-09-12T01:12:58.398279+0000","last_clean":"2024-09-12T01:12:58.398279+0000","last_became_active":"2024-09-12T00:02:56.077573+0000","last_became_peered":"2024-09-12T00:02:56.077573+0000","last_unstale":"2024-09-12T01:12:58.398279+0000","last_undegraded":"2024-09-12T01:12:58.398279+0000","last_fullsized":"2024-09-12T01:12:58.398279+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.485844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'149","reported_seq":1250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.171046+0000","last_change":"2024-09-12T00:02:58.099809+0000","last_active":"2024-09-12T01:14:00.171046+0000","last_peered":"2024-09-12T01:14:00.171046+0000","last_clean":"2024-09-12T01:14:00.171046+0000","last_became_active":"2024-09-12T00:02:58.099426+0000","last_became_peered":"2024-09-12T00:02:58.099426+0000","last_unstale":"2024-09-12T01:14:00.171046+0000","last_undegraded":"2024-09-12T01:14:00.171046+0000","last_fullsized":"2024-09-12T01:14:00.171046+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:47.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":755,"num_read_kb":754,"num_write":338,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'470","reported_seq":1958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.281149+0000","last_change":"2024-09-12T00:02:50.064387+0000","last_active":"2024-09-12T01:13:32.281149+0000","last_peered":"2024-09-12T01:13:32.281149+0000","last_clean":"2024-09-12T01:13:32.281149+0000","last_became_active":"2024-09-12T00:02:50.063959+0000","last_became_peered":"2024-09-12T00:02:50.063959+0000","last_unstale":"2024-09-12T01:13:32.281149+0000","last_undegraded":"2024-09-12T01:13:32.281149+0000","last_fullsized":"2024-09-12T01:13:32.281149+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:18.236963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2471,"num_read_kb":2277,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'193","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.167534+0000","last_change":"2024-09-12T00:02:48.055373+0000","last_active":"2024-09-12T01:15:48.167534+0000","last_peered":"2024-09-12T01:15:48.167534+0000","last_clean":"2024-09-12T01:15:48.167534+0000","last_became_active":"2024-09-12T00:02:48.054650+0000","last_became_peered":"2024-09-12T00:02:48.054650+0000","last_unstale":"2024-09-12T01:15:48.167534+0000","last_undegraded":"2024-09-12T01:15:48.167534+0000","last_fullsized":"2024-09-12T01:15:48.167534+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:13.706061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250177,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":59687,"num_write":954,"num_write_kb":41766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"38'4","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.926078+0000","last_change":"2024-09-12T00:02:52.066201+0000","last_active":"2024-09-12T01:15:47.926078+0000","last_peered":"2024-09-12T01:15:47.926078+0000","last_clean":"2024-09-12T01:15:47.926078+0000","last_became_active":"2024-09-12T00:02:52.065804+0000","last_became_peered":"2024-09-12T00:02:52.065804+0000","last_unstale":"2024-09-12T01:15:47.926078+0000","last_undegraded":"2024-09-12T01:15:47.926078+0000","last_fullsized":"2024-09-12T01:15:47.926078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:39.988981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'181","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.205498+0000","last_change":"2024-09-12T00:02:54.067254+0000","last_active":"2024-09-12T01:15:48.205498+0000","last_peered":"2024-09-12T01:15:48.205498+0000","last_clean":"2024-09-12T01:15:48.205498+0000","last_became_active":"2024-09-12T00:02:54.066918+0000","last_became_peered":"2024-09-12T00:02:54.066918+0000","last_unstale":"2024-09-12T01:15:48.205498+0000","last_undegraded":"2024-09-12T01:15:48.205498+0000","last_fullsized":"2024-09-12T01:15:48.205498+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:12.059169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":266,"num_write":140,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243946+0000","last_change":"2024-09-12T00:02:56.085398+0000","last_active":"2024-09-12T01:12:55.243946+0000","last_peered":"2024-09-12T01:12:55.243946+0000","last_clean":"2024-09-12T01:12:55.243946+0000","last_became_active":"2024-09-12T00:02:56.084768+0000","last_became_peered":"2024-09-12T00:02:56.084768+0000","last_unstale":"2024-09-12T01:12:55.243946+0000","last_undegraded":"2024-09-12T01:12:55.243946+0000","last_fullsized":"2024-09-12T01:12:55.243946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:48.456473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'155","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.758350+0000","last_change":"2024-09-12T00:02:58.097950+0000","last_active":"2024-09-12T01:15:09.758350+0000","last_peered":"2024-09-12T01:15:09.758350+0000","last_clean":"2024-09-12T01:15:09.758350+0000","last_became_active":"2024-09-12T00:02:58.097725+0000","last_became_peered":"2024-09-12T00:02:58.097725+0000","last_unstale":"2024-09-12T01:15:09.758350+0000","last_undegraded":"2024-09-12T01:15:09.758350+0000","last_fullsized":"2024-09-12T01:15:09.758350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:53.001751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":109,"num_write":343,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'690","reported_seq":2193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.278553+0000","last_change":"2024-09-12T00:02:50.064639+0000","last_active":"2024-09-12T01:13:32.278553+0000","last_peered":"2024-09-12T01:13:32.278553+0000","last_clean":"2024-09-12T01:13:32.278553+0000","last_became_active":"2024-09-12T00:02:50.064354+0000","last_became_peered":"2024-09-12T00:02:50.064354+0000","last_unstale":"2024-09-12T01:13:32.278553+0000","last_undegraded":"2024-09-12T01:13:32.278553+0000","last_fullsized":"2024-09-12T01:13:32.278553+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:47.800598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3412,"num_read_kb":3118,"num_write":870,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'187","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154216+0000","last_change":"2024-09-12T00:02:48.049912+0000","last_active":"2024-09-12T01:15:48.154216+0000","last_peered":"2024-09-12T01:15:48.154216+0000","last_clean":"2024-09-12T01:15:48.154216+0000","last_became_active":"2024-09-12T00:02:48.049242+0000","last_became_peered":"2024-09-12T00:02:48.049242+0000","last_unstale":"2024-09-12T01:15:48.154216+0000","last_undegraded":"2024-09-12T01:15:48.154216+0000","last_fullsized":"2024-09-12T01:15:48.154216+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:23.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":39372,"num_write":875,"num_write_kb":46728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'350","reported_seq":1687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.128431+0000","last_change":"2024-09-12T00:02:50.066620+0000","last_active":"2024-09-12T01:14:04.128431+0000","last_peered":"2024-09-12T01:14:04.128431+0000","last_clean":"2024-09-12T01:14:04.128431+0000","last_became_active":"2024-09-12T00:02:50.065060+0000","last_became_peered":"2024-09-12T00:02:50.065060+0000","last_unstale":"2024-09-12T01:14:04.128431+0000","last_undegraded":"2024-09-12T01:14:04.128431+0000","last_fullsized":"2024-09-12T01:14:04.128431+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:29.932545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1806,"num_read_kb":1710,"num_write":413,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'203","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.232859+0000","last_change":"2024-09-12T00:02:48.042203+0000","last_active":"2024-09-12T01:13:38.232859+0000","last_peered":"2024-09-12T01:13:38.232859+0000","last_clean":"2024-09-12T01:13:38.232859+0000","last_became_active":"2024-09-12T00:02:48.041842+0000","last_became_peered":"2024-09-12T00:02:48.041842+0000","last_unstale":"2024-09-12T01:13:38.232859+0000","last_undegraded":"2024-09-12T01:13:38.232859+0000","last_fullsized":"2024-09-12T01:13:38.232859+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.057094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":13124,"num_write":1044,"num_write_kb":38354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'456","reported_seq":2064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.953879+0000","last_change":"2024-09-12T00:02:50.066620+0000","last_active":"2024-09-12T01:14:02.953879+0000","last_peered":"2024-09-12T01:14:02.953879+0000","last_clean":"2024-09-12T01:14:02.953879+0000","last_became_active":"2024-09-12T00:02:50.066341+0000","last_became_peered":"2024-09-12T00:02:50.066341+0000","last_unstale":"2024-09-12T01:14:02.953879+0000","last_undegraded":"2024-09-12T01:14:02.953879+0000","last_fullsized":"2024-09-12T01:14:02.953879+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:24.335215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2383,"num_read_kb":2262,"num_write":523,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'185","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.203656+0000","last_change":"2024-09-12T00:02:48.053321+0000","last_active":"2024-09-12T01:15:48.203656+0000","last_peered":"2024-09-12T01:15:48.203656+0000","last_clean":"2024-09-12T01:15:48.203656+0000","last_became_active":"2024-09-12T00:02:48.052205+0000","last_became_peered":"2024-09-12T00:02:48.052205+0000","last_unstale":"2024-09-12T01:15:48.203656+0000","last_undegraded":"2024-09-12T01:15:48.203656+0000","last_fullsized":"2024-09-12T01:15:48.203656+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:46.259191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":389,"num_read_kb":19493,"num_write":855,"num_write_kb":24928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'366","reported_seq":1876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.726506+0000","last_change":"2024-09-12T00:02:50.066198+0000","last_active":"2024-09-12T01:15:09.726506+0000","last_peered":"2024-09-12T01:15:09.726506+0000","last_clean":"2024-09-12T01:15:09.726506+0000","last_became_active":"2024-09-12T00:02:50.065534+0000","last_became_peered":"2024-09-12T00:02:50.065534+0000","last_unstale":"2024-09-12T01:15:09.726506+0000","last_undegraded":"2024-09-12T01:15:09.726506+0000","last_fullsized":"2024-09-12T01:15:09.726506+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:03.014135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1966,"num_read_kb":1903,"num_write":390,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'155","reported_seq":751,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.238188+0000","last_change":"2024-09-12T00:03:21.720945+0000","last_active":"2024-09-12T01:14:28.238188+0000","last_peered":"2024-09-12T01:14:28.238188+0000","last_clean":"2024-09-12T01:14:28.238188+0000","last_became_active":"2024-09-12T00:03:21.720441+0000","last_became_peered":"2024-09-12T00:03:21.720441+0000","last_unstale":"2024-09-12T01:14:28.238188+0000","last_undegraded":"2024-09-12T01:14:28.238188+0000","last_fullsized":"2024-09-12T01:14:28.238188+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:43.089434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":16297,"num_write":778,"num_write_kb":33256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"267'1239","reported_seq":3053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:32.279664+0000","last_change":"2024-09-12T00:02:50.070807+0000","last_active":"2024-09-12T01:13:32.279664+0000","last_peered":"2024-09-12T01:13:32.279664+0000","last_clean":"2024-09-12T01:13:32.279664+0000","last_became_active":"2024-09-12T00:02:50.070406+0000","last_became_peered":"2024-09-12T00:02:50.070406+0000","last_unstale":"2024-09-12T01:13:32.279664+0000","last_undegraded":"2024-09-12T01:13:32.279664+0000","last_fullsized":"2024-09-12T01:13:32.279664+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:02.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5822,"num_read_kb":5176,"num_write":1694,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'195","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.087099+0000","last_change":"2024-09-12T00:02:48.051785+0000","last_active":"2024-09-12T01:15:48.087099+0000","last_peered":"2024-09-12T01:15:48.087099+0000","last_clean":"2024-09-12T01:15:48.087099+0000","last_became_active":"2024-09-12T00:02:48.051454+0000","last_became_peered":"2024-09-12T00:02:48.051454+0000","last_unstale":"2024-09-12T01:15:48.087099+0000","last_undegraded":"2024-09-12T01:15:48.087099+0000","last_fullsized":"2024-09-12T01:15:48.087099+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:03.729498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":27281,"num_write":913,"num_write_kb":43596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'808","reported_seq":2264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257926+0000","last_change":"2024-09-12T00:02:50.065953+0000","last_active":"2024-09-12T01:13:43.257926+0000","last_peered":"2024-09-12T01:13:43.257926+0000","last_clean":"2024-09-12T01:13:43.257926+0000","last_became_active":"2024-09-12T00:02:50.065615+0000","last_became_peered":"2024-09-12T00:02:50.065615+0000","last_unstale":"2024-09-12T01:13:43.257926+0000","last_undegraded":"2024-09-12T01:13:43.257926+0000","last_fullsized":"2024-09-12T01:13:43.257926+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:10.609393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3886,"num_read_kb":3508,"num_write":1123,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'223","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.010387+0000","last_change":"2024-09-12T00:02:48.047922+0000","last_active":"2024-09-12T01:15:48.010387+0000","last_peered":"2024-09-12T01:15:48.010387+0000","last_clean":"2024-09-12T01:15:48.010387+0000","last_became_active":"2024-09-12T00:02:48.047357+0000","last_became_peered":"2024-09-12T00:02:48.047357+0000","last_unstale":"2024-09-12T01:15:48.010387+0000","last_undegraded":"2024-09-12T01:15:48.010387+0000","last_fullsized":"2024-09-12T01:15:48.010387+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:00.961888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":6089,"num_write":1092,"num_write_kb":27766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1102","reported_seq":2609,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.239495+0000","last_change":"2024-09-12T00:02:50.076287+0000","last_active":"2024-09-12T01:13:43.239495+0000","last_peered":"2024-09-12T01:13:43.239495+0000","last_clean":"2024-09-12T01:13:43.239495+0000","last_became_active":"2024-09-12T00:02:50.075265+0000","last_became_peered":"2024-09-12T00:02:50.075265+0000","last_unstale":"2024-09-12T01:13:43.239495+0000","last_undegraded":"2024-09-12T01:13:43.239495+0000","last_fullsized":"2024-09-12T01:13:43.239495+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":1000,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:28.198469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4403,"num_write":1512,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'200","reported_seq":822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.177090+0000","last_change":"2024-09-12T00:02:48.047911+0000","last_active":"2024-09-12T01:15:48.177090+0000","last_peered":"2024-09-12T01:15:48.177090+0000","last_clean":"2024-09-12T01:15:48.177090+0000","last_became_active":"2024-09-12T00:02:48.047266+0000","last_became_peered":"2024-09-12T00:02:48.047266+0000","last_unstale":"2024-09-12T01:15:48.177090+0000","last_undegraded":"2024-09-12T01:15:48.177090+0000","last_fullsized":"2024-09-12T01:15:48.177090+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.110547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":23654,"num_write":912,"num_write_kb":39021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'475","reported_seq":2121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.622203+0000","last_change":"2024-09-12T00:02:50.068176+0000","last_active":"2024-09-12T01:13:43.622203+0000","last_peered":"2024-09-12T01:13:43.622203+0000","last_clean":"2024-09-12T01:13:43.622203+0000","last_became_active":"2024-09-12T00:02:50.067919+0000","last_became_peered":"2024-09-12T00:02:50.067919+0000","last_unstale":"2024-09-12T01:13:43.622203+0000","last_undegraded":"2024-09-12T01:13:43.622203+0000","last_fullsized":"2024-09-12T01:13:43.622203+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:55.966361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2453,"num_write":580,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:53.249785+0000","last_change":"2024-09-12T00:03:21.143532+0000","last_active":"2024-09-12T01:14:53.249785+0000","last_peered":"2024-09-12T01:14:53.249785+0000","last_clean":"2024-09-12T01:14:53.249785+0000","last_became_active":"2024-09-12T00:03:21.143091+0000","last_became_peered":"2024-09-12T00:03:21.143091+0000","last_unstale":"2024-09-12T01:14:53.249785+0000","last_undegraded":"2024-09-12T01:14:53.249785+0000","last_fullsized":"2024-09-12T01:14:53.249785+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:15.405828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":6539,"num_write":770,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'874","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.863508+0000","last_change":"2024-09-12T00:02:50.076474+0000","last_active":"2024-09-12T01:13:20.863508+0000","last_peered":"2024-09-12T01:13:20.863508+0000","last_clean":"2024-09-12T01:13:20.863508+0000","last_became_active":"2024-09-12T00:02:50.076097+0000","last_became_peered":"2024-09-12T00:02:50.076097+0000","last_unstale":"2024-09-12T01:13:20.863508+0000","last_undegraded":"2024-09-12T01:13:20.863508+0000","last_fullsized":"2024-09-12T01:13:20.863508+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:53.760772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3804,"num_write":1206,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'185","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:23.523597+0000","last_change":"2024-09-12T00:02:48.058120+0000","last_active":"2024-09-12T01:14:23.523597+0000","last_peered":"2024-09-12T01:14:23.523597+0000","last_clean":"2024-09-12T01:14:23.523597+0000","last_became_active":"2024-09-12T00:02:48.057693+0000","last_became_peered":"2024-09-12T00:02:48.057693+0000","last_unstale":"2024-09-12T01:14:23.523597+0000","last_undegraded":"2024-09-12T01:14:23.523597+0000","last_fullsized":"2024-09-12T01:14:23.523597+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:03.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":352,"num_read_kb":5525,"num_write":905,"num_write_kb":35074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'837","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.955489+0000","last_change":"2024-09-12T00:02:50.062788+0000","last_active":"2024-09-12T01:14:02.955489+0000","last_peered":"2024-09-12T01:14:02.955489+0000","last_clean":"2024-09-12T01:14:02.955489+0000","last_became_active":"2024-09-12T00:02:50.062524+0000","last_became_peered":"2024-09-12T00:02:50.062524+0000","last_unstale":"2024-09-12T01:14:02.955489+0000","last_undegraded":"2024-09-12T01:14:02.955489+0000","last_fullsized":"2024-09-12T01:14:02.955489+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:00.117674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4232,"num_read_kb":3859,"num_write":1078,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'258","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.221757+0000","last_change":"2024-09-12T00:02:48.050975+0000","last_active":"2024-09-12T01:15:48.221757+0000","last_peered":"2024-09-12T01:15:48.221757+0000","last_clean":"2024-09-12T01:15:48.221757+0000","last_became_active":"2024-09-12T00:02:48.050574+0000","last_became_peered":"2024-09-12T00:02:48.050574+0000","last_unstale":"2024-09-12T01:15:48.221757+0000","last_undegraded":"2024-09-12T01:15:48.221757+0000","last_fullsized":"2024-09-12T01:15:48.221757+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:18.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67790,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":15341,"num_write":1132,"num_write_kb":29230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'811","reported_seq":2278,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.722532+0000","last_change":"2024-09-12T00:02:50.063982+0000","last_active":"2024-09-12T01:15:09.722532+0000","last_peered":"2024-09-12T01:15:09.722532+0000","last_clean":"2024-09-12T01:15:09.722532+0000","last_became_active":"2024-09-12T00:02:50.063668+0000","last_became_peered":"2024-09-12T00:02:50.063668+0000","last_unstale":"2024-09-12T01:15:09.722532+0000","last_undegraded":"2024-09-12T01:15:09.722532+0000","last_fullsized":"2024-09-12T01:15:09.722532+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:25.340207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3770,"num_read_kb":3367,"num_write":1118,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'211","reported_seq":889,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.231252+0000","last_change":"2024-09-12T00:02:48.049176+0000","last_active":"2024-09-12T01:15:48.231252+0000","last_peered":"2024-09-12T01:15:48.231252+0000","last_clean":"2024-09-12T01:15:48.231252+0000","last_became_active":"2024-09-12T00:02:48.048851+0000","last_became_peered":"2024-09-12T00:02:48.048851+0000","last_unstale":"2024-09-12T01:15:48.231252+0000","last_undegraded":"2024-09-12T01:15:48.231252+0000","last_fullsized":"2024-09-12T01:15:48.231252+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:48.606466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":48639,"num_write":1072,"num_write_kb":41735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'811","reported_seq":2269,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.790333+0000","last_change":"2024-09-12T00:02:50.064007+0000","last_active":"2024-09-12T01:13:16.790333+0000","last_peered":"2024-09-12T01:13:16.790333+0000","last_clean":"2024-09-12T01:13:16.790333+0000","last_became_active":"2024-09-12T00:02:50.063615+0000","last_became_peered":"2024-09-12T00:02:50.063615+0000","last_unstale":"2024-09-12T01:13:16.790333+0000","last_undegraded":"2024-09-12T01:13:16.790333+0000","last_fullsized":"2024-09-12T01:13:16.790333+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:42.699086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3747,"num_read_kb":3346,"num_write":1068,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'284","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:50.258450+0000","last_change":"2024-09-12T00:02:48.047449+0000","last_active":"2024-09-12T01:14:50.258450+0000","last_peered":"2024-09-12T01:14:50.258450+0000","last_clean":"2024-09-12T01:14:50.258450+0000","last_became_active":"2024-09-12T00:02:48.046828+0000","last_became_peered":"2024-09-12T00:02:48.046828+0000","last_unstale":"2024-09-12T01:14:50.258450+0000","last_undegraded":"2024-09-12T01:14:50.258450+0000","last_fullsized":"2024-09-12T01:14:50.258450+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.302266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":12026,"num_write":1074,"num_write_kb":33544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'751","reported_seq":2258,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127565+0000","last_change":"2024-09-12T00:02:50.070132+0000","last_active":"2024-09-12T01:14:04.127565+0000","last_peered":"2024-09-12T01:14:04.127565+0000","last_clean":"2024-09-12T01:14:04.127565+0000","last_became_active":"2024-09-12T00:02:50.069844+0000","last_became_peered":"2024-09-12T00:02:50.069844+0000","last_unstale":"2024-09-12T01:14:04.127565+0000","last_undegraded":"2024-09-12T01:14:04.127565+0000","last_fullsized":"2024-09-12T01:14:04.127565+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:41.241382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3535,"num_read_kb":3209,"num_write":983,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'198","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.154781+0000","last_change":"2024-09-12T00:02:48.046768+0000","last_active":"2024-09-12T01:15:48.154781+0000","last_peered":"2024-09-12T01:15:48.154781+0000","last_clean":"2024-09-12T01:15:48.154781+0000","last_became_active":"2024-09-12T00:02:48.046397+0000","last_became_peered":"2024-09-12T00:02:48.046397+0000","last_unstale":"2024-09-12T01:15:48.154781+0000","last_undegraded":"2024-09-12T01:15:48.154781+0000","last_fullsized":"2024-09-12T01:15:48.154781+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:20.073613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":38047,"num_write":933,"num_write_kb":24740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'852","reported_seq":2476,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.727874+0000","last_change":"2024-09-12T00:02:50.078323+0000","last_active":"2024-09-12T01:15:09.727874+0000","last_peered":"2024-09-12T01:15:09.727874+0000","last_clean":"2024-09-12T01:15:09.727874+0000","last_became_active":"2024-09-12T00:02:50.078018+0000","last_became_peered":"2024-09-12T00:02:50.078018+0000","last_unstale":"2024-09-12T01:15:09.727874+0000","last_undegraded":"2024-09-12T01:15:09.727874+0000","last_fullsized":"2024-09-12T01:15:09.727874+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.331727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4154,"num_read_kb":3748,"num_write":1160,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'171","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.248955+0000","last_change":"2024-09-12T00:02:48.049824+0000","last_active":"2024-09-12T01:15:48.248955+0000","last_peered":"2024-09-12T01:15:48.248955+0000","last_clean":"2024-09-12T01:15:48.248955+0000","last_became_active":"2024-09-12T00:02:48.047945+0000","last_became_peered":"2024-09-12T00:02:48.047945+0000","last_unstale":"2024-09-12T01:15:48.248955+0000","last_undegraded":"2024-09-12T01:15:48.248955+0000","last_fullsized":"2024-09-12T01:15:48.248955+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:07.052258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":324,"num_read_kb":25981,"num_write":829,"num_write_kb":31809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'530","reported_seq":2291,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.229835+0000","last_change":"2024-09-12T00:03:21.133800+0000","last_active":"2024-09-12T01:13:08.229835+0000","last_peered":"2024-09-12T01:13:08.229835+0000","last_clean":"2024-09-12T01:13:08.229835+0000","last_became_active":"2024-09-12T00:03:21.133475+0000","last_became_peered":"2024-09-12T00:03:21.133475+0000","last_unstale":"2024-09-12T01:13:08.229835+0000","last_undegraded":"2024-09-12T01:13:08.229835+0000","last_fullsized":"2024-09-12T01:13:08.229835+0000","mapping_epoch":39,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:12.713868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2976,"num_read_kb":2811,"num_write":614,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"267'233","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.059488+0000","last_change":"2024-09-12T00:02:48.049475+0000","last_active":"2024-09-12T01:15:48.059488+0000","last_peered":"2024-09-12T01:15:48.059488+0000","last_clean":"2024-09-12T01:15:48.059488+0000","last_became_active":"2024-09-12T00:02:48.049104+0000","last_became_peered":"2024-09-12T00:02:48.049104+0000","last_unstale":"2024-09-12T01:15:48.059488+0000","last_undegraded":"2024-09-12T01:15:48.059488+0000","last_fullsized":"2024-09-12T01:15:48.059488+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:30.113842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456491,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":11103,"num_write":1027,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'905","reported_seq":2496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.127160+0000","last_change":"2024-09-12T00:02:50.069815+0000","last_active":"2024-09-12T01:14:04.127160+0000","last_peered":"2024-09-12T01:14:04.127160+0000","last_clean":"2024-09-12T01:14:04.127160+0000","last_became_active":"2024-09-12T00:02:50.069494+0000","last_became_peered":"2024-09-12T00:02:50.069494+0000","last_unstale":"2024-09-12T01:14:04.127160+0000","last_undegraded":"2024-09-12T01:14:04.127160+0000","last_fullsized":"2024-09-12T01:14:04.127160+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:18.542138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4355,"num_read_kb":3868,"num_write":1227,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'175","reported_seq":808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.202875+0000","last_change":"2024-09-12T00:04:21.225632+0000","last_active":"2024-09-12T01:15:48.202875+0000","last_peered":"2024-09-12T01:15:48.202875+0000","last_clean":"2024-09-12T01:15:48.202875+0000","last_became_active":"2024-09-12T00:04:21.225148+0000","last_became_peered":"2024-09-12T00:04:21.225148+0000","last_unstale":"2024-09-12T01:15:48.202875+0000","last_undegraded":"2024-09-12T01:15:48.202875+0000","last_fullsized":"2024-09-12T01:15:48.202875+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:11.655162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7533161,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":15843,"num_write":853,"num_write_kb":25246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'175","reported_seq":796,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.178507+0000","last_change":"2024-09-12T00:03:21.141209+0000","last_active":"2024-09-12T01:15:48.178507+0000","last_peered":"2024-09-12T01:15:48.178507+0000","last_clean":"2024-09-12T01:15:48.178507+0000","last_became_active":"2024-09-12T00:03:21.140871+0000","last_became_peered":"2024-09-12T00:03:21.140871+0000","last_unstale":"2024-09-12T01:15:48.178507+0000","last_undegraded":"2024-09-12T01:15:48.178507+0000","last_fullsized":"2024-09-12T01:15:48.178507+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.144813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2728229,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":36071,"num_write":841,"num_write_kb":27237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'834","reported_seq":2461,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.749255+0000","last_change":"2024-09-12T00:02:50.076816+0000","last_active":"2024-09-12T01:15:09.749255+0000","last_peered":"2024-09-12T01:15:09.749255+0000","last_clean":"2024-09-12T01:15:09.749255+0000","last_became_active":"2024-09-12T00:02:50.076513+0000","last_became_peered":"2024-09-12T00:02:50.076513+0000","last_unstale":"2024-09-12T01:15:09.749255+0000","last_undegraded":"2024-09-12T01:15:09.749255+0000","last_fullsized":"2024-09-12T01:15:09.749255+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:15.455296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4096,"num_read_kb":3692,"num_write":1085,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'193","reported_seq":853,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.233434+0000","last_change":"2024-09-12T00:03:21.143529+0000","last_active":"2024-09-12T01:15:48.233434+0000","last_peered":"2024-09-12T01:15:48.233434+0000","last_clean":"2024-09-12T01:15:48.233434+0000","last_became_active":"2024-09-12T00:03:21.143160+0000","last_became_peered":"2024-09-12T00:03:21.143160+0000","last_unstale":"2024-09-12T01:15:48.233434+0000","last_undegraded":"2024-09-12T01:15:48.233434+0000","last_fullsized":"2024-09-12T01:15:48.233434+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:47.020837+0000","last_clean_scrub_stamp":"2024-09-12T00:02:47.020837+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:30.205902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":434,"num_read_kb":67077,"num_write":937,"num_write_kb":29840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.787449+0000","last_change":"2024-09-12T00:02:50.060740+0000","last_active":"2024-09-12T01:13:16.787449+0000","last_peered":"2024-09-12T01:13:16.787449+0000","last_clean":"2024-09-12T01:13:16.787449+0000","last_became_active":"2024-09-12T00:02:50.060457+0000","last_became_peered":"2024-09-12T00:02:50.060457+0000","last_unstale":"2024-09-12T01:13:16.787449+0000","last_undegraded":"2024-09-12T01:13:16.787449+0000","last_fullsized":"2024-09-12T01:13:16.787449+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:20.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2366,"num_read_kb":2209,"num_write":518,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5804,"num_read_kb":4071,"num_write":1920,"num_write_kb":818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1091,"ondisk_log_size":1091,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15077,"num_read_kb":14728,"num_write":16720,"num_write_kb":4882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":259874,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":10212,"num_read_kb":12359,"num_write":7103,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1886,"ondisk_log_size":1886,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212469,"num_read_kb":193861,"num_write":55201,"num_write_kb":18788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3960,"ondisk_log_size":3960,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":93137464,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":33184,"num_read_kb":2494324,"num_write":62091,"num_write_kb":2229204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":141545472,"data_stored":141545472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4519,"ondisk_log_size":4519,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196988,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185720,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510327,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243856,"kb_used_data":14084,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94127984,"statfs":{"total":96636764160,"available":96387055616,"internally_reserved":0,"allocated":14422016,"data_stored":12282601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510329,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255716,"kb_used_data":25968,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116124,"statfs":{"total":96636764160,"available":96374910976,"internally_reserved":0,"allocated":26591232,"data_stored":24503671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510331,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97104,"kb_used_data":15848,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94274736,"statfs":{"total":96636764160,"available":96537329664,"internally_reserved":0,"allocated":16228352,"data_stored":14061021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510326,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106540,"kb_used_data":25360,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94265300,"statfs":{"total":96636764160,"available":96527667200,"internally_reserved":0,"allocated":25968640,"data_stored":23900981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510325,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246056,"kb_used_data":16276,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94125784,"statfs":{"total":96636764160,"available":96384802816,"internally_reserved":0,"allocated":16666624,"data_stored":14539294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510323,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101528,"kb_used_data":25916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94270312,"statfs":{"total":96636764160,"available":96532799488,"internally_reserved":0,"allocated":26537984,"data_stored":24477318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510324,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150040,"kb_used_data":28616,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94221800,"statfs":{"total":96636764160,"available":96483123200,"internally_reserved":0,"allocated":29302784,"data_stored":27210308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575735,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":269432,"kb_used_data":21736,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94102408,"statfs":{"total":96636764160,"available":96360865792,"internally_reserved":0,"allocated":22257664,"data_stored":20146116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17256448,"data_stored":17256448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24911872,"data_stored":24911872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22179840,"data_stored":22179840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12238848,"data_stored":12238848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21602304,"data_stored":21602304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11759616,"data_stored":11759616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22204416,"data_stored":22204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:15:56.805 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.805 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.805 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.805 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.806 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.806 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.806 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.806 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.806 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.806 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.806 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.807 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.807 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.807 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.807 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.807 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.807 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.807 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.808 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.808 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.808 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.808 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.808 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.808 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.808 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.809 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.809 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.809 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.809 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.809 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.809 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.810 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.810 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.810 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.810 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.810 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.810 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.810 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.810 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.811 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.811 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.811 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.811 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.811 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.811 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.811 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.811 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.812 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.813 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.814 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.815 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.816 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.817 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.818 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.819 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.820 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.821 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.822 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.823 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.824 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.825 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.826 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.827 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.828 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.829 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.830 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.831 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.831 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.831 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.831 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.831 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.831 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.831 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:02:29.944268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.832 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:02:34.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.832 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.832 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.832 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.832 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.832 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.832 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.832 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:02:34.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.833 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.833 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.833 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.833 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.833 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.833 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:02:34.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.833 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.833 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.834 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.834 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.834 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.834 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.834 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:02:34.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.834 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.834 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:02:34.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.835 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.836 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.836 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.836 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.836 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:02:34.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.836 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.836 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.837 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.837 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.837 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.837 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.837 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:02:34.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.837 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.837 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.837 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.838 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.838 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.838 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:02:34.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.838 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.838 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.838 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.839 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.839 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.839 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.839 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.839 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.839 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.839 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.839 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.840 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.840 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.840 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.840 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.840 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.840 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.840 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.840 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.841 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.841 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.841 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.841 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.841 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.841 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.842 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.842 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.842 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.842 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.842 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.842 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.842 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.843 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.843 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.843 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.843 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.843 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.843 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.844 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.844 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.844 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.844 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.844 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.844 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.844 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.844 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.845 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.846 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.847 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.848 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.848 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.848 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.848 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.848 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.848 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.848 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.848 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.849 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.849 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.849 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.849 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.849 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.849 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.850 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.851 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.852 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.852 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.852 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.852 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.852 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:02:47.020837+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.852 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:15:56.852 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:16:16.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:16:17.206 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:16:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T01:16:17.224 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":2475,"stamp":"2024-09-12T01:16:15.331383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":94005387,"num_objects":732,"num_object_clones":0,"num_object_copies":1697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":279494,"num_read_kb":3104975,"num_write":143492,"num_write_kb":2513046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":41450,"num_omap_keys":161,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14145,"ondisk_log_size":14145,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1474092,"kb_used_data":173804,"kb_used_omap":12,"kb_used_meta":1300147,"kb_avail":753500628,"statfs":{"total":773094113280,"available":771584643072,"internally_reserved":0,"allocated":177975296,"data_stored":161121310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1331351089},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34566,"num_omap_keys":133,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005658"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502105+0000","last_change":"2024-09-12T00:39:26.642397+0000","last_active":"2024-09-12T01:11:58.502105+0000","last_peered":"2024-09-12T01:11:58.502105+0000","last_clean":"2024-09-12T01:11:58.502105+0000","last_became_active":"2024-09-12T00:39:26.642090+0000","last_became_peered":"2024-09-12T00:39:26.642090+0000","last_unstale":"2024-09-12T01:11:58.502105+0000","last_undegraded":"2024-09-12T01:11:58.502105+0000","last_fullsized":"2024-09-12T01:11:58.502105+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:54.374892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.502826+0000","last_change":"2024-09-12T00:22:02.424471+0000","last_active":"2024-09-12T01:12:03.502826+0000","last_peered":"2024-09-12T01:12:03.502826+0000","last_clean":"2024-09-12T01:12:03.502826+0000","last_became_active":"2024-09-12T00:22:02.423867+0000","last_became_peered":"2024-09-12T00:22:02.423867+0000","last_unstale":"2024-09-12T01:12:03.502826+0000","last_undegraded":"2024-09-12T01:12:03.502826+0000","last_fullsized":"2024-09-12T01:12:03.502826+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.940652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.246266+0000","last_change":"2024-09-12T00:21:58.336211+0000","last_active":"2024-09-12T01:14:28.246266+0000","last_peered":"2024-09-12T01:14:28.246266+0000","last_clean":"2024-09-12T01:14:28.246266+0000","last_became_active":"2024-09-12T00:21:58.335882+0000","last_became_peered":"2024-09-12T00:21:58.335882+0000","last_unstale":"2024-09-12T01:14:28.246266+0000","last_undegraded":"2024-09-12T01:14:28.246266+0000","last_fullsized":"2024-09-12T01:14:28.246266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:06.306799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":322,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'60","reported_seq":223,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238949+0000","last_change":"2024-09-12T00:17:58.354178+0000","last_active":"2024-09-12T01:12:10.238949+0000","last_peered":"2024-09-12T01:12:10.238949+0000","last_clean":"2024-09-12T01:12:10.238949+0000","last_became_active":"2024-09-12T00:17:58.353889+0000","last_became_peered":"2024-09-12T00:17:58.353889+0000","last_unstale":"2024-09-12T01:12:10.238949+0000","last_undegraded":"2024-09-12T01:12:10.238949+0000","last_fullsized":"2024-09-12T01:12:10.238949+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.435699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":209,"num_write":117,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221699+0000","last_change":"2024-09-12T00:39:26.637541+0000","last_active":"2024-09-12T01:11:58.221699+0000","last_peered":"2024-09-12T01:11:58.221699+0000","last_clean":"2024-09-12T01:11:58.221699+0000","last_became_active":"2024-09-12T00:39:26.637244+0000","last_became_peered":"2024-09-12T00:39:26.637244+0000","last_unstale":"2024-09-12T01:11:58.221699+0000","last_undegraded":"2024-09-12T01:11:58.221699+0000","last_fullsized":"2024-09-12T01:11:58.221699+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:40.343211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.390545+0000","last_change":"2024-09-12T00:22:02.421061+0000","last_active":"2024-09-12T01:12:03.390545+0000","last_peered":"2024-09-12T01:12:03.390545+0000","last_clean":"2024-09-12T01:12:03.390545+0000","last_became_active":"2024-09-12T00:22:02.420774+0000","last_became_peered":"2024-09-12T00:22:02.420774+0000","last_unstale":"2024-09-12T01:12:03.390545+0000","last_undegraded":"2024-09-12T01:12:03.390545+0000","last_fullsized":"2024-09-12T01:12:03.390545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:12.865558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.229707+0000","last_change":"2024-09-12T00:21:58.338086+0000","last_active":"2024-09-12T01:11:58.229707+0000","last_peered":"2024-09-12T01:11:58.229707+0000","last_clean":"2024-09-12T01:11:58.229707+0000","last_became_active":"2024-09-12T00:21:58.336723+0000","last_became_peered":"2024-09-12T00:21:58.336723+0000","last_unstale":"2024-09-12T01:11:58.229707+0000","last_undegraded":"2024-09-12T01:11:58.229707+0000","last_fullsized":"2024-09-12T01:11:58.229707+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:29.016179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'21","reported_seq":124,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.235830+0000","last_change":"2024-09-12T00:17:58.361616+0000","last_active":"2024-09-12T01:14:08.235830+0000","last_peered":"2024-09-12T01:14:08.235830+0000","last_clean":"2024-09-12T01:14:08.235830+0000","last_became_active":"2024-09-12T00:17:58.361306+0000","last_became_peered":"2024-09-12T00:17:58.361306+0000","last_unstale":"2024-09-12T01:14:08.235830+0000","last_undegraded":"2024-09-12T01:14:08.235830+0000","last_fullsized":"2024-09-12T01:14:08.235830+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618592+0000","last_change":"2024-09-12T00:39:26.625650+0000","last_active":"2024-09-12T01:13:18.618592+0000","last_peered":"2024-09-12T01:13:18.618592+0000","last_clean":"2024-09-12T01:13:18.618592+0000","last_became_active":"2024-09-12T00:39:26.625454+0000","last_became_peered":"2024-09-12T00:39:26.625454+0000","last_unstale":"2024-09-12T01:13:18.618592+0000","last_undegraded":"2024-09-12T01:13:18.618592+0000","last_fullsized":"2024-09-12T01:13:18.618592+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:07.891692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:10.253071+0000","last_change":"2024-09-12T00:22:02.422000+0000","last_active":"2024-09-12T01:14:10.253071+0000","last_peered":"2024-09-12T01:14:10.253071+0000","last_clean":"2024-09-12T01:14:10.253071+0000","last_became_active":"2024-09-12T00:22:02.421689+0000","last_became_peered":"2024-09-12T00:22:02.421689+0000","last_unstale":"2024-09-12T01:14:10.253071+0000","last_undegraded":"2024-09-12T01:14:10.253071+0000","last_fullsized":"2024-09-12T01:14:10.253071+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.235808+0000","last_change":"2024-09-12T00:21:58.333094+0000","last_active":"2024-09-12T01:14:08.235808+0000","last_peered":"2024-09-12T01:14:08.235808+0000","last_clean":"2024-09-12T01:14:08.235808+0000","last_became_active":"2024-09-12T00:21:58.332782+0000","last_became_peered":"2024-09-12T00:21:58.332782+0000","last_unstale":"2024-09-12T01:14:08.235808+0000","last_undegraded":"2024-09-12T01:14:08.235808+0000","last_fullsized":"2024-09-12T01:14:08.235808+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'34","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244636+0000","last_change":"2024-09-12T00:17:58.353482+0000","last_active":"2024-09-12T01:13:00.244636+0000","last_peered":"2024-09-12T01:13:00.244636+0000","last_clean":"2024-09-12T01:13:00.244636+0000","last_became_active":"2024-09-12T00:17:58.353045+0000","last_became_peered":"2024-09-12T00:17:58.353045+0000","last_unstale":"2024-09-12T01:13:00.244636+0000","last_undegraded":"2024-09-12T01:13:00.244636+0000","last_fullsized":"2024-09-12T01:13:00.244636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:52.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.237224+0000","last_change":"2024-09-12T00:39:26.637464+0000","last_active":"2024-09-12T01:13:23.237224+0000","last_peered":"2024-09-12T01:13:23.237224+0000","last_clean":"2024-09-12T01:13:23.237224+0000","last_became_active":"2024-09-12T00:39:26.637185+0000","last_became_peered":"2024-09-12T00:39:26.637185+0000","last_unstale":"2024-09-12T01:13:23.237224+0000","last_undegraded":"2024-09-12T01:13:23.237224+0000","last_fullsized":"2024-09-12T01:13:23.237224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:20.137461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.244311+0000","last_change":"2024-09-12T00:22:02.428079+0000","last_active":"2024-09-12T01:14:13.244311+0000","last_peered":"2024-09-12T01:14:13.244311+0000","last_clean":"2024-09-12T01:14:13.244311+0000","last_became_active":"2024-09-12T00:22:02.427612+0000","last_became_peered":"2024-09-12T00:22:02.427612+0000","last_unstale":"2024-09-12T01:14:13.244311+0000","last_undegraded":"2024-09-12T01:14:13.244311+0000","last_fullsized":"2024-09-12T01:14:13.244311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.260856+0000","last_change":"2024-09-12T00:21:58.335917+0000","last_active":"2024-09-12T01:14:03.260856+0000","last_peered":"2024-09-12T01:14:03.260856+0000","last_clean":"2024-09-12T01:14:03.260856+0000","last_became_active":"2024-09-12T00:21:58.335619+0000","last_became_peered":"2024-09-12T00:21:58.335619+0000","last_unstale":"2024-09-12T01:14:03.260856+0000","last_undegraded":"2024-09-12T01:14:03.260856+0000","last_fullsized":"2024-09-12T01:14:03.260856+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455358+0000","last_change":"2024-09-12T00:17:58.356021+0000","last_active":"2024-09-12T01:12:58.455358+0000","last_peered":"2024-09-12T01:12:58.455358+0000","last_clean":"2024-09-12T01:12:58.455358+0000","last_became_active":"2024-09-12T00:17:58.355691+0000","last_became_peered":"2024-09-12T00:17:58.355691+0000","last_unstale":"2024-09-12T01:12:58.455358+0000","last_undegraded":"2024-09-12T01:12:58.455358+0000","last_fullsized":"2024-09-12T01:12:58.455358+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:23.027551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238400+0000","last_change":"2024-09-12T00:39:26.635830+0000","last_active":"2024-09-12T01:13:33.238400+0000","last_peered":"2024-09-12T01:13:33.238400+0000","last_clean":"2024-09-12T01:13:33.238400+0000","last_became_active":"2024-09-12T00:39:26.635537+0000","last_became_peered":"2024-09-12T00:39:26.635537+0000","last_unstale":"2024-09-12T01:13:33.238400+0000","last_undegraded":"2024-09-12T01:13:33.238400+0000","last_fullsized":"2024-09-12T01:13:33.238400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:16.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510161+0000","last_change":"2024-09-12T00:22:02.429586+0000","last_active":"2024-09-12T01:12:53.510161+0000","last_peered":"2024-09-12T01:12:53.510161+0000","last_clean":"2024-09-12T01:12:53.510161+0000","last_became_active":"2024-09-12T00:22:02.429230+0000","last_became_peered":"2024-09-12T00:22:02.429230+0000","last_unstale":"2024-09-12T01:12:53.510161+0000","last_undegraded":"2024-09-12T01:12:53.510161+0000","last_fullsized":"2024-09-12T01:12:53.510161+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:50.744822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.221802+0000","last_change":"2024-09-12T00:21:58.338788+0000","last_active":"2024-09-12T01:15:48.221802+0000","last_peered":"2024-09-12T01:15:48.221802+0000","last_clean":"2024-09-12T01:15:48.221802+0000","last_became_active":"2024-09-12T00:21:58.338021+0000","last_became_peered":"2024-09-12T00:21:58.338021+0000","last_unstale":"2024-09-12T01:15:48.221802+0000","last_undegraded":"2024-09-12T01:15:48.221802+0000","last_fullsized":"2024-09-12T01:15:48.221802+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:31.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'22","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455331+0000","last_change":"2024-09-12T00:17:58.358082+0000","last_active":"2024-09-12T01:12:58.455331+0000","last_peered":"2024-09-12T01:12:58.455331+0000","last_clean":"2024-09-12T01:12:58.455331+0000","last_became_active":"2024-09-12T00:17:58.357755+0000","last_became_peered":"2024-09-12T00:17:58.357755+0000","last_unstale":"2024-09-12T01:12:58.455331+0000","last_undegraded":"2024-09-12T01:12:58.455331+0000","last_fullsized":"2024-09-12T01:12:58.455331+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:17.853509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.235439+0000","last_change":"2024-09-12T00:39:26.631339+0000","last_active":"2024-09-12T01:12:48.235439+0000","last_peered":"2024-09-12T01:12:48.235439+0000","last_clean":"2024-09-12T01:12:48.235439+0000","last_became_active":"2024-09-12T00:39:26.630758+0000","last_became_peered":"2024-09-12T00:39:26.630758+0000","last_unstale":"2024-09-12T01:12:48.235439+0000","last_undegraded":"2024-09-12T01:12:48.235439+0000","last_fullsized":"2024-09-12T01:12:48.235439+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.184229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'5","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.041261+0000","last_change":"2024-09-12T00:22:02.428161+0000","last_active":"2024-09-12T01:15:48.041261+0000","last_peered":"2024-09-12T01:15:48.041261+0000","last_clean":"2024-09-12T01:15:48.041261+0000","last_became_active":"2024-09-12T00:22:02.427863+0000","last_became_peered":"2024-09-12T00:22:02.427863+0000","last_unstale":"2024-09-12T01:15:48.041261+0000","last_undegraded":"2024-09-12T01:15:48.041261+0000","last_fullsized":"2024-09-12T01:15:48.041261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:46.107765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":40,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397371+0000","last_change":"2024-09-12T00:21:58.330893+0000","last_active":"2024-09-12T01:12:53.397371+0000","last_peered":"2024-09-12T01:12:53.397371+0000","last_clean":"2024-09-12T01:12:53.397371+0000","last_became_active":"2024-09-12T00:21:58.330308+0000","last_became_peered":"2024-09-12T00:21:58.330308+0000","last_unstale":"2024-09-12T01:12:53.397371+0000","last_undegraded":"2024-09-12T01:12:53.397371+0000","last_fullsized":"2024-09-12T01:12:53.397371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.864549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'33","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616030+0000","last_change":"2024-09-12T00:17:58.360675+0000","last_active":"2024-09-12T01:12:58.616030+0000","last_peered":"2024-09-12T01:12:58.616030+0000","last_clean":"2024-09-12T01:12:58.616030+0000","last_became_active":"2024-09-12T00:17:58.360394+0000","last_became_peered":"2024-09-12T00:17:58.360394+0000","last_unstale":"2024-09-12T01:12:58.616030+0000","last_undegraded":"2024-09-12T01:12:58.616030+0000","last_fullsized":"2024-09-12T01:12:58.616030+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:36.476994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":120,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391380+0000","last_change":"2024-09-12T00:39:26.638745+0000","last_active":"2024-09-12T01:11:58.391380+0000","last_peered":"2024-09-12T01:11:58.391380+0000","last_clean":"2024-09-12T01:11:58.391380+0000","last_became_active":"2024-09-12T00:39:26.638443+0000","last_became_peered":"2024-09-12T00:39:26.638443+0000","last_unstale":"2024-09-12T01:11:58.391380+0000","last_undegraded":"2024-09-12T01:11:58.391380+0000","last_fullsized":"2024-09-12T01:11:58.391380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:39.177058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"264'5","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.608465+0000","last_change":"2024-09-12T00:22:02.420219+0000","last_active":"2024-09-12T01:12:03.608465+0000","last_peered":"2024-09-12T01:12:03.608465+0000","last_clean":"2024-09-12T01:12:03.608465+0000","last_became_active":"2024-09-12T00:22:02.419920+0000","last_became_peered":"2024-09-12T00:22:02.419920+0000","last_unstale":"2024-09-12T01:12:03.608465+0000","last_undegraded":"2024-09-12T01:12:03.608465+0000","last_fullsized":"2024-09-12T01:12:03.608465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.257546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6462,"num_write":5,"num_write_kb":6462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.057954+0000","last_change":"2024-09-12T00:21:58.334923+0000","last_active":"2024-09-12T01:15:48.057954+0000","last_peered":"2024-09-12T01:15:48.057954+0000","last_clean":"2024-09-12T01:15:48.057954+0000","last_became_active":"2024-09-12T00:21:58.334622+0000","last_became_peered":"2024-09-12T00:21:58.334622+0000","last_unstale":"2024-09-12T01:15:48.057954+0000","last_undegraded":"2024-09-12T01:15:48.057954+0000","last_fullsized":"2024-09-12T01:15:48.057954+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:27.246572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'18","reported_seq":108,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:50.250668+0000","last_change":"2024-09-12T00:17:58.362164+0000","last_active":"2024-09-12T01:13:50.250668+0000","last_peered":"2024-09-12T01:13:50.250668+0000","last_clean":"2024-09-12T01:13:50.250668+0000","last_became_active":"2024-09-12T00:17:58.361620+0000","last_became_peered":"2024-09-12T00:17:58.361620+0000","last_unstale":"2024-09-12T01:13:50.250668+0000","last_undegraded":"2024-09-12T01:13:50.250668+0000","last_fullsized":"2024-09-12T01:13:50.250668+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391431+0000","last_change":"2024-09-12T00:39:26.643583+0000","last_active":"2024-09-12T01:11:58.391431+0000","last_peered":"2024-09-12T01:11:58.391431+0000","last_clean":"2024-09-12T01:11:58.391431+0000","last_became_active":"2024-09-12T00:39:26.643223+0000","last_became_peered":"2024-09-12T00:39:26.643223+0000","last_unstale":"2024-09-12T01:11:58.391431+0000","last_undegraded":"2024-09-12T01:11:58.391431+0000","last_fullsized":"2024-09-12T01:11:58.391431+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:18.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'5","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066478+0000","last_change":"2024-09-12T00:22:22.312042+0000","last_active":"2024-09-12T01:15:48.066478+0000","last_peered":"2024-09-12T01:15:48.066478+0000","last_clean":"2024-09-12T01:15:48.066478+0000","last_became_active":"2024-09-12T00:22:22.311701+0000","last_became_peered":"2024-09-12T00:22:22.311701+0000","last_unstale":"2024-09-12T01:15:48.066478+0000","last_undegraded":"2024-09-12T01:15:48.066478+0000","last_fullsized":"2024-09-12T01:15:48.066478+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.780165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":5,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237766+0000","last_change":"2024-09-12T00:21:58.339874+0000","last_active":"2024-09-12T01:12:00.237766+0000","last_peered":"2024-09-12T01:12:00.237766+0000","last_clean":"2024-09-12T01:12:00.237766+0000","last_became_active":"2024-09-12T00:21:58.339586+0000","last_became_peered":"2024-09-12T00:21:58.339586+0000","last_unstale":"2024-09-12T01:12:00.237766+0000","last_undegraded":"2024-09-12T01:12:00.237766+0000","last_fullsized":"2024-09-12T01:12:00.237766+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:27.131816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'26","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.240180+0000","last_change":"2024-09-12T00:17:58.352434+0000","last_active":"2024-09-12T01:13:33.240180+0000","last_peered":"2024-09-12T01:13:33.240180+0000","last_clean":"2024-09-12T01:13:33.240180+0000","last_became_active":"2024-09-12T00:17:58.352129+0000","last_became_peered":"2024-09-12T00:17:58.352129+0000","last_unstale":"2024-09-12T01:13:33.240180+0000","last_undegraded":"2024-09-12T01:13:33.240180+0000","last_fullsized":"2024-09-12T01:13:33.240180+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230767+0000","last_change":"2024-09-12T00:39:26.636027+0000","last_active":"2024-09-12T01:12:08.230767+0000","last_peered":"2024-09-12T01:12:08.230767+0000","last_clean":"2024-09-12T01:12:08.230767+0000","last_became_active":"2024-09-12T00:39:26.635558+0000","last_became_peered":"2024-09-12T00:39:26.635558+0000","last_unstale":"2024-09-12T01:12:08.230767+0000","last_undegraded":"2024-09-12T01:12:08.230767+0000","last_fullsized":"2024-09-12T01:12:08.230767+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.105963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.252261+0000","last_change":"2024-09-12T00:22:02.427487+0000","last_active":"2024-09-12T01:15:13.252261+0000","last_peered":"2024-09-12T01:15:13.252261+0000","last_clean":"2024-09-12T01:15:13.252261+0000","last_became_active":"2024-09-12T00:22:02.427180+0000","last_became_peered":"2024-09-12T00:22:02.427180+0000","last_unstale":"2024-09-12T01:15:13.252261+0000","last_undegraded":"2024-09-12T01:15:13.252261+0000","last_fullsized":"2024-09-12T01:15:13.252261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:40.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.535314+0000","last_change":"2024-09-12T00:21:58.334729+0000","last_active":"2024-09-12T01:15:43.535314+0000","last_peered":"2024-09-12T01:15:43.535314+0000","last_clean":"2024-09-12T01:15:43.535314+0000","last_became_active":"2024-09-12T00:21:58.334446+0000","last_became_peered":"2024-09-12T00:21:58.334446+0000","last_unstale":"2024-09-12T01:15:43.535314+0000","last_undegraded":"2024-09-12T01:15:43.535314+0000","last_fullsized":"2024-09-12T01:15:43.535314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:37.568023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'14","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:35.248951+0000","last_change":"2024-09-12T00:17:58.360971+0000","last_active":"2024-09-12T01:13:35.248951+0000","last_peered":"2024-09-12T01:13:35.248951+0000","last_clean":"2024-09-12T01:13:35.248951+0000","last_became_active":"2024-09-12T00:17:58.360560+0000","last_became_peered":"2024-09-12T00:17:58.360560+0000","last_unstale":"2024-09-12T01:13:35.248951+0000","last_undegraded":"2024-09-12T01:13:35.248951+0000","last_fullsized":"2024-09-12T01:13:35.248951+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222918+0000","last_change":"2024-09-12T00:39:26.635643+0000","last_active":"2024-09-12T01:12:08.222918+0000","last_peered":"2024-09-12T01:12:08.222918+0000","last_clean":"2024-09-12T01:12:08.222918+0000","last_became_active":"2024-09-12T00:39:26.635359+0000","last_became_peered":"2024-09-12T00:39:26.635359+0000","last_unstale":"2024-09-12T01:12:08.222918+0000","last_undegraded":"2024-09-12T01:12:08.222918+0000","last_fullsized":"2024-09-12T01:12:08.222918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:47.949344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066730+0000","last_change":"2024-09-12T00:22:02.432403+0000","last_active":"2024-09-12T01:15:48.066730+0000","last_peered":"2024-09-12T01:15:48.066730+0000","last_clean":"2024-09-12T01:15:48.066730+0000","last_became_active":"2024-09-12T00:22:02.431994+0000","last_became_peered":"2024-09-12T00:22:02.431994+0000","last_unstale":"2024-09-12T01:15:48.066730+0000","last_undegraded":"2024-09-12T01:15:48.066730+0000","last_fullsized":"2024-09-12T01:15:48.066730+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.483552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397576+0000","last_change":"2024-09-12T00:21:58.327781+0000","last_active":"2024-09-12T01:12:43.397576+0000","last_peered":"2024-09-12T01:12:43.397576+0000","last_clean":"2024-09-12T01:12:43.397576+0000","last_became_active":"2024-09-12T00:21:58.327504+0000","last_became_peered":"2024-09-12T00:21:58.327504+0000","last_unstale":"2024-09-12T01:12:43.397576+0000","last_undegraded":"2024-09-12T01:12:43.397576+0000","last_fullsized":"2024-09-12T01:12:43.397576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:09.606355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'62","reported_seq":222,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238426+0000","last_change":"2024-09-12T00:17:58.360373+0000","last_active":"2024-09-12T01:13:33.238426+0000","last_peered":"2024-09-12T01:13:33.238426+0000","last_clean":"2024-09-12T01:13:33.238426+0000","last_became_active":"2024-09-12T00:17:58.360095+0000","last_became_peered":"2024-09-12T00:17:58.360095+0000","last_unstale":"2024-09-12T01:13:33.238426+0000","last_undegraded":"2024-09-12T01:13:33.238426+0000","last_fullsized":"2024-09-12T01:13:33.238426+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":213,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392762+0000","last_change":"2024-09-12T00:39:26.639982+0000","last_active":"2024-09-12T01:12:08.392762+0000","last_peered":"2024-09-12T01:12:08.392762+0000","last_clean":"2024-09-12T01:12:08.392762+0000","last_became_active":"2024-09-12T00:39:26.639681+0000","last_became_peered":"2024-09-12T00:39:26.639681+0000","last_unstale":"2024-09-12T01:12:08.392762+0000","last_undegraded":"2024-09-12T01:12:08.392762+0000","last_fullsized":"2024-09-12T01:12:08.392762+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:35.336644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.454200+0000","last_change":"2024-09-12T00:22:02.427581+0000","last_active":"2024-09-12T01:12:48.454200+0000","last_peered":"2024-09-12T01:12:48.454200+0000","last_clean":"2024-09-12T01:12:48.454200+0000","last_became_active":"2024-09-12T00:22:02.427285+0000","last_became_peered":"2024-09-12T00:22:02.427285+0000","last_unstale":"2024-09-12T01:12:48.454200+0000","last_undegraded":"2024-09-12T01:12:48.454200+0000","last_fullsized":"2024-09-12T01:12:48.454200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:22.119778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.227172+0000","last_change":"2024-09-12T00:21:58.335430+0000","last_active":"2024-09-12T01:12:43.227172+0000","last_peered":"2024-09-12T01:12:43.227172+0000","last_clean":"2024-09-12T01:12:43.227172+0000","last_became_active":"2024-09-12T00:21:58.335100+0000","last_became_peered":"2024-09-12T00:21:58.335100+0000","last_unstale":"2024-09-12T01:12:43.227172+0000","last_undegraded":"2024-09-12T01:12:43.227172+0000","last_fullsized":"2024-09-12T01:12:43.227172+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:24.939276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'91","reported_seq":370,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.232366+0000","last_change":"2024-09-12T00:17:58.350821+0000","last_active":"2024-09-12T01:13:33.232366+0000","last_peered":"2024-09-12T01:13:33.232366+0000","last_clean":"2024-09-12T01:13:33.232366+0000","last_became_active":"2024-09-12T00:17:58.350522+0000","last_became_peered":"2024-09-12T00:17:58.350522+0000","last_unstale":"2024-09-12T01:13:33.232366+0000","last_undegraded":"2024-09-12T01:13:33.232366+0000","last_fullsized":"2024-09-12T01:13:33.232366+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":413,"num_write":129,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503487+0000","last_change":"2024-09-12T00:39:26.642765+0000","last_active":"2024-09-12T01:12:08.503487+0000","last_peered":"2024-09-12T01:12:08.503487+0000","last_clean":"2024-09-12T01:12:08.503487+0000","last_became_active":"2024-09-12T00:39:26.642486+0000","last_became_peered":"2024-09-12T00:39:26.642486+0000","last_unstale":"2024-09-12T01:12:08.503487+0000","last_undegraded":"2024-09-12T01:12:08.503487+0000","last_fullsized":"2024-09-12T01:12:08.503487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:37.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396598+0000","last_change":"2024-09-12T00:22:02.418272+0000","last_active":"2024-09-12T01:12:48.396598+0000","last_peered":"2024-09-12T01:12:48.396598+0000","last_clean":"2024-09-12T01:12:48.396598+0000","last_became_active":"2024-09-12T00:22:02.417518+0000","last_became_peered":"2024-09-12T00:22:02.417518+0000","last_unstale":"2024-09-12T01:12:48.396598+0000","last_undegraded":"2024-09-12T01:12:48.396598+0000","last_fullsized":"2024-09-12T01:12:48.396598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.931899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.211527+0000","last_change":"2024-09-12T00:21:58.337365+0000","last_active":"2024-09-12T01:15:48.211527+0000","last_peered":"2024-09-12T01:15:48.211527+0000","last_clean":"2024-09-12T01:15:48.211527+0000","last_became_active":"2024-09-12T00:21:58.337079+0000","last_became_peered":"2024-09-12T00:21:58.337079+0000","last_unstale":"2024-09-12T01:15:48.211527+0000","last_undegraded":"2024-09-12T01:15:48.211527+0000","last_fullsized":"2024-09-12T01:15:48.211527+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.875541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24618,"num_write":22,"num_write_kb":14376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'26","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.390038+0000","last_change":"2024-09-12T00:17:58.360573+0000","last_active":"2024-09-12T01:11:48.390038+0000","last_peered":"2024-09-12T01:11:48.390038+0000","last_clean":"2024-09-12T01:11:48.390038+0000","last_became_active":"2024-09-12T00:17:58.360141+0000","last_became_peered":"2024-09-12T00:17:58.360141+0000","last_unstale":"2024-09-12T01:11:48.390038+0000","last_undegraded":"2024-09-12T01:11:48.390038+0000","last_fullsized":"2024-09-12T01:11:48.390038+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.883700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236768+0000","last_change":"2024-09-12T00:39:26.636792+0000","last_active":"2024-09-12T01:13:18.236768+0000","last_peered":"2024-09-12T01:13:18.236768+0000","last_clean":"2024-09-12T01:13:18.236768+0000","last_became_active":"2024-09-12T00:39:26.636434+0000","last_became_peered":"2024-09-12T00:39:26.636434+0000","last_unstale":"2024-09-12T01:13:18.236768+0000","last_undegraded":"2024-09-12T01:13:18.236768+0000","last_fullsized":"2024-09-12T01:13:18.236768+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:17.120295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256725+0000","last_change":"2024-09-12T00:22:02.420813+0000","last_active":"2024-09-12T01:15:43.256725+0000","last_peered":"2024-09-12T01:15:43.256725+0000","last_clean":"2024-09-12T01:15:43.256725+0000","last_became_active":"2024-09-12T00:22:02.420528+0000","last_became_peered":"2024-09-12T00:22:02.420528+0000","last_unstale":"2024-09-12T01:15:43.256725+0000","last_undegraded":"2024-09-12T01:15:43.256725+0000","last_fullsized":"2024-09-12T01:15:43.256725+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:36.557751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:38.274384+0000","last_change":"2024-09-12T00:21:58.337490+0000","last_active":"2024-09-12T01:15:38.274384+0000","last_peered":"2024-09-12T01:15:38.274384+0000","last_clean":"2024-09-12T01:15:38.274384+0000","last_became_active":"2024-09-12T00:21:58.337215+0000","last_became_peered":"2024-09-12T00:21:58.337215+0000","last_unstale":"2024-09-12T01:15:38.274384+0000","last_undegraded":"2024-09-12T01:15:38.274384+0000","last_fullsized":"2024-09-12T01:15:38.274384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.089070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.388739+0000","last_change":"2024-09-12T00:17:58.360965+0000","last_active":"2024-09-12T01:11:38.388739+0000","last_peered":"2024-09-12T01:11:38.388739+0000","last_clean":"2024-09-12T01:11:38.388739+0000","last_became_active":"2024-09-12T00:17:58.360592+0000","last_became_peered":"2024-09-12T00:17:58.360592+0000","last_unstale":"2024-09-12T01:11:38.388739+0000","last_undegraded":"2024-09-12T01:11:38.388739+0000","last_fullsized":"2024-09-12T01:11:38.388739+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:45.213272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.247005+0000","last_change":"2024-09-12T00:39:26.641706+0000","last_active":"2024-09-12T01:13:20.247005+0000","last_peered":"2024-09-12T01:13:20.247005+0000","last_clean":"2024-09-12T01:13:20.247005+0000","last_became_active":"2024-09-12T00:39:26.641432+0000","last_became_peered":"2024-09-12T00:39:26.641432+0000","last_unstale":"2024-09-12T01:13:20.247005+0000","last_undegraded":"2024-09-12T01:13:20.247005+0000","last_fullsized":"2024-09-12T01:13:20.247005+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.345745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.239133+0000","last_change":"2024-09-12T00:22:02.423461+0000","last_active":"2024-09-12T01:13:23.239133+0000","last_peered":"2024-09-12T01:13:23.239133+0000","last_clean":"2024-09-12T01:13:23.239133+0000","last_became_active":"2024-09-12T00:22:02.423012+0000","last_became_peered":"2024-09-12T00:22:02.423012+0000","last_unstale":"2024-09-12T01:13:23.239133+0000","last_undegraded":"2024-09-12T01:13:23.239133+0000","last_fullsized":"2024-09-12T01:13:23.239133+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:14.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236682+0000","last_change":"2024-09-12T00:21:58.334875+0000","last_active":"2024-09-12T01:13:18.236682+0000","last_peered":"2024-09-12T01:13:18.236682+0000","last_clean":"2024-09-12T01:13:18.236682+0000","last_became_active":"2024-09-12T00:21:58.334493+0000","last_became_peered":"2024-09-12T00:21:58.334493+0000","last_unstale":"2024-09-12T01:13:18.236682+0000","last_undegraded":"2024-09-12T01:13:18.236682+0000","last_fullsized":"2024-09-12T01:13:18.236682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:46.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'39","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.235549+0000","last_change":"2024-09-12T00:17:58.355241+0000","last_active":"2024-09-12T01:11:40.235549+0000","last_peered":"2024-09-12T01:11:40.235549+0000","last_clean":"2024-09-12T01:11:40.235549+0000","last_became_active":"2024-09-12T00:17:58.354989+0000","last_became_peered":"2024-09-12T00:17:58.354989+0000","last_unstale":"2024-09-12T01:11:40.235549+0000","last_undegraded":"2024-09-12T01:11:40.235549+0000","last_fullsized":"2024-09-12T01:11:40.235549+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:24.511646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":70,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240008+0000","last_change":"2024-09-12T00:39:26.630455+0000","last_active":"2024-09-12T01:12:20.240008+0000","last_peered":"2024-09-12T01:12:20.240008+0000","last_clean":"2024-09-12T01:12:20.240008+0000","last_became_active":"2024-09-12T00:39:26.627899+0000","last_became_peered":"2024-09-12T00:39:26.627899+0000","last_unstale":"2024-09-12T01:12:20.240008+0000","last_undegraded":"2024-09-12T01:12:20.240008+0000","last_fullsized":"2024-09-12T01:12:20.240008+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:19.704293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256860+0000","last_change":"2024-09-12T00:22:02.428036+0000","last_active":"2024-09-12T01:15:43.256860+0000","last_peered":"2024-09-12T01:15:43.256860+0000","last_clean":"2024-09-12T01:15:43.256860+0000","last_became_active":"2024-09-12T00:22:02.427322+0000","last_became_peered":"2024-09-12T00:22:02.427322+0000","last_unstale":"2024-09-12T01:15:43.256860+0000","last_undegraded":"2024-09-12T01:15:43.256860+0000","last_fullsized":"2024-09-12T01:15:43.256860+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:40.144405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.618639+0000","last_change":"2024-09-12T00:21:58.329454+0000","last_active":"2024-09-12T01:13:18.618639+0000","last_peered":"2024-09-12T01:13:18.618639+0000","last_clean":"2024-09-12T01:13:18.618639+0000","last_became_active":"2024-09-12T00:21:58.329166+0000","last_became_peered":"2024-09-12T00:21:58.329166+0000","last_unstale":"2024-09-12T01:13:18.618639+0000","last_undegraded":"2024-09-12T01:13:18.618639+0000","last_fullsized":"2024-09-12T01:13:18.618639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:00.444000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'42","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386895+0000","last_change":"2024-09-12T00:17:58.355842+0000","last_active":"2024-09-12T01:11:38.386895+0000","last_peered":"2024-09-12T01:11:38.386895+0000","last_clean":"2024-09-12T01:11:38.386895+0000","last_became_active":"2024-09-12T00:17:58.355530+0000","last_became_peered":"2024-09-12T00:17:58.355530+0000","last_unstale":"2024-09-12T01:11:38.386895+0000","last_undegraded":"2024-09-12T01:11:38.386895+0000","last_fullsized":"2024-09-12T01:11:38.386895+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:00.979655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":155,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236747+0000","last_change":"2024-09-12T00:39:26.636645+0000","last_active":"2024-09-12T01:13:18.236747+0000","last_peered":"2024-09-12T01:13:18.236747+0000","last_clean":"2024-09-12T01:13:18.236747+0000","last_became_active":"2024-09-12T00:39:26.635996+0000","last_became_peered":"2024-09-12T00:39:26.635996+0000","last_unstale":"2024-09-12T01:13:18.236747+0000","last_undegraded":"2024-09-12T01:13:18.236747+0000","last_fullsized":"2024-09-12T01:13:18.236747+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:54.401173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.619395+0000","last_change":"2024-09-12T00:22:02.424107+0000","last_active":"2024-09-12T01:13:23.619395+0000","last_peered":"2024-09-12T01:13:23.619395+0000","last_clean":"2024-09-12T01:13:23.619395+0000","last_became_active":"2024-09-12T00:22:02.423766+0000","last_became_peered":"2024-09-12T00:22:02.423766+0000","last_unstale":"2024-09-12T01:13:23.619395+0000","last_undegraded":"2024-09-12T01:13:23.619395+0000","last_fullsized":"2024-09-12T01:13:23.619395+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:45.304079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.514151+0000","last_change":"2024-09-12T00:21:58.334763+0000","last_active":"2024-09-12T01:13:18.514151+0000","last_peered":"2024-09-12T01:13:18.514151+0000","last_clean":"2024-09-12T01:13:18.514151+0000","last_became_active":"2024-09-12T00:21:58.334482+0000","last_became_peered":"2024-09-12T00:21:58.334482+0000","last_unstale":"2024-09-12T01:13:18.514151+0000","last_undegraded":"2024-09-12T01:13:18.514151+0000","last_fullsized":"2024-09-12T01:13:18.514151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.615431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'8","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.445588+0000","last_change":"2024-09-12T00:17:58.357504+0000","last_active":"2024-09-12T01:11:38.445588+0000","last_peered":"2024-09-12T01:11:38.445588+0000","last_clean":"2024-09-12T01:11:38.445588+0000","last_became_active":"2024-09-12T00:17:58.357226+0000","last_became_peered":"2024-09-12T00:17:58.357226+0000","last_unstale":"2024-09-12T01:11:38.445588+0000","last_undegraded":"2024-09-12T01:11:38.445588+0000","last_fullsized":"2024-09-12T01:11:38.445588+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.150821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.222890+0000","last_change":"2024-09-12T00:39:26.638504+0000","last_active":"2024-09-12T01:12:08.222890+0000","last_peered":"2024-09-12T01:12:08.222890+0000","last_clean":"2024-09-12T01:12:08.222890+0000","last_became_active":"2024-09-12T00:39:26.638202+0000","last_became_peered":"2024-09-12T00:39:26.638202+0000","last_unstale":"2024-09-12T01:12:08.222890+0000","last_undegraded":"2024-09-12T01:12:08.222890+0000","last_fullsized":"2024-09-12T01:12:08.222890+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:29.584845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.240177+0000","last_change":"2024-09-12T00:22:02.428671+0000","last_active":"2024-09-12T01:13:48.240177+0000","last_peered":"2024-09-12T01:13:48.240177+0000","last_clean":"2024-09-12T01:13:48.240177+0000","last_became_active":"2024-09-12T00:22:02.427762+0000","last_became_peered":"2024-09-12T00:22:02.427762+0000","last_unstale":"2024-09-12T01:13:48.240177+0000","last_undegraded":"2024-09-12T01:13:48.240177+0000","last_fullsized":"2024-09-12T01:13:48.240177+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"267'5","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.087874+0000","last_change":"2024-09-12T00:21:58.338414+0000","last_active":"2024-09-12T01:15:48.087874+0000","last_peered":"2024-09-12T01:15:48.087874+0000","last_clean":"2024-09-12T01:15:48.087874+0000","last_became_active":"2024-09-12T00:21:58.338104+0000","last_became_peered":"2024-09-12T00:21:58.338104+0000","last_unstale":"2024-09-12T01:15:48.087874+0000","last_undegraded":"2024-09-12T01:15:48.087874+0000","last_fullsized":"2024-09-12T01:15:48.087874+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10244,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'33","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.448982+0000","last_change":"2024-09-12T00:17:58.352171+0000","last_active":"2024-09-12T01:12:03.448982+0000","last_peered":"2024-09-12T01:12:03.448982+0000","last_clean":"2024-09-12T01:12:03.448982+0000","last_became_active":"2024-09-12T00:17:58.351876+0000","last_became_peered":"2024-09-12T00:17:58.351876+0000","last_unstale":"2024-09-12T01:12:03.448982+0000","last_undegraded":"2024-09-12T01:12:03.448982+0000","last_fullsized":"2024-09-12T01:12:03.448982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.992607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":110,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401591+0000","last_change":"2024-09-12T00:39:26.640188+0000","last_active":"2024-09-12T01:13:13.401591+0000","last_peered":"2024-09-12T01:13:13.401591+0000","last_clean":"2024-09-12T01:13:13.401591+0000","last_became_active":"2024-09-12T00:39:26.639704+0000","last_became_peered":"2024-09-12T00:39:26.639704+0000","last_unstale":"2024-09-12T01:13:13.401591+0000","last_undegraded":"2024-09-12T01:13:13.401591+0000","last_fullsized":"2024-09-12T01:13:13.401591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.680724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'6","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.132302+0000","last_change":"2024-09-12T00:22:02.430308+0000","last_active":"2024-09-12T01:15:48.132302+0000","last_peered":"2024-09-12T01:15:48.132302+0000","last_clean":"2024-09-12T01:15:48.132302+0000","last_became_active":"2024-09-12T00:22:02.430034+0000","last_became_peered":"2024-09-12T00:22:02.430034+0000","last_unstale":"2024-09-12T01:15:48.132302+0000","last_undegraded":"2024-09-12T01:15:48.132302+0000","last_fullsized":"2024-09-12T01:15:48.132302+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.295199+0000","last_change":"2024-09-12T00:21:58.333427+0000","last_active":"2024-09-12T01:15:48.295199+0000","last_peered":"2024-09-12T01:15:48.295199+0000","last_clean":"2024-09-12T01:15:48.295199+0000","last_became_active":"2024-09-12T00:21:58.333135+0000","last_became_peered":"2024-09-12T00:21:58.333135+0000","last_unstale":"2024-09-12T01:15:48.295199+0000","last_undegraded":"2024-09-12T01:15:48.295199+0000","last_fullsized":"2024-09-12T01:15:48.295199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'34","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502186+0000","last_change":"2024-09-12T00:17:58.360392+0000","last_active":"2024-09-12T01:11:58.502186+0000","last_peered":"2024-09-12T01:11:58.502186+0000","last_clean":"2024-09-12T01:11:58.502186+0000","last_became_active":"2024-09-12T00:17:58.360064+0000","last_became_peered":"2024-09-12T00:17:58.360064+0000","last_unstale":"2024-09-12T01:11:58.502186+0000","last_undegraded":"2024-09-12T01:11:58.502186+0000","last_fullsized":"2024-09-12T01:11:58.502186+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:06.356739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":114,"num_write":67,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607743+0000","last_change":"2024-09-12T00:39:26.620334+0000","last_active":"2024-09-12T01:11:58.607743+0000","last_peered":"2024-09-12T01:11:58.607743+0000","last_clean":"2024-09-12T01:11:58.607743+0000","last_became_active":"2024-09-12T00:39:26.620012+0000","last_became_peered":"2024-09-12T00:39:26.620012+0000","last_unstale":"2024-09-12T01:11:58.607743+0000","last_undegraded":"2024-09-12T01:11:58.607743+0000","last_fullsized":"2024-09-12T01:11:58.607743+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.575760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.228663+0000","last_change":"2024-09-12T00:22:02.420815+0000","last_active":"2024-09-12T01:11:48.228663+0000","last_peered":"2024-09-12T01:11:48.228663+0000","last_clean":"2024-09-12T01:11:48.228663+0000","last_became_active":"2024-09-12T00:22:02.420536+0000","last_became_peered":"2024-09-12T00:22:02.420536+0000","last_unstale":"2024-09-12T01:11:48.228663+0000","last_undegraded":"2024-09-12T01:11:48.228663+0000","last_fullsized":"2024-09-12T01:11:48.228663+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:29.069188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:45.250189+0000","last_change":"2024-09-12T00:21:58.339677+0000","last_active":"2024-09-12T01:13:45.250189+0000","last_peered":"2024-09-12T01:13:45.250189+0000","last_clean":"2024-09-12T01:13:45.250189+0000","last_became_active":"2024-09-12T00:21:58.339390+0000","last_became_peered":"2024-09-12T00:21:58.339390+0000","last_unstale":"2024-09-12T01:13:45.250189+0000","last_undegraded":"2024-09-12T01:13:45.250189+0000","last_fullsized":"2024-09-12T01:13:45.250189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'22","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.607816+0000","last_change":"2024-09-12T00:17:58.355891+0000","last_active":"2024-09-12T01:11:58.607816+0000","last_peered":"2024-09-12T01:11:58.607816+0000","last_clean":"2024-09-12T01:11:58.607816+0000","last_became_active":"2024-09-12T00:17:58.355602+0000","last_became_peered":"2024-09-12T00:17:58.355602+0000","last_unstale":"2024-09-12T01:11:58.607816+0000","last_undegraded":"2024-09-12T01:11:58.607816+0000","last_fullsized":"2024-09-12T01:11:58.607816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:26.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391317+0000","last_change":"2024-09-12T00:39:26.644546+0000","last_active":"2024-09-12T01:11:58.391317+0000","last_peered":"2024-09-12T01:11:58.391317+0000","last_clean":"2024-09-12T01:11:58.391317+0000","last_became_active":"2024-09-12T00:39:26.644190+0000","last_became_peered":"2024-09-12T00:39:26.644190+0000","last_unstale":"2024-09-12T01:11:58.391317+0000","last_undegraded":"2024-09-12T01:11:58.391317+0000","last_fullsized":"2024-09-12T01:11:58.391317+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:28.896406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.068076+0000","last_change":"2024-09-12T00:22:02.429622+0000","last_active":"2024-09-12T01:15:48.068076+0000","last_peered":"2024-09-12T01:15:48.068076+0000","last_clean":"2024-09-12T01:15:48.068076+0000","last_became_active":"2024-09-12T00:22:02.429289+0000","last_became_peered":"2024-09-12T00:22:02.429289+0000","last_unstale":"2024-09-12T01:15:48.068076+0000","last_undegraded":"2024-09-12T01:15:48.068076+0000","last_fullsized":"2024-09-12T01:15:48.068076+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'3","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.242953+0000","last_change":"2024-09-12T00:21:58.334628+0000","last_active":"2024-09-12T01:13:58.242953+0000","last_peered":"2024-09-12T01:13:58.242953+0000","last_clean":"2024-09-12T01:13:58.242953+0000","last_became_active":"2024-09-12T00:21:58.334362+0000","last_became_peered":"2024-09-12T00:21:58.334362+0000","last_unstale":"2024-09-12T01:13:58.242953+0000","last_undegraded":"2024-09-12T01:13:58.242953+0000","last_fullsized":"2024-09-12T01:13:58.242953+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'50","reported_seq":198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221741+0000","last_change":"2024-09-12T00:17:58.353550+0000","last_active":"2024-09-12T01:11:58.221741+0000","last_peered":"2024-09-12T01:11:58.221741+0000","last_clean":"2024-09-12T01:11:58.221741+0000","last_became_active":"2024-09-12T00:17:58.353253+0000","last_became_peered":"2024-09-12T00:17:58.353253+0000","last_unstale":"2024-09-12T01:11:58.221741+0000","last_undegraded":"2024-09-12T01:11:58.221741+0000","last_fullsized":"2024-09-12T01:11:58.221741+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":79,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.457321+0000","last_change":"2024-09-12T00:39:26.636163+0000","last_active":"2024-09-12T01:13:13.457321+0000","last_peered":"2024-09-12T01:13:13.457321+0000","last_clean":"2024-09-12T01:13:13.457321+0000","last_became_active":"2024-09-12T00:39:26.633295+0000","last_became_peered":"2024-09-12T00:39:26.633295+0000","last_unstale":"2024-09-12T01:13:13.457321+0000","last_undegraded":"2024-09-12T01:13:13.457321+0000","last_fullsized":"2024-09-12T01:13:13.457321+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:58.692850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.260744+0000","last_change":"2024-09-12T00:22:02.429406+0000","last_active":"2024-09-12T01:14:03.260744+0000","last_peered":"2024-09-12T01:14:03.260744+0000","last_clean":"2024-09-12T01:14:03.260744+0000","last_became_active":"2024-09-12T00:22:02.429088+0000","last_became_peered":"2024-09-12T00:22:02.429088+0000","last_unstale":"2024-09-12T01:14:03.260744+0000","last_undegraded":"2024-09-12T01:14:03.260744+0000","last_fullsized":"2024-09-12T01:14:03.260744+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.251778+0000","last_change":"2024-09-12T00:21:58.338881+0000","last_active":"2024-09-12T01:14:00.251778+0000","last_peered":"2024-09-12T01:14:00.251778+0000","last_clean":"2024-09-12T01:14:00.251778+0000","last_became_active":"2024-09-12T00:21:58.338592+0000","last_became_peered":"2024-09-12T00:21:58.338592+0000","last_unstale":"2024-09-12T01:14:00.251778+0000","last_undegraded":"2024-09-12T01:14:00.251778+0000","last_fullsized":"2024-09-12T01:14:00.251778+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'20","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237791+0000","last_change":"2024-09-12T00:17:58.357513+0000","last_active":"2024-09-12T01:12:00.237791+0000","last_peered":"2024-09-12T01:12:00.237791+0000","last_clean":"2024-09-12T01:12:00.237791+0000","last_became_active":"2024-09-12T00:17:58.357219+0000","last_became_peered":"2024-09-12T00:17:58.357219+0000","last_unstale":"2024-09-12T01:12:00.237791+0000","last_undegraded":"2024-09-12T01:12:00.237791+0000","last_fullsized":"2024-09-12T01:12:00.237791+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:44.097143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":69,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.402289+0000","last_change":"2024-09-12T00:39:26.643775+0000","last_active":"2024-09-12T01:13:18.402289+0000","last_peered":"2024-09-12T01:13:18.402289+0000","last_clean":"2024-09-12T01:13:18.402289+0000","last_became_active":"2024-09-12T00:39:26.643469+0000","last_became_peered":"2024-09-12T00:39:26.643469+0000","last_unstale":"2024-09-12T01:13:18.402289+0000","last_undegraded":"2024-09-12T01:13:18.402289+0000","last_fullsized":"2024-09-12T01:13:18.402289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:16.398681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408640+0000","last_change":"2024-09-12T00:22:02.422788+0000","last_active":"2024-09-12T01:14:03.408640+0000","last_peered":"2024-09-12T01:14:03.408640+0000","last_clean":"2024-09-12T01:14:03.408640+0000","last_became_active":"2024-09-12T00:22:02.422532+0000","last_became_peered":"2024-09-12T00:22:02.422532+0000","last_unstale":"2024-09-12T01:14:03.408640+0000","last_undegraded":"2024-09-12T01:14:03.408640+0000","last_fullsized":"2024-09-12T01:14:03.408640+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.009325+0000","last_change":"2024-09-12T00:21:58.333014+0000","last_active":"2024-09-12T01:15:48.009325+0000","last_peered":"2024-09-12T01:15:48.009325+0000","last_clean":"2024-09-12T01:15:48.009325+0000","last_became_active":"2024-09-12T00:21:58.332715+0000","last_became_peered":"2024-09-12T00:21:58.332715+0000","last_unstale":"2024-09-12T01:15:48.009325+0000","last_undegraded":"2024-09-12T01:15:48.009325+0000","last_fullsized":"2024-09-12T01:15:48.009325+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'12","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394261+0000","last_change":"2024-09-12T00:17:58.348284+0000","last_active":"2024-09-12T01:12:18.394261+0000","last_peered":"2024-09-12T01:12:18.394261+0000","last_clean":"2024-09-12T01:12:18.394261+0000","last_became_active":"2024-09-12T00:17:58.347709+0000","last_became_peered":"2024-09-12T00:17:58.347709+0000","last_unstale":"2024-09-12T01:12:18.394261+0000","last_undegraded":"2024-09-12T01:12:18.394261+0000","last_fullsized":"2024-09-12T01:12:18.394261+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:50.010174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401624+0000","last_change":"2024-09-12T00:39:26.639353+0000","last_active":"2024-09-12T01:13:13.401624+0000","last_peered":"2024-09-12T01:13:13.401624+0000","last_clean":"2024-09-12T01:13:13.401624+0000","last_became_active":"2024-09-12T00:39:26.639094+0000","last_became_peered":"2024-09-12T00:39:26.639094+0000","last_unstale":"2024-09-12T01:13:13.401624+0000","last_undegraded":"2024-09-12T01:13:13.401624+0000","last_fullsized":"2024-09-12T01:13:13.401624+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.241862+0000","last_change":"2024-09-12T00:22:02.423237+0000","last_active":"2024-09-12T01:13:48.241862+0000","last_peered":"2024-09-12T01:13:48.241862+0000","last_clean":"2024-09-12T01:13:48.241862+0000","last_became_active":"2024-09-12T00:22:02.422922+0000","last_became_peered":"2024-09-12T00:22:02.422922+0000","last_unstale":"2024-09-12T01:13:48.241862+0000","last_undegraded":"2024-09-12T01:13:48.241862+0000","last_fullsized":"2024-09-12T01:13:48.241862+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.238314+0000","last_change":"2024-09-12T00:21:58.341237+0000","last_active":"2024-09-12T01:12:05.238314+0000","last_peered":"2024-09-12T01:12:05.238314+0000","last_clean":"2024-09-12T01:12:05.238314+0000","last_became_active":"2024-09-12T00:21:58.340910+0000","last_became_peered":"2024-09-12T00:21:58.340910+0000","last_unstale":"2024-09-12T01:12:05.238314+0000","last_undegraded":"2024-09-12T01:12:05.238314+0000","last_fullsized":"2024-09-12T01:12:05.238314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:12.245684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'59","reported_seq":219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.449466+0000","last_change":"2024-09-12T00:17:58.351895+0000","last_active":"2024-09-12T01:12:08.449466+0000","last_peered":"2024-09-12T01:12:08.449466+0000","last_clean":"2024-09-12T01:12:08.449466+0000","last_became_active":"2024-09-12T00:17:58.351362+0000","last_became_peered":"2024-09-12T00:17:58.351362+0000","last_unstale":"2024-09-12T01:12:08.449466+0000","last_undegraded":"2024-09-12T01:12:08.449466+0000","last_fullsized":"2024-09-12T01:12:08.449466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.054114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":214,"num_write":104,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:15.246472+0000","last_change":"2024-09-12T00:39:26.631761+0000","last_active":"2024-09-12T01:13:15.246472+0000","last_peered":"2024-09-12T01:13:15.246472+0000","last_clean":"2024-09-12T01:13:15.246472+0000","last_became_active":"2024-09-12T00:39:26.631491+0000","last_became_peered":"2024-09-12T00:39:26.631491+0000","last_unstale":"2024-09-12T01:13:15.246472+0000","last_undegraded":"2024-09-12T01:13:15.246472+0000","last_fullsized":"2024-09-12T01:13:15.246472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:37.091629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'3","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.410353+0000","last_change":"2024-09-12T00:22:02.430547+0000","last_active":"2024-09-12T01:14:13.410353+0000","last_peered":"2024-09-12T01:14:13.410353+0000","last_clean":"2024-09-12T01:14:13.410353+0000","last_became_active":"2024-09-12T00:22:02.430209+0000","last_became_peered":"2024-09-12T00:22:02.430209+0000","last_unstale":"2024-09-12T01:14:13.410353+0000","last_undegraded":"2024-09-12T01:14:13.410353+0000","last_fullsized":"2024-09-12T01:14:13.410353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:01.694638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257936+0000","last_change":"2024-09-12T00:21:58.339483+0000","last_active":"2024-09-12T01:13:43.257936+0000","last_peered":"2024-09-12T01:13:43.257936+0000","last_clean":"2024-09-12T01:13:43.257936+0000","last_became_active":"2024-09-12T00:21:58.339248+0000","last_became_peered":"2024-09-12T00:21:58.339248+0000","last_unstale":"2024-09-12T01:13:43.257936+0000","last_undegraded":"2024-09-12T01:13:43.257936+0000","last_fullsized":"2024-09-12T01:13:43.257936+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'36","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609071+0000","last_change":"2024-09-12T00:17:58.358376+0000","last_active":"2024-09-12T01:12:08.609071+0000","last_peered":"2024-09-12T01:12:08.609071+0000","last_clean":"2024-09-12T01:12:08.609071+0000","last_became_active":"2024-09-12T00:17:58.358022+0000","last_became_peered":"2024-09-12T00:17:58.358022+0000","last_unstale":"2024-09-12T01:12:08.609071+0000","last_undegraded":"2024-09-12T01:12:08.609071+0000","last_fullsized":"2024-09-12T01:12:08.609071+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:18.456203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":54,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398216+0000","last_change":"2024-09-12T00:39:26.645252+0000","last_active":"2024-09-12T01:12:48.398216+0000","last_peered":"2024-09-12T01:12:48.398216+0000","last_clean":"2024-09-12T01:12:48.398216+0000","last_became_active":"2024-09-12T00:39:26.644935+0000","last_became_peered":"2024-09-12T00:39:26.644935+0000","last_unstale":"2024-09-12T01:12:48.398216+0000","last_undegraded":"2024-09-12T01:12:48.398216+0000","last_fullsized":"2024-09-12T01:12:48.398216+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:56.007971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240045+0000","last_change":"2024-09-12T00:22:02.424691+0000","last_active":"2024-09-12T01:12:20.240045+0000","last_peered":"2024-09-12T01:12:20.240045+0000","last_clean":"2024-09-12T01:12:20.240045+0000","last_became_active":"2024-09-12T00:22:02.424116+0000","last_became_peered":"2024-09-12T00:22:02.424116+0000","last_unstale":"2024-09-12T01:12:20.240045+0000","last_undegraded":"2024-09-12T01:12:20.240045+0000","last_fullsized":"2024-09-12T01:12:20.240045+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.947612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'6","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.295710+0000","last_change":"2024-09-12T00:21:58.332119+0000","last_active":"2024-09-12T01:15:48.295710+0000","last_peered":"2024-09-12T01:15:48.295710+0000","last_clean":"2024-09-12T01:15:48.295710+0000","last_became_active":"2024-09-12T00:21:58.331839+0000","last_became_peered":"2024-09-12T00:21:58.331839+0000","last_unstale":"2024-09-12T01:15:48.295710+0000","last_undegraded":"2024-09-12T01:15:48.295710+0000","last_fullsized":"2024-09-12T01:15:48.295710+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.238960+0000","last_change":"2024-09-12T00:17:58.354881+0000","last_active":"2024-09-12T01:12:10.238960+0000","last_peered":"2024-09-12T01:12:10.238960+0000","last_clean":"2024-09-12T01:12:10.238960+0000","last_became_active":"2024-09-12T00:17:58.354568+0000","last_became_peered":"2024-09-12T00:17:58.354568+0000","last_unstale":"2024-09-12T01:12:10.238960+0000","last_undegraded":"2024-09-12T01:12:10.238960+0000","last_fullsized":"2024-09-12T01:12:10.238960+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:54.500434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.509385+0000","last_change":"2024-09-12T00:39:26.640912+0000","last_active":"2024-09-12T01:12:48.509385+0000","last_peered":"2024-09-12T01:12:48.509385+0000","last_clean":"2024-09-12T01:12:48.509385+0000","last_became_active":"2024-09-12T00:39:26.635679+0000","last_became_peered":"2024-09-12T00:39:26.635679+0000","last_unstale":"2024-09-12T01:12:48.509385+0000","last_undegraded":"2024-09-12T01:12:48.509385+0000","last_fullsized":"2024-09-12T01:12:48.509385+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:19.017813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'15","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.130463+0000","last_change":"2024-09-12T00:22:02.420520+0000","last_active":"2024-09-12T01:15:48.130463+0000","last_peered":"2024-09-12T01:15:48.130463+0000","last_clean":"2024-09-12T01:15:48.130463+0000","last_became_active":"2024-09-12T00:22:02.420246+0000","last_became_peered":"2024-09-12T00:22:02.420246+0000","last_unstale":"2024-09-12T01:15:48.130463+0000","last_undegraded":"2024-09-12T01:15:48.130463+0000","last_fullsized":"2024-09-12T01:15:48.130463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.236313+0000","last_change":"2024-09-12T00:21:58.332641+0000","last_active":"2024-09-12T01:14:13.236313+0000","last_peered":"2024-09-12T01:14:13.236313+0000","last_clean":"2024-09-12T01:14:13.236313+0000","last_became_active":"2024-09-12T00:21:58.332362+0000","last_became_peered":"2024-09-12T00:21:58.332362+0000","last_unstale":"2024-09-12T01:14:13.236313+0000","last_undegraded":"2024-09-12T01:14:13.236313+0000","last_fullsized":"2024-09-12T01:14:13.236313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:38.121091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'54","reported_seq":199,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609180+0000","last_change":"2024-09-12T00:17:58.356444+0000","last_active":"2024-09-12T01:12:08.609180+0000","last_peered":"2024-09-12T01:12:08.609180+0000","last_clean":"2024-09-12T01:12:08.609180+0000","last_became_active":"2024-09-12T00:17:58.356120+0000","last_became_peered":"2024-09-12T00:17:58.356120+0000","last_unstale":"2024-09-12T01:12:08.609180+0000","last_undegraded":"2024-09-12T01:12:08.609180+0000","last_fullsized":"2024-09-12T01:12:08.609180+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:56.553542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":175,"num_write":100,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.240729+0000","last_change":"2024-09-12T00:39:26.625293+0000","last_active":"2024-09-12T01:13:38.240729+0000","last_peered":"2024-09-12T01:13:38.240729+0000","last_clean":"2024-09-12T01:13:38.240729+0000","last_became_active":"2024-09-12T00:39:26.624994+0000","last_became_peered":"2024-09-12T00:39:26.624994+0000","last_unstale":"2024-09-12T01:13:38.240729+0000","last_undegraded":"2024-09-12T01:13:38.240729+0000","last_fullsized":"2024-09-12T01:13:38.240729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:56.114504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'5","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408780+0000","last_change":"2024-09-12T00:22:02.424780+0000","last_active":"2024-09-12T01:14:03.408780+0000","last_peered":"2024-09-12T01:14:03.408780+0000","last_clean":"2024-09-12T01:14:03.408780+0000","last_became_active":"2024-09-12T00:22:02.424412+0000","last_became_peered":"2024-09-12T00:22:02.424412+0000","last_unstale":"2024-09-12T01:14:03.408780+0000","last_undegraded":"2024-09-12T01:14:03.408780+0000","last_fullsized":"2024-09-12T01:14:03.408780+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.520118+0000","last_change":"2024-09-12T00:21:58.334861+0000","last_active":"2024-09-12T01:13:58.520118+0000","last_peered":"2024-09-12T01:13:58.520118+0000","last_clean":"2024-09-12T01:13:58.520118+0000","last_became_active":"2024-09-12T00:21:58.334536+0000","last_became_peered":"2024-09-12T00:21:58.334536+0000","last_unstale":"2024-09-12T01:13:58.520118+0000","last_undegraded":"2024-09-12T01:13:58.520118+0000","last_fullsized":"2024-09-12T01:13:58.520118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394307+0000","last_change":"2024-09-12T00:17:58.353484+0000","last_active":"2024-09-12T01:12:18.394307+0000","last_peered":"2024-09-12T01:12:18.394307+0000","last_clean":"2024-09-12T01:12:18.394307+0000","last_became_active":"2024-09-12T00:17:58.353219+0000","last_became_peered":"2024-09-12T00:17:58.353219+0000","last_unstale":"2024-09-12T01:12:18.394307+0000","last_undegraded":"2024-09-12T01:12:18.394307+0000","last_fullsized":"2024-09-12T01:12:18.394307+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:54.015109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":151,"num_write":85,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396509+0000","last_change":"2024-09-12T00:39:26.638305+0000","last_active":"2024-09-12T01:12:48.396509+0000","last_peered":"2024-09-12T01:12:48.396509+0000","last_clean":"2024-09-12T01:12:48.396509+0000","last_became_active":"2024-09-12T00:39:26.638008+0000","last_became_peered":"2024-09-12T00:39:26.638008+0000","last_unstale":"2024-09-12T01:12:48.396509+0000","last_undegraded":"2024-09-12T01:12:48.396509+0000","last_fullsized":"2024-09-12T01:12:48.396509+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:10.696670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.040491+0000","last_change":"2024-09-12T00:22:02.419773+0000","last_active":"2024-09-12T01:15:48.040491+0000","last_peered":"2024-09-12T01:15:48.040491+0000","last_clean":"2024-09-12T01:15:48.040491+0000","last_became_active":"2024-09-12T00:22:02.419443+0000","last_became_peered":"2024-09-12T00:22:02.419443+0000","last_unstale":"2024-09-12T01:15:48.040491+0000","last_undegraded":"2024-09-12T01:15:48.040491+0000","last_fullsized":"2024-09-12T01:15:48.040491+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.408131+0000","last_change":"2024-09-12T00:21:58.335735+0000","last_active":"2024-09-12T01:13:58.408131+0000","last_peered":"2024-09-12T01:13:58.408131+0000","last_clean":"2024-09-12T01:13:58.408131+0000","last_became_active":"2024-09-12T00:21:58.335360+0000","last_became_peered":"2024-09-12T00:21:58.335360+0000","last_unstale":"2024-09-12T01:13:58.408131+0000","last_undegraded":"2024-09-12T01:13:58.408131+0000","last_fullsized":"2024-09-12T01:13:58.408131+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'110","reported_seq":429,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230801+0000","last_change":"2024-09-12T00:17:58.356038+0000","last_active":"2024-09-12T01:12:08.230801+0000","last_peered":"2024-09-12T01:12:08.230801+0000","last_clean":"2024-09-12T01:12:08.230801+0000","last_became_active":"2024-09-12T00:17:58.355688+0000","last_became_peered":"2024-09-12T00:17:58.355688+0000","last_unstale":"2024-09-12T01:12:08.230801+0000","last_undegraded":"2024-09-12T01:12:08.230801+0000","last_fullsized":"2024-09-12T01:12:08.230801+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:17.662520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":717,"num_read_kb":507,"num_write":143,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.221804+0000","last_change":"2024-09-12T00:39:26.637811+0000","last_active":"2024-09-12T01:11:58.221804+0000","last_peered":"2024-09-12T01:11:58.221804+0000","last_clean":"2024-09-12T01:11:58.221804+0000","last_became_active":"2024-09-12T00:39:26.637393+0000","last_became_peered":"2024-09-12T00:39:26.637393+0000","last_unstale":"2024-09-12T01:11:58.221804+0000","last_undegraded":"2024-09-12T01:11:58.221804+0000","last_fullsized":"2024-09-12T01:11:58.221804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:54.616369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.243956+0000","last_change":"2024-09-12T00:22:02.423927+0000","last_active":"2024-09-12T01:14:08.243956+0000","last_peered":"2024-09-12T01:14:08.243956+0000","last_clean":"2024-09-12T01:14:08.243956+0000","last_became_active":"2024-09-12T00:22:02.423601+0000","last_became_peered":"2024-09-12T00:22:02.423601+0000","last_unstale":"2024-09-12T01:14:08.243956+0000","last_undegraded":"2024-09-12T01:14:08.243956+0000","last_fullsized":"2024-09-12T01:14:08.243956+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.409460+0000","last_change":"2024-09-12T00:21:58.339918+0000","last_active":"2024-09-12T01:14:08.409460+0000","last_peered":"2024-09-12T01:14:08.409460+0000","last_clean":"2024-09-12T01:14:08.409460+0000","last_became_active":"2024-09-12T00:21:58.339625+0000","last_became_peered":"2024-09-12T00:21:58.339625+0000","last_unstale":"2024-09-12T01:14:08.409460+0000","last_undegraded":"2024-09-12T01:14:08.409460+0000","last_fullsized":"2024-09-12T01:14:08.409460+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503535+0000","last_change":"2024-09-12T00:17:58.357264+0000","last_active":"2024-09-12T01:12:08.503535+0000","last_peered":"2024-09-12T01:12:08.503535+0000","last_clean":"2024-09-12T01:12:08.503535+0000","last_became_active":"2024-09-12T00:17:58.356906+0000","last_became_peered":"2024-09-12T00:17:58.356906+0000","last_unstale":"2024-09-12T01:12:08.503535+0000","last_undegraded":"2024-09-12T01:12:08.503535+0000","last_fullsized":"2024-09-12T01:12:08.503535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:35.900823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":164,"num_write":72,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237860+0000","last_change":"2024-09-12T00:39:26.628713+0000","last_active":"2024-09-12T01:12:00.237860+0000","last_peered":"2024-09-12T01:12:00.237860+0000","last_clean":"2024-09-12T01:12:00.237860+0000","last_became_active":"2024-09-12T00:39:26.628244+0000","last_became_peered":"2024-09-12T00:39:26.628244+0000","last_unstale":"2024-09-12T01:12:00.237860+0000","last_undegraded":"2024-09-12T01:12:00.237860+0000","last_fullsized":"2024-09-12T01:12:00.237860+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:04.390305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.009638+0000","last_change":"2024-09-12T00:22:02.417514+0000","last_active":"2024-09-12T01:15:48.009638+0000","last_peered":"2024-09-12T01:15:48.009638+0000","last_clean":"2024-09-12T01:15:48.009638+0000","last_became_active":"2024-09-12T00:22:02.417237+0000","last_became_peered":"2024-09-12T00:22:02.417237+0000","last_unstale":"2024-09-12T01:15:48.009638+0000","last_undegraded":"2024-09-12T01:15:48.009638+0000","last_fullsized":"2024-09-12T01:15:48.009638+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.223299+0000","last_change":"2024-09-12T00:21:58.335825+0000","last_active":"2024-09-12T01:15:48.223299+0000","last_peered":"2024-09-12T01:15:48.223299+0000","last_clean":"2024-09-12T01:15:48.223299+0000","last_became_active":"2024-09-12T00:21:58.335541+0000","last_became_peered":"2024-09-12T00:21:58.335541+0000","last_unstale":"2024-09-12T01:15:48.223299+0000","last_undegraded":"2024-09-12T01:15:48.223299+0000","last_fullsized":"2024-09-12T01:15:48.223299+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'21","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.391247+0000","last_change":"2024-09-12T00:17:58.349817+0000","last_active":"2024-09-12T01:12:08.391247+0000","last_peered":"2024-09-12T01:12:08.391247+0000","last_clean":"2024-09-12T01:12:08.391247+0000","last_became_active":"2024-09-12T00:17:58.349428+0000","last_became_peered":"2024-09-12T00:17:58.349428+0000","last_unstale":"2024-09-12T01:12:08.391247+0000","last_undegraded":"2024-09-12T01:12:08.391247+0000","last_fullsized":"2024-09-12T01:12:08.391247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:25.884859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":78,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243328+0000","last_change":"2024-09-12T00:39:26.641703+0000","last_active":"2024-09-12T01:12:50.243328+0000","last_peered":"2024-09-12T01:12:50.243328+0000","last_clean":"2024-09-12T01:12:50.243328+0000","last_became_active":"2024-09-12T00:39:26.641360+0000","last_became_peered":"2024-09-12T00:39:26.641360+0000","last_unstale":"2024-09-12T01:12:50.243328+0000","last_undegraded":"2024-09-12T01:12:50.243328+0000","last_fullsized":"2024-09-12T01:12:50.243328+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.843665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.625766+0000","last_change":"2024-09-12T00:22:02.430353+0000","last_active":"2024-09-12T01:14:08.625766+0000","last_peered":"2024-09-12T01:14:08.625766+0000","last_clean":"2024-09-12T01:14:08.625766+0000","last_became_active":"2024-09-12T00:22:02.430041+0000","last_became_peered":"2024-09-12T00:22:02.430041+0000","last_unstale":"2024-09-12T01:14:08.625766+0000","last_undegraded":"2024-09-12T01:14:08.625766+0000","last_fullsized":"2024-09-12T01:14:08.625766+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.210392+0000","last_change":"2024-09-12T00:21:58.327372+0000","last_active":"2024-09-12T01:15:48.210392+0000","last_peered":"2024-09-12T01:15:48.210392+0000","last_clean":"2024-09-12T01:15:48.210392+0000","last_became_active":"2024-09-12T00:21:58.327094+0000","last_became_peered":"2024-09-12T00:21:58.327094+0000","last_unstale":"2024-09-12T01:15:48.210392+0000","last_undegraded":"2024-09-12T01:15:48.210392+0000","last_fullsized":"2024-09-12T01:15:48.210392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'15","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.609100+0000","last_change":"2024-09-12T00:17:58.355203+0000","last_active":"2024-09-12T01:12:08.609100+0000","last_peered":"2024-09-12T01:12:08.609100+0000","last_clean":"2024-09-12T01:12:08.609100+0000","last_became_active":"2024-09-12T00:17:58.354797+0000","last_became_peered":"2024-09-12T00:17:58.354797+0000","last_unstale":"2024-09-12T01:12:08.609100+0000","last_undegraded":"2024-09-12T01:12:08.609100+0000","last_fullsized":"2024-09-12T01:12:08.609100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.618609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399062+0000","last_change":"2024-09-12T00:39:26.641320+0000","last_active":"2024-09-12T01:12:53.399062+0000","last_peered":"2024-09-12T01:12:53.399062+0000","last_clean":"2024-09-12T01:12:53.399062+0000","last_became_active":"2024-09-12T00:39:26.640877+0000","last_became_peered":"2024-09-12T00:39:26.640877+0000","last_unstale":"2024-09-12T01:12:53.399062+0000","last_undegraded":"2024-09-12T01:12:53.399062+0000","last_fullsized":"2024-09-12T01:12:53.399062+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:44.522883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.130922+0000","last_change":"2024-09-12T00:22:02.418887+0000","last_active":"2024-09-12T01:15:48.130922+0000","last_peered":"2024-09-12T01:15:48.130922+0000","last_clean":"2024-09-12T01:15:48.130922+0000","last_became_active":"2024-09-12T00:22:02.418588+0000","last_became_peered":"2024-09-12T00:22:02.418588+0000","last_unstale":"2024-09-12T01:15:48.130922+0000","last_undegraded":"2024-09-12T01:15:48.130922+0000","last_fullsized":"2024-09-12T01:15:48.130922+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'7","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.112011+0000","last_change":"2024-09-12T00:21:58.332292+0000","last_active":"2024-09-12T01:15:48.112011+0000","last_peered":"2024-09-12T01:15:48.112011+0000","last_clean":"2024-09-12T01:15:48.112011+0000","last_became_active":"2024-09-12T00:21:58.331972+0000","last_became_peered":"2024-09-12T00:21:58.331972+0000","last_unstale":"2024-09-12T01:15:48.112011+0000","last_undegraded":"2024-09-12T01:15:48.112011+0000","last_fullsized":"2024-09-12T01:15:48.112011+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'16","reported_seq":104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.409478+0000","last_change":"2024-09-12T00:17:58.358230+0000","last_active":"2024-09-12T01:14:08.409478+0000","last_peered":"2024-09-12T01:14:08.409478+0000","last_clean":"2024-09-12T01:14:08.409478+0000","last_became_active":"2024-09-12T00:17:58.357689+0000","last_became_peered":"2024-09-12T00:17:58.357689+0000","last_unstale":"2024-09-12T01:14:08.409478+0000","last_undegraded":"2024-09-12T01:14:08.409478+0000","last_fullsized":"2024-09-12T01:14:08.409478+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'204","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.772916+0000","last_change":"2024-09-12T01:16:08.772916+0000","last_active":"2024-09-12T01:16:08.772916+0000","last_peered":"2024-09-12T01:16:08.772916+0000","last_clean":"2024-09-12T01:16:08.772916+0000","last_became_active":"2024-09-12T00:02:48.051117+0000","last_became_peered":"2024-09-12T00:02:48.051117+0000","last_unstale":"2024-09-12T01:16:08.772916+0000","last_undegraded":"2024-09-12T01:16:08.772916+0000","last_fullsized":"2024-09-12T01:16:08.772916+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'204","last_scrub_stamp":"2024-09-12T01:16:08.772784+0000","last_deep_scrub":"267'204","last_deep_scrub_stamp":"2024-09-12T01:16:08.772784+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.772784+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:49.188552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342064,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":17555,"num_write":999,"num_write_kb":27178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'739","reported_seq":2130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:06.061089+0000","last_change":"2024-09-12T00:02:50.065523+0000","last_active":"2024-09-12T01:13:06.061089+0000","last_peered":"2024-09-12T01:13:06.061089+0000","last_clean":"2024-09-12T01:13:06.061089+0000","last_became_active":"2024-09-12T00:02:50.065257+0000","last_became_peered":"2024-09-12T00:02:50.065257+0000","last_unstale":"2024-09-12T01:13:06.061089+0000","last_undegraded":"2024-09-12T01:13:06.061089+0000","last_fullsized":"2024-09-12T01:13:06.061089+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:22.262738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3376,"num_read_kb":3036,"num_write":968,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'285","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.132495+0000","last_change":"2024-09-12T01:16:02.132495+0000","last_active":"2024-09-12T01:16:02.132495+0000","last_peered":"2024-09-12T01:16:02.132495+0000","last_clean":"2024-09-12T01:16:02.132495+0000","last_became_active":"2024-09-12T00:02:48.049002+0000","last_became_peered":"2024-09-12T00:02:48.049002+0000","last_unstale":"2024-09-12T01:16:02.132495+0000","last_undegraded":"2024-09-12T01:16:02.132495+0000","last_fullsized":"2024-09-12T01:16:02.132495+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-12T01:16:02.132389+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-12T01:16:02.132389+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.132389+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:19.692843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":975,"num_read_kb":18236,"num_write":1256,"num_write_kb":26545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'691","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398967+0000","last_change":"2024-09-12T00:02:50.063909+0000","last_active":"2024-09-12T01:12:53.398967+0000","last_peered":"2024-09-12T01:12:53.398967+0000","last_clean":"2024-09-12T01:12:53.398967+0000","last_became_active":"2024-09-12T00:02:50.063612+0000","last_became_peered":"2024-09-12T00:02:50.063612+0000","last_unstale":"2024-09-12T01:12:53.398967+0000","last_undegraded":"2024-09-12T01:12:53.398967+0000","last_fullsized":"2024-09-12T01:12:53.398967+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":600,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:00.810818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3358,"num_read_kb":3023,"num_write":921,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'219","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.835122+0000","last_change":"2024-09-12T01:16:01.835122+0000","last_active":"2024-09-12T01:16:01.835122+0000","last_peered":"2024-09-12T01:16:01.835122+0000","last_clean":"2024-09-12T01:16:01.835122+0000","last_became_active":"2024-09-12T00:02:48.045960+0000","last_became_peered":"2024-09-12T00:02:48.045960+0000","last_unstale":"2024-09-12T01:16:01.835122+0000","last_undegraded":"2024-09-12T01:16:01.835122+0000","last_fullsized":"2024-09-12T01:16:01.835122+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T01:16:01.835001+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T01:16:01.835001+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.835001+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.564621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1118647,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":21329,"num_write":1072,"num_write_kb":32132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'462","reported_seq":2030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.917023+0000","last_change":"2024-09-12T01:16:12.917023+0000","last_active":"2024-09-12T01:16:12.917023+0000","last_peered":"2024-09-12T01:16:12.917023+0000","last_clean":"2024-09-12T01:16:12.917023+0000","last_became_active":"2024-09-12T00:02:50.060902+0000","last_became_peered":"2024-09-12T00:02:50.060902+0000","last_unstale":"2024-09-12T01:16:12.917023+0000","last_undegraded":"2024-09-12T01:16:12.917023+0000","last_fullsized":"2024-09-12T01:16:12.917023+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'462","last_scrub_stamp":"2024-09-12T01:16:12.916931+0000","last_deep_scrub":"267'462","last_deep_scrub_stamp":"2024-09-12T01:16:12.916931+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.916931+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:30.139448+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2604,"num_read_kb":2455,"num_write":536,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'260","reported_seq":954,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.248640+0000","last_change":"2024-09-12T01:16:09.248640+0000","last_active":"2024-09-12T01:16:09.248640+0000","last_peered":"2024-09-12T01:16:09.248640+0000","last_clean":"2024-09-12T01:16:09.248640+0000","last_became_active":"2024-09-12T00:02:48.052802+0000","last_became_peered":"2024-09-12T00:02:48.052802+0000","last_unstale":"2024-09-12T01:16:09.248640+0000","last_undegraded":"2024-09-12T01:16:09.248640+0000","last_fullsized":"2024-09-12T01:16:09.248640+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'260","last_scrub_stamp":"2024-09-12T01:16:09.248507+0000","last_deep_scrub":"267'260","last_deep_scrub_stamp":"2024-09-12T01:16:09.248507+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.248507+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.932847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":8609,"num_write":1124,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'1279","reported_seq":2874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.692636+0000","last_change":"2024-09-12T01:16:10.692636+0000","last_active":"2024-09-12T01:16:10.692636+0000","last_peered":"2024-09-12T01:16:10.692636+0000","last_clean":"2024-09-12T01:16:10.692636+0000","last_became_active":"2024-09-12T00:02:50.072574+0000","last_became_peered":"2024-09-12T00:02:50.072574+0000","last_unstale":"2024-09-12T01:16:10.692636+0000","last_undegraded":"2024-09-12T01:16:10.692636+0000","last_fullsized":"2024-09-12T01:16:10.692636+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1279","last_scrub_stamp":"2024-09-12T01:16:10.692530+0000","last_deep_scrub":"267'1279","last_deep_scrub_stamp":"2024-09-12T01:16:10.692530+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.692530+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":1200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:40.321730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5797,"num_read_kb":5069,"num_write":1818,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'162","reported_seq":797,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.708655+0000","last_change":"2024-09-12T01:16:10.708655+0000","last_active":"2024-09-12T01:16:10.708655+0000","last_peered":"2024-09-12T01:16:10.708655+0000","last_clean":"2024-09-12T01:16:10.708655+0000","last_became_active":"2024-09-12T00:02:48.052778+0000","last_became_peered":"2024-09-12T00:02:48.052778+0000","last_unstale":"2024-09-12T01:16:10.708655+0000","last_undegraded":"2024-09-12T01:16:10.708655+0000","last_fullsized":"2024-09-12T01:16:10.708655+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:10.708562+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:10.708562+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.708562+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:36.850671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":373,"num_read_kb":36558,"num_write":790,"num_write_kb":25424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'762","reported_seq":2180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.447646+0000","last_change":"2024-09-12T01:16:08.447646+0000","last_active":"2024-09-12T01:16:08.447646+0000","last_peered":"2024-09-12T01:16:08.447646+0000","last_clean":"2024-09-12T01:16:08.447646+0000","last_became_active":"2024-09-12T00:02:50.062257+0000","last_became_peered":"2024-09-12T00:02:50.062257+0000","last_unstale":"2024-09-12T01:16:08.447646+0000","last_undegraded":"2024-09-12T01:16:08.447646+0000","last_fullsized":"2024-09-12T01:16:08.447646+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-09-12T01:16:08.447540+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-09-12T01:16:08.447540+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.447540+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:13.108811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3047,"num_write":970,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'225","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.223498+0000","last_change":"2024-09-12T01:16:06.223498+0000","last_active":"2024-09-12T01:16:06.223498+0000","last_peered":"2024-09-12T01:16:06.223498+0000","last_clean":"2024-09-12T01:16:06.223498+0000","last_became_active":"2024-09-12T00:02:48.052257+0000","last_became_peered":"2024-09-12T00:02:48.052257+0000","last_unstale":"2024-09-12T01:16:06.223498+0000","last_undegraded":"2024-09-12T01:16:06.223498+0000","last_fullsized":"2024-09-12T01:16:06.223498+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-12T01:16:06.223377+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-12T01:16:06.223377+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.223377+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:59.368626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798278,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":39161,"num_write":992,"num_write_kb":40171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'407","reported_seq":1873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.748758+0000","last_change":"2024-09-12T00:02:50.061476+0000","last_active":"2024-09-12T01:15:09.748758+0000","last_peered":"2024-09-12T01:15:09.748758+0000","last_clean":"2024-09-12T01:15:09.748758+0000","last_became_active":"2024-09-12T00:02:50.060756+0000","last_became_peered":"2024-09-12T00:02:50.060756+0000","last_unstale":"2024-09-12T01:15:09.748758+0000","last_undegraded":"2024-09-12T01:15:09.748758+0000","last_fullsized":"2024-09-12T01:15:09.748758+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:07.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2108,"num_read_kb":1993,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'193","reported_seq":860,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.759441+0000","last_change":"2024-09-12T01:16:05.759441+0000","last_active":"2024-09-12T01:16:05.759441+0000","last_peered":"2024-09-12T01:16:05.759441+0000","last_clean":"2024-09-12T01:16:05.759441+0000","last_became_active":"2024-09-12T00:03:21.143840+0000","last_became_peered":"2024-09-12T00:03:21.143840+0000","last_unstale":"2024-09-12T01:16:05.759441+0000","last_undegraded":"2024-09-12T01:16:05.759441+0000","last_fullsized":"2024-09-12T01:16:05.759441+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:16:05.759305+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:16:05.759305+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.759305+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:05.625596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":20506,"num_write":998,"num_write_kb":32663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'432","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.517921+0000","last_change":"2024-09-12T00:02:50.065057+0000","last_active":"2024-09-12T01:13:43.517921+0000","last_peered":"2024-09-12T01:13:43.517921+0000","last_clean":"2024-09-12T01:13:43.517921+0000","last_became_active":"2024-09-12T00:02:50.064658+0000","last_became_peered":"2024-09-12T00:02:50.064658+0000","last_unstale":"2024-09-12T01:13:43.517921+0000","last_undegraded":"2024-09-12T01:13:43.517921+0000","last_fullsized":"2024-09-12T01:13:43.517921+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:42.210482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":488,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'181","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.718672+0000","last_change":"2024-09-12T01:16:02.718672+0000","last_active":"2024-09-12T01:16:02.718672+0000","last_peered":"2024-09-12T01:16:02.718672+0000","last_clean":"2024-09-12T01:16:02.718672+0000","last_became_active":"2024-09-12T00:02:48.058678+0000","last_became_peered":"2024-09-12T00:02:48.058678+0000","last_unstale":"2024-09-12T01:16:02.718672+0000","last_undegraded":"2024-09-12T01:16:02.718672+0000","last_fullsized":"2024-09-12T01:16:02.718672+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T01:16:02.718561+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T01:16:02.718561+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.718561+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:30.288718+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170390,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1879,"num_write":959,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'893","reported_seq":2468,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.250161+0000","last_change":"2024-09-12T01:16:11.250161+0000","last_active":"2024-09-12T01:16:11.250161+0000","last_peered":"2024-09-12T01:16:11.250161+0000","last_clean":"2024-09-12T01:16:11.250161+0000","last_became_active":"2024-09-12T00:02:50.069840+0000","last_became_peered":"2024-09-12T00:02:50.069840+0000","last_unstale":"2024-09-12T01:16:11.250161+0000","last_undegraded":"2024-09-12T01:16:11.250161+0000","last_fullsized":"2024-09-12T01:16:11.250161+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'893","last_scrub_stamp":"2024-09-12T01:16:11.250063+0000","last_deep_scrub":"267'893","last_deep_scrub_stamp":"2024-09-12T01:16:11.250063+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.250063+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:33.826482+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4122,"num_read_kb":3699,"num_write":1233,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'601","reported_seq":2192,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.878551+0000","last_change":"2024-09-12T01:16:09.878551+0000","last_active":"2024-09-12T01:16:09.878551+0000","last_peered":"2024-09-12T01:16:09.878551+0000","last_clean":"2024-09-12T01:16:09.878551+0000","last_became_active":"2024-09-12T00:02:50.060919+0000","last_became_peered":"2024-09-12T00:02:50.060919+0000","last_unstale":"2024-09-12T01:16:09.878551+0000","last_undegraded":"2024-09-12T01:16:09.878551+0000","last_fullsized":"2024-09-12T01:16:09.878551+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'601","last_scrub_stamp":"2024-09-12T01:16:09.878461+0000","last_deep_scrub":"267'601","last_deep_scrub_stamp":"2024-09-12T01:16:09.878461+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.878461+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:51.104915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3046,"num_read_kb":2788,"num_write":785,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'202","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.738292+0000","last_change":"2024-09-12T01:16:07.738292+0000","last_active":"2024-09-12T01:16:07.738292+0000","last_peered":"2024-09-12T01:16:07.738292+0000","last_clean":"2024-09-12T01:16:07.738292+0000","last_became_active":"2024-09-12T00:02:48.050909+0000","last_became_peered":"2024-09-12T00:02:48.050909+0000","last_unstale":"2024-09-12T01:16:07.738292+0000","last_undegraded":"2024-09-12T01:16:07.738292+0000","last_fullsized":"2024-09-12T01:16:07.738292+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'202","last_scrub_stamp":"2024-09-12T01:16:07.738154+0000","last_deep_scrub":"267'202","last_deep_scrub_stamp":"2024-09-12T01:16:07.738154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.738154+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.887555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":10751,"num_write":911,"num_write_kb":36355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'827","reported_seq":2323,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.741265+0000","last_change":"2024-09-12T01:16:12.741265+0000","last_active":"2024-09-12T01:16:12.741265+0000","last_peered":"2024-09-12T01:16:12.741265+0000","last_clean":"2024-09-12T01:16:12.741265+0000","last_became_active":"2024-09-12T00:02:50.072791+0000","last_became_peered":"2024-09-12T00:02:50.072791+0000","last_unstale":"2024-09-12T01:16:12.741265+0000","last_undegraded":"2024-09-12T01:16:12.741265+0000","last_fullsized":"2024-09-12T01:16:12.741265+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-12T01:16:12.741138+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-12T01:16:12.741138+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.741138+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:18.033096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3382,"num_write":1095,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'201","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.501668+0000","last_change":"2024-09-12T01:16:03.501668+0000","last_active":"2024-09-12T01:16:03.501668+0000","last_peered":"2024-09-12T01:16:03.501668+0000","last_clean":"2024-09-12T01:16:03.501668+0000","last_became_active":"2024-09-12T00:02:48.053452+0000","last_became_peered":"2024-09-12T00:02:48.053452+0000","last_unstale":"2024-09-12T01:16:03.501668+0000","last_undegraded":"2024-09-12T01:16:03.501668+0000","last_fullsized":"2024-09-12T01:16:03.501668+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:16:03.501500+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:16:03.501500+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.501500+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:08.370323+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684145,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":6281,"num_write":1001,"num_write_kb":31607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'856","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.956760+0000","last_change":"2024-09-12T00:02:50.072524+0000","last_active":"2024-09-12T01:14:02.956760+0000","last_peered":"2024-09-12T01:14:02.956760+0000","last_clean":"2024-09-12T01:14:02.956760+0000","last_became_active":"2024-09-12T00:02:50.072128+0000","last_became_peered":"2024-09-12T00:02:50.072128+0000","last_unstale":"2024-09-12T01:14:02.956760+0000","last_undegraded":"2024-09-12T01:14:02.956760+0000","last_fullsized":"2024-09-12T01:14:02.956760+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:10.120502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4255,"num_read_kb":3837,"num_write":1128,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'188","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.512321+0000","last_change":"2024-09-12T01:16:01.512321+0000","last_active":"2024-09-12T01:16:01.512321+0000","last_peered":"2024-09-12T01:16:01.512321+0000","last_clean":"2024-09-12T01:16:01.512321+0000","last_became_active":"2024-09-12T00:02:48.059289+0000","last_became_peered":"2024-09-12T00:02:48.059289+0000","last_unstale":"2024-09-12T01:16:01.512321+0000","last_undegraded":"2024-09-12T01:16:01.512321+0000","last_fullsized":"2024-09-12T01:16:01.512321+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'188","last_scrub_stamp":"2024-09-12T01:16:01.512172+0000","last_deep_scrub":"267'188","last_deep_scrub_stamp":"2024-09-12T01:16:01.512172+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.512172+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:19.543793+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342107,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":40439,"num_write":973,"num_write_kb":33156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'1000","reported_seq":2691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.288328+0000","last_change":"2024-09-12T01:16:03.288328+0000","last_active":"2024-09-12T01:16:03.288328+0000","last_peered":"2024-09-12T01:16:03.288328+0000","last_clean":"2024-09-12T01:16:03.288328+0000","last_became_active":"2024-09-12T00:02:50.069775+0000","last_became_peered":"2024-09-12T00:02:50.069775+0000","last_unstale":"2024-09-12T01:16:03.288328+0000","last_undegraded":"2024-09-12T01:16:03.288328+0000","last_fullsized":"2024-09-12T01:16:03.288328+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1000","last_scrub_stamp":"2024-09-12T01:16:03.288239+0000","last_deep_scrub":"267'1000","last_deep_scrub_stamp":"2024-09-12T01:16:03.288239+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.288239+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":900,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:44.983401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4692,"num_read_kb":4217,"num_write":1368,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'201","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.214490+0000","last_change":"2024-09-12T01:15:59.214490+0000","last_active":"2024-09-12T01:15:59.214490+0000","last_peered":"2024-09-12T01:15:59.214490+0000","last_clean":"2024-09-12T01:15:59.214490+0000","last_became_active":"2024-09-12T00:04:21.322881+0000","last_became_peered":"2024-09-12T00:04:21.322881+0000","last_unstale":"2024-09-12T01:15:59.214490+0000","last_undegraded":"2024-09-12T01:15:59.214490+0000","last_fullsized":"2024-09-12T01:15:59.214490+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:15:59.214384+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:15:59.214384+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.214384+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:08.684418+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10550637,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":44397,"num_write":1009,"num_write_kb":26074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"267'851","reported_seq":2426,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.298099+0000","last_change":"2024-09-12T01:16:06.298099+0000","last_active":"2024-09-12T01:16:06.298099+0000","last_peered":"2024-09-12T01:16:06.298099+0000","last_clean":"2024-09-12T01:16:06.298099+0000","last_became_active":"2024-09-12T00:02:50.061055+0000","last_became_peered":"2024-09-12T00:02:50.061055+0000","last_unstale":"2024-09-12T01:16:06.298099+0000","last_undegraded":"2024-09-12T01:16:06.298099+0000","last_fullsized":"2024-09-12T01:16:06.298099+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-12T01:16:06.298021+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-12T01:16:06.298021+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.298021+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:35.804703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3601,"num_write":1146,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'246","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.246926+0000","last_change":"2024-09-12T01:16:00.246926+0000","last_active":"2024-09-12T01:16:00.246926+0000","last_peered":"2024-09-12T01:16:00.246926+0000","last_clean":"2024-09-12T01:16:00.246926+0000","last_became_active":"2024-09-12T00:03:22.073294+0000","last_became_peered":"2024-09-12T00:03:22.073294+0000","last_unstale":"2024-09-12T01:16:00.246926+0000","last_undegraded":"2024-09-12T01:16:00.246926+0000","last_fullsized":"2024-09-12T01:16:00.246926+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-12T01:16:00.246812+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-12T01:16:00.246812+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.246812+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:30.922054+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5592646,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":9461,"num_write":1068,"num_write_kb":47816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"267'877","reported_seq":2509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.919530+0000","last_change":"2024-09-12T01:16:10.919530+0000","last_active":"2024-09-12T01:16:10.919530+0000","last_peered":"2024-09-12T01:16:10.919530+0000","last_clean":"2024-09-12T01:16:10.919530+0000","last_became_active":"2024-09-12T00:02:50.067334+0000","last_became_peered":"2024-09-12T00:02:50.067334+0000","last_unstale":"2024-09-12T01:16:10.919530+0000","last_undegraded":"2024-09-12T01:16:10.919530+0000","last_fullsized":"2024-09-12T01:16:10.919530+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'877","last_scrub_stamp":"2024-09-12T01:16:10.919444+0000","last_deep_scrub":"267'877","last_deep_scrub_stamp":"2024-09-12T01:16:10.919444+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.919444+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:06.787118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4129,"num_read_kb":3712,"num_write":1142,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'242","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.787967+0000","last_change":"2024-09-12T01:16:00.787967+0000","last_active":"2024-09-12T01:16:00.787967+0000","last_peered":"2024-09-12T01:16:00.787967+0000","last_clean":"2024-09-12T01:16:00.787967+0000","last_became_active":"2024-09-12T00:02:48.049926+0000","last_became_peered":"2024-09-12T00:02:48.049926+0000","last_unstale":"2024-09-12T01:16:00.787967+0000","last_undegraded":"2024-09-12T01:16:00.787967+0000","last_fullsized":"2024-09-12T01:16:00.787967+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-12T01:16:00.787782+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-12T01:16:00.787782+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.787782+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.123434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399169,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":41400,"num_write":1181,"num_write_kb":37207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'135","reported_seq":652,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.271975+0000","last_change":"2024-09-12T00:02:58.094744+0000","last_active":"2024-09-12T01:14:04.271975+0000","last_peered":"2024-09-12T01:14:04.271975+0000","last_clean":"2024-09-12T01:14:04.271975+0000","last_became_active":"2024-09-12T00:02:58.094271+0000","last_became_peered":"2024-09-12T00:02:58.094271+0000","last_unstale":"2024-09-12T01:14:04.271975+0000","last_undegraded":"2024-09-12T01:14:04.271975+0000","last_fullsized":"2024-09-12T01:14:04.271975+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:25.220277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":142,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'583","reported_seq":2357,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.701641+0000","last_change":"2024-09-12T01:16:03.701641+0000","last_active":"2024-09-12T01:16:03.701641+0000","last_peered":"2024-09-12T01:16:03.701641+0000","last_clean":"2024-09-12T01:16:03.701641+0000","last_became_active":"2024-09-12T00:02:50.073327+0000","last_became_peered":"2024-09-12T00:02:50.073327+0000","last_unstale":"2024-09-12T01:16:03.701641+0000","last_undegraded":"2024-09-12T01:16:03.701641+0000","last_fullsized":"2024-09-12T01:16:03.701641+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'583","last_scrub_stamp":"2024-09-12T01:16:03.701558+0000","last_deep_scrub":"267'583","last_deep_scrub_stamp":"2024-09-12T01:16:03.701558+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.701558+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:50.578518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3161,"num_read_kb":2955,"num_write":696,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'270","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.760685+0000","last_change":"2024-09-12T01:16:04.760685+0000","last_active":"2024-09-12T01:16:04.760685+0000","last_peered":"2024-09-12T01:16:04.760685+0000","last_clean":"2024-09-12T01:16:04.760685+0000","last_became_active":"2024-09-12T00:03:21.143543+0000","last_became_peered":"2024-09-12T00:03:21.143543+0000","last_unstale":"2024-09-12T01:16:04.760685+0000","last_undegraded":"2024-09-12T01:16:04.760685+0000","last_fullsized":"2024-09-12T01:16:04.760685+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:16:04.760551+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:16:04.760551+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.760551+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:44.290335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":789,"num_read_kb":207403,"num_write":1277,"num_write_kb":65033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510971+0000","last_change":"2024-09-12T00:02:52.067537+0000","last_active":"2024-09-12T01:12:58.510971+0000","last_peered":"2024-09-12T01:12:58.510971+0000","last_clean":"2024-09-12T01:12:58.510971+0000","last_became_active":"2024-09-12T00:02:52.067288+0000","last_became_peered":"2024-09-12T00:02:52.067288+0000","last_unstale":"2024-09-12T01:12:58.510971+0000","last_undegraded":"2024-09-12T01:12:58.510971+0000","last_fullsized":"2024-09-12T01:12:58.510971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:59.660984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'236","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.118412+0000","last_change":"2024-09-12T00:02:54.070876+0000","last_active":"2024-09-12T01:15:48.118412+0000","last_peered":"2024-09-12T01:15:48.118412+0000","last_clean":"2024-09-12T01:15:48.118412+0000","last_became_active":"2024-09-12T00:02:54.070547+0000","last_became_peered":"2024-09-12T00:02:54.070547+0000","last_unstale":"2024-09-12T01:15:48.118412+0000","last_undegraded":"2024-09-12T01:15:48.118412+0000","last_fullsized":"2024-09-12T01:15:48.118412+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:55.618177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9977,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":320,"num_read_kb":418,"num_write":196,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.400430+0000","last_change":"2024-09-12T00:02:56.081347+0000","last_active":"2024-09-12T01:13:03.400430+0000","last_peered":"2024-09-12T01:13:03.400430+0000","last_clean":"2024-09-12T01:13:03.400430+0000","last_became_active":"2024-09-12T00:02:56.081086+0000","last_became_peered":"2024-09-12T00:02:56.081086+0000","last_unstale":"2024-09-12T01:13:03.400430+0000","last_undegraded":"2024-09-12T01:13:03.400430+0000","last_fullsized":"2024-09-12T01:13:03.400430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:59.050278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'2432","reported_seq":4341,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.081005+0000","last_change":"2024-09-12T00:02:58.096284+0000","last_active":"2024-09-12T01:14:00.081005+0000","last_peered":"2024-09-12T01:14:00.081005+0000","last_clean":"2024-09-12T01:14:00.081005+0000","last_became_active":"2024-09-12T00:02:58.095948+0000","last_became_peered":"2024-09-12T00:02:58.095948+0000","last_unstale":"2024-09-12T01:14:00.081005+0000","last_undegraded":"2024-09-12T01:14:00.081005+0000","last_fullsized":"2024-09-12T01:14:00.081005+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":2400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6163,"num_read_kb":6149,"num_write":4865,"num_write_kb":1796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'433","reported_seq":1968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.277489+0000","last_change":"2024-09-12T01:16:12.277489+0000","last_active":"2024-09-12T01:16:12.277489+0000","last_peered":"2024-09-12T01:16:12.277489+0000","last_clean":"2024-09-12T01:16:12.277489+0000","last_became_active":"2024-09-12T00:02:50.065654+0000","last_became_peered":"2024-09-12T00:02:50.065654+0000","last_unstale":"2024-09-12T01:16:12.277489+0000","last_undegraded":"2024-09-12T01:16:12.277489+0000","last_fullsized":"2024-09-12T01:16:12.277489+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'433","last_scrub_stamp":"2024-09-12T01:16:12.277405+0000","last_deep_scrub":"267'433","last_deep_scrub_stamp":"2024-09-12T01:16:12.277405+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.277405+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:57.117394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2304,"num_read_kb":2172,"num_write":510,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'198","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.924085+0000","last_change":"2024-09-12T01:15:55.924085+0000","last_active":"2024-09-12T01:15:55.924085+0000","last_peered":"2024-09-12T01:15:55.924085+0000","last_clean":"2024-09-12T01:15:55.924085+0000","last_became_active":"2024-09-12T00:02:48.050499+0000","last_became_peered":"2024-09-12T00:02:48.050499+0000","last_unstale":"2024-09-12T01:15:55.924085+0000","last_undegraded":"2024-09-12T01:15:55.924085+0000","last_fullsized":"2024-09-12T01:15:55.924085+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:15:55.924011+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:15:55.924011+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.924011+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.010889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":23205,"num_write":930,"num_write_kb":52906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.658857+0000","last_change":"2024-09-12T01:16:09.658857+0000","last_active":"2024-09-12T01:16:09.658857+0000","last_peered":"2024-09-12T01:16:09.658857+0000","last_clean":"2024-09-12T01:16:09.658857+0000","last_became_active":"2024-09-12T00:02:52.068519+0000","last_became_peered":"2024-09-12T00:02:52.068519+0000","last_unstale":"2024-09-12T01:16:09.658857+0000","last_undegraded":"2024-09-12T01:16:09.658857+0000","last_fullsized":"2024-09-12T01:16:09.658857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.658760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.658760+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.658760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:31.485302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'115","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.479573+0000","last_change":"2024-09-12T00:02:54.060615+0000","last_active":"2024-09-12T01:13:29.479573+0000","last_peered":"2024-09-12T01:13:29.479573+0000","last_clean":"2024-09-12T01:13:29.479573+0000","last_became_active":"2024-09-12T00:02:54.060334+0000","last_became_peered":"2024-09-12T00:02:54.060334+0000","last_unstale":"2024-09-12T01:13:29.479573+0000","last_undegraded":"2024-09-12T01:13:29.479573+0000","last_fullsized":"2024-09-12T01:13:29.479573+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:06.270504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.399195+0000","last_change":"2024-09-12T00:02:56.085489+0000","last_active":"2024-09-12T01:13:03.399195+0000","last_peered":"2024-09-12T01:13:03.399195+0000","last_clean":"2024-09-12T01:13:03.399195+0000","last_became_active":"2024-09-12T00:02:56.085222+0000","last_became_peered":"2024-09-12T00:02:56.085222+0000","last_unstale":"2024-09-12T01:13:03.399195+0000","last_undegraded":"2024-09-12T01:13:03.399195+0000","last_fullsized":"2024-09-12T01:13:03.399195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:10.915396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'143","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244578+0000","last_change":"2024-09-12T00:02:58.094502+0000","last_active":"2024-09-12T01:13:00.244578+0000","last_peered":"2024-09-12T01:13:00.244578+0000","last_clean":"2024-09-12T01:13:00.244578+0000","last_became_active":"2024-09-12T00:02:58.094312+0000","last_became_peered":"2024-09-12T00:02:58.094312+0000","last_unstale":"2024-09-12T01:13:00.244578+0000","last_undegraded":"2024-09-12T01:13:00.244578+0000","last_fullsized":"2024-09-12T01:13:00.244578+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:05.995438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":193,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'830","reported_seq":2439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.807881+0000","last_change":"2024-09-12T01:16:05.807881+0000","last_active":"2024-09-12T01:16:05.807881+0000","last_peered":"2024-09-12T01:16:05.807881+0000","last_clean":"2024-09-12T01:16:05.807881+0000","last_became_active":"2024-09-12T00:02:50.071219+0000","last_became_peered":"2024-09-12T00:02:50.071219+0000","last_unstale":"2024-09-12T01:16:05.807881+0000","last_undegraded":"2024-09-12T01:16:05.807881+0000","last_fullsized":"2024-09-12T01:16:05.807881+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'830","last_scrub_stamp":"2024-09-12T01:16:05.807733+0000","last_deep_scrub":"267'830","last_deep_scrub_stamp":"2024-09-12T01:16:05.807733+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.807733+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:00.465607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4069,"num_read_kb":3661,"num_write":1104,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2553,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'211","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.726231+0000","last_change":"2024-09-12T01:16:01.726231+0000","last_active":"2024-09-12T01:16:01.726231+0000","last_peered":"2024-09-12T01:16:01.726231+0000","last_clean":"2024-09-12T01:16:01.726231+0000","last_became_active":"2024-09-12T00:02:48.059132+0000","last_became_peered":"2024-09-12T00:02:48.059132+0000","last_unstale":"2024-09-12T01:16:01.726231+0000","last_undegraded":"2024-09-12T01:16:01.726231+0000","last_fullsized":"2024-09-12T01:16:01.726231+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'211","last_scrub_stamp":"2024-09-12T01:16:01.726101+0000","last_deep_scrub":"267'211","last_deep_scrub_stamp":"2024-09-12T01:16:01.726101+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.726101+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:47.889650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":5763,"num_write":993,"num_write_kb":32529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455423+0000","last_change":"2024-09-12T00:02:52.064543+0000","last_active":"2024-09-12T01:12:58.455423+0000","last_peered":"2024-09-12T01:12:58.455423+0000","last_clean":"2024-09-12T01:12:58.455423+0000","last_became_active":"2024-09-12T00:02:52.064216+0000","last_became_peered":"2024-09-12T00:02:52.064216+0000","last_unstale":"2024-09-12T01:12:58.455423+0000","last_undegraded":"2024-09-12T01:12:58.455423+0000","last_fullsized":"2024-09-12T01:12:58.455423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:47.668439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'162","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.200793+0000","last_change":"2024-09-12T01:16:13.200793+0000","last_active":"2024-09-12T01:16:13.200793+0000","last_peered":"2024-09-12T01:16:13.200793+0000","last_clean":"2024-09-12T01:16:13.200793+0000","last_became_active":"2024-09-12T00:02:54.060501+0000","last_became_peered":"2024-09-12T00:02:54.060501+0000","last_unstale":"2024-09-12T01:16:13.200793+0000","last_undegraded":"2024-09-12T01:16:13.200793+0000","last_fullsized":"2024-09-12T01:16:13.200793+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:13.200687+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:13.200687+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.200687+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:11.033202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":182,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'766","reported_seq":2662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.957227+0000","last_change":"2024-09-12T00:02:56.087899+0000","last_active":"2024-09-12T01:15:47.957227+0000","last_peered":"2024-09-12T01:15:47.957227+0000","last_clean":"2024-09-12T01:15:47.957227+0000","last_became_active":"2024-09-12T00:02:56.087506+0000","last_became_peered":"2024-09-12T00:02:56.087506+0000","last_unstale":"2024-09-12T01:15:47.957227+0000","last_undegraded":"2024-09-12T01:15:47.957227+0000","last_fullsized":"2024-09-12T01:15:47.957227+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.840099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'208","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.331265+0000","last_change":"2024-09-12T00:02:58.090727+0000","last_active":"2024-09-12T01:14:04.331265+0000","last_peered":"2024-09-12T01:14:04.331265+0000","last_clean":"2024-09-12T01:14:04.331265+0000","last_became_active":"2024-09-12T00:02:58.090424+0000","last_became_peered":"2024-09-12T00:02:58.090424+0000","last_unstale":"2024-09-12T01:14:04.331265+0000","last_undegraded":"2024-09-12T01:14:04.331265+0000","last_fullsized":"2024-09-12T01:14:04.331265+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:25.948169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":609,"num_read_kb":603,"num_write":442,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'494","reported_seq":2303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.683501+0000","last_change":"2024-09-12T01:16:04.683501+0000","last_active":"2024-09-12T01:16:04.683501+0000","last_peered":"2024-09-12T01:16:04.683501+0000","last_clean":"2024-09-12T01:16:04.683501+0000","last_became_active":"2024-09-12T00:02:50.067933+0000","last_became_peered":"2024-09-12T00:02:50.067933+0000","last_unstale":"2024-09-12T01:16:04.683501+0000","last_undegraded":"2024-09-12T01:16:04.683501+0000","last_fullsized":"2024-09-12T01:16:04.683501+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-09-12T01:16:04.683410+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-09-12T01:16:04.683410+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.683410+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:55.086027+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2745,"num_read_kb":2618,"num_write":566,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'210","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.550622+0000","last_change":"2024-09-12T01:15:57.550622+0000","last_active":"2024-09-12T01:15:57.550622+0000","last_peered":"2024-09-12T01:15:57.550622+0000","last_clean":"2024-09-12T01:15:57.550622+0000","last_became_active":"2024-09-12T00:02:48.052566+0000","last_became_peered":"2024-09-12T00:02:48.052566+0000","last_unstale":"2024-09-12T01:15:57.550622+0000","last_undegraded":"2024-09-12T01:15:57.550622+0000","last_fullsized":"2024-09-12T01:15:57.550622+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:15:57.550505+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:15:57.550505+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.550505+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.920796+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":572,"num_read_kb":73907,"num_write":996,"num_write_kb":20895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.511011+0000","last_change":"2024-09-12T00:02:52.066484+0000","last_active":"2024-09-12T01:12:58.511011+0000","last_peered":"2024-09-12T01:12:58.511011+0000","last_clean":"2024-09-12T01:12:58.511011+0000","last_became_active":"2024-09-12T00:02:52.066171+0000","last_became_peered":"2024-09-12T00:02:52.066171+0000","last_unstale":"2024-09-12T01:12:58.511011+0000","last_undegraded":"2024-09-12T01:12:58.511011+0000","last_fullsized":"2024-09-12T01:12:58.511011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:47.617107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'168","reported_seq":756,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.074173+0000","last_change":"2024-09-12T00:02:54.239939+0000","last_active":"2024-09-12T01:15:48.074173+0000","last_peered":"2024-09-12T01:15:48.074173+0000","last_clean":"2024-09-12T01:15:48.074173+0000","last_became_active":"2024-09-12T00:02:54.239618+0000","last_became_peered":"2024-09-12T00:02:54.239618+0000","last_unstale":"2024-09-12T01:15:48.074173+0000","last_undegraded":"2024-09-12T01:15:48.074173+0000","last_fullsized":"2024-09-12T01:15:48.074173+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:03.054772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":308,"num_write":128,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'807","reported_seq":2630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.961786+0000","last_change":"2024-09-12T00:02:56.082933+0000","last_active":"2024-09-12T01:15:47.961786+0000","last_peered":"2024-09-12T01:15:47.961786+0000","last_clean":"2024-09-12T01:15:47.961786+0000","last_became_active":"2024-09-12T00:02:56.082567+0000","last_became_peered":"2024-09-12T00:02:56.082567+0000","last_unstale":"2024-09-12T01:15:47.961786+0000","last_undegraded":"2024-09-12T01:15:47.961786+0000","last_fullsized":"2024-09-12T01:15:47.961786+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:12.520817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'364","reported_seq":1788,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.242073+0000","last_change":"2024-09-12T01:16:11.242073+0000","last_active":"2024-09-12T01:16:11.242073+0000","last_peered":"2024-09-12T01:16:11.242073+0000","last_clean":"2024-09-12T01:16:11.242073+0000","last_became_active":"2024-09-12T00:02:50.063707+0000","last_became_peered":"2024-09-12T00:02:50.063707+0000","last_unstale":"2024-09-12T01:16:11.242073+0000","last_undegraded":"2024-09-12T01:16:11.242073+0000","last_fullsized":"2024-09-12T01:16:11.242073+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T01:16:11.241987+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T01:16:11.241987+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.241987+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:49.086172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1902,"num_write":425,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'196","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.757332+0000","last_change":"2024-09-12T01:16:03.757332+0000","last_active":"2024-09-12T01:16:03.757332+0000","last_peered":"2024-09-12T01:16:03.757332+0000","last_clean":"2024-09-12T01:16:03.757332+0000","last_became_active":"2024-09-12T00:02:48.056135+0000","last_became_peered":"2024-09-12T00:02:48.056135+0000","last_unstale":"2024-09-12T01:16:03.757332+0000","last_undegraded":"2024-09-12T01:16:03.757332+0000","last_fullsized":"2024-09-12T01:16:03.757332+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T01:16:03.757211+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T01:16:03.757211+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.757211+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:10.396944+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":40539,"num_write":934,"num_write_kb":46911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.393561+0000","last_change":"2024-09-12T00:02:52.069040+0000","last_active":"2024-09-12T01:12:13.393561+0000","last_peered":"2024-09-12T01:12:13.393561+0000","last_clean":"2024-09-12T01:12:13.393561+0000","last_became_active":"2024-09-12T00:02:52.068747+0000","last_became_peered":"2024-09-12T00:02:52.068747+0000","last_unstale":"2024-09-12T01:12:13.393561+0000","last_undegraded":"2024-09-12T01:12:13.393561+0000","last_fullsized":"2024-09-12T01:12:13.393561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:35.948073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'275","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.157693+0000","last_change":"2024-09-12T00:02:54.239819+0000","last_active":"2024-09-12T01:15:48.157693+0000","last_peered":"2024-09-12T01:15:48.157693+0000","last_clean":"2024-09-12T01:15:48.157693+0000","last_became_active":"2024-09-12T00:02:54.239475+0000","last_became_peered":"2024-09-12T00:02:54.239475+0000","last_unstale":"2024-09-12T01:15:48.157693+0000","last_undegraded":"2024-09-12T01:15:48.157693+0000","last_fullsized":"2024-09-12T01:15:48.157693+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:54.855357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5743,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":380,"num_read_kb":454,"num_write":232,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.234848+0000","last_change":"2024-09-12T00:02:56.082064+0000","last_active":"2024-09-12T01:12:43.234848+0000","last_peered":"2024-09-12T01:12:43.234848+0000","last_clean":"2024-09-12T01:12:43.234848+0000","last_became_active":"2024-09-12T00:02:56.080748+0000","last_became_peered":"2024-09-12T00:02:56.080748+0000","last_unstale":"2024-09-12T01:12:43.234848+0000","last_undegraded":"2024-09-12T01:12:43.234848+0000","last_fullsized":"2024-09-12T01:12:43.234848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:53.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'526","reported_seq":1342,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.903053+0000","last_change":"2024-09-12T00:02:58.095783+0000","last_active":"2024-09-12T01:15:10.903053+0000","last_peered":"2024-09-12T01:15:10.903053+0000","last_clean":"2024-09-12T01:15:10.903053+0000","last_became_active":"2024-09-12T00:02:58.095311+0000","last_became_peered":"2024-09-12T00:02:58.095311+0000","last_unstale":"2024-09-12T01:15:10.903053+0000","last_undegraded":"2024-09-12T01:15:10.903053+0000","last_fullsized":"2024-09-12T01:15:10.903053+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:26.606781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1247,"num_read_kb":1245,"num_write":1070,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'399","reported_seq":1709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.751890+0000","last_change":"2024-09-12T01:16:03.751890+0000","last_active":"2024-09-12T01:16:03.751890+0000","last_peered":"2024-09-12T01:16:03.751890+0000","last_clean":"2024-09-12T01:16:03.751890+0000","last_became_active":"2024-09-12T00:02:50.068223+0000","last_became_peered":"2024-09-12T00:02:50.068223+0000","last_unstale":"2024-09-12T01:16:03.751890+0000","last_undegraded":"2024-09-12T01:16:03.751890+0000","last_fullsized":"2024-09-12T01:16:03.751890+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-12T01:16:03.751752+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-12T01:16:03.751752+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.751752+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:31.247244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1919,"num_read_kb":1778,"num_write":479,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'153","reported_seq":792,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.760986+0000","last_change":"2024-09-12T01:16:00.760986+0000","last_active":"2024-09-12T01:16:00.760986+0000","last_peered":"2024-09-12T01:16:00.760986+0000","last_clean":"2024-09-12T01:16:00.760986+0000","last_became_active":"2024-09-12T00:02:48.055480+0000","last_became_peered":"2024-09-12T00:02:48.055480+0000","last_unstale":"2024-09-12T01:16:00.760986+0000","last_undegraded":"2024-09-12T01:16:00.760986+0000","last_fullsized":"2024-09-12T01:16:00.760986+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-12T01:16:00.760880+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-12T01:16:00.760880+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.760880+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.310424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250607,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":416,"num_read_kb":43431,"num_write":767,"num_write_kb":28983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.264574+0000","last_change":"2024-09-12T01:16:09.264574+0000","last_active":"2024-09-12T01:16:09.264574+0000","last_peered":"2024-09-12T01:16:09.264574+0000","last_clean":"2024-09-12T01:16:09.264574+0000","last_became_active":"2024-09-12T00:02:52.062219+0000","last_became_peered":"2024-09-12T00:02:52.062219+0000","last_unstale":"2024-09-12T01:16:09.264574+0000","last_undegraded":"2024-09-12T01:16:09.264574+0000","last_fullsized":"2024-09-12T01:16:09.264574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.264489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.264489+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.264489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:41.480353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'157","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.271575+0000","last_change":"2024-09-12T00:02:54.069965+0000","last_active":"2024-09-12T01:15:48.271575+0000","last_peered":"2024-09-12T01:15:48.271575+0000","last_clean":"2024-09-12T01:15:48.271575+0000","last_became_active":"2024-09-12T00:02:54.069656+0000","last_became_peered":"2024-09-12T00:02:54.069656+0000","last_unstale":"2024-09-12T01:15:48.271575+0000","last_undegraded":"2024-09-12T01:15:48.271575+0000","last_fullsized":"2024-09-12T01:15:48.271575+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:14.543544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9092,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":201,"num_read_kb":271,"num_write":108,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.451158+0000","last_change":"2024-09-12T00:02:56.082127+0000","last_active":"2024-09-12T01:12:23.451158+0000","last_peered":"2024-09-12T01:12:23.451158+0000","last_clean":"2024-09-12T01:12:23.451158+0000","last_became_active":"2024-09-12T00:02:56.081804+0000","last_became_peered":"2024-09-12T00:02:56.081804+0000","last_unstale":"2024-09-12T01:12:23.451158+0000","last_undegraded":"2024-09-12T01:12:23.451158+0000","last_fullsized":"2024-09-12T01:12:23.451158+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'120","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:00.156766+0000","last_change":"2024-09-12T00:02:58.095336+0000","last_active":"2024-09-12T01:15:00.156766+0000","last_peered":"2024-09-12T01:15:00.156766+0000","last_clean":"2024-09-12T01:15:00.156766+0000","last_became_active":"2024-09-12T00:02:58.095068+0000","last_became_peered":"2024-09-12T00:02:58.095068+0000","last_unstale":"2024-09-12T01:15:00.156766+0000","last_undegraded":"2024-09-12T01:15:00.156766+0000","last_fullsized":"2024-09-12T01:15:00.156766+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":135,"num_write":297,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'897","reported_seq":2427,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.517733+0000","last_change":"2024-09-12T01:16:05.517733+0000","last_active":"2024-09-12T01:16:05.517733+0000","last_peered":"2024-09-12T01:16:05.517733+0000","last_clean":"2024-09-12T01:16:05.517733+0000","last_became_active":"2024-09-12T00:02:50.078033+0000","last_became_peered":"2024-09-12T00:02:50.078033+0000","last_unstale":"2024-09-12T01:16:05.517733+0000","last_undegraded":"2024-09-12T01:16:05.517733+0000","last_fullsized":"2024-09-12T01:16:05.517733+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'897","last_scrub_stamp":"2024-09-12T01:16:05.517647+0000","last_deep_scrub":"267'897","last_deep_scrub_stamp":"2024-09-12T01:16:05.517647+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.517647+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:04.806609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4128,"num_read_kb":3671,"num_write":1209,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'185","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.716184+0000","last_change":"2024-09-12T01:15:59.716184+0000","last_active":"2024-09-12T01:15:59.716184+0000","last_peered":"2024-09-12T01:15:59.716184+0000","last_clean":"2024-09-12T01:15:59.716184+0000","last_became_active":"2024-09-12T00:02:48.048973+0000","last_became_peered":"2024-09-12T00:02:48.048973+0000","last_unstale":"2024-09-12T01:15:59.716184+0000","last_undegraded":"2024-09-12T01:15:59.716184+0000","last_fullsized":"2024-09-12T01:15:59.716184+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:59.716068+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:59.716068+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.716068+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:27.806731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":6868,"num_write":918,"num_write_kb":34085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.262229+0000","last_change":"2024-09-12T01:16:10.262229+0000","last_active":"2024-09-12T01:16:10.262229+0000","last_peered":"2024-09-12T01:16:10.262229+0000","last_clean":"2024-09-12T01:16:10.262229+0000","last_became_active":"2024-09-12T00:02:52.065809+0000","last_became_peered":"2024-09-12T00:02:52.065809+0000","last_unstale":"2024-09-12T01:16:10.262229+0000","last_undegraded":"2024-09-12T01:16:10.262229+0000","last_fullsized":"2024-09-12T01:16:10.262229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.262136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.262136+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.262136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:54.718660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'211","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.180814+0000","last_change":"2024-09-12T00:02:54.067330+0000","last_active":"2024-09-12T01:15:48.180814+0000","last_peered":"2024-09-12T01:15:48.180814+0000","last_clean":"2024-09-12T01:15:48.180814+0000","last_became_active":"2024-09-12T00:02:54.066781+0000","last_became_peered":"2024-09-12T00:02:54.066781+0000","last_unstale":"2024-09-12T01:15:48.180814+0000","last_undegraded":"2024-09-12T01:15:48.180814+0000","last_fullsized":"2024-09-12T01:15:48.180814+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:13.921060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":282,"num_read_kb":329,"num_write":166,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'794","reported_seq":2817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.962907+0000","last_change":"2024-09-12T00:02:56.086997+0000","last_active":"2024-09-12T01:15:47.962907+0000","last_peered":"2024-09-12T01:15:47.962907+0000","last_clean":"2024-09-12T01:15:47.962907+0000","last_became_active":"2024-09-12T00:02:56.086692+0000","last_became_peered":"2024-09-12T00:02:56.086692+0000","last_unstale":"2024-09-12T01:15:47.962907+0000","last_undegraded":"2024-09-12T01:15:47.962907+0000","last_fullsized":"2024-09-12T01:15:47.962907+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:43.673008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'116","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.570840+0000","last_change":"2024-09-12T00:02:58.093723+0000","last_active":"2024-09-12T01:15:09.570840+0000","last_peered":"2024-09-12T01:15:09.570840+0000","last_clean":"2024-09-12T01:15:09.570840+0000","last_became_active":"2024-09-12T00:02:58.093419+0000","last_became_peered":"2024-09-12T00:02:58.093419+0000","last_unstale":"2024-09-12T01:15:09.570840+0000","last_undegraded":"2024-09-12T01:15:09.570840+0000","last_fullsized":"2024-09-12T01:15:09.570840+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:27.505545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":298,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'401","reported_seq":2002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.792877+0000","last_change":"2024-09-12T01:16:04.792877+0000","last_active":"2024-09-12T01:16:04.792877+0000","last_peered":"2024-09-12T01:16:04.792877+0000","last_clean":"2024-09-12T01:16:04.792877+0000","last_became_active":"2024-09-12T00:02:50.073986+0000","last_became_peered":"2024-09-12T00:02:50.073986+0000","last_unstale":"2024-09-12T01:16:04.792877+0000","last_undegraded":"2024-09-12T01:16:04.792877+0000","last_fullsized":"2024-09-12T01:16:04.792877+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T01:16:04.792766+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T01:16:04.792766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.792766+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:59.004193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2369,"num_read_kb":2271,"num_write":449,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'218","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.185384+0000","last_change":"2024-09-12T01:15:57.185384+0000","last_active":"2024-09-12T01:15:57.185384+0000","last_peered":"2024-09-12T01:15:57.185384+0000","last_clean":"2024-09-12T01:15:57.185384+0000","last_became_active":"2024-09-12T00:02:48.051190+0000","last_became_peered":"2024-09-12T00:02:48.051190+0000","last_unstale":"2024-09-12T01:15:57.185384+0000","last_undegraded":"2024-09-12T01:15:57.185384+0000","last_fullsized":"2024-09-12T01:15:57.185384+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:15:57.185281+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:15:57.185281+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.185281+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.188053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":21060,"num_write":1056,"num_write_kb":24204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.288239+0000","last_change":"2024-09-12T01:16:07.288239+0000","last_active":"2024-09-12T01:16:07.288239+0000","last_peered":"2024-09-12T01:16:07.288239+0000","last_clean":"2024-09-12T01:16:07.288239+0000","last_became_active":"2024-09-12T00:02:52.056676+0000","last_became_peered":"2024-09-12T00:02:52.056676+0000","last_unstale":"2024-09-12T01:16:07.288239+0000","last_undegraded":"2024-09-12T01:16:07.288239+0000","last_fullsized":"2024-09-12T01:16:07.288239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:07.288154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:07.288154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.288154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.787901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'225","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.297507+0000","last_change":"2024-09-12T00:02:54.067361+0000","last_active":"2024-09-12T01:15:48.297507+0000","last_peered":"2024-09-12T01:15:48.297507+0000","last_clean":"2024-09-12T01:15:48.297507+0000","last_became_active":"2024-09-12T00:02:54.066994+0000","last_became_peered":"2024-09-12T00:02:54.066994+0000","last_unstale":"2024-09-12T01:15:48.297507+0000","last_undegraded":"2024-09-12T01:15:48.297507+0000","last_fullsized":"2024-09-12T01:15:48.297507+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:13.963065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10683,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":318,"num_read_kb":432,"num_write":164,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.224174+0000","last_change":"2024-09-12T00:02:56.079092+0000","last_active":"2024-09-12T01:12:18.224174+0000","last_peered":"2024-09-12T01:12:18.224174+0000","last_clean":"2024-09-12T01:12:18.224174+0000","last_became_active":"2024-09-12T00:02:56.078740+0000","last_became_peered":"2024-09-12T00:02:56.078740+0000","last_unstale":"2024-09-12T01:12:18.224174+0000","last_undegraded":"2024-09-12T01:12:18.224174+0000","last_fullsized":"2024-09-12T01:12:18.224174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.551797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'108","reported_seq":625,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.778285+0000","last_change":"2024-09-12T00:02:58.092860+0000","last_active":"2024-09-12T01:14:00.778285+0000","last_peered":"2024-09-12T01:14:00.778285+0000","last_clean":"2024-09-12T01:14:00.778285+0000","last_became_active":"2024-09-12T00:02:58.092520+0000","last_became_peered":"2024-09-12T00:02:58.092520+0000","last_unstale":"2024-09-12T01:14:00.778285+0000","last_undegraded":"2024-09-12T01:14:00.778285+0000","last_fullsized":"2024-09-12T01:14:00.778285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":241,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'522","reported_seq":2244,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.702966+0000","last_change":"2024-09-12T01:15:57.702966+0000","last_active":"2024-09-12T01:15:57.702966+0000","last_peered":"2024-09-12T01:15:57.702966+0000","last_clean":"2024-09-12T01:15:57.702966+0000","last_became_active":"2024-09-12T00:02:50.068691+0000","last_became_peered":"2024-09-12T00:02:50.068691+0000","last_unstale":"2024-09-12T01:15:57.702966+0000","last_undegraded":"2024-09-12T01:15:57.702966+0000","last_fullsized":"2024-09-12T01:15:57.702966+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'522","last_scrub_stamp":"2024-09-12T01:15:57.702886+0000","last_deep_scrub":"267'522","last_deep_scrub_stamp":"2024-09-12T01:15:57.702886+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.702886+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:32.128046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2837,"num_read_kb":2668,"num_write":620,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'204","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.771129+0000","last_change":"2024-09-12T01:15:57.771129+0000","last_active":"2024-09-12T01:15:57.771129+0000","last_peered":"2024-09-12T01:15:57.771129+0000","last_clean":"2024-09-12T01:15:57.771129+0000","last_became_active":"2024-09-12T00:02:48.050513+0000","last_became_peered":"2024-09-12T00:02:48.050513+0000","last_unstale":"2024-09-12T01:15:57.771129+0000","last_undegraded":"2024-09-12T01:15:57.771129+0000","last_fullsized":"2024-09-12T01:15:57.771129+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'204","last_scrub_stamp":"2024-09-12T01:15:57.771000+0000","last_deep_scrub":"267'204","last_deep_scrub_stamp":"2024-09-12T01:15:57.771000+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.771000+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:32.870808+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342067,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":923,"num_read_kb":76851,"num_write":1040,"num_write_kb":50138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.275148+0000","last_change":"2024-09-12T01:16:08.275148+0000","last_active":"2024-09-12T01:16:08.275148+0000","last_peered":"2024-09-12T01:16:08.275148+0000","last_clean":"2024-09-12T01:16:08.275148+0000","last_became_active":"2024-09-12T00:02:52.064333+0000","last_became_peered":"2024-09-12T00:02:52.064333+0000","last_unstale":"2024-09-12T01:16:08.275148+0000","last_undegraded":"2024-09-12T01:16:08.275148+0000","last_fullsized":"2024-09-12T01:16:08.275148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:08.275061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:08.275061+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.275061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:43.190059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'175","reported_seq":778,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.013426+0000","last_change":"2024-09-12T00:02:54.069072+0000","last_active":"2024-09-12T01:15:48.013426+0000","last_peered":"2024-09-12T01:15:48.013426+0000","last_clean":"2024-09-12T01:15:48.013426+0000","last_became_active":"2024-09-12T00:02:54.068732+0000","last_became_peered":"2024-09-12T00:02:54.068732+0000","last_unstale":"2024-09-12T01:15:48.013426+0000","last_undegraded":"2024-09-12T01:15:48.013426+0000","last_fullsized":"2024-09-12T01:15:48.013426+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:07.854071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":259,"num_read_kb":329,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.244035+0000","last_change":"2024-09-12T00:02:56.088885+0000","last_active":"2024-09-12T01:12:55.244035+0000","last_peered":"2024-09-12T01:12:55.244035+0000","last_clean":"2024-09-12T01:12:55.244035+0000","last_became_active":"2024-09-12T00:02:56.088527+0000","last_became_peered":"2024-09-12T00:02:56.088527+0000","last_unstale":"2024-09-12T01:12:55.244035+0000","last_undegraded":"2024-09-12T01:12:55.244035+0000","last_fullsized":"2024-09-12T01:12:55.244035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:43.640519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'110","reported_seq":616,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:00.159830+0000","last_change":"2024-09-12T00:02:58.101029+0000","last_active":"2024-09-12T01:15:00.159830+0000","last_peered":"2024-09-12T01:15:00.159830+0000","last_clean":"2024-09-12T01:15:00.159830+0000","last_became_active":"2024-09-12T00:02:58.100726+0000","last_became_peered":"2024-09-12T00:02:58.100726+0000","last_unstale":"2024-09-12T01:15:00.159830+0000","last_undegraded":"2024-09-12T01:15:00.159830+0000","last_fullsized":"2024-09-12T01:15:00.159830+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:32.362052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":109,"num_write":270,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'822","reported_seq":2447,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.677185+0000","last_change":"2024-09-12T01:16:00.677185+0000","last_active":"2024-09-12T01:16:00.677185+0000","last_peered":"2024-09-12T01:16:00.677185+0000","last_clean":"2024-09-12T01:16:00.677185+0000","last_became_active":"2024-09-12T00:02:50.059646+0000","last_became_peered":"2024-09-12T00:02:50.059646+0000","last_unstale":"2024-09-12T01:16:00.677185+0000","last_undegraded":"2024-09-12T01:16:00.677185+0000","last_fullsized":"2024-09-12T01:16:00.677185+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'822","last_scrub_stamp":"2024-09-12T01:16:00.677097+0000","last_deep_scrub":"267'822","last_deep_scrub_stamp":"2024-09-12T01:16:00.677097+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.677097+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:43.127120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3626,"num_write":1074,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'218","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.584216+0000","last_change":"2024-09-12T01:15:56.584216+0000","last_active":"2024-09-12T01:15:56.584216+0000","last_peered":"2024-09-12T01:15:56.584216+0000","last_clean":"2024-09-12T01:15:56.584216+0000","last_became_active":"2024-09-12T00:02:48.046424+0000","last_became_peered":"2024-09-12T00:02:48.046424+0000","last_unstale":"2024-09-12T01:15:56.584216+0000","last_undegraded":"2024-09-12T01:15:56.584216+0000","last_fullsized":"2024-09-12T01:15:56.584216+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:15:56.584071+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:15:56.584071+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.584071+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:34.930249+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":142057,"num_write":895,"num_write_kb":42631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.169805+0000","last_change":"2024-09-12T01:16:10.169805+0000","last_active":"2024-09-12T01:16:10.169805+0000","last_peered":"2024-09-12T01:16:10.169805+0000","last_clean":"2024-09-12T01:16:10.169805+0000","last_became_active":"2024-09-12T00:02:52.063641+0000","last_became_peered":"2024-09-12T00:02:52.063641+0000","last_unstale":"2024-09-12T01:16:10.169805+0000","last_undegraded":"2024-09-12T01:16:10.169805+0000","last_fullsized":"2024-09-12T01:16:10.169805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.169703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.169703+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.169703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:33.997915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'192","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.214623+0000","last_change":"2024-09-12T01:16:12.214623+0000","last_active":"2024-09-12T01:16:12.214623+0000","last_peered":"2024-09-12T01:16:12.214623+0000","last_clean":"2024-09-12T01:16:12.214623+0000","last_became_active":"2024-09-12T00:02:54.067328+0000","last_became_peered":"2024-09-12T00:02:54.067328+0000","last_unstale":"2024-09-12T01:16:12.214623+0000","last_undegraded":"2024-09-12T01:16:12.214623+0000","last_fullsized":"2024-09-12T01:16:12.214623+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-12T01:16:12.214526+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-12T01:16:12.214526+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.214526+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:31.671601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":308,"num_write":148,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'744","reported_seq":2618,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.957993+0000","last_change":"2024-09-12T00:02:56.079479+0000","last_active":"2024-09-12T01:15:47.957993+0000","last_peered":"2024-09-12T01:15:47.957993+0000","last_clean":"2024-09-12T01:15:47.957993+0000","last_became_active":"2024-09-12T00:02:56.079167+0000","last_became_peered":"2024-09-12T00:02:56.079167+0000","last_unstale":"2024-09-12T01:15:47.957993+0000","last_undegraded":"2024-09-12T01:15:47.957993+0000","last_fullsized":"2024-09-12T01:15:47.957993+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:15.403409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'124","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:01.459991+0000","last_change":"2024-09-12T00:02:58.097685+0000","last_active":"2024-09-12T01:14:01.459991+0000","last_peered":"2024-09-12T01:14:01.459991+0000","last_clean":"2024-09-12T01:14:01.459991+0000","last_became_active":"2024-09-12T00:02:58.097332+0000","last_became_peered":"2024-09-12T00:02:58.097332+0000","last_unstale":"2024-09-12T01:14:01.459991+0000","last_undegraded":"2024-09-12T01:14:01.459991+0000","last_fullsized":"2024-09-12T01:14:01.459991+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:48.010383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'387","reported_seq":2005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.709242+0000","last_change":"2024-09-12T01:15:59.709242+0000","last_active":"2024-09-12T01:15:59.709242+0000","last_peered":"2024-09-12T01:15:59.709242+0000","last_clean":"2024-09-12T01:15:59.709242+0000","last_became_active":"2024-09-12T00:02:50.063676+0000","last_became_peered":"2024-09-12T00:02:50.063676+0000","last_unstale":"2024-09-12T01:15:59.709242+0000","last_undegraded":"2024-09-12T01:15:59.709242+0000","last_fullsized":"2024-09-12T01:15:59.709242+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-09-12T01:15:59.709154+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-09-12T01:15:59.709154+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.709154+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:48.504412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2187,"num_read_kb":2115,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'185","reported_seq":837,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.700181+0000","last_change":"2024-09-12T01:15:58.700181+0000","last_active":"2024-09-12T01:15:58.700181+0000","last_peered":"2024-09-12T01:15:58.700181+0000","last_clean":"2024-09-12T01:15:58.700181+0000","last_became_active":"2024-09-12T00:02:48.046457+0000","last_became_peered":"2024-09-12T00:02:48.046457+0000","last_unstale":"2024-09-12T01:15:58.700181+0000","last_undegraded":"2024-09-12T01:15:58.700181+0000","last_fullsized":"2024-09-12T01:15:58.700181+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:58.700097+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:58.700097+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.700097+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:20.069674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":408,"num_read_kb":52839,"num_write":877,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.937718+0000","last_change":"2024-09-12T00:02:52.068801+0000","last_active":"2024-09-12T01:15:47.937718+0000","last_peered":"2024-09-12T01:15:47.937718+0000","last_clean":"2024-09-12T01:15:47.937718+0000","last_became_active":"2024-09-12T00:02:52.068535+0000","last_became_peered":"2024-09-12T00:02:52.068535+0000","last_unstale":"2024-09-12T01:15:47.937718+0000","last_undegraded":"2024-09-12T01:15:47.937718+0000","last_fullsized":"2024-09-12T01:15:47.937718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:14.683759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'108","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.637945+0000","last_change":"2024-09-12T01:16:11.637945+0000","last_active":"2024-09-12T01:16:11.637945+0000","last_peered":"2024-09-12T01:16:11.637945+0000","last_clean":"2024-09-12T01:16:11.637945+0000","last_became_active":"2024-09-12T00:02:54.239924+0000","last_became_peered":"2024-09-12T00:02:54.239924+0000","last_unstale":"2024-09-12T01:16:11.637945+0000","last_undegraded":"2024-09-12T01:16:11.637945+0000","last_fullsized":"2024-09-12T01:16:11.637945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'108","last_scrub_stamp":"2024-09-12T01:16:11.637836+0000","last_deep_scrub":"267'108","last_deep_scrub_stamp":"2024-09-12T01:16:11.637836+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.637836+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:14.647602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":4496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.959587+0000","last_change":"2024-09-12T00:02:56.086976+0000","last_active":"2024-09-12T01:15:47.959587+0000","last_peered":"2024-09-12T01:15:47.959587+0000","last_clean":"2024-09-12T01:15:47.959587+0000","last_became_active":"2024-09-12T00:02:56.086668+0000","last_became_peered":"2024-09-12T00:02:56.086668+0000","last_unstale":"2024-09-12T01:15:47.959587+0000","last_undegraded":"2024-09-12T01:15:47.959587+0000","last_fullsized":"2024-09-12T01:15:47.959587+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:09.139717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'150","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.258589+0000","last_change":"2024-09-12T00:02:58.097729+0000","last_active":"2024-09-12T01:13:48.258589+0000","last_peered":"2024-09-12T01:13:48.258589+0000","last_clean":"2024-09-12T01:13:48.258589+0000","last_became_active":"2024-09-12T00:02:58.097435+0000","last_became_peered":"2024-09-12T00:02:58.097435+0000","last_unstale":"2024-09-12T01:13:48.258589+0000","last_undegraded":"2024-09-12T01:13:48.258589+0000","last_fullsized":"2024-09-12T01:13:48.258589+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:06.625906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":180,"num_write":378,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'763","reported_seq":2624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.126650+0000","last_change":"2024-09-12T01:16:05.126650+0000","last_active":"2024-09-12T01:16:05.126650+0000","last_peered":"2024-09-12T01:16:05.126650+0000","last_clean":"2024-09-12T01:16:05.126650+0000","last_became_active":"2024-09-12T00:02:50.069661+0000","last_became_peered":"2024-09-12T00:02:50.069661+0000","last_unstale":"2024-09-12T01:16:05.126650+0000","last_undegraded":"2024-09-12T01:16:05.126650+0000","last_fullsized":"2024-09-12T01:16:05.126650+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'763","last_scrub_stamp":"2024-09-12T01:16:05.126551+0000","last_deep_scrub":"267'763","last_deep_scrub_stamp":"2024-09-12T01:16:05.126551+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.126551+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:05.494723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4159,"num_read_kb":3799,"num_write":1082,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5109,"num_omap_keys":21,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'214","reported_seq":944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.740095+0000","last_change":"2024-09-12T01:15:56.740095+0000","last_active":"2024-09-12T01:15:56.740095+0000","last_peered":"2024-09-12T01:15:56.740095+0000","last_clean":"2024-09-12T01:15:56.740095+0000","last_became_active":"2024-09-12T00:02:48.046527+0000","last_became_peered":"2024-09-12T00:02:48.046527+0000","last_unstale":"2024-09-12T01:15:56.740095+0000","last_undegraded":"2024-09-12T01:15:56.740095+0000","last_fullsized":"2024-09-12T01:15:56.740095+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-12T01:15:56.739986+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-12T01:15:56.739986+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.739986+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:08.369987+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":898,"num_read_kb":26543,"num_write":1077,"num_write_kb":24642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"38'4","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:47.925616+0000","last_change":"2024-09-12T00:02:52.064448+0000","last_active":"2024-09-12T01:15:47.925616+0000","last_peered":"2024-09-12T01:15:47.925616+0000","last_clean":"2024-09-12T01:15:47.925616+0000","last_became_active":"2024-09-12T00:02:52.064186+0000","last_became_peered":"2024-09-12T00:02:52.064186+0000","last_unstale":"2024-09-12T01:15:47.925616+0000","last_undegraded":"2024-09-12T01:15:47.925616+0000","last_fullsized":"2024-09-12T01:15:47.925616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:57.033593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'295","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.124813+0000","last_change":"2024-09-12T00:02:54.072647+0000","last_active":"2024-09-12T01:15:48.124813+0000","last_peered":"2024-09-12T01:15:48.124813+0000","last_clean":"2024-09-12T01:15:48.124813+0000","last_became_active":"2024-09-12T00:02:54.072431+0000","last_became_peered":"2024-09-12T00:02:54.072431+0000","last_unstale":"2024-09-12T01:15:48.124813+0000","last_undegraded":"2024-09-12T01:15:48.124813+0000","last_fullsized":"2024-09-12T01:15:48.124813+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:22.191371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1000,"num_write":1544,"num_write_kb":1370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.426217+0000","last_change":"2024-09-12T01:16:13.426217+0000","last_active":"2024-09-12T01:16:13.426217+0000","last_peered":"2024-09-12T01:16:13.426217+0000","last_clean":"2024-09-12T01:16:13.426217+0000","last_became_active":"2024-09-12T00:02:56.083643+0000","last_became_peered":"2024-09-12T00:02:56.083643+0000","last_unstale":"2024-09-12T01:16:13.426217+0000","last_undegraded":"2024-09-12T01:16:13.426217+0000","last_fullsized":"2024-09-12T01:16:13.426217+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.426122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.426122+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.426122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:16.827180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'154","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.241850+0000","last_change":"2024-09-12T00:02:58.096803+0000","last_active":"2024-09-12T01:13:48.241850+0000","last_peered":"2024-09-12T01:13:48.241850+0000","last_clean":"2024-09-12T01:13:48.241850+0000","last_became_active":"2024-09-12T00:02:58.096337+0000","last_became_peered":"2024-09-12T00:02:58.096337+0000","last_unstale":"2024-09-12T01:13:48.241850+0000","last_undegraded":"2024-09-12T01:13:48.241850+0000","last_fullsized":"2024-09-12T01:13:48.241850+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":374,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'346","reported_seq":1750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.525322+0000","last_change":"2024-09-12T01:16:04.525322+0000","last_active":"2024-09-12T01:16:04.525322+0000","last_peered":"2024-09-12T01:16:04.525322+0000","last_clean":"2024-09-12T01:16:04.525322+0000","last_became_active":"2024-09-12T00:02:50.063141+0000","last_became_peered":"2024-09-12T00:02:50.063141+0000","last_unstale":"2024-09-12T01:16:04.525322+0000","last_undegraded":"2024-09-12T01:16:04.525322+0000","last_fullsized":"2024-09-12T01:16:04.525322+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T01:16:04.525232+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T01:16:04.525232+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.525232+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:47.471239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1807,"num_write":392,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.712040+0000","last_change":"2024-09-12T01:15:56.712040+0000","last_active":"2024-09-12T01:15:56.712040+0000","last_peered":"2024-09-12T01:15:56.712040+0000","last_clean":"2024-09-12T01:15:56.712040+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T01:15:56.712040+0000","last_undegraded":"2024-09-12T01:15:56.712040+0000","last_fullsized":"2024-09-12T01:15:56.712040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:15:56.711929+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:15:56.711929+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.711929+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.441635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.202303+0000","last_change":"2024-09-12T01:16:00.202303+0000","last_active":"2024-09-12T01:16:00.202303+0000","last_peered":"2024-09-12T01:16:00.202303+0000","last_clean":"2024-09-12T01:16:00.202303+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T01:16:00.202303+0000","last_undegraded":"2024-09-12T01:16:00.202303+0000","last_fullsized":"2024-09-12T01:16:00.202303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:00.202177+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:00.202177+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.202177+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:38.507294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'199","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.725025+0000","last_change":"2024-09-12T01:15:55.725025+0000","last_active":"2024-09-12T01:15:55.725025+0000","last_peered":"2024-09-12T01:15:55.725025+0000","last_clean":"2024-09-12T01:15:55.725025+0000","last_became_active":"2024-09-12T00:02:48.047739+0000","last_became_peered":"2024-09-12T00:02:48.047739+0000","last_unstale":"2024-09-12T01:15:55.725025+0000","last_undegraded":"2024-09-12T01:15:55.725025+0000","last_fullsized":"2024-09-12T01:15:55.725025+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'199","last_scrub_stamp":"2024-09-12T01:15:55.724921+0000","last_deep_scrub":"267'199","last_deep_scrub_stamp":"2024-09-12T01:15:55.724921+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.724921+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:06.864180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":439,"num_read_kb":34702,"num_write":919,"num_write_kb":51263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.405908+0000","last_change":"2024-09-12T00:02:52.065910+0000","last_active":"2024-09-12T01:13:43.405908+0000","last_peered":"2024-09-12T01:13:43.405908+0000","last_clean":"2024-09-12T01:13:43.405908+0000","last_became_active":"2024-09-12T00:02:52.065587+0000","last_became_peered":"2024-09-12T00:02:52.065587+0000","last_unstale":"2024-09-12T01:13:43.405908+0000","last_undegraded":"2024-09-12T01:13:43.405908+0000","last_fullsized":"2024-09-12T01:13:43.405908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:58.876252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'333","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.224680+0000","last_change":"2024-09-12T00:02:54.069602+0000","last_active":"2024-09-12T01:15:48.224680+0000","last_peered":"2024-09-12T01:15:48.224680+0000","last_clean":"2024-09-12T01:15:48.224680+0000","last_became_active":"2024-09-12T00:02:54.069167+0000","last_became_peered":"2024-09-12T00:02:54.069167+0000","last_unstale":"2024-09-12T01:15:48.224680+0000","last_undegraded":"2024-09-12T01:15:48.224680+0000","last_fullsized":"2024-09-12T01:15:48.224680+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.314767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":868,"num_write":580,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.239491+0000","last_change":"2024-09-12T00:02:56.083312+0000","last_active":"2024-09-12T01:12:15.239491+0000","last_peered":"2024-09-12T01:12:15.239491+0000","last_clean":"2024-09-12T01:12:15.239491+0000","last_became_active":"2024-09-12T00:02:56.082981+0000","last_became_peered":"2024-09-12T00:02:56.082981+0000","last_unstale":"2024-09-12T01:12:15.239491+0000","last_undegraded":"2024-09-12T01:12:15.239491+0000","last_fullsized":"2024-09-12T01:12:15.239491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:01.810212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'220","reported_seq":934,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.154487+0000","last_change":"2024-09-12T00:02:58.099932+0000","last_active":"2024-09-12T01:14:04.154487+0000","last_peered":"2024-09-12T01:14:04.154487+0000","last_clean":"2024-09-12T01:14:04.154487+0000","last_became_active":"2024-09-12T00:02:58.099655+0000","last_became_peered":"2024-09-12T00:02:58.099655+0000","last_unstale":"2024-09-12T01:14:04.154487+0000","last_undegraded":"2024-09-12T01:14:04.154487+0000","last_fullsized":"2024-09-12T01:14:04.154487+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:49.539153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1237,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":468,"num_write":474,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'877","reported_seq":2635,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.833288+0000","last_change":"2024-09-12T01:16:03.833288+0000","last_active":"2024-09-12T01:16:03.833288+0000","last_peered":"2024-09-12T01:16:03.833288+0000","last_clean":"2024-09-12T01:16:03.833288+0000","last_became_active":"2024-09-12T00:02:50.075700+0000","last_became_peered":"2024-09-12T00:02:50.075700+0000","last_unstale":"2024-09-12T01:16:03.833288+0000","last_undegraded":"2024-09-12T01:16:03.833288+0000","last_fullsized":"2024-09-12T01:16:03.833288+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'877","last_scrub_stamp":"2024-09-12T01:16:03.833186+0000","last_deep_scrub":"267'877","last_deep_scrub_stamp":"2024-09-12T01:16:03.833186+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.833186+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:45.011515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4451,"num_read_kb":4025,"num_write":1186,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.692568+0000","last_change":"2024-09-12T01:15:58.692568+0000","last_active":"2024-09-12T01:15:58.692568+0000","last_peered":"2024-09-12T01:15:58.692568+0000","last_clean":"2024-09-12T01:15:58.692568+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T01:15:58.692568+0000","last_undegraded":"2024-09-12T01:15:58.692568+0000","last_fullsized":"2024-09-12T01:15:58.692568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:58.692481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:58.692481+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.692481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:48.738124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'216","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.934809+0000","last_change":"2024-09-12T01:15:54.934809+0000","last_active":"2024-09-12T01:15:54.934809+0000","last_peered":"2024-09-12T01:15:54.934809+0000","last_clean":"2024-09-12T01:15:54.934809+0000","last_became_active":"2024-09-12T00:02:48.057849+0000","last_became_peered":"2024-09-12T00:02:48.057849+0000","last_unstale":"2024-09-12T01:15:54.934809+0000","last_undegraded":"2024-09-12T01:15:54.934809+0000","last_fullsized":"2024-09-12T01:15:54.934809+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'216","last_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_deep_scrub":"267'216","last_deep_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.934711+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.315677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079943,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":138068,"num_write":1057,"num_write_kb":57312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.504352+0000","last_change":"2024-09-12T00:02:52.066638+0000","last_active":"2024-09-12T01:12:13.504352+0000","last_peered":"2024-09-12T01:12:13.504352+0000","last_clean":"2024-09-12T01:12:13.504352+0000","last_became_active":"2024-09-12T00:02:52.066352+0000","last_became_peered":"2024-09-12T00:02:52.066352+0000","last_unstale":"2024-09-12T01:12:13.504352+0000","last_undegraded":"2024-09-12T01:12:13.504352+0000","last_fullsized":"2024-09-12T01:12:13.504352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:43.605378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'939","reported_seq":2779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.281957+0000","last_change":"2024-09-12T00:02:54.070381+0000","last_active":"2024-09-12T01:15:48.281957+0000","last_peered":"2024-09-12T01:15:48.281957+0000","last_clean":"2024-09-12T01:15:48.281957+0000","last_became_active":"2024-09-12T00:02:54.070061+0000","last_became_peered":"2024-09-12T00:02:54.070061+0000","last_unstale":"2024-09-12T01:15:48.281957+0000","last_undegraded":"2024-09-12T01:15:48.281957+0000","last_fullsized":"2024-09-12T01:15:48.281957+0000","mapping_epoch":32,"log_start":"267'901","ondisk_log_start":"267'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":901,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:23.921978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20817,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1281,"num_read_kb":1476,"num_write":392,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.408111+0000","last_change":"2024-09-12T00:02:56.078956+0000","last_active":"2024-09-12T01:13:58.408111+0000","last_peered":"2024-09-12T01:13:58.408111+0000","last_clean":"2024-09-12T01:13:58.408111+0000","last_became_active":"2024-09-12T00:02:56.078658+0000","last_became_peered":"2024-09-12T00:02:56.078658+0000","last_unstale":"2024-09-12T01:13:58.408111+0000","last_undegraded":"2024-09-12T01:13:58.408111+0000","last_fullsized":"2024-09-12T01:13:58.408111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'171","reported_seq":753,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:33.233571+0000","last_change":"2024-09-12T00:02:58.089668+0000","last_active":"2024-09-12T01:12:33.233571+0000","last_peered":"2024-09-12T01:12:33.233571+0000","last_clean":"2024-09-12T01:12:33.233571+0000","last_became_active":"2024-09-12T00:02:58.089378+0000","last_became_peered":"2024-09-12T00:02:58.089378+0000","last_unstale":"2024-09-12T01:12:33.233571+0000","last_undegraded":"2024-09-12T01:12:33.233571+0000","last_fullsized":"2024-09-12T01:12:33.233571+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.424097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":336,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'1109","reported_seq":2834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.123960+0000","last_change":"2024-09-12T01:16:03.123960+0000","last_active":"2024-09-12T01:16:03.123960+0000","last_peered":"2024-09-12T01:16:03.123960+0000","last_clean":"2024-09-12T01:16:03.123960+0000","last_became_active":"2024-09-12T00:02:50.067002+0000","last_became_peered":"2024-09-12T00:02:50.067002+0000","last_unstale":"2024-09-12T01:16:03.123960+0000","last_undegraded":"2024-09-12T01:16:03.123960+0000","last_fullsized":"2024-09-12T01:16:03.123960+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1109","last_scrub_stamp":"2024-09-12T01:16:03.123868+0000","last_deep_scrub":"267'1109","last_deep_scrub_stamp":"2024-09-12T01:16:03.123868+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.123868+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":1000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.293606+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5247,"num_read_kb":4613,"num_write":1599,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":551,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.086300+0000","last_change":"2024-09-12T01:15:54.086300+0000","last_active":"2024-09-12T01:15:54.086300+0000","last_peered":"2024-09-12T01:15:54.086300+0000","last_clean":"2024-09-12T01:15:54.086300+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T01:15:54.086300+0000","last_undegraded":"2024-09-12T01:15:54.086300+0000","last_fullsized":"2024-09-12T01:15:54.086300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:54.086226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:54.086226+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.086226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:56.605178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'185","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.053418+0000","last_change":"2024-09-12T01:15:56.053418+0000","last_active":"2024-09-12T01:15:56.053418+0000","last_peered":"2024-09-12T01:15:56.053418+0000","last_clean":"2024-09-12T01:15:56.053418+0000","last_became_active":"2024-09-12T00:02:48.044126+0000","last_became_peered":"2024-09-12T00:02:48.044126+0000","last_unstale":"2024-09-12T01:15:56.053418+0000","last_undegraded":"2024-09-12T01:15:56.053418+0000","last_fullsized":"2024-09-12T01:15:56.053418+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:56.053326+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:56.053326+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.053326+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.310181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4751719,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":400,"num_read_kb":27065,"num_write":781,"num_write_kb":40333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.261538+0000","last_change":"2024-09-12T01:16:05.261538+0000","last_active":"2024-09-12T01:16:05.261538+0000","last_peered":"2024-09-12T01:16:05.261538+0000","last_clean":"2024-09-12T01:16:05.261538+0000","last_became_active":"2024-09-12T00:02:52.068351+0000","last_became_peered":"2024-09-12T00:02:52.068351+0000","last_unstale":"2024-09-12T01:16:05.261538+0000","last_undegraded":"2024-09-12T01:16:05.261538+0000","last_fullsized":"2024-09-12T01:16:05.261538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:05.261339+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:05.261339+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.261339+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:53.809383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'302","reported_seq":1733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:11.036867+0000","last_change":"2024-09-12T00:02:54.241862+0000","last_active":"2024-09-12T01:15:11.036867+0000","last_peered":"2024-09-12T01:15:11.036867+0000","last_clean":"2024-09-12T01:15:11.036867+0000","last_became_active":"2024-09-12T00:02:54.241581+0000","last_became_peered":"2024-09-12T00:02:54.241581+0000","last_unstale":"2024-09-12T01:15:11.036867+0000","last_undegraded":"2024-09-12T01:15:11.036867+0000","last_fullsized":"2024-09-12T01:15:11.036867+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":254,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:45.250159+0000","last_change":"2024-09-12T00:02:56.081949+0000","last_active":"2024-09-12T01:13:45.250159+0000","last_peered":"2024-09-12T01:13:45.250159+0000","last_clean":"2024-09-12T01:13:45.250159+0000","last_became_active":"2024-09-12T00:02:56.081641+0000","last_became_peered":"2024-09-12T00:02:56.081641+0000","last_unstale":"2024-09-12T01:13:45.250159+0000","last_undegraded":"2024-09-12T01:13:45.250159+0000","last_fullsized":"2024-09-12T01:13:45.250159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:16.553415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'273","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.410516+0000","last_change":"2024-09-12T00:02:58.088758+0000","last_active":"2024-09-12T01:14:04.410516+0000","last_peered":"2024-09-12T01:14:04.410516+0000","last_clean":"2024-09-12T01:14:04.410516+0000","last_became_active":"2024-09-12T00:02:58.088442+0000","last_became_peered":"2024-09-12T00:02:58.088442+0000","last_unstale":"2024-09-12T01:14:04.410516+0000","last_undegraded":"2024-09-12T01:14:04.410516+0000","last_fullsized":"2024-09-12T01:14:04.410516+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:27.430742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":615,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'439","reported_seq":2023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.247891+0000","last_change":"2024-09-12T01:16:10.247891+0000","last_active":"2024-09-12T01:16:10.247891+0000","last_peered":"2024-09-12T01:16:10.247891+0000","last_clean":"2024-09-12T01:16:10.247891+0000","last_became_active":"2024-09-12T00:03:21.140691+0000","last_became_peered":"2024-09-12T00:03:21.140691+0000","last_unstale":"2024-09-12T01:16:10.247891+0000","last_undegraded":"2024-09-12T01:16:10.247891+0000","last_fullsized":"2024-09-12T01:16:10.247891+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'439","last_scrub_stamp":"2024-09-12T01:16:10.247775+0000","last_deep_scrub":"267'439","last_deep_scrub_stamp":"2024-09-12T01:16:10.247775+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.247775+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:43.615955+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2439,"num_read_kb":2322,"num_write":494,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.160871+0000","last_change":"2024-09-12T01:15:56.160871+0000","last_active":"2024-09-12T01:15:56.160871+0000","last_peered":"2024-09-12T01:15:56.160871+0000","last_clean":"2024-09-12T01:15:56.160871+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T01:15:56.160871+0000","last_undegraded":"2024-09-12T01:15:56.160871+0000","last_fullsized":"2024-09-12T01:15:56.160871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:15:56.160739+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:15:56.160739+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.160739+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:36.791017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'207","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.693700+0000","last_change":"2024-09-12T01:15:55.693700+0000","last_active":"2024-09-12T01:15:55.693700+0000","last_peered":"2024-09-12T01:15:55.693700+0000","last_clean":"2024-09-12T01:15:55.693700+0000","last_became_active":"2024-09-12T00:02:48.049260+0000","last_became_peered":"2024-09-12T00:02:48.049260+0000","last_unstale":"2024-09-12T01:15:55.693700+0000","last_undegraded":"2024-09-12T01:15:55.693700+0000","last_fullsized":"2024-09-12T01:15:55.693700+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-12T01:15:55.693558+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-12T01:15:55.693558+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.693558+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.593673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":103584,"num_write":943,"num_write_kb":20218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.641153+0000","last_change":"2024-09-12T01:16:12.641153+0000","last_active":"2024-09-12T01:16:12.641153+0000","last_peered":"2024-09-12T01:16:12.641153+0000","last_clean":"2024-09-12T01:16:12.641153+0000","last_became_active":"2024-09-12T00:02:52.066289+0000","last_became_peered":"2024-09-12T00:02:52.066289+0000","last_unstale":"2024-09-12T01:16:12.641153+0000","last_undegraded":"2024-09-12T01:16:12.641153+0000","last_fullsized":"2024-09-12T01:16:12.641153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:12.641053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:12.641053+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.641053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:37.049985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'159","reported_seq":725,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:02.202549+0000","last_change":"2024-09-12T00:02:54.067179+0000","last_active":"2024-09-12T01:15:02.202549+0000","last_peered":"2024-09-12T01:15:02.202549+0000","last_clean":"2024-09-12T01:15:02.202549+0000","last_became_active":"2024-09-12T00:02:54.066864+0000","last_became_peered":"2024-09-12T00:02:54.066864+0000","last_unstale":"2024-09-12T01:15:02.202549+0000","last_undegraded":"2024-09-12T01:15:02.202549+0000","last_fullsized":"2024-09-12T01:15:02.202549+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:34.036499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":203,"num_read_kb":195,"num_write":150,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.458972+0000","last_change":"2024-09-12T01:16:12.458972+0000","last_active":"2024-09-12T01:16:12.458972+0000","last_peered":"2024-09-12T01:16:12.458972+0000","last_clean":"2024-09-12T01:16:12.458972+0000","last_became_active":"2024-09-12T00:02:56.085437+0000","last_became_peered":"2024-09-12T00:02:56.085437+0000","last_unstale":"2024-09-12T01:16:12.458972+0000","last_undegraded":"2024-09-12T01:16:12.458972+0000","last_fullsized":"2024-09-12T01:16:12.458972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:12.458882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:12.458882+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.458882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:11.334322+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'109","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.524360+0000","last_change":"2024-09-12T00:02:58.095790+0000","last_active":"2024-09-12T01:14:28.524360+0000","last_peered":"2024-09-12T01:14:28.524360+0000","last_clean":"2024-09-12T01:14:28.524360+0000","last_became_active":"2024-09-12T00:02:58.095419+0000","last_became_peered":"2024-09-12T00:02:58.095419+0000","last_unstale":"2024-09-12T01:14:28.524360+0000","last_undegraded":"2024-09-12T01:14:28.524360+0000","last_fullsized":"2024-09-12T01:14:28.524360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.835201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":189,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'417","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.135125+0000","last_change":"2024-09-12T01:16:04.135125+0000","last_active":"2024-09-12T01:16:04.135125+0000","last_peered":"2024-09-12T01:16:04.135125+0000","last_clean":"2024-09-12T01:16:04.135125+0000","last_became_active":"2024-09-12T00:02:50.075209+0000","last_became_peered":"2024-09-12T00:02:50.075209+0000","last_unstale":"2024-09-12T01:16:04.135125+0000","last_undegraded":"2024-09-12T01:16:04.135125+0000","last_fullsized":"2024-09-12T01:16:04.135125+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'417","last_scrub_stamp":"2024-09-12T01:16:04.135003+0000","last_deep_scrub":"267'417","last_deep_scrub_stamp":"2024-09-12T01:16:04.135003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.135003+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.259816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2214,"num_read_kb":2093,"num_write":483,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'191","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.197783+0000","last_change":"2024-09-12T01:15:58.197783+0000","last_active":"2024-09-12T01:15:58.197783+0000","last_peered":"2024-09-12T01:15:58.197783+0000","last_clean":"2024-09-12T01:15:58.197783+0000","last_became_active":"2024-09-12T00:02:48.052751+0000","last_became_peered":"2024-09-12T00:02:48.052751+0000","last_unstale":"2024-09-12T01:15:58.197783+0000","last_undegraded":"2024-09-12T01:15:58.197783+0000","last_fullsized":"2024-09-12T01:15:58.197783+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'191","last_scrub_stamp":"2024-09-12T01:15:58.197662+0000","last_deep_scrub":"267'191","last_deep_scrub_stamp":"2024-09-12T01:15:58.197662+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.197662+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:11.307806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493417,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":26295,"num_write":910,"num_write_kb":36863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.106575+0000","last_change":"2024-09-12T01:15:54.106575+0000","last_active":"2024-09-12T01:15:54.106575+0000","last_peered":"2024-09-12T01:15:54.106575+0000","last_clean":"2024-09-12T01:15:54.106575+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T01:15:54.106575+0000","last_undegraded":"2024-09-12T01:15:54.106575+0000","last_fullsized":"2024-09-12T01:15:54.106575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:54.106483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:54.106483+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.106483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:20.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.681070+0000","last_change":"2024-09-12T01:16:11.681070+0000","last_active":"2024-09-12T01:16:11.681070+0000","last_peered":"2024-09-12T01:16:11.681070+0000","last_clean":"2024-09-12T01:16:11.681070+0000","last_became_active":"2024-09-12T00:02:52.067200+0000","last_became_peered":"2024-09-12T00:02:52.067200+0000","last_unstale":"2024-09-12T01:16:11.681070+0000","last_undegraded":"2024-09-12T01:16:11.681070+0000","last_fullsized":"2024-09-12T01:16:11.681070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:11.680981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:11.680981+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.680981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:51.075341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'316","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.694954+0000","last_change":"2024-09-12T01:16:14.694954+0000","last_active":"2024-09-12T01:16:14.694954+0000","last_peered":"2024-09-12T01:16:14.694954+0000","last_clean":"2024-09-12T01:16:14.694954+0000","last_became_active":"2024-09-12T00:02:54.069071+0000","last_became_peered":"2024-09-12T00:02:54.069071+0000","last_unstale":"2024-09-12T01:16:14.694954+0000","last_undegraded":"2024-09-12T01:16:14.694954+0000","last_fullsized":"2024-09-12T01:16:14.694954+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'316","last_scrub_stamp":"2024-09-12T01:16:14.694854+0000","last_deep_scrub":"267'316","last_deep_scrub_stamp":"2024-09-12T01:16:14.694854+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.694854+0000","objects_scrubbed":11,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:57.933950+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":450,"num_read_kb":594,"num_write":258,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.258551+0000","last_change":"2024-09-12T00:02:56.082353+0000","last_active":"2024-09-12T01:13:48.258551+0000","last_peered":"2024-09-12T01:13:48.258551+0000","last_clean":"2024-09-12T01:13:48.258551+0000","last_became_active":"2024-09-12T00:02:56.082046+0000","last_became_peered":"2024-09-12T00:02:56.082046+0000","last_unstale":"2024-09-12T01:13:48.258551+0000","last_undegraded":"2024-09-12T01:13:48.258551+0000","last_fullsized":"2024-09-12T01:13:48.258551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:22.021250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'163","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.352871+0000","last_change":"2024-09-12T00:02:58.091879+0000","last_active":"2024-09-12T01:14:00.352871+0000","last_peered":"2024-09-12T01:14:00.352871+0000","last_clean":"2024-09-12T01:14:00.352871+0000","last_became_active":"2024-09-12T00:02:58.091590+0000","last_became_peered":"2024-09-12T00:02:58.091590+0000","last_unstale":"2024-09-12T01:14:00.352871+0000","last_undegraded":"2024-09-12T01:14:00.352871+0000","last_fullsized":"2024-09-12T01:14:00.352871+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:04.868329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1150,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":174,"num_write":425,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'452","reported_seq":2003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.829586+0000","last_change":"2024-09-12T01:16:02.829586+0000","last_active":"2024-09-12T01:16:02.829586+0000","last_peered":"2024-09-12T01:16:02.829586+0000","last_clean":"2024-09-12T01:16:02.829586+0000","last_became_active":"2024-09-12T00:02:50.073262+0000","last_became_peered":"2024-09-12T00:02:50.073262+0000","last_unstale":"2024-09-12T01:16:02.829586+0000","last_undegraded":"2024-09-12T01:16:02.829586+0000","last_fullsized":"2024-09-12T01:16:02.829586+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'452","last_scrub_stamp":"2024-09-12T01:16:02.829503+0000","last_deep_scrub":"267'452","last_deep_scrub_stamp":"2024-09-12T01:16:02.829503+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.829503+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:27.994764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2298,"num_read_kb":2165,"num_write":516,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'158","reported_seq":798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.086308+0000","last_change":"2024-09-12T01:15:57.086308+0000","last_active":"2024-09-12T01:15:57.086308+0000","last_peered":"2024-09-12T01:15:57.086308+0000","last_clean":"2024-09-12T01:15:57.086308+0000","last_became_active":"2024-09-12T00:02:48.052768+0000","last_became_peered":"2024-09-12T00:02:48.052768+0000","last_unstale":"2024-09-12T01:15:57.086308+0000","last_undegraded":"2024-09-12T01:15:57.086308+0000","last_fullsized":"2024-09-12T01:15:57.086308+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:15:57.086208+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:15:57.086208+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.086208+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:33.822235+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3687654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":16851,"num_write":770,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.680047+0000","last_change":"2024-09-12T01:15:57.680047+0000","last_active":"2024-09-12T01:15:57.680047+0000","last_peered":"2024-09-12T01:15:57.680047+0000","last_clean":"2024-09-12T01:15:57.680047+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T01:15:57.680047+0000","last_undegraded":"2024-09-12T01:15:57.680047+0000","last_fullsized":"2024-09-12T01:15:57.680047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:57.679926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:57.679926+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.679926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:28.341226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.404382+0000","last_change":"2024-09-12T01:16:09.404382+0000","last_active":"2024-09-12T01:16:09.404382+0000","last_peered":"2024-09-12T01:16:09.404382+0000","last_clean":"2024-09-12T01:16:09.404382+0000","last_became_active":"2024-09-12T00:02:52.069469+0000","last_became_peered":"2024-09-12T00:02:52.069469+0000","last_unstale":"2024-09-12T01:16:09.404382+0000","last_undegraded":"2024-09-12T01:16:09.404382+0000","last_fullsized":"2024-09-12T01:16:09.404382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.404244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.404244+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.404244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:48.154706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'259","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.188900+0000","last_change":"2024-09-12T00:02:54.240228+0000","last_active":"2024-09-12T01:14:02.188900+0000","last_peered":"2024-09-12T01:14:02.188900+0000","last_clean":"2024-09-12T01:14:02.188900+0000","last_became_active":"2024-09-12T00:02:54.239879+0000","last_became_peered":"2024-09-12T00:02:54.239879+0000","last_unstale":"2024-09-12T01:14:02.188900+0000","last_undegraded":"2024-09-12T01:14:02.188900+0000","last_fullsized":"2024-09-12T01:14:02.188900+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:03.113532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":332,"num_read_kb":322,"num_write":304,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'793","reported_seq":5263,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.252240+0000","last_change":"2024-09-12T00:02:56.087559+0000","last_active":"2024-09-12T01:15:48.252240+0000","last_peered":"2024-09-12T01:15:48.252240+0000","last_clean":"2024-09-12T01:15:48.252240+0000","last_became_active":"2024-09-12T00:02:56.086704+0000","last_became_peered":"2024-09-12T00:02:56.086704+0000","last_unstale":"2024-09-12T01:15:48.252240+0000","last_undegraded":"2024-09-12T01:15:48.252240+0000","last_fullsized":"2024-09-12T01:15:48.252240+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:41.420237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'152","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:08.251702+0000","last_change":"2024-09-12T00:02:58.091748+0000","last_active":"2024-09-12T01:15:08.251702+0000","last_peered":"2024-09-12T01:15:08.251702+0000","last_clean":"2024-09-12T01:15:08.251702+0000","last_became_active":"2024-09-12T00:02:58.091466+0000","last_became_peered":"2024-09-12T00:02:58.091466+0000","last_unstale":"2024-09-12T01:15:08.251702+0000","last_undegraded":"2024-09-12T01:15:08.251702+0000","last_fullsized":"2024-09-12T01:15:08.251702+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:19.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":335,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'992","reported_seq":2663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.642819+0000","last_change":"2024-09-12T01:16:05.642819+0000","last_active":"2024-09-12T01:16:05.642819+0000","last_peered":"2024-09-12T01:16:05.642819+0000","last_clean":"2024-09-12T01:16:05.642819+0000","last_became_active":"2024-09-12T00:02:50.067868+0000","last_became_peered":"2024-09-12T00:02:50.067868+0000","last_unstale":"2024-09-12T01:16:05.642819+0000","last_undegraded":"2024-09-12T01:16:05.642819+0000","last_fullsized":"2024-09-12T01:16:05.642819+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'992","last_scrub_stamp":"2024-09-12T01:16:05.642648+0000","last_deep_scrub":"267'992","last_deep_scrub_stamp":"2024-09-12T01:16:05.642648+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.642648+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":900,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.830523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4764,"num_read_kb":4246,"num_write":1341,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'174","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.765840+0000","last_change":"2024-09-12T01:15:54.765840+0000","last_active":"2024-09-12T01:15:54.765840+0000","last_peered":"2024-09-12T01:15:54.765840+0000","last_clean":"2024-09-12T01:15:54.765840+0000","last_became_active":"2024-09-12T00:02:48.052431+0000","last_became_peered":"2024-09-12T00:02:48.052431+0000","last_unstale":"2024-09-12T01:15:54.765840+0000","last_undegraded":"2024-09-12T01:15:54.765840+0000","last_fullsized":"2024-09-12T01:15:54.765840+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-12T01:15:54.765727+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-12T01:15:54.765727+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.765727+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:58.196722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1211576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":121623,"num_write":832,"num_write_kb":33084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.074456+0000","last_change":"2024-09-12T01:15:55.074456+0000","last_active":"2024-09-12T01:15:55.074456+0000","last_peered":"2024-09-12T01:15:55.074456+0000","last_clean":"2024-09-12T01:15:55.074456+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T01:15:55.074456+0000","last_undegraded":"2024-09-12T01:15:55.074456+0000","last_fullsized":"2024-09-12T01:15:55.074456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:55.074392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:55.074392+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.074392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:33.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257884+0000","last_change":"2024-09-12T00:02:52.062924+0000","last_active":"2024-09-12T01:13:43.257884+0000","last_peered":"2024-09-12T01:13:43.257884+0000","last_clean":"2024-09-12T01:13:43.257884+0000","last_became_active":"2024-09-12T00:02:52.062631+0000","last_became_peered":"2024-09-12T00:02:52.062631+0000","last_unstale":"2024-09-12T01:13:43.257884+0000","last_undegraded":"2024-09-12T01:13:43.257884+0000","last_fullsized":"2024-09-12T01:13:43.257884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:03.938023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'137","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:43.257905+0000","last_change":"2024-09-12T00:02:54.069239+0000","last_active":"2024-09-12T01:13:43.257905+0000","last_peered":"2024-09-12T01:13:43.257905+0000","last_clean":"2024-09-12T01:13:43.257905+0000","last_became_active":"2024-09-12T00:02:54.068812+0000","last_became_peered":"2024-09-12T00:02:54.068812+0000","last_unstale":"2024-09-12T01:13:43.257905+0000","last_undegraded":"2024-09-12T01:13:43.257905+0000","last_fullsized":"2024-09-12T01:13:43.257905+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:58.060604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":169,"num_write":118,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'808","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.306703+0000","last_change":"2024-09-12T00:02:56.084227+0000","last_active":"2024-09-12T01:15:48.306703+0000","last_peered":"2024-09-12T01:15:48.306703+0000","last_clean":"2024-09-12T01:15:48.306703+0000","last_became_active":"2024-09-12T00:02:56.083894+0000","last_became_peered":"2024-09-12T00:02:56.083894+0000","last_unstale":"2024-09-12T01:15:48.306703+0000","last_undegraded":"2024-09-12T01:15:48.306703+0000","last_fullsized":"2024-09-12T01:15:48.306703+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:40.096034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'273","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:45.242702+0000","last_change":"2024-09-12T00:02:58.093731+0000","last_active":"2024-09-12T01:12:45.242702+0000","last_peered":"2024-09-12T01:12:45.242702+0000","last_clean":"2024-09-12T01:12:45.242702+0000","last_became_active":"2024-09-12T00:02:58.093442+0000","last_became_peered":"2024-09-12T00:02:58.093442+0000","last_unstale":"2024-09-12T01:12:45.242702+0000","last_undegraded":"2024-09-12T01:12:45.242702+0000","last_fullsized":"2024-09-12T01:12:45.242702+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:58.495113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":340,"num_read_kb":339,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'414","reported_seq":1929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.721059+0000","last_change":"2024-09-12T01:16:01.721059+0000","last_active":"2024-09-12T01:16:01.721059+0000","last_peered":"2024-09-12T01:16:01.721059+0000","last_clean":"2024-09-12T01:16:01.721059+0000","last_became_active":"2024-09-12T00:02:50.057999+0000","last_became_peered":"2024-09-12T00:02:50.057999+0000","last_unstale":"2024-09-12T01:16:01.721059+0000","last_undegraded":"2024-09-12T01:16:01.721059+0000","last_fullsized":"2024-09-12T01:16:01.721059+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-12T01:16:01.720958+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-12T01:16:01.720958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.720958+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:36.846886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2267,"num_read_kb":2133,"num_write":493,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'270","reported_seq":960,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:53.943324+0000","last_change":"2024-09-12T01:15:53.943324+0000","last_active":"2024-09-12T01:15:53.943324+0000","last_peered":"2024-09-12T01:15:53.943324+0000","last_clean":"2024-09-12T01:15:53.943324+0000","last_became_active":"2024-09-12T00:02:48.051495+0000","last_became_peered":"2024-09-12T00:02:48.051495+0000","last_unstale":"2024-09-12T01:15:53.943324+0000","last_undegraded":"2024-09-12T01:15:53.943324+0000","last_fullsized":"2024-09-12T01:15:53.943324+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_clean_scrub_stamp":"2024-09-12T01:15:53.943232+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:48.709674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598650,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":670,"num_read_kb":18611,"num_write":1220,"num_write_kb":43211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.519255+0000","last_change":"2024-09-12T01:16:00.519255+0000","last_active":"2024-09-12T01:16:00.519255+0000","last_peered":"2024-09-12T01:16:00.519255+0000","last_clean":"2024-09-12T01:16:00.519255+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T01:16:00.519255+0000","last_undegraded":"2024-09-12T01:16:00.519255+0000","last_fullsized":"2024-09-12T01:16:00.519255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:00.519172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:00.519172+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.519172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:56.447826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455282+0000","last_change":"2024-09-12T00:02:52.062908+0000","last_active":"2024-09-12T01:12:58.455282+0000","last_peered":"2024-09-12T01:12:58.455282+0000","last_clean":"2024-09-12T01:12:58.455282+0000","last_became_active":"2024-09-12T00:02:52.062544+0000","last_became_peered":"2024-09-12T00:02:52.062544+0000","last_unstale":"2024-09-12T01:12:58.455282+0000","last_undegraded":"2024-09-12T01:12:58.455282+0000","last_fullsized":"2024-09-12T01:12:58.455282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:54.138905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'358","reported_seq":1105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.290569+0000","last_change":"2024-09-12T00:02:54.239678+0000","last_active":"2024-09-12T01:15:48.290569+0000","last_peered":"2024-09-12T01:15:48.290569+0000","last_clean":"2024-09-12T01:15:48.290569+0000","last_became_active":"2024-09-12T00:02:54.239355+0000","last_became_peered":"2024-09-12T00:02:54.239355+0000","last_unstale":"2024-09-12T01:15:48.290569+0000","last_undegraded":"2024-09-12T01:15:48.290569+0000","last_fullsized":"2024-09-12T01:15:48.290569+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:10.540534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":736,"num_write":272,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.240098+0000","last_change":"2024-09-12T00:02:56.087894+0000","last_active":"2024-09-12T01:13:48.240098+0000","last_peered":"2024-09-12T01:13:48.240098+0000","last_clean":"2024-09-12T01:13:48.240098+0000","last_became_active":"2024-09-12T00:02:56.087448+0000","last_became_peered":"2024-09-12T00:02:56.087448+0000","last_unstale":"2024-09-12T01:13:48.240098+0000","last_undegraded":"2024-09-12T01:13:48.240098+0000","last_fullsized":"2024-09-12T01:13:48.240098+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:19.357528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'125","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.291357+0000","last_change":"2024-09-12T00:02:58.100159+0000","last_active":"2024-09-12T01:12:58.291357+0000","last_peered":"2024-09-12T01:12:58.291357+0000","last_clean":"2024-09-12T01:12:58.291357+0000","last_became_active":"2024-09-12T00:02:58.099906+0000","last_became_peered":"2024-09-12T00:02:58.099906+0000","last_unstale":"2024-09-12T01:12:58.291357+0000","last_undegraded":"2024-09-12T01:12:58.291357+0000","last_fullsized":"2024-09-12T01:12:58.291357+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:36.467359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":140,"num_write":299,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'130","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.739979+0000","last_change":"2024-09-12T00:02:58.099964+0000","last_active":"2024-09-12T01:15:09.739979+0000","last_peered":"2024-09-12T01:15:09.739979+0000","last_clean":"2024-09-12T01:15:09.739979+0000","last_became_active":"2024-09-12T00:02:58.099564+0000","last_became_peered":"2024-09-12T00:02:58.099564+0000","last_unstale":"2024-09-12T01:15:09.739979+0000","last_undegraded":"2024-09-12T01:15:09.739979+0000","last_fullsized":"2024-09-12T01:15:09.739979+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":201,"num_write":295,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'832","reported_seq":2385,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.713433+0000","last_change":"2024-09-12T01:16:02.713433+0000","last_active":"2024-09-12T01:16:02.713433+0000","last_peered":"2024-09-12T01:16:02.713433+0000","last_clean":"2024-09-12T01:16:02.713433+0000","last_became_active":"2024-09-12T00:02:50.063351+0000","last_became_peered":"2024-09-12T00:02:50.063351+0000","last_unstale":"2024-09-12T01:16:02.713433+0000","last_undegraded":"2024-09-12T01:16:02.713433+0000","last_fullsized":"2024-09-12T01:16:02.713433+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'832","last_scrub_stamp":"2024-09-12T01:16:02.713331+0000","last_deep_scrub":"267'832","last_deep_scrub_stamp":"2024-09-12T01:16:02.713331+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.713331+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:01.106721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3851,"num_read_kb":3457,"num_write":1080,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'158","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.711008+0000","last_change":"2024-09-12T01:15:56.711008+0000","last_active":"2024-09-12T01:15:56.711008+0000","last_peered":"2024-09-12T01:15:56.711008+0000","last_clean":"2024-09-12T01:15:56.711008+0000","last_became_active":"2024-09-12T00:02:48.047723+0000","last_became_peered":"2024-09-12T00:02:48.047723+0000","last_unstale":"2024-09-12T01:15:56.711008+0000","last_undegraded":"2024-09-12T01:15:56.711008+0000","last_fullsized":"2024-09-12T01:15:56.711008+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:15:56.710861+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:15:56.710861+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.710861+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:41.398940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":26182,"num_write":818,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.127605+0000","last_change":"2024-09-12T01:16:09.127605+0000","last_active":"2024-09-12T01:16:09.127605+0000","last_peered":"2024-09-12T01:16:09.127605+0000","last_clean":"2024-09-12T01:16:09.127605+0000","last_became_active":"2024-09-12T00:02:52.066702+0000","last_became_peered":"2024-09-12T00:02:52.066702+0000","last_unstale":"2024-09-12T01:16:09.127605+0000","last_undegraded":"2024-09-12T01:16:09.127605+0000","last_fullsized":"2024-09-12T01:16:09.127605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.127494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.127494+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.127494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:35.855938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'196","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.171053+0000","last_change":"2024-09-12T00:02:54.067156+0000","last_active":"2024-09-12T01:15:48.171053+0000","last_peered":"2024-09-12T01:15:48.171053+0000","last_clean":"2024-09-12T01:15:48.171053+0000","last_became_active":"2024-09-12T00:02:54.066679+0000","last_became_peered":"2024-09-12T00:02:54.066679+0000","last_unstale":"2024-09-12T01:15:48.171053+0000","last_undegraded":"2024-09-12T01:15:48.171053+0000","last_fullsized":"2024-09-12T01:15:48.171053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:44.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":343,"num_write":152,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455258+0000","last_change":"2024-09-12T00:02:56.081781+0000","last_active":"2024-09-12T01:12:58.455258+0000","last_peered":"2024-09-12T01:12:58.455258+0000","last_clean":"2024-09-12T01:12:58.455258+0000","last_became_active":"2024-09-12T00:02:56.081445+0000","last_became_peered":"2024-09-12T00:02:56.081445+0000","last_unstale":"2024-09-12T01:12:58.455258+0000","last_undegraded":"2024-09-12T01:12:58.455258+0000","last_fullsized":"2024-09-12T01:12:58.455258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.185278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'151","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.456004+0000","last_change":"2024-09-12T00:02:58.097284+0000","last_active":"2024-09-12T01:13:03.456004+0000","last_peered":"2024-09-12T01:13:03.456004+0000","last_clean":"2024-09-12T01:13:03.456004+0000","last_became_active":"2024-09-12T00:02:58.096979+0000","last_became_peered":"2024-09-12T00:02:58.096979+0000","last_unstale":"2024-09-12T01:13:03.456004+0000","last_undegraded":"2024-09-12T01:13:03.456004+0000","last_fullsized":"2024-09-12T01:13:03.456004+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:10.194576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":142,"num_write":377,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'431","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.142244+0000","last_change":"2024-09-12T01:16:06.142244+0000","last_active":"2024-09-12T01:16:06.142244+0000","last_peered":"2024-09-12T01:16:06.142244+0000","last_clean":"2024-09-12T01:16:06.142244+0000","last_became_active":"2024-09-12T00:02:50.065307+0000","last_became_peered":"2024-09-12T00:02:50.065307+0000","last_unstale":"2024-09-12T01:16:06.142244+0000","last_undegraded":"2024-09-12T01:16:06.142244+0000","last_fullsized":"2024-09-12T01:16:06.142244+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'431","last_scrub_stamp":"2024-09-12T01:16:06.142162+0000","last_deep_scrub":"267'431","last_deep_scrub_stamp":"2024-09-12T01:16:06.142162+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.142162+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:57.029036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2299,"num_read_kb":2174,"num_write":505,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'162","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.721269+0000","last_change":"2024-09-12T01:16:02.721269+0000","last_active":"2024-09-12T01:16:02.721269+0000","last_peered":"2024-09-12T01:16:02.721269+0000","last_clean":"2024-09-12T01:16:02.721269+0000","last_became_active":"2024-09-12T00:02:48.048506+0000","last_became_peered":"2024-09-12T00:02:48.048506+0000","last_unstale":"2024-09-12T01:16:02.721269+0000","last_undegraded":"2024-09-12T01:16:02.721269+0000","last_fullsized":"2024-09-12T01:16:02.721269+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:02.721132+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:02.721132+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.721132+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:27.676261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":321,"num_read_kb":61867,"num_write":777,"num_write_kb":44911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.454749+0000","last_change":"2024-09-12T00:02:52.065265+0000","last_active":"2024-09-12T01:12:53.454749+0000","last_peered":"2024-09-12T01:12:53.454749+0000","last_clean":"2024-09-12T01:12:53.454749+0000","last_became_active":"2024-09-12T00:02:52.064967+0000","last_became_peered":"2024-09-12T00:02:52.064967+0000","last_unstale":"2024-09-12T01:12:53.454749+0000","last_undegraded":"2024-09-12T01:12:53.454749+0000","last_fullsized":"2024-09-12T01:12:53.454749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.210086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'59","reported_seq":576,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.171183+0000","last_change":"2024-09-12T00:02:54.067540+0000","last_active":"2024-09-12T01:13:29.171183+0000","last_peered":"2024-09-12T01:13:29.171183+0000","last_clean":"2024-09-12T01:13:29.171183+0000","last_became_active":"2024-09-12T00:02:54.067255+0000","last_became_peered":"2024-09-12T00:02:54.067255+0000","last_unstale":"2024-09-12T01:13:29.171183+0000","last_undegraded":"2024-09-12T01:13:29.171183+0000","last_fullsized":"2024-09-12T01:13:29.171183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:18.453952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399626+0000","last_change":"2024-09-12T00:02:56.079344+0000","last_active":"2024-09-12T01:12:58.399626+0000","last_peered":"2024-09-12T01:12:58.399626+0000","last_clean":"2024-09-12T01:12:58.399626+0000","last_became_active":"2024-09-12T00:02:56.079057+0000","last_became_peered":"2024-09-12T00:02:56.079057+0000","last_unstale":"2024-09-12T01:12:58.399626+0000","last_undegraded":"2024-09-12T01:12:58.399626+0000","last_fullsized":"2024-09-12T01:12:58.399626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:17.425376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'185","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.012822+0000","last_change":"2024-09-12T00:02:58.091784+0000","last_active":"2024-09-12T01:14:03.012822+0000","last_peered":"2024-09-12T01:14:03.012822+0000","last_clean":"2024-09-12T01:14:03.012822+0000","last_became_active":"2024-09-12T00:02:58.091505+0000","last_became_peered":"2024-09-12T00:02:58.091505+0000","last_unstale":"2024-09-12T01:14:03.012822+0000","last_undegraded":"2024-09-12T01:14:03.012822+0000","last_fullsized":"2024-09-12T01:14:03.012822+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:32.965615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":268,"num_read_kb":263,"num_write":396,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'447","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.608031+0000","last_change":"2024-09-12T01:16:06.608031+0000","last_active":"2024-09-12T01:16:06.608031+0000","last_peered":"2024-09-12T01:16:06.608031+0000","last_clean":"2024-09-12T01:16:06.608031+0000","last_became_active":"2024-09-12T00:02:50.068129+0000","last_became_peered":"2024-09-12T00:02:50.068129+0000","last_unstale":"2024-09-12T01:16:06.608031+0000","last_undegraded":"2024-09-12T01:16:06.608031+0000","last_fullsized":"2024-09-12T01:16:06.608031+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-12T01:16:06.607930+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-12T01:16:06.607930+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.607930+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:54.520447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2203,"num_read_kb":2070,"num_write":514,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'206","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.193472+0000","last_change":"2024-09-12T01:15:59.193472+0000","last_active":"2024-09-12T01:15:59.193472+0000","last_peered":"2024-09-12T01:15:59.193472+0000","last_clean":"2024-09-12T01:15:59.193472+0000","last_became_active":"2024-09-12T00:02:48.049791+0000","last_became_peered":"2024-09-12T00:02:48.049791+0000","last_unstale":"2024-09-12T01:15:59.193472+0000","last_undegraded":"2024-09-12T01:15:59.193472+0000","last_fullsized":"2024-09-12T01:15:59.193472+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'206","last_scrub_stamp":"2024-09-12T01:15:59.193369+0000","last_deep_scrub":"267'206","last_deep_scrub_stamp":"2024-09-12T01:15:59.193369+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.193369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:40.264107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":116478,"num_write":1001,"num_write_kb":35286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.398938+0000","last_change":"2024-09-12T00:02:52.071771+0000","last_active":"2024-09-12T01:12:53.398938+0000","last_peered":"2024-09-12T01:12:53.398938+0000","last_clean":"2024-09-12T01:12:53.398938+0000","last_became_active":"2024-09-12T00:02:52.071502+0000","last_became_peered":"2024-09-12T00:02:52.071502+0000","last_unstale":"2024-09-12T01:12:53.398938+0000","last_undegraded":"2024-09-12T01:12:53.398938+0000","last_fullsized":"2024-09-12T01:12:53.398938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:36.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'203","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.061053+0000","last_change":"2024-09-12T00:02:54.069300+0000","last_active":"2024-09-12T01:15:48.061053+0000","last_peered":"2024-09-12T01:15:48.061053+0000","last_clean":"2024-09-12T01:15:48.061053+0000","last_became_active":"2024-09-12T00:02:54.067314+0000","last_became_peered":"2024-09-12T00:02:54.067314+0000","last_unstale":"2024-09-12T01:15:48.061053+0000","last_undegraded":"2024-09-12T01:15:48.061053+0000","last_fullsized":"2024-09-12T01:15:48.061053+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:25.593409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18955,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":388,"num_write":160,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.616059+0000","last_change":"2024-09-12T00:02:56.084951+0000","last_active":"2024-09-12T01:12:58.616059+0000","last_peered":"2024-09-12T01:12:58.616059+0000","last_clean":"2024-09-12T01:12:58.616059+0000","last_became_active":"2024-09-12T00:02:56.084651+0000","last_became_peered":"2024-09-12T00:02:56.084651+0000","last_unstale":"2024-09-12T01:12:58.616059+0000","last_undegraded":"2024-09-12T01:12:58.616059+0000","last_fullsized":"2024-09-12T01:12:58.616059+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.763159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'155","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:05.706621+0000","last_change":"2024-09-12T00:02:58.100001+0000","last_active":"2024-09-12T01:13:05.706621+0000","last_peered":"2024-09-12T01:13:05.706621+0000","last_clean":"2024-09-12T01:13:05.706621+0000","last_became_active":"2024-09-12T00:02:58.099635+0000","last_became_peered":"2024-09-12T00:02:58.099635+0000","last_unstale":"2024-09-12T01:13:05.706621+0000","last_undegraded":"2024-09-12T01:13:05.706621+0000","last_fullsized":"2024-09-12T01:13:05.706621+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":359,"num_read_kb":309,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'638","reported_seq":2530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.622238+0000","last_change":"2024-09-12T01:16:07.622238+0000","last_active":"2024-09-12T01:16:07.622238+0000","last_peered":"2024-09-12T01:16:07.622238+0000","last_clean":"2024-09-12T01:16:07.622238+0000","last_became_active":"2024-09-12T00:02:50.068518+0000","last_became_peered":"2024-09-12T00:02:50.068518+0000","last_unstale":"2024-09-12T01:16:07.622238+0000","last_undegraded":"2024-09-12T01:16:07.622238+0000","last_fullsized":"2024-09-12T01:16:07.622238+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'638","last_scrub_stamp":"2024-09-12T01:16:07.622152+0000","last_deep_scrub":"267'638","last_deep_scrub_stamp":"2024-09-12T01:16:07.622152+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.622152+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:11.149565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3685,"num_read_kb":3433,"num_write":846,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'197","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.883669+0000","last_change":"2024-09-12T01:15:57.883669+0000","last_active":"2024-09-12T01:15:57.883669+0000","last_peered":"2024-09-12T01:15:57.883669+0000","last_clean":"2024-09-12T01:15:57.883669+0000","last_became_active":"2024-09-12T00:02:48.054056+0000","last_became_peered":"2024-09-12T00:02:48.054056+0000","last_unstale":"2024-09-12T01:15:57.883669+0000","last_undegraded":"2024-09-12T01:15:57.883669+0000","last_fullsized":"2024-09-12T01:15:57.883669+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'197","last_scrub_stamp":"2024-09-12T01:15:57.883525+0000","last_deep_scrub":"267'197","last_deep_scrub_stamp":"2024-09-12T01:15:57.883525+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.883525+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.780477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493919,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":69874,"num_write":900,"num_write_kb":25144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.392046+0000","last_change":"2024-09-12T01:16:10.392046+0000","last_active":"2024-09-12T01:16:10.392046+0000","last_peered":"2024-09-12T01:16:10.392046+0000","last_clean":"2024-09-12T01:16:10.392046+0000","last_became_active":"2024-09-12T00:02:52.064441+0000","last_became_peered":"2024-09-12T00:02:52.064441+0000","last_unstale":"2024-09-12T01:16:10.392046+0000","last_undegraded":"2024-09-12T01:16:10.392046+0000","last_fullsized":"2024-09-12T01:16:10.392046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.391958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.391958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.391958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:22.111524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'141","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.035158+0000","last_change":"2024-09-12T00:02:54.067331+0000","last_active":"2024-09-12T01:15:48.035158+0000","last_peered":"2024-09-12T01:15:48.035158+0000","last_clean":"2024-09-12T01:15:48.035158+0000","last_became_active":"2024-09-12T00:02:54.066900+0000","last_became_peered":"2024-09-12T00:02:54.066900+0000","last_unstale":"2024-09-12T01:15:48.035158+0000","last_undegraded":"2024-09-12T01:15:48.035158+0000","last_fullsized":"2024-09-12T01:15:48.035158+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:20.920036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243955+0000","last_change":"2024-09-12T00:02:56.085678+0000","last_active":"2024-09-12T01:12:55.243955+0000","last_peered":"2024-09-12T01:12:55.243955+0000","last_clean":"2024-09-12T01:12:55.243955+0000","last_became_active":"2024-09-12T00:02:56.084454+0000","last_became_peered":"2024-09-12T00:02:56.084454+0000","last_unstale":"2024-09-12T01:12:55.243955+0000","last_undegraded":"2024-09-12T01:12:55.243955+0000","last_fullsized":"2024-09-12T01:12:55.243955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.942660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'814","reported_seq":2296,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.492864+0000","last_change":"2024-09-12T01:16:06.492864+0000","last_active":"2024-09-12T01:16:06.492864+0000","last_peered":"2024-09-12T01:16:06.492864+0000","last_clean":"2024-09-12T01:16:06.492864+0000","last_became_active":"2024-09-12T00:02:50.072570+0000","last_became_peered":"2024-09-12T00:02:50.072570+0000","last_unstale":"2024-09-12T01:16:06.492864+0000","last_undegraded":"2024-09-12T01:16:06.492864+0000","last_fullsized":"2024-09-12T01:16:06.492864+0000","mapping_epoch":28,"log_start":"267'801","ondisk_log_start":"267'801","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'814","last_scrub_stamp":"2024-09-12T01:16:06.492765+0000","last_deep_scrub":"267'814","last_deep_scrub_stamp":"2024-09-12T01:16:06.492765+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.492765+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":801,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.698227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3795,"num_read_kb":3393,"num_write":1092,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1437,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'152","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.794883+0000","last_change":"2024-09-12T01:15:58.794883+0000","last_active":"2024-09-12T01:15:58.794883+0000","last_peered":"2024-09-12T01:15:58.794883+0000","last_clean":"2024-09-12T01:15:58.794883+0000","last_became_active":"2024-09-12T00:02:48.050025+0000","last_became_peered":"2024-09-12T00:02:48.050025+0000","last_unstale":"2024-09-12T01:15:58.794883+0000","last_undegraded":"2024-09-12T01:15:58.794883+0000","last_fullsized":"2024-09-12T01:15:58.794883+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:15:58.794742+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:15:58.794742+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.794742+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:46.260076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":278,"num_read_kb":9330,"num_write":746,"num_write_kb":34876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.683097+0000","last_change":"2024-09-12T01:16:13.683097+0000","last_active":"2024-09-12T01:16:13.683097+0000","last_peered":"2024-09-12T01:16:13.683097+0000","last_clean":"2024-09-12T01:16:13.683097+0000","last_became_active":"2024-09-12T00:02:52.071201+0000","last_became_peered":"2024-09-12T00:02:52.071201+0000","last_unstale":"2024-09-12T01:16:13.683097+0000","last_undegraded":"2024-09-12T01:16:13.683097+0000","last_fullsized":"2024-09-12T01:16:13.683097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.683003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.683003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.683003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:16.153780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'225","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.215655+0000","last_change":"2024-09-12T00:02:54.073975+0000","last_active":"2024-09-12T01:15:48.215655+0000","last_peered":"2024-09-12T01:15:48.215655+0000","last_clean":"2024-09-12T01:15:48.215655+0000","last_became_active":"2024-09-12T00:02:54.073541+0000","last_became_peered":"2024-09-12T00:02:54.073541+0000","last_unstale":"2024-09-12T01:15:48.215655+0000","last_undegraded":"2024-09-12T01:15:48.215655+0000","last_fullsized":"2024-09-12T01:15:48.215655+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:09.658572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15168,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":358,"num_read_kb":528,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.510916+0000","last_change":"2024-09-12T00:02:56.084926+0000","last_active":"2024-09-12T01:12:58.510916+0000","last_peered":"2024-09-12T01:12:58.510916+0000","last_clean":"2024-09-12T01:12:58.510916+0000","last_became_active":"2024-09-12T00:02:56.084627+0000","last_became_peered":"2024-09-12T00:02:56.084627+0000","last_unstale":"2024-09-12T01:12:58.510916+0000","last_undegraded":"2024-09-12T01:12:58.510916+0000","last_fullsized":"2024-09-12T01:12:58.510916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:48.546873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'184","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.259373+0000","last_change":"2024-09-12T00:02:58.090856+0000","last_active":"2024-09-12T01:14:04.259373+0000","last_peered":"2024-09-12T01:14:04.259373+0000","last_clean":"2024-09-12T01:14:04.259373+0000","last_became_active":"2024-09-12T00:02:58.089750+0000","last_became_peered":"2024-09-12T00:02:58.089750+0000","last_unstale":"2024-09-12T01:14:04.259373+0000","last_undegraded":"2024-09-12T01:14:04.259373+0000","last_fullsized":"2024-09-12T01:14:04.259373+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:39.825708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":234,"num_read_kb":235,"num_write":422,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'480","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.730708+0000","last_change":"2024-09-12T01:16:08.730708+0000","last_active":"2024-09-12T01:16:08.730708+0000","last_peered":"2024-09-12T01:16:08.730708+0000","last_clean":"2024-09-12T01:16:08.730708+0000","last_became_active":"2024-09-12T00:02:50.064157+0000","last_became_peered":"2024-09-12T00:02:50.064157+0000","last_unstale":"2024-09-12T01:16:08.730708+0000","last_undegraded":"2024-09-12T01:16:08.730708+0000","last_fullsized":"2024-09-12T01:16:08.730708+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'480","last_scrub_stamp":"2024-09-12T01:16:08.730614+0000","last_deep_scrub":"267'480","last_deep_scrub_stamp":"2024-09-12T01:16:08.730614+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.730614+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:57.895222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2183,"num_write":585,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1892,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'252","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.084847+0000","last_change":"2024-09-12T01:15:58.084847+0000","last_active":"2024-09-12T01:15:58.084847+0000","last_peered":"2024-09-12T01:15:58.084847+0000","last_clean":"2024-09-12T01:15:58.084847+0000","last_became_active":"2024-09-12T00:02:48.053055+0000","last_became_peered":"2024-09-12T00:02:48.053055+0000","last_unstale":"2024-09-12T01:15:58.084847+0000","last_undegraded":"2024-09-12T01:15:58.084847+0000","last_fullsized":"2024-09-12T01:15:58.084847+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'252","last_scrub_stamp":"2024-09-12T01:15:58.084728+0000","last_deep_scrub":"267'252","last_deep_scrub_stamp":"2024-09-12T01:15:58.084728+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.084728+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:42.507269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":662,"num_read_kb":2689,"num_write":1334,"num_write_kb":25481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.423609+0000","last_change":"2024-09-12T01:16:11.423609+0000","last_active":"2024-09-12T01:16:11.423609+0000","last_peered":"2024-09-12T01:16:11.423609+0000","last_clean":"2024-09-12T01:16:11.423609+0000","last_became_active":"2024-09-12T00:02:52.060034+0000","last_became_peered":"2024-09-12T00:02:52.060034+0000","last_unstale":"2024-09-12T01:16:11.423609+0000","last_undegraded":"2024-09-12T01:16:11.423609+0000","last_fullsized":"2024-09-12T01:16:11.423609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:11.423519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:11.423519+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.423519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:10.571986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'197","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.045639+0000","last_change":"2024-09-12T00:02:54.067256+0000","last_active":"2024-09-12T01:15:48.045639+0000","last_peered":"2024-09-12T01:15:48.045639+0000","last_clean":"2024-09-12T01:15:48.045639+0000","last_became_active":"2024-09-12T00:02:54.066854+0000","last_became_peered":"2024-09-12T00:02:54.066854+0000","last_unstale":"2024-09-12T01:15:48.045639+0000","last_undegraded":"2024-09-12T01:15:48.045639+0000","last_fullsized":"2024-09-12T01:15:48.045639+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:56.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":290,"num_read_kb":407,"num_write":194,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.236453+0000","last_change":"2024-09-12T00:02:56.086661+0000","last_active":"2024-09-12T01:12:58.236453+0000","last_peered":"2024-09-12T01:12:58.236453+0000","last_clean":"2024-09-12T01:12:58.236453+0000","last_became_active":"2024-09-12T00:02:56.086349+0000","last_became_peered":"2024-09-12T00:02:56.086349+0000","last_unstale":"2024-09-12T01:12:58.236453+0000","last_undegraded":"2024-09-12T01:12:58.236453+0000","last_fullsized":"2024-09-12T01:12:58.236453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:32.352621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'169","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.265206+0000","last_change":"2024-09-12T00:02:58.100935+0000","last_active":"2024-09-12T01:14:04.265206+0000","last_peered":"2024-09-12T01:14:04.265206+0000","last_clean":"2024-09-12T01:14:04.265206+0000","last_became_active":"2024-09-12T00:02:58.100646+0000","last_became_peered":"2024-09-12T00:02:58.100646+0000","last_unstale":"2024-09-12T01:14:04.265206+0000","last_undegraded":"2024-09-12T01:14:04.265206+0000","last_fullsized":"2024-09-12T01:14:04.265206+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:32.687456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":591,"num_write":465,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'697","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.619187+0000","last_change":"2024-09-12T01:16:10.619187+0000","last_active":"2024-09-12T01:16:10.619187+0000","last_peered":"2024-09-12T01:16:10.619187+0000","last_clean":"2024-09-12T01:16:10.619187+0000","last_became_active":"2024-09-12T00:02:50.072665+0000","last_became_peered":"2024-09-12T00:02:50.072665+0000","last_unstale":"2024-09-12T01:16:10.619187+0000","last_undegraded":"2024-09-12T01:16:10.619187+0000","last_fullsized":"2024-09-12T01:16:10.619187+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'697","last_scrub_stamp":"2024-09-12T01:16:10.619098+0000","last_deep_scrub":"267'697","last_deep_scrub_stamp":"2024-09-12T01:16:10.619098+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.619098+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:07.282926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3202,"num_read_kb":2877,"num_write":917,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'241","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.110405+0000","last_change":"2024-09-12T01:15:56.110405+0000","last_active":"2024-09-12T01:15:56.110405+0000","last_peered":"2024-09-12T01:15:56.110405+0000","last_clean":"2024-09-12T01:15:56.110405+0000","last_became_active":"2024-09-12T00:03:21.140095+0000","last_became_peered":"2024-09-12T00:03:21.140095+0000","last_unstale":"2024-09-12T01:15:56.110405+0000","last_undegraded":"2024-09-12T01:15:56.110405+0000","last_fullsized":"2024-09-12T01:15:56.110405+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-12T01:15:56.110316+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-12T01:15:56.110316+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.110316+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:39.287721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":39289,"num_write":1009,"num_write_kb":58524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397483+0000","last_change":"2024-09-12T00:02:52.063849+0000","last_active":"2024-09-12T01:12:53.397483+0000","last_peered":"2024-09-12T01:12:53.397483+0000","last_clean":"2024-09-12T01:12:53.397483+0000","last_became_active":"2024-09-12T00:02:52.063334+0000","last_became_peered":"2024-09-12T00:02:52.063334+0000","last_unstale":"2024-09-12T01:12:53.397483+0000","last_undegraded":"2024-09-12T01:12:53.397483+0000","last_fullsized":"2024-09-12T01:12:53.397483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:03.747256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.197503+0000","last_change":"2024-09-12T00:02:54.240449+0000","last_active":"2024-09-12T01:15:48.197503+0000","last_peered":"2024-09-12T01:15:48.197503+0000","last_clean":"2024-09-12T01:15:48.197503+0000","last_became_active":"2024-09-12T00:02:54.240007+0000","last_became_peered":"2024-09-12T00:02:54.240007+0000","last_unstale":"2024-09-12T01:15:48.197503+0000","last_undegraded":"2024-09-12T01:15:48.197503+0000","last_fullsized":"2024-09-12T01:15:48.197503+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:58.601042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":288,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.238159+0000","last_change":"2024-09-12T00:02:56.087660+0000","last_active":"2024-09-12T01:13:13.238159+0000","last_peered":"2024-09-12T01:13:13.238159+0000","last_clean":"2024-09-12T01:13:13.238159+0000","last_became_active":"2024-09-12T00:02:56.087317+0000","last_became_peered":"2024-09-12T00:02:56.087317+0000","last_unstale":"2024-09-12T01:13:13.238159+0000","last_undegraded":"2024-09-12T01:13:13.238159+0000","last_fullsized":"2024-09-12T01:13:13.238159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:30.847202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'148","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:10.905755+0000","last_change":"2024-09-12T00:02:58.099988+0000","last_active":"2024-09-12T01:15:10.905755+0000","last_peered":"2024-09-12T01:15:10.905755+0000","last_clean":"2024-09-12T01:15:10.905755+0000","last_became_active":"2024-09-12T00:02:58.099712+0000","last_became_peered":"2024-09-12T00:02:58.099712+0000","last_unstale":"2024-09-12T01:15:10.905755+0000","last_undegraded":"2024-09-12T01:15:10.905755+0000","last_fullsized":"2024-09-12T01:15:10.905755+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:28.021756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'710","reported_seq":2420,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.262576+0000","last_change":"2024-09-12T01:16:02.262576+0000","last_active":"2024-09-12T01:16:02.262576+0000","last_peered":"2024-09-12T01:16:02.262576+0000","last_clean":"2024-09-12T01:16:02.262576+0000","last_became_active":"2024-09-12T00:02:50.061909+0000","last_became_peered":"2024-09-12T00:02:50.061909+0000","last_unstale":"2024-09-12T01:16:02.262576+0000","last_undegraded":"2024-09-12T01:16:02.262576+0000","last_fullsized":"2024-09-12T01:16:02.262576+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'710","last_scrub_stamp":"2024-09-12T01:16:02.262485+0000","last_deep_scrub":"267'710","last_deep_scrub_stamp":"2024-09-12T01:16:02.262485+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.262485+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":600,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:26.931797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3690,"num_read_kb":3334,"num_write":961,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1922,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'201","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.918024+0000","last_change":"2024-09-12T01:15:56.918024+0000","last_active":"2024-09-12T01:15:56.918024+0000","last_peered":"2024-09-12T01:15:56.918024+0000","last_clean":"2024-09-12T01:15:56.918024+0000","last_became_active":"2024-09-12T00:02:48.050894+0000","last_became_peered":"2024-09-12T00:02:48.050894+0000","last_unstale":"2024-09-12T01:15:56.918024+0000","last_undegraded":"2024-09-12T01:15:56.918024+0000","last_fullsized":"2024-09-12T01:15:56.918024+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:15:56.917926+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:15:56.917926+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.917926+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:57.174009+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409979,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":20890,"num_write":1012,"num_write_kb":39832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.203493+0000","last_change":"2024-09-12T01:16:13.203493+0000","last_active":"2024-09-12T01:16:13.203493+0000","last_peered":"2024-09-12T01:16:13.203493+0000","last_clean":"2024-09-12T01:16:13.203493+0000","last_became_active":"2024-09-12T00:02:52.064125+0000","last_became_peered":"2024-09-12T00:02:52.064125+0000","last_unstale":"2024-09-12T01:16:13.203493+0000","last_undegraded":"2024-09-12T01:16:13.203493+0000","last_fullsized":"2024-09-12T01:16:13.203493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.203371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.203371+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.203371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:07.040646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'111","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:29.555449+0000","last_change":"2024-09-12T00:02:54.239923+0000","last_active":"2024-09-12T01:13:29.555449+0000","last_peered":"2024-09-12T01:13:29.555449+0000","last_clean":"2024-09-12T01:13:29.555449+0000","last_became_active":"2024-09-12T00:02:54.239412+0000","last_became_peered":"2024-09-12T00:02:54.239412+0000","last_unstale":"2024-09-12T01:13:29.555449+0000","last_undegraded":"2024-09-12T01:13:29.555449+0000","last_fullsized":"2024-09-12T01:13:29.555449+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.570833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'772","reported_seq":2646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.301474+0000","last_change":"2024-09-12T00:02:56.080694+0000","last_active":"2024-09-12T01:15:48.301474+0000","last_peered":"2024-09-12T01:15:48.301474+0000","last_clean":"2024-09-12T01:15:48.301474+0000","last_became_active":"2024-09-12T00:02:56.080374+0000","last_became_peered":"2024-09-12T00:02:56.080374+0000","last_unstale":"2024-09-12T01:15:48.301474+0000","last_undegraded":"2024-09-12T01:15:48.301474+0000","last_fullsized":"2024-09-12T01:15:48.301474+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:02.095265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'116","reported_seq":621,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.399596+0000","last_change":"2024-09-12T00:02:58.101477+0000","last_active":"2024-09-12T01:12:58.399596+0000","last_peered":"2024-09-12T01:12:58.399596+0000","last_clean":"2024-09-12T01:12:58.399596+0000","last_became_active":"2024-09-12T00:02:58.100777+0000","last_became_peered":"2024-09-12T00:02:58.100777+0000","last_unstale":"2024-09-12T01:12:58.399596+0000","last_undegraded":"2024-09-12T01:12:58.399596+0000","last_fullsized":"2024-09-12T01:12:58.399596+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:03.981795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'476","reported_seq":2046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.851836+0000","last_change":"2024-09-12T01:16:06.851836+0000","last_active":"2024-09-12T01:16:06.851836+0000","last_peered":"2024-09-12T01:16:06.851836+0000","last_clean":"2024-09-12T01:16:06.851836+0000","last_became_active":"2024-09-12T00:02:50.070186+0000","last_became_peered":"2024-09-12T00:02:50.070186+0000","last_unstale":"2024-09-12T01:16:06.851836+0000","last_undegraded":"2024-09-12T01:16:06.851836+0000","last_fullsized":"2024-09-12T01:16:06.851836+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'476","last_scrub_stamp":"2024-09-12T01:16:06.851723+0000","last_deep_scrub":"267'476","last_deep_scrub_stamp":"2024-09-12T01:16:06.851723+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.851723+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:58.941621+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2560,"num_read_kb":2381,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'280","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.159485+0000","last_change":"2024-09-12T01:16:01.159485+0000","last_active":"2024-09-12T01:16:01.159485+0000","last_peered":"2024-09-12T01:16:01.159485+0000","last_clean":"2024-09-12T01:16:01.159485+0000","last_became_active":"2024-09-12T00:02:48.054303+0000","last_became_peered":"2024-09-12T00:02:48.054303+0000","last_unstale":"2024-09-12T01:16:01.159485+0000","last_undegraded":"2024-09-12T01:16:01.159485+0000","last_fullsized":"2024-09-12T01:16:01.159485+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'280","last_scrub_stamp":"2024-09-12T01:16:01.159368+0000","last_deep_scrub":"267'280","last_deep_scrub_stamp":"2024-09-12T01:16:01.159368+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.159368+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:04.113014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":47582,"num_write":1191,"num_write_kb":28572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399009+0000","last_change":"2024-09-12T00:02:52.071857+0000","last_active":"2024-09-12T01:12:53.399009+0000","last_peered":"2024-09-12T01:12:53.399009+0000","last_clean":"2024-09-12T01:12:53.399009+0000","last_became_active":"2024-09-12T00:02:52.071580+0000","last_became_peered":"2024-09-12T00:02:52.071580+0000","last_unstale":"2024-09-12T01:12:53.399009+0000","last_undegraded":"2024-09-12T01:12:53.399009+0000","last_fullsized":"2024-09-12T01:12:53.399009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:15.575099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'229","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.250455+0000","last_change":"2024-09-12T00:02:54.069107+0000","last_active":"2024-09-12T01:15:48.250455+0000","last_peered":"2024-09-12T01:15:48.250455+0000","last_clean":"2024-09-12T01:15:48.250455+0000","last_became_active":"2024-09-12T00:02:54.068806+0000","last_became_peered":"2024-09-12T00:02:54.068806+0000","last_unstale":"2024-09-12T01:15:48.250455+0000","last_undegraded":"2024-09-12T01:15:48.250455+0000","last_fullsized":"2024-09-12T01:15:48.250455+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:03.065780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9605,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":355,"num_write":182,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244538+0000","last_change":"2024-09-12T00:02:56.083225+0000","last_active":"2024-09-12T01:13:00.244538+0000","last_peered":"2024-09-12T01:13:00.244538+0000","last_clean":"2024-09-12T01:13:00.244538+0000","last_became_active":"2024-09-12T00:02:56.082924+0000","last_became_peered":"2024-09-12T00:02:56.082924+0000","last_unstale":"2024-09-12T01:13:00.244538+0000","last_undegraded":"2024-09-12T01:13:00.244538+0000","last_fullsized":"2024-09-12T01:13:00.244538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:14.433764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'109","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:04.113160+0000","last_change":"2024-09-12T00:02:58.099967+0000","last_active":"2024-09-12T01:14:04.113160+0000","last_peered":"2024-09-12T01:14:04.113160+0000","last_clean":"2024-09-12T01:14:04.113160+0000","last_became_active":"2024-09-12T00:02:58.099683+0000","last_became_peered":"2024-09-12T00:02:58.099683+0000","last_unstale":"2024-09-12T01:14:04.113160+0000","last_undegraded":"2024-09-12T01:14:04.113160+0000","last_fullsized":"2024-09-12T01:14:04.113160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:14.241268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":199,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'542","reported_seq":2277,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.811930+0000","last_change":"2024-09-12T01:16:05.811930+0000","last_active":"2024-09-12T01:16:05.811930+0000","last_peered":"2024-09-12T01:16:05.811930+0000","last_clean":"2024-09-12T01:16:05.811930+0000","last_became_active":"2024-09-12T00:02:50.069907+0000","last_became_peered":"2024-09-12T00:02:50.069907+0000","last_unstale":"2024-09-12T01:16:05.811930+0000","last_undegraded":"2024-09-12T01:16:05.811930+0000","last_fullsized":"2024-09-12T01:16:05.811930+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'542","last_scrub_stamp":"2024-09-12T01:16:05.811845+0000","last_deep_scrub":"267'542","last_deep_scrub_stamp":"2024-09-12T01:16:05.811845+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.811845+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:24.596886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2946,"num_read_kb":2752,"num_write":643,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2534,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'210","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.207922+0000","last_change":"2024-09-12T01:16:02.207922+0000","last_active":"2024-09-12T01:16:02.207922+0000","last_peered":"2024-09-12T01:16:02.207922+0000","last_clean":"2024-09-12T01:16:02.207922+0000","last_became_active":"2024-09-12T00:02:48.052303+0000","last_became_peered":"2024-09-12T00:02:48.052303+0000","last_unstale":"2024-09-12T01:16:02.207922+0000","last_undegraded":"2024-09-12T01:16:02.207922+0000","last_fullsized":"2024-09-12T01:16:02.207922+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:16:02.207773+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:16:02.207773+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.207773+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:42.794663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":51729,"num_write":985,"num_write_kb":45446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510194+0000","last_change":"2024-09-12T00:02:52.066240+0000","last_active":"2024-09-12T01:12:53.510194+0000","last_peered":"2024-09-12T01:12:53.510194+0000","last_clean":"2024-09-12T01:12:53.510194+0000","last_became_active":"2024-09-12T00:02:52.065653+0000","last_became_peered":"2024-09-12T00:02:52.065653+0000","last_unstale":"2024-09-12T01:12:53.510194+0000","last_undegraded":"2024-09-12T01:12:53.510194+0000","last_fullsized":"2024-09-12T01:12:53.510194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:07.249585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'152","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.266147+0000","last_change":"2024-09-12T00:02:54.074579+0000","last_active":"2024-09-12T01:15:48.266147+0000","last_peered":"2024-09-12T01:15:48.266147+0000","last_clean":"2024-09-12T01:15:48.266147+0000","last_became_active":"2024-09-12T00:02:54.073930+0000","last_became_peered":"2024-09-12T00:02:54.073930+0000","last_unstale":"2024-09-12T01:15:48.266147+0000","last_undegraded":"2024-09-12T01:15:48.266147+0000","last_fullsized":"2024-09-12T01:15:48.266147+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:21.507632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4988,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":267,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:08.617272+0000","last_change":"2024-09-12T00:02:56.078803+0000","last_active":"2024-09-12T01:13:08.617272+0000","last_peered":"2024-09-12T01:13:08.617272+0000","last_clean":"2024-09-12T01:13:08.617272+0000","last_became_active":"2024-09-12T00:02:56.078528+0000","last_became_peered":"2024-09-12T00:02:56.078528+0000","last_unstale":"2024-09-12T01:13:08.617272+0000","last_undegraded":"2024-09-12T01:13:08.617272+0000","last_fullsized":"2024-09-12T01:13:08.617272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:32.315601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'99","reported_seq":620,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:02.947976+0000","last_change":"2024-09-12T00:02:58.087504+0000","last_active":"2024-09-12T01:14:02.947976+0000","last_peered":"2024-09-12T01:14:02.947976+0000","last_clean":"2024-09-12T01:14:02.947976+0000","last_became_active":"2024-09-12T00:02:58.087199+0000","last_became_peered":"2024-09-12T00:02:58.087199+0000","last_unstale":"2024-09-12T01:14:02.947976+0000","last_undegraded":"2024-09-12T01:14:02.947976+0000","last_fullsized":"2024-09-12T01:14:02.947976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:03.468020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":246,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'470","reported_seq":2094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.613518+0000","last_change":"2024-09-12T01:16:08.613518+0000","last_active":"2024-09-12T01:16:08.613518+0000","last_peered":"2024-09-12T01:16:08.613518+0000","last_clean":"2024-09-12T01:16:08.613518+0000","last_became_active":"2024-09-12T00:02:50.072920+0000","last_became_peered":"2024-09-12T00:02:50.072920+0000","last_unstale":"2024-09-12T01:16:08.613518+0000","last_undegraded":"2024-09-12T01:16:08.613518+0000","last_fullsized":"2024-09-12T01:16:08.613518+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'470","last_scrub_stamp":"2024-09-12T01:16:08.613412+0000","last_deep_scrub":"267'470","last_deep_scrub_stamp":"2024-09-12T01:16:08.613412+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.613412+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:17.773006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2371,"num_write":566,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'212","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.772435+0000","last_change":"2024-09-12T01:15:59.772435+0000","last_active":"2024-09-12T01:15:59.772435+0000","last_peered":"2024-09-12T01:15:59.772435+0000","last_clean":"2024-09-12T01:15:59.772435+0000","last_became_active":"2024-09-12T00:02:48.048308+0000","last_became_peered":"2024-09-12T00:02:48.048308+0000","last_unstale":"2024-09-12T01:15:59.772435+0000","last_undegraded":"2024-09-12T01:15:59.772435+0000","last_fullsized":"2024-09-12T01:15:59.772435+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-12T01:15:59.772317+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-12T01:15:59.772317+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.772317+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:08.055567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":37398,"num_write":997,"num_write_kb":57972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398220+0000","last_change":"2024-09-12T00:02:52.060575+0000","last_active":"2024-09-12T01:12:58.398220+0000","last_peered":"2024-09-12T01:12:58.398220+0000","last_clean":"2024-09-12T01:12:58.398220+0000","last_became_active":"2024-09-12T00:02:52.060283+0000","last_became_peered":"2024-09-12T00:02:52.060283+0000","last_unstale":"2024-09-12T01:12:58.398220+0000","last_undegraded":"2024-09-12T01:12:58.398220+0000","last_fullsized":"2024-09-12T01:12:58.398220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:51.045924+0000","last_clean_scrub_stamp":"2024-09-12T00:02:51.045924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.734208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'126","reported_seq":700,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.188246+0000","last_change":"2024-09-12T00:02:54.068064+0000","last_active":"2024-09-12T01:15:48.188246+0000","last_peered":"2024-09-12T01:15:48.188246+0000","last_clean":"2024-09-12T01:15:48.188246+0000","last_became_active":"2024-09-12T00:02:54.067770+0000","last_became_peered":"2024-09-12T00:02:54.067770+0000","last_unstale":"2024-09-12T01:15:48.188246+0000","last_undegraded":"2024-09-12T01:15:48.188246+0000","last_fullsized":"2024-09-12T01:15:48.188246+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:35.379645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4641,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":72,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.398279+0000","last_change":"2024-09-12T00:02:56.078599+0000","last_active":"2024-09-12T01:12:58.398279+0000","last_peered":"2024-09-12T01:12:58.398279+0000","last_clean":"2024-09-12T01:12:58.398279+0000","last_became_active":"2024-09-12T00:02:56.077573+0000","last_became_peered":"2024-09-12T00:02:56.077573+0000","last_unstale":"2024-09-12T01:12:58.398279+0000","last_undegraded":"2024-09-12T01:12:58.398279+0000","last_fullsized":"2024-09-12T01:12:58.398279+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:36.485844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'149","reported_seq":1250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.171046+0000","last_change":"2024-09-12T00:02:58.099809+0000","last_active":"2024-09-12T01:14:00.171046+0000","last_peered":"2024-09-12T01:14:00.171046+0000","last_clean":"2024-09-12T01:14:00.171046+0000","last_became_active":"2024-09-12T00:02:58.099426+0000","last_became_peered":"2024-09-12T00:02:58.099426+0000","last_unstale":"2024-09-12T01:14:00.171046+0000","last_undegraded":"2024-09-12T01:14:00.171046+0000","last_fullsized":"2024-09-12T01:14:00.171046+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:47.482641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":755,"num_read_kb":754,"num_write":338,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'471","reported_seq":1967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.778780+0000","last_change":"2024-09-12T01:16:04.778780+0000","last_active":"2024-09-12T01:16:04.778780+0000","last_peered":"2024-09-12T01:16:04.778780+0000","last_clean":"2024-09-12T01:16:04.778780+0000","last_became_active":"2024-09-12T00:02:50.063959+0000","last_became_peered":"2024-09-12T00:02:50.063959+0000","last_unstale":"2024-09-12T01:16:04.778780+0000","last_undegraded":"2024-09-12T01:16:04.778780+0000","last_fullsized":"2024-09-12T01:16:04.778780+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'471","last_scrub_stamp":"2024-09-12T01:16:04.778701+0000","last_deep_scrub":"267'471","last_deep_scrub_stamp":"2024-09-12T01:16:04.778701+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.778701+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:30.342027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2471,"num_read_kb":2277,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":708,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'193","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.857061+0000","last_change":"2024-09-12T01:15:58.857061+0000","last_active":"2024-09-12T01:15:58.857061+0000","last_peered":"2024-09-12T01:15:58.857061+0000","last_clean":"2024-09-12T01:15:58.857061+0000","last_became_active":"2024-09-12T00:02:48.054650+0000","last_became_peered":"2024-09-12T00:02:48.054650+0000","last_unstale":"2024-09-12T01:15:58.857061+0000","last_undegraded":"2024-09-12T01:15:58.857061+0000","last_fullsized":"2024-09-12T01:15:58.857061+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:15:58.856935+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:15:58.856935+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.856935+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:00.850043+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250177,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":59687,"num_write":954,"num_write_kb":41766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'6","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.157400+0000","last_change":"2024-09-12T01:16:11.157400+0000","last_active":"2024-09-12T01:16:11.157400+0000","last_peered":"2024-09-12T01:16:11.157400+0000","last_clean":"2024-09-12T01:16:11.157400+0000","last_became_active":"2024-09-12T00:02:52.065804+0000","last_became_peered":"2024-09-12T00:02:52.065804+0000","last_unstale":"2024-09-12T01:16:11.157400+0000","last_undegraded":"2024-09-12T01:16:11.157400+0000","last_fullsized":"2024-09-12T01:16:11.157400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:11.157309+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:11.157309+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.157309+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.232298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'181","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.205498+0000","last_change":"2024-09-12T00:02:54.067254+0000","last_active":"2024-09-12T01:15:48.205498+0000","last_peered":"2024-09-12T01:15:48.205498+0000","last_clean":"2024-09-12T01:15:48.205498+0000","last_became_active":"2024-09-12T00:02:54.066918+0000","last_became_peered":"2024-09-12T00:02:54.066918+0000","last_unstale":"2024-09-12T01:15:48.205498+0000","last_undegraded":"2024-09-12T01:15:48.205498+0000","last_fullsized":"2024-09-12T01:15:48.205498+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:53.049792+0000","last_clean_scrub_stamp":"2024-09-12T00:02:53.049792+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:12.059169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":266,"num_write":140,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:55.243946+0000","last_change":"2024-09-12T00:02:56.085398+0000","last_active":"2024-09-12T01:12:55.243946+0000","last_peered":"2024-09-12T01:12:55.243946+0000","last_clean":"2024-09-12T01:12:55.243946+0000","last_became_active":"2024-09-12T00:02:56.084768+0000","last_became_peered":"2024-09-12T00:02:56.084768+0000","last_unstale":"2024-09-12T01:12:55.243946+0000","last_undegraded":"2024-09-12T01:12:55.243946+0000","last_fullsized":"2024-09-12T01:12:55.243946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:55.061536+0000","last_clean_scrub_stamp":"2024-09-12T00:02:55.061536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:48.456473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'155","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:09.758350+0000","last_change":"2024-09-12T00:02:58.097950+0000","last_active":"2024-09-12T01:15:09.758350+0000","last_peered":"2024-09-12T01:15:09.758350+0000","last_clean":"2024-09-12T01:15:09.758350+0000","last_became_active":"2024-09-12T00:02:58.097725+0000","last_became_peered":"2024-09-12T00:02:58.097725+0000","last_unstale":"2024-09-12T01:15:09.758350+0000","last_undegraded":"2024-09-12T01:15:09.758350+0000","last_fullsized":"2024-09-12T01:15:09.758350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:53.001751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":109,"num_write":343,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'692","reported_seq":2203,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.205191+0000","last_change":"2024-09-12T01:16:12.205191+0000","last_active":"2024-09-12T01:16:12.205191+0000","last_peered":"2024-09-12T01:16:12.205191+0000","last_clean":"2024-09-12T01:16:12.205191+0000","last_became_active":"2024-09-12T00:02:50.064354+0000","last_became_peered":"2024-09-12T00:02:50.064354+0000","last_unstale":"2024-09-12T01:16:12.205191+0000","last_undegraded":"2024-09-12T01:16:12.205191+0000","last_fullsized":"2024-09-12T01:16:12.205191+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'692","last_scrub_stamp":"2024-09-12T01:16:12.205104+0000","last_deep_scrub":"267'692","last_deep_scrub_stamp":"2024-09-12T01:16:12.205104+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.205104+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:42.512342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3412,"num_read_kb":3118,"num_write":870,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'187","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.538591+0000","last_change":"2024-09-12T01:15:59.538591+0000","last_active":"2024-09-12T01:15:59.538591+0000","last_peered":"2024-09-12T01:15:59.538591+0000","last_clean":"2024-09-12T01:15:59.538591+0000","last_became_active":"2024-09-12T00:02:48.049242+0000","last_became_peered":"2024-09-12T00:02:48.049242+0000","last_unstale":"2024-09-12T01:15:59.538591+0000","last_undegraded":"2024-09-12T01:15:59.538591+0000","last_fullsized":"2024-09-12T01:15:59.538591+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:15:59.538483+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:15:59.538483+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.538483+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:48.772077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":39372,"num_write":875,"num_write_kb":46728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'352","reported_seq":1697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.151351+0000","last_change":"2024-09-12T01:16:08.151351+0000","last_active":"2024-09-12T01:16:08.151351+0000","last_peered":"2024-09-12T01:16:08.151351+0000","last_clean":"2024-09-12T01:16:08.151351+0000","last_became_active":"2024-09-12T00:02:50.065060+0000","last_became_peered":"2024-09-12T00:02:50.065060+0000","last_unstale":"2024-09-12T01:16:08.151351+0000","last_undegraded":"2024-09-12T01:16:08.151351+0000","last_fullsized":"2024-09-12T01:16:08.151351+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-09-12T01:16:08.151246+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-09-12T01:16:08.151246+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.151246+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:32.866300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1806,"num_read_kb":1710,"num_write":413,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'203","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.099431+0000","last_change":"2024-09-12T01:15:55.099431+0000","last_active":"2024-09-12T01:15:55.099431+0000","last_peered":"2024-09-12T01:15:55.099431+0000","last_clean":"2024-09-12T01:15:55.099431+0000","last_became_active":"2024-09-12T00:02:48.041842+0000","last_became_peered":"2024-09-12T00:02:48.041842+0000","last_unstale":"2024-09-12T01:15:55.099431+0000","last_undegraded":"2024-09-12T01:15:55.099431+0000","last_fullsized":"2024-09-12T01:15:55.099431+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'203","last_scrub_stamp":"2024-09-12T01:15:55.099312+0000","last_deep_scrub":"267'203","last_deep_scrub_stamp":"2024-09-12T01:15:55.099312+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.099312+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:35.347299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":13124,"num_write":1044,"num_write_kb":38354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'458","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.265508+0000","last_change":"2024-09-12T01:16:13.265508+0000","last_active":"2024-09-12T01:16:13.265508+0000","last_peered":"2024-09-12T01:16:13.265508+0000","last_clean":"2024-09-12T01:16:13.265508+0000","last_became_active":"2024-09-12T00:02:50.066341+0000","last_became_peered":"2024-09-12T00:02:50.066341+0000","last_unstale":"2024-09-12T01:16:13.265508+0000","last_undegraded":"2024-09-12T01:16:13.265508+0000","last_fullsized":"2024-09-12T01:16:13.265508+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'458","last_scrub_stamp":"2024-09-12T01:16:13.265421+0000","last_deep_scrub":"267'458","last_deep_scrub_stamp":"2024-09-12T01:16:13.265421+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.265421+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:02.745745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2383,"num_read_kb":2262,"num_write":523,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'185","reported_seq":819,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.199885+0000","last_change":"2024-09-12T01:16:03.199885+0000","last_active":"2024-09-12T01:16:03.199885+0000","last_peered":"2024-09-12T01:16:03.199885+0000","last_clean":"2024-09-12T01:16:03.199885+0000","last_became_active":"2024-09-12T00:02:48.052205+0000","last_became_peered":"2024-09-12T00:02:48.052205+0000","last_unstale":"2024-09-12T01:16:03.199885+0000","last_undegraded":"2024-09-12T01:16:03.199885+0000","last_fullsized":"2024-09-12T01:16:03.199885+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:16:03.199736+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:16:03.199736+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.199736+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:22.555181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":389,"num_read_kb":19493,"num_write":855,"num_write_kb":24928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'368","reported_seq":1886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.149286+0000","last_change":"2024-09-12T01:16:07.149286+0000","last_active":"2024-09-12T01:16:07.149286+0000","last_peered":"2024-09-12T01:16:07.149286+0000","last_clean":"2024-09-12T01:16:07.149286+0000","last_became_active":"2024-09-12T00:02:50.065534+0000","last_became_peered":"2024-09-12T00:02:50.065534+0000","last_unstale":"2024-09-12T01:16:07.149286+0000","last_undegraded":"2024-09-12T01:16:07.149286+0000","last_fullsized":"2024-09-12T01:16:07.149286+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'368","last_scrub_stamp":"2024-09-12T01:16:07.149197+0000","last_deep_scrub":"267'368","last_deep_scrub_stamp":"2024-09-12T01:16:07.149197+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.149197+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:26.769112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1966,"num_read_kb":1903,"num_write":390,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'155","reported_seq":759,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.132517+0000","last_change":"2024-09-12T01:15:57.132517+0000","last_active":"2024-09-12T01:15:57.132517+0000","last_peered":"2024-09-12T01:15:57.132517+0000","last_clean":"2024-09-12T01:15:57.132517+0000","last_became_active":"2024-09-12T00:03:21.720441+0000","last_became_peered":"2024-09-12T00:03:21.720441+0000","last_unstale":"2024-09-12T01:15:57.132517+0000","last_undegraded":"2024-09-12T01:15:57.132517+0000","last_fullsized":"2024-09-12T01:15:57.132517+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-12T01:15:57.132438+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-12T01:15:57.132438+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.132438+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:56.866362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":16297,"num_write":778,"num_write_kb":33256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"267'1239","reported_seq":3054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:53.240679+0000","last_change":"2024-09-12T00:02:50.070807+0000","last_active":"2024-09-12T01:13:53.240679+0000","last_peered":"2024-09-12T01:13:53.240679+0000","last_clean":"2024-09-12T01:13:53.240679+0000","last_became_active":"2024-09-12T00:02:50.070406+0000","last_became_peered":"2024-09-12T00:02:50.070406+0000","last_unstale":"2024-09-12T01:13:53.240679+0000","last_undegraded":"2024-09-12T01:13:53.240679+0000","last_fullsized":"2024-09-12T01:13:53.240679+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5822,"num_read_kb":5176,"num_write":1694,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'195","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.695026+0000","last_change":"2024-09-12T01:16:01.695026+0000","last_active":"2024-09-12T01:16:01.695026+0000","last_peered":"2024-09-12T01:16:01.695026+0000","last_clean":"2024-09-12T01:16:01.695026+0000","last_became_active":"2024-09-12T00:02:48.051454+0000","last_became_peered":"2024-09-12T00:02:48.051454+0000","last_unstale":"2024-09-12T01:16:01.695026+0000","last_undegraded":"2024-09-12T01:16:01.695026+0000","last_fullsized":"2024-09-12T01:16:01.695026+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'195","last_scrub_stamp":"2024-09-12T01:16:01.694929+0000","last_deep_scrub":"267'195","last_deep_scrub_stamp":"2024-09-12T01:16:01.694929+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.694929+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:50.288118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":27281,"num_write":913,"num_write_kb":43596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'811","reported_seq":2275,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.823457+0000","last_change":"2024-09-12T01:16:07.823457+0000","last_active":"2024-09-12T01:16:07.823457+0000","last_peered":"2024-09-12T01:16:07.823457+0000","last_clean":"2024-09-12T01:16:07.823457+0000","last_became_active":"2024-09-12T00:02:50.065615+0000","last_became_peered":"2024-09-12T00:02:50.065615+0000","last_unstale":"2024-09-12T01:16:07.823457+0000","last_undegraded":"2024-09-12T01:16:07.823457+0000","last_fullsized":"2024-09-12T01:16:07.823457+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'811","last_scrub_stamp":"2024-09-12T01:16:07.823369+0000","last_deep_scrub":"267'811","last_deep_scrub_stamp":"2024-09-12T01:16:07.823369+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.823369+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:09.542904+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3886,"num_read_kb":3508,"num_write":1123,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'223","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.095055+0000","last_change":"2024-09-12T01:15:59.095055+0000","last_active":"2024-09-12T01:15:59.095055+0000","last_peered":"2024-09-12T01:15:59.095055+0000","last_clean":"2024-09-12T01:15:59.095055+0000","last_became_active":"2024-09-12T00:02:48.047357+0000","last_became_peered":"2024-09-12T00:02:48.047357+0000","last_unstale":"2024-09-12T01:15:59.095055+0000","last_undegraded":"2024-09-12T01:15:59.095055+0000","last_fullsized":"2024-09-12T01:15:59.095055+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-12T01:15:59.094931+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-12T01:15:59.094931+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.094931+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:21.356655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":6089,"num_write":1092,"num_write_kb":27766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1104","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.628883+0000","last_change":"2024-09-12T01:16:12.628883+0000","last_active":"2024-09-12T01:16:12.628883+0000","last_peered":"2024-09-12T01:16:12.628883+0000","last_clean":"2024-09-12T01:16:12.628883+0000","last_became_active":"2024-09-12T00:02:50.075265+0000","last_became_peered":"2024-09-12T00:02:50.075265+0000","last_unstale":"2024-09-12T01:16:12.628883+0000","last_undegraded":"2024-09-12T01:16:12.628883+0000","last_fullsized":"2024-09-12T01:16:12.628883+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1104","last_scrub_stamp":"2024-09-12T01:16:12.628783+0000","last_deep_scrub":"267'1104","last_deep_scrub_stamp":"2024-09-12T01:16:12.628783+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.628783+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:31.330763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4403,"num_write":1512,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'200","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.554239+0000","last_change":"2024-09-12T01:15:58.554239+0000","last_active":"2024-09-12T01:15:58.554239+0000","last_peered":"2024-09-12T01:15:58.554239+0000","last_clean":"2024-09-12T01:15:58.554239+0000","last_became_active":"2024-09-12T00:02:48.047266+0000","last_became_peered":"2024-09-12T00:02:48.047266+0000","last_unstale":"2024-09-12T01:15:58.554239+0000","last_undegraded":"2024-09-12T01:15:58.554239+0000","last_fullsized":"2024-09-12T01:15:58.554239+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-12T01:15:58.554118+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-12T01:15:58.554118+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.554118+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:22.527176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":23654,"num_write":912,"num_write_kb":39021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'477","reported_seq":2131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.473365+0000","last_change":"2024-09-12T01:16:07.473365+0000","last_active":"2024-09-12T01:16:07.473365+0000","last_peered":"2024-09-12T01:16:07.473365+0000","last_clean":"2024-09-12T01:16:07.473365+0000","last_became_active":"2024-09-12T00:02:50.067919+0000","last_became_peered":"2024-09-12T00:02:50.067919+0000","last_unstale":"2024-09-12T01:16:07.473365+0000","last_undegraded":"2024-09-12T01:16:07.473365+0000","last_fullsized":"2024-09-12T01:16:07.473365+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'477","last_scrub_stamp":"2024-09-12T01:16:07.473283+0000","last_deep_scrub":"267'477","last_deep_scrub_stamp":"2024-09-12T01:16:07.473283+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.473283+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:57.980949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2453,"num_write":580,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'153","reported_seq":740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.103312+0000","last_change":"2024-09-12T01:16:00.103312+0000","last_active":"2024-09-12T01:16:00.103312+0000","last_peered":"2024-09-12T01:16:00.103312+0000","last_clean":"2024-09-12T01:16:00.103312+0000","last_became_active":"2024-09-12T00:03:21.143091+0000","last_became_peered":"2024-09-12T00:03:21.143091+0000","last_unstale":"2024-09-12T01:16:00.103312+0000","last_undegraded":"2024-09-12T01:16:00.103312+0000","last_fullsized":"2024-09-12T01:16:00.103312+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-12T01:16:00.103180+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-12T01:16:00.103180+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.103180+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:22.971120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":6539,"num_write":770,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'875","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.732349+0000","last_change":"2024-09-12T01:16:07.732349+0000","last_active":"2024-09-12T01:16:07.732349+0000","last_peered":"2024-09-12T01:16:07.732349+0000","last_clean":"2024-09-12T01:16:07.732349+0000","last_became_active":"2024-09-12T00:02:50.076097+0000","last_became_peered":"2024-09-12T00:02:50.076097+0000","last_unstale":"2024-09-12T01:16:07.732349+0000","last_undegraded":"2024-09-12T01:16:07.732349+0000","last_fullsized":"2024-09-12T01:16:07.732349+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'875","last_scrub_stamp":"2024-09-12T01:16:07.732265+0000","last_deep_scrub":"267'875","last_deep_scrub_stamp":"2024-09-12T01:16:07.732265+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.732265+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.381212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3804,"num_write":1206,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'185","reported_seq":797,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.251637+0000","last_change":"2024-09-12T01:16:05.251637+0000","last_active":"2024-09-12T01:16:05.251637+0000","last_peered":"2024-09-12T01:16:05.251637+0000","last_clean":"2024-09-12T01:16:05.251637+0000","last_became_active":"2024-09-12T00:02:48.057693+0000","last_became_peered":"2024-09-12T00:02:48.057693+0000","last_unstale":"2024-09-12T01:16:05.251637+0000","last_undegraded":"2024-09-12T01:16:05.251637+0000","last_fullsized":"2024-09-12T01:16:05.251637+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:16:05.251527+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:16:05.251527+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.251527+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:53.355948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":352,"num_read_kb":5525,"num_write":905,"num_write_kb":35074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'842","reported_seq":2623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.930794+0000","last_change":"2024-09-12T01:16:11.930794+0000","last_active":"2024-09-12T01:16:11.930794+0000","last_peered":"2024-09-12T01:16:11.930794+0000","last_clean":"2024-09-12T01:16:11.930794+0000","last_became_active":"2024-09-12T00:02:50.062524+0000","last_became_peered":"2024-09-12T00:02:50.062524+0000","last_unstale":"2024-09-12T01:16:11.930794+0000","last_undegraded":"2024-09-12T01:16:11.930794+0000","last_fullsized":"2024-09-12T01:16:11.930794+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'842","last_scrub_stamp":"2024-09-12T01:16:11.930681+0000","last_deep_scrub":"267'842","last_deep_scrub_stamp":"2024-09-12T01:16:11.930681+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.930681+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:21.897504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4232,"num_read_kb":3859,"num_write":1078,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4832,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'258","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.730568+0000","last_change":"2024-09-12T01:16:00.730568+0000","last_active":"2024-09-12T01:16:00.730568+0000","last_peered":"2024-09-12T01:16:00.730568+0000","last_clean":"2024-09-12T01:16:00.730568+0000","last_became_active":"2024-09-12T00:02:48.050574+0000","last_became_peered":"2024-09-12T00:02:48.050574+0000","last_unstale":"2024-09-12T01:16:00.730568+0000","last_undegraded":"2024-09-12T01:16:00.730568+0000","last_fullsized":"2024-09-12T01:16:00.730568+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:16:00.730443+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:16:00.730443+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.730443+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:08.715998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67790,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":15341,"num_write":1132,"num_write_kb":29230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'815","reported_seq":2290,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.253395+0000","last_change":"2024-09-12T01:16:04.253395+0000","last_active":"2024-09-12T01:16:04.253395+0000","last_peered":"2024-09-12T01:16:04.253395+0000","last_clean":"2024-09-12T01:16:04.253395+0000","last_became_active":"2024-09-12T00:02:50.063668+0000","last_became_peered":"2024-09-12T00:02:50.063668+0000","last_unstale":"2024-09-12T01:16:04.253395+0000","last_undegraded":"2024-09-12T01:16:04.253395+0000","last_fullsized":"2024-09-12T01:16:04.253395+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'815","last_scrub_stamp":"2024-09-12T01:16:04.253299+0000","last_deep_scrub":"267'815","last_deep_scrub_stamp":"2024-09-12T01:16:04.253299+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.253299+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:04.727166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3770,"num_read_kb":3367,"num_write":1118,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'211","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.220264+0000","last_change":"2024-09-12T01:16:04.220264+0000","last_active":"2024-09-12T01:16:04.220264+0000","last_peered":"2024-09-12T01:16:04.220264+0000","last_clean":"2024-09-12T01:16:04.220264+0000","last_became_active":"2024-09-12T00:02:48.048851+0000","last_became_peered":"2024-09-12T00:02:48.048851+0000","last_unstale":"2024-09-12T01:16:04.220264+0000","last_undegraded":"2024-09-12T01:16:04.220264+0000","last_fullsized":"2024-09-12T01:16:04.220264+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'211","last_scrub_stamp":"2024-09-12T01:16:04.220141+0000","last_deep_scrub":"267'211","last_deep_scrub_stamp":"2024-09-12T01:16:04.220141+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.220141+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:47.525059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":48639,"num_write":1072,"num_write_kb":41735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'815","reported_seq":2281,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.835311+0000","last_change":"2024-09-12T01:16:08.835311+0000","last_active":"2024-09-12T01:16:08.835311+0000","last_peered":"2024-09-12T01:16:08.835311+0000","last_clean":"2024-09-12T01:16:08.835311+0000","last_became_active":"2024-09-12T00:02:50.063615+0000","last_became_peered":"2024-09-12T00:02:50.063615+0000","last_unstale":"2024-09-12T01:16:08.835311+0000","last_undegraded":"2024-09-12T01:16:08.835311+0000","last_fullsized":"2024-09-12T01:16:08.835311+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'815","last_scrub_stamp":"2024-09-12T01:16:08.835219+0000","last_deep_scrub":"267'815","last_deep_scrub_stamp":"2024-09-12T01:16:08.835219+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.835219+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:58.732596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3747,"num_read_kb":3346,"num_write":1068,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'284","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.821132+0000","last_change":"2024-09-12T01:15:59.821132+0000","last_active":"2024-09-12T01:15:59.821132+0000","last_peered":"2024-09-12T01:15:59.821132+0000","last_clean":"2024-09-12T01:15:59.821132+0000","last_became_active":"2024-09-12T00:02:48.046828+0000","last_became_peered":"2024-09-12T00:02:48.046828+0000","last_unstale":"2024-09-12T01:15:59.821132+0000","last_undegraded":"2024-09-12T01:15:59.821132+0000","last_fullsized":"2024-09-12T01:15:59.821132+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'284","last_scrub_stamp":"2024-09-12T01:15:59.821026+0000","last_deep_scrub":"267'284","last_deep_scrub_stamp":"2024-09-12T01:15:59.821026+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.821026+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.732125+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":12026,"num_write":1074,"num_write_kb":33544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'754","reported_seq":2269,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.720788+0000","last_change":"2024-09-12T01:16:11.720788+0000","last_active":"2024-09-12T01:16:11.720788+0000","last_peered":"2024-09-12T01:16:11.720788+0000","last_clean":"2024-09-12T01:16:11.720788+0000","last_became_active":"2024-09-12T00:02:50.069844+0000","last_became_peered":"2024-09-12T00:02:50.069844+0000","last_unstale":"2024-09-12T01:16:11.720788+0000","last_undegraded":"2024-09-12T01:16:11.720788+0000","last_fullsized":"2024-09-12T01:16:11.720788+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'754","last_scrub_stamp":"2024-09-12T01:16:11.720709+0000","last_deep_scrub":"267'754","last_deep_scrub_stamp":"2024-09-12T01:16:11.720709+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.720709+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:50.677876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3535,"num_read_kb":3209,"num_write":983,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'198","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.521700+0000","last_change":"2024-09-12T01:16:02.521700+0000","last_active":"2024-09-12T01:16:02.521700+0000","last_peered":"2024-09-12T01:16:02.521700+0000","last_clean":"2024-09-12T01:16:02.521700+0000","last_became_active":"2024-09-12T00:02:48.046397+0000","last_became_peered":"2024-09-12T00:02:48.046397+0000","last_unstale":"2024-09-12T01:16:02.521700+0000","last_undegraded":"2024-09-12T01:16:02.521700+0000","last_fullsized":"2024-09-12T01:16:02.521700+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:16:02.521590+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:16:02.521590+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.521590+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:52.392814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":38047,"num_write":933,"num_write_kb":24740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'854","reported_seq":2486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.774581+0000","last_change":"2024-09-12T01:16:06.774581+0000","last_active":"2024-09-12T01:16:06.774581+0000","last_peered":"2024-09-12T01:16:06.774581+0000","last_clean":"2024-09-12T01:16:06.774581+0000","last_became_active":"2024-09-12T00:02:50.078018+0000","last_became_peered":"2024-09-12T00:02:50.078018+0000","last_unstale":"2024-09-12T01:16:06.774581+0000","last_undegraded":"2024-09-12T01:16:06.774581+0000","last_fullsized":"2024-09-12T01:16:06.774581+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'854","last_scrub_stamp":"2024-09-12T01:16:06.774436+0000","last_deep_scrub":"267'854","last_deep_scrub_stamp":"2024-09-12T01:16:06.774436+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.774436+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:12.958179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4154,"num_read_kb":3748,"num_write":1160,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'171","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.723711+0000","last_change":"2024-09-12T01:16:06.723711+0000","last_active":"2024-09-12T01:16:06.723711+0000","last_peered":"2024-09-12T01:16:06.723711+0000","last_clean":"2024-09-12T01:16:06.723711+0000","last_became_active":"2024-09-12T00:02:48.047945+0000","last_became_peered":"2024-09-12T00:02:48.047945+0000","last_unstale":"2024-09-12T01:16:06.723711+0000","last_undegraded":"2024-09-12T01:16:06.723711+0000","last_fullsized":"2024-09-12T01:16:06.723711+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-12T01:16:06.723583+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-12T01:16:06.723583+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.723583+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:29.604328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":324,"num_read_kb":25981,"num_write":829,"num_write_kb":31809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'534","reported_seq":2303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.235496+0000","last_change":"2024-09-12T01:16:01.235496+0000","last_active":"2024-09-12T01:16:01.235496+0000","last_peered":"2024-09-12T01:16:01.235496+0000","last_clean":"2024-09-12T01:16:01.235496+0000","last_became_active":"2024-09-12T00:03:21.133475+0000","last_became_peered":"2024-09-12T00:03:21.133475+0000","last_unstale":"2024-09-12T01:16:01.235496+0000","last_undegraded":"2024-09-12T01:16:01.235496+0000","last_fullsized":"2024-09-12T01:16:01.235496+0000","mapping_epoch":39,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'534","last_scrub_stamp":"2024-09-12T01:16:01.235392+0000","last_deep_scrub":"267'534","last_deep_scrub_stamp":"2024-09-12T01:16:01.235392+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.235392+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:42.656876+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2976,"num_read_kb":2811,"num_write":614,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":436,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"267'233","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.161645+0000","last_change":"2024-09-12T01:15:58.161645+0000","last_active":"2024-09-12T01:15:58.161645+0000","last_peered":"2024-09-12T01:15:58.161645+0000","last_clean":"2024-09-12T01:15:58.161645+0000","last_became_active":"2024-09-12T00:02:48.049104+0000","last_became_peered":"2024-09-12T00:02:48.049104+0000","last_unstale":"2024-09-12T01:15:58.161645+0000","last_undegraded":"2024-09-12T01:15:58.161645+0000","last_fullsized":"2024-09-12T01:15:58.161645+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'233","last_scrub_stamp":"2024-09-12T01:15:58.161506+0000","last_deep_scrub":"267'233","last_deep_scrub_stamp":"2024-09-12T01:15:58.161506+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.161506+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.839368+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456491,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":11103,"num_write":1027,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'910","reported_seq":2509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.736466+0000","last_change":"2024-09-12T01:16:09.736466+0000","last_active":"2024-09-12T01:16:09.736466+0000","last_peered":"2024-09-12T01:16:09.736466+0000","last_clean":"2024-09-12T01:16:09.736466+0000","last_became_active":"2024-09-12T00:02:50.069494+0000","last_became_peered":"2024-09-12T00:02:50.069494+0000","last_unstale":"2024-09-12T01:16:09.736466+0000","last_undegraded":"2024-09-12T01:16:09.736466+0000","last_fullsized":"2024-09-12T01:16:09.736466+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'910","last_scrub_stamp":"2024-09-12T01:16:09.736373+0000","last_deep_scrub":"267'910","last_deep_scrub_stamp":"2024-09-12T01:16:09.736373+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.736373+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:52.193047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4355,"num_read_kb":3868,"num_write":1227,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'175","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.268258+0000","last_change":"2024-09-12T01:16:07.268258+0000","last_active":"2024-09-12T01:16:07.268258+0000","last_peered":"2024-09-12T01:16:07.268258+0000","last_clean":"2024-09-12T01:16:07.268258+0000","last_became_active":"2024-09-12T00:04:21.225148+0000","last_became_peered":"2024-09-12T00:04:21.225148+0000","last_unstale":"2024-09-12T01:16:07.268258+0000","last_undegraded":"2024-09-12T01:16:07.268258+0000","last_fullsized":"2024-09-12T01:16:07.268258+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-12T01:16:07.268138+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-12T01:16:07.268138+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.268138+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:34.383522+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7533161,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":15843,"num_write":853,"num_write_kb":25246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'175","reported_seq":804,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.287894+0000","last_change":"2024-09-12T01:16:08.287894+0000","last_active":"2024-09-12T01:16:08.287894+0000","last_peered":"2024-09-12T01:16:08.287894+0000","last_clean":"2024-09-12T01:16:08.287894+0000","last_became_active":"2024-09-12T00:03:21.140871+0000","last_became_peered":"2024-09-12T00:03:21.140871+0000","last_unstale":"2024-09-12T01:16:08.287894+0000","last_undegraded":"2024-09-12T01:16:08.287894+0000","last_fullsized":"2024-09-12T01:16:08.287894+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-12T01:16:08.287766+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-12T01:16:08.287766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.287766+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:57.597678+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2728229,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":36071,"num_write":841,"num_write_kb":27237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'835","reported_seq":2470,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.688636+0000","last_change":"2024-09-12T01:16:09.688636+0000","last_active":"2024-09-12T01:16:09.688636+0000","last_peered":"2024-09-12T01:16:09.688636+0000","last_clean":"2024-09-12T01:16:09.688636+0000","last_became_active":"2024-09-12T00:02:50.076513+0000","last_became_peered":"2024-09-12T00:02:50.076513+0000","last_unstale":"2024-09-12T01:16:09.688636+0000","last_undegraded":"2024-09-12T01:16:09.688636+0000","last_fullsized":"2024-09-12T01:16:09.688636+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'835","last_scrub_stamp":"2024-09-12T01:16:09.688553+0000","last_deep_scrub":"267'835","last_deep_scrub_stamp":"2024-09-12T01:16:09.688553+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.688553+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:38.082389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4096,"num_read_kb":3692,"num_write":1085,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'193","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.147640+0000","last_change":"2024-09-12T01:16:01.147640+0000","last_active":"2024-09-12T01:16:01.147640+0000","last_peered":"2024-09-12T01:16:01.147640+0000","last_clean":"2024-09-12T01:16:01.147640+0000","last_became_active":"2024-09-12T00:03:21.143160+0000","last_became_peered":"2024-09-12T00:03:21.143160+0000","last_unstale":"2024-09-12T01:16:01.147640+0000","last_undegraded":"2024-09-12T01:16:01.147640+0000","last_fullsized":"2024-09-12T01:16:01.147640+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:16:01.147530+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:16:01.147530+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.147530+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:27.265957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":434,"num_read_kb":67077,"num_write":937,"num_write_kb":29840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:16.787449+0000","last_change":"2024-09-12T00:02:50.060740+0000","last_active":"2024-09-12T01:13:16.787449+0000","last_peered":"2024-09-12T01:13:16.787449+0000","last_clean":"2024-09-12T01:13:16.787449+0000","last_became_active":"2024-09-12T00:02:50.060457+0000","last_became_peered":"2024-09-12T00:02:50.060457+0000","last_unstale":"2024-09-12T01:13:16.787449+0000","last_undegraded":"2024-09-12T01:13:16.787449+0000","last_fullsized":"2024-09-12T01:13:16.787449+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:49.042039+0000","last_clean_scrub_stamp":"2024-09-12T00:02:49.042039+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:20.005668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2366,"num_read_kb":2209,"num_write":518,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5804,"num_read_kb":4071,"num_write":1920,"num_write_kb":818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1091,"ondisk_log_size":1091,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15077,"num_read_kb":14728,"num_write":16720,"num_write_kb":4882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":259874,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":10212,"num_read_kb":12359,"num_write":7103,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1813,"ondisk_log_size":1813,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212469,"num_read_kb":193861,"num_write":55201,"num_write_kb":18788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37116,"num_omap_keys":151,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3908,"ondisk_log_size":3908,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":93137464,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":33184,"num_read_kb":2494324,"num_write":62091,"num_write_kb":2229204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":141545472,"data_stored":141545472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4519,"ondisk_log_size":4519,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196988,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185720,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510331,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243796,"kb_used_data":14084,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94128044,"statfs":{"total":96636764160,"available":96387117056,"internally_reserved":0,"allocated":14422016,"data_stored":12282601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510333,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255680,"kb_used_data":25968,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116160,"statfs":{"total":96636764160,"available":96374947840,"internally_reserved":0,"allocated":26591232,"data_stored":24503671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235207110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510335,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97016,"kb_used_data":15848,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94274824,"statfs":{"total":96636764160,"available":96537419776,"internally_reserved":0,"allocated":16228352,"data_stored":14061021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510330,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106528,"kb_used_data":25360,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94265312,"statfs":{"total":96636764160,"available":96527679488,"internally_reserved":0,"allocated":25968640,"data_stored":23900981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510329,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245988,"kb_used_data":16276,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94125852,"statfs":{"total":96636764160,"available":96384872448,"internally_reserved":0,"allocated":16666624,"data_stored":14539294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510327,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101516,"kb_used_data":25916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94270324,"statfs":{"total":96636764160,"available":96532811776,"internally_reserved":0,"allocated":26537984,"data_stored":24477318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510328,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154136,"kb_used_data":28616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94217704,"statfs":{"total":96636764160,"available":96478928896,"internally_reserved":0,"allocated":29302784,"data_stored":27210308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575739,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":269432,"kb_used_data":21736,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94102408,"statfs":{"total":96636764160,"available":96360865792,"internally_reserved":0,"allocated":22257664,"data_stored":20146116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17256448,"data_stored":17256448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24911872,"data_stored":24911872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22179840,"data_stored":22179840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12238848,"data_stored":12238848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21602304,"data_stored":21602304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11759616,"data_stored":11759616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22204416,"data_stored":22204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:16:17.283 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.283 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.283 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.283 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.283 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.283 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.283 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.284 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.284 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.284 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.284 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.284 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.284 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.284 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.284 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.285 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.286 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.287 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.287 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.287 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.287 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.287 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.287 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.287 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.287 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.288 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.289 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.290 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.291 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.292 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.293 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.294 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.295 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.296 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.297 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.297 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.297 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.297 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.297 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.297 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.297 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.298 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.298 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.298 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.298 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.298 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.298 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.298 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.298 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.299 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.299 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.299 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.299 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.299 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.299 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.299 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.299 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.300 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.300 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.300 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.300 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.300 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.300 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.300 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.300 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.301 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.301 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.301 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.301 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.301 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.301 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.301 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.301 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.302 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.302 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.302 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.302 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.302 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.302 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.302 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.302 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.303 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.303 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.303 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.303 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.303 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.303 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.303 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.303 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.304 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.304 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.304 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.304 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.304 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.304 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.304 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.305 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.306 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.307 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.308 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.308 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.308 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.308 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.308 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.308 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.308 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.308 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.309 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.309 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.309 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.309 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.309 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.309 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.309 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.309 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:02:51.045924+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:02:53.049792+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:02:55.061536+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.310 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.311 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.311 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:02:49.042039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:17.311 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:16:37.312 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:16:37.663 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:16:37.675 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T01:16:37.677 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":2486,"stamp":"2024-09-12T01:16:37.341512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":94005387,"num_objects":732,"num_object_clones":0,"num_object_copies":1697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":279494,"num_read_kb":3104975,"num_write":143492,"num_write_kb":2513046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731476,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14032,"ondisk_log_size":14032,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1482412,"kb_used_data":173804,"kb_used_omap":12,"kb_used_meta":1308467,"kb_avail":753492308,"statfs":{"total":773094113280,"available":771576123392,"internally_reserved":0,"allocated":177975296,"data_stored":161121310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1339870769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":507217,"num_omap_keys":1181,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005622"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.502105+0000","last_change":"2024-09-12T00:39:26.642397+0000","last_active":"2024-09-12T01:11:58.502105+0000","last_peered":"2024-09-12T01:11:58.502105+0000","last_clean":"2024-09-12T01:11:58.502105+0000","last_became_active":"2024-09-12T00:39:26.642090+0000","last_became_peered":"2024-09-12T00:39:26.642090+0000","last_unstale":"2024-09-12T01:11:58.502105+0000","last_undegraded":"2024-09-12T01:11:58.502105+0000","last_fullsized":"2024-09-12T01:11:58.502105+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:54.374892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.502826+0000","last_change":"2024-09-12T00:22:02.424471+0000","last_active":"2024-09-12T01:12:03.502826+0000","last_peered":"2024-09-12T01:12:03.502826+0000","last_clean":"2024-09-12T01:12:03.502826+0000","last_became_active":"2024-09-12T00:22:02.423867+0000","last_became_peered":"2024-09-12T00:22:02.423867+0000","last_unstale":"2024-09-12T01:12:03.502826+0000","last_undegraded":"2024-09-12T01:12:03.502826+0000","last_fullsized":"2024-09-12T01:12:03.502826+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.940652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:28.246266+0000","last_change":"2024-09-12T00:21:58.336211+0000","last_active":"2024-09-12T01:14:28.246266+0000","last_peered":"2024-09-12T01:14:28.246266+0000","last_clean":"2024-09-12T01:14:28.246266+0000","last_became_active":"2024-09-12T00:21:58.335882+0000","last_became_peered":"2024-09-12T00:21:58.335882+0000","last_unstale":"2024-09-12T01:14:28.246266+0000","last_undegraded":"2024-09-12T01:14:28.246266+0000","last_fullsized":"2024-09-12T01:14:28.246266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:06.306799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":322,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'60","reported_seq":224,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:15.253694+0000","last_change":"2024-09-12T00:17:58.354178+0000","last_active":"2024-09-12T01:14:15.253694+0000","last_peered":"2024-09-12T01:14:15.253694+0000","last_clean":"2024-09-12T01:14:15.253694+0000","last_became_active":"2024-09-12T00:17:58.353889+0000","last_became_peered":"2024-09-12T00:17:58.353889+0000","last_unstale":"2024-09-12T01:14:15.253694+0000","last_undegraded":"2024-09-12T01:14:15.253694+0000","last_fullsized":"2024-09-12T01:14:15.253694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":209,"num_write":117,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.272165+0000","last_change":"2024-09-12T01:16:26.272165+0000","last_active":"2024-09-12T01:16:26.272165+0000","last_peered":"2024-09-12T01:16:26.272165+0000","last_clean":"2024-09-12T01:16:26.272165+0000","last_became_active":"2024-09-12T00:39:26.637244+0000","last_became_peered":"2024-09-12T00:39:26.637244+0000","last_unstale":"2024-09-12T01:16:26.272165+0000","last_undegraded":"2024-09-12T01:16:26.272165+0000","last_fullsized":"2024-09-12T01:16:26.272165+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:26.272076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:26.272076+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.272076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:45.460900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.390545+0000","last_change":"2024-09-12T00:22:02.421061+0000","last_active":"2024-09-12T01:12:03.390545+0000","last_peered":"2024-09-12T01:12:03.390545+0000","last_clean":"2024-09-12T01:12:03.390545+0000","last_became_active":"2024-09-12T00:22:02.420774+0000","last_became_peered":"2024-09-12T00:22:02.420774+0000","last_unstale":"2024-09-12T01:12:03.390545+0000","last_undegraded":"2024-09-12T01:12:03.390545+0000","last_fullsized":"2024-09-12T01:12:03.390545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:12.865558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.399546+0000","last_change":"2024-09-12T01:16:29.399546+0000","last_active":"2024-09-12T01:16:29.399546+0000","last_peered":"2024-09-12T01:16:29.399546+0000","last_clean":"2024-09-12T01:16:29.399546+0000","last_became_active":"2024-09-12T00:21:58.336723+0000","last_became_peered":"2024-09-12T00:21:58.336723+0000","last_unstale":"2024-09-12T01:16:29.399546+0000","last_undegraded":"2024-09-12T01:16:29.399546+0000","last_fullsized":"2024-09-12T01:16:29.399546+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:29.399457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:29.399457+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.399457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:53.257732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'21","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.253525+0000","last_change":"2024-09-12T01:16:18.253525+0000","last_active":"2024-09-12T01:16:18.253525+0000","last_peered":"2024-09-12T01:16:18.253525+0000","last_clean":"2024-09-12T01:16:18.253525+0000","last_became_active":"2024-09-12T00:17:58.361306+0000","last_became_peered":"2024-09-12T00:17:58.361306+0000","last_unstale":"2024-09-12T01:16:18.253525+0000","last_undegraded":"2024-09-12T01:16:18.253525+0000","last_fullsized":"2024-09-12T01:16:18.253525+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T01:16:18.253413+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T01:16:18.253413+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.253413+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.534994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.395558+0000","last_change":"2024-09-12T01:16:32.395558+0000","last_active":"2024-09-12T01:16:32.395558+0000","last_peered":"2024-09-12T01:16:32.395558+0000","last_clean":"2024-09-12T01:16:32.395558+0000","last_became_active":"2024-09-12T00:39:26.625454+0000","last_became_peered":"2024-09-12T00:39:26.625454+0000","last_unstale":"2024-09-12T01:16:32.395558+0000","last_undegraded":"2024-09-12T01:16:32.395558+0000","last_fullsized":"2024-09-12T01:16:32.395558+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.395472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.395472+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.395472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:47.842934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:10.253071+0000","last_change":"2024-09-12T00:22:02.422000+0000","last_active":"2024-09-12T01:14:10.253071+0000","last_peered":"2024-09-12T01:14:10.253071+0000","last_clean":"2024-09-12T01:14:10.253071+0000","last_became_active":"2024-09-12T00:22:02.421689+0000","last_became_peered":"2024-09-12T00:22:02.421689+0000","last_unstale":"2024-09-12T01:14:10.253071+0000","last_undegraded":"2024-09-12T01:14:10.253071+0000","last_fullsized":"2024-09-12T01:14:10.253071+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.198466+0000","last_change":"2024-09-12T01:16:22.198466+0000","last_active":"2024-09-12T01:16:22.198466+0000","last_peered":"2024-09-12T01:16:22.198466+0000","last_clean":"2024-09-12T01:16:22.198466+0000","last_became_active":"2024-09-12T00:21:58.332782+0000","last_became_peered":"2024-09-12T00:21:58.332782+0000","last_unstale":"2024-09-12T01:16:22.198466+0000","last_undegraded":"2024-09-12T01:16:22.198466+0000","last_fullsized":"2024-09-12T01:16:22.198466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:22.198371+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:22.198371+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.198371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:01.472421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'34","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:00.244636+0000","last_change":"2024-09-12T00:17:58.353482+0000","last_active":"2024-09-12T01:13:00.244636+0000","last_peered":"2024-09-12T01:13:00.244636+0000","last_clean":"2024-09-12T01:13:00.244636+0000","last_became_active":"2024-09-12T00:17:58.353045+0000","last_became_peered":"2024-09-12T00:17:58.353045+0000","last_unstale":"2024-09-12T01:13:00.244636+0000","last_undegraded":"2024-09-12T01:13:00.244636+0000","last_fullsized":"2024-09-12T01:13:00.244636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:52.688622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.237224+0000","last_change":"2024-09-12T00:39:26.637464+0000","last_active":"2024-09-12T01:13:23.237224+0000","last_peered":"2024-09-12T01:13:23.237224+0000","last_clean":"2024-09-12T01:13:23.237224+0000","last_became_active":"2024-09-12T00:39:26.637185+0000","last_became_peered":"2024-09-12T00:39:26.637185+0000","last_unstale":"2024-09-12T01:13:23.237224+0000","last_undegraded":"2024-09-12T01:13:23.237224+0000","last_fullsized":"2024-09-12T01:13:23.237224+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:20.137461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.244311+0000","last_change":"2024-09-12T00:22:02.428079+0000","last_active":"2024-09-12T01:14:13.244311+0000","last_peered":"2024-09-12T01:14:13.244311+0000","last_clean":"2024-09-12T01:14:13.244311+0000","last_became_active":"2024-09-12T00:22:02.427612+0000","last_became_peered":"2024-09-12T00:22:02.427612+0000","last_unstale":"2024-09-12T01:14:13.244311+0000","last_undegraded":"2024-09-12T01:14:13.244311+0000","last_fullsized":"2024-09-12T01:14:13.244311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.260856+0000","last_change":"2024-09-12T00:21:58.335917+0000","last_active":"2024-09-12T01:14:03.260856+0000","last_peered":"2024-09-12T01:14:03.260856+0000","last_clean":"2024-09-12T01:14:03.260856+0000","last_became_active":"2024-09-12T00:21:58.335619+0000","last_became_peered":"2024-09-12T00:21:58.335619+0000","last_unstale":"2024-09-12T01:14:03.260856+0000","last_undegraded":"2024-09-12T01:14:03.260856+0000","last_fullsized":"2024-09-12T01:14:03.260856+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455358+0000","last_change":"2024-09-12T00:17:58.356021+0000","last_active":"2024-09-12T01:12:58.455358+0000","last_peered":"2024-09-12T01:12:58.455358+0000","last_clean":"2024-09-12T01:12:58.455358+0000","last_became_active":"2024-09-12T00:17:58.355691+0000","last_became_peered":"2024-09-12T00:17:58.355691+0000","last_unstale":"2024-09-12T01:12:58.455358+0000","last_undegraded":"2024-09-12T01:12:58.455358+0000","last_fullsized":"2024-09-12T01:12:58.455358+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:23.027551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238400+0000","last_change":"2024-09-12T00:39:26.635830+0000","last_active":"2024-09-12T01:13:33.238400+0000","last_peered":"2024-09-12T01:13:33.238400+0000","last_clean":"2024-09-12T01:13:33.238400+0000","last_became_active":"2024-09-12T00:39:26.635537+0000","last_became_peered":"2024-09-12T00:39:26.635537+0000","last_unstale":"2024-09-12T01:13:33.238400+0000","last_undegraded":"2024-09-12T01:13:33.238400+0000","last_fullsized":"2024-09-12T01:13:33.238400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:16.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.510161+0000","last_change":"2024-09-12T00:22:02.429586+0000","last_active":"2024-09-12T01:12:53.510161+0000","last_peered":"2024-09-12T01:12:53.510161+0000","last_clean":"2024-09-12T01:12:53.510161+0000","last_became_active":"2024-09-12T00:22:02.429230+0000","last_became_peered":"2024-09-12T00:22:02.429230+0000","last_unstale":"2024-09-12T01:12:53.510161+0000","last_undegraded":"2024-09-12T01:12:53.510161+0000","last_fullsized":"2024-09-12T01:12:53.510161+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:50.744822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'5","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.221802+0000","last_change":"2024-09-12T00:21:58.338788+0000","last_active":"2024-09-12T01:15:48.221802+0000","last_peered":"2024-09-12T01:15:48.221802+0000","last_clean":"2024-09-12T01:15:48.221802+0000","last_became_active":"2024-09-12T00:21:58.338021+0000","last_became_peered":"2024-09-12T00:21:58.338021+0000","last_unstale":"2024-09-12T01:15:48.221802+0000","last_undegraded":"2024-09-12T01:15:48.221802+0000","last_fullsized":"2024-09-12T01:15:48.221802+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:31.346206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'22","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:58.455331+0000","last_change":"2024-09-12T00:17:58.358082+0000","last_active":"2024-09-12T01:12:58.455331+0000","last_peered":"2024-09-12T01:12:58.455331+0000","last_clean":"2024-09-12T01:12:58.455331+0000","last_became_active":"2024-09-12T00:17:58.357755+0000","last_became_peered":"2024-09-12T00:17:58.357755+0000","last_unstale":"2024-09-12T01:12:58.455331+0000","last_undegraded":"2024-09-12T01:12:58.455331+0000","last_fullsized":"2024-09-12T01:12:58.455331+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:17.853509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.235439+0000","last_change":"2024-09-12T00:39:26.631339+0000","last_active":"2024-09-12T01:12:48.235439+0000","last_peered":"2024-09-12T01:12:48.235439+0000","last_clean":"2024-09-12T01:12:48.235439+0000","last_became_active":"2024-09-12T00:39:26.630758+0000","last_became_peered":"2024-09-12T00:39:26.630758+0000","last_unstale":"2024-09-12T01:12:48.235439+0000","last_undegraded":"2024-09-12T01:12:48.235439+0000","last_fullsized":"2024-09-12T01:12:48.235439+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.184229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'5","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.401417+0000","last_change":"2024-09-12T01:16:30.401417+0000","last_active":"2024-09-12T01:16:30.401417+0000","last_peered":"2024-09-12T01:16:30.401417+0000","last_clean":"2024-09-12T01:16:30.401417+0000","last_became_active":"2024-09-12T00:22:02.427863+0000","last_became_peered":"2024-09-12T00:22:02.427863+0000","last_unstale":"2024-09-12T01:16:30.401417+0000","last_undegraded":"2024-09-12T01:16:30.401417+0000","last_fullsized":"2024-09-12T01:16:30.401417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:30.401321+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:30.401321+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.401321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:49.965892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":40,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.397371+0000","last_change":"2024-09-12T00:21:58.330893+0000","last_active":"2024-09-12T01:12:53.397371+0000","last_peered":"2024-09-12T01:12:53.397371+0000","last_clean":"2024-09-12T01:12:53.397371+0000","last_became_active":"2024-09-12T00:21:58.330308+0000","last_became_peered":"2024-09-12T00:21:58.330308+0000","last_unstale":"2024-09-12T01:12:53.397371+0000","last_undegraded":"2024-09-12T01:12:53.397371+0000","last_fullsized":"2024-09-12T01:12:53.397371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.864549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'33","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.322083+0000","last_change":"2024-09-12T01:16:25.322083+0000","last_active":"2024-09-12T01:16:25.322083+0000","last_peered":"2024-09-12T01:16:25.322083+0000","last_clean":"2024-09-12T01:16:25.322083+0000","last_became_active":"2024-09-12T00:17:58.360394+0000","last_became_peered":"2024-09-12T00:17:58.360394+0000","last_unstale":"2024-09-12T01:16:25.322083+0000","last_undegraded":"2024-09-12T01:16:25.322083+0000","last_fullsized":"2024-09-12T01:16:25.322083+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-12T01:16:25.322003+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-12T01:16:25.322003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.322003+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:07.467681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":120,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391380+0000","last_change":"2024-09-12T00:39:26.638745+0000","last_active":"2024-09-12T01:11:58.391380+0000","last_peered":"2024-09-12T01:11:58.391380+0000","last_clean":"2024-09-12T01:11:58.391380+0000","last_became_active":"2024-09-12T00:39:26.638443+0000","last_became_peered":"2024-09-12T00:39:26.638443+0000","last_unstale":"2024-09-12T01:11:58.391380+0000","last_undegraded":"2024-09-12T01:11:58.391380+0000","last_fullsized":"2024-09-12T01:11:58.391380+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:39.177058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"264'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.404392+0000","last_change":"2024-09-12T01:16:31.404392+0000","last_active":"2024-09-12T01:16:31.404392+0000","last_peered":"2024-09-12T01:16:31.404392+0000","last_clean":"2024-09-12T01:16:31.404392+0000","last_became_active":"2024-09-12T00:22:02.419920+0000","last_became_peered":"2024-09-12T00:22:02.419920+0000","last_unstale":"2024-09-12T01:16:31.404392+0000","last_undegraded":"2024-09-12T01:16:31.404392+0000","last_fullsized":"2024-09-12T01:16:31.404392+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:31.404304+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:31.404304+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.404304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:38.209811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6462,"num_write":5,"num_write_kb":6462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.057954+0000","last_change":"2024-09-12T00:21:58.334923+0000","last_active":"2024-09-12T01:15:48.057954+0000","last_peered":"2024-09-12T01:15:48.057954+0000","last_clean":"2024-09-12T01:15:48.057954+0000","last_became_active":"2024-09-12T00:21:58.334622+0000","last_became_peered":"2024-09-12T00:21:58.334622+0000","last_unstale":"2024-09-12T01:15:48.057954+0000","last_undegraded":"2024-09-12T01:15:48.057954+0000","last_fullsized":"2024-09-12T01:15:48.057954+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:27.246572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'18","reported_seq":108,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:50.250668+0000","last_change":"2024-09-12T00:17:58.362164+0000","last_active":"2024-09-12T01:13:50.250668+0000","last_peered":"2024-09-12T01:13:50.250668+0000","last_clean":"2024-09-12T01:13:50.250668+0000","last_became_active":"2024-09-12T00:17:58.361620+0000","last_became_peered":"2024-09-12T00:17:58.361620+0000","last_unstale":"2024-09-12T01:13:50.250668+0000","last_undegraded":"2024-09-12T01:13:50.250668+0000","last_fullsized":"2024-09-12T01:13:50.250668+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391431+0000","last_change":"2024-09-12T00:39:26.643583+0000","last_active":"2024-09-12T01:11:58.391431+0000","last_peered":"2024-09-12T01:11:58.391431+0000","last_clean":"2024-09-12T01:11:58.391431+0000","last_became_active":"2024-09-12T00:39:26.643223+0000","last_became_peered":"2024-09-12T00:39:26.643223+0000","last_unstale":"2024-09-12T01:11:58.391431+0000","last_undegraded":"2024-09-12T01:11:58.391431+0000","last_fullsized":"2024-09-12T01:11:58.391431+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:18.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'5","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066478+0000","last_change":"2024-09-12T00:22:22.312042+0000","last_active":"2024-09-12T01:15:48.066478+0000","last_peered":"2024-09-12T01:15:48.066478+0000","last_clean":"2024-09-12T01:15:48.066478+0000","last_became_active":"2024-09-12T00:22:22.311701+0000","last_became_peered":"2024-09-12T00:22:22.311701+0000","last_unstale":"2024-09-12T01:15:48.066478+0000","last_undegraded":"2024-09-12T01:15:48.066478+0000","last_fullsized":"2024-09-12T01:15:48.066478+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.780165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":5,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.237766+0000","last_change":"2024-09-12T00:21:58.339874+0000","last_active":"2024-09-12T01:12:00.237766+0000","last_peered":"2024-09-12T01:12:00.237766+0000","last_clean":"2024-09-12T01:12:00.237766+0000","last_became_active":"2024-09-12T00:21:58.339586+0000","last_became_peered":"2024-09-12T00:21:58.339586+0000","last_unstale":"2024-09-12T01:12:00.237766+0000","last_undegraded":"2024-09-12T01:12:00.237766+0000","last_fullsized":"2024-09-12T01:12:00.237766+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:27.131816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'26","reported_seq":137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.278337+0000","last_change":"2024-09-12T01:16:26.278337+0000","last_active":"2024-09-12T01:16:26.278337+0000","last_peered":"2024-09-12T01:16:26.278337+0000","last_clean":"2024-09-12T01:16:26.278337+0000","last_became_active":"2024-09-12T00:17:58.352129+0000","last_became_peered":"2024-09-12T00:17:58.352129+0000","last_unstale":"2024-09-12T01:16:26.278337+0000","last_undegraded":"2024-09-12T01:16:26.278337+0000","last_fullsized":"2024-09-12T01:16:26.278337+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T01:16:26.278250+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T01:16:26.278250+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.278250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:58.119622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.230767+0000","last_change":"2024-09-12T00:39:26.636027+0000","last_active":"2024-09-12T01:12:08.230767+0000","last_peered":"2024-09-12T01:12:08.230767+0000","last_clean":"2024-09-12T01:12:08.230767+0000","last_became_active":"2024-09-12T00:39:26.635558+0000","last_became_peered":"2024-09-12T00:39:26.635558+0000","last_unstale":"2024-09-12T01:12:08.230767+0000","last_undegraded":"2024-09-12T01:12:08.230767+0000","last_fullsized":"2024-09-12T01:12:08.230767+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.105963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:13.252261+0000","last_change":"2024-09-12T00:22:02.427487+0000","last_active":"2024-09-12T01:15:13.252261+0000","last_peered":"2024-09-12T01:15:13.252261+0000","last_clean":"2024-09-12T01:15:13.252261+0000","last_became_active":"2024-09-12T00:22:02.427180+0000","last_became_peered":"2024-09-12T00:22:02.427180+0000","last_unstale":"2024-09-12T01:15:13.252261+0000","last_undegraded":"2024-09-12T01:15:13.252261+0000","last_fullsized":"2024-09-12T01:15:13.252261+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:40.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.535314+0000","last_change":"2024-09-12T00:21:58.334729+0000","last_active":"2024-09-12T01:15:43.535314+0000","last_peered":"2024-09-12T01:15:43.535314+0000","last_clean":"2024-09-12T01:15:43.535314+0000","last_became_active":"2024-09-12T00:21:58.334446+0000","last_became_peered":"2024-09-12T00:21:58.334446+0000","last_unstale":"2024-09-12T01:15:43.535314+0000","last_undegraded":"2024-09-12T01:15:43.535314+0000","last_fullsized":"2024-09-12T01:15:43.535314+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:37.568023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'14","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:35.248951+0000","last_change":"2024-09-12T00:17:58.360971+0000","last_active":"2024-09-12T01:13:35.248951+0000","last_peered":"2024-09-12T01:13:35.248951+0000","last_clean":"2024-09-12T01:13:35.248951+0000","last_became_active":"2024-09-12T00:17:58.360560+0000","last_became_peered":"2024-09-12T00:17:58.360560+0000","last_unstale":"2024-09-12T01:13:35.248951+0000","last_undegraded":"2024-09-12T01:13:35.248951+0000","last_fullsized":"2024-09-12T01:13:35.248951+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.248007+0000","last_change":"2024-09-12T01:16:25.248007+0000","last_active":"2024-09-12T01:16:25.248007+0000","last_peered":"2024-09-12T01:16:25.248007+0000","last_clean":"2024-09-12T01:16:25.248007+0000","last_became_active":"2024-09-12T00:39:26.635359+0000","last_became_peered":"2024-09-12T00:39:26.635359+0000","last_unstale":"2024-09-12T01:16:25.248007+0000","last_undegraded":"2024-09-12T01:16:25.248007+0000","last_fullsized":"2024-09-12T01:16:25.248007+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:25.247921+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:25.247921+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.247921+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:23.777053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.066730+0000","last_change":"2024-09-12T00:22:02.432403+0000","last_active":"2024-09-12T01:15:48.066730+0000","last_peered":"2024-09-12T01:15:48.066730+0000","last_clean":"2024-09-12T01:15:48.066730+0000","last_became_active":"2024-09-12T00:22:02.431994+0000","last_became_peered":"2024-09-12T00:22:02.431994+0000","last_unstale":"2024-09-12T01:15:48.066730+0000","last_undegraded":"2024-09-12T01:15:48.066730+0000","last_fullsized":"2024-09-12T01:15:48.066730+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.483552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:43.397576+0000","last_change":"2024-09-12T00:21:58.327781+0000","last_active":"2024-09-12T01:12:43.397576+0000","last_peered":"2024-09-12T01:12:43.397576+0000","last_clean":"2024-09-12T01:12:43.397576+0000","last_became_active":"2024-09-12T00:21:58.327504+0000","last_became_peered":"2024-09-12T00:21:58.327504+0000","last_unstale":"2024-09-12T01:12:43.397576+0000","last_undegraded":"2024-09-12T01:12:43.397576+0000","last_fullsized":"2024-09-12T01:12:43.397576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:09.606355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'62","reported_seq":222,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238426+0000","last_change":"2024-09-12T00:17:58.360373+0000","last_active":"2024-09-12T01:13:33.238426+0000","last_peered":"2024-09-12T01:13:33.238426+0000","last_clean":"2024-09-12T01:13:33.238426+0000","last_became_active":"2024-09-12T00:17:58.360095+0000","last_became_peered":"2024-09-12T00:17:58.360095+0000","last_unstale":"2024-09-12T01:13:33.238426+0000","last_undegraded":"2024-09-12T01:13:33.238426+0000","last_fullsized":"2024-09-12T01:13:33.238426+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":213,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.392762+0000","last_change":"2024-09-12T00:39:26.639982+0000","last_active":"2024-09-12T01:12:08.392762+0000","last_peered":"2024-09-12T01:12:08.392762+0000","last_clean":"2024-09-12T01:12:08.392762+0000","last_became_active":"2024-09-12T00:39:26.639681+0000","last_became_peered":"2024-09-12T00:39:26.639681+0000","last_unstale":"2024-09-12T01:12:08.392762+0000","last_undegraded":"2024-09-12T01:12:08.392762+0000","last_fullsized":"2024-09-12T01:12:08.392762+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:35.336644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.454200+0000","last_change":"2024-09-12T00:22:02.427581+0000","last_active":"2024-09-12T01:12:48.454200+0000","last_peered":"2024-09-12T01:12:48.454200+0000","last_clean":"2024-09-12T01:12:48.454200+0000","last_became_active":"2024-09-12T00:22:02.427285+0000","last_became_peered":"2024-09-12T00:22:02.427285+0000","last_unstale":"2024-09-12T01:12:48.454200+0000","last_undegraded":"2024-09-12T01:12:48.454200+0000","last_fullsized":"2024-09-12T01:12:48.454200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:22.119778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.214116+0000","last_change":"2024-09-12T01:16:21.214116+0000","last_active":"2024-09-12T01:16:21.214116+0000","last_peered":"2024-09-12T01:16:21.214116+0000","last_clean":"2024-09-12T01:16:21.214116+0000","last_became_active":"2024-09-12T00:21:58.335100+0000","last_became_peered":"2024-09-12T00:21:58.335100+0000","last_unstale":"2024-09-12T01:16:21.214116+0000","last_undegraded":"2024-09-12T01:16:21.214116+0000","last_fullsized":"2024-09-12T01:16:21.214116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:21.214016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:21.214016+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.214016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:39.484612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'92","reported_seq":379,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.220753+0000","last_change":"2024-09-12T01:16:17.220753+0000","last_active":"2024-09-12T01:16:17.220753+0000","last_peered":"2024-09-12T01:16:17.220753+0000","last_clean":"2024-09-12T01:16:17.220753+0000","last_became_active":"2024-09-12T00:17:58.350522+0000","last_became_peered":"2024-09-12T00:17:58.350522+0000","last_unstale":"2024-09-12T01:16:17.220753+0000","last_undegraded":"2024-09-12T01:16:17.220753+0000","last_fullsized":"2024-09-12T01:16:17.220753+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'92","last_scrub_stamp":"2024-09-12T01:16:17.220682+0000","last_deep_scrub":"267'92","last_deep_scrub_stamp":"2024-09-12T01:16:17.220682+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.220682+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:17.904421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":413,"num_write":129,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4000,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.503487+0000","last_change":"2024-09-12T00:39:26.642765+0000","last_active":"2024-09-12T01:12:08.503487+0000","last_peered":"2024-09-12T01:12:08.503487+0000","last_clean":"2024-09-12T01:12:08.503487+0000","last_became_active":"2024-09-12T00:39:26.642486+0000","last_became_peered":"2024-09-12T00:39:26.642486+0000","last_unstale":"2024-09-12T01:12:08.503487+0000","last_undegraded":"2024-09-12T01:12:08.503487+0000","last_fullsized":"2024-09-12T01:12:08.503487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:37.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396598+0000","last_change":"2024-09-12T00:22:02.418272+0000","last_active":"2024-09-12T01:12:48.396598+0000","last_peered":"2024-09-12T01:12:48.396598+0000","last_clean":"2024-09-12T01:12:48.396598+0000","last_became_active":"2024-09-12T00:22:02.417518+0000","last_became_peered":"2024-09-12T00:22:02.417518+0000","last_unstale":"2024-09-12T01:12:48.396598+0000","last_undegraded":"2024-09-12T01:12:48.396598+0000","last_fullsized":"2024-09-12T01:12:48.396598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.931899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.211527+0000","last_change":"2024-09-12T00:21:58.337365+0000","last_active":"2024-09-12T01:15:48.211527+0000","last_peered":"2024-09-12T01:15:48.211527+0000","last_clean":"2024-09-12T01:15:48.211527+0000","last_became_active":"2024-09-12T00:21:58.337079+0000","last_became_peered":"2024-09-12T00:21:58.337079+0000","last_unstale":"2024-09-12T01:15:48.211527+0000","last_undegraded":"2024-09-12T01:15:48.211527+0000","last_fullsized":"2024-09-12T01:15:48.211527+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.875541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24618,"num_write":22,"num_write_kb":14376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'26","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.409571+0000","last_change":"2024-09-12T00:17:58.360573+0000","last_active":"2024-09-12T01:14:08.409571+0000","last_peered":"2024-09-12T01:14:08.409571+0000","last_clean":"2024-09-12T01:14:08.409571+0000","last_became_active":"2024-09-12T00:17:58.360141+0000","last_became_peered":"2024-09-12T00:17:58.360141+0000","last_unstale":"2024-09-12T01:14:08.409571+0000","last_undegraded":"2024-09-12T01:14:08.409571+0000","last_fullsized":"2024-09-12T01:14:08.409571+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236768+0000","last_change":"2024-09-12T00:39:26.636792+0000","last_active":"2024-09-12T01:13:18.236768+0000","last_peered":"2024-09-12T01:13:18.236768+0000","last_clean":"2024-09-12T01:13:18.236768+0000","last_became_active":"2024-09-12T00:39:26.636434+0000","last_became_peered":"2024-09-12T00:39:26.636434+0000","last_unstale":"2024-09-12T01:13:18.236768+0000","last_undegraded":"2024-09-12T01:13:18.236768+0000","last_fullsized":"2024-09-12T01:13:18.236768+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:17.120295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256725+0000","last_change":"2024-09-12T00:22:02.420813+0000","last_active":"2024-09-12T01:15:43.256725+0000","last_peered":"2024-09-12T01:15:43.256725+0000","last_clean":"2024-09-12T01:15:43.256725+0000","last_became_active":"2024-09-12T00:22:02.420528+0000","last_became_peered":"2024-09-12T00:22:02.420528+0000","last_unstale":"2024-09-12T01:15:43.256725+0000","last_undegraded":"2024-09-12T01:15:43.256725+0000","last_fullsized":"2024-09-12T01:15:43.256725+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:36.557751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"267'3","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:38.274384+0000","last_change":"2024-09-12T00:21:58.337490+0000","last_active":"2024-09-12T01:15:38.274384+0000","last_peered":"2024-09-12T01:15:38.274384+0000","last_clean":"2024-09-12T01:15:38.274384+0000","last_became_active":"2024-09-12T00:21:58.337215+0000","last_became_peered":"2024-09-12T00:21:58.337215+0000","last_unstale":"2024-09-12T01:15:38.274384+0000","last_undegraded":"2024-09-12T01:15:38.274384+0000","last_fullsized":"2024-09-12T01:15:38.274384+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.089070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.408052+0000","last_change":"2024-09-12T00:17:58.360965+0000","last_active":"2024-09-12T01:13:58.408052+0000","last_peered":"2024-09-12T01:13:58.408052+0000","last_clean":"2024-09-12T01:13:58.408052+0000","last_became_active":"2024-09-12T00:17:58.360592+0000","last_became_peered":"2024-09-12T00:17:58.360592+0000","last_unstale":"2024-09-12T01:13:58.408052+0000","last_undegraded":"2024-09-12T01:13:58.408052+0000","last_fullsized":"2024-09-12T01:13:58.408052+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:20.247005+0000","last_change":"2024-09-12T00:39:26.641706+0000","last_active":"2024-09-12T01:13:20.247005+0000","last_peered":"2024-09-12T01:13:20.247005+0000","last_clean":"2024-09-12T01:13:20.247005+0000","last_became_active":"2024-09-12T00:39:26.641432+0000","last_became_peered":"2024-09-12T00:39:26.641432+0000","last_unstale":"2024-09-12T01:13:20.247005+0000","last_undegraded":"2024-09-12T01:13:20.247005+0000","last_fullsized":"2024-09-12T01:13:20.247005+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:01.345745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:23.239133+0000","last_change":"2024-09-12T00:22:02.423461+0000","last_active":"2024-09-12T01:13:23.239133+0000","last_peered":"2024-09-12T01:13:23.239133+0000","last_clean":"2024-09-12T01:13:23.239133+0000","last_became_active":"2024-09-12T00:22:02.423012+0000","last_became_peered":"2024-09-12T00:22:02.423012+0000","last_unstale":"2024-09-12T01:13:23.239133+0000","last_undegraded":"2024-09-12T01:13:23.239133+0000","last_fullsized":"2024-09-12T01:13:23.239133+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:14.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236682+0000","last_change":"2024-09-12T00:21:58.334875+0000","last_active":"2024-09-12T01:13:18.236682+0000","last_peered":"2024-09-12T01:13:18.236682+0000","last_clean":"2024-09-12T01:13:18.236682+0000","last_became_active":"2024-09-12T00:21:58.334493+0000","last_became_peered":"2024-09-12T00:21:58.334493+0000","last_unstale":"2024-09-12T01:13:18.236682+0000","last_undegraded":"2024-09-12T01:13:18.236682+0000","last_fullsized":"2024-09-12T01:13:18.236682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:46.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'39","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.600584+0000","last_change":"2024-09-12T01:16:34.600584+0000","last_active":"2024-09-12T01:16:34.600584+0000","last_peered":"2024-09-12T01:16:34.600584+0000","last_clean":"2024-09-12T01:16:34.600584+0000","last_became_active":"2024-09-12T00:17:58.354989+0000","last_became_peered":"2024-09-12T00:17:58.354989+0000","last_unstale":"2024-09-12T01:16:34.600584+0000","last_undegraded":"2024-09-12T01:16:34.600584+0000","last_fullsized":"2024-09-12T01:16:34.600584+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'39","last_scrub_stamp":"2024-09-12T01:16:34.600480+0000","last_deep_scrub":"267'39","last_deep_scrub_stamp":"2024-09-12T01:16:34.600480+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.600480+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:20.236186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":70,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.240008+0000","last_change":"2024-09-12T00:39:26.630455+0000","last_active":"2024-09-12T01:12:20.240008+0000","last_peered":"2024-09-12T01:12:20.240008+0000","last_clean":"2024-09-12T01:12:20.240008+0000","last_became_active":"2024-09-12T00:39:26.627899+0000","last_became_peered":"2024-09-12T00:39:26.627899+0000","last_unstale":"2024-09-12T01:12:20.240008+0000","last_undegraded":"2024-09-12T01:12:20.240008+0000","last_fullsized":"2024-09-12T01:12:20.240008+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:19.704293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:43.256860+0000","last_change":"2024-09-12T00:22:02.428036+0000","last_active":"2024-09-12T01:15:43.256860+0000","last_peered":"2024-09-12T01:15:43.256860+0000","last_clean":"2024-09-12T01:15:43.256860+0000","last_became_active":"2024-09-12T00:22:02.427322+0000","last_became_peered":"2024-09-12T00:22:02.427322+0000","last_unstale":"2024-09-12T01:15:43.256860+0000","last_undegraded":"2024-09-12T01:15:43.256860+0000","last_fullsized":"2024-09-12T01:15:43.256860+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:40.144405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.321361+0000","last_change":"2024-09-12T01:16:27.321361+0000","last_active":"2024-09-12T01:16:27.321361+0000","last_peered":"2024-09-12T01:16:27.321361+0000","last_clean":"2024-09-12T01:16:27.321361+0000","last_became_active":"2024-09-12T00:21:58.329166+0000","last_became_peered":"2024-09-12T00:21:58.329166+0000","last_unstale":"2024-09-12T01:16:27.321361+0000","last_undegraded":"2024-09-12T01:16:27.321361+0000","last_fullsized":"2024-09-12T01:16:27.321361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:16:27.321237+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:16:27.321237+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.321237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:45.617097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'42","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.914520+0000","last_change":"2024-09-12T01:16:31.914520+0000","last_active":"2024-09-12T01:16:31.914520+0000","last_peered":"2024-09-12T01:16:31.914520+0000","last_clean":"2024-09-12T01:16:31.914520+0000","last_became_active":"2024-09-12T00:17:58.355530+0000","last_became_peered":"2024-09-12T00:17:58.355530+0000","last_unstale":"2024-09-12T01:16:31.914520+0000","last_undegraded":"2024-09-12T01:16:31.914520+0000","last_fullsized":"2024-09-12T01:16:31.914520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:16:31.914428+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:16:31.914428+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.914428+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:59.113318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":155,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236747+0000","last_change":"2024-09-12T00:39:26.636645+0000","last_active":"2024-09-12T01:13:18.236747+0000","last_peered":"2024-09-12T01:13:18.236747+0000","last_clean":"2024-09-12T01:13:18.236747+0000","last_became_active":"2024-09-12T00:39:26.635996+0000","last_became_peered":"2024-09-12T00:39:26.635996+0000","last_unstale":"2024-09-12T01:13:18.236747+0000","last_undegraded":"2024-09-12T01:13:18.236747+0000","last_fullsized":"2024-09-12T01:13:18.236747+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:54.401173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.372292+0000","last_change":"2024-09-12T01:16:29.372292+0000","last_active":"2024-09-12T01:16:29.372292+0000","last_peered":"2024-09-12T01:16:29.372292+0000","last_clean":"2024-09-12T01:16:29.372292+0000","last_became_active":"2024-09-12T00:22:02.423766+0000","last_became_peered":"2024-09-12T00:22:02.423766+0000","last_unstale":"2024-09-12T01:16:29.372292+0000","last_undegraded":"2024-09-12T01:16:29.372292+0000","last_fullsized":"2024-09-12T01:16:29.372292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:29.372211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:29.372211+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.372211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:41.792146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.514151+0000","last_change":"2024-09-12T00:21:58.334763+0000","last_active":"2024-09-12T01:13:18.514151+0000","last_peered":"2024-09-12T01:13:18.514151+0000","last_clean":"2024-09-12T01:13:18.514151+0000","last_became_active":"2024-09-12T00:21:58.334482+0000","last_became_peered":"2024-09-12T00:21:58.334482+0000","last_unstale":"2024-09-12T01:13:18.514151+0000","last_undegraded":"2024-09-12T01:13:18.514151+0000","last_fullsized":"2024-09-12T01:13:18.514151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:05.615431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.241272+0000","last_change":"2024-09-12T00:17:58.357504+0000","last_active":"2024-09-12T01:13:58.241272+0000","last_peered":"2024-09-12T01:13:58.241272+0000","last_clean":"2024-09-12T01:13:58.241272+0000","last_became_active":"2024-09-12T00:17:58.357226+0000","last_became_peered":"2024-09-12T00:17:58.357226+0000","last_unstale":"2024-09-12T01:13:58.241272+0000","last_undegraded":"2024-09-12T01:13:58.241272+0000","last_fullsized":"2024-09-12T01:13:58.241272+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.234052+0000","last_change":"2024-09-12T01:16:24.233987+0000","last_active":"2024-09-12T01:16:24.234052+0000","last_peered":"2024-09-12T01:16:24.234052+0000","last_clean":"2024-09-12T01:16:24.234052+0000","last_became_active":"2024-09-12T00:39:26.638202+0000","last_became_peered":"2024-09-12T00:39:26.638202+0000","last_unstale":"2024-09-12T01:16:24.234052+0000","last_undegraded":"2024-09-12T01:16:24.234052+0000","last_fullsized":"2024-09-12T01:16:24.234052+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.233895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.233895+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.233895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:37.675094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:48.240177+0000","last_change":"2024-09-12T00:22:02.428671+0000","last_active":"2024-09-12T01:13:48.240177+0000","last_peered":"2024-09-12T01:13:48.240177+0000","last_clean":"2024-09-12T01:13:48.240177+0000","last_became_active":"2024-09-12T00:22:02.427762+0000","last_became_peered":"2024-09-12T00:22:02.427762+0000","last_unstale":"2024-09-12T01:13:48.240177+0000","last_undegraded":"2024-09-12T01:13:48.240177+0000","last_fullsized":"2024-09-12T01:13:48.240177+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"267'5","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.087874+0000","last_change":"2024-09-12T00:21:58.338414+0000","last_active":"2024-09-12T01:15:48.087874+0000","last_peered":"2024-09-12T01:15:48.087874+0000","last_clean":"2024-09-12T01:15:48.087874+0000","last_became_active":"2024-09-12T00:21:58.338104+0000","last_became_peered":"2024-09-12T00:21:58.338104+0000","last_unstale":"2024-09-12T01:15:48.087874+0000","last_undegraded":"2024-09-12T01:15:48.087874+0000","last_fullsized":"2024-09-12T01:15:48.087874+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10244,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'33","reported_seq":145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.448982+0000","last_change":"2024-09-12T00:17:58.352171+0000","last_active":"2024-09-12T01:12:03.448982+0000","last_peered":"2024-09-12T01:12:03.448982+0000","last_clean":"2024-09-12T01:12:03.448982+0000","last_became_active":"2024-09-12T00:17:58.351876+0000","last_became_peered":"2024-09-12T00:17:58.351876+0000","last_unstale":"2024-09-12T01:12:03.448982+0000","last_undegraded":"2024-09-12T01:12:03.448982+0000","last_fullsized":"2024-09-12T01:12:03.448982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.992607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":110,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401591+0000","last_change":"2024-09-12T00:39:26.640188+0000","last_active":"2024-09-12T01:13:13.401591+0000","last_peered":"2024-09-12T01:13:13.401591+0000","last_clean":"2024-09-12T01:13:13.401591+0000","last_became_active":"2024-09-12T00:39:26.639704+0000","last_became_peered":"2024-09-12T00:39:26.639704+0000","last_unstale":"2024-09-12T01:13:13.401591+0000","last_undegraded":"2024-09-12T01:13:13.401591+0000","last_fullsized":"2024-09-12T01:13:13.401591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.680724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'6","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.132302+0000","last_change":"2024-09-12T00:22:02.430308+0000","last_active":"2024-09-12T01:15:48.132302+0000","last_peered":"2024-09-12T01:15:48.132302+0000","last_clean":"2024-09-12T01:15:48.132302+0000","last_became_active":"2024-09-12T00:22:02.430034+0000","last_became_peered":"2024-09-12T00:22:02.430034+0000","last_unstale":"2024-09-12T01:15:48.132302+0000","last_undegraded":"2024-09-12T01:15:48.132302+0000","last_fullsized":"2024-09-12T01:15:48.132302+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.258175+0000","last_change":"2024-09-12T01:16:20.258175+0000","last_active":"2024-09-12T01:16:20.258175+0000","last_peered":"2024-09-12T01:16:20.258175+0000","last_clean":"2024-09-12T01:16:20.258175+0000","last_became_active":"2024-09-12T00:21:58.333135+0000","last_became_peered":"2024-09-12T00:21:58.333135+0000","last_unstale":"2024-09-12T01:16:20.258175+0000","last_undegraded":"2024-09-12T01:16:20.258175+0000","last_fullsized":"2024-09-12T01:16:20.258175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:20.258077+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:20.258077+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.258077+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:41.884363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'34","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.522385+0000","last_change":"2024-09-12T00:17:58.360392+0000","last_active":"2024-09-12T01:14:13.522385+0000","last_peered":"2024-09-12T01:14:13.522385+0000","last_clean":"2024-09-12T01:14:13.522385+0000","last_became_active":"2024-09-12T00:17:58.360064+0000","last_became_peered":"2024-09-12T00:17:58.360064+0000","last_unstale":"2024-09-12T01:14:13.522385+0000","last_undegraded":"2024-09-12T01:14:13.522385+0000","last_fullsized":"2024-09-12T01:14:13.522385+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":114,"num_write":67,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.433034+0000","last_change":"2024-09-12T01:16:33.433034+0000","last_active":"2024-09-12T01:16:33.433034+0000","last_peered":"2024-09-12T01:16:33.433034+0000","last_clean":"2024-09-12T01:16:33.433034+0000","last_became_active":"2024-09-12T00:39:26.620012+0000","last_became_peered":"2024-09-12T00:39:26.620012+0000","last_unstale":"2024-09-12T01:16:33.433034+0000","last_undegraded":"2024-09-12T01:16:33.433034+0000","last_fullsized":"2024-09-12T01:16:33.433034+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:33.432943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:33.432943+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.432943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.218370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.458122+0000","last_change":"2024-09-12T01:16:32.458122+0000","last_active":"2024-09-12T01:16:32.458122+0000","last_peered":"2024-09-12T01:16:32.458122+0000","last_clean":"2024-09-12T01:16:32.458122+0000","last_became_active":"2024-09-12T00:22:02.420536+0000","last_became_peered":"2024-09-12T00:22:02.420536+0000","last_unstale":"2024-09-12T01:16:32.458122+0000","last_undegraded":"2024-09-12T01:16:32.458122+0000","last_fullsized":"2024-09-12T01:16:32.458122+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.458032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.458032+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.458032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:19.110535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:45.250189+0000","last_change":"2024-09-12T00:21:58.339677+0000","last_active":"2024-09-12T01:13:45.250189+0000","last_peered":"2024-09-12T01:13:45.250189+0000","last_clean":"2024-09-12T01:13:45.250189+0000","last_became_active":"2024-09-12T00:21:58.339390+0000","last_became_peered":"2024-09-12T00:21:58.339390+0000","last_unstale":"2024-09-12T01:13:45.250189+0000","last_undegraded":"2024-09-12T01:13:45.250189+0000","last_fullsized":"2024-09-12T01:13:45.250189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'22","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.334176+0000","last_change":"2024-09-12T01:16:24.334118+0000","last_active":"2024-09-12T01:16:24.334176+0000","last_peered":"2024-09-12T01:16:24.334176+0000","last_clean":"2024-09-12T01:16:24.334176+0000","last_became_active":"2024-09-12T00:17:58.355602+0000","last_became_peered":"2024-09-12T00:17:58.355602+0000","last_unstale":"2024-09-12T01:16:24.334176+0000","last_undegraded":"2024-09-12T01:16:24.334176+0000","last_fullsized":"2024-09-12T01:16:24.334176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-12T01:16:24.334043+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-12T01:16:24.334043+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.334043+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:35.826962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.409503+0000","last_change":"2024-09-12T00:39:26.644546+0000","last_active":"2024-09-12T01:14:08.409503+0000","last_peered":"2024-09-12T01:14:08.409503+0000","last_clean":"2024-09-12T01:14:08.409503+0000","last_became_active":"2024-09-12T00:39:26.644190+0000","last_became_peered":"2024-09-12T00:39:26.644190+0000","last_unstale":"2024-09-12T01:14:08.409503+0000","last_undegraded":"2024-09-12T01:14:08.409503+0000","last_fullsized":"2024-09-12T01:14:08.409503+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.068076+0000","last_change":"2024-09-12T00:22:02.429622+0000","last_active":"2024-09-12T01:15:48.068076+0000","last_peered":"2024-09-12T01:15:48.068076+0000","last_clean":"2024-09-12T01:15:48.068076+0000","last_became_active":"2024-09-12T00:22:02.429289+0000","last_became_peered":"2024-09-12T00:22:02.429289+0000","last_unstale":"2024-09-12T01:15:48.068076+0000","last_undegraded":"2024-09-12T01:15:48.068076+0000","last_fullsized":"2024-09-12T01:15:48.068076+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'3","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.371187+0000","last_change":"2024-09-12T01:16:28.371187+0000","last_active":"2024-09-12T01:16:28.371187+0000","last_peered":"2024-09-12T01:16:28.371187+0000","last_clean":"2024-09-12T01:16:28.371187+0000","last_became_active":"2024-09-12T00:21:58.334362+0000","last_became_peered":"2024-09-12T00:21:58.334362+0000","last_unstale":"2024-09-12T01:16:28.371187+0000","last_undegraded":"2024-09-12T01:16:28.371187+0000","last_fullsized":"2024-09-12T01:16:28.371187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:16:28.371086+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:16:28.371086+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.371086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:05.721958+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'50","reported_seq":207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.229496+0000","last_change":"2024-09-12T01:16:16.229433+0000","last_active":"2024-09-12T01:16:16.229496+0000","last_peered":"2024-09-12T01:16:16.229496+0000","last_clean":"2024-09-12T01:16:16.229496+0000","last_became_active":"2024-09-12T00:17:58.353253+0000","last_became_peered":"2024-09-12T00:17:58.353253+0000","last_unstale":"2024-09-12T01:16:16.229496+0000","last_undegraded":"2024-09-12T01:16:16.229496+0000","last_fullsized":"2024-09-12T01:16:16.229496+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'50","last_scrub_stamp":"2024-09-12T01:16:16.229344+0000","last_deep_scrub":"267'50","last_deep_scrub_stamp":"2024-09-12T01:16:16.229344+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.229344+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:06.509012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":79,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.457321+0000","last_change":"2024-09-12T00:39:26.636163+0000","last_active":"2024-09-12T01:13:13.457321+0000","last_peered":"2024-09-12T01:13:13.457321+0000","last_clean":"2024-09-12T01:13:13.457321+0000","last_became_active":"2024-09-12T00:39:26.633295+0000","last_became_peered":"2024-09-12T00:39:26.633295+0000","last_unstale":"2024-09-12T01:13:13.457321+0000","last_undegraded":"2024-09-12T01:13:13.457321+0000","last_fullsized":"2024-09-12T01:13:13.457321+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:58.692850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.260744+0000","last_change":"2024-09-12T00:22:02.429406+0000","last_active":"2024-09-12T01:14:03.260744+0000","last_peered":"2024-09-12T01:14:03.260744+0000","last_clean":"2024-09-12T01:14:03.260744+0000","last_became_active":"2024-09-12T00:22:02.429088+0000","last_became_peered":"2024-09-12T00:22:02.429088+0000","last_unstale":"2024-09-12T01:14:03.260744+0000","last_undegraded":"2024-09-12T01:14:03.260744+0000","last_fullsized":"2024-09-12T01:14:03.260744+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:00.251778+0000","last_change":"2024-09-12T00:21:58.338881+0000","last_active":"2024-09-12T01:14:00.251778+0000","last_peered":"2024-09-12T01:14:00.251778+0000","last_clean":"2024-09-12T01:14:00.251778+0000","last_became_active":"2024-09-12T00:21:58.338592+0000","last_became_peered":"2024-09-12T00:21:58.338592+0000","last_unstale":"2024-09-12T01:14:00.251778+0000","last_undegraded":"2024-09-12T01:14:00.251778+0000","last_fullsized":"2024-09-12T01:14:00.251778+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'20","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.664247+0000","last_change":"2024-09-12T01:16:32.664247+0000","last_active":"2024-09-12T01:16:32.664247+0000","last_peered":"2024-09-12T01:16:32.664247+0000","last_clean":"2024-09-12T01:16:32.664247+0000","last_became_active":"2024-09-12T00:17:58.357219+0000","last_became_peered":"2024-09-12T00:17:58.357219+0000","last_unstale":"2024-09-12T01:16:32.664247+0000","last_undegraded":"2024-09-12T01:16:32.664247+0000","last_fullsized":"2024-09-12T01:16:32.664247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:16:32.664160+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:16:32.664160+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.664160+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:27.988848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":69,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.402289+0000","last_change":"2024-09-12T00:39:26.643775+0000","last_active":"2024-09-12T01:13:18.402289+0000","last_peered":"2024-09-12T01:13:18.402289+0000","last_clean":"2024-09-12T01:13:18.402289+0000","last_became_active":"2024-09-12T00:39:26.643469+0000","last_became_peered":"2024-09-12T00:39:26.643469+0000","last_unstale":"2024-09-12T01:13:18.402289+0000","last_undegraded":"2024-09-12T01:13:18.402289+0000","last_fullsized":"2024-09-12T01:13:18.402289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:16.398681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408640+0000","last_change":"2024-09-12T00:22:02.422788+0000","last_active":"2024-09-12T01:14:03.408640+0000","last_peered":"2024-09-12T01:14:03.408640+0000","last_clean":"2024-09-12T01:14:03.408640+0000","last_became_active":"2024-09-12T00:22:02.422532+0000","last_became_peered":"2024-09-12T00:22:02.422532+0000","last_unstale":"2024-09-12T01:14:03.408640+0000","last_undegraded":"2024-09-12T01:14:03.408640+0000","last_fullsized":"2024-09-12T01:14:03.408640+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.327600+0000","last_change":"2024-09-12T01:16:27.327600+0000","last_active":"2024-09-12T01:16:27.327600+0000","last_peered":"2024-09-12T01:16:27.327600+0000","last_clean":"2024-09-12T01:16:27.327600+0000","last_became_active":"2024-09-12T00:21:58.332715+0000","last_became_peered":"2024-09-12T00:21:58.332715+0000","last_unstale":"2024-09-12T01:16:27.327600+0000","last_undegraded":"2024-09-12T01:16:27.327600+0000","last_fullsized":"2024-09-12T01:16:27.327600+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:27.327505+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:27.327505+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.327505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:27.914435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'12","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.394261+0000","last_change":"2024-09-12T00:17:58.348284+0000","last_active":"2024-09-12T01:12:18.394261+0000","last_peered":"2024-09-12T01:12:18.394261+0000","last_clean":"2024-09-12T01:12:18.394261+0000","last_became_active":"2024-09-12T00:17:58.347709+0000","last_became_peered":"2024-09-12T00:17:58.347709+0000","last_unstale":"2024-09-12T01:12:18.394261+0000","last_undegraded":"2024-09-12T01:12:18.394261+0000","last_fullsized":"2024-09-12T01:12:18.394261+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:50.010174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:13.401624+0000","last_change":"2024-09-12T00:39:26.639353+0000","last_active":"2024-09-12T01:13:13.401624+0000","last_peered":"2024-09-12T01:13:13.401624+0000","last_clean":"2024-09-12T01:13:13.401624+0000","last_became_active":"2024-09-12T00:39:26.639094+0000","last_became_peered":"2024-09-12T00:39:26.639094+0000","last_unstale":"2024-09-12T01:13:13.401624+0000","last_undegraded":"2024-09-12T01:13:13.401624+0000","last_fullsized":"2024-09-12T01:13:13.401624+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.428970+0000","last_change":"2024-09-12T01:16:31.428970+0000","last_active":"2024-09-12T01:16:31.428970+0000","last_peered":"2024-09-12T01:16:31.428970+0000","last_clean":"2024-09-12T01:16:31.428970+0000","last_became_active":"2024-09-12T00:22:02.422922+0000","last_became_peered":"2024-09-12T00:22:02.422922+0000","last_unstale":"2024-09-12T01:16:31.428970+0000","last_undegraded":"2024-09-12T01:16:31.428970+0000","last_fullsized":"2024-09-12T01:16:31.428970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:31.428871+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:31.428871+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.428871+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:02.156672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:15.253603+0000","last_change":"2024-09-12T00:21:58.341237+0000","last_active":"2024-09-12T01:14:15.253603+0000","last_peered":"2024-09-12T01:14:15.253603+0000","last_clean":"2024-09-12T01:14:15.253603+0000","last_became_active":"2024-09-12T00:21:58.340910+0000","last_became_peered":"2024-09-12T00:21:58.340910+0000","last_unstale":"2024-09-12T01:14:15.253603+0000","last_undegraded":"2024-09-12T01:14:15.253603+0000","last_fullsized":"2024-09-12T01:14:15.253603+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'59","reported_seq":220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:18.244831+0000","last_change":"2024-09-12T00:17:58.351895+0000","last_active":"2024-09-12T01:14:18.244831+0000","last_peered":"2024-09-12T01:14:18.244831+0000","last_clean":"2024-09-12T01:14:18.244831+0000","last_became_active":"2024-09-12T00:17:58.351362+0000","last_became_peered":"2024-09-12T00:17:58.351362+0000","last_unstale":"2024-09-12T01:14:18.244831+0000","last_undegraded":"2024-09-12T01:14:18.244831+0000","last_fullsized":"2024-09-12T01:14:18.244831+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":214,"num_write":104,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:15.246472+0000","last_change":"2024-09-12T00:39:26.631761+0000","last_active":"2024-09-12T01:13:15.246472+0000","last_peered":"2024-09-12T01:13:15.246472+0000","last_clean":"2024-09-12T01:13:15.246472+0000","last_became_active":"2024-09-12T00:39:26.631491+0000","last_became_peered":"2024-09-12T00:39:26.631491+0000","last_unstale":"2024-09-12T01:13:15.246472+0000","last_undegraded":"2024-09-12T01:13:15.246472+0000","last_fullsized":"2024-09-12T01:13:15.246472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:37.091629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'3","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.009806+0000","last_change":"2024-09-12T00:22:02.430547+0000","last_active":"2024-09-12T01:15:48.009806+0000","last_peered":"2024-09-12T01:15:48.009806+0000","last_clean":"2024-09-12T01:15:48.009806+0000","last_became_active":"2024-09-12T00:22:02.430209+0000","last_became_peered":"2024-09-12T00:22:02.430209+0000","last_unstale":"2024-09-12T01:15:48.009806+0000","last_undegraded":"2024-09-12T01:15:48.009806+0000","last_fullsized":"2024-09-12T01:15:48.009806+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.877239+0000","last_change":"2024-09-12T01:16:32.877239+0000","last_active":"2024-09-12T01:16:32.877239+0000","last_peered":"2024-09-12T01:16:32.877239+0000","last_clean":"2024-09-12T01:16:32.877239+0000","last_became_active":"2024-09-12T00:21:58.339248+0000","last_became_peered":"2024-09-12T00:21:58.339248+0000","last_unstale":"2024-09-12T01:16:32.877239+0000","last_undegraded":"2024-09-12T01:16:32.877239+0000","last_fullsized":"2024-09-12T01:16:32.877239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.877145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.877145+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.877145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:27.966100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'36","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.339033+0000","last_change":"2024-09-12T01:16:21.338959+0000","last_active":"2024-09-12T01:16:21.339033+0000","last_peered":"2024-09-12T01:16:21.339033+0000","last_clean":"2024-09-12T01:16:21.339033+0000","last_became_active":"2024-09-12T00:17:58.358022+0000","last_became_peered":"2024-09-12T00:17:58.358022+0000","last_unstale":"2024-09-12T01:16:21.339033+0000","last_undegraded":"2024-09-12T01:16:21.339033+0000","last_fullsized":"2024-09-12T01:16:21.339033+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-09-12T01:16:21.338872+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-09-12T01:16:21.338872+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.338872+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:40.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":54,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.398216+0000","last_change":"2024-09-12T00:39:26.645252+0000","last_active":"2024-09-12T01:12:48.398216+0000","last_peered":"2024-09-12T01:12:48.398216+0000","last_clean":"2024-09-12T01:12:48.398216+0000","last_became_active":"2024-09-12T00:39:26.644935+0000","last_became_peered":"2024-09-12T00:39:26.644935+0000","last_unstale":"2024-09-12T01:12:48.398216+0000","last_undegraded":"2024-09-12T01:12:48.398216+0000","last_fullsized":"2024-09-12T01:12:48.398216+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:56.007971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:25.254977+0000","last_change":"2024-09-12T00:22:02.424691+0000","last_active":"2024-09-12T01:14:25.254977+0000","last_peered":"2024-09-12T01:14:25.254977+0000","last_clean":"2024-09-12T01:14:25.254977+0000","last_became_active":"2024-09-12T00:22:02.424116+0000","last_became_peered":"2024-09-12T00:22:02.424116+0000","last_unstale":"2024-09-12T01:14:25.254977+0000","last_undegraded":"2024-09-12T01:14:25.254977+0000","last_fullsized":"2024-09-12T01:14:25.254977+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'6","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.295710+0000","last_change":"2024-09-12T00:21:58.332119+0000","last_active":"2024-09-12T01:15:48.295710+0000","last_peered":"2024-09-12T01:15:48.295710+0000","last_clean":"2024-09-12T01:15:48.295710+0000","last_became_active":"2024-09-12T00:21:58.331839+0000","last_became_peered":"2024-09-12T00:21:58.331839+0000","last_unstale":"2024-09-12T01:15:48.295710+0000","last_undegraded":"2024-09-12T01:15:48.295710+0000","last_fullsized":"2024-09-12T01:15:48.295710+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'6","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.647193+0000","last_change":"2024-09-12T01:16:33.647193+0000","last_active":"2024-09-12T01:16:33.647193+0000","last_peered":"2024-09-12T01:16:33.647193+0000","last_clean":"2024-09-12T01:16:33.647193+0000","last_became_active":"2024-09-12T00:17:58.354568+0000","last_became_peered":"2024-09-12T00:17:58.354568+0000","last_unstale":"2024-09-12T01:16:33.647193+0000","last_undegraded":"2024-09-12T01:16:33.647193+0000","last_fullsized":"2024-09-12T01:16:33.647193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:16:33.647093+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:16:33.647093+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.647093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:35.308243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.509385+0000","last_change":"2024-09-12T00:39:26.640912+0000","last_active":"2024-09-12T01:12:48.509385+0000","last_peered":"2024-09-12T01:12:48.509385+0000","last_clean":"2024-09-12T01:12:48.509385+0000","last_became_active":"2024-09-12T00:39:26.635679+0000","last_became_peered":"2024-09-12T00:39:26.635679+0000","last_unstale":"2024-09-12T01:12:48.509385+0000","last_undegraded":"2024-09-12T01:12:48.509385+0000","last_fullsized":"2024-09-12T01:12:48.509385+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:19.017813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'15","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.130463+0000","last_change":"2024-09-12T00:22:02.420520+0000","last_active":"2024-09-12T01:15:48.130463+0000","last_peered":"2024-09-12T01:15:48.130463+0000","last_clean":"2024-09-12T01:15:48.130463+0000","last_became_active":"2024-09-12T00:22:02.420246+0000","last_became_peered":"2024-09-12T00:22:02.420246+0000","last_unstale":"2024-09-12T01:15:48.130463+0000","last_undegraded":"2024-09-12T01:15:48.130463+0000","last_fullsized":"2024-09-12T01:15:48.130463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.255683+0000","last_change":"2024-09-12T01:16:19.255683+0000","last_active":"2024-09-12T01:16:19.255683+0000","last_peered":"2024-09-12T01:16:19.255683+0000","last_clean":"2024-09-12T01:16:19.255683+0000","last_became_active":"2024-09-12T00:21:58.332362+0000","last_became_peered":"2024-09-12T00:21:58.332362+0000","last_unstale":"2024-09-12T01:16:19.255683+0000","last_undegraded":"2024-09-12T01:16:19.255683+0000","last_fullsized":"2024-09-12T01:16:19.255683+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:16:19.255591+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:16:19.255591+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.255591+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:22.082056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'54","reported_seq":208,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.379318+0000","last_change":"2024-09-12T01:16:22.379248+0000","last_active":"2024-09-12T01:16:22.379318+0000","last_peered":"2024-09-12T01:16:22.379318+0000","last_clean":"2024-09-12T01:16:22.379318+0000","last_became_active":"2024-09-12T00:17:58.356120+0000","last_became_peered":"2024-09-12T00:17:58.356120+0000","last_unstale":"2024-09-12T01:16:22.379318+0000","last_undegraded":"2024-09-12T01:16:22.379318+0000","last_fullsized":"2024-09-12T01:16:22.379318+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'54","last_scrub_stamp":"2024-09-12T01:16:22.379129+0000","last_deep_scrub":"267'54","last_deep_scrub_stamp":"2024-09-12T01:16:22.379129+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.379129+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:19.689178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":175,"num_write":100,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:38.240729+0000","last_change":"2024-09-12T00:39:26.625293+0000","last_active":"2024-09-12T01:13:38.240729+0000","last_peered":"2024-09-12T01:13:38.240729+0000","last_clean":"2024-09-12T01:13:38.240729+0000","last_became_active":"2024-09-12T00:39:26.624994+0000","last_became_peered":"2024-09-12T00:39:26.624994+0000","last_unstale":"2024-09-12T01:13:38.240729+0000","last_undegraded":"2024-09-12T01:13:38.240729+0000","last_fullsized":"2024-09-12T01:13:38.240729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:56.114504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'5","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:03.408780+0000","last_change":"2024-09-12T00:22:02.424780+0000","last_active":"2024-09-12T01:14:03.408780+0000","last_peered":"2024-09-12T01:14:03.408780+0000","last_clean":"2024-09-12T01:14:03.408780+0000","last_became_active":"2024-09-12T00:22:02.424412+0000","last_became_peered":"2024-09-12T00:22:02.424412+0000","last_unstale":"2024-09-12T01:14:03.408780+0000","last_undegraded":"2024-09-12T01:14:03.408780+0000","last_fullsized":"2024-09-12T01:14:03.408780+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.520118+0000","last_change":"2024-09-12T00:21:58.334861+0000","last_active":"2024-09-12T01:13:58.520118+0000","last_peered":"2024-09-12T01:13:58.520118+0000","last_clean":"2024-09-12T01:13:58.520118+0000","last_became_active":"2024-09-12T00:21:58.334536+0000","last_became_peered":"2024-09-12T00:21:58.334536+0000","last_unstale":"2024-09-12T01:13:58.520118+0000","last_undegraded":"2024-09-12T01:13:58.520118+0000","last_fullsized":"2024-09-12T01:13:58.520118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'42","reported_seq":189,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.893081+0000","last_change":"2024-09-12T01:16:31.893081+0000","last_active":"2024-09-12T01:16:31.893081+0000","last_peered":"2024-09-12T01:16:31.893081+0000","last_clean":"2024-09-12T01:16:31.893081+0000","last_became_active":"2024-09-12T00:17:58.353219+0000","last_became_peered":"2024-09-12T00:17:58.353219+0000","last_unstale":"2024-09-12T01:16:31.893081+0000","last_undegraded":"2024-09-12T01:16:31.893081+0000","last_fullsized":"2024-09-12T01:16:31.893081+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:16:31.892979+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:16:31.892979+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.892979+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:55.483672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":151,"num_write":85,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:48.396509+0000","last_change":"2024-09-12T00:39:26.638305+0000","last_active":"2024-09-12T01:12:48.396509+0000","last_peered":"2024-09-12T01:12:48.396509+0000","last_clean":"2024-09-12T01:12:48.396509+0000","last_became_active":"2024-09-12T00:39:26.638008+0000","last_became_peered":"2024-09-12T00:39:26.638008+0000","last_unstale":"2024-09-12T01:12:48.396509+0000","last_undegraded":"2024-09-12T01:12:48.396509+0000","last_fullsized":"2024-09-12T01:12:48.396509+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:10.696670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'3","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.040491+0000","last_change":"2024-09-12T00:22:02.419773+0000","last_active":"2024-09-12T01:15:48.040491+0000","last_peered":"2024-09-12T01:15:48.040491+0000","last_clean":"2024-09-12T01:15:48.040491+0000","last_became_active":"2024-09-12T00:22:02.419443+0000","last_became_peered":"2024-09-12T00:22:02.419443+0000","last_unstale":"2024-09-12T01:15:48.040491+0000","last_undegraded":"2024-09-12T01:15:48.040491+0000","last_fullsized":"2024-09-12T01:15:48.040491+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:58.408131+0000","last_change":"2024-09-12T00:21:58.335735+0000","last_active":"2024-09-12T01:13:58.408131+0000","last_peered":"2024-09-12T01:13:58.408131+0000","last_clean":"2024-09-12T01:13:58.408131+0000","last_became_active":"2024-09-12T00:21:58.335360+0000","last_became_peered":"2024-09-12T00:21:58.335360+0000","last_unstale":"2024-09-12T01:13:58.408131+0000","last_undegraded":"2024-09-12T01:13:58.408131+0000","last_fullsized":"2024-09-12T01:13:58.408131+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'111","reported_seq":439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.319503+0000","last_change":"2024-09-12T01:16:24.319503+0000","last_active":"2024-09-12T01:16:24.319503+0000","last_peered":"2024-09-12T01:16:24.319503+0000","last_clean":"2024-09-12T01:16:24.319503+0000","last_became_active":"2024-09-12T00:17:58.355688+0000","last_became_peered":"2024-09-12T00:17:58.355688+0000","last_unstale":"2024-09-12T01:16:24.319503+0000","last_undegraded":"2024-09-12T01:16:24.319503+0000","last_fullsized":"2024-09-12T01:16:24.319503+0000","mapping_epoch":254,"log_start":"267'100","ondisk_log_start":"267'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-12T01:16:24.319420+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-12T01:16:24.319420+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.319420+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:44.709514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":717,"num_read_kb":507,"num_write":143,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4194,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.193803+0000","last_change":"2024-09-12T01:16:23.193803+0000","last_active":"2024-09-12T01:16:23.193803+0000","last_peered":"2024-09-12T01:16:23.193803+0000","last_clean":"2024-09-12T01:16:23.193803+0000","last_became_active":"2024-09-12T00:39:26.637393+0000","last_became_peered":"2024-09-12T00:39:26.637393+0000","last_unstale":"2024-09-12T01:16:23.193803+0000","last_undegraded":"2024-09-12T01:16:23.193803+0000","last_fullsized":"2024-09-12T01:16:23.193803+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:23.193699+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:23.193699+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.193699+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:41.499806+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.413263+0000","last_change":"2024-09-12T01:16:30.413263+0000","last_active":"2024-09-12T01:16:30.413263+0000","last_peered":"2024-09-12T01:16:30.413263+0000","last_clean":"2024-09-12T01:16:30.413263+0000","last_became_active":"2024-09-12T00:22:02.423601+0000","last_became_peered":"2024-09-12T00:22:02.423601+0000","last_unstale":"2024-09-12T01:16:30.413263+0000","last_undegraded":"2024-09-12T01:16:30.413263+0000","last_fullsized":"2024-09-12T01:16:30.413263+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:30.413173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:30.413173+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.413173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:07.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:08.409460+0000","last_change":"2024-09-12T00:21:58.339918+0000","last_active":"2024-09-12T01:14:08.409460+0000","last_peered":"2024-09-12T01:14:08.409460+0000","last_clean":"2024-09-12T01:14:08.409460+0000","last_became_active":"2024-09-12T00:21:58.339625+0000","last_became_peered":"2024-09-12T00:21:58.339625+0000","last_unstale":"2024-09-12T01:14:08.409460+0000","last_undegraded":"2024-09-12T01:14:08.409460+0000","last_fullsized":"2024-09-12T01:14:08.409460+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":181,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:13.522319+0000","last_change":"2024-09-12T00:17:58.357264+0000","last_active":"2024-09-12T01:14:13.522319+0000","last_peered":"2024-09-12T01:14:13.522319+0000","last_clean":"2024-09-12T01:14:13.522319+0000","last_became_active":"2024-09-12T00:17:58.356906+0000","last_became_peered":"2024-09-12T00:17:58.356906+0000","last_unstale":"2024-09-12T01:14:13.522319+0000","last_undegraded":"2024-09-12T01:14:13.522319+0000","last_fullsized":"2024-09-12T01:14:13.522319+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.332613+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.332613+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":164,"num_write":72,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:14:10.253058+0000","last_change":"2024-09-12T00:39:26.628713+0000","last_active":"2024-09-12T01:14:10.253058+0000","last_peered":"2024-09-12T01:14:10.253058+0000","last_clean":"2024-09-12T01:14:10.253058+0000","last_became_active":"2024-09-12T00:39:26.628244+0000","last_became_peered":"2024-09-12T00:39:26.628244+0000","last_unstale":"2024-09-12T01:14:10.253058+0000","last_undegraded":"2024-09-12T01:14:10.253058+0000","last_fullsized":"2024-09-12T01:14:10.253058+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.009638+0000","last_change":"2024-09-12T00:22:02.417514+0000","last_active":"2024-09-12T01:15:48.009638+0000","last_peered":"2024-09-12T01:15:48.009638+0000","last_clean":"2024-09-12T01:15:48.009638+0000","last_became_active":"2024-09-12T00:22:02.417237+0000","last_became_peered":"2024-09-12T00:22:02.417237+0000","last_unstale":"2024-09-12T01:15:48.009638+0000","last_undegraded":"2024-09-12T01:15:48.009638+0000","last_fullsized":"2024-09-12T01:15:48.009638+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.223299+0000","last_change":"2024-09-12T00:21:58.335825+0000","last_active":"2024-09-12T01:15:48.223299+0000","last_peered":"2024-09-12T01:15:48.223299+0000","last_clean":"2024-09-12T01:15:48.223299+0000","last_became_active":"2024-09-12T00:21:58.335541+0000","last_became_peered":"2024-09-12T00:21:58.335541+0000","last_unstale":"2024-09-12T01:15:48.223299+0000","last_undegraded":"2024-09-12T01:15:48.223299+0000","last_fullsized":"2024-09-12T01:15:48.223299+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:21:57.313654+0000","last_clean_scrub_stamp":"2024-09-12T00:21:57.313654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'21","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.956697+0000","last_change":"2024-09-12T01:16:29.956697+0000","last_active":"2024-09-12T01:16:29.956697+0000","last_peered":"2024-09-12T01:16:29.956697+0000","last_clean":"2024-09-12T01:16:29.956697+0000","last_became_active":"2024-09-12T00:17:58.349428+0000","last_became_peered":"2024-09-12T00:17:58.349428+0000","last_unstale":"2024-09-12T01:16:29.956697+0000","last_undegraded":"2024-09-12T01:16:29.956697+0000","last_fullsized":"2024-09-12T01:16:29.956697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T01:16:29.956611+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T01:16:29.956611+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.956611+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:47.110997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":78,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:50.243328+0000","last_change":"2024-09-12T00:39:26.641703+0000","last_active":"2024-09-12T01:12:50.243328+0000","last_peered":"2024-09-12T01:12:50.243328+0000","last_clean":"2024-09-12T01:12:50.243328+0000","last_became_active":"2024-09-12T00:39:26.641360+0000","last_became_peered":"2024-09-12T00:39:26.641360+0000","last_unstale":"2024-09-12T01:12:50.243328+0000","last_undegraded":"2024-09-12T01:12:50.243328+0000","last_fullsized":"2024-09-12T01:12:50.243328+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.843665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.370474+0000","last_change":"2024-09-12T01:16:28.370474+0000","last_active":"2024-09-12T01:16:28.370474+0000","last_peered":"2024-09-12T01:16:28.370474+0000","last_clean":"2024-09-12T01:16:28.370474+0000","last_became_active":"2024-09-12T00:22:02.430041+0000","last_became_peered":"2024-09-12T00:22:02.430041+0000","last_unstale":"2024-09-12T01:16:28.370474+0000","last_undegraded":"2024-09-12T01:16:28.370474+0000","last_fullsized":"2024-09-12T01:16:28.370474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:28.370379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:28.370379+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.370379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:20.727022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.284671+0000","last_change":"2024-09-12T01:16:25.284671+0000","last_active":"2024-09-12T01:16:25.284671+0000","last_peered":"2024-09-12T01:16:25.284671+0000","last_clean":"2024-09-12T01:16:25.284671+0000","last_became_active":"2024-09-12T00:21:58.327094+0000","last_became_peered":"2024-09-12T00:21:58.327094+0000","last_unstale":"2024-09-12T01:16:25.284671+0000","last_undegraded":"2024-09-12T01:16:25.284671+0000","last_fullsized":"2024-09-12T01:16:25.284671+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:25.284582+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:25.284582+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.284582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:40.941677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'15","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.344360+0000","last_change":"2024-09-12T01:16:23.344360+0000","last_active":"2024-09-12T01:16:23.344360+0000","last_peered":"2024-09-12T01:16:23.344360+0000","last_clean":"2024-09-12T01:16:23.344360+0000","last_became_active":"2024-09-12T00:17:58.354797+0000","last_became_peered":"2024-09-12T00:17:58.354797+0000","last_unstale":"2024-09-12T01:16:23.344360+0000","last_undegraded":"2024-09-12T01:16:23.344360+0000","last_fullsized":"2024-09-12T01:16:23.344360+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T01:16:23.344276+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T01:16:23.344276+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.344276+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.699579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:12:53.399062+0000","last_change":"2024-09-12T00:39:26.641320+0000","last_active":"2024-09-12T01:12:53.399062+0000","last_peered":"2024-09-12T01:12:53.399062+0000","last_clean":"2024-09-12T01:12:53.399062+0000","last_became_active":"2024-09-12T00:39:26.640877+0000","last_became_peered":"2024-09-12T00:39:26.640877+0000","last_unstale":"2024-09-12T01:12:53.399062+0000","last_undegraded":"2024-09-12T01:12:53.399062+0000","last_fullsized":"2024-09-12T01:12:53.399062+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:44.522883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:48.130922+0000","last_change":"2024-09-12T00:22:02.418887+0000","last_active":"2024-09-12T01:15:48.130922+0000","last_peered":"2024-09-12T01:15:48.130922+0000","last_clean":"2024-09-12T01:15:48.130922+0000","last_became_active":"2024-09-12T00:22:02.418588+0000","last_became_peered":"2024-09-12T00:22:02.418588+0000","last_unstale":"2024-09-12T01:15:48.130922+0000","last_undegraded":"2024-09-12T01:15:48.130922+0000","last_fullsized":"2024-09-12T01:15:48.130922+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:01.395068+0000","last_clean_scrub_stamp":"2024-09-12T00:22:01.395068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.292266+0000","last_change":"2024-09-12T01:16:26.292266+0000","last_active":"2024-09-12T01:16:26.292266+0000","last_peered":"2024-09-12T01:16:26.292266+0000","last_clean":"2024-09-12T01:16:26.292266+0000","last_became_active":"2024-09-12T00:21:58.331972+0000","last_became_peered":"2024-09-12T00:21:58.331972+0000","last_unstale":"2024-09-12T01:16:26.292266+0000","last_undegraded":"2024-09-12T01:16:26.292266+0000","last_fullsized":"2024-09-12T01:16:26.292266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:16:26.292184+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:16:26.292184+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.292184+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:49.501286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'16","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.891043+0000","last_change":"2024-09-12T01:16:32.891043+0000","last_active":"2024-09-12T01:16:32.891043+0000","last_peered":"2024-09-12T01:16:32.891043+0000","last_clean":"2024-09-12T01:16:32.891043+0000","last_became_active":"2024-09-12T00:17:58.357689+0000","last_became_peered":"2024-09-12T00:17:58.357689+0000","last_unstale":"2024-09-12T01:16:32.891043+0000","last_undegraded":"2024-09-12T01:16:32.891043+0000","last_fullsized":"2024-09-12T01:16:32.891043+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'16","last_scrub_stamp":"2024-09-12T01:16:32.890932+0000","last_deep_scrub":"267'16","last_deep_scrub_stamp":"2024-09-12T01:16:32.890932+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.890932+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.754132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'204","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.772916+0000","last_change":"2024-09-12T01:16:08.772916+0000","last_active":"2024-09-12T01:16:08.772916+0000","last_peered":"2024-09-12T01:16:08.772916+0000","last_clean":"2024-09-12T01:16:08.772916+0000","last_became_active":"2024-09-12T00:02:48.051117+0000","last_became_peered":"2024-09-12T00:02:48.051117+0000","last_unstale":"2024-09-12T01:16:08.772916+0000","last_undegraded":"2024-09-12T01:16:08.772916+0000","last_fullsized":"2024-09-12T01:16:08.772916+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'204","last_scrub_stamp":"2024-09-12T01:16:08.772784+0000","last_deep_scrub":"267'204","last_deep_scrub_stamp":"2024-09-12T01:16:08.772784+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.772784+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:49.188552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342064,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":17555,"num_write":999,"num_write_kb":27178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'739","reported_seq":2138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.217058+0000","last_change":"2024-09-12T01:16:17.217058+0000","last_active":"2024-09-12T01:16:17.217058+0000","last_peered":"2024-09-12T01:16:17.217058+0000","last_clean":"2024-09-12T01:16:17.217058+0000","last_became_active":"2024-09-12T00:02:50.065257+0000","last_became_peered":"2024-09-12T00:02:50.065257+0000","last_unstale":"2024-09-12T01:16:17.217058+0000","last_undegraded":"2024-09-12T01:16:17.217058+0000","last_fullsized":"2024-09-12T01:16:17.217058+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'739","last_scrub_stamp":"2024-09-12T01:16:17.216970+0000","last_deep_scrub":"267'739","last_deep_scrub_stamp":"2024-09-12T01:16:17.216970+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.216970+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:41.588976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3376,"num_read_kb":3036,"num_write":968,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'285","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.132495+0000","last_change":"2024-09-12T01:16:02.132495+0000","last_active":"2024-09-12T01:16:02.132495+0000","last_peered":"2024-09-12T01:16:02.132495+0000","last_clean":"2024-09-12T01:16:02.132495+0000","last_became_active":"2024-09-12T00:02:48.049002+0000","last_became_peered":"2024-09-12T00:02:48.049002+0000","last_unstale":"2024-09-12T01:16:02.132495+0000","last_undegraded":"2024-09-12T01:16:02.132495+0000","last_fullsized":"2024-09-12T01:16:02.132495+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-12T01:16:02.132389+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-12T01:16:02.132389+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.132389+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:19.692843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":975,"num_read_kb":18236,"num_write":1256,"num_write_kb":26545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'696","reported_seq":2340,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.782508+0000","last_change":"2024-09-12T01:16:13.782508+0000","last_active":"2024-09-12T01:16:13.782508+0000","last_peered":"2024-09-12T01:16:13.782508+0000","last_clean":"2024-09-12T01:16:13.782508+0000","last_became_active":"2024-09-12T00:02:50.063612+0000","last_became_peered":"2024-09-12T00:02:50.063612+0000","last_unstale":"2024-09-12T01:16:13.782508+0000","last_undegraded":"2024-09-12T01:16:13.782508+0000","last_fullsized":"2024-09-12T01:16:13.782508+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'696","last_scrub_stamp":"2024-09-12T01:16:13.782407+0000","last_deep_scrub":"267'696","last_deep_scrub_stamp":"2024-09-12T01:16:13.782407+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.782407+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:05.284371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3358,"num_read_kb":3023,"num_write":921,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'219","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.835122+0000","last_change":"2024-09-12T01:16:01.835122+0000","last_active":"2024-09-12T01:16:01.835122+0000","last_peered":"2024-09-12T01:16:01.835122+0000","last_clean":"2024-09-12T01:16:01.835122+0000","last_became_active":"2024-09-12T00:02:48.045960+0000","last_became_peered":"2024-09-12T00:02:48.045960+0000","last_unstale":"2024-09-12T01:16:01.835122+0000","last_undegraded":"2024-09-12T01:16:01.835122+0000","last_fullsized":"2024-09-12T01:16:01.835122+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T01:16:01.835001+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T01:16:01.835001+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.835001+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.564621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1118647,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":21329,"num_write":1072,"num_write_kb":32132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'462","reported_seq":2030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.917023+0000","last_change":"2024-09-12T01:16:12.917023+0000","last_active":"2024-09-12T01:16:12.917023+0000","last_peered":"2024-09-12T01:16:12.917023+0000","last_clean":"2024-09-12T01:16:12.917023+0000","last_became_active":"2024-09-12T00:02:50.060902+0000","last_became_peered":"2024-09-12T00:02:50.060902+0000","last_unstale":"2024-09-12T01:16:12.917023+0000","last_undegraded":"2024-09-12T01:16:12.917023+0000","last_fullsized":"2024-09-12T01:16:12.917023+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'462","last_scrub_stamp":"2024-09-12T01:16:12.916931+0000","last_deep_scrub":"267'462","last_deep_scrub_stamp":"2024-09-12T01:16:12.916931+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.916931+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:30.139448+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2604,"num_read_kb":2455,"num_write":536,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'260","reported_seq":954,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.248640+0000","last_change":"2024-09-12T01:16:09.248640+0000","last_active":"2024-09-12T01:16:09.248640+0000","last_peered":"2024-09-12T01:16:09.248640+0000","last_clean":"2024-09-12T01:16:09.248640+0000","last_became_active":"2024-09-12T00:02:48.052802+0000","last_became_peered":"2024-09-12T00:02:48.052802+0000","last_unstale":"2024-09-12T01:16:09.248640+0000","last_undegraded":"2024-09-12T01:16:09.248640+0000","last_fullsized":"2024-09-12T01:16:09.248640+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'260","last_scrub_stamp":"2024-09-12T01:16:09.248507+0000","last_deep_scrub":"267'260","last_deep_scrub_stamp":"2024-09-12T01:16:09.248507+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.248507+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.932847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":8609,"num_write":1124,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'1279","reported_seq":2874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.692636+0000","last_change":"2024-09-12T01:16:10.692636+0000","last_active":"2024-09-12T01:16:10.692636+0000","last_peered":"2024-09-12T01:16:10.692636+0000","last_clean":"2024-09-12T01:16:10.692636+0000","last_became_active":"2024-09-12T00:02:50.072574+0000","last_became_peered":"2024-09-12T00:02:50.072574+0000","last_unstale":"2024-09-12T01:16:10.692636+0000","last_undegraded":"2024-09-12T01:16:10.692636+0000","last_fullsized":"2024-09-12T01:16:10.692636+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1279","last_scrub_stamp":"2024-09-12T01:16:10.692530+0000","last_deep_scrub":"267'1279","last_deep_scrub_stamp":"2024-09-12T01:16:10.692530+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.692530+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":1200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:40.321730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5797,"num_read_kb":5069,"num_write":1818,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'162","reported_seq":797,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.708655+0000","last_change":"2024-09-12T01:16:10.708655+0000","last_active":"2024-09-12T01:16:10.708655+0000","last_peered":"2024-09-12T01:16:10.708655+0000","last_clean":"2024-09-12T01:16:10.708655+0000","last_became_active":"2024-09-12T00:02:48.052778+0000","last_became_peered":"2024-09-12T00:02:48.052778+0000","last_unstale":"2024-09-12T01:16:10.708655+0000","last_undegraded":"2024-09-12T01:16:10.708655+0000","last_fullsized":"2024-09-12T01:16:10.708655+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:10.708562+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:10.708562+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.708562+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:36.850671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":373,"num_read_kb":36558,"num_write":790,"num_write_kb":25424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'762","reported_seq":2180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.447646+0000","last_change":"2024-09-12T01:16:08.447646+0000","last_active":"2024-09-12T01:16:08.447646+0000","last_peered":"2024-09-12T01:16:08.447646+0000","last_clean":"2024-09-12T01:16:08.447646+0000","last_became_active":"2024-09-12T00:02:50.062257+0000","last_became_peered":"2024-09-12T00:02:50.062257+0000","last_unstale":"2024-09-12T01:16:08.447646+0000","last_undegraded":"2024-09-12T01:16:08.447646+0000","last_fullsized":"2024-09-12T01:16:08.447646+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-09-12T01:16:08.447540+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-09-12T01:16:08.447540+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.447540+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:13.108811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3047,"num_write":970,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'225","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.223498+0000","last_change":"2024-09-12T01:16:06.223498+0000","last_active":"2024-09-12T01:16:06.223498+0000","last_peered":"2024-09-12T01:16:06.223498+0000","last_clean":"2024-09-12T01:16:06.223498+0000","last_became_active":"2024-09-12T00:02:48.052257+0000","last_became_peered":"2024-09-12T00:02:48.052257+0000","last_unstale":"2024-09-12T01:16:06.223498+0000","last_undegraded":"2024-09-12T01:16:06.223498+0000","last_fullsized":"2024-09-12T01:16:06.223498+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-12T01:16:06.223377+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-12T01:16:06.223377+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.223377+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:59.368626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798278,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":39161,"num_write":992,"num_write_kb":40171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'409","reported_seq":1883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.938341+0000","last_change":"2024-09-12T01:16:17.938341+0000","last_active":"2024-09-12T01:16:17.938341+0000","last_peered":"2024-09-12T01:16:17.938341+0000","last_clean":"2024-09-12T01:16:17.938341+0000","last_became_active":"2024-09-12T00:02:50.060756+0000","last_became_peered":"2024-09-12T00:02:50.060756+0000","last_unstale":"2024-09-12T01:16:17.938341+0000","last_undegraded":"2024-09-12T01:16:17.938341+0000","last_fullsized":"2024-09-12T01:16:17.938341+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-09-12T01:16:17.938263+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-09-12T01:16:17.938263+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.938263+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:29.171795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2108,"num_read_kb":1993,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'193","reported_seq":860,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.759441+0000","last_change":"2024-09-12T01:16:05.759441+0000","last_active":"2024-09-12T01:16:05.759441+0000","last_peered":"2024-09-12T01:16:05.759441+0000","last_clean":"2024-09-12T01:16:05.759441+0000","last_became_active":"2024-09-12T00:03:21.143840+0000","last_became_peered":"2024-09-12T00:03:21.143840+0000","last_unstale":"2024-09-12T01:16:05.759441+0000","last_undegraded":"2024-09-12T01:16:05.759441+0000","last_fullsized":"2024-09-12T01:16:05.759441+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:16:05.759305+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:16:05.759305+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.759305+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:05.625596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":20506,"num_write":998,"num_write_kb":32663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'433","reported_seq":1997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.238800+0000","last_change":"2024-09-12T01:16:16.238800+0000","last_active":"2024-09-12T01:16:16.238800+0000","last_peered":"2024-09-12T01:16:16.238800+0000","last_clean":"2024-09-12T01:16:16.238800+0000","last_became_active":"2024-09-12T00:02:50.064658+0000","last_became_peered":"2024-09-12T00:02:50.064658+0000","last_unstale":"2024-09-12T01:16:16.238800+0000","last_undegraded":"2024-09-12T01:16:16.238800+0000","last_fullsized":"2024-09-12T01:16:16.238800+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'433","last_scrub_stamp":"2024-09-12T01:16:16.238682+0000","last_deep_scrub":"267'433","last_deep_scrub_stamp":"2024-09-12T01:16:16.238682+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.238682+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:40.925562+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":488,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'181","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.718672+0000","last_change":"2024-09-12T01:16:02.718672+0000","last_active":"2024-09-12T01:16:02.718672+0000","last_peered":"2024-09-12T01:16:02.718672+0000","last_clean":"2024-09-12T01:16:02.718672+0000","last_became_active":"2024-09-12T00:02:48.058678+0000","last_became_peered":"2024-09-12T00:02:48.058678+0000","last_unstale":"2024-09-12T01:16:02.718672+0000","last_undegraded":"2024-09-12T01:16:02.718672+0000","last_fullsized":"2024-09-12T01:16:02.718672+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T01:16:02.718561+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T01:16:02.718561+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.718561+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:30.288718+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170390,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1879,"num_write":959,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'893","reported_seq":2468,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.250161+0000","last_change":"2024-09-12T01:16:11.250161+0000","last_active":"2024-09-12T01:16:11.250161+0000","last_peered":"2024-09-12T01:16:11.250161+0000","last_clean":"2024-09-12T01:16:11.250161+0000","last_became_active":"2024-09-12T00:02:50.069840+0000","last_became_peered":"2024-09-12T00:02:50.069840+0000","last_unstale":"2024-09-12T01:16:11.250161+0000","last_undegraded":"2024-09-12T01:16:11.250161+0000","last_fullsized":"2024-09-12T01:16:11.250161+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'893","last_scrub_stamp":"2024-09-12T01:16:11.250063+0000","last_deep_scrub":"267'893","last_deep_scrub_stamp":"2024-09-12T01:16:11.250063+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.250063+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:33.826482+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4122,"num_read_kb":3699,"num_write":1233,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'601","reported_seq":2192,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.878551+0000","last_change":"2024-09-12T01:16:09.878551+0000","last_active":"2024-09-12T01:16:09.878551+0000","last_peered":"2024-09-12T01:16:09.878551+0000","last_clean":"2024-09-12T01:16:09.878551+0000","last_became_active":"2024-09-12T00:02:50.060919+0000","last_became_peered":"2024-09-12T00:02:50.060919+0000","last_unstale":"2024-09-12T01:16:09.878551+0000","last_undegraded":"2024-09-12T01:16:09.878551+0000","last_fullsized":"2024-09-12T01:16:09.878551+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'601","last_scrub_stamp":"2024-09-12T01:16:09.878461+0000","last_deep_scrub":"267'601","last_deep_scrub_stamp":"2024-09-12T01:16:09.878461+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.878461+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:51.104915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3046,"num_read_kb":2788,"num_write":785,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'202","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.738292+0000","last_change":"2024-09-12T01:16:07.738292+0000","last_active":"2024-09-12T01:16:07.738292+0000","last_peered":"2024-09-12T01:16:07.738292+0000","last_clean":"2024-09-12T01:16:07.738292+0000","last_became_active":"2024-09-12T00:02:48.050909+0000","last_became_peered":"2024-09-12T00:02:48.050909+0000","last_unstale":"2024-09-12T01:16:07.738292+0000","last_undegraded":"2024-09-12T01:16:07.738292+0000","last_fullsized":"2024-09-12T01:16:07.738292+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'202","last_scrub_stamp":"2024-09-12T01:16:07.738154+0000","last_deep_scrub":"267'202","last_deep_scrub_stamp":"2024-09-12T01:16:07.738154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.738154+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.887555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":10751,"num_write":911,"num_write_kb":36355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'827","reported_seq":2323,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.741265+0000","last_change":"2024-09-12T01:16:12.741265+0000","last_active":"2024-09-12T01:16:12.741265+0000","last_peered":"2024-09-12T01:16:12.741265+0000","last_clean":"2024-09-12T01:16:12.741265+0000","last_became_active":"2024-09-12T00:02:50.072791+0000","last_became_peered":"2024-09-12T00:02:50.072791+0000","last_unstale":"2024-09-12T01:16:12.741265+0000","last_undegraded":"2024-09-12T01:16:12.741265+0000","last_fullsized":"2024-09-12T01:16:12.741265+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-12T01:16:12.741138+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-12T01:16:12.741138+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.741138+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:18.033096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3382,"num_write":1095,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'201","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.501668+0000","last_change":"2024-09-12T01:16:03.501668+0000","last_active":"2024-09-12T01:16:03.501668+0000","last_peered":"2024-09-12T01:16:03.501668+0000","last_clean":"2024-09-12T01:16:03.501668+0000","last_became_active":"2024-09-12T00:02:48.053452+0000","last_became_peered":"2024-09-12T00:02:48.053452+0000","last_unstale":"2024-09-12T01:16:03.501668+0000","last_undegraded":"2024-09-12T01:16:03.501668+0000","last_fullsized":"2024-09-12T01:16:03.501668+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:16:03.501500+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:16:03.501500+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.501500+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:08.370323+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684145,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":6281,"num_write":1001,"num_write_kb":31607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'859","reported_seq":2564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.283793+0000","last_change":"2024-09-12T01:16:14.283793+0000","last_active":"2024-09-12T01:16:14.283793+0000","last_peered":"2024-09-12T01:16:14.283793+0000","last_clean":"2024-09-12T01:16:14.283793+0000","last_became_active":"2024-09-12T00:02:50.072128+0000","last_became_peered":"2024-09-12T00:02:50.072128+0000","last_unstale":"2024-09-12T01:16:14.283793+0000","last_undegraded":"2024-09-12T01:16:14.283793+0000","last_fullsized":"2024-09-12T01:16:14.283793+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'859","last_scrub_stamp":"2024-09-12T01:16:14.283708+0000","last_deep_scrub":"267'859","last_deep_scrub_stamp":"2024-09-12T01:16:14.283708+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.283708+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:57.648491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4255,"num_read_kb":3837,"num_write":1128,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3450,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'188","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.512321+0000","last_change":"2024-09-12T01:16:01.512321+0000","last_active":"2024-09-12T01:16:01.512321+0000","last_peered":"2024-09-12T01:16:01.512321+0000","last_clean":"2024-09-12T01:16:01.512321+0000","last_became_active":"2024-09-12T00:02:48.059289+0000","last_became_peered":"2024-09-12T00:02:48.059289+0000","last_unstale":"2024-09-12T01:16:01.512321+0000","last_undegraded":"2024-09-12T01:16:01.512321+0000","last_fullsized":"2024-09-12T01:16:01.512321+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'188","last_scrub_stamp":"2024-09-12T01:16:01.512172+0000","last_deep_scrub":"267'188","last_deep_scrub_stamp":"2024-09-12T01:16:01.512172+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.512172+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:19.543793+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342107,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":40439,"num_write":973,"num_write_kb":33156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'1000","reported_seq":2691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.288328+0000","last_change":"2024-09-12T01:16:03.288328+0000","last_active":"2024-09-12T01:16:03.288328+0000","last_peered":"2024-09-12T01:16:03.288328+0000","last_clean":"2024-09-12T01:16:03.288328+0000","last_became_active":"2024-09-12T00:02:50.069775+0000","last_became_peered":"2024-09-12T00:02:50.069775+0000","last_unstale":"2024-09-12T01:16:03.288328+0000","last_undegraded":"2024-09-12T01:16:03.288328+0000","last_fullsized":"2024-09-12T01:16:03.288328+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1000","last_scrub_stamp":"2024-09-12T01:16:03.288239+0000","last_deep_scrub":"267'1000","last_deep_scrub_stamp":"2024-09-12T01:16:03.288239+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.288239+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":900,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:44.983401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4692,"num_read_kb":4217,"num_write":1368,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'201","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.214490+0000","last_change":"2024-09-12T01:15:59.214490+0000","last_active":"2024-09-12T01:15:59.214490+0000","last_peered":"2024-09-12T01:15:59.214490+0000","last_clean":"2024-09-12T01:15:59.214490+0000","last_became_active":"2024-09-12T00:04:21.322881+0000","last_became_peered":"2024-09-12T00:04:21.322881+0000","last_unstale":"2024-09-12T01:15:59.214490+0000","last_undegraded":"2024-09-12T01:15:59.214490+0000","last_fullsized":"2024-09-12T01:15:59.214490+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:15:59.214384+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:15:59.214384+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.214384+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:08.684418+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10550637,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":44397,"num_write":1009,"num_write_kb":26074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"267'851","reported_seq":2426,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.298099+0000","last_change":"2024-09-12T01:16:06.298099+0000","last_active":"2024-09-12T01:16:06.298099+0000","last_peered":"2024-09-12T01:16:06.298099+0000","last_clean":"2024-09-12T01:16:06.298099+0000","last_became_active":"2024-09-12T00:02:50.061055+0000","last_became_peered":"2024-09-12T00:02:50.061055+0000","last_unstale":"2024-09-12T01:16:06.298099+0000","last_undegraded":"2024-09-12T01:16:06.298099+0000","last_fullsized":"2024-09-12T01:16:06.298099+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-12T01:16:06.298021+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-12T01:16:06.298021+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.298021+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:35.804703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3601,"num_write":1146,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'246","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.246926+0000","last_change":"2024-09-12T01:16:00.246926+0000","last_active":"2024-09-12T01:16:00.246926+0000","last_peered":"2024-09-12T01:16:00.246926+0000","last_clean":"2024-09-12T01:16:00.246926+0000","last_became_active":"2024-09-12T00:03:22.073294+0000","last_became_peered":"2024-09-12T00:03:22.073294+0000","last_unstale":"2024-09-12T01:16:00.246926+0000","last_undegraded":"2024-09-12T01:16:00.246926+0000","last_fullsized":"2024-09-12T01:16:00.246926+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-12T01:16:00.246812+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-12T01:16:00.246812+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.246812+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:30.922054+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5592646,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":9461,"num_write":1068,"num_write_kb":47816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"267'877","reported_seq":2509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.919530+0000","last_change":"2024-09-12T01:16:10.919530+0000","last_active":"2024-09-12T01:16:10.919530+0000","last_peered":"2024-09-12T01:16:10.919530+0000","last_clean":"2024-09-12T01:16:10.919530+0000","last_became_active":"2024-09-12T00:02:50.067334+0000","last_became_peered":"2024-09-12T00:02:50.067334+0000","last_unstale":"2024-09-12T01:16:10.919530+0000","last_undegraded":"2024-09-12T01:16:10.919530+0000","last_fullsized":"2024-09-12T01:16:10.919530+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'877","last_scrub_stamp":"2024-09-12T01:16:10.919444+0000","last_deep_scrub":"267'877","last_deep_scrub_stamp":"2024-09-12T01:16:10.919444+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.919444+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:06.787118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4129,"num_read_kb":3712,"num_write":1142,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'242","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.787967+0000","last_change":"2024-09-12T01:16:00.787967+0000","last_active":"2024-09-12T01:16:00.787967+0000","last_peered":"2024-09-12T01:16:00.787967+0000","last_clean":"2024-09-12T01:16:00.787967+0000","last_became_active":"2024-09-12T00:02:48.049926+0000","last_became_peered":"2024-09-12T00:02:48.049926+0000","last_unstale":"2024-09-12T01:16:00.787967+0000","last_undegraded":"2024-09-12T01:16:00.787967+0000","last_fullsized":"2024-09-12T01:16:00.787967+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-12T01:16:00.787782+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-12T01:16:00.787782+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.787782+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.123434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399169,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":41400,"num_write":1181,"num_write_kb":37207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'140","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.982957+0000","last_change":"2024-09-12T01:16:27.982957+0000","last_active":"2024-09-12T01:16:27.982957+0000","last_peered":"2024-09-12T01:16:27.982957+0000","last_clean":"2024-09-12T01:16:27.982957+0000","last_became_active":"2024-09-12T00:02:58.094271+0000","last_became_peered":"2024-09-12T00:02:58.094271+0000","last_unstale":"2024-09-12T01:16:27.982957+0000","last_undegraded":"2024-09-12T01:16:27.982957+0000","last_fullsized":"2024-09-12T01:16:27.982957+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'140","last_scrub_stamp":"2024-09-12T01:16:27.982842+0000","last_deep_scrub":"267'140","last_deep_scrub_stamp":"2024-09-12T01:16:27.982842+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.982842+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:44.482595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":142,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'583","reported_seq":2357,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.701641+0000","last_change":"2024-09-12T01:16:03.701641+0000","last_active":"2024-09-12T01:16:03.701641+0000","last_peered":"2024-09-12T01:16:03.701641+0000","last_clean":"2024-09-12T01:16:03.701641+0000","last_became_active":"2024-09-12T00:02:50.073327+0000","last_became_peered":"2024-09-12T00:02:50.073327+0000","last_unstale":"2024-09-12T01:16:03.701641+0000","last_undegraded":"2024-09-12T01:16:03.701641+0000","last_fullsized":"2024-09-12T01:16:03.701641+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'583","last_scrub_stamp":"2024-09-12T01:16:03.701558+0000","last_deep_scrub":"267'583","last_deep_scrub_stamp":"2024-09-12T01:16:03.701558+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.701558+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:50.578518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3161,"num_read_kb":2955,"num_write":696,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'270","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.760685+0000","last_change":"2024-09-12T01:16:04.760685+0000","last_active":"2024-09-12T01:16:04.760685+0000","last_peered":"2024-09-12T01:16:04.760685+0000","last_clean":"2024-09-12T01:16:04.760685+0000","last_became_active":"2024-09-12T00:03:21.143543+0000","last_became_peered":"2024-09-12T00:03:21.143543+0000","last_unstale":"2024-09-12T01:16:04.760685+0000","last_undegraded":"2024-09-12T01:16:04.760685+0000","last_fullsized":"2024-09-12T01:16:04.760685+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:16:04.760551+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:16:04.760551+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.760551+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:44.290335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":789,"num_read_kb":207403,"num_write":1277,"num_write_kb":65033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.333381+0000","last_change":"2024-09-12T01:16:21.333381+0000","last_active":"2024-09-12T01:16:21.333381+0000","last_peered":"2024-09-12T01:16:21.333381+0000","last_clean":"2024-09-12T01:16:21.333381+0000","last_became_active":"2024-09-12T00:02:52.067288+0000","last_became_peered":"2024-09-12T00:02:52.067288+0000","last_unstale":"2024-09-12T01:16:21.333381+0000","last_undegraded":"2024-09-12T01:16:21.333381+0000","last_fullsized":"2024-09-12T01:16:21.333381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:21.333295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:21.333295+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.333295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:06.501565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'241","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.666793+0000","last_change":"2024-09-12T01:16:17.666793+0000","last_active":"2024-09-12T01:16:17.666793+0000","last_peered":"2024-09-12T01:16:17.666793+0000","last_clean":"2024-09-12T01:16:17.666793+0000","last_became_active":"2024-09-12T00:02:54.070547+0000","last_became_peered":"2024-09-12T00:02:54.070547+0000","last_unstale":"2024-09-12T01:16:17.666793+0000","last_undegraded":"2024-09-12T01:16:17.666793+0000","last_fullsized":"2024-09-12T01:16:17.666793+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-12T01:16:17.666675+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-12T01:16:17.666675+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.666675+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.550527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9977,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":320,"num_read_kb":418,"num_write":196,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.837474+0000","last_change":"2024-09-12T01:16:27.837474+0000","last_active":"2024-09-12T01:16:27.837474+0000","last_peered":"2024-09-12T01:16:27.837474+0000","last_clean":"2024-09-12T01:16:27.837474+0000","last_became_active":"2024-09-12T00:02:56.081086+0000","last_became_peered":"2024-09-12T00:02:56.081086+0000","last_unstale":"2024-09-12T01:16:27.837474+0000","last_undegraded":"2024-09-12T01:16:27.837474+0000","last_fullsized":"2024-09-12T01:16:27.837474+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:27.837373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:27.837373+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.837373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:04.504964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'2435","reported_seq":4352,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.178737+0000","last_change":"2024-09-12T01:16:33.178737+0000","last_active":"2024-09-12T01:16:33.178737+0000","last_peered":"2024-09-12T01:16:33.178737+0000","last_clean":"2024-09-12T01:16:33.178737+0000","last_became_active":"2024-09-12T00:02:58.095948+0000","last_became_peered":"2024-09-12T00:02:58.095948+0000","last_unstale":"2024-09-12T01:16:33.178737+0000","last_undegraded":"2024-09-12T01:16:33.178737+0000","last_fullsized":"2024-09-12T01:16:33.178737+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2435","last_scrub_stamp":"2024-09-12T01:16:33.178632+0000","last_deep_scrub":"267'2435","last_deep_scrub_stamp":"2024-09-12T01:16:33.178632+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.178632+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":2400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:35.648901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6163,"num_read_kb":6149,"num_write":4865,"num_write_kb":1796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'433","reported_seq":1968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.277489+0000","last_change":"2024-09-12T01:16:12.277489+0000","last_active":"2024-09-12T01:16:12.277489+0000","last_peered":"2024-09-12T01:16:12.277489+0000","last_clean":"2024-09-12T01:16:12.277489+0000","last_became_active":"2024-09-12T00:02:50.065654+0000","last_became_peered":"2024-09-12T00:02:50.065654+0000","last_unstale":"2024-09-12T01:16:12.277489+0000","last_undegraded":"2024-09-12T01:16:12.277489+0000","last_fullsized":"2024-09-12T01:16:12.277489+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'433","last_scrub_stamp":"2024-09-12T01:16:12.277405+0000","last_deep_scrub":"267'433","last_deep_scrub_stamp":"2024-09-12T01:16:12.277405+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.277405+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:57.117394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2304,"num_read_kb":2172,"num_write":510,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'198","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.924085+0000","last_change":"2024-09-12T01:15:55.924085+0000","last_active":"2024-09-12T01:15:55.924085+0000","last_peered":"2024-09-12T01:15:55.924085+0000","last_clean":"2024-09-12T01:15:55.924085+0000","last_became_active":"2024-09-12T00:02:48.050499+0000","last_became_peered":"2024-09-12T00:02:48.050499+0000","last_unstale":"2024-09-12T01:15:55.924085+0000","last_undegraded":"2024-09-12T01:15:55.924085+0000","last_fullsized":"2024-09-12T01:15:55.924085+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:15:55.924011+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:15:55.924011+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.924011+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.010889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":23205,"num_write":930,"num_write_kb":52906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.658857+0000","last_change":"2024-09-12T01:16:09.658857+0000","last_active":"2024-09-12T01:16:09.658857+0000","last_peered":"2024-09-12T01:16:09.658857+0000","last_clean":"2024-09-12T01:16:09.658857+0000","last_became_active":"2024-09-12T00:02:52.068519+0000","last_became_peered":"2024-09-12T00:02:52.068519+0000","last_unstale":"2024-09-12T01:16:09.658857+0000","last_undegraded":"2024-09-12T01:16:09.658857+0000","last_fullsized":"2024-09-12T01:16:09.658857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.658760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.658760+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.658760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:31.485302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'119","reported_seq":675,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.979691+0000","last_change":"2024-09-12T01:16:20.979691+0000","last_active":"2024-09-12T01:16:20.979691+0000","last_peered":"2024-09-12T01:16:20.979691+0000","last_clean":"2024-09-12T01:16:20.979691+0000","last_became_active":"2024-09-12T00:02:54.060334+0000","last_became_peered":"2024-09-12T00:02:54.060334+0000","last_unstale":"2024-09-12T01:16:20.979691+0000","last_undegraded":"2024-09-12T01:16:20.979691+0000","last_fullsized":"2024-09-12T01:16:20.979691+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'119","last_scrub_stamp":"2024-09-12T01:16:20.979573+0000","last_deep_scrub":"267'119","last_deep_scrub_stamp":"2024-09-12T01:16:20.979573+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.979573+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:17.324078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.924434+0000","last_change":"2024-09-12T01:16:24.924434+0000","last_active":"2024-09-12T01:16:24.924434+0000","last_peered":"2024-09-12T01:16:24.924434+0000","last_clean":"2024-09-12T01:16:24.924434+0000","last_became_active":"2024-09-12T00:02:56.085222+0000","last_became_peered":"2024-09-12T00:02:56.085222+0000","last_unstale":"2024-09-12T01:16:24.924434+0000","last_undegraded":"2024-09-12T01:16:24.924434+0000","last_fullsized":"2024-09-12T01:16:24.924434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.924316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.924316+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.924316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.301751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'148","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.649202+0000","last_change":"2024-09-12T01:16:30.649202+0000","last_active":"2024-09-12T01:16:30.649202+0000","last_peered":"2024-09-12T01:16:30.649202+0000","last_clean":"2024-09-12T01:16:30.649202+0000","last_became_active":"2024-09-12T00:02:58.094312+0000","last_became_peered":"2024-09-12T00:02:58.094312+0000","last_unstale":"2024-09-12T01:16:30.649202+0000","last_undegraded":"2024-09-12T01:16:30.649202+0000","last_fullsized":"2024-09-12T01:16:30.649202+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'148","last_scrub_stamp":"2024-09-12T01:16:30.649112+0000","last_deep_scrub":"267'148","last_deep_scrub_stamp":"2024-09-12T01:16:30.649112+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.649112+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.047313+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":193,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'830","reported_seq":2439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.807881+0000","last_change":"2024-09-12T01:16:05.807881+0000","last_active":"2024-09-12T01:16:05.807881+0000","last_peered":"2024-09-12T01:16:05.807881+0000","last_clean":"2024-09-12T01:16:05.807881+0000","last_became_active":"2024-09-12T00:02:50.071219+0000","last_became_peered":"2024-09-12T00:02:50.071219+0000","last_unstale":"2024-09-12T01:16:05.807881+0000","last_undegraded":"2024-09-12T01:16:05.807881+0000","last_fullsized":"2024-09-12T01:16:05.807881+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'830","last_scrub_stamp":"2024-09-12T01:16:05.807733+0000","last_deep_scrub":"267'830","last_deep_scrub_stamp":"2024-09-12T01:16:05.807733+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.807733+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:00.465607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4069,"num_read_kb":3661,"num_write":1104,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2553,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'211","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.726231+0000","last_change":"2024-09-12T01:16:01.726231+0000","last_active":"2024-09-12T01:16:01.726231+0000","last_peered":"2024-09-12T01:16:01.726231+0000","last_clean":"2024-09-12T01:16:01.726231+0000","last_became_active":"2024-09-12T00:02:48.059132+0000","last_became_peered":"2024-09-12T00:02:48.059132+0000","last_unstale":"2024-09-12T01:16:01.726231+0000","last_undegraded":"2024-09-12T01:16:01.726231+0000","last_fullsized":"2024-09-12T01:16:01.726231+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'211","last_scrub_stamp":"2024-09-12T01:16:01.726101+0000","last_deep_scrub":"267'211","last_deep_scrub_stamp":"2024-09-12T01:16:01.726101+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.726101+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:47.889650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":5763,"num_write":993,"num_write_kb":32529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.547500+0000","last_change":"2024-09-12T01:16:15.547500+0000","last_active":"2024-09-12T01:16:15.547500+0000","last_peered":"2024-09-12T01:16:15.547500+0000","last_clean":"2024-09-12T01:16:15.547500+0000","last_became_active":"2024-09-12T00:02:52.064216+0000","last_became_peered":"2024-09-12T00:02:52.064216+0000","last_unstale":"2024-09-12T01:16:15.547500+0000","last_undegraded":"2024-09-12T01:16:15.547500+0000","last_fullsized":"2024-09-12T01:16:15.547500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.547409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.547409+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.547409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:49.762131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'162","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.200793+0000","last_change":"2024-09-12T01:16:13.200793+0000","last_active":"2024-09-12T01:16:13.200793+0000","last_peered":"2024-09-12T01:16:13.200793+0000","last_clean":"2024-09-12T01:16:13.200793+0000","last_became_active":"2024-09-12T00:02:54.060501+0000","last_became_peered":"2024-09-12T00:02:54.060501+0000","last_unstale":"2024-09-12T01:16:13.200793+0000","last_undegraded":"2024-09-12T01:16:13.200793+0000","last_fullsized":"2024-09-12T01:16:13.200793+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:13.200687+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:13.200687+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.200687+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:11.033202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":182,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'767","reported_seq":2671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.846701+0000","last_change":"2024-09-12T01:16:26.846701+0000","last_active":"2024-09-12T01:16:26.846701+0000","last_peered":"2024-09-12T01:16:26.846701+0000","last_clean":"2024-09-12T01:16:26.846701+0000","last_became_active":"2024-09-12T00:02:56.087506+0000","last_became_peered":"2024-09-12T00:02:56.087506+0000","last_unstale":"2024-09-12T01:16:26.846701+0000","last_undegraded":"2024-09-12T01:16:26.846701+0000","last_fullsized":"2024-09-12T01:16:26.846701+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'767","last_scrub_stamp":"2024-09-12T01:16:26.846570+0000","last_deep_scrub":"267'767","last_deep_scrub_stamp":"2024-09-12T01:16:26.846570+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.846570+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:02.349841+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.928869+0000","last_change":"2024-09-12T01:16:30.928869+0000","last_active":"2024-09-12T01:16:30.928869+0000","last_peered":"2024-09-12T01:16:30.928869+0000","last_clean":"2024-09-12T01:16:30.928869+0000","last_became_active":"2024-09-12T00:02:58.090424+0000","last_became_peered":"2024-09-12T00:02:58.090424+0000","last_unstale":"2024-09-12T01:16:30.928869+0000","last_undegraded":"2024-09-12T01:16:30.928869+0000","last_fullsized":"2024-09-12T01:16:30.928869+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:16:30.928770+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:16:30.928770+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.928770+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:56.460749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":609,"num_read_kb":603,"num_write":442,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'494","reported_seq":2303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.683501+0000","last_change":"2024-09-12T01:16:04.683501+0000","last_active":"2024-09-12T01:16:04.683501+0000","last_peered":"2024-09-12T01:16:04.683501+0000","last_clean":"2024-09-12T01:16:04.683501+0000","last_became_active":"2024-09-12T00:02:50.067933+0000","last_became_peered":"2024-09-12T00:02:50.067933+0000","last_unstale":"2024-09-12T01:16:04.683501+0000","last_undegraded":"2024-09-12T01:16:04.683501+0000","last_fullsized":"2024-09-12T01:16:04.683501+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-09-12T01:16:04.683410+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-09-12T01:16:04.683410+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.683410+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:55.086027+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2745,"num_read_kb":2618,"num_write":566,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'210","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.550622+0000","last_change":"2024-09-12T01:15:57.550622+0000","last_active":"2024-09-12T01:15:57.550622+0000","last_peered":"2024-09-12T01:15:57.550622+0000","last_clean":"2024-09-12T01:15:57.550622+0000","last_became_active":"2024-09-12T00:02:48.052566+0000","last_became_peered":"2024-09-12T00:02:48.052566+0000","last_unstale":"2024-09-12T01:15:57.550622+0000","last_undegraded":"2024-09-12T01:15:57.550622+0000","last_fullsized":"2024-09-12T01:15:57.550622+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:15:57.550505+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:15:57.550505+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.550505+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.920796+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":572,"num_read_kb":73907,"num_write":996,"num_write_kb":20895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.287740+0000","last_change":"2024-09-12T01:16:20.287740+0000","last_active":"2024-09-12T01:16:20.287740+0000","last_peered":"2024-09-12T01:16:20.287740+0000","last_clean":"2024-09-12T01:16:20.287740+0000","last_became_active":"2024-09-12T00:02:52.066171+0000","last_became_peered":"2024-09-12T00:02:52.066171+0000","last_unstale":"2024-09-12T01:16:20.287740+0000","last_undegraded":"2024-09-12T01:16:20.287740+0000","last_fullsized":"2024-09-12T01:16:20.287740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:20.287615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:20.287615+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.287615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:13.634610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'173","reported_seq":769,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.883046+0000","last_change":"2024-09-12T01:16:22.883046+0000","last_active":"2024-09-12T01:16:22.883046+0000","last_peered":"2024-09-12T01:16:22.883046+0000","last_clean":"2024-09-12T01:16:22.883046+0000","last_became_active":"2024-09-12T00:02:54.239618+0000","last_became_peered":"2024-09-12T00:02:54.239618+0000","last_unstale":"2024-09-12T01:16:22.883046+0000","last_undegraded":"2024-09-12T01:16:22.883046+0000","last_fullsized":"2024-09-12T01:16:22.883046+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-09-12T01:16:22.882915+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-09-12T01:16:22.882915+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.882915+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:17.059053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":308,"num_write":128,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'808","reported_seq":2639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.568661+0000","last_change":"2024-09-12T01:16:27.568661+0000","last_active":"2024-09-12T01:16:27.568661+0000","last_peered":"2024-09-12T01:16:27.568661+0000","last_clean":"2024-09-12T01:16:27.568661+0000","last_became_active":"2024-09-12T00:02:56.082567+0000","last_became_peered":"2024-09-12T00:02:56.082567+0000","last_unstale":"2024-09-12T01:16:27.568661+0000","last_undegraded":"2024-09-12T01:16:27.568661+0000","last_fullsized":"2024-09-12T01:16:27.568661+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'808","last_scrub_stamp":"2024-09-12T01:16:27.568577+0000","last_deep_scrub":"267'808","last_deep_scrub_stamp":"2024-09-12T01:16:27.568577+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.568577+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:18.717470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'364","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.242131+0000","last_change":"2024-09-12T01:16:11.242073+0000","last_active":"2024-09-12T01:16:11.242131+0000","last_peered":"2024-09-12T01:16:11.242131+0000","last_clean":"2024-09-12T01:16:11.242131+0000","last_became_active":"2024-09-12T00:02:50.063707+0000","last_became_peered":"2024-09-12T00:02:50.063707+0000","last_unstale":"2024-09-12T01:16:11.242131+0000","last_undegraded":"2024-09-12T01:16:11.242131+0000","last_fullsized":"2024-09-12T01:16:11.242131+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T01:16:11.241987+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T01:16:11.241987+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.241987+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:49.086172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1902,"num_write":425,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'196","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.757332+0000","last_change":"2024-09-12T01:16:03.757332+0000","last_active":"2024-09-12T01:16:03.757332+0000","last_peered":"2024-09-12T01:16:03.757332+0000","last_clean":"2024-09-12T01:16:03.757332+0000","last_became_active":"2024-09-12T00:02:48.056135+0000","last_became_peered":"2024-09-12T00:02:48.056135+0000","last_unstale":"2024-09-12T01:16:03.757332+0000","last_undegraded":"2024-09-12T01:16:03.757332+0000","last_fullsized":"2024-09-12T01:16:03.757332+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T01:16:03.757211+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T01:16:03.757211+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.757211+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:10.396944+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":40539,"num_write":934,"num_write_kb":46911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.853035+0000","last_change":"2024-09-12T01:16:15.852946+0000","last_active":"2024-09-12T01:16:15.853035+0000","last_peered":"2024-09-12T01:16:15.853035+0000","last_clean":"2024-09-12T01:16:15.853035+0000","last_became_active":"2024-09-12T00:02:52.068747+0000","last_became_peered":"2024-09-12T00:02:52.068747+0000","last_unstale":"2024-09-12T01:16:15.853035+0000","last_undegraded":"2024-09-12T01:16:15.853035+0000","last_fullsized":"2024-09-12T01:16:15.853035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.852843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.852843+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.852843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:15.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'285","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.263604+0000","last_change":"2024-09-12T01:16:25.263604+0000","last_active":"2024-09-12T01:16:25.263604+0000","last_peered":"2024-09-12T01:16:25.263604+0000","last_clean":"2024-09-12T01:16:25.263604+0000","last_became_active":"2024-09-12T00:02:54.239475+0000","last_became_peered":"2024-09-12T00:02:54.239475+0000","last_unstale":"2024-09-12T01:16:25.263604+0000","last_undegraded":"2024-09-12T01:16:25.263604+0000","last_fullsized":"2024-09-12T01:16:25.263604+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-12T01:16:25.263492+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-12T01:16:25.263492+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.263492+0000","objects_scrubbed":10,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:39.629858+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5743,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":380,"num_read_kb":454,"num_write":232,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.295945+0000","last_change":"2024-09-12T01:16:16.295945+0000","last_active":"2024-09-12T01:16:16.295945+0000","last_peered":"2024-09-12T01:16:16.295945+0000","last_clean":"2024-09-12T01:16:16.295945+0000","last_became_active":"2024-09-12T00:02:56.080748+0000","last_became_peered":"2024-09-12T00:02:56.080748+0000","last_unstale":"2024-09-12T01:16:16.295945+0000","last_undegraded":"2024-09-12T01:16:16.295945+0000","last_fullsized":"2024-09-12T01:16:16.295945+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.295864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.295864+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.295864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:13.823929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'530","reported_seq":1354,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.276181+0000","last_change":"2024-09-12T01:16:29.276181+0000","last_active":"2024-09-12T01:16:29.276181+0000","last_peered":"2024-09-12T01:16:29.276181+0000","last_clean":"2024-09-12T01:16:29.276181+0000","last_became_active":"2024-09-12T00:02:58.095311+0000","last_became_peered":"2024-09-12T00:02:58.095311+0000","last_unstale":"2024-09-12T01:16:29.276181+0000","last_undegraded":"2024-09-12T01:16:29.276181+0000","last_fullsized":"2024-09-12T01:16:29.276181+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'530","last_scrub_stamp":"2024-09-12T01:16:29.276083+0000","last_deep_scrub":"267'530","last_deep_scrub_stamp":"2024-09-12T01:16:29.276083+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.276083+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:26.727522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1247,"num_read_kb":1245,"num_write":1070,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'399","reported_seq":1710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.751966+0000","last_change":"2024-09-12T01:16:03.751890+0000","last_active":"2024-09-12T01:16:03.751966+0000","last_peered":"2024-09-12T01:16:03.751966+0000","last_clean":"2024-09-12T01:16:03.751966+0000","last_became_active":"2024-09-12T00:02:50.068223+0000","last_became_peered":"2024-09-12T00:02:50.068223+0000","last_unstale":"2024-09-12T01:16:03.751966+0000","last_undegraded":"2024-09-12T01:16:03.751966+0000","last_fullsized":"2024-09-12T01:16:03.751966+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-12T01:16:03.751752+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-12T01:16:03.751752+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.751752+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:31.247244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1919,"num_read_kb":1778,"num_write":479,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'153","reported_seq":792,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.760986+0000","last_change":"2024-09-12T01:16:00.760986+0000","last_active":"2024-09-12T01:16:00.760986+0000","last_peered":"2024-09-12T01:16:00.760986+0000","last_clean":"2024-09-12T01:16:00.760986+0000","last_became_active":"2024-09-12T00:02:48.055480+0000","last_became_peered":"2024-09-12T00:02:48.055480+0000","last_unstale":"2024-09-12T01:16:00.760986+0000","last_undegraded":"2024-09-12T01:16:00.760986+0000","last_fullsized":"2024-09-12T01:16:00.760986+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-12T01:16:00.760880+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-12T01:16:00.760880+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.760880+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.310424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250607,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":416,"num_read_kb":43431,"num_write":767,"num_write_kb":28983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.264636+0000","last_change":"2024-09-12T01:16:09.264574+0000","last_active":"2024-09-12T01:16:09.264636+0000","last_peered":"2024-09-12T01:16:09.264636+0000","last_clean":"2024-09-12T01:16:09.264636+0000","last_became_active":"2024-09-12T00:02:52.062219+0000","last_became_peered":"2024-09-12T00:02:52.062219+0000","last_unstale":"2024-09-12T01:16:09.264636+0000","last_undegraded":"2024-09-12T01:16:09.264636+0000","last_fullsized":"2024-09-12T01:16:09.264636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.264489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.264489+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.264489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:41.480353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'161","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.553910+0000","last_change":"2024-09-12T01:16:17.553910+0000","last_active":"2024-09-12T01:16:17.553910+0000","last_peered":"2024-09-12T01:16:17.553910+0000","last_clean":"2024-09-12T01:16:17.553910+0000","last_became_active":"2024-09-12T00:02:54.069656+0000","last_became_peered":"2024-09-12T00:02:54.069656+0000","last_unstale":"2024-09-12T01:16:17.553910+0000","last_undegraded":"2024-09-12T01:16:17.553910+0000","last_fullsized":"2024-09-12T01:16:17.553910+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:16:17.553833+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:16:17.553833+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.553833+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:30.758345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9092,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":201,"num_read_kb":271,"num_write":108,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.572021+0000","last_change":"2024-09-12T01:16:23.572021+0000","last_active":"2024-09-12T01:16:23.572021+0000","last_peered":"2024-09-12T01:16:23.572021+0000","last_clean":"2024-09-12T01:16:23.572021+0000","last_became_active":"2024-09-12T00:02:56.081804+0000","last_became_peered":"2024-09-12T00:02:56.081804+0000","last_unstale":"2024-09-12T01:16:23.572021+0000","last_undegraded":"2024-09-12T01:16:23.572021+0000","last_fullsized":"2024-09-12T01:16:23.572021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.571932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.571932+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.571932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:03.164700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'122","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.394034+0000","last_change":"2024-09-12T01:16:18.394034+0000","last_active":"2024-09-12T01:16:18.394034+0000","last_peered":"2024-09-12T01:16:18.394034+0000","last_clean":"2024-09-12T01:16:18.394034+0000","last_became_active":"2024-09-12T00:02:58.095068+0000","last_became_peered":"2024-09-12T00:02:58.095068+0000","last_unstale":"2024-09-12T01:16:18.394034+0000","last_undegraded":"2024-09-12T01:16:18.394034+0000","last_fullsized":"2024-09-12T01:16:18.394034+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-09-12T01:16:18.393945+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-09-12T01:16:18.393945+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.393945+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:24.673992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":135,"num_write":297,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'897","reported_seq":2427,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.517733+0000","last_change":"2024-09-12T01:16:05.517733+0000","last_active":"2024-09-12T01:16:05.517733+0000","last_peered":"2024-09-12T01:16:05.517733+0000","last_clean":"2024-09-12T01:16:05.517733+0000","last_became_active":"2024-09-12T00:02:50.078033+0000","last_became_peered":"2024-09-12T00:02:50.078033+0000","last_unstale":"2024-09-12T01:16:05.517733+0000","last_undegraded":"2024-09-12T01:16:05.517733+0000","last_fullsized":"2024-09-12T01:16:05.517733+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'897","last_scrub_stamp":"2024-09-12T01:16:05.517647+0000","last_deep_scrub":"267'897","last_deep_scrub_stamp":"2024-09-12T01:16:05.517647+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.517647+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:04.806609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4128,"num_read_kb":3671,"num_write":1209,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'185","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.716184+0000","last_change":"2024-09-12T01:15:59.716184+0000","last_active":"2024-09-12T01:15:59.716184+0000","last_peered":"2024-09-12T01:15:59.716184+0000","last_clean":"2024-09-12T01:15:59.716184+0000","last_became_active":"2024-09-12T00:02:48.048973+0000","last_became_peered":"2024-09-12T00:02:48.048973+0000","last_unstale":"2024-09-12T01:15:59.716184+0000","last_undegraded":"2024-09-12T01:15:59.716184+0000","last_fullsized":"2024-09-12T01:15:59.716184+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:59.716068+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:59.716068+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.716068+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:27.806731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":6868,"num_write":918,"num_write_kb":34085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.262229+0000","last_change":"2024-09-12T01:16:10.262229+0000","last_active":"2024-09-12T01:16:10.262229+0000","last_peered":"2024-09-12T01:16:10.262229+0000","last_clean":"2024-09-12T01:16:10.262229+0000","last_became_active":"2024-09-12T00:02:52.065809+0000","last_became_peered":"2024-09-12T00:02:52.065809+0000","last_unstale":"2024-09-12T01:16:10.262229+0000","last_undegraded":"2024-09-12T01:16:10.262229+0000","last_fullsized":"2024-09-12T01:16:10.262229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.262136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.262136+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.262136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:54.718660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'220","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.905259+0000","last_change":"2024-09-12T01:16:19.905198+0000","last_active":"2024-09-12T01:16:19.905259+0000","last_peered":"2024-09-12T01:16:19.905259+0000","last_clean":"2024-09-12T01:16:19.905259+0000","last_became_active":"2024-09-12T00:02:54.066781+0000","last_became_peered":"2024-09-12T00:02:54.066781+0000","last_unstale":"2024-09-12T01:16:19.905259+0000","last_undegraded":"2024-09-12T01:16:19.905259+0000","last_fullsized":"2024-09-12T01:16:19.905259+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-12T01:16:19.905107+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-12T01:16:19.905107+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.905107+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:53.442084+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":282,"num_read_kb":329,"num_write":166,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'795","reported_seq":2827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.649273+0000","last_change":"2024-09-12T01:16:21.649211+0000","last_active":"2024-09-12T01:16:21.649273+0000","last_peered":"2024-09-12T01:16:21.649273+0000","last_clean":"2024-09-12T01:16:21.649273+0000","last_became_active":"2024-09-12T00:02:56.086692+0000","last_became_peered":"2024-09-12T00:02:56.086692+0000","last_unstale":"2024-09-12T01:16:21.649273+0000","last_undegraded":"2024-09-12T01:16:21.649273+0000","last_fullsized":"2024-09-12T01:16:21.649273+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'795","last_scrub_stamp":"2024-09-12T01:16:21.649118+0000","last_deep_scrub":"267'795","last_deep_scrub_stamp":"2024-09-12T01:16:21.649118+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.649118+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:17.175987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'116","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.584201+0000","last_change":"2024-09-12T01:16:26.584201+0000","last_active":"2024-09-12T01:16:26.584201+0000","last_peered":"2024-09-12T01:16:26.584201+0000","last_clean":"2024-09-12T01:16:26.584201+0000","last_became_active":"2024-09-12T00:02:58.093419+0000","last_became_peered":"2024-09-12T00:02:58.093419+0000","last_unstale":"2024-09-12T01:16:26.584201+0000","last_undegraded":"2024-09-12T01:16:26.584201+0000","last_fullsized":"2024-09-12T01:16:26.584201+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-12T01:16:26.584111+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-12T01:16:26.584111+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.584111+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:04.476681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":298,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'401","reported_seq":2002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.792877+0000","last_change":"2024-09-12T01:16:04.792877+0000","last_active":"2024-09-12T01:16:04.792877+0000","last_peered":"2024-09-12T01:16:04.792877+0000","last_clean":"2024-09-12T01:16:04.792877+0000","last_became_active":"2024-09-12T00:02:50.073986+0000","last_became_peered":"2024-09-12T00:02:50.073986+0000","last_unstale":"2024-09-12T01:16:04.792877+0000","last_undegraded":"2024-09-12T01:16:04.792877+0000","last_fullsized":"2024-09-12T01:16:04.792877+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T01:16:04.792766+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T01:16:04.792766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.792766+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:59.004193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2369,"num_read_kb":2271,"num_write":449,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'218","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.185384+0000","last_change":"2024-09-12T01:15:57.185384+0000","last_active":"2024-09-12T01:15:57.185384+0000","last_peered":"2024-09-12T01:15:57.185384+0000","last_clean":"2024-09-12T01:15:57.185384+0000","last_became_active":"2024-09-12T00:02:48.051190+0000","last_became_peered":"2024-09-12T00:02:48.051190+0000","last_unstale":"2024-09-12T01:15:57.185384+0000","last_undegraded":"2024-09-12T01:15:57.185384+0000","last_fullsized":"2024-09-12T01:15:57.185384+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:15:57.185281+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:15:57.185281+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.185281+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.188053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":21060,"num_write":1056,"num_write_kb":24204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.288239+0000","last_change":"2024-09-12T01:16:07.288239+0000","last_active":"2024-09-12T01:16:07.288239+0000","last_peered":"2024-09-12T01:16:07.288239+0000","last_clean":"2024-09-12T01:16:07.288239+0000","last_became_active":"2024-09-12T00:02:52.056676+0000","last_became_peered":"2024-09-12T00:02:52.056676+0000","last_unstale":"2024-09-12T01:16:07.288239+0000","last_undegraded":"2024-09-12T01:16:07.288239+0000","last_fullsized":"2024-09-12T01:16:07.288239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:07.288154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:07.288154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.288154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.787901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'230","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.671376+0000","last_change":"2024-09-12T01:16:15.671311+0000","last_active":"2024-09-12T01:16:15.671376+0000","last_peered":"2024-09-12T01:16:15.671376+0000","last_clean":"2024-09-12T01:16:15.671376+0000","last_became_active":"2024-09-12T00:02:54.066994+0000","last_became_peered":"2024-09-12T00:02:54.066994+0000","last_unstale":"2024-09-12T01:16:15.671376+0000","last_undegraded":"2024-09-12T01:16:15.671376+0000","last_fullsized":"2024-09-12T01:16:15.671376+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-12T01:16:15.671217+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-12T01:16:15.671217+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.671217+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:53.817921+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10683,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":318,"num_read_kb":432,"num_write":164,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.174290+0000","last_change":"2024-09-12T01:16:14.174290+0000","last_active":"2024-09-12T01:16:14.174290+0000","last_peered":"2024-09-12T01:16:14.174290+0000","last_clean":"2024-09-12T01:16:14.174290+0000","last_became_active":"2024-09-12T00:02:56.078740+0000","last_became_peered":"2024-09-12T00:02:56.078740+0000","last_unstale":"2024-09-12T01:16:14.174290+0000","last_undegraded":"2024-09-12T01:16:14.174290+0000","last_fullsized":"2024-09-12T01:16:14.174290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.174189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.174189+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.174189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:29.216963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'110","reported_seq":635,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.272871+0000","last_change":"2024-09-12T01:16:23.272871+0000","last_active":"2024-09-12T01:16:23.272871+0000","last_peered":"2024-09-12T01:16:23.272871+0000","last_clean":"2024-09-12T01:16:23.272871+0000","last_became_active":"2024-09-12T00:02:58.092520+0000","last_became_peered":"2024-09-12T00:02:58.092520+0000","last_unstale":"2024-09-12T01:16:23.272871+0000","last_undegraded":"2024-09-12T01:16:23.272871+0000","last_fullsized":"2024-09-12T01:16:23.272871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'110","last_scrub_stamp":"2024-09-12T01:16:23.272757+0000","last_deep_scrub":"267'110","last_deep_scrub_stamp":"2024-09-12T01:16:23.272757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.272757+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.827113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":241,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'522","reported_seq":2244,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.702966+0000","last_change":"2024-09-12T01:15:57.702966+0000","last_active":"2024-09-12T01:15:57.702966+0000","last_peered":"2024-09-12T01:15:57.702966+0000","last_clean":"2024-09-12T01:15:57.702966+0000","last_became_active":"2024-09-12T00:02:50.068691+0000","last_became_peered":"2024-09-12T00:02:50.068691+0000","last_unstale":"2024-09-12T01:15:57.702966+0000","last_undegraded":"2024-09-12T01:15:57.702966+0000","last_fullsized":"2024-09-12T01:15:57.702966+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'522","last_scrub_stamp":"2024-09-12T01:15:57.702886+0000","last_deep_scrub":"267'522","last_deep_scrub_stamp":"2024-09-12T01:15:57.702886+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.702886+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:32.128046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2837,"num_read_kb":2668,"num_write":620,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'204","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.771129+0000","last_change":"2024-09-12T01:15:57.771129+0000","last_active":"2024-09-12T01:15:57.771129+0000","last_peered":"2024-09-12T01:15:57.771129+0000","last_clean":"2024-09-12T01:15:57.771129+0000","last_became_active":"2024-09-12T00:02:48.050513+0000","last_became_peered":"2024-09-12T00:02:48.050513+0000","last_unstale":"2024-09-12T01:15:57.771129+0000","last_undegraded":"2024-09-12T01:15:57.771129+0000","last_fullsized":"2024-09-12T01:15:57.771129+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'204","last_scrub_stamp":"2024-09-12T01:15:57.771000+0000","last_deep_scrub":"267'204","last_deep_scrub_stamp":"2024-09-12T01:15:57.771000+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.771000+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:32.870808+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342067,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":923,"num_read_kb":76851,"num_write":1040,"num_write_kb":50138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.275148+0000","last_change":"2024-09-12T01:16:08.275148+0000","last_active":"2024-09-12T01:16:08.275148+0000","last_peered":"2024-09-12T01:16:08.275148+0000","last_clean":"2024-09-12T01:16:08.275148+0000","last_became_active":"2024-09-12T00:02:52.064333+0000","last_became_peered":"2024-09-12T00:02:52.064333+0000","last_unstale":"2024-09-12T01:16:08.275148+0000","last_undegraded":"2024-09-12T01:16:08.275148+0000","last_fullsized":"2024-09-12T01:16:08.275148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:08.275061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:08.275061+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.275061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:43.190059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'182","reported_seq":793,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.987536+0000","last_change":"2024-09-12T01:16:19.987536+0000","last_active":"2024-09-12T01:16:19.987536+0000","last_peered":"2024-09-12T01:16:19.987536+0000","last_clean":"2024-09-12T01:16:19.987536+0000","last_became_active":"2024-09-12T00:02:54.068732+0000","last_became_peered":"2024-09-12T00:02:54.068732+0000","last_unstale":"2024-09-12T01:16:19.987536+0000","last_undegraded":"2024-09-12T01:16:19.987536+0000","last_fullsized":"2024-09-12T01:16:19.987536+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'182","last_scrub_stamp":"2024-09-12T01:16:19.987427+0000","last_deep_scrub":"267'182","last_deep_scrub_stamp":"2024-09-12T01:16:19.987427+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.987427+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:27.573352+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":259,"num_read_kb":329,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.610657+0000","last_change":"2024-09-12T01:16:22.610657+0000","last_active":"2024-09-12T01:16:22.610657+0000","last_peered":"2024-09-12T01:16:22.610657+0000","last_clean":"2024-09-12T01:16:22.610657+0000","last_became_active":"2024-09-12T00:02:56.088527+0000","last_became_peered":"2024-09-12T00:02:56.088527+0000","last_unstale":"2024-09-12T01:16:22.610657+0000","last_undegraded":"2024-09-12T01:16:22.610657+0000","last_fullsized":"2024-09-12T01:16:22.610657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:22.610554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:22.610554+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.610554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:15.716696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'113","reported_seq":627,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.629020+0000","last_change":"2024-09-12T01:16:29.629020+0000","last_active":"2024-09-12T01:16:29.629020+0000","last_peered":"2024-09-12T01:16:29.629020+0000","last_clean":"2024-09-12T01:16:29.629020+0000","last_became_active":"2024-09-12T00:02:58.100726+0000","last_became_peered":"2024-09-12T00:02:58.100726+0000","last_unstale":"2024-09-12T01:16:29.629020+0000","last_undegraded":"2024-09-12T01:16:29.629020+0000","last_fullsized":"2024-09-12T01:16:29.629020+0000","mapping_epoch":36,"log_start":"267'101","ondisk_log_start":"267'101","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T01:16:29.628930+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T01:16:29.628930+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.628930+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:01.386299+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":109,"num_write":270,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'822","reported_seq":2447,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.677185+0000","last_change":"2024-09-12T01:16:00.677185+0000","last_active":"2024-09-12T01:16:00.677185+0000","last_peered":"2024-09-12T01:16:00.677185+0000","last_clean":"2024-09-12T01:16:00.677185+0000","last_became_active":"2024-09-12T00:02:50.059646+0000","last_became_peered":"2024-09-12T00:02:50.059646+0000","last_unstale":"2024-09-12T01:16:00.677185+0000","last_undegraded":"2024-09-12T01:16:00.677185+0000","last_fullsized":"2024-09-12T01:16:00.677185+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'822","last_scrub_stamp":"2024-09-12T01:16:00.677097+0000","last_deep_scrub":"267'822","last_deep_scrub_stamp":"2024-09-12T01:16:00.677097+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.677097+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:43.127120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3626,"num_write":1074,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'218","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.584277+0000","last_change":"2024-09-12T01:15:56.584216+0000","last_active":"2024-09-12T01:15:56.584277+0000","last_peered":"2024-09-12T01:15:56.584277+0000","last_clean":"2024-09-12T01:15:56.584277+0000","last_became_active":"2024-09-12T00:02:48.046424+0000","last_became_peered":"2024-09-12T00:02:48.046424+0000","last_unstale":"2024-09-12T01:15:56.584277+0000","last_undegraded":"2024-09-12T01:15:56.584277+0000","last_fullsized":"2024-09-12T01:15:56.584277+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:15:56.584071+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:15:56.584071+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.584071+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:34.930249+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":142057,"num_write":895,"num_write_kb":42631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.169805+0000","last_change":"2024-09-12T01:16:10.169805+0000","last_active":"2024-09-12T01:16:10.169805+0000","last_peered":"2024-09-12T01:16:10.169805+0000","last_clean":"2024-09-12T01:16:10.169805+0000","last_became_active":"2024-09-12T00:02:52.063641+0000","last_became_peered":"2024-09-12T00:02:52.063641+0000","last_unstale":"2024-09-12T01:16:10.169805+0000","last_undegraded":"2024-09-12T01:16:10.169805+0000","last_fullsized":"2024-09-12T01:16:10.169805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.169703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.169703+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.169703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:33.997915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'192","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.214623+0000","last_change":"2024-09-12T01:16:12.214623+0000","last_active":"2024-09-12T01:16:12.214623+0000","last_peered":"2024-09-12T01:16:12.214623+0000","last_clean":"2024-09-12T01:16:12.214623+0000","last_became_active":"2024-09-12T00:02:54.067328+0000","last_became_peered":"2024-09-12T00:02:54.067328+0000","last_unstale":"2024-09-12T01:16:12.214623+0000","last_undegraded":"2024-09-12T01:16:12.214623+0000","last_fullsized":"2024-09-12T01:16:12.214623+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-12T01:16:12.214526+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-12T01:16:12.214526+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.214526+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:31.671601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":308,"num_write":148,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'744","reported_seq":2626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.218202+0000","last_change":"2024-09-12T01:16:15.218202+0000","last_active":"2024-09-12T01:16:15.218202+0000","last_peered":"2024-09-12T01:16:15.218202+0000","last_clean":"2024-09-12T01:16:15.218202+0000","last_became_active":"2024-09-12T00:02:56.079167+0000","last_became_peered":"2024-09-12T00:02:56.079167+0000","last_unstale":"2024-09-12T01:16:15.218202+0000","last_undegraded":"2024-09-12T01:16:15.218202+0000","last_fullsized":"2024-09-12T01:16:15.218202+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'744","last_scrub_stamp":"2024-09-12T01:16:15.218093+0000","last_deep_scrub":"267'744","last_deep_scrub_stamp":"2024-09-12T01:16:15.218093+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.218093+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:12.282880+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.305272+0000","last_change":"2024-09-12T01:16:20.305272+0000","last_active":"2024-09-12T01:16:20.305272+0000","last_peered":"2024-09-12T01:16:20.305272+0000","last_clean":"2024-09-12T01:16:20.305272+0000","last_became_active":"2024-09-12T00:02:58.097332+0000","last_became_peered":"2024-09-12T00:02:58.097332+0000","last_unstale":"2024-09-12T01:16:20.305272+0000","last_undegraded":"2024-09-12T01:16:20.305272+0000","last_fullsized":"2024-09-12T01:16:20.305272+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'128","last_scrub_stamp":"2024-09-12T01:16:20.305137+0000","last_deep_scrub":"267'128","last_deep_scrub_stamp":"2024-09-12T01:16:20.305137+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.305137+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:42.624853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'387","reported_seq":2005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.709242+0000","last_change":"2024-09-12T01:15:59.709242+0000","last_active":"2024-09-12T01:15:59.709242+0000","last_peered":"2024-09-12T01:15:59.709242+0000","last_clean":"2024-09-12T01:15:59.709242+0000","last_became_active":"2024-09-12T00:02:50.063676+0000","last_became_peered":"2024-09-12T00:02:50.063676+0000","last_unstale":"2024-09-12T01:15:59.709242+0000","last_undegraded":"2024-09-12T01:15:59.709242+0000","last_fullsized":"2024-09-12T01:15:59.709242+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-09-12T01:15:59.709154+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-09-12T01:15:59.709154+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.709154+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:48.504412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2187,"num_read_kb":2115,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'185","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.700248+0000","last_change":"2024-09-12T01:15:58.700181+0000","last_active":"2024-09-12T01:15:58.700248+0000","last_peered":"2024-09-12T01:15:58.700248+0000","last_clean":"2024-09-12T01:15:58.700248+0000","last_became_active":"2024-09-12T00:02:48.046457+0000","last_became_peered":"2024-09-12T00:02:48.046457+0000","last_unstale":"2024-09-12T01:15:58.700248+0000","last_undegraded":"2024-09-12T01:15:58.700248+0000","last_fullsized":"2024-09-12T01:15:58.700248+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:58.700097+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:58.700097+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.700097+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:20.069674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":408,"num_read_kb":52839,"num_write":877,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1465,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.244747+0000","last_change":"2024-09-12T01:16:19.244747+0000","last_active":"2024-09-12T01:16:19.244747+0000","last_peered":"2024-09-12T01:16:19.244747+0000","last_clean":"2024-09-12T01:16:19.244747+0000","last_became_active":"2024-09-12T00:02:52.068535+0000","last_became_peered":"2024-09-12T00:02:52.068535+0000","last_unstale":"2024-09-12T01:16:19.244747+0000","last_undegraded":"2024-09-12T01:16:19.244747+0000","last_fullsized":"2024-09-12T01:16:19.244747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:16:19.244653+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:16:19.244653+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.244653+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:05.379037+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'108","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.637945+0000","last_change":"2024-09-12T01:16:11.637945+0000","last_active":"2024-09-12T01:16:11.637945+0000","last_peered":"2024-09-12T01:16:11.637945+0000","last_clean":"2024-09-12T01:16:11.637945+0000","last_became_active":"2024-09-12T00:02:54.239924+0000","last_became_peered":"2024-09-12T00:02:54.239924+0000","last_unstale":"2024-09-12T01:16:11.637945+0000","last_undegraded":"2024-09-12T01:16:11.637945+0000","last_fullsized":"2024-09-12T01:16:11.637945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'108","last_scrub_stamp":"2024-09-12T01:16:11.637836+0000","last_deep_scrub":"267'108","last_deep_scrub_stamp":"2024-09-12T01:16:11.637836+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.637836+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:14.647602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":4504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.454795+0000","last_change":"2024-09-12T01:16:14.454795+0000","last_active":"2024-09-12T01:16:14.454795+0000","last_peered":"2024-09-12T01:16:14.454795+0000","last_clean":"2024-09-12T01:16:14.454795+0000","last_became_active":"2024-09-12T00:02:56.086668+0000","last_became_peered":"2024-09-12T00:02:56.086668+0000","last_unstale":"2024-09-12T01:16:14.454795+0000","last_undegraded":"2024-09-12T01:16:14.454795+0000","last_fullsized":"2024-09-12T01:16:14.454795+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'773","last_scrub_stamp":"2024-09-12T01:16:14.454708+0000","last_deep_scrub":"267'773","last_deep_scrub_stamp":"2024-09-12T01:16:14.454708+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.454708+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:26.916302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'150","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.955992+0000","last_change":"2024-09-12T01:16:26.955992+0000","last_active":"2024-09-12T01:16:26.955992+0000","last_peered":"2024-09-12T01:16:26.955992+0000","last_clean":"2024-09-12T01:16:26.955992+0000","last_became_active":"2024-09-12T00:02:58.097435+0000","last_became_peered":"2024-09-12T00:02:58.097435+0000","last_unstale":"2024-09-12T01:16:26.955992+0000","last_undegraded":"2024-09-12T01:16:26.955992+0000","last_fullsized":"2024-09-12T01:16:26.955992+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'150","last_scrub_stamp":"2024-09-12T01:16:26.955889+0000","last_deep_scrub":"267'150","last_deep_scrub_stamp":"2024-09-12T01:16:26.955889+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.955889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:30.719695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":180,"num_write":378,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'763","reported_seq":2624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.126650+0000","last_change":"2024-09-12T01:16:05.126650+0000","last_active":"2024-09-12T01:16:05.126650+0000","last_peered":"2024-09-12T01:16:05.126650+0000","last_clean":"2024-09-12T01:16:05.126650+0000","last_became_active":"2024-09-12T00:02:50.069661+0000","last_became_peered":"2024-09-12T00:02:50.069661+0000","last_unstale":"2024-09-12T01:16:05.126650+0000","last_undegraded":"2024-09-12T01:16:05.126650+0000","last_fullsized":"2024-09-12T01:16:05.126650+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'763","last_scrub_stamp":"2024-09-12T01:16:05.126551+0000","last_deep_scrub":"267'763","last_deep_scrub_stamp":"2024-09-12T01:16:05.126551+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.126551+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:05.494723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4159,"num_read_kb":3799,"num_write":1082,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5109,"num_omap_keys":21,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'214","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.740174+0000","last_change":"2024-09-12T01:15:56.740095+0000","last_active":"2024-09-12T01:15:56.740174+0000","last_peered":"2024-09-12T01:15:56.740174+0000","last_clean":"2024-09-12T01:15:56.740174+0000","last_became_active":"2024-09-12T00:02:48.046527+0000","last_became_peered":"2024-09-12T00:02:48.046527+0000","last_unstale":"2024-09-12T01:15:56.740174+0000","last_undegraded":"2024-09-12T01:15:56.740174+0000","last_fullsized":"2024-09-12T01:15:56.740174+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-12T01:15:56.739986+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-12T01:15:56.739986+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.739986+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:08.369987+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":898,"num_read_kb":26543,"num_write":1077,"num_write_kb":24642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"267'5","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.918274+0000","last_change":"2024-09-12T01:16:13.918274+0000","last_active":"2024-09-12T01:16:13.918274+0000","last_peered":"2024-09-12T01:16:13.918274+0000","last_clean":"2024-09-12T01:16:13.918274+0000","last_became_active":"2024-09-12T00:02:52.064186+0000","last_became_peered":"2024-09-12T00:02:52.064186+0000","last_unstale":"2024-09-12T01:16:13.918274+0000","last_undegraded":"2024-09-12T01:16:13.918274+0000","last_fullsized":"2024-09-12T01:16:13.918274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:13.918187+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:13.918187+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.918187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:12.455769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'304","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.307202+0000","last_change":"2024-09-12T01:16:24.307202+0000","last_active":"2024-09-12T01:16:24.307202+0000","last_peered":"2024-09-12T01:16:24.307202+0000","last_clean":"2024-09-12T01:16:24.307202+0000","last_became_active":"2024-09-12T00:02:54.072431+0000","last_became_peered":"2024-09-12T00:02:54.072431+0000","last_unstale":"2024-09-12T01:16:24.307202+0000","last_undegraded":"2024-09-12T01:16:24.307202+0000","last_fullsized":"2024-09-12T01:16:24.307202+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'304","last_scrub_stamp":"2024-09-12T01:16:24.307101+0000","last_deep_scrub":"267'304","last_deep_scrub_stamp":"2024-09-12T01:16:24.307101+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.307101+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:18.118573+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1000,"num_write":1544,"num_write_kb":1370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488644,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.426217+0000","last_change":"2024-09-12T01:16:13.426217+0000","last_active":"2024-09-12T01:16:13.426217+0000","last_peered":"2024-09-12T01:16:13.426217+0000","last_clean":"2024-09-12T01:16:13.426217+0000","last_became_active":"2024-09-12T00:02:56.083643+0000","last_became_peered":"2024-09-12T00:02:56.083643+0000","last_unstale":"2024-09-12T01:16:13.426217+0000","last_undegraded":"2024-09-12T01:16:13.426217+0000","last_fullsized":"2024-09-12T01:16:13.426217+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.426122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.426122+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.426122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:16.827180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'156","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.268505+0000","last_change":"2024-09-12T01:16:21.268505+0000","last_active":"2024-09-12T01:16:21.268505+0000","last_peered":"2024-09-12T01:16:21.268505+0000","last_clean":"2024-09-12T01:16:21.268505+0000","last_became_active":"2024-09-12T00:02:58.096337+0000","last_became_peered":"2024-09-12T00:02:58.096337+0000","last_unstale":"2024-09-12T01:16:21.268505+0000","last_undegraded":"2024-09-12T01:16:21.268505+0000","last_fullsized":"2024-09-12T01:16:21.268505+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:21.268392+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:21.268392+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.268392+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:54.802343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":374,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'346","reported_seq":1750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.525322+0000","last_change":"2024-09-12T01:16:04.525322+0000","last_active":"2024-09-12T01:16:04.525322+0000","last_peered":"2024-09-12T01:16:04.525322+0000","last_clean":"2024-09-12T01:16:04.525322+0000","last_became_active":"2024-09-12T00:02:50.063141+0000","last_became_peered":"2024-09-12T00:02:50.063141+0000","last_unstale":"2024-09-12T01:16:04.525322+0000","last_undegraded":"2024-09-12T01:16:04.525322+0000","last_fullsized":"2024-09-12T01:16:04.525322+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T01:16:04.525232+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T01:16:04.525232+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.525232+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:47.471239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1807,"num_write":392,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.712040+0000","last_change":"2024-09-12T01:15:56.712040+0000","last_active":"2024-09-12T01:15:56.712040+0000","last_peered":"2024-09-12T01:15:56.712040+0000","last_clean":"2024-09-12T01:15:56.712040+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T01:15:56.712040+0000","last_undegraded":"2024-09-12T01:15:56.712040+0000","last_fullsized":"2024-09-12T01:15:56.712040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:15:56.711929+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:15:56.711929+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.711929+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.441635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.202303+0000","last_change":"2024-09-12T01:16:00.202303+0000","last_active":"2024-09-12T01:16:00.202303+0000","last_peered":"2024-09-12T01:16:00.202303+0000","last_clean":"2024-09-12T01:16:00.202303+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T01:16:00.202303+0000","last_undegraded":"2024-09-12T01:16:00.202303+0000","last_fullsized":"2024-09-12T01:16:00.202303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:00.202177+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:00.202177+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.202177+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:38.507294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'199","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.725025+0000","last_change":"2024-09-12T01:15:55.725025+0000","last_active":"2024-09-12T01:15:55.725025+0000","last_peered":"2024-09-12T01:15:55.725025+0000","last_clean":"2024-09-12T01:15:55.725025+0000","last_became_active":"2024-09-12T00:02:48.047739+0000","last_became_peered":"2024-09-12T00:02:48.047739+0000","last_unstale":"2024-09-12T01:15:55.725025+0000","last_undegraded":"2024-09-12T01:15:55.725025+0000","last_fullsized":"2024-09-12T01:15:55.725025+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'199","last_scrub_stamp":"2024-09-12T01:15:55.724921+0000","last_deep_scrub":"267'199","last_deep_scrub_stamp":"2024-09-12T01:15:55.724921+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.724921+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:06.864180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":439,"num_read_kb":34702,"num_write":919,"num_write_kb":51263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.805994+0000","last_change":"2024-09-12T01:16:14.805994+0000","last_active":"2024-09-12T01:16:14.805994+0000","last_peered":"2024-09-12T01:16:14.805994+0000","last_clean":"2024-09-12T01:16:14.805994+0000","last_became_active":"2024-09-12T00:02:52.065587+0000","last_became_peered":"2024-09-12T00:02:52.065587+0000","last_unstale":"2024-09-12T01:16:14.805994+0000","last_undegraded":"2024-09-12T01:16:14.805994+0000","last_fullsized":"2024-09-12T01:16:14.805994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.805908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.805908+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.805908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:19.064794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'340","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.278652+0000","last_change":"2024-09-12T01:16:23.278578+0000","last_active":"2024-09-12T01:16:23.278652+0000","last_peered":"2024-09-12T01:16:23.278652+0000","last_clean":"2024-09-12T01:16:23.278652+0000","last_became_active":"2024-09-12T00:02:54.069167+0000","last_became_peered":"2024-09-12T00:02:54.069167+0000","last_unstale":"2024-09-12T01:16:23.278652+0000","last_undegraded":"2024-09-12T01:16:23.278652+0000","last_fullsized":"2024-09-12T01:16:23.278652+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T01:16:23.278472+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T01:16:23.278472+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.278472+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.673031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":868,"num_write":580,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106956,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.650166+0000","last_change":"2024-09-12T01:16:20.650107+0000","last_active":"2024-09-12T01:16:20.650166+0000","last_peered":"2024-09-12T01:16:20.650166+0000","last_clean":"2024-09-12T01:16:20.650166+0000","last_became_active":"2024-09-12T00:02:56.082981+0000","last_became_peered":"2024-09-12T00:02:56.082981+0000","last_unstale":"2024-09-12T01:16:20.650166+0000","last_undegraded":"2024-09-12T01:16:20.650166+0000","last_fullsized":"2024-09-12T01:16:20.650166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:20.650022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:20.650022+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.650022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:11.460289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'224","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.388159+0000","last_change":"2024-09-12T01:16:20.388159+0000","last_active":"2024-09-12T01:16:20.388159+0000","last_peered":"2024-09-12T01:16:20.388159+0000","last_clean":"2024-09-12T01:16:20.388159+0000","last_became_active":"2024-09-12T00:02:58.099655+0000","last_became_peered":"2024-09-12T00:02:58.099655+0000","last_unstale":"2024-09-12T01:16:20.388159+0000","last_undegraded":"2024-09-12T01:16:20.388159+0000","last_fullsized":"2024-09-12T01:16:20.388159+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'224","last_scrub_stamp":"2024-09-12T01:16:20.388069+0000","last_deep_scrub":"267'224","last_deep_scrub_stamp":"2024-09-12T01:16:20.388069+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.388069+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.275567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1237,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":468,"num_write":474,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'877","reported_seq":2636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.833351+0000","last_change":"2024-09-12T01:16:03.833288+0000","last_active":"2024-09-12T01:16:03.833351+0000","last_peered":"2024-09-12T01:16:03.833351+0000","last_clean":"2024-09-12T01:16:03.833351+0000","last_became_active":"2024-09-12T00:02:50.075700+0000","last_became_peered":"2024-09-12T00:02:50.075700+0000","last_unstale":"2024-09-12T01:16:03.833351+0000","last_undegraded":"2024-09-12T01:16:03.833351+0000","last_fullsized":"2024-09-12T01:16:03.833351+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'877","last_scrub_stamp":"2024-09-12T01:16:03.833186+0000","last_deep_scrub":"267'877","last_deep_scrub_stamp":"2024-09-12T01:16:03.833186+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.833186+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:45.011515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4451,"num_read_kb":4025,"num_write":1186,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.692568+0000","last_change":"2024-09-12T01:15:58.692568+0000","last_active":"2024-09-12T01:15:58.692568+0000","last_peered":"2024-09-12T01:15:58.692568+0000","last_clean":"2024-09-12T01:15:58.692568+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T01:15:58.692568+0000","last_undegraded":"2024-09-12T01:15:58.692568+0000","last_fullsized":"2024-09-12T01:15:58.692568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:58.692481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:58.692481+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.692481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:48.738124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'216","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.934809+0000","last_change":"2024-09-12T01:15:54.934809+0000","last_active":"2024-09-12T01:15:54.934809+0000","last_peered":"2024-09-12T01:15:54.934809+0000","last_clean":"2024-09-12T01:15:54.934809+0000","last_became_active":"2024-09-12T00:02:48.057849+0000","last_became_peered":"2024-09-12T00:02:48.057849+0000","last_unstale":"2024-09-12T01:15:54.934809+0000","last_undegraded":"2024-09-12T01:15:54.934809+0000","last_fullsized":"2024-09-12T01:15:54.934809+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'216","last_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_deep_scrub":"267'216","last_deep_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.934711+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.315677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079943,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":138068,"num_write":1057,"num_write_kb":57312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.217101+0000","last_change":"2024-09-12T01:16:18.217024+0000","last_active":"2024-09-12T01:16:18.217101+0000","last_peered":"2024-09-12T01:16:18.217101+0000","last_clean":"2024-09-12T01:16:18.217101+0000","last_became_active":"2024-09-12T00:02:52.066352+0000","last_became_peered":"2024-09-12T00:02:52.066352+0000","last_unstale":"2024-09-12T01:16:18.217101+0000","last_undegraded":"2024-09-12T01:16:18.217101+0000","last_fullsized":"2024-09-12T01:16:18.217101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.216903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.216903+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.216903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:57.836293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'947","reported_seq":2795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.250857+0000","last_change":"2024-09-12T01:16:14.250857+0000","last_active":"2024-09-12T01:16:14.250857+0000","last_peered":"2024-09-12T01:16:14.250857+0000","last_clean":"2024-09-12T01:16:14.250857+0000","last_became_active":"2024-09-12T00:02:54.070061+0000","last_became_peered":"2024-09-12T00:02:54.070061+0000","last_unstale":"2024-09-12T01:16:14.250857+0000","last_undegraded":"2024-09-12T01:16:14.250857+0000","last_fullsized":"2024-09-12T01:16:14.250857+0000","mapping_epoch":32,"log_start":"267'901","ondisk_log_start":"267'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'947","last_scrub_stamp":"2024-09-12T01:16:14.250736+0000","last_deep_scrub":"267'947","last_deep_scrub_stamp":"2024-09-12T01:16:14.250736+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.250736+0000","objects_scrubbed":12,"log_size":46,"log_dups_size":901,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.703976+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20817,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1281,"num_read_kb":1476,"num_write":392,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.913627+0000","last_change":"2024-09-12T01:16:24.913627+0000","last_active":"2024-09-12T01:16:24.913627+0000","last_peered":"2024-09-12T01:16:24.913627+0000","last_clean":"2024-09-12T01:16:24.913627+0000","last_became_active":"2024-09-12T00:02:56.078658+0000","last_became_peered":"2024-09-12T00:02:56.078658+0000","last_unstale":"2024-09-12T01:16:24.913627+0000","last_undegraded":"2024-09-12T01:16:24.913627+0000","last_fullsized":"2024-09-12T01:16:24.913627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.913532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.913532+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.913532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:54.477216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'172","reported_seq":762,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.262539+0000","last_change":"2024-09-12T01:16:22.262539+0000","last_active":"2024-09-12T01:16:22.262539+0000","last_peered":"2024-09-12T01:16:22.262539+0000","last_clean":"2024-09-12T01:16:22.262539+0000","last_became_active":"2024-09-12T00:02:58.089378+0000","last_became_peered":"2024-09-12T00:02:58.089378+0000","last_unstale":"2024-09-12T01:16:22.262539+0000","last_undegraded":"2024-09-12T01:16:22.262539+0000","last_fullsized":"2024-09-12T01:16:22.262539+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'172","last_scrub_stamp":"2024-09-12T01:16:22.262447+0000","last_deep_scrub":"267'172","last_deep_scrub_stamp":"2024-09-12T01:16:22.262447+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.262447+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:23.907893+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":336,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'1109","reported_seq":2835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.124023+0000","last_change":"2024-09-12T01:16:03.123960+0000","last_active":"2024-09-12T01:16:03.124023+0000","last_peered":"2024-09-12T01:16:03.124023+0000","last_clean":"2024-09-12T01:16:03.124023+0000","last_became_active":"2024-09-12T00:02:50.067002+0000","last_became_peered":"2024-09-12T00:02:50.067002+0000","last_unstale":"2024-09-12T01:16:03.124023+0000","last_undegraded":"2024-09-12T01:16:03.124023+0000","last_fullsized":"2024-09-12T01:16:03.124023+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1109","last_scrub_stamp":"2024-09-12T01:16:03.123868+0000","last_deep_scrub":"267'1109","last_deep_scrub_stamp":"2024-09-12T01:16:03.123868+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.123868+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":1000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.293606+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5247,"num_read_kb":4613,"num_write":1599,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":551,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.086300+0000","last_change":"2024-09-12T01:15:54.086300+0000","last_active":"2024-09-12T01:15:54.086300+0000","last_peered":"2024-09-12T01:15:54.086300+0000","last_clean":"2024-09-12T01:15:54.086300+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T01:15:54.086300+0000","last_undegraded":"2024-09-12T01:15:54.086300+0000","last_fullsized":"2024-09-12T01:15:54.086300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:54.086226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:54.086226+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.086226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:56.605178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'185","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.053418+0000","last_change":"2024-09-12T01:15:56.053418+0000","last_active":"2024-09-12T01:15:56.053418+0000","last_peered":"2024-09-12T01:15:56.053418+0000","last_clean":"2024-09-12T01:15:56.053418+0000","last_became_active":"2024-09-12T00:02:48.044126+0000","last_became_peered":"2024-09-12T00:02:48.044126+0000","last_unstale":"2024-09-12T01:15:56.053418+0000","last_undegraded":"2024-09-12T01:15:56.053418+0000","last_fullsized":"2024-09-12T01:15:56.053418+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:56.053326+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:56.053326+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.053326+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.310181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4751719,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":400,"num_read_kb":27065,"num_write":781,"num_write_kb":40333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.261642+0000","last_change":"2024-09-12T01:16:05.261538+0000","last_active":"2024-09-12T01:16:05.261642+0000","last_peered":"2024-09-12T01:16:05.261642+0000","last_clean":"2024-09-12T01:16:05.261642+0000","last_became_active":"2024-09-12T00:02:52.068351+0000","last_became_peered":"2024-09-12T00:02:52.068351+0000","last_unstale":"2024-09-12T01:16:05.261642+0000","last_undegraded":"2024-09-12T01:16:05.261642+0000","last_fullsized":"2024-09-12T01:16:05.261642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:05.261339+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:05.261339+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.261339+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:53.809383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'311","reported_seq":1750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.874033+0000","last_change":"2024-09-12T01:16:21.874033+0000","last_active":"2024-09-12T01:16:21.874033+0000","last_peered":"2024-09-12T01:16:21.874033+0000","last_clean":"2024-09-12T01:16:21.874033+0000","last_became_active":"2024-09-12T00:02:54.241581+0000","last_became_peered":"2024-09-12T00:02:54.241581+0000","last_unstale":"2024-09-12T01:16:21.874033+0000","last_undegraded":"2024-09-12T01:16:21.874033+0000","last_fullsized":"2024-09-12T01:16:21.874033+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:16:21.873938+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:16:21.873938+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.873938+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:16.952197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":254,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.668167+0000","last_change":"2024-09-12T01:16:18.668167+0000","last_active":"2024-09-12T01:16:18.668167+0000","last_peered":"2024-09-12T01:16:18.668167+0000","last_clean":"2024-09-12T01:16:18.668167+0000","last_became_active":"2024-09-12T00:02:56.081641+0000","last_became_peered":"2024-09-12T00:02:56.081641+0000","last_unstale":"2024-09-12T01:16:18.668167+0000","last_undegraded":"2024-09-12T01:16:18.668167+0000","last_fullsized":"2024-09-12T01:16:18.668167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.668049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.668049+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.668049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:09.740334+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'277","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.612937+0000","last_change":"2024-09-12T01:16:28.612937+0000","last_active":"2024-09-12T01:16:28.612937+0000","last_peered":"2024-09-12T01:16:28.612937+0000","last_clean":"2024-09-12T01:16:28.612937+0000","last_became_active":"2024-09-12T00:02:58.088442+0000","last_became_peered":"2024-09-12T00:02:58.088442+0000","last_unstale":"2024-09-12T01:16:28.612937+0000","last_undegraded":"2024-09-12T01:16:28.612937+0000","last_fullsized":"2024-09-12T01:16:28.612937+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T01:16:28.612850+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T01:16:28.612850+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.612850+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.460954+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":615,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'439","reported_seq":2024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.247988+0000","last_change":"2024-09-12T01:16:10.247891+0000","last_active":"2024-09-12T01:16:10.247988+0000","last_peered":"2024-09-12T01:16:10.247988+0000","last_clean":"2024-09-12T01:16:10.247988+0000","last_became_active":"2024-09-12T00:03:21.140691+0000","last_became_peered":"2024-09-12T00:03:21.140691+0000","last_unstale":"2024-09-12T01:16:10.247988+0000","last_undegraded":"2024-09-12T01:16:10.247988+0000","last_fullsized":"2024-09-12T01:16:10.247988+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'439","last_scrub_stamp":"2024-09-12T01:16:10.247775+0000","last_deep_scrub":"267'439","last_deep_scrub_stamp":"2024-09-12T01:16:10.247775+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.247775+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:43.615955+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2439,"num_read_kb":2322,"num_write":494,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.160871+0000","last_change":"2024-09-12T01:15:56.160871+0000","last_active":"2024-09-12T01:15:56.160871+0000","last_peered":"2024-09-12T01:15:56.160871+0000","last_clean":"2024-09-12T01:15:56.160871+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T01:15:56.160871+0000","last_undegraded":"2024-09-12T01:15:56.160871+0000","last_fullsized":"2024-09-12T01:15:56.160871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:15:56.160739+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:15:56.160739+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.160739+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:36.791017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'207","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.693700+0000","last_change":"2024-09-12T01:15:55.693700+0000","last_active":"2024-09-12T01:15:55.693700+0000","last_peered":"2024-09-12T01:15:55.693700+0000","last_clean":"2024-09-12T01:15:55.693700+0000","last_became_active":"2024-09-12T00:02:48.049260+0000","last_became_peered":"2024-09-12T00:02:48.049260+0000","last_unstale":"2024-09-12T01:15:55.693700+0000","last_undegraded":"2024-09-12T01:15:55.693700+0000","last_fullsized":"2024-09-12T01:15:55.693700+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-12T01:15:55.693558+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-12T01:15:55.693558+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.693558+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.593673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":103584,"num_write":943,"num_write_kb":20218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.641153+0000","last_change":"2024-09-12T01:16:12.641153+0000","last_active":"2024-09-12T01:16:12.641153+0000","last_peered":"2024-09-12T01:16:12.641153+0000","last_clean":"2024-09-12T01:16:12.641153+0000","last_became_active":"2024-09-12T00:02:52.066289+0000","last_became_peered":"2024-09-12T00:02:52.066289+0000","last_unstale":"2024-09-12T01:16:12.641153+0000","last_undegraded":"2024-09-12T01:16:12.641153+0000","last_fullsized":"2024-09-12T01:16:12.641153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:12.641053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:12.641053+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.641053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:37.049985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'166","reported_seq":741,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.578322+0000","last_change":"2024-09-12T01:16:20.578250+0000","last_active":"2024-09-12T01:16:20.578322+0000","last_peered":"2024-09-12T01:16:20.578322+0000","last_clean":"2024-09-12T01:16:20.578322+0000","last_became_active":"2024-09-12T00:02:54.066864+0000","last_became_peered":"2024-09-12T00:02:54.066864+0000","last_unstale":"2024-09-12T01:16:20.578322+0000","last_undegraded":"2024-09-12T01:16:20.578322+0000","last_fullsized":"2024-09-12T01:16:20.578322+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-09-12T01:16:20.578154+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-09-12T01:16:20.578154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.578154+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:07.312869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":203,"num_read_kb":195,"num_write":150,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.458972+0000","last_change":"2024-09-12T01:16:12.458972+0000","last_active":"2024-09-12T01:16:12.458972+0000","last_peered":"2024-09-12T01:16:12.458972+0000","last_clean":"2024-09-12T01:16:12.458972+0000","last_became_active":"2024-09-12T00:02:56.085437+0000","last_became_peered":"2024-09-12T00:02:56.085437+0000","last_unstale":"2024-09-12T01:16:12.458972+0000","last_undegraded":"2024-09-12T01:16:12.458972+0000","last_fullsized":"2024-09-12T01:16:12.458972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:12.458882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:12.458882+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.458882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:11.334322+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'109","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.260026+0000","last_change":"2024-09-12T01:16:30.260026+0000","last_active":"2024-09-12T01:16:30.260026+0000","last_peered":"2024-09-12T01:16:30.260026+0000","last_clean":"2024-09-12T01:16:30.260026+0000","last_became_active":"2024-09-12T00:02:58.095419+0000","last_became_peered":"2024-09-12T00:02:58.095419+0000","last_unstale":"2024-09-12T01:16:30.260026+0000","last_undegraded":"2024-09-12T01:16:30.260026+0000","last_fullsized":"2024-09-12T01:16:30.260026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'109","last_scrub_stamp":"2024-09-12T01:16:30.259943+0000","last_deep_scrub":"267'109","last_deep_scrub_stamp":"2024-09-12T01:16:30.259943+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.259943+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:03.848903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":189,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'417","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.135125+0000","last_change":"2024-09-12T01:16:04.135125+0000","last_active":"2024-09-12T01:16:04.135125+0000","last_peered":"2024-09-12T01:16:04.135125+0000","last_clean":"2024-09-12T01:16:04.135125+0000","last_became_active":"2024-09-12T00:02:50.075209+0000","last_became_peered":"2024-09-12T00:02:50.075209+0000","last_unstale":"2024-09-12T01:16:04.135125+0000","last_undegraded":"2024-09-12T01:16:04.135125+0000","last_fullsized":"2024-09-12T01:16:04.135125+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'417","last_scrub_stamp":"2024-09-12T01:16:04.135003+0000","last_deep_scrub":"267'417","last_deep_scrub_stamp":"2024-09-12T01:16:04.135003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.135003+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.259816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2214,"num_read_kb":2093,"num_write":483,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'191","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.197783+0000","last_change":"2024-09-12T01:15:58.197783+0000","last_active":"2024-09-12T01:15:58.197783+0000","last_peered":"2024-09-12T01:15:58.197783+0000","last_clean":"2024-09-12T01:15:58.197783+0000","last_became_active":"2024-09-12T00:02:48.052751+0000","last_became_peered":"2024-09-12T00:02:48.052751+0000","last_unstale":"2024-09-12T01:15:58.197783+0000","last_undegraded":"2024-09-12T01:15:58.197783+0000","last_fullsized":"2024-09-12T01:15:58.197783+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'191","last_scrub_stamp":"2024-09-12T01:15:58.197662+0000","last_deep_scrub":"267'191","last_deep_scrub_stamp":"2024-09-12T01:15:58.197662+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.197662+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:11.307806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493417,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":26295,"num_write":910,"num_write_kb":36863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.106575+0000","last_change":"2024-09-12T01:15:54.106575+0000","last_active":"2024-09-12T01:15:54.106575+0000","last_peered":"2024-09-12T01:15:54.106575+0000","last_clean":"2024-09-12T01:15:54.106575+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T01:15:54.106575+0000","last_undegraded":"2024-09-12T01:15:54.106575+0000","last_fullsized":"2024-09-12T01:15:54.106575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:54.106483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:54.106483+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.106483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:20.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.681070+0000","last_change":"2024-09-12T01:16:11.681070+0000","last_active":"2024-09-12T01:16:11.681070+0000","last_peered":"2024-09-12T01:16:11.681070+0000","last_clean":"2024-09-12T01:16:11.681070+0000","last_became_active":"2024-09-12T00:02:52.067200+0000","last_became_peered":"2024-09-12T00:02:52.067200+0000","last_unstale":"2024-09-12T01:16:11.681070+0000","last_undegraded":"2024-09-12T01:16:11.681070+0000","last_fullsized":"2024-09-12T01:16:11.681070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:11.680981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:11.680981+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.680981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:51.075341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'316","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.694954+0000","last_change":"2024-09-12T01:16:14.694954+0000","last_active":"2024-09-12T01:16:14.694954+0000","last_peered":"2024-09-12T01:16:14.694954+0000","last_clean":"2024-09-12T01:16:14.694954+0000","last_became_active":"2024-09-12T00:02:54.069071+0000","last_became_peered":"2024-09-12T00:02:54.069071+0000","last_unstale":"2024-09-12T01:16:14.694954+0000","last_undegraded":"2024-09-12T01:16:14.694954+0000","last_fullsized":"2024-09-12T01:16:14.694954+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'316","last_scrub_stamp":"2024-09-12T01:16:14.694854+0000","last_deep_scrub":"267'316","last_deep_scrub_stamp":"2024-09-12T01:16:14.694854+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.694854+0000","objects_scrubbed":11,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:57.933950+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":450,"num_read_kb":594,"num_write":258,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.951234+0000","last_change":"2024-09-12T01:16:23.951234+0000","last_active":"2024-09-12T01:16:23.951234+0000","last_peered":"2024-09-12T01:16:23.951234+0000","last_clean":"2024-09-12T01:16:23.951234+0000","last_became_active":"2024-09-12T00:02:56.082046+0000","last_became_peered":"2024-09-12T00:02:56.082046+0000","last_unstale":"2024-09-12T01:16:23.951234+0000","last_undegraded":"2024-09-12T01:16:23.951234+0000","last_fullsized":"2024-09-12T01:16:23.951234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.951113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.951113+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.951113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.037004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'167","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.583861+0000","last_change":"2024-09-12T01:16:28.583861+0000","last_active":"2024-09-12T01:16:28.583861+0000","last_peered":"2024-09-12T01:16:28.583861+0000","last_clean":"2024-09-12T01:16:28.583861+0000","last_became_active":"2024-09-12T00:02:58.091590+0000","last_became_peered":"2024-09-12T00:02:58.091590+0000","last_unstale":"2024-09-12T01:16:28.583861+0000","last_undegraded":"2024-09-12T01:16:28.583861+0000","last_fullsized":"2024-09-12T01:16:28.583861+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T01:16:28.583748+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T01:16:28.583748+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.583748+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:57.607309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1150,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":174,"num_write":425,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'452","reported_seq":2003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.829586+0000","last_change":"2024-09-12T01:16:02.829586+0000","last_active":"2024-09-12T01:16:02.829586+0000","last_peered":"2024-09-12T01:16:02.829586+0000","last_clean":"2024-09-12T01:16:02.829586+0000","last_became_active":"2024-09-12T00:02:50.073262+0000","last_became_peered":"2024-09-12T00:02:50.073262+0000","last_unstale":"2024-09-12T01:16:02.829586+0000","last_undegraded":"2024-09-12T01:16:02.829586+0000","last_fullsized":"2024-09-12T01:16:02.829586+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'452","last_scrub_stamp":"2024-09-12T01:16:02.829503+0000","last_deep_scrub":"267'452","last_deep_scrub_stamp":"2024-09-12T01:16:02.829503+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.829503+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:27.994764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2298,"num_read_kb":2165,"num_write":516,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'158","reported_seq":798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.086308+0000","last_change":"2024-09-12T01:15:57.086308+0000","last_active":"2024-09-12T01:15:57.086308+0000","last_peered":"2024-09-12T01:15:57.086308+0000","last_clean":"2024-09-12T01:15:57.086308+0000","last_became_active":"2024-09-12T00:02:48.052768+0000","last_became_peered":"2024-09-12T00:02:48.052768+0000","last_unstale":"2024-09-12T01:15:57.086308+0000","last_undegraded":"2024-09-12T01:15:57.086308+0000","last_fullsized":"2024-09-12T01:15:57.086308+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:15:57.086208+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:15:57.086208+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.086208+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:33.822235+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3687654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":16851,"num_write":770,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.680047+0000","last_change":"2024-09-12T01:15:57.680047+0000","last_active":"2024-09-12T01:15:57.680047+0000","last_peered":"2024-09-12T01:15:57.680047+0000","last_clean":"2024-09-12T01:15:57.680047+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T01:15:57.680047+0000","last_undegraded":"2024-09-12T01:15:57.680047+0000","last_fullsized":"2024-09-12T01:15:57.680047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:57.679926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:57.679926+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.679926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:28.341226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.404382+0000","last_change":"2024-09-12T01:16:09.404382+0000","last_active":"2024-09-12T01:16:09.404382+0000","last_peered":"2024-09-12T01:16:09.404382+0000","last_clean":"2024-09-12T01:16:09.404382+0000","last_became_active":"2024-09-12T00:02:52.069469+0000","last_became_peered":"2024-09-12T00:02:52.069469+0000","last_unstale":"2024-09-12T01:16:09.404382+0000","last_undegraded":"2024-09-12T01:16:09.404382+0000","last_fullsized":"2024-09-12T01:16:09.404382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.404244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.404244+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.404244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:48.154706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'268","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.257925+0000","last_change":"2024-09-12T01:16:15.257925+0000","last_active":"2024-09-12T01:16:15.257925+0000","last_peered":"2024-09-12T01:16:15.257925+0000","last_clean":"2024-09-12T01:16:15.257925+0000","last_became_active":"2024-09-12T00:02:54.239879+0000","last_became_peered":"2024-09-12T00:02:54.239879+0000","last_unstale":"2024-09-12T01:16:15.257925+0000","last_undegraded":"2024-09-12T01:16:15.257925+0000","last_fullsized":"2024-09-12T01:16:15.257925+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'268","last_scrub_stamp":"2024-09-12T01:16:15.257819+0000","last_deep_scrub":"267'268","last_deep_scrub_stamp":"2024-09-12T01:16:15.257819+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.257819+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:05.117332+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":332,"num_read_kb":322,"num_write":304,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'794","reported_seq":5272,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.307983+0000","last_change":"2024-09-12T01:16:27.307983+0000","last_active":"2024-09-12T01:16:27.307983+0000","last_peered":"2024-09-12T01:16:27.307983+0000","last_clean":"2024-09-12T01:16:27.307983+0000","last_became_active":"2024-09-12T00:02:56.086704+0000","last_became_peered":"2024-09-12T00:02:56.086704+0000","last_unstale":"2024-09-12T01:16:27.307983+0000","last_undegraded":"2024-09-12T01:16:27.307983+0000","last_fullsized":"2024-09-12T01:16:27.307983+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'794","last_scrub_stamp":"2024-09-12T01:16:27.307879+0000","last_deep_scrub":"267'794","last_deep_scrub_stamp":"2024-09-12T01:16:27.307879+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.307879+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.008848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'156","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.602075+0000","last_change":"2024-09-12T01:16:30.602075+0000","last_active":"2024-09-12T01:16:30.602075+0000","last_peered":"2024-09-12T01:16:30.602075+0000","last_clean":"2024-09-12T01:16:30.602075+0000","last_became_active":"2024-09-12T00:02:58.091466+0000","last_became_peered":"2024-09-12T00:02:58.091466+0000","last_unstale":"2024-09-12T01:16:30.602075+0000","last_undegraded":"2024-09-12T01:16:30.602075+0000","last_fullsized":"2024-09-12T01:16:30.602075+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:30.601983+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:30.601983+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.601983+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:41.138937+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":335,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'992","reported_seq":2663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.642819+0000","last_change":"2024-09-12T01:16:05.642819+0000","last_active":"2024-09-12T01:16:05.642819+0000","last_peered":"2024-09-12T01:16:05.642819+0000","last_clean":"2024-09-12T01:16:05.642819+0000","last_became_active":"2024-09-12T00:02:50.067868+0000","last_became_peered":"2024-09-12T00:02:50.067868+0000","last_unstale":"2024-09-12T01:16:05.642819+0000","last_undegraded":"2024-09-12T01:16:05.642819+0000","last_fullsized":"2024-09-12T01:16:05.642819+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'992","last_scrub_stamp":"2024-09-12T01:16:05.642648+0000","last_deep_scrub":"267'992","last_deep_scrub_stamp":"2024-09-12T01:16:05.642648+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.642648+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":900,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.830523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4764,"num_read_kb":4246,"num_write":1341,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'174","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.765888+0000","last_change":"2024-09-12T01:15:54.765840+0000","last_active":"2024-09-12T01:15:54.765888+0000","last_peered":"2024-09-12T01:15:54.765888+0000","last_clean":"2024-09-12T01:15:54.765888+0000","last_became_active":"2024-09-12T00:02:48.052431+0000","last_became_peered":"2024-09-12T00:02:48.052431+0000","last_unstale":"2024-09-12T01:15:54.765888+0000","last_undegraded":"2024-09-12T01:15:54.765888+0000","last_fullsized":"2024-09-12T01:15:54.765888+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-12T01:15:54.765727+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-12T01:15:54.765727+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.765727+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:58.196722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1211576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":121623,"num_write":832,"num_write_kb":33084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.074501+0000","last_change":"2024-09-12T01:15:55.074456+0000","last_active":"2024-09-12T01:15:55.074501+0000","last_peered":"2024-09-12T01:15:55.074501+0000","last_clean":"2024-09-12T01:15:55.074501+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T01:15:55.074501+0000","last_undegraded":"2024-09-12T01:15:55.074501+0000","last_fullsized":"2024-09-12T01:15:55.074501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:55.074392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:55.074392+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.074392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:33.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.904718+0000","last_change":"2024-09-12T01:16:14.904718+0000","last_active":"2024-09-12T01:16:14.904718+0000","last_peered":"2024-09-12T01:16:14.904718+0000","last_clean":"2024-09-12T01:16:14.904718+0000","last_became_active":"2024-09-12T00:02:52.062631+0000","last_became_peered":"2024-09-12T00:02:52.062631+0000","last_unstale":"2024-09-12T01:16:14.904718+0000","last_undegraded":"2024-09-12T01:16:14.904718+0000","last_fullsized":"2024-09-12T01:16:14.904718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.904620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.904620+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.904620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:52.933314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'143","reported_seq":720,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.989354+0000","last_change":"2024-09-12T01:16:18.989354+0000","last_active":"2024-09-12T01:16:18.989354+0000","last_peered":"2024-09-12T01:16:18.989354+0000","last_clean":"2024-09-12T01:16:18.989354+0000","last_became_active":"2024-09-12T00:02:54.068812+0000","last_became_peered":"2024-09-12T00:02:54.068812+0000","last_unstale":"2024-09-12T01:16:18.989354+0000","last_undegraded":"2024-09-12T01:16:18.989354+0000","last_fullsized":"2024-09-12T01:16:18.989354+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'143","last_scrub_stamp":"2024-09-12T01:16:18.989240+0000","last_deep_scrub":"267'143","last_deep_scrub_stamp":"2024-09-12T01:16:18.989240+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.989240+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:18.570760+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":169,"num_write":118,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'809","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.552525+0000","last_change":"2024-09-12T01:16:26.552525+0000","last_active":"2024-09-12T01:16:26.552525+0000","last_peered":"2024-09-12T01:16:26.552525+0000","last_clean":"2024-09-12T01:16:26.552525+0000","last_became_active":"2024-09-12T00:02:56.083894+0000","last_became_peered":"2024-09-12T00:02:56.083894+0000","last_unstale":"2024-09-12T01:16:26.552525+0000","last_undegraded":"2024-09-12T01:16:26.552525+0000","last_fullsized":"2024-09-12T01:16:26.552525+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'809","last_scrub_stamp":"2024-09-12T01:16:26.552439+0000","last_deep_scrub":"267'809","last_deep_scrub_stamp":"2024-09-12T01:16:26.552439+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.552439+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:42.339646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'277","reported_seq":814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.621041+0000","last_change":"2024-09-12T01:16:27.621041+0000","last_active":"2024-09-12T01:16:27.621041+0000","last_peered":"2024-09-12T01:16:27.621041+0000","last_clean":"2024-09-12T01:16:27.621041+0000","last_became_active":"2024-09-12T00:02:58.093442+0000","last_became_peered":"2024-09-12T00:02:58.093442+0000","last_unstale":"2024-09-12T01:16:27.621041+0000","last_undegraded":"2024-09-12T01:16:27.621041+0000","last_fullsized":"2024-09-12T01:16:27.621041+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T01:16:27.620900+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T01:16:27.620900+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.620900+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:52.669324+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":340,"num_read_kb":339,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'414","reported_seq":1929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.721059+0000","last_change":"2024-09-12T01:16:01.721059+0000","last_active":"2024-09-12T01:16:01.721059+0000","last_peered":"2024-09-12T01:16:01.721059+0000","last_clean":"2024-09-12T01:16:01.721059+0000","last_became_active":"2024-09-12T00:02:50.057999+0000","last_became_peered":"2024-09-12T00:02:50.057999+0000","last_unstale":"2024-09-12T01:16:01.721059+0000","last_undegraded":"2024-09-12T01:16:01.721059+0000","last_fullsized":"2024-09-12T01:16:01.721059+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-12T01:16:01.720958+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-12T01:16:01.720958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.720958+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:36.846886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2267,"num_read_kb":2133,"num_write":493,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'270","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:53.943397+0000","last_change":"2024-09-12T01:15:53.943324+0000","last_active":"2024-09-12T01:15:53.943397+0000","last_peered":"2024-09-12T01:15:53.943397+0000","last_clean":"2024-09-12T01:15:53.943397+0000","last_became_active":"2024-09-12T00:02:48.051495+0000","last_became_peered":"2024-09-12T00:02:48.051495+0000","last_unstale":"2024-09-12T01:15:53.943397+0000","last_undegraded":"2024-09-12T01:15:53.943397+0000","last_fullsized":"2024-09-12T01:15:53.943397+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_clean_scrub_stamp":"2024-09-12T01:15:53.943232+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:48.709674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598650,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":670,"num_read_kb":18611,"num_write":1220,"num_write_kb":43211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.519319+0000","last_change":"2024-09-12T01:16:00.519255+0000","last_active":"2024-09-12T01:16:00.519319+0000","last_peered":"2024-09-12T01:16:00.519319+0000","last_clean":"2024-09-12T01:16:00.519319+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T01:16:00.519319+0000","last_undegraded":"2024-09-12T01:16:00.519319+0000","last_fullsized":"2024-09-12T01:16:00.519319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:00.519172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:00.519172+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.519172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:56.447826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.594306+0000","last_change":"2024-09-12T01:16:13.594306+0000","last_active":"2024-09-12T01:16:13.594306+0000","last_peered":"2024-09-12T01:16:13.594306+0000","last_clean":"2024-09-12T01:16:13.594306+0000","last_became_active":"2024-09-12T00:02:52.062544+0000","last_became_peered":"2024-09-12T00:02:52.062544+0000","last_unstale":"2024-09-12T01:16:13.594306+0000","last_undegraded":"2024-09-12T01:16:13.594306+0000","last_fullsized":"2024-09-12T01:16:13.594306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.594219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.594219+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.594219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:10.561944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'364","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.903838+0000","last_change":"2024-09-12T01:16:17.903838+0000","last_active":"2024-09-12T01:16:17.903838+0000","last_peered":"2024-09-12T01:16:17.903838+0000","last_clean":"2024-09-12T01:16:17.903838+0000","last_became_active":"2024-09-12T00:02:54.239355+0000","last_became_peered":"2024-09-12T00:02:54.239355+0000","last_unstale":"2024-09-12T01:16:17.903838+0000","last_undegraded":"2024-09-12T01:16:17.903838+0000","last_fullsized":"2024-09-12T01:16:17.903838+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T01:16:17.903729+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T01:16:17.903729+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.903729+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:31.614604+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":736,"num_write":272,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.603312+0000","last_change":"2024-09-12T01:16:19.603312+0000","last_active":"2024-09-12T01:16:19.603312+0000","last_peered":"2024-09-12T01:16:19.603312+0000","last_clean":"2024-09-12T01:16:19.603312+0000","last_became_active":"2024-09-12T00:02:56.087448+0000","last_became_peered":"2024-09-12T00:02:56.087448+0000","last_unstale":"2024-09-12T01:16:19.603312+0000","last_undegraded":"2024-09-12T01:16:19.603312+0000","last_fullsized":"2024-09-12T01:16:19.603312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:19.603217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:19.603217+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.603217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:11.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'131","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.257024+0000","last_change":"2024-09-12T01:16:31.257024+0000","last_active":"2024-09-12T01:16:31.257024+0000","last_peered":"2024-09-12T01:16:31.257024+0000","last_clean":"2024-09-12T01:16:31.257024+0000","last_became_active":"2024-09-12T00:02:58.099906+0000","last_became_peered":"2024-09-12T00:02:58.099906+0000","last_unstale":"2024-09-12T01:16:31.257024+0000","last_undegraded":"2024-09-12T01:16:31.257024+0000","last_fullsized":"2024-09-12T01:16:31.257024+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:16:31.256911+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:16:31.256911+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.256911+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:58.144369+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":140,"num_write":299,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'131","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.682118+0000","last_change":"2024-09-12T01:16:31.682118+0000","last_active":"2024-09-12T01:16:31.682118+0000","last_peered":"2024-09-12T01:16:31.682118+0000","last_clean":"2024-09-12T01:16:31.682118+0000","last_became_active":"2024-09-12T00:02:58.099564+0000","last_became_peered":"2024-09-12T00:02:58.099564+0000","last_unstale":"2024-09-12T01:16:31.682118+0000","last_undegraded":"2024-09-12T01:16:31.682118+0000","last_fullsized":"2024-09-12T01:16:31.682118+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:16:31.682035+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:16:31.682035+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.682035+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:49.336012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":201,"num_write":295,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'832","reported_seq":2385,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.713433+0000","last_change":"2024-09-12T01:16:02.713433+0000","last_active":"2024-09-12T01:16:02.713433+0000","last_peered":"2024-09-12T01:16:02.713433+0000","last_clean":"2024-09-12T01:16:02.713433+0000","last_became_active":"2024-09-12T00:02:50.063351+0000","last_became_peered":"2024-09-12T00:02:50.063351+0000","last_unstale":"2024-09-12T01:16:02.713433+0000","last_undegraded":"2024-09-12T01:16:02.713433+0000","last_fullsized":"2024-09-12T01:16:02.713433+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'832","last_scrub_stamp":"2024-09-12T01:16:02.713331+0000","last_deep_scrub":"267'832","last_deep_scrub_stamp":"2024-09-12T01:16:02.713331+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.713331+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:01.106721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3851,"num_read_kb":3457,"num_write":1080,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'158","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.711008+0000","last_change":"2024-09-12T01:15:56.711008+0000","last_active":"2024-09-12T01:15:56.711008+0000","last_peered":"2024-09-12T01:15:56.711008+0000","last_clean":"2024-09-12T01:15:56.711008+0000","last_became_active":"2024-09-12T00:02:48.047723+0000","last_became_peered":"2024-09-12T00:02:48.047723+0000","last_unstale":"2024-09-12T01:15:56.711008+0000","last_undegraded":"2024-09-12T01:15:56.711008+0000","last_fullsized":"2024-09-12T01:15:56.711008+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:15:56.710861+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:15:56.710861+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.710861+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:41.398940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":26182,"num_write":818,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.127605+0000","last_change":"2024-09-12T01:16:09.127605+0000","last_active":"2024-09-12T01:16:09.127605+0000","last_peered":"2024-09-12T01:16:09.127605+0000","last_clean":"2024-09-12T01:16:09.127605+0000","last_became_active":"2024-09-12T00:02:52.066702+0000","last_became_peered":"2024-09-12T00:02:52.066702+0000","last_unstale":"2024-09-12T01:16:09.127605+0000","last_undegraded":"2024-09-12T01:16:09.127605+0000","last_fullsized":"2024-09-12T01:16:09.127605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.127494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.127494+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.127494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:35.855938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'201","reported_seq":808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.591460+0000","last_change":"2024-09-12T01:16:16.591460+0000","last_active":"2024-09-12T01:16:16.591460+0000","last_peered":"2024-09-12T01:16:16.591460+0000","last_clean":"2024-09-12T01:16:16.591460+0000","last_became_active":"2024-09-12T00:02:54.066679+0000","last_became_peered":"2024-09-12T00:02:54.066679+0000","last_unstale":"2024-09-12T01:16:16.591460+0000","last_undegraded":"2024-09-12T01:16:16.591460+0000","last_fullsized":"2024-09-12T01:16:16.591460+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:16:16.591267+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:16:16.591267+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.591267+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:25.553404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":343,"num_write":152,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.556234+0000","last_change":"2024-09-12T01:16:24.556234+0000","last_active":"2024-09-12T01:16:24.556234+0000","last_peered":"2024-09-12T01:16:24.556234+0000","last_clean":"2024-09-12T01:16:24.556234+0000","last_became_active":"2024-09-12T00:02:56.081445+0000","last_became_peered":"2024-09-12T00:02:56.081445+0000","last_unstale":"2024-09-12T01:16:24.556234+0000","last_undegraded":"2024-09-12T01:16:24.556234+0000","last_fullsized":"2024-09-12T01:16:24.556234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.556139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.556139+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.556139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:06.184503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'151","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:03.456004+0000","last_change":"2024-09-12T00:02:58.097284+0000","last_active":"2024-09-12T01:13:03.456004+0000","last_peered":"2024-09-12T01:13:03.456004+0000","last_clean":"2024-09-12T01:13:03.456004+0000","last_became_active":"2024-09-12T00:02:58.096979+0000","last_became_peered":"2024-09-12T00:02:58.096979+0000","last_unstale":"2024-09-12T01:13:03.456004+0000","last_undegraded":"2024-09-12T01:13:03.456004+0000","last_fullsized":"2024-09-12T01:13:03.456004+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:10.194576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":142,"num_write":377,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'431","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.142244+0000","last_change":"2024-09-12T01:16:06.142244+0000","last_active":"2024-09-12T01:16:06.142244+0000","last_peered":"2024-09-12T01:16:06.142244+0000","last_clean":"2024-09-12T01:16:06.142244+0000","last_became_active":"2024-09-12T00:02:50.065307+0000","last_became_peered":"2024-09-12T00:02:50.065307+0000","last_unstale":"2024-09-12T01:16:06.142244+0000","last_undegraded":"2024-09-12T01:16:06.142244+0000","last_fullsized":"2024-09-12T01:16:06.142244+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'431","last_scrub_stamp":"2024-09-12T01:16:06.142162+0000","last_deep_scrub":"267'431","last_deep_scrub_stamp":"2024-09-12T01:16:06.142162+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.142162+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:57.029036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2299,"num_read_kb":2174,"num_write":505,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'162","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.721269+0000","last_change":"2024-09-12T01:16:02.721269+0000","last_active":"2024-09-12T01:16:02.721269+0000","last_peered":"2024-09-12T01:16:02.721269+0000","last_clean":"2024-09-12T01:16:02.721269+0000","last_became_active":"2024-09-12T00:02:48.048506+0000","last_became_peered":"2024-09-12T00:02:48.048506+0000","last_unstale":"2024-09-12T01:16:02.721269+0000","last_undegraded":"2024-09-12T01:16:02.721269+0000","last_fullsized":"2024-09-12T01:16:02.721269+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:02.721132+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:02.721132+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.721132+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:27.676261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":321,"num_read_kb":61867,"num_write":777,"num_write_kb":44911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.589857+0000","last_change":"2024-09-12T01:16:14.589857+0000","last_active":"2024-09-12T01:16:14.589857+0000","last_peered":"2024-09-12T01:16:14.589857+0000","last_clean":"2024-09-12T01:16:14.589857+0000","last_became_active":"2024-09-12T00:02:52.064967+0000","last_became_peered":"2024-09-12T00:02:52.064967+0000","last_unstale":"2024-09-12T01:16:14.589857+0000","last_undegraded":"2024-09-12T01:16:14.589857+0000","last_fullsized":"2024-09-12T01:16:14.589857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.589757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.589757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.589757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:08.739218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'62","reported_seq":587,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.684858+0000","last_change":"2024-09-12T01:16:19.684858+0000","last_active":"2024-09-12T01:16:19.684858+0000","last_peered":"2024-09-12T01:16:19.684858+0000","last_clean":"2024-09-12T01:16:19.684858+0000","last_became_active":"2024-09-12T00:02:54.067255+0000","last_became_peered":"2024-09-12T00:02:54.067255+0000","last_unstale":"2024-09-12T01:16:19.684858+0000","last_undegraded":"2024-09-12T01:16:19.684858+0000","last_fullsized":"2024-09-12T01:16:19.684858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'62","last_scrub_stamp":"2024-09-12T01:16:19.684757+0000","last_deep_scrub":"267'62","last_deep_scrub_stamp":"2024-09-12T01:16:19.684757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.684757+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:16.708129+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.885028+0000","last_change":"2024-09-12T01:16:25.885028+0000","last_active":"2024-09-12T01:16:25.885028+0000","last_peered":"2024-09-12T01:16:25.885028+0000","last_clean":"2024-09-12T01:16:25.885028+0000","last_became_active":"2024-09-12T00:02:56.079057+0000","last_became_peered":"2024-09-12T00:02:56.079057+0000","last_unstale":"2024-09-12T01:16:25.885028+0000","last_undegraded":"2024-09-12T01:16:25.885028+0000","last_fullsized":"2024-09-12T01:16:25.885028+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.884902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.884902+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.884902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:53.091760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'187","reported_seq":719,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.610921+0000","last_change":"2024-09-12T01:16:29.610921+0000","last_active":"2024-09-12T01:16:29.610921+0000","last_peered":"2024-09-12T01:16:29.610921+0000","last_clean":"2024-09-12T01:16:29.610921+0000","last_became_active":"2024-09-12T00:02:58.091505+0000","last_became_peered":"2024-09-12T00:02:58.091505+0000","last_unstale":"2024-09-12T01:16:29.610921+0000","last_undegraded":"2024-09-12T01:16:29.610921+0000","last_fullsized":"2024-09-12T01:16:29.610921+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:16:29.610820+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:16:29.610820+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.610820+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:21.995692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":268,"num_read_kb":263,"num_write":396,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'447","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.608031+0000","last_change":"2024-09-12T01:16:06.608031+0000","last_active":"2024-09-12T01:16:06.608031+0000","last_peered":"2024-09-12T01:16:06.608031+0000","last_clean":"2024-09-12T01:16:06.608031+0000","last_became_active":"2024-09-12T00:02:50.068129+0000","last_became_peered":"2024-09-12T00:02:50.068129+0000","last_unstale":"2024-09-12T01:16:06.608031+0000","last_undegraded":"2024-09-12T01:16:06.608031+0000","last_fullsized":"2024-09-12T01:16:06.608031+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-12T01:16:06.607930+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-12T01:16:06.607930+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.607930+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:54.520447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2203,"num_read_kb":2070,"num_write":514,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'206","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.193472+0000","last_change":"2024-09-12T01:15:59.193472+0000","last_active":"2024-09-12T01:15:59.193472+0000","last_peered":"2024-09-12T01:15:59.193472+0000","last_clean":"2024-09-12T01:15:59.193472+0000","last_became_active":"2024-09-12T00:02:48.049791+0000","last_became_peered":"2024-09-12T00:02:48.049791+0000","last_unstale":"2024-09-12T01:15:59.193472+0000","last_undegraded":"2024-09-12T01:15:59.193472+0000","last_fullsized":"2024-09-12T01:15:59.193472+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'206","last_scrub_stamp":"2024-09-12T01:15:59.193369+0000","last_deep_scrub":"267'206","last_deep_scrub_stamp":"2024-09-12T01:15:59.193369+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.193369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:40.264107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":116478,"num_write":1001,"num_write_kb":35286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.873485+0000","last_change":"2024-09-12T01:16:16.873485+0000","last_active":"2024-09-12T01:16:16.873485+0000","last_peered":"2024-09-12T01:16:16.873485+0000","last_clean":"2024-09-12T01:16:16.873485+0000","last_became_active":"2024-09-12T00:02:52.071502+0000","last_became_peered":"2024-09-12T00:02:52.071502+0000","last_unstale":"2024-09-12T01:16:16.873485+0000","last_undegraded":"2024-09-12T01:16:16.873485+0000","last_fullsized":"2024-09-12T01:16:16.873485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.873383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.873383+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.873383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:10.546043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'208","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.605684+0000","last_change":"2024-09-12T01:16:21.605684+0000","last_active":"2024-09-12T01:16:21.605684+0000","last_peered":"2024-09-12T01:16:21.605684+0000","last_clean":"2024-09-12T01:16:21.605684+0000","last_became_active":"2024-09-12T00:02:54.067314+0000","last_became_peered":"2024-09-12T00:02:54.067314+0000","last_unstale":"2024-09-12T01:16:21.605684+0000","last_undegraded":"2024-09-12T01:16:21.605684+0000","last_fullsized":"2024-09-12T01:16:21.605684+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-12T01:16:21.605595+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-12T01:16:21.605595+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.605595+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.268586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18955,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":388,"num_write":160,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.477221+0000","last_change":"2024-09-12T01:16:15.477221+0000","last_active":"2024-09-12T01:16:15.477221+0000","last_peered":"2024-09-12T01:16:15.477221+0000","last_clean":"2024-09-12T01:16:15.477221+0000","last_became_active":"2024-09-12T00:02:56.084651+0000","last_became_peered":"2024-09-12T00:02:56.084651+0000","last_unstale":"2024-09-12T01:16:15.477221+0000","last_undegraded":"2024-09-12T01:16:15.477221+0000","last_fullsized":"2024-09-12T01:16:15.477221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.477139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.477139+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.477139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:59.506909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'155","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:05.706621+0000","last_change":"2024-09-12T00:02:58.100001+0000","last_active":"2024-09-12T01:13:05.706621+0000","last_peered":"2024-09-12T01:13:05.706621+0000","last_clean":"2024-09-12T01:13:05.706621+0000","last_became_active":"2024-09-12T00:02:58.099635+0000","last_became_peered":"2024-09-12T00:02:58.099635+0000","last_unstale":"2024-09-12T01:13:05.706621+0000","last_undegraded":"2024-09-12T01:13:05.706621+0000","last_fullsized":"2024-09-12T01:13:05.706621+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:57.065776+0000","last_clean_scrub_stamp":"2024-09-12T00:02:57.065776+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:38.037347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":359,"num_read_kb":309,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'638","reported_seq":2530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.622238+0000","last_change":"2024-09-12T01:16:07.622238+0000","last_active":"2024-09-12T01:16:07.622238+0000","last_peered":"2024-09-12T01:16:07.622238+0000","last_clean":"2024-09-12T01:16:07.622238+0000","last_became_active":"2024-09-12T00:02:50.068518+0000","last_became_peered":"2024-09-12T00:02:50.068518+0000","last_unstale":"2024-09-12T01:16:07.622238+0000","last_undegraded":"2024-09-12T01:16:07.622238+0000","last_fullsized":"2024-09-12T01:16:07.622238+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'638","last_scrub_stamp":"2024-09-12T01:16:07.622152+0000","last_deep_scrub":"267'638","last_deep_scrub_stamp":"2024-09-12T01:16:07.622152+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.622152+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:11.149565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3685,"num_read_kb":3433,"num_write":846,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'197","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.883669+0000","last_change":"2024-09-12T01:15:57.883669+0000","last_active":"2024-09-12T01:15:57.883669+0000","last_peered":"2024-09-12T01:15:57.883669+0000","last_clean":"2024-09-12T01:15:57.883669+0000","last_became_active":"2024-09-12T00:02:48.054056+0000","last_became_peered":"2024-09-12T00:02:48.054056+0000","last_unstale":"2024-09-12T01:15:57.883669+0000","last_undegraded":"2024-09-12T01:15:57.883669+0000","last_fullsized":"2024-09-12T01:15:57.883669+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'197","last_scrub_stamp":"2024-09-12T01:15:57.883525+0000","last_deep_scrub":"267'197","last_deep_scrub_stamp":"2024-09-12T01:15:57.883525+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.883525+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.780477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493919,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":69874,"num_write":900,"num_write_kb":25144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.392046+0000","last_change":"2024-09-12T01:16:10.392046+0000","last_active":"2024-09-12T01:16:10.392046+0000","last_peered":"2024-09-12T01:16:10.392046+0000","last_clean":"2024-09-12T01:16:10.392046+0000","last_became_active":"2024-09-12T00:02:52.064441+0000","last_became_peered":"2024-09-12T00:02:52.064441+0000","last_unstale":"2024-09-12T01:16:10.392046+0000","last_undegraded":"2024-09-12T01:16:10.392046+0000","last_fullsized":"2024-09-12T01:16:10.392046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.391958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.391958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.391958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:22.111524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'145","reported_seq":736,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.891145+0000","last_change":"2024-09-12T01:16:20.891145+0000","last_active":"2024-09-12T01:16:20.891145+0000","last_peered":"2024-09-12T01:16:20.891145+0000","last_clean":"2024-09-12T01:16:20.891145+0000","last_became_active":"2024-09-12T00:02:54.066900+0000","last_became_peered":"2024-09-12T00:02:54.066900+0000","last_unstale":"2024-09-12T01:16:20.891145+0000","last_undegraded":"2024-09-12T01:16:20.891145+0000","last_fullsized":"2024-09-12T01:16:20.891145+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'145","last_scrub_stamp":"2024-09-12T01:16:20.891064+0000","last_deep_scrub":"267'145","last_deep_scrub_stamp":"2024-09-12T01:16:20.891064+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.891064+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:59.572392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.562956+0000","last_change":"2024-09-12T01:16:23.562956+0000","last_active":"2024-09-12T01:16:23.562956+0000","last_peered":"2024-09-12T01:16:23.562956+0000","last_clean":"2024-09-12T01:16:23.562956+0000","last_became_active":"2024-09-12T00:02:56.084454+0000","last_became_peered":"2024-09-12T00:02:56.084454+0000","last_unstale":"2024-09-12T01:16:23.562956+0000","last_undegraded":"2024-09-12T01:16:23.562956+0000","last_fullsized":"2024-09-12T01:16:23.562956+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.562866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.562866+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.562866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.666113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'814","reported_seq":2296,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.492864+0000","last_change":"2024-09-12T01:16:06.492864+0000","last_active":"2024-09-12T01:16:06.492864+0000","last_peered":"2024-09-12T01:16:06.492864+0000","last_clean":"2024-09-12T01:16:06.492864+0000","last_became_active":"2024-09-12T00:02:50.072570+0000","last_became_peered":"2024-09-12T00:02:50.072570+0000","last_unstale":"2024-09-12T01:16:06.492864+0000","last_undegraded":"2024-09-12T01:16:06.492864+0000","last_fullsized":"2024-09-12T01:16:06.492864+0000","mapping_epoch":28,"log_start":"267'801","ondisk_log_start":"267'801","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'814","last_scrub_stamp":"2024-09-12T01:16:06.492765+0000","last_deep_scrub":"267'814","last_deep_scrub_stamp":"2024-09-12T01:16:06.492765+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.492765+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":801,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.698227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3795,"num_read_kb":3393,"num_write":1092,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1437,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'152","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.794883+0000","last_change":"2024-09-12T01:15:58.794883+0000","last_active":"2024-09-12T01:15:58.794883+0000","last_peered":"2024-09-12T01:15:58.794883+0000","last_clean":"2024-09-12T01:15:58.794883+0000","last_became_active":"2024-09-12T00:02:48.050025+0000","last_became_peered":"2024-09-12T00:02:48.050025+0000","last_unstale":"2024-09-12T01:15:58.794883+0000","last_undegraded":"2024-09-12T01:15:58.794883+0000","last_fullsized":"2024-09-12T01:15:58.794883+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:15:58.794742+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:15:58.794742+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.794742+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:46.260076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":278,"num_read_kb":9330,"num_write":746,"num_write_kb":34876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.683097+0000","last_change":"2024-09-12T01:16:13.683097+0000","last_active":"2024-09-12T01:16:13.683097+0000","last_peered":"2024-09-12T01:16:13.683097+0000","last_clean":"2024-09-12T01:16:13.683097+0000","last_became_active":"2024-09-12T00:02:52.071201+0000","last_became_peered":"2024-09-12T00:02:52.071201+0000","last_unstale":"2024-09-12T01:16:13.683097+0000","last_undegraded":"2024-09-12T01:16:13.683097+0000","last_fullsized":"2024-09-12T01:16:13.683097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.683003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.683003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.683003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:16.153780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'230","reported_seq":893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.270920+0000","last_change":"2024-09-12T01:16:17.270920+0000","last_active":"2024-09-12T01:16:17.270920+0000","last_peered":"2024-09-12T01:16:17.270920+0000","last_clean":"2024-09-12T01:16:17.270920+0000","last_became_active":"2024-09-12T00:02:54.073541+0000","last_became_peered":"2024-09-12T00:02:54.073541+0000","last_unstale":"2024-09-12T01:16:17.270920+0000","last_undegraded":"2024-09-12T01:16:17.270920+0000","last_fullsized":"2024-09-12T01:16:17.270920+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-12T01:16:17.270842+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-12T01:16:17.270842+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.270842+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:18.778181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15168,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":358,"num_read_kb":528,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.303594+0000","last_change":"2024-09-12T01:16:28.303594+0000","last_active":"2024-09-12T01:16:28.303594+0000","last_peered":"2024-09-12T01:16:28.303594+0000","last_clean":"2024-09-12T01:16:28.303594+0000","last_became_active":"2024-09-12T00:02:56.084627+0000","last_became_peered":"2024-09-12T00:02:56.084627+0000","last_unstale":"2024-09-12T01:16:28.303594+0000","last_undegraded":"2024-09-12T01:16:28.303594+0000","last_fullsized":"2024-09-12T01:16:28.303594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:28.303500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:28.303500+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.303500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:20.250220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'186","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.631872+0000","last_change":"2024-09-12T01:16:31.631872+0000","last_active":"2024-09-12T01:16:31.631872+0000","last_peered":"2024-09-12T01:16:31.631872+0000","last_clean":"2024-09-12T01:16:31.631872+0000","last_became_active":"2024-09-12T00:02:58.089750+0000","last_became_peered":"2024-09-12T00:02:58.089750+0000","last_unstale":"2024-09-12T01:16:31.631872+0000","last_undegraded":"2024-09-12T01:16:31.631872+0000","last_fullsized":"2024-09-12T01:16:31.631872+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-12T01:16:31.631772+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-12T01:16:31.631772+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.631772+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:29.946650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":234,"num_read_kb":235,"num_write":422,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'480","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.730708+0000","last_change":"2024-09-12T01:16:08.730708+0000","last_active":"2024-09-12T01:16:08.730708+0000","last_peered":"2024-09-12T01:16:08.730708+0000","last_clean":"2024-09-12T01:16:08.730708+0000","last_became_active":"2024-09-12T00:02:50.064157+0000","last_became_peered":"2024-09-12T00:02:50.064157+0000","last_unstale":"2024-09-12T01:16:08.730708+0000","last_undegraded":"2024-09-12T01:16:08.730708+0000","last_fullsized":"2024-09-12T01:16:08.730708+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'480","last_scrub_stamp":"2024-09-12T01:16:08.730614+0000","last_deep_scrub":"267'480","last_deep_scrub_stamp":"2024-09-12T01:16:08.730614+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.730614+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:57.895222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2183,"num_write":585,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1892,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'252","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.084847+0000","last_change":"2024-09-12T01:15:58.084847+0000","last_active":"2024-09-12T01:15:58.084847+0000","last_peered":"2024-09-12T01:15:58.084847+0000","last_clean":"2024-09-12T01:15:58.084847+0000","last_became_active":"2024-09-12T00:02:48.053055+0000","last_became_peered":"2024-09-12T00:02:48.053055+0000","last_unstale":"2024-09-12T01:15:58.084847+0000","last_undegraded":"2024-09-12T01:15:58.084847+0000","last_fullsized":"2024-09-12T01:15:58.084847+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'252","last_scrub_stamp":"2024-09-12T01:15:58.084728+0000","last_deep_scrub":"267'252","last_deep_scrub_stamp":"2024-09-12T01:15:58.084728+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.084728+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:42.507269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":662,"num_read_kb":2689,"num_write":1334,"num_write_kb":25481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.423609+0000","last_change":"2024-09-12T01:16:11.423609+0000","last_active":"2024-09-12T01:16:11.423609+0000","last_peered":"2024-09-12T01:16:11.423609+0000","last_clean":"2024-09-12T01:16:11.423609+0000","last_became_active":"2024-09-12T00:02:52.060034+0000","last_became_peered":"2024-09-12T00:02:52.060034+0000","last_unstale":"2024-09-12T01:16:11.423609+0000","last_undegraded":"2024-09-12T01:16:11.423609+0000","last_fullsized":"2024-09-12T01:16:11.423609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:11.423519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:11.423519+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.423519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:10.571986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'205","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.878921+0000","last_change":"2024-09-12T01:16:23.878921+0000","last_active":"2024-09-12T01:16:23.878921+0000","last_peered":"2024-09-12T01:16:23.878921+0000","last_clean":"2024-09-12T01:16:23.878921+0000","last_became_active":"2024-09-12T00:02:54.066854+0000","last_became_peered":"2024-09-12T00:02:54.066854+0000","last_unstale":"2024-09-12T01:16:23.878921+0000","last_undegraded":"2024-09-12T01:16:23.878921+0000","last_fullsized":"2024-09-12T01:16:23.878921+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'205","last_scrub_stamp":"2024-09-12T01:16:23.878805+0000","last_deep_scrub":"267'205","last_deep_scrub_stamp":"2024-09-12T01:16:23.878805+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.878805+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:02.656337+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":290,"num_read_kb":407,"num_write":194,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.314619+0000","last_change":"2024-09-12T01:16:18.314619+0000","last_active":"2024-09-12T01:16:18.314619+0000","last_peered":"2024-09-12T01:16:18.314619+0000","last_clean":"2024-09-12T01:16:18.314619+0000","last_became_active":"2024-09-12T00:02:56.086349+0000","last_became_peered":"2024-09-12T00:02:56.086349+0000","last_unstale":"2024-09-12T01:16:18.314619+0000","last_undegraded":"2024-09-12T01:16:18.314619+0000","last_fullsized":"2024-09-12T01:16:18.314619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.314499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.314499+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.314499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:29.781773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'176","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.366518+0000","last_change":"2024-09-12T01:16:19.366518+0000","last_active":"2024-09-12T01:16:19.366518+0000","last_peered":"2024-09-12T01:16:19.366518+0000","last_clean":"2024-09-12T01:16:19.366518+0000","last_became_active":"2024-09-12T00:02:58.100646+0000","last_became_peered":"2024-09-12T00:02:58.100646+0000","last_unstale":"2024-09-12T01:16:19.366518+0000","last_undegraded":"2024-09-12T01:16:19.366518+0000","last_fullsized":"2024-09-12T01:16:19.366518+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'176","last_scrub_stamp":"2024-09-12T01:16:19.366420+0000","last_deep_scrub":"267'176","last_deep_scrub_stamp":"2024-09-12T01:16:19.366420+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.366420+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:32.801190+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":591,"num_write":465,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'697","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.619187+0000","last_change":"2024-09-12T01:16:10.619187+0000","last_active":"2024-09-12T01:16:10.619187+0000","last_peered":"2024-09-12T01:16:10.619187+0000","last_clean":"2024-09-12T01:16:10.619187+0000","last_became_active":"2024-09-12T00:02:50.072665+0000","last_became_peered":"2024-09-12T00:02:50.072665+0000","last_unstale":"2024-09-12T01:16:10.619187+0000","last_undegraded":"2024-09-12T01:16:10.619187+0000","last_fullsized":"2024-09-12T01:16:10.619187+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'697","last_scrub_stamp":"2024-09-12T01:16:10.619098+0000","last_deep_scrub":"267'697","last_deep_scrub_stamp":"2024-09-12T01:16:10.619098+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.619098+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:07.282926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3202,"num_read_kb":2877,"num_write":917,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'241","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.110405+0000","last_change":"2024-09-12T01:15:56.110405+0000","last_active":"2024-09-12T01:15:56.110405+0000","last_peered":"2024-09-12T01:15:56.110405+0000","last_clean":"2024-09-12T01:15:56.110405+0000","last_became_active":"2024-09-12T00:03:21.140095+0000","last_became_peered":"2024-09-12T00:03:21.140095+0000","last_unstale":"2024-09-12T01:15:56.110405+0000","last_undegraded":"2024-09-12T01:15:56.110405+0000","last_fullsized":"2024-09-12T01:15:56.110405+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-12T01:15:56.110316+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-12T01:15:56.110316+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.110316+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:39.287721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":39289,"num_write":1009,"num_write_kb":58524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.903046+0000","last_change":"2024-09-12T01:16:16.903046+0000","last_active":"2024-09-12T01:16:16.903046+0000","last_peered":"2024-09-12T01:16:16.903046+0000","last_clean":"2024-09-12T01:16:16.903046+0000","last_became_active":"2024-09-12T00:02:52.063334+0000","last_became_peered":"2024-09-12T00:02:52.063334+0000","last_unstale":"2024-09-12T01:16:16.903046+0000","last_undegraded":"2024-09-12T01:16:16.903046+0000","last_fullsized":"2024-09-12T01:16:16.903046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.902950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.902950+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.902950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:50.260846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'178","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.600551+0000","last_change":"2024-09-12T01:16:18.600551+0000","last_active":"2024-09-12T01:16:18.600551+0000","last_peered":"2024-09-12T01:16:18.600551+0000","last_clean":"2024-09-12T01:16:18.600551+0000","last_became_active":"2024-09-12T00:02:54.240007+0000","last_became_peered":"2024-09-12T00:02:54.240007+0000","last_unstale":"2024-09-12T01:16:18.600551+0000","last_undegraded":"2024-09-12T01:16:18.600551+0000","last_fullsized":"2024-09-12T01:16:18.600551+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'178","last_scrub_stamp":"2024-09-12T01:16:18.600451+0000","last_deep_scrub":"267'178","last_deep_scrub_stamp":"2024-09-12T01:16:18.600451+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.600451+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:24.259892+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":288,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.309231+0000","last_change":"2024-09-12T01:16:19.309231+0000","last_active":"2024-09-12T01:16:19.309231+0000","last_peered":"2024-09-12T01:16:19.309231+0000","last_clean":"2024-09-12T01:16:19.309231+0000","last_became_active":"2024-09-12T00:02:56.087317+0000","last_became_peered":"2024-09-12T00:02:56.087317+0000","last_unstale":"2024-09-12T01:16:19.309231+0000","last_undegraded":"2024-09-12T01:16:19.309231+0000","last_fullsized":"2024-09-12T01:16:19.309231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:19.309148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:19.309148+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.309148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:20.598859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'151","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.214600+0000","last_change":"2024-09-12T01:16:32.214600+0000","last_active":"2024-09-12T01:16:32.214600+0000","last_peered":"2024-09-12T01:16:32.214600+0000","last_clean":"2024-09-12T01:16:32.214600+0000","last_became_active":"2024-09-12T00:02:58.099712+0000","last_became_peered":"2024-09-12T00:02:58.099712+0000","last_unstale":"2024-09-12T01:16:32.214600+0000","last_undegraded":"2024-09-12T01:16:32.214600+0000","last_fullsized":"2024-09-12T01:16:32.214600+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-12T01:16:32.214514+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-12T01:16:32.214514+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.214514+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.161826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'710","reported_seq":2420,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.262576+0000","last_change":"2024-09-12T01:16:02.262576+0000","last_active":"2024-09-12T01:16:02.262576+0000","last_peered":"2024-09-12T01:16:02.262576+0000","last_clean":"2024-09-12T01:16:02.262576+0000","last_became_active":"2024-09-12T00:02:50.061909+0000","last_became_peered":"2024-09-12T00:02:50.061909+0000","last_unstale":"2024-09-12T01:16:02.262576+0000","last_undegraded":"2024-09-12T01:16:02.262576+0000","last_fullsized":"2024-09-12T01:16:02.262576+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'710","last_scrub_stamp":"2024-09-12T01:16:02.262485+0000","last_deep_scrub":"267'710","last_deep_scrub_stamp":"2024-09-12T01:16:02.262485+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.262485+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":600,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:26.931797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3690,"num_read_kb":3334,"num_write":961,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1922,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'201","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.918024+0000","last_change":"2024-09-12T01:15:56.918024+0000","last_active":"2024-09-12T01:15:56.918024+0000","last_peered":"2024-09-12T01:15:56.918024+0000","last_clean":"2024-09-12T01:15:56.918024+0000","last_became_active":"2024-09-12T00:02:48.050894+0000","last_became_peered":"2024-09-12T00:02:48.050894+0000","last_unstale":"2024-09-12T01:15:56.918024+0000","last_undegraded":"2024-09-12T01:15:56.918024+0000","last_fullsized":"2024-09-12T01:15:56.918024+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:15:56.917926+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:15:56.917926+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.917926+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:57.174009+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409979,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":20890,"num_write":1012,"num_write_kb":39832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.203493+0000","last_change":"2024-09-12T01:16:13.203493+0000","last_active":"2024-09-12T01:16:13.203493+0000","last_peered":"2024-09-12T01:16:13.203493+0000","last_clean":"2024-09-12T01:16:13.203493+0000","last_became_active":"2024-09-12T00:02:52.064125+0000","last_became_peered":"2024-09-12T00:02:52.064125+0000","last_unstale":"2024-09-12T01:16:13.203493+0000","last_undegraded":"2024-09-12T01:16:13.203493+0000","last_fullsized":"2024-09-12T01:16:13.203493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.203371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.203371+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.203371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:07.040646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'118","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.966454+0000","last_change":"2024-09-12T01:16:22.966454+0000","last_active":"2024-09-12T01:16:22.966454+0000","last_peered":"2024-09-12T01:16:22.966454+0000","last_clean":"2024-09-12T01:16:22.966454+0000","last_became_active":"2024-09-12T00:02:54.239412+0000","last_became_peered":"2024-09-12T00:02:54.239412+0000","last_unstale":"2024-09-12T01:16:22.966454+0000","last_undegraded":"2024-09-12T01:16:22.966454+0000","last_fullsized":"2024-09-12T01:16:22.966454+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:16:22.966358+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:16:22.966358+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.966358+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:38.921115+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'772","reported_seq":2654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.441107+0000","last_change":"2024-09-12T01:16:17.441107+0000","last_active":"2024-09-12T01:16:17.441107+0000","last_peered":"2024-09-12T01:16:17.441107+0000","last_clean":"2024-09-12T01:16:17.441107+0000","last_became_active":"2024-09-12T00:02:56.080374+0000","last_became_peered":"2024-09-12T00:02:56.080374+0000","last_unstale":"2024-09-12T01:16:17.441107+0000","last_undegraded":"2024-09-12T01:16:17.441107+0000","last_fullsized":"2024-09-12T01:16:17.441107+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'772","last_scrub_stamp":"2024-09-12T01:16:17.441017+0000","last_deep_scrub":"267'772","last_deep_scrub_stamp":"2024-09-12T01:16:17.441017+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.441017+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:39.610983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'117","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.798101+0000","last_change":"2024-09-12T01:16:28.798101+0000","last_active":"2024-09-12T01:16:28.798101+0000","last_peered":"2024-09-12T01:16:28.798101+0000","last_clean":"2024-09-12T01:16:28.798101+0000","last_became_active":"2024-09-12T00:02:58.100777+0000","last_became_peered":"2024-09-12T00:02:58.100777+0000","last_unstale":"2024-09-12T01:16:28.798101+0000","last_undegraded":"2024-09-12T01:16:28.798101+0000","last_fullsized":"2024-09-12T01:16:28.798101+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:16:28.798015+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:16:28.798015+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.798015+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:32.708838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'476","reported_seq":2046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.851836+0000","last_change":"2024-09-12T01:16:06.851836+0000","last_active":"2024-09-12T01:16:06.851836+0000","last_peered":"2024-09-12T01:16:06.851836+0000","last_clean":"2024-09-12T01:16:06.851836+0000","last_became_active":"2024-09-12T00:02:50.070186+0000","last_became_peered":"2024-09-12T00:02:50.070186+0000","last_unstale":"2024-09-12T01:16:06.851836+0000","last_undegraded":"2024-09-12T01:16:06.851836+0000","last_fullsized":"2024-09-12T01:16:06.851836+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'476","last_scrub_stamp":"2024-09-12T01:16:06.851723+0000","last_deep_scrub":"267'476","last_deep_scrub_stamp":"2024-09-12T01:16:06.851723+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.851723+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:58.941621+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2560,"num_read_kb":2381,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'280","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.159485+0000","last_change":"2024-09-12T01:16:01.159485+0000","last_active":"2024-09-12T01:16:01.159485+0000","last_peered":"2024-09-12T01:16:01.159485+0000","last_clean":"2024-09-12T01:16:01.159485+0000","last_became_active":"2024-09-12T00:02:48.054303+0000","last_became_peered":"2024-09-12T00:02:48.054303+0000","last_unstale":"2024-09-12T01:16:01.159485+0000","last_undegraded":"2024-09-12T01:16:01.159485+0000","last_fullsized":"2024-09-12T01:16:01.159485+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'280","last_scrub_stamp":"2024-09-12T01:16:01.159368+0000","last_deep_scrub":"267'280","last_deep_scrub_stamp":"2024-09-12T01:16:01.159368+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.159368+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:04.113014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":47582,"num_write":1191,"num_write_kb":28572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.873818+0000","last_change":"2024-09-12T01:16:18.873818+0000","last_active":"2024-09-12T01:16:18.873818+0000","last_peered":"2024-09-12T01:16:18.873818+0000","last_clean":"2024-09-12T01:16:18.873818+0000","last_became_active":"2024-09-12T00:02:52.071580+0000","last_became_peered":"2024-09-12T00:02:52.071580+0000","last_unstale":"2024-09-12T01:16:18.873818+0000","last_undegraded":"2024-09-12T01:16:18.873818+0000","last_fullsized":"2024-09-12T01:16:18.873818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.873734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.873734+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.873734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:59.300868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'240","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.283472+0000","last_change":"2024-09-12T01:16:26.283472+0000","last_active":"2024-09-12T01:16:26.283472+0000","last_peered":"2024-09-12T01:16:26.283472+0000","last_clean":"2024-09-12T01:16:26.283472+0000","last_became_active":"2024-09-12T00:02:54.068806+0000","last_became_peered":"2024-09-12T00:02:54.068806+0000","last_unstale":"2024-09-12T01:16:26.283472+0000","last_undegraded":"2024-09-12T01:16:26.283472+0000","last_fullsized":"2024-09-12T01:16:26.283472+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-12T01:16:26.283363+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-12T01:16:26.283363+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.283363+0000","objects_scrubbed":11,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:44.646018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9605,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":355,"num_write":182,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.608463+0000","last_change":"2024-09-12T01:16:24.608463+0000","last_active":"2024-09-12T01:16:24.608463+0000","last_peered":"2024-09-12T01:16:24.608463+0000","last_clean":"2024-09-12T01:16:24.608463+0000","last_became_active":"2024-09-12T00:02:56.082924+0000","last_became_peered":"2024-09-12T00:02:56.082924+0000","last_unstale":"2024-09-12T01:16:24.608463+0000","last_undegraded":"2024-09-12T01:16:24.608463+0000","last_fullsized":"2024-09-12T01:16:24.608463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.608368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.608368+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.608368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:33.741139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'111","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.807213+0000","last_change":"2024-09-12T01:16:29.807213+0000","last_active":"2024-09-12T01:16:29.807213+0000","last_peered":"2024-09-12T01:16:29.807213+0000","last_clean":"2024-09-12T01:16:29.807213+0000","last_became_active":"2024-09-12T00:02:58.099683+0000","last_became_peered":"2024-09-12T00:02:58.099683+0000","last_unstale":"2024-09-12T01:16:29.807213+0000","last_undegraded":"2024-09-12T01:16:29.807213+0000","last_fullsized":"2024-09-12T01:16:29.807213+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-12T01:16:29.807131+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-12T01:16:29.807131+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.807131+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:24.107285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":199,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'542","reported_seq":2277,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.811930+0000","last_change":"2024-09-12T01:16:05.811930+0000","last_active":"2024-09-12T01:16:05.811930+0000","last_peered":"2024-09-12T01:16:05.811930+0000","last_clean":"2024-09-12T01:16:05.811930+0000","last_became_active":"2024-09-12T00:02:50.069907+0000","last_became_peered":"2024-09-12T00:02:50.069907+0000","last_unstale":"2024-09-12T01:16:05.811930+0000","last_undegraded":"2024-09-12T01:16:05.811930+0000","last_fullsized":"2024-09-12T01:16:05.811930+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'542","last_scrub_stamp":"2024-09-12T01:16:05.811845+0000","last_deep_scrub":"267'542","last_deep_scrub_stamp":"2024-09-12T01:16:05.811845+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.811845+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:24.596886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2946,"num_read_kb":2752,"num_write":643,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2534,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'210","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.207922+0000","last_change":"2024-09-12T01:16:02.207922+0000","last_active":"2024-09-12T01:16:02.207922+0000","last_peered":"2024-09-12T01:16:02.207922+0000","last_clean":"2024-09-12T01:16:02.207922+0000","last_became_active":"2024-09-12T00:02:48.052303+0000","last_became_peered":"2024-09-12T00:02:48.052303+0000","last_unstale":"2024-09-12T01:16:02.207922+0000","last_undegraded":"2024-09-12T01:16:02.207922+0000","last_fullsized":"2024-09-12T01:16:02.207922+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:16:02.207773+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:16:02.207773+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.207773+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:42.794663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":51729,"num_write":985,"num_write_kb":45446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.309309+0000","last_change":"2024-09-12T01:16:22.309309+0000","last_active":"2024-09-12T01:16:22.309309+0000","last_peered":"2024-09-12T01:16:22.309309+0000","last_clean":"2024-09-12T01:16:22.309309+0000","last_became_active":"2024-09-12T00:02:52.065653+0000","last_became_peered":"2024-09-12T00:02:52.065653+0000","last_unstale":"2024-09-12T01:16:22.309309+0000","last_undegraded":"2024-09-12T01:16:22.309309+0000","last_fullsized":"2024-09-12T01:16:22.309309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:22.309220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:22.309220+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.309220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:12.264453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'156","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.658573+0000","last_change":"2024-09-12T01:16:16.658573+0000","last_active":"2024-09-12T01:16:16.658573+0000","last_peered":"2024-09-12T01:16:16.658573+0000","last_clean":"2024-09-12T01:16:16.658573+0000","last_became_active":"2024-09-12T00:02:54.073930+0000","last_became_peered":"2024-09-12T00:02:54.073930+0000","last_unstale":"2024-09-12T01:16:16.658573+0000","last_undegraded":"2024-09-12T01:16:16.658573+0000","last_fullsized":"2024-09-12T01:16:16.658573+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:16.658478+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:16.658478+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.658478+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:59.460201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4988,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":267,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.429953+0000","last_change":"2024-09-12T01:16:16.429953+0000","last_active":"2024-09-12T01:16:16.429953+0000","last_peered":"2024-09-12T01:16:16.429953+0000","last_clean":"2024-09-12T01:16:16.429953+0000","last_became_active":"2024-09-12T00:02:56.078528+0000","last_became_peered":"2024-09-12T00:02:56.078528+0000","last_unstale":"2024-09-12T01:16:16.429953+0000","last_undegraded":"2024-09-12T01:16:16.429953+0000","last_fullsized":"2024-09-12T01:16:16.429953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.429865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.429865+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.429865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:38.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'100","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.619012+0000","last_change":"2024-09-12T01:16:32.619012+0000","last_active":"2024-09-12T01:16:32.619012+0000","last_peered":"2024-09-12T01:16:32.619012+0000","last_clean":"2024-09-12T01:16:32.619012+0000","last_became_active":"2024-09-12T00:02:58.087199+0000","last_became_peered":"2024-09-12T00:02:58.087199+0000","last_unstale":"2024-09-12T01:16:32.619012+0000","last_undegraded":"2024-09-12T01:16:32.619012+0000","last_fullsized":"2024-09-12T01:16:32.619012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-09-12T01:16:32.618924+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-09-12T01:16:32.618924+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.618924+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:51.132932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":246,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'470","reported_seq":2094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.613518+0000","last_change":"2024-09-12T01:16:08.613518+0000","last_active":"2024-09-12T01:16:08.613518+0000","last_peered":"2024-09-12T01:16:08.613518+0000","last_clean":"2024-09-12T01:16:08.613518+0000","last_became_active":"2024-09-12T00:02:50.072920+0000","last_became_peered":"2024-09-12T00:02:50.072920+0000","last_unstale":"2024-09-12T01:16:08.613518+0000","last_undegraded":"2024-09-12T01:16:08.613518+0000","last_fullsized":"2024-09-12T01:16:08.613518+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'470","last_scrub_stamp":"2024-09-12T01:16:08.613412+0000","last_deep_scrub":"267'470","last_deep_scrub_stamp":"2024-09-12T01:16:08.613412+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.613412+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:17.773006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2371,"num_write":566,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'212","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.772435+0000","last_change":"2024-09-12T01:15:59.772435+0000","last_active":"2024-09-12T01:15:59.772435+0000","last_peered":"2024-09-12T01:15:59.772435+0000","last_clean":"2024-09-12T01:15:59.772435+0000","last_became_active":"2024-09-12T00:02:48.048308+0000","last_became_peered":"2024-09-12T00:02:48.048308+0000","last_unstale":"2024-09-12T01:15:59.772435+0000","last_undegraded":"2024-09-12T01:15:59.772435+0000","last_fullsized":"2024-09-12T01:15:59.772435+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-12T01:15:59.772317+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-12T01:15:59.772317+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.772317+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:08.055567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":37398,"num_write":997,"num_write_kb":57972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.947366+0000","last_change":"2024-09-12T01:16:15.947366+0000","last_active":"2024-09-12T01:16:15.947366+0000","last_peered":"2024-09-12T01:16:15.947366+0000","last_clean":"2024-09-12T01:16:15.947366+0000","last_became_active":"2024-09-12T00:02:52.060283+0000","last_became_peered":"2024-09-12T00:02:52.060283+0000","last_unstale":"2024-09-12T01:16:15.947366+0000","last_undegraded":"2024-09-12T01:16:15.947366+0000","last_fullsized":"2024-09-12T01:16:15.947366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.947271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.947271+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.947271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:50.354609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'129","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.553123+0000","last_change":"2024-09-12T01:16:25.553123+0000","last_active":"2024-09-12T01:16:25.553123+0000","last_peered":"2024-09-12T01:16:25.553123+0000","last_clean":"2024-09-12T01:16:25.553123+0000","last_became_active":"2024-09-12T00:02:54.067770+0000","last_became_peered":"2024-09-12T00:02:54.067770+0000","last_unstale":"2024-09-12T01:16:25.553123+0000","last_undegraded":"2024-09-12T01:16:25.553123+0000","last_fullsized":"2024-09-12T01:16:25.553123+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:16:25.553018+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:16:25.553018+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.553018+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:22.835758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4641,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":72,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.958170+0000","last_change":"2024-09-12T01:16:25.958170+0000","last_active":"2024-09-12T01:16:25.958170+0000","last_peered":"2024-09-12T01:16:25.958170+0000","last_clean":"2024-09-12T01:16:25.958170+0000","last_became_active":"2024-09-12T00:02:56.077573+0000","last_became_peered":"2024-09-12T00:02:56.077573+0000","last_unstale":"2024-09-12T01:16:25.958170+0000","last_undegraded":"2024-09-12T01:16:25.958170+0000","last_fullsized":"2024-09-12T01:16:25.958170+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.958065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.958065+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.958065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:05.572857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'152","reported_seq":1261,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.845895+0000","last_change":"2024-09-12T01:16:30.845895+0000","last_active":"2024-09-12T01:16:30.845895+0000","last_peered":"2024-09-12T01:16:30.845895+0000","last_clean":"2024-09-12T01:16:30.845895+0000","last_became_active":"2024-09-12T00:02:58.099426+0000","last_became_peered":"2024-09-12T00:02:58.099426+0000","last_unstale":"2024-09-12T01:16:30.845895+0000","last_undegraded":"2024-09-12T01:16:30.845895+0000","last_fullsized":"2024-09-12T01:16:30.845895+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:16:30.845804+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:16:30.845804+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.845804+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:58.749136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":755,"num_read_kb":754,"num_write":338,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'471","reported_seq":1967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.778780+0000","last_change":"2024-09-12T01:16:04.778780+0000","last_active":"2024-09-12T01:16:04.778780+0000","last_peered":"2024-09-12T01:16:04.778780+0000","last_clean":"2024-09-12T01:16:04.778780+0000","last_became_active":"2024-09-12T00:02:50.063959+0000","last_became_peered":"2024-09-12T00:02:50.063959+0000","last_unstale":"2024-09-12T01:16:04.778780+0000","last_undegraded":"2024-09-12T01:16:04.778780+0000","last_fullsized":"2024-09-12T01:16:04.778780+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'471","last_scrub_stamp":"2024-09-12T01:16:04.778701+0000","last_deep_scrub":"267'471","last_deep_scrub_stamp":"2024-09-12T01:16:04.778701+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.778701+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:30.342027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2471,"num_read_kb":2277,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":708,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'193","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.857061+0000","last_change":"2024-09-12T01:15:58.857061+0000","last_active":"2024-09-12T01:15:58.857061+0000","last_peered":"2024-09-12T01:15:58.857061+0000","last_clean":"2024-09-12T01:15:58.857061+0000","last_became_active":"2024-09-12T00:02:48.054650+0000","last_became_peered":"2024-09-12T00:02:48.054650+0000","last_unstale":"2024-09-12T01:15:58.857061+0000","last_undegraded":"2024-09-12T01:15:58.857061+0000","last_fullsized":"2024-09-12T01:15:58.857061+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:15:58.856935+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:15:58.856935+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.856935+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:00.850043+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250177,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":59687,"num_write":954,"num_write_kb":41766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'6","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.157400+0000","last_change":"2024-09-12T01:16:11.157400+0000","last_active":"2024-09-12T01:16:11.157400+0000","last_peered":"2024-09-12T01:16:11.157400+0000","last_clean":"2024-09-12T01:16:11.157400+0000","last_became_active":"2024-09-12T00:02:52.065804+0000","last_became_peered":"2024-09-12T00:02:52.065804+0000","last_unstale":"2024-09-12T01:16:11.157400+0000","last_undegraded":"2024-09-12T01:16:11.157400+0000","last_fullsized":"2024-09-12T01:16:11.157400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:11.157309+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:11.157309+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.157309+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.232298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'187","reported_seq":809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.015357+0000","last_change":"2024-09-12T01:16:22.015357+0000","last_active":"2024-09-12T01:16:22.015357+0000","last_peered":"2024-09-12T01:16:22.015357+0000","last_clean":"2024-09-12T01:16:22.015357+0000","last_became_active":"2024-09-12T00:02:54.066918+0000","last_became_peered":"2024-09-12T00:02:54.066918+0000","last_unstale":"2024-09-12T01:16:22.015357+0000","last_undegraded":"2024-09-12T01:16:22.015357+0000","last_fullsized":"2024-09-12T01:16:22.015357+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:16:22.015263+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:16:22.015263+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.015263+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:07.799810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":266,"num_write":140,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.606996+0000","last_change":"2024-09-12T01:16:25.606996+0000","last_active":"2024-09-12T01:16:25.606996+0000","last_peered":"2024-09-12T01:16:25.606996+0000","last_clean":"2024-09-12T01:16:25.606996+0000","last_became_active":"2024-09-12T00:02:56.084768+0000","last_became_peered":"2024-09-12T00:02:56.084768+0000","last_unstale":"2024-09-12T01:16:25.606996+0000","last_undegraded":"2024-09-12T01:16:25.606996+0000","last_fullsized":"2024-09-12T01:16:25.606996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.606905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.606905+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.606905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:39.095761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'157","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.961917+0000","last_change":"2024-09-12T01:16:28.961917+0000","last_active":"2024-09-12T01:16:28.961917+0000","last_peered":"2024-09-12T01:16:28.961917+0000","last_clean":"2024-09-12T01:16:28.961917+0000","last_became_active":"2024-09-12T00:02:58.097725+0000","last_became_peered":"2024-09-12T00:02:58.097725+0000","last_unstale":"2024-09-12T01:16:28.961917+0000","last_undegraded":"2024-09-12T01:16:28.961917+0000","last_fullsized":"2024-09-12T01:16:28.961917+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T01:16:28.961825+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T01:16:28.961825+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.961825+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:36.526169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":109,"num_write":343,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'692","reported_seq":2204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.205253+0000","last_change":"2024-09-12T01:16:12.205191+0000","last_active":"2024-09-12T01:16:12.205253+0000","last_peered":"2024-09-12T01:16:12.205253+0000","last_clean":"2024-09-12T01:16:12.205253+0000","last_became_active":"2024-09-12T00:02:50.064354+0000","last_became_peered":"2024-09-12T00:02:50.064354+0000","last_unstale":"2024-09-12T01:16:12.205253+0000","last_undegraded":"2024-09-12T01:16:12.205253+0000","last_fullsized":"2024-09-12T01:16:12.205253+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'692","last_scrub_stamp":"2024-09-12T01:16:12.205104+0000","last_deep_scrub":"267'692","last_deep_scrub_stamp":"2024-09-12T01:16:12.205104+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.205104+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:42.512342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3412,"num_read_kb":3118,"num_write":870,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'187","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.538591+0000","last_change":"2024-09-12T01:15:59.538591+0000","last_active":"2024-09-12T01:15:59.538591+0000","last_peered":"2024-09-12T01:15:59.538591+0000","last_clean":"2024-09-12T01:15:59.538591+0000","last_became_active":"2024-09-12T00:02:48.049242+0000","last_became_peered":"2024-09-12T00:02:48.049242+0000","last_unstale":"2024-09-12T01:15:59.538591+0000","last_undegraded":"2024-09-12T01:15:59.538591+0000","last_fullsized":"2024-09-12T01:15:59.538591+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:15:59.538483+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:15:59.538483+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.538483+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:48.772077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":39372,"num_write":875,"num_write_kb":46728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'352","reported_seq":1698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.151473+0000","last_change":"2024-09-12T01:16:08.151351+0000","last_active":"2024-09-12T01:16:08.151473+0000","last_peered":"2024-09-12T01:16:08.151473+0000","last_clean":"2024-09-12T01:16:08.151473+0000","last_became_active":"2024-09-12T00:02:50.065060+0000","last_became_peered":"2024-09-12T00:02:50.065060+0000","last_unstale":"2024-09-12T01:16:08.151473+0000","last_undegraded":"2024-09-12T01:16:08.151473+0000","last_fullsized":"2024-09-12T01:16:08.151473+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-09-12T01:16:08.151246+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-09-12T01:16:08.151246+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.151246+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:32.866300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1806,"num_read_kb":1710,"num_write":413,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'203","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.099431+0000","last_change":"2024-09-12T01:15:55.099431+0000","last_active":"2024-09-12T01:15:55.099431+0000","last_peered":"2024-09-12T01:15:55.099431+0000","last_clean":"2024-09-12T01:15:55.099431+0000","last_became_active":"2024-09-12T00:02:48.041842+0000","last_became_peered":"2024-09-12T00:02:48.041842+0000","last_unstale":"2024-09-12T01:15:55.099431+0000","last_undegraded":"2024-09-12T01:15:55.099431+0000","last_fullsized":"2024-09-12T01:15:55.099431+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'203","last_scrub_stamp":"2024-09-12T01:15:55.099312+0000","last_deep_scrub":"267'203","last_deep_scrub_stamp":"2024-09-12T01:15:55.099312+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.099312+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:35.347299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":13124,"num_write":1044,"num_write_kb":38354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'458","reported_seq":2075,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.265565+0000","last_change":"2024-09-12T01:16:13.265508+0000","last_active":"2024-09-12T01:16:13.265565+0000","last_peered":"2024-09-12T01:16:13.265565+0000","last_clean":"2024-09-12T01:16:13.265565+0000","last_became_active":"2024-09-12T00:02:50.066341+0000","last_became_peered":"2024-09-12T00:02:50.066341+0000","last_unstale":"2024-09-12T01:16:13.265565+0000","last_undegraded":"2024-09-12T01:16:13.265565+0000","last_fullsized":"2024-09-12T01:16:13.265565+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'458","last_scrub_stamp":"2024-09-12T01:16:13.265421+0000","last_deep_scrub":"267'458","last_deep_scrub_stamp":"2024-09-12T01:16:13.265421+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.265421+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:02.745745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2383,"num_read_kb":2262,"num_write":523,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'185","reported_seq":819,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.199885+0000","last_change":"2024-09-12T01:16:03.199885+0000","last_active":"2024-09-12T01:16:03.199885+0000","last_peered":"2024-09-12T01:16:03.199885+0000","last_clean":"2024-09-12T01:16:03.199885+0000","last_became_active":"2024-09-12T00:02:48.052205+0000","last_became_peered":"2024-09-12T00:02:48.052205+0000","last_unstale":"2024-09-12T01:16:03.199885+0000","last_undegraded":"2024-09-12T01:16:03.199885+0000","last_fullsized":"2024-09-12T01:16:03.199885+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:16:03.199736+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:16:03.199736+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.199736+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:22.555181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":389,"num_read_kb":19493,"num_write":855,"num_write_kb":24928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'368","reported_seq":1887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.149350+0000","last_change":"2024-09-12T01:16:07.149286+0000","last_active":"2024-09-12T01:16:07.149350+0000","last_peered":"2024-09-12T01:16:07.149350+0000","last_clean":"2024-09-12T01:16:07.149350+0000","last_became_active":"2024-09-12T00:02:50.065534+0000","last_became_peered":"2024-09-12T00:02:50.065534+0000","last_unstale":"2024-09-12T01:16:07.149350+0000","last_undegraded":"2024-09-12T01:16:07.149350+0000","last_fullsized":"2024-09-12T01:16:07.149350+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'368","last_scrub_stamp":"2024-09-12T01:16:07.149197+0000","last_deep_scrub":"267'368","last_deep_scrub_stamp":"2024-09-12T01:16:07.149197+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.149197+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:26.769112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1966,"num_read_kb":1903,"num_write":390,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'155","reported_seq":760,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.132577+0000","last_change":"2024-09-12T01:15:57.132517+0000","last_active":"2024-09-12T01:15:57.132577+0000","last_peered":"2024-09-12T01:15:57.132577+0000","last_clean":"2024-09-12T01:15:57.132577+0000","last_became_active":"2024-09-12T00:03:21.720441+0000","last_became_peered":"2024-09-12T00:03:21.720441+0000","last_unstale":"2024-09-12T01:15:57.132577+0000","last_undegraded":"2024-09-12T01:15:57.132577+0000","last_fullsized":"2024-09-12T01:15:57.132577+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-12T01:15:57.132438+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-12T01:15:57.132438+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.132438+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:56.866362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":16297,"num_write":778,"num_write_kb":33256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"267'1242","reported_seq":3065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.610318+0000","last_change":"2024-09-12T01:16:22.610318+0000","last_active":"2024-09-12T01:16:22.610318+0000","last_peered":"2024-09-12T01:16:22.610318+0000","last_clean":"2024-09-12T01:16:22.610318+0000","last_became_active":"2024-09-12T00:02:50.070406+0000","last_became_peered":"2024-09-12T00:02:50.070406+0000","last_unstale":"2024-09-12T01:16:22.610318+0000","last_undegraded":"2024-09-12T01:16:22.610318+0000","last_fullsized":"2024-09-12T01:16:22.610318+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1242","last_scrub_stamp":"2024-09-12T01:16:22.610208+0000","last_deep_scrub":"267'1242","last_deep_scrub_stamp":"2024-09-12T01:16:22.610208+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.610208+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":1200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.017549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5822,"num_read_kb":5176,"num_write":1694,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2225,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'195","reported_seq":851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.695089+0000","last_change":"2024-09-12T01:16:01.695026+0000","last_active":"2024-09-12T01:16:01.695089+0000","last_peered":"2024-09-12T01:16:01.695089+0000","last_clean":"2024-09-12T01:16:01.695089+0000","last_became_active":"2024-09-12T00:02:48.051454+0000","last_became_peered":"2024-09-12T00:02:48.051454+0000","last_unstale":"2024-09-12T01:16:01.695089+0000","last_undegraded":"2024-09-12T01:16:01.695089+0000","last_fullsized":"2024-09-12T01:16:01.695089+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'195","last_scrub_stamp":"2024-09-12T01:16:01.694929+0000","last_deep_scrub":"267'195","last_deep_scrub_stamp":"2024-09-12T01:16:01.694929+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.694929+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:50.288118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":27281,"num_write":913,"num_write_kb":43596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'811","reported_seq":2275,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.823457+0000","last_change":"2024-09-12T01:16:07.823457+0000","last_active":"2024-09-12T01:16:07.823457+0000","last_peered":"2024-09-12T01:16:07.823457+0000","last_clean":"2024-09-12T01:16:07.823457+0000","last_became_active":"2024-09-12T00:02:50.065615+0000","last_became_peered":"2024-09-12T00:02:50.065615+0000","last_unstale":"2024-09-12T01:16:07.823457+0000","last_undegraded":"2024-09-12T01:16:07.823457+0000","last_fullsized":"2024-09-12T01:16:07.823457+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'811","last_scrub_stamp":"2024-09-12T01:16:07.823369+0000","last_deep_scrub":"267'811","last_deep_scrub_stamp":"2024-09-12T01:16:07.823369+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.823369+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:09.542904+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3886,"num_read_kb":3508,"num_write":1123,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'223","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.095128+0000","last_change":"2024-09-12T01:15:59.095055+0000","last_active":"2024-09-12T01:15:59.095128+0000","last_peered":"2024-09-12T01:15:59.095128+0000","last_clean":"2024-09-12T01:15:59.095128+0000","last_became_active":"2024-09-12T00:02:48.047357+0000","last_became_peered":"2024-09-12T00:02:48.047357+0000","last_unstale":"2024-09-12T01:15:59.095128+0000","last_undegraded":"2024-09-12T01:15:59.095128+0000","last_fullsized":"2024-09-12T01:15:59.095128+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-12T01:15:59.094931+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-12T01:15:59.094931+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.094931+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:21.356655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":6089,"num_write":1092,"num_write_kb":27766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1104","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.628883+0000","last_change":"2024-09-12T01:16:12.628883+0000","last_active":"2024-09-12T01:16:12.628883+0000","last_peered":"2024-09-12T01:16:12.628883+0000","last_clean":"2024-09-12T01:16:12.628883+0000","last_became_active":"2024-09-12T00:02:50.075265+0000","last_became_peered":"2024-09-12T00:02:50.075265+0000","last_unstale":"2024-09-12T01:16:12.628883+0000","last_undegraded":"2024-09-12T01:16:12.628883+0000","last_fullsized":"2024-09-12T01:16:12.628883+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1104","last_scrub_stamp":"2024-09-12T01:16:12.628783+0000","last_deep_scrub":"267'1104","last_deep_scrub_stamp":"2024-09-12T01:16:12.628783+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.628783+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:31.330763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4403,"num_write":1512,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'200","reported_seq":831,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.554304+0000","last_change":"2024-09-12T01:15:58.554239+0000","last_active":"2024-09-12T01:15:58.554304+0000","last_peered":"2024-09-12T01:15:58.554304+0000","last_clean":"2024-09-12T01:15:58.554304+0000","last_became_active":"2024-09-12T00:02:48.047266+0000","last_became_peered":"2024-09-12T00:02:48.047266+0000","last_unstale":"2024-09-12T01:15:58.554304+0000","last_undegraded":"2024-09-12T01:15:58.554304+0000","last_fullsized":"2024-09-12T01:15:58.554304+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-12T01:15:58.554118+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-12T01:15:58.554118+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.554118+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:22.527176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":23654,"num_write":912,"num_write_kb":39021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'477","reported_seq":2131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.473365+0000","last_change":"2024-09-12T01:16:07.473365+0000","last_active":"2024-09-12T01:16:07.473365+0000","last_peered":"2024-09-12T01:16:07.473365+0000","last_clean":"2024-09-12T01:16:07.473365+0000","last_became_active":"2024-09-12T00:02:50.067919+0000","last_became_peered":"2024-09-12T00:02:50.067919+0000","last_unstale":"2024-09-12T01:16:07.473365+0000","last_undegraded":"2024-09-12T01:16:07.473365+0000","last_fullsized":"2024-09-12T01:16:07.473365+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'477","last_scrub_stamp":"2024-09-12T01:16:07.473283+0000","last_deep_scrub":"267'477","last_deep_scrub_stamp":"2024-09-12T01:16:07.473283+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.473283+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:57.980949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2453,"num_write":580,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'153","reported_seq":740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.103312+0000","last_change":"2024-09-12T01:16:00.103312+0000","last_active":"2024-09-12T01:16:00.103312+0000","last_peered":"2024-09-12T01:16:00.103312+0000","last_clean":"2024-09-12T01:16:00.103312+0000","last_became_active":"2024-09-12T00:03:21.143091+0000","last_became_peered":"2024-09-12T00:03:21.143091+0000","last_unstale":"2024-09-12T01:16:00.103312+0000","last_undegraded":"2024-09-12T01:16:00.103312+0000","last_fullsized":"2024-09-12T01:16:00.103312+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-12T01:16:00.103180+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-12T01:16:00.103180+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.103180+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:22.971120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":6539,"num_write":770,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'875","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.732349+0000","last_change":"2024-09-12T01:16:07.732349+0000","last_active":"2024-09-12T01:16:07.732349+0000","last_peered":"2024-09-12T01:16:07.732349+0000","last_clean":"2024-09-12T01:16:07.732349+0000","last_became_active":"2024-09-12T00:02:50.076097+0000","last_became_peered":"2024-09-12T00:02:50.076097+0000","last_unstale":"2024-09-12T01:16:07.732349+0000","last_undegraded":"2024-09-12T01:16:07.732349+0000","last_fullsized":"2024-09-12T01:16:07.732349+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'875","last_scrub_stamp":"2024-09-12T01:16:07.732265+0000","last_deep_scrub":"267'875","last_deep_scrub_stamp":"2024-09-12T01:16:07.732265+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.732265+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.381212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3804,"num_write":1206,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'185","reported_seq":798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.251693+0000","last_change":"2024-09-12T01:16:05.251637+0000","last_active":"2024-09-12T01:16:05.251693+0000","last_peered":"2024-09-12T01:16:05.251693+0000","last_clean":"2024-09-12T01:16:05.251693+0000","last_became_active":"2024-09-12T00:02:48.057693+0000","last_became_peered":"2024-09-12T00:02:48.057693+0000","last_unstale":"2024-09-12T01:16:05.251693+0000","last_undegraded":"2024-09-12T01:16:05.251693+0000","last_fullsized":"2024-09-12T01:16:05.251693+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:16:05.251527+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:16:05.251527+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.251527+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:53.355948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":352,"num_read_kb":5525,"num_write":905,"num_write_kb":35074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'842","reported_seq":2623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.930794+0000","last_change":"2024-09-12T01:16:11.930794+0000","last_active":"2024-09-12T01:16:11.930794+0000","last_peered":"2024-09-12T01:16:11.930794+0000","last_clean":"2024-09-12T01:16:11.930794+0000","last_became_active":"2024-09-12T00:02:50.062524+0000","last_became_peered":"2024-09-12T00:02:50.062524+0000","last_unstale":"2024-09-12T01:16:11.930794+0000","last_undegraded":"2024-09-12T01:16:11.930794+0000","last_fullsized":"2024-09-12T01:16:11.930794+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'842","last_scrub_stamp":"2024-09-12T01:16:11.930681+0000","last_deep_scrub":"267'842","last_deep_scrub_stamp":"2024-09-12T01:16:11.930681+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.930681+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:21.897504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4232,"num_read_kb":3859,"num_write":1078,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4832,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'258","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.730568+0000","last_change":"2024-09-12T01:16:00.730568+0000","last_active":"2024-09-12T01:16:00.730568+0000","last_peered":"2024-09-12T01:16:00.730568+0000","last_clean":"2024-09-12T01:16:00.730568+0000","last_became_active":"2024-09-12T00:02:48.050574+0000","last_became_peered":"2024-09-12T00:02:48.050574+0000","last_unstale":"2024-09-12T01:16:00.730568+0000","last_undegraded":"2024-09-12T01:16:00.730568+0000","last_fullsized":"2024-09-12T01:16:00.730568+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:16:00.730443+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:16:00.730443+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.730443+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:08.715998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67790,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":15341,"num_write":1132,"num_write_kb":29230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'815","reported_seq":2290,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.253395+0000","last_change":"2024-09-12T01:16:04.253395+0000","last_active":"2024-09-12T01:16:04.253395+0000","last_peered":"2024-09-12T01:16:04.253395+0000","last_clean":"2024-09-12T01:16:04.253395+0000","last_became_active":"2024-09-12T00:02:50.063668+0000","last_became_peered":"2024-09-12T00:02:50.063668+0000","last_unstale":"2024-09-12T01:16:04.253395+0000","last_undegraded":"2024-09-12T01:16:04.253395+0000","last_fullsized":"2024-09-12T01:16:04.253395+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'815","last_scrub_stamp":"2024-09-12T01:16:04.253299+0000","last_deep_scrub":"267'815","last_deep_scrub_stamp":"2024-09-12T01:16:04.253299+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.253299+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:04.727166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3770,"num_read_kb":3367,"num_write":1118,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'211","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.220264+0000","last_change":"2024-09-12T01:16:04.220264+0000","last_active":"2024-09-12T01:16:04.220264+0000","last_peered":"2024-09-12T01:16:04.220264+0000","last_clean":"2024-09-12T01:16:04.220264+0000","last_became_active":"2024-09-12T00:02:48.048851+0000","last_became_peered":"2024-09-12T00:02:48.048851+0000","last_unstale":"2024-09-12T01:16:04.220264+0000","last_undegraded":"2024-09-12T01:16:04.220264+0000","last_fullsized":"2024-09-12T01:16:04.220264+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'211","last_scrub_stamp":"2024-09-12T01:16:04.220141+0000","last_deep_scrub":"267'211","last_deep_scrub_stamp":"2024-09-12T01:16:04.220141+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.220141+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:47.525059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":48639,"num_write":1072,"num_write_kb":41735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'815","reported_seq":2281,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.835311+0000","last_change":"2024-09-12T01:16:08.835311+0000","last_active":"2024-09-12T01:16:08.835311+0000","last_peered":"2024-09-12T01:16:08.835311+0000","last_clean":"2024-09-12T01:16:08.835311+0000","last_became_active":"2024-09-12T00:02:50.063615+0000","last_became_peered":"2024-09-12T00:02:50.063615+0000","last_unstale":"2024-09-12T01:16:08.835311+0000","last_undegraded":"2024-09-12T01:16:08.835311+0000","last_fullsized":"2024-09-12T01:16:08.835311+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'815","last_scrub_stamp":"2024-09-12T01:16:08.835219+0000","last_deep_scrub":"267'815","last_deep_scrub_stamp":"2024-09-12T01:16:08.835219+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.835219+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:58.732596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3747,"num_read_kb":3346,"num_write":1068,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'284","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.821132+0000","last_change":"2024-09-12T01:15:59.821132+0000","last_active":"2024-09-12T01:15:59.821132+0000","last_peered":"2024-09-12T01:15:59.821132+0000","last_clean":"2024-09-12T01:15:59.821132+0000","last_became_active":"2024-09-12T00:02:48.046828+0000","last_became_peered":"2024-09-12T00:02:48.046828+0000","last_unstale":"2024-09-12T01:15:59.821132+0000","last_undegraded":"2024-09-12T01:15:59.821132+0000","last_fullsized":"2024-09-12T01:15:59.821132+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'284","last_scrub_stamp":"2024-09-12T01:15:59.821026+0000","last_deep_scrub":"267'284","last_deep_scrub_stamp":"2024-09-12T01:15:59.821026+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.821026+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.732125+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":12026,"num_write":1074,"num_write_kb":33544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'754","reported_seq":2269,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.720788+0000","last_change":"2024-09-12T01:16:11.720788+0000","last_active":"2024-09-12T01:16:11.720788+0000","last_peered":"2024-09-12T01:16:11.720788+0000","last_clean":"2024-09-12T01:16:11.720788+0000","last_became_active":"2024-09-12T00:02:50.069844+0000","last_became_peered":"2024-09-12T00:02:50.069844+0000","last_unstale":"2024-09-12T01:16:11.720788+0000","last_undegraded":"2024-09-12T01:16:11.720788+0000","last_fullsized":"2024-09-12T01:16:11.720788+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'754","last_scrub_stamp":"2024-09-12T01:16:11.720709+0000","last_deep_scrub":"267'754","last_deep_scrub_stamp":"2024-09-12T01:16:11.720709+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.720709+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:50.677876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3535,"num_read_kb":3209,"num_write":983,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'198","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.521700+0000","last_change":"2024-09-12T01:16:02.521700+0000","last_active":"2024-09-12T01:16:02.521700+0000","last_peered":"2024-09-12T01:16:02.521700+0000","last_clean":"2024-09-12T01:16:02.521700+0000","last_became_active":"2024-09-12T00:02:48.046397+0000","last_became_peered":"2024-09-12T00:02:48.046397+0000","last_unstale":"2024-09-12T01:16:02.521700+0000","last_undegraded":"2024-09-12T01:16:02.521700+0000","last_fullsized":"2024-09-12T01:16:02.521700+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:16:02.521590+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:16:02.521590+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.521590+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:52.392814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":38047,"num_write":933,"num_write_kb":24740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'854","reported_seq":2486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.774581+0000","last_change":"2024-09-12T01:16:06.774581+0000","last_active":"2024-09-12T01:16:06.774581+0000","last_peered":"2024-09-12T01:16:06.774581+0000","last_clean":"2024-09-12T01:16:06.774581+0000","last_became_active":"2024-09-12T00:02:50.078018+0000","last_became_peered":"2024-09-12T00:02:50.078018+0000","last_unstale":"2024-09-12T01:16:06.774581+0000","last_undegraded":"2024-09-12T01:16:06.774581+0000","last_fullsized":"2024-09-12T01:16:06.774581+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'854","last_scrub_stamp":"2024-09-12T01:16:06.774436+0000","last_deep_scrub":"267'854","last_deep_scrub_stamp":"2024-09-12T01:16:06.774436+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.774436+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:12.958179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4154,"num_read_kb":3748,"num_write":1160,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'171","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.723711+0000","last_change":"2024-09-12T01:16:06.723711+0000","last_active":"2024-09-12T01:16:06.723711+0000","last_peered":"2024-09-12T01:16:06.723711+0000","last_clean":"2024-09-12T01:16:06.723711+0000","last_became_active":"2024-09-12T00:02:48.047945+0000","last_became_peered":"2024-09-12T00:02:48.047945+0000","last_unstale":"2024-09-12T01:16:06.723711+0000","last_undegraded":"2024-09-12T01:16:06.723711+0000","last_fullsized":"2024-09-12T01:16:06.723711+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-12T01:16:06.723583+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-12T01:16:06.723583+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.723583+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:29.604328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":324,"num_read_kb":25981,"num_write":829,"num_write_kb":31809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'534","reported_seq":2303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.235496+0000","last_change":"2024-09-12T01:16:01.235496+0000","last_active":"2024-09-12T01:16:01.235496+0000","last_peered":"2024-09-12T01:16:01.235496+0000","last_clean":"2024-09-12T01:16:01.235496+0000","last_became_active":"2024-09-12T00:03:21.133475+0000","last_became_peered":"2024-09-12T00:03:21.133475+0000","last_unstale":"2024-09-12T01:16:01.235496+0000","last_undegraded":"2024-09-12T01:16:01.235496+0000","last_fullsized":"2024-09-12T01:16:01.235496+0000","mapping_epoch":39,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'534","last_scrub_stamp":"2024-09-12T01:16:01.235392+0000","last_deep_scrub":"267'534","last_deep_scrub_stamp":"2024-09-12T01:16:01.235392+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.235392+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:42.656876+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2976,"num_read_kb":2811,"num_write":614,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":436,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"267'233","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.161645+0000","last_change":"2024-09-12T01:15:58.161645+0000","last_active":"2024-09-12T01:15:58.161645+0000","last_peered":"2024-09-12T01:15:58.161645+0000","last_clean":"2024-09-12T01:15:58.161645+0000","last_became_active":"2024-09-12T00:02:48.049104+0000","last_became_peered":"2024-09-12T00:02:48.049104+0000","last_unstale":"2024-09-12T01:15:58.161645+0000","last_undegraded":"2024-09-12T01:15:58.161645+0000","last_fullsized":"2024-09-12T01:15:58.161645+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'233","last_scrub_stamp":"2024-09-12T01:15:58.161506+0000","last_deep_scrub":"267'233","last_deep_scrub_stamp":"2024-09-12T01:15:58.161506+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.161506+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.839368+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456491,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":11103,"num_write":1027,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'910","reported_seq":2509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.736466+0000","last_change":"2024-09-12T01:16:09.736466+0000","last_active":"2024-09-12T01:16:09.736466+0000","last_peered":"2024-09-12T01:16:09.736466+0000","last_clean":"2024-09-12T01:16:09.736466+0000","last_became_active":"2024-09-12T00:02:50.069494+0000","last_became_peered":"2024-09-12T00:02:50.069494+0000","last_unstale":"2024-09-12T01:16:09.736466+0000","last_undegraded":"2024-09-12T01:16:09.736466+0000","last_fullsized":"2024-09-12T01:16:09.736466+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'910","last_scrub_stamp":"2024-09-12T01:16:09.736373+0000","last_deep_scrub":"267'910","last_deep_scrub_stamp":"2024-09-12T01:16:09.736373+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.736373+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:52.193047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4355,"num_read_kb":3868,"num_write":1227,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'175","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.268258+0000","last_change":"2024-09-12T01:16:07.268258+0000","last_active":"2024-09-12T01:16:07.268258+0000","last_peered":"2024-09-12T01:16:07.268258+0000","last_clean":"2024-09-12T01:16:07.268258+0000","last_became_active":"2024-09-12T00:04:21.225148+0000","last_became_peered":"2024-09-12T00:04:21.225148+0000","last_unstale":"2024-09-12T01:16:07.268258+0000","last_undegraded":"2024-09-12T01:16:07.268258+0000","last_fullsized":"2024-09-12T01:16:07.268258+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-12T01:16:07.268138+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-12T01:16:07.268138+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.268138+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:34.383522+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7533161,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":15843,"num_write":853,"num_write_kb":25246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'175","reported_seq":804,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.287894+0000","last_change":"2024-09-12T01:16:08.287894+0000","last_active":"2024-09-12T01:16:08.287894+0000","last_peered":"2024-09-12T01:16:08.287894+0000","last_clean":"2024-09-12T01:16:08.287894+0000","last_became_active":"2024-09-12T00:03:21.140871+0000","last_became_peered":"2024-09-12T00:03:21.140871+0000","last_unstale":"2024-09-12T01:16:08.287894+0000","last_undegraded":"2024-09-12T01:16:08.287894+0000","last_fullsized":"2024-09-12T01:16:08.287894+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-12T01:16:08.287766+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-12T01:16:08.287766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.287766+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:57.597678+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2728229,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":36071,"num_write":841,"num_write_kb":27237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'835","reported_seq":2470,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.688636+0000","last_change":"2024-09-12T01:16:09.688636+0000","last_active":"2024-09-12T01:16:09.688636+0000","last_peered":"2024-09-12T01:16:09.688636+0000","last_clean":"2024-09-12T01:16:09.688636+0000","last_became_active":"2024-09-12T00:02:50.076513+0000","last_became_peered":"2024-09-12T00:02:50.076513+0000","last_unstale":"2024-09-12T01:16:09.688636+0000","last_undegraded":"2024-09-12T01:16:09.688636+0000","last_fullsized":"2024-09-12T01:16:09.688636+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'835","last_scrub_stamp":"2024-09-12T01:16:09.688553+0000","last_deep_scrub":"267'835","last_deep_scrub_stamp":"2024-09-12T01:16:09.688553+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.688553+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:38.082389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4096,"num_read_kb":3692,"num_write":1085,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'193","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.147640+0000","last_change":"2024-09-12T01:16:01.147640+0000","last_active":"2024-09-12T01:16:01.147640+0000","last_peered":"2024-09-12T01:16:01.147640+0000","last_clean":"2024-09-12T01:16:01.147640+0000","last_became_active":"2024-09-12T00:03:21.143160+0000","last_became_peered":"2024-09-12T00:03:21.143160+0000","last_unstale":"2024-09-12T01:16:01.147640+0000","last_undegraded":"2024-09-12T01:16:01.147640+0000","last_fullsized":"2024-09-12T01:16:01.147640+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:16:01.147530+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:16:01.147530+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.147530+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:27.265957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":434,"num_read_kb":67077,"num_write":937,"num_write_kb":29840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'450","reported_seq":1973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.274158+0000","last_change":"2024-09-12T01:16:15.274158+0000","last_active":"2024-09-12T01:16:15.274158+0000","last_peered":"2024-09-12T01:16:15.274158+0000","last_clean":"2024-09-12T01:16:15.274158+0000","last_became_active":"2024-09-12T00:02:50.060457+0000","last_became_peered":"2024-09-12T00:02:50.060457+0000","last_unstale":"2024-09-12T01:16:15.274158+0000","last_undegraded":"2024-09-12T01:16:15.274158+0000","last_fullsized":"2024-09-12T01:16:15.274158+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'450","last_scrub_stamp":"2024-09-12T01:16:15.274064+0000","last_deep_scrub":"267'450","last_deep_scrub_stamp":"2024-09-12T01:16:15.274064+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.274064+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:18.935122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2366,"num_read_kb":2209,"num_write":518,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5804,"num_read_kb":4071,"num_write":1920,"num_write_kb":818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8194,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":993,"ondisk_log_size":993,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15077,"num_read_kb":14728,"num_write":16720,"num_write_kb":4882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1744,"ondisk_log_size":1744,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662,"ondisk_log_size":662,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":259874,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":10212,"num_read_kb":12359,"num_write":7103,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":676584,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1890,"ondisk_log_size":1890,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212469,"num_read_kb":193861,"num_write":55201,"num_write_kb":18788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43525,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3924,"ondisk_log_size":3924,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":93137464,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":33184,"num_read_kb":2494324,"num_write":62091,"num_write_kb":2229204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":141545472,"data_stored":141545472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4519,"ondisk_log_size":4519,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196988,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185720,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510335,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243796,"kb_used_data":14084,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94128044,"statfs":{"total":96636764160,"available":96387117056,"internally_reserved":0,"allocated":14422016,"data_stored":12282601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510337,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259840,"kb_used_data":25968,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94112000,"statfs":{"total":96636764160,"available":96370688000,"internally_reserved":0,"allocated":26591232,"data_stored":24503671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510339,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97016,"kb_used_data":15848,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94274824,"statfs":{"total":96636764160,"available":96537419776,"internally_reserved":0,"allocated":16228352,"data_stored":14061021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510334,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106528,"kb_used_data":25360,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94265312,"statfs":{"total":96636764160,"available":96527679488,"internally_reserved":0,"allocated":25968640,"data_stored":23900981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510333,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245988,"kb_used_data":16276,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94125852,"statfs":{"total":96636764160,"available":96384872448,"internally_reserved":0,"allocated":16666624,"data_stored":14539294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510331,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101516,"kb_used_data":25916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94270324,"statfs":{"total":96636764160,"available":96532811776,"internally_reserved":0,"allocated":26537984,"data_stored":24477318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510332,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154136,"kb_used_data":28616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94217704,"statfs":{"total":96636764160,"available":96478928896,"internally_reserved":0,"allocated":29302784,"data_stored":27210308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575743,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273592,"kb_used_data":21736,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098248,"statfs":{"total":96636764160,"available":96356605952,"internally_reserved":0,"allocated":22257664,"data_stored":20146116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17256448,"data_stored":17256448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24911872,"data_stored":24911872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22179840,"data_stored":22179840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12238848,"data_stored":12238848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21602304,"data_stored":21602304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11759616,"data_stored":11759616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22204416,"data_stored":22204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:16:37.694 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.694 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.694 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.694 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.694 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.695 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.696 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.697 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.698 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.699 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.699 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.699 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.699 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.699 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.699 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.699 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.700 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.701 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.701 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.701 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.701 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.701 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.701 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.701 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.701 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.702 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.702 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.702 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.702 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.702 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.702 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.702 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.702 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:17:57.332613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.703 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.704 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.704 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:21:57.313654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=21, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.704 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.704 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.704 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:22:01.395068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.706 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.706 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:02:57.065776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:37.707 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:16:57.709 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:16:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:16:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T01:16:58.077 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":2496,"stamp":"2024-09-12T01:16:57.350262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":94005387,"num_objects":732,"num_object_clones":0,"num_object_copies":1697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":279494,"num_read_kb":3104975,"num_write":143492,"num_write_kb":2513046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":732228,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14039,"ondisk_log_size":14039,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1482412,"kb_used_data":173804,"kb_used_omap":12,"kb_used_meta":1308467,"kb_avail":753492308,"statfs":{"total":773094113280,"available":771576123392,"internally_reserved":0,"allocated":177975296,"data_stored":161121310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1339870769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005519"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:46.201045+0000","last_change":"2024-09-12T01:16:46.201045+0000","last_active":"2024-09-12T01:16:46.201045+0000","last_peered":"2024-09-12T01:16:46.201045+0000","last_clean":"2024-09-12T01:16:46.201045+0000","last_became_active":"2024-09-12T00:39:26.642090+0000","last_became_peered":"2024-09-12T00:39:26.642090+0000","last_unstale":"2024-09-12T01:16:46.201045+0000","last_undegraded":"2024-09-12T01:16:46.201045+0000","last_fullsized":"2024-09-12T01:16:46.201045+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:46.200953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:46.200953+0000","last_clean_scrub_stamp":"2024-09-12T01:16:46.200953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:36.950269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:43.144170+0000","last_change":"2024-09-12T01:16:43.144170+0000","last_active":"2024-09-12T01:16:43.144170+0000","last_peered":"2024-09-12T01:16:43.144170+0000","last_clean":"2024-09-12T01:16:43.144170+0000","last_became_active":"2024-09-12T00:22:02.423867+0000","last_became_peered":"2024-09-12T00:22:02.423867+0000","last_unstale":"2024-09-12T01:16:43.144170+0000","last_undegraded":"2024-09-12T01:16:43.144170+0000","last_fullsized":"2024-09-12T01:16:43.144170+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:16:43.144081+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:16:43.144081+0000","last_clean_scrub_stamp":"2024-09-12T01:16:43.144081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:54.007496+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.753894+0000","last_change":"2024-09-12T01:16:41.753894+0000","last_active":"2024-09-12T01:16:41.753894+0000","last_peered":"2024-09-12T01:16:41.753894+0000","last_clean":"2024-09-12T01:16:41.753894+0000","last_became_active":"2024-09-12T00:21:58.335882+0000","last_became_peered":"2024-09-12T00:21:58.335882+0000","last_unstale":"2024-09-12T01:16:41.753894+0000","last_undegraded":"2024-09-12T01:16:41.753894+0000","last_fullsized":"2024-09-12T01:16:41.753894+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:16:41.753805+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:16:41.753805+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.753805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:40.280055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":322,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'60","reported_seq":232,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.666715+0000","last_change":"2024-09-12T01:16:41.666715+0000","last_active":"2024-09-12T01:16:41.666715+0000","last_peered":"2024-09-12T01:16:41.666715+0000","last_clean":"2024-09-12T01:16:41.666715+0000","last_became_active":"2024-09-12T00:17:58.353889+0000","last_became_peered":"2024-09-12T00:17:58.353889+0000","last_unstale":"2024-09-12T01:16:41.666715+0000","last_undegraded":"2024-09-12T01:16:41.666715+0000","last_fullsized":"2024-09-12T01:16:41.666715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'60","last_scrub_stamp":"2024-09-12T01:16:41.666624+0000","last_deep_scrub":"267'60","last_deep_scrub_stamp":"2024-09-12T01:16:41.666624+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.666624+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.041466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":209,"num_write":117,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.272165+0000","last_change":"2024-09-12T01:16:26.272165+0000","last_active":"2024-09-12T01:16:26.272165+0000","last_peered":"2024-09-12T01:16:26.272165+0000","last_clean":"2024-09-12T01:16:26.272165+0000","last_became_active":"2024-09-12T00:39:26.637244+0000","last_became_peered":"2024-09-12T00:39:26.637244+0000","last_unstale":"2024-09-12T01:16:26.272165+0000","last_undegraded":"2024-09-12T01:16:26.272165+0000","last_fullsized":"2024-09-12T01:16:26.272165+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:26.272076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:26.272076+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.272076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:45.460900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.885921+0000","last_change":"2024-09-12T01:16:41.885921+0000","last_active":"2024-09-12T01:16:41.885921+0000","last_peered":"2024-09-12T01:16:41.885921+0000","last_clean":"2024-09-12T01:16:41.885921+0000","last_became_active":"2024-09-12T00:22:02.420774+0000","last_became_peered":"2024-09-12T00:22:02.420774+0000","last_unstale":"2024-09-12T01:16:41.885921+0000","last_undegraded":"2024-09-12T01:16:41.885921+0000","last_fullsized":"2024-09-12T01:16:41.885921+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:41.885786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:41.885786+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.885786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:42.094189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.399546+0000","last_change":"2024-09-12T01:16:29.399546+0000","last_active":"2024-09-12T01:16:29.399546+0000","last_peered":"2024-09-12T01:16:29.399546+0000","last_clean":"2024-09-12T01:16:29.399546+0000","last_became_active":"2024-09-12T00:21:58.336723+0000","last_became_peered":"2024-09-12T00:21:58.336723+0000","last_unstale":"2024-09-12T01:16:29.399546+0000","last_undegraded":"2024-09-12T01:16:29.399546+0000","last_fullsized":"2024-09-12T01:16:29.399546+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:29.399457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:29.399457+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.399457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:53.257732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'21","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.253525+0000","last_change":"2024-09-12T01:16:18.253525+0000","last_active":"2024-09-12T01:16:18.253525+0000","last_peered":"2024-09-12T01:16:18.253525+0000","last_clean":"2024-09-12T01:16:18.253525+0000","last_became_active":"2024-09-12T00:17:58.361306+0000","last_became_peered":"2024-09-12T00:17:58.361306+0000","last_unstale":"2024-09-12T01:16:18.253525+0000","last_undegraded":"2024-09-12T01:16:18.253525+0000","last_fullsized":"2024-09-12T01:16:18.253525+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T01:16:18.253413+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T01:16:18.253413+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.253413+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.534994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.395558+0000","last_change":"2024-09-12T01:16:32.395558+0000","last_active":"2024-09-12T01:16:32.395558+0000","last_peered":"2024-09-12T01:16:32.395558+0000","last_clean":"2024-09-12T01:16:32.395558+0000","last_became_active":"2024-09-12T00:39:26.625454+0000","last_became_peered":"2024-09-12T00:39:26.625454+0000","last_unstale":"2024-09-12T01:16:32.395558+0000","last_undegraded":"2024-09-12T01:16:32.395558+0000","last_fullsized":"2024-09-12T01:16:32.395558+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.395472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.395472+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.395472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:47.842934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:47.641389+0000","last_change":"2024-09-12T01:16:47.641389+0000","last_active":"2024-09-12T01:16:47.641389+0000","last_peered":"2024-09-12T01:16:47.641389+0000","last_clean":"2024-09-12T01:16:47.641389+0000","last_became_active":"2024-09-12T00:22:02.421689+0000","last_became_peered":"2024-09-12T00:22:02.421689+0000","last_unstale":"2024-09-12T01:16:47.641389+0000","last_undegraded":"2024-09-12T01:16:47.641389+0000","last_fullsized":"2024-09-12T01:16:47.641389+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:47.641297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:47.641297+0000","last_clean_scrub_stamp":"2024-09-12T01:16:47.641297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:12.624272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.198466+0000","last_change":"2024-09-12T01:16:22.198466+0000","last_active":"2024-09-12T01:16:22.198466+0000","last_peered":"2024-09-12T01:16:22.198466+0000","last_clean":"2024-09-12T01:16:22.198466+0000","last_became_active":"2024-09-12T00:21:58.332782+0000","last_became_peered":"2024-09-12T00:21:58.332782+0000","last_unstale":"2024-09-12T01:16:22.198466+0000","last_undegraded":"2024-09-12T01:16:22.198466+0000","last_fullsized":"2024-09-12T01:16:22.198466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:22.198371+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:22.198371+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.198371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:01.472421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'34","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.613784+0000","last_change":"2024-09-12T01:16:36.613784+0000","last_active":"2024-09-12T01:16:36.613784+0000","last_peered":"2024-09-12T01:16:36.613784+0000","last_clean":"2024-09-12T01:16:36.613784+0000","last_became_active":"2024-09-12T00:17:58.353045+0000","last_became_peered":"2024-09-12T00:17:58.353045+0000","last_unstale":"2024-09-12T01:16:36.613784+0000","last_undegraded":"2024-09-12T01:16:36.613784+0000","last_fullsized":"2024-09-12T01:16:36.613784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-12T01:16:36.613699+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-12T01:16:36.613699+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.613699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:44.318488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:52.692306+0000","last_change":"2024-09-12T01:16:52.692306+0000","last_active":"2024-09-12T01:16:52.692306+0000","last_peered":"2024-09-12T01:16:52.692306+0000","last_clean":"2024-09-12T01:16:52.692306+0000","last_became_active":"2024-09-12T00:39:26.637185+0000","last_became_peered":"2024-09-12T00:39:26.637185+0000","last_unstale":"2024-09-12T01:16:52.692306+0000","last_undegraded":"2024-09-12T01:16:52.692306+0000","last_fullsized":"2024-09-12T01:16:52.692306+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:52.692217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:52.692217+0000","last_clean_scrub_stamp":"2024-09-12T01:16:52.692217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:44.772129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:49.747098+0000","last_change":"2024-09-12T01:16:49.747098+0000","last_active":"2024-09-12T01:16:49.747098+0000","last_peered":"2024-09-12T01:16:49.747098+0000","last_clean":"2024-09-12T01:16:49.747098+0000","last_became_active":"2024-09-12T00:22:02.427612+0000","last_became_peered":"2024-09-12T00:22:02.427612+0000","last_unstale":"2024-09-12T01:16:49.747098+0000","last_undegraded":"2024-09-12T01:16:49.747098+0000","last_fullsized":"2024-09-12T01:16:49.747098+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:49.747017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:49.747017+0000","last_clean_scrub_stamp":"2024-09-12T01:16:49.747017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:29.496472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.810747+0000","last_change":"2024-09-12T01:16:36.810747+0000","last_active":"2024-09-12T01:16:36.810747+0000","last_peered":"2024-09-12T01:16:36.810747+0000","last_clean":"2024-09-12T01:16:36.810747+0000","last_became_active":"2024-09-12T00:21:58.335619+0000","last_became_peered":"2024-09-12T00:21:58.335619+0000","last_unstale":"2024-09-12T01:16:36.810747+0000","last_undegraded":"2024-09-12T01:16:36.810747+0000","last_fullsized":"2024-09-12T01:16:36.810747+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:16:36.810657+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:16:36.810657+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.810657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.449800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.790742+0000","last_change":"2024-09-12T01:16:39.790742+0000","last_active":"2024-09-12T01:16:39.790742+0000","last_peered":"2024-09-12T01:16:39.790742+0000","last_clean":"2024-09-12T01:16:39.790742+0000","last_became_active":"2024-09-12T00:17:58.355691+0000","last_became_peered":"2024-09-12T00:17:58.355691+0000","last_unstale":"2024-09-12T01:16:39.790742+0000","last_undegraded":"2024-09-12T01:16:39.790742+0000","last_fullsized":"2024-09-12T01:16:39.790742+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:39.790647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:39.790647+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.790647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:47.087881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:33.238400+0000","last_change":"2024-09-12T00:39:26.635830+0000","last_active":"2024-09-12T01:13:33.238400+0000","last_peered":"2024-09-12T01:13:33.238400+0000","last_clean":"2024-09-12T01:13:33.238400+0000","last_became_active":"2024-09-12T00:39:26.635537+0000","last_became_peered":"2024-09-12T00:39:26.635537+0000","last_unstale":"2024-09-12T01:13:33.238400+0000","last_undegraded":"2024-09-12T01:13:33.238400+0000","last_fullsized":"2024-09-12T01:13:33.238400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:16.342432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.112205+0000","last_change":"2024-09-12T01:16:41.112205+0000","last_active":"2024-09-12T01:16:41.112205+0000","last_peered":"2024-09-12T01:16:41.112205+0000","last_clean":"2024-09-12T01:16:41.112205+0000","last_became_active":"2024-09-12T00:22:02.429230+0000","last_became_peered":"2024-09-12T00:22:02.429230+0000","last_unstale":"2024-09-12T01:16:41.112205+0000","last_undegraded":"2024-09-12T01:16:41.112205+0000","last_fullsized":"2024-09-12T01:16:41.112205+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:41.112113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:41.112113+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.112113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:15.069560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'5","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:43.638511+0000","last_change":"2024-09-12T01:16:43.638511+0000","last_active":"2024-09-12T01:16:43.638511+0000","last_peered":"2024-09-12T01:16:43.638511+0000","last_clean":"2024-09-12T01:16:43.638511+0000","last_became_active":"2024-09-12T00:21:58.338021+0000","last_became_peered":"2024-09-12T00:21:58.338021+0000","last_unstale":"2024-09-12T01:16:43.638511+0000","last_undegraded":"2024-09-12T01:16:43.638511+0000","last_fullsized":"2024-09-12T01:16:43.638511+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:43.638414+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:43.638414+0000","last_clean_scrub_stamp":"2024-09-12T01:16:43.638414+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:21.866097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'22","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.809299+0000","last_change":"2024-09-12T01:16:38.809299+0000","last_active":"2024-09-12T01:16:38.809299+0000","last_peered":"2024-09-12T01:16:38.809299+0000","last_clean":"2024-09-12T01:16:38.809299+0000","last_became_active":"2024-09-12T00:17:58.357755+0000","last_became_peered":"2024-09-12T00:17:58.357755+0000","last_unstale":"2024-09-12T01:16:38.809299+0000","last_undegraded":"2024-09-12T01:16:38.809299+0000","last_fullsized":"2024-09-12T01:16:38.809299+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-12T01:16:38.809205+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-12T01:16:38.809205+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.809205+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.962679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.552696+0000","last_change":"2024-09-12T01:16:36.552696+0000","last_active":"2024-09-12T01:16:36.552696+0000","last_peered":"2024-09-12T01:16:36.552696+0000","last_clean":"2024-09-12T01:16:36.552696+0000","last_became_active":"2024-09-12T00:39:26.630758+0000","last_became_peered":"2024-09-12T00:39:26.630758+0000","last_unstale":"2024-09-12T01:16:36.552696+0000","last_undegraded":"2024-09-12T01:16:36.552696+0000","last_fullsized":"2024-09-12T01:16:36.552696+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:36.552611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:36.552611+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.552611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.494798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'5","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.401417+0000","last_change":"2024-09-12T01:16:30.401417+0000","last_active":"2024-09-12T01:16:30.401417+0000","last_peered":"2024-09-12T01:16:30.401417+0000","last_clean":"2024-09-12T01:16:30.401417+0000","last_became_active":"2024-09-12T00:22:02.427863+0000","last_became_peered":"2024-09-12T00:22:02.427863+0000","last_unstale":"2024-09-12T01:16:30.401417+0000","last_undegraded":"2024-09-12T01:16:30.401417+0000","last_fullsized":"2024-09-12T01:16:30.401417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:30.401321+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:30.401321+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.401321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:49.965892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":40,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.841235+0000","last_change":"2024-09-12T01:16:34.841235+0000","last_active":"2024-09-12T01:16:34.841235+0000","last_peered":"2024-09-12T01:16:34.841235+0000","last_clean":"2024-09-12T01:16:34.841235+0000","last_became_active":"2024-09-12T00:21:58.330308+0000","last_became_peered":"2024-09-12T00:21:58.330308+0000","last_unstale":"2024-09-12T01:16:34.841235+0000","last_undegraded":"2024-09-12T01:16:34.841235+0000","last_fullsized":"2024-09-12T01:16:34.841235+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:16:34.841149+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:16:34.841149+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.841149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:14.738628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'33","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.322083+0000","last_change":"2024-09-12T01:16:25.322083+0000","last_active":"2024-09-12T01:16:25.322083+0000","last_peered":"2024-09-12T01:16:25.322083+0000","last_clean":"2024-09-12T01:16:25.322083+0000","last_became_active":"2024-09-12T00:17:58.360394+0000","last_became_peered":"2024-09-12T00:17:58.360394+0000","last_unstale":"2024-09-12T01:16:25.322083+0000","last_undegraded":"2024-09-12T01:16:25.322083+0000","last_fullsized":"2024-09-12T01:16:25.322083+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-12T01:16:25.322003+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-12T01:16:25.322003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.322003+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:07.467681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":120,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:51.941518+0000","last_change":"2024-09-12T01:16:51.941518+0000","last_active":"2024-09-12T01:16:51.941518+0000","last_peered":"2024-09-12T01:16:51.941518+0000","last_clean":"2024-09-12T01:16:51.941518+0000","last_became_active":"2024-09-12T00:39:26.638443+0000","last_became_peered":"2024-09-12T00:39:26.638443+0000","last_unstale":"2024-09-12T01:16:51.941518+0000","last_undegraded":"2024-09-12T01:16:51.941518+0000","last_fullsized":"2024-09-12T01:16:51.941518+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:51.941429+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:51.941429+0000","last_clean_scrub_stamp":"2024-09-12T01:16:51.941429+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:02.798904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"264'5","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.404392+0000","last_change":"2024-09-12T01:16:31.404392+0000","last_active":"2024-09-12T01:16:31.404392+0000","last_peered":"2024-09-12T01:16:31.404392+0000","last_clean":"2024-09-12T01:16:31.404392+0000","last_became_active":"2024-09-12T00:22:02.419920+0000","last_became_peered":"2024-09-12T00:22:02.419920+0000","last_unstale":"2024-09-12T01:16:31.404392+0000","last_undegraded":"2024-09-12T01:16:31.404392+0000","last_fullsized":"2024-09-12T01:16:31.404392+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:31.404304+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:31.404304+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.404304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:38.209811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6462,"num_write":5,"num_write_kb":6462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.826278+0000","last_change":"2024-09-12T01:16:35.826278+0000","last_active":"2024-09-12T01:16:35.826278+0000","last_peered":"2024-09-12T01:16:35.826278+0000","last_clean":"2024-09-12T01:16:35.826278+0000","last_became_active":"2024-09-12T00:21:58.334622+0000","last_became_peered":"2024-09-12T00:21:58.334622+0000","last_unstale":"2024-09-12T01:16:35.826278+0000","last_undegraded":"2024-09-12T01:16:35.826278+0000","last_fullsized":"2024-09-12T01:16:35.826278+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:35.826174+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:35.826174+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.826174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:31.878816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'18","reported_seq":116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.622681+0000","last_change":"2024-09-12T01:16:35.622681+0000","last_active":"2024-09-12T01:16:35.622681+0000","last_peered":"2024-09-12T01:16:35.622681+0000","last_clean":"2024-09-12T01:16:35.622681+0000","last_became_active":"2024-09-12T00:17:58.361620+0000","last_became_peered":"2024-09-12T00:17:58.361620+0000","last_unstale":"2024-09-12T01:16:35.622681+0000","last_undegraded":"2024-09-12T01:16:35.622681+0000","last_fullsized":"2024-09-12T01:16:35.622681+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'18","last_scrub_stamp":"2024-09-12T01:16:35.622592+0000","last_deep_scrub":"267'18","last_deep_scrub_stamp":"2024-09-12T01:16:35.622592+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.622592+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:23.160375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.391431+0000","last_change":"2024-09-12T00:39:26.643583+0000","last_active":"2024-09-12T01:11:58.391431+0000","last_peered":"2024-09-12T01:11:58.391431+0000","last_clean":"2024-09-12T01:11:58.391431+0000","last_became_active":"2024-09-12T00:39:26.643223+0000","last_became_peered":"2024-09-12T00:39:26.643223+0000","last_unstale":"2024-09-12T01:11:58.391431+0000","last_undegraded":"2024-09-12T01:11:58.391431+0000","last_fullsized":"2024-09-12T01:11:58.391431+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:18.297840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'5","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.158764+0000","last_change":"2024-09-12T01:16:42.158764+0000","last_active":"2024-09-12T01:16:42.158764+0000","last_peered":"2024-09-12T01:16:42.158764+0000","last_clean":"2024-09-12T01:16:42.158764+0000","last_became_active":"2024-09-12T00:22:22.311701+0000","last_became_peered":"2024-09-12T00:22:22.311701+0000","last_unstale":"2024-09-12T01:16:42.158764+0000","last_undegraded":"2024-09-12T01:16:42.158764+0000","last_fullsized":"2024-09-12T01:16:42.158764+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:42.158660+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:42.158660+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.158660+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:46.648688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":5,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:44.666231+0000","last_change":"2024-09-12T01:16:44.666231+0000","last_active":"2024-09-12T01:16:44.666231+0000","last_peered":"2024-09-12T01:16:44.666231+0000","last_clean":"2024-09-12T01:16:44.666231+0000","last_became_active":"2024-09-12T00:21:58.339586+0000","last_became_peered":"2024-09-12T00:21:58.339586+0000","last_unstale":"2024-09-12T01:16:44.666231+0000","last_undegraded":"2024-09-12T01:16:44.666231+0000","last_fullsized":"2024-09-12T01:16:44.666231+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:44.666134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:44.666134+0000","last_clean_scrub_stamp":"2024-09-12T01:16:44.666134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:10.501441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'26","reported_seq":137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.278337+0000","last_change":"2024-09-12T01:16:26.278337+0000","last_active":"2024-09-12T01:16:26.278337+0000","last_peered":"2024-09-12T01:16:26.278337+0000","last_clean":"2024-09-12T01:16:26.278337+0000","last_became_active":"2024-09-12T00:17:58.352129+0000","last_became_peered":"2024-09-12T00:17:58.352129+0000","last_unstale":"2024-09-12T01:16:26.278337+0000","last_undegraded":"2024-09-12T01:16:26.278337+0000","last_fullsized":"2024-09-12T01:16:26.278337+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T01:16:26.278250+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T01:16:26.278250+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.278250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:58.119622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.513104+0000","last_change":"2024-09-12T01:16:37.513017+0000","last_active":"2024-09-12T01:16:37.513104+0000","last_peered":"2024-09-12T01:16:37.513104+0000","last_clean":"2024-09-12T01:16:37.513104+0000","last_became_active":"2024-09-12T00:39:26.635558+0000","last_became_peered":"2024-09-12T00:39:26.635558+0000","last_unstale":"2024-09-12T01:16:37.513104+0000","last_undegraded":"2024-09-12T01:16:37.513104+0000","last_fullsized":"2024-09-12T01:16:37.513104+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:37.512935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:37.512935+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.512935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:39.574872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:47.705340+0000","last_change":"2024-09-12T01:16:47.705340+0000","last_active":"2024-09-12T01:16:47.705340+0000","last_peered":"2024-09-12T01:16:47.705340+0000","last_clean":"2024-09-12T01:16:47.705340+0000","last_became_active":"2024-09-12T00:22:02.427180+0000","last_became_peered":"2024-09-12T00:22:02.427180+0000","last_unstale":"2024-09-12T01:16:47.705340+0000","last_undegraded":"2024-09-12T01:16:47.705340+0000","last_fullsized":"2024-09-12T01:16:47.705340+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:47.705221+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:47.705221+0000","last_clean_scrub_stamp":"2024-09-12T01:16:47.705221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:52.237912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.153451+0000","last_change":"2024-09-12T01:16:39.153451+0000","last_active":"2024-09-12T01:16:39.153451+0000","last_peered":"2024-09-12T01:16:39.153451+0000","last_clean":"2024-09-12T01:16:39.153451+0000","last_became_active":"2024-09-12T00:21:58.334446+0000","last_became_peered":"2024-09-12T00:21:58.334446+0000","last_unstale":"2024-09-12T01:16:39.153451+0000","last_undegraded":"2024-09-12T01:16:39.153451+0000","last_fullsized":"2024-09-12T01:16:39.153451+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:39.153343+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:39.153343+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.153343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:17.459737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'14","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.710648+0000","last_change":"2024-09-12T01:16:38.710648+0000","last_active":"2024-09-12T01:16:38.710648+0000","last_peered":"2024-09-12T01:16:38.710648+0000","last_clean":"2024-09-12T01:16:38.710648+0000","last_became_active":"2024-09-12T00:17:58.360560+0000","last_became_peered":"2024-09-12T00:17:58.360560+0000","last_unstale":"2024-09-12T01:16:38.710648+0000","last_undegraded":"2024-09-12T01:16:38.710648+0000","last_fullsized":"2024-09-12T01:16:38.710648+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-12T01:16:38.710552+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-12T01:16:38.710552+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.710552+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:31.636846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.248067+0000","last_change":"2024-09-12T01:16:25.248007+0000","last_active":"2024-09-12T01:16:25.248067+0000","last_peered":"2024-09-12T01:16:25.248067+0000","last_clean":"2024-09-12T01:16:25.248067+0000","last_became_active":"2024-09-12T00:39:26.635359+0000","last_became_peered":"2024-09-12T00:39:26.635359+0000","last_unstale":"2024-09-12T01:16:25.248067+0000","last_undegraded":"2024-09-12T01:16:25.248067+0000","last_fullsized":"2024-09-12T01:16:25.248067+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:25.247921+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:25.247921+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.247921+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:23.777053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:46.682719+0000","last_change":"2024-09-12T01:16:46.682719+0000","last_active":"2024-09-12T01:16:46.682719+0000","last_peered":"2024-09-12T01:16:46.682719+0000","last_clean":"2024-09-12T01:16:46.682719+0000","last_became_active":"2024-09-12T00:22:02.431994+0000","last_became_peered":"2024-09-12T00:22:02.431994+0000","last_unstale":"2024-09-12T01:16:46.682719+0000","last_undegraded":"2024-09-12T01:16:46.682719+0000","last_fullsized":"2024-09-12T01:16:46.682719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:16:46.682635+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:16:46.682635+0000","last_clean_scrub_stamp":"2024-09-12T01:16:46.682635+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:32.497622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.930374+0000","last_change":"2024-09-12T01:16:40.930374+0000","last_active":"2024-09-12T01:16:40.930374+0000","last_peered":"2024-09-12T01:16:40.930374+0000","last_clean":"2024-09-12T01:16:40.930374+0000","last_became_active":"2024-09-12T00:21:58.327504+0000","last_became_peered":"2024-09-12T00:21:58.327504+0000","last_unstale":"2024-09-12T01:16:40.930374+0000","last_undegraded":"2024-09-12T01:16:40.930374+0000","last_fullsized":"2024-09-12T01:16:40.930374+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:40.930291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:40.930291+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.930291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.314624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'62","reported_seq":230,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.760835+0000","last_change":"2024-09-12T01:16:37.760835+0000","last_active":"2024-09-12T01:16:37.760835+0000","last_peered":"2024-09-12T01:16:37.760835+0000","last_clean":"2024-09-12T01:16:37.760835+0000","last_became_active":"2024-09-12T00:17:58.360095+0000","last_became_peered":"2024-09-12T00:17:58.360095+0000","last_unstale":"2024-09-12T01:16:37.760835+0000","last_undegraded":"2024-09-12T01:16:37.760835+0000","last_fullsized":"2024-09-12T01:16:37.760835+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'62","last_scrub_stamp":"2024-09-12T01:16:37.760756+0000","last_deep_scrub":"267'62","last_deep_scrub_stamp":"2024-09-12T01:16:37.760756+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.760756+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:08.529977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":213,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:52.944449+0000","last_change":"2024-09-12T01:16:52.944449+0000","last_active":"2024-09-12T01:16:52.944449+0000","last_peered":"2024-09-12T01:16:52.944449+0000","last_clean":"2024-09-12T01:16:52.944449+0000","last_became_active":"2024-09-12T00:39:26.639681+0000","last_became_peered":"2024-09-12T00:39:26.639681+0000","last_unstale":"2024-09-12T01:16:52.944449+0000","last_undegraded":"2024-09-12T01:16:52.944449+0000","last_fullsized":"2024-09-12T01:16:52.944449+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:52.944353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:52.944353+0000","last_clean_scrub_stamp":"2024-09-12T01:16:52.944353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:11.550310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:48.724424+0000","last_change":"2024-09-12T01:16:48.724424+0000","last_active":"2024-09-12T01:16:48.724424+0000","last_peered":"2024-09-12T01:16:48.724424+0000","last_clean":"2024-09-12T01:16:48.724424+0000","last_became_active":"2024-09-12T00:22:02.427285+0000","last_became_peered":"2024-09-12T00:22:02.427285+0000","last_unstale":"2024-09-12T01:16:48.724424+0000","last_undegraded":"2024-09-12T01:16:48.724424+0000","last_fullsized":"2024-09-12T01:16:48.724424+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:48.724330+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:48.724330+0000","last_clean_scrub_stamp":"2024-09-12T01:16:48.724330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:09.001256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.214116+0000","last_change":"2024-09-12T01:16:21.214116+0000","last_active":"2024-09-12T01:16:21.214116+0000","last_peered":"2024-09-12T01:16:21.214116+0000","last_clean":"2024-09-12T01:16:21.214116+0000","last_became_active":"2024-09-12T00:21:58.335100+0000","last_became_peered":"2024-09-12T00:21:58.335100+0000","last_unstale":"2024-09-12T01:16:21.214116+0000","last_undegraded":"2024-09-12T01:16:21.214116+0000","last_fullsized":"2024-09-12T01:16:21.214116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:21.214016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:21.214016+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.214016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:39.484612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'92","reported_seq":379,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.220753+0000","last_change":"2024-09-12T01:16:17.220753+0000","last_active":"2024-09-12T01:16:17.220753+0000","last_peered":"2024-09-12T01:16:17.220753+0000","last_clean":"2024-09-12T01:16:17.220753+0000","last_became_active":"2024-09-12T00:17:58.350522+0000","last_became_peered":"2024-09-12T00:17:58.350522+0000","last_unstale":"2024-09-12T01:16:17.220753+0000","last_undegraded":"2024-09-12T01:16:17.220753+0000","last_fullsized":"2024-09-12T01:16:17.220753+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'92","last_scrub_stamp":"2024-09-12T01:16:17.220682+0000","last_deep_scrub":"267'92","last_deep_scrub_stamp":"2024-09-12T01:16:17.220682+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.220682+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:17.904421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":413,"num_write":129,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4000,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:45.213940+0000","last_change":"2024-09-12T01:16:45.213868+0000","last_active":"2024-09-12T01:16:45.213940+0000","last_peered":"2024-09-12T01:16:45.213940+0000","last_clean":"2024-09-12T01:16:45.213940+0000","last_became_active":"2024-09-12T00:39:26.642486+0000","last_became_peered":"2024-09-12T00:39:26.642486+0000","last_unstale":"2024-09-12T01:16:45.213940+0000","last_undegraded":"2024-09-12T01:16:45.213940+0000","last_fullsized":"2024-09-12T01:16:45.213940+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:45.213766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:45.213766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:45.213766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:42.345841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.890049+0000","last_change":"2024-09-12T01:16:40.890049+0000","last_active":"2024-09-12T01:16:40.890049+0000","last_peered":"2024-09-12T01:16:40.890049+0000","last_clean":"2024-09-12T01:16:40.890049+0000","last_became_active":"2024-09-12T00:22:02.417518+0000","last_became_peered":"2024-09-12T00:22:02.417518+0000","last_unstale":"2024-09-12T01:16:40.890049+0000","last_undegraded":"2024-09-12T01:16:40.890049+0000","last_fullsized":"2024-09-12T01:16:40.890049+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:40.889958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:40.889958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.889958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:39.906774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.663632+0000","last_change":"2024-09-12T01:16:42.663632+0000","last_active":"2024-09-12T01:16:42.663632+0000","last_peered":"2024-09-12T01:16:42.663632+0000","last_clean":"2024-09-12T01:16:42.663632+0000","last_became_active":"2024-09-12T00:21:58.337079+0000","last_became_peered":"2024-09-12T00:21:58.337079+0000","last_unstale":"2024-09-12T01:16:42.663632+0000","last_undegraded":"2024-09-12T01:16:42.663632+0000","last_fullsized":"2024-09-12T01:16:42.663632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:16:42.663541+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:16:42.663541+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.663541+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:47.189751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24618,"num_write":22,"num_write_kb":14376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'26","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.960124+0000","last_change":"2024-09-12T01:16:35.960124+0000","last_active":"2024-09-12T01:16:35.960124+0000","last_peered":"2024-09-12T01:16:35.960124+0000","last_clean":"2024-09-12T01:16:35.960124+0000","last_became_active":"2024-09-12T00:17:58.360141+0000","last_became_peered":"2024-09-12T00:17:58.360141+0000","last_unstale":"2024-09-12T01:16:35.960124+0000","last_undegraded":"2024-09-12T01:16:35.960124+0000","last_fullsized":"2024-09-12T01:16:35.960124+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T01:16:35.960026+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T01:16:35.960026+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.960026+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:40.754856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:13:18.236768+0000","last_change":"2024-09-12T00:39:26.636792+0000","last_active":"2024-09-12T01:13:18.236768+0000","last_peered":"2024-09-12T01:13:18.236768+0000","last_clean":"2024-09-12T01:13:18.236768+0000","last_became_active":"2024-09-12T00:39:26.636434+0000","last_became_peered":"2024-09-12T00:39:26.636434+0000","last_unstale":"2024-09-12T01:13:18.236768+0000","last_undegraded":"2024-09-12T01:13:18.236768+0000","last_fullsized":"2024-09-12T01:13:18.236768+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.603778+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.603778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:17.120295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.494616+0000","last_change":"2024-09-12T01:16:33.494616+0000","last_active":"2024-09-12T01:16:33.494616+0000","last_peered":"2024-09-12T01:16:33.494616+0000","last_clean":"2024-09-12T01:16:33.494616+0000","last_became_active":"2024-09-12T00:22:02.420528+0000","last_became_peered":"2024-09-12T00:22:02.420528+0000","last_unstale":"2024-09-12T01:16:33.494616+0000","last_undegraded":"2024-09-12T01:16:33.494616+0000","last_fullsized":"2024-09-12T01:16:33.494616+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:33.494521+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:33.494521+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.494521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:20.312164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.862913+0000","last_change":"2024-09-12T01:16:33.862913+0000","last_active":"2024-09-12T01:16:33.862913+0000","last_peered":"2024-09-12T01:16:33.862913+0000","last_clean":"2024-09-12T01:16:33.862913+0000","last_became_active":"2024-09-12T00:21:58.337215+0000","last_became_peered":"2024-09-12T00:21:58.337215+0000","last_unstale":"2024-09-12T01:16:33.862913+0000","last_undegraded":"2024-09-12T01:16:33.862913+0000","last_fullsized":"2024-09-12T01:16:33.862913+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:33.862817+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:33.862817+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.862817+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:40.242997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.923759+0000","last_change":"2024-09-12T01:16:34.923759+0000","last_active":"2024-09-12T01:16:34.923759+0000","last_peered":"2024-09-12T01:16:34.923759+0000","last_clean":"2024-09-12T01:16:34.923759+0000","last_became_active":"2024-09-12T00:17:58.360592+0000","last_became_peered":"2024-09-12T00:17:58.360592+0000","last_unstale":"2024-09-12T01:16:34.923759+0000","last_undegraded":"2024-09-12T01:16:34.923759+0000","last_fullsized":"2024-09-12T01:16:34.923759+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-12T01:16:34.923677+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-12T01:16:34.923677+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.923677+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:39.921202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:52.665685+0000","last_change":"2024-09-12T01:16:52.665685+0000","last_active":"2024-09-12T01:16:52.665685+0000","last_peered":"2024-09-12T01:16:52.665685+0000","last_clean":"2024-09-12T01:16:52.665685+0000","last_became_active":"2024-09-12T00:39:26.641432+0000","last_became_peered":"2024-09-12T00:39:26.641432+0000","last_unstale":"2024-09-12T01:16:52.665685+0000","last_undegraded":"2024-09-12T01:16:52.665685+0000","last_fullsized":"2024-09-12T01:16:52.665685+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:52.665587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:52.665587+0000","last_clean_scrub_stamp":"2024-09-12T01:16:52.665587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:11.426799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.503347+0000","last_change":"2024-09-12T01:16:34.503347+0000","last_active":"2024-09-12T01:16:34.503347+0000","last_peered":"2024-09-12T01:16:34.503347+0000","last_clean":"2024-09-12T01:16:34.503347+0000","last_became_active":"2024-09-12T00:22:02.423012+0000","last_became_peered":"2024-09-12T00:22:02.423012+0000","last_unstale":"2024-09-12T01:16:34.503347+0000","last_undegraded":"2024-09-12T01:16:34.503347+0000","last_fullsized":"2024-09-12T01:16:34.503347+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:34.503246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:34.503246+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.503246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:49.517475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.765298+0000","last_change":"2024-09-12T01:16:40.765298+0000","last_active":"2024-09-12T01:16:40.765298+0000","last_peered":"2024-09-12T01:16:40.765298+0000","last_clean":"2024-09-12T01:16:40.765298+0000","last_became_active":"2024-09-12T00:21:58.334493+0000","last_became_peered":"2024-09-12T00:21:58.334493+0000","last_unstale":"2024-09-12T01:16:40.765298+0000","last_undegraded":"2024-09-12T01:16:40.765298+0000","last_fullsized":"2024-09-12T01:16:40.765298+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:40.765208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:40.765208+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.765208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:52.075681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'39","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.600584+0000","last_change":"2024-09-12T01:16:34.600584+0000","last_active":"2024-09-12T01:16:34.600584+0000","last_peered":"2024-09-12T01:16:34.600584+0000","last_clean":"2024-09-12T01:16:34.600584+0000","last_became_active":"2024-09-12T00:17:58.354989+0000","last_became_peered":"2024-09-12T00:17:58.354989+0000","last_unstale":"2024-09-12T01:16:34.600584+0000","last_undegraded":"2024-09-12T01:16:34.600584+0000","last_fullsized":"2024-09-12T01:16:34.600584+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'39","last_scrub_stamp":"2024-09-12T01:16:34.600480+0000","last_deep_scrub":"267'39","last_deep_scrub_stamp":"2024-09-12T01:16:34.600480+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.600480+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:20.236186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":70,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:50.626548+0000","last_change":"2024-09-12T01:16:50.626548+0000","last_active":"2024-09-12T01:16:50.626548+0000","last_peered":"2024-09-12T01:16:50.626548+0000","last_clean":"2024-09-12T01:16:50.626548+0000","last_became_active":"2024-09-12T00:39:26.627899+0000","last_became_peered":"2024-09-12T00:39:26.627899+0000","last_unstale":"2024-09-12T01:16:50.626548+0000","last_undegraded":"2024-09-12T01:16:50.626548+0000","last_fullsized":"2024-09-12T01:16:50.626548+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:50.626452+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:50.626452+0000","last_clean_scrub_stamp":"2024-09-12T01:16:50.626452+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:37.398315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'3","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:45.648640+0000","last_change":"2024-09-12T01:16:45.648640+0000","last_active":"2024-09-12T01:16:45.648640+0000","last_peered":"2024-09-12T01:16:45.648640+0000","last_clean":"2024-09-12T01:16:45.648640+0000","last_became_active":"2024-09-12T00:22:02.427322+0000","last_became_peered":"2024-09-12T00:22:02.427322+0000","last_unstale":"2024-09-12T01:16:45.648640+0000","last_undegraded":"2024-09-12T01:16:45.648640+0000","last_fullsized":"2024-09-12T01:16:45.648640+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:45.648552+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:45.648552+0000","last_clean_scrub_stamp":"2024-09-12T01:16:45.648552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:29.945712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.321361+0000","last_change":"2024-09-12T01:16:27.321361+0000","last_active":"2024-09-12T01:16:27.321361+0000","last_peered":"2024-09-12T01:16:27.321361+0000","last_clean":"2024-09-12T01:16:27.321361+0000","last_became_active":"2024-09-12T00:21:58.329166+0000","last_became_peered":"2024-09-12T00:21:58.329166+0000","last_unstale":"2024-09-12T01:16:27.321361+0000","last_undegraded":"2024-09-12T01:16:27.321361+0000","last_fullsized":"2024-09-12T01:16:27.321361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:16:27.321237+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:16:27.321237+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.321237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:45.617097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'42","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.914520+0000","last_change":"2024-09-12T01:16:31.914520+0000","last_active":"2024-09-12T01:16:31.914520+0000","last_peered":"2024-09-12T01:16:31.914520+0000","last_clean":"2024-09-12T01:16:31.914520+0000","last_became_active":"2024-09-12T00:17:58.355530+0000","last_became_peered":"2024-09-12T00:17:58.355530+0000","last_unstale":"2024-09-12T01:16:31.914520+0000","last_undegraded":"2024-09-12T01:16:31.914520+0000","last_fullsized":"2024-09-12T01:16:31.914520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:16:31.914428+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:16:31.914428+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.914428+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:59.113318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":155,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:51.705343+0000","last_change":"2024-09-12T01:16:51.705343+0000","last_active":"2024-09-12T01:16:51.705343+0000","last_peered":"2024-09-12T01:16:51.705343+0000","last_clean":"2024-09-12T01:16:51.705343+0000","last_became_active":"2024-09-12T00:39:26.635996+0000","last_became_peered":"2024-09-12T00:39:26.635996+0000","last_unstale":"2024-09-12T01:16:51.705343+0000","last_undegraded":"2024-09-12T01:16:51.705343+0000","last_fullsized":"2024-09-12T01:16:51.705343+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:51.705261+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:51.705261+0000","last_clean_scrub_stamp":"2024-09-12T01:16:51.705261+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:29.353144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.372292+0000","last_change":"2024-09-12T01:16:29.372292+0000","last_active":"2024-09-12T01:16:29.372292+0000","last_peered":"2024-09-12T01:16:29.372292+0000","last_clean":"2024-09-12T01:16:29.372292+0000","last_became_active":"2024-09-12T00:22:02.423766+0000","last_became_peered":"2024-09-12T00:22:02.423766+0000","last_unstale":"2024-09-12T01:16:29.372292+0000","last_undegraded":"2024-09-12T01:16:29.372292+0000","last_fullsized":"2024-09-12T01:16:29.372292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:29.372211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:29.372211+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.372211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:41.792146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.176235+0000","last_change":"2024-09-12T01:16:38.176235+0000","last_active":"2024-09-12T01:16:38.176235+0000","last_peered":"2024-09-12T01:16:38.176235+0000","last_clean":"2024-09-12T01:16:38.176235+0000","last_became_active":"2024-09-12T00:21:58.334482+0000","last_became_peered":"2024-09-12T00:21:58.334482+0000","last_unstale":"2024-09-12T01:16:38.176235+0000","last_undegraded":"2024-09-12T01:16:38.176235+0000","last_fullsized":"2024-09-12T01:16:38.176235+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:38.176146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:38.176146+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.176146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:16.851231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'8","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.717778+0000","last_change":"2024-09-12T01:16:36.717778+0000","last_active":"2024-09-12T01:16:36.717778+0000","last_peered":"2024-09-12T01:16:36.717778+0000","last_clean":"2024-09-12T01:16:36.717778+0000","last_became_active":"2024-09-12T00:17:58.357226+0000","last_became_peered":"2024-09-12T00:17:58.357226+0000","last_unstale":"2024-09-12T01:16:36.717778+0000","last_undegraded":"2024-09-12T01:16:36.717778+0000","last_fullsized":"2024-09-12T01:16:36.717778+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:16:36.717693+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:16:36.717693+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.717693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:30.380003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.234052+0000","last_change":"2024-09-12T01:16:24.233987+0000","last_active":"2024-09-12T01:16:24.234052+0000","last_peered":"2024-09-12T01:16:24.234052+0000","last_clean":"2024-09-12T01:16:24.234052+0000","last_became_active":"2024-09-12T00:39:26.638202+0000","last_became_peered":"2024-09-12T00:39:26.638202+0000","last_unstale":"2024-09-12T01:16:24.234052+0000","last_undegraded":"2024-09-12T01:16:24.234052+0000","last_fullsized":"2024-09-12T01:16:24.234052+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.233895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.233895+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.233895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:37.675094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:43.713595+0000","last_change":"2024-09-12T01:16:43.713595+0000","last_active":"2024-09-12T01:16:43.713595+0000","last_peered":"2024-09-12T01:16:43.713595+0000","last_clean":"2024-09-12T01:16:43.713595+0000","last_became_active":"2024-09-12T00:22:02.427762+0000","last_became_peered":"2024-09-12T00:22:02.427762+0000","last_unstale":"2024-09-12T01:16:43.713595+0000","last_undegraded":"2024-09-12T01:16:43.713595+0000","last_fullsized":"2024-09-12T01:16:43.713595+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:43.713502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:43.713502+0000","last_clean_scrub_stamp":"2024-09-12T01:16:43.713502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.949327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"267'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.889851+0000","last_change":"2024-09-12T01:16:39.889851+0000","last_active":"2024-09-12T01:16:39.889851+0000","last_peered":"2024-09-12T01:16:39.889851+0000","last_clean":"2024-09-12T01:16:39.889851+0000","last_became_active":"2024-09-12T00:21:58.338104+0000","last_became_peered":"2024-09-12T00:21:58.338104+0000","last_unstale":"2024-09-12T01:16:39.889851+0000","last_undegraded":"2024-09-12T01:16:39.889851+0000","last_fullsized":"2024-09-12T01:16:39.889851+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:39.889748+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:39.889748+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.889748+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:07.992079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10244,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'33","reported_seq":154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.688308+0000","last_change":"2024-09-12T01:16:35.688205+0000","last_active":"2024-09-12T01:16:35.688308+0000","last_peered":"2024-09-12T01:16:35.688308+0000","last_clean":"2024-09-12T01:16:35.688308+0000","last_became_active":"2024-09-12T00:17:58.351876+0000","last_became_peered":"2024-09-12T00:17:58.351876+0000","last_unstale":"2024-09-12T01:16:35.688308+0000","last_undegraded":"2024-09-12T01:16:35.688308+0000","last_fullsized":"2024-09-12T01:16:35.688308+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-12T01:16:35.688094+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-12T01:16:35.688094+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.688094+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:20.943350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":110,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:48.967733+0000","last_change":"2024-09-12T01:16:48.967733+0000","last_active":"2024-09-12T01:16:48.967733+0000","last_peered":"2024-09-12T01:16:48.967733+0000","last_clean":"2024-09-12T01:16:48.967733+0000","last_became_active":"2024-09-12T00:39:26.639704+0000","last_became_peered":"2024-09-12T00:39:26.639704+0000","last_unstale":"2024-09-12T01:16:48.967733+0000","last_undegraded":"2024-09-12T01:16:48.967733+0000","last_fullsized":"2024-09-12T01:16:48.967733+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:48.967620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:48.967620+0000","last_clean_scrub_stamp":"2024-09-12T01:16:48.967620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:54.727707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'6","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.738041+0000","last_change":"2024-09-12T01:16:42.738041+0000","last_active":"2024-09-12T01:16:42.738041+0000","last_peered":"2024-09-12T01:16:42.738041+0000","last_clean":"2024-09-12T01:16:42.738041+0000","last_became_active":"2024-09-12T00:22:02.430034+0000","last_became_peered":"2024-09-12T00:22:02.430034+0000","last_unstale":"2024-09-12T01:16:42.738041+0000","last_undegraded":"2024-09-12T01:16:42.738041+0000","last_fullsized":"2024-09-12T01:16:42.738041+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:42.737940+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:42.737940+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.737940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:38.606599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.258175+0000","last_change":"2024-09-12T01:16:20.258175+0000","last_active":"2024-09-12T01:16:20.258175+0000","last_peered":"2024-09-12T01:16:20.258175+0000","last_clean":"2024-09-12T01:16:20.258175+0000","last_became_active":"2024-09-12T00:21:58.333135+0000","last_became_peered":"2024-09-12T00:21:58.333135+0000","last_unstale":"2024-09-12T01:16:20.258175+0000","last_undegraded":"2024-09-12T01:16:20.258175+0000","last_fullsized":"2024-09-12T01:16:20.258175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:20.258077+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:20.258077+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.258077+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:41.884363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'34","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.202077+0000","last_change":"2024-09-12T01:16:36.202077+0000","last_active":"2024-09-12T01:16:36.202077+0000","last_peered":"2024-09-12T01:16:36.202077+0000","last_clean":"2024-09-12T01:16:36.202077+0000","last_became_active":"2024-09-12T00:17:58.360064+0000","last_became_peered":"2024-09-12T00:17:58.360064+0000","last_unstale":"2024-09-12T01:16:36.202077+0000","last_undegraded":"2024-09-12T01:16:36.202077+0000","last_fullsized":"2024-09-12T01:16:36.202077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-12T01:16:36.201987+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-12T01:16:36.201987+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.201987+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:09.843005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":114,"num_write":67,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.433034+0000","last_change":"2024-09-12T01:16:33.433034+0000","last_active":"2024-09-12T01:16:33.433034+0000","last_peered":"2024-09-12T01:16:33.433034+0000","last_clean":"2024-09-12T01:16:33.433034+0000","last_became_active":"2024-09-12T00:39:26.620012+0000","last_became_peered":"2024-09-12T00:39:26.620012+0000","last_unstale":"2024-09-12T01:16:33.433034+0000","last_undegraded":"2024-09-12T01:16:33.433034+0000","last_fullsized":"2024-09-12T01:16:33.433034+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:33.432943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:33.432943+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.432943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.218370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.458122+0000","last_change":"2024-09-12T01:16:32.458122+0000","last_active":"2024-09-12T01:16:32.458122+0000","last_peered":"2024-09-12T01:16:32.458122+0000","last_clean":"2024-09-12T01:16:32.458122+0000","last_became_active":"2024-09-12T00:22:02.420536+0000","last_became_peered":"2024-09-12T00:22:02.420536+0000","last_unstale":"2024-09-12T01:16:32.458122+0000","last_undegraded":"2024-09-12T01:16:32.458122+0000","last_fullsized":"2024-09-12T01:16:32.458122+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.458032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.458032+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.458032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:19.110535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.686568+0000","last_change":"2024-09-12T01:16:40.686568+0000","last_active":"2024-09-12T01:16:40.686568+0000","last_peered":"2024-09-12T01:16:40.686568+0000","last_clean":"2024-09-12T01:16:40.686568+0000","last_became_active":"2024-09-12T00:21:58.339390+0000","last_became_peered":"2024-09-12T00:21:58.339390+0000","last_unstale":"2024-09-12T01:16:40.686568+0000","last_undegraded":"2024-09-12T01:16:40.686568+0000","last_fullsized":"2024-09-12T01:16:40.686568+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:40.686467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:40.686467+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.686467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:25.120844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'22","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.334176+0000","last_change":"2024-09-12T01:16:24.334118+0000","last_active":"2024-09-12T01:16:24.334176+0000","last_peered":"2024-09-12T01:16:24.334176+0000","last_clean":"2024-09-12T01:16:24.334176+0000","last_became_active":"2024-09-12T00:17:58.355602+0000","last_became_peered":"2024-09-12T00:17:58.355602+0000","last_unstale":"2024-09-12T01:16:24.334176+0000","last_undegraded":"2024-09-12T01:16:24.334176+0000","last_fullsized":"2024-09-12T01:16:24.334176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-12T01:16:24.334043+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-12T01:16:24.334043+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.334043+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:35.826962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:47.979905+0000","last_change":"2024-09-12T01:16:47.979905+0000","last_active":"2024-09-12T01:16:47.979905+0000","last_peered":"2024-09-12T01:16:47.979905+0000","last_clean":"2024-09-12T01:16:47.979905+0000","last_became_active":"2024-09-12T00:39:26.644190+0000","last_became_peered":"2024-09-12T00:39:26.644190+0000","last_unstale":"2024-09-12T01:16:47.979905+0000","last_undegraded":"2024-09-12T01:16:47.979905+0000","last_fullsized":"2024-09-12T01:16:47.979905+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:47.979740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:47.979740+0000","last_clean_scrub_stamp":"2024-09-12T01:16:47.979740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:25.924065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:44.694235+0000","last_change":"2024-09-12T01:16:44.694235+0000","last_active":"2024-09-12T01:16:44.694235+0000","last_peered":"2024-09-12T01:16:44.694235+0000","last_clean":"2024-09-12T01:16:44.694235+0000","last_became_active":"2024-09-12T00:22:02.429289+0000","last_became_peered":"2024-09-12T00:22:02.429289+0000","last_unstale":"2024-09-12T01:16:44.694235+0000","last_undegraded":"2024-09-12T01:16:44.694235+0000","last_fullsized":"2024-09-12T01:16:44.694235+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:44.694135+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:44.694135+0000","last_clean_scrub_stamp":"2024-09-12T01:16:44.694135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:30.158612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'3","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.371187+0000","last_change":"2024-09-12T01:16:28.371187+0000","last_active":"2024-09-12T01:16:28.371187+0000","last_peered":"2024-09-12T01:16:28.371187+0000","last_clean":"2024-09-12T01:16:28.371187+0000","last_became_active":"2024-09-12T00:21:58.334362+0000","last_became_peered":"2024-09-12T00:21:58.334362+0000","last_unstale":"2024-09-12T01:16:28.371187+0000","last_undegraded":"2024-09-12T01:16:28.371187+0000","last_fullsized":"2024-09-12T01:16:28.371187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:16:28.371086+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:16:28.371086+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.371086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:05.721958+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'50","reported_seq":207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.229496+0000","last_change":"2024-09-12T01:16:16.229433+0000","last_active":"2024-09-12T01:16:16.229496+0000","last_peered":"2024-09-12T01:16:16.229496+0000","last_clean":"2024-09-12T01:16:16.229496+0000","last_became_active":"2024-09-12T00:17:58.353253+0000","last_became_peered":"2024-09-12T00:17:58.353253+0000","last_unstale":"2024-09-12T01:16:16.229496+0000","last_undegraded":"2024-09-12T01:16:16.229496+0000","last_fullsized":"2024-09-12T01:16:16.229496+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'50","last_scrub_stamp":"2024-09-12T01:16:16.229344+0000","last_deep_scrub":"267'50","last_deep_scrub_stamp":"2024-09-12T01:16:16.229344+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.229344+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:06.509012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":79,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:50.721430+0000","last_change":"2024-09-12T01:16:50.721430+0000","last_active":"2024-09-12T01:16:50.721430+0000","last_peered":"2024-09-12T01:16:50.721430+0000","last_clean":"2024-09-12T01:16:50.721430+0000","last_became_active":"2024-09-12T00:39:26.633295+0000","last_became_peered":"2024-09-12T00:39:26.633295+0000","last_unstale":"2024-09-12T01:16:50.721430+0000","last_undegraded":"2024-09-12T01:16:50.721430+0000","last_fullsized":"2024-09-12T01:16:50.721430+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:50.721346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:50.721346+0000","last_clean_scrub_stamp":"2024-09-12T01:16:50.721346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:11.926748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.863570+0000","last_change":"2024-09-12T01:16:39.863570+0000","last_active":"2024-09-12T01:16:39.863570+0000","last_peered":"2024-09-12T01:16:39.863570+0000","last_clean":"2024-09-12T01:16:39.863570+0000","last_became_active":"2024-09-12T00:22:02.429088+0000","last_became_peered":"2024-09-12T00:22:02.429088+0000","last_unstale":"2024-09-12T01:16:39.863570+0000","last_undegraded":"2024-09-12T01:16:39.863570+0000","last_fullsized":"2024-09-12T01:16:39.863570+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:39.863475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:39.863475+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.863475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:48.586996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.663533+0000","last_change":"2024-09-12T01:16:37.663533+0000","last_active":"2024-09-12T01:16:37.663533+0000","last_peered":"2024-09-12T01:16:37.663533+0000","last_clean":"2024-09-12T01:16:37.663533+0000","last_became_active":"2024-09-12T00:21:58.338592+0000","last_became_peered":"2024-09-12T00:21:58.338592+0000","last_unstale":"2024-09-12T01:16:37.663533+0000","last_undegraded":"2024-09-12T01:16:37.663533+0000","last_fullsized":"2024-09-12T01:16:37.663533+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:37.663425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:37.663425+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.663425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:27.716808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'20","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.664247+0000","last_change":"2024-09-12T01:16:32.664247+0000","last_active":"2024-09-12T01:16:32.664247+0000","last_peered":"2024-09-12T01:16:32.664247+0000","last_clean":"2024-09-12T01:16:32.664247+0000","last_became_active":"2024-09-12T00:17:58.357219+0000","last_became_peered":"2024-09-12T00:17:58.357219+0000","last_unstale":"2024-09-12T01:16:32.664247+0000","last_undegraded":"2024-09-12T01:16:32.664247+0000","last_fullsized":"2024-09-12T01:16:32.664247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:16:32.664160+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:16:32.664160+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.664160+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:27.988848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":69,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:50.964335+0000","last_change":"2024-09-12T01:16:50.964335+0000","last_active":"2024-09-12T01:16:50.964335+0000","last_peered":"2024-09-12T01:16:50.964335+0000","last_clean":"2024-09-12T01:16:50.964335+0000","last_became_active":"2024-09-12T00:39:26.643469+0000","last_became_peered":"2024-09-12T00:39:26.643469+0000","last_unstale":"2024-09-12T01:16:50.964335+0000","last_undegraded":"2024-09-12T01:16:50.964335+0000","last_fullsized":"2024-09-12T01:16:50.964335+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:50.964246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:50.964246+0000","last_clean_scrub_stamp":"2024-09-12T01:16:50.964246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:02.004587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.963637+0000","last_change":"2024-09-12T01:16:42.963637+0000","last_active":"2024-09-12T01:16:42.963637+0000","last_peered":"2024-09-12T01:16:42.963637+0000","last_clean":"2024-09-12T01:16:42.963637+0000","last_became_active":"2024-09-12T00:22:02.422532+0000","last_became_peered":"2024-09-12T00:22:02.422532+0000","last_unstale":"2024-09-12T01:16:42.963637+0000","last_undegraded":"2024-09-12T01:16:42.963637+0000","last_fullsized":"2024-09-12T01:16:42.963637+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:16:42.963514+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:16:42.963514+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.963514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:12.283873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.327600+0000","last_change":"2024-09-12T01:16:27.327600+0000","last_active":"2024-09-12T01:16:27.327600+0000","last_peered":"2024-09-12T01:16:27.327600+0000","last_clean":"2024-09-12T01:16:27.327600+0000","last_became_active":"2024-09-12T00:21:58.332715+0000","last_became_peered":"2024-09-12T00:21:58.332715+0000","last_unstale":"2024-09-12T01:16:27.327600+0000","last_undegraded":"2024-09-12T01:16:27.327600+0000","last_fullsized":"2024-09-12T01:16:27.327600+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:27.327505+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:27.327505+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.327505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:27.914435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'12","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.921421+0000","last_change":"2024-09-12T01:16:33.921334+0000","last_active":"2024-09-12T01:16:33.921421+0000","last_peered":"2024-09-12T01:16:33.921421+0000","last_clean":"2024-09-12T01:16:33.921421+0000","last_became_active":"2024-09-12T00:17:58.347709+0000","last_became_peered":"2024-09-12T00:17:58.347709+0000","last_unstale":"2024-09-12T01:16:33.921421+0000","last_undegraded":"2024-09-12T01:16:33.921421+0000","last_fullsized":"2024-09-12T01:16:33.921421+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:16:33.921216+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:16:33.921216+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.921216+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:14.561691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:49.935796+0000","last_change":"2024-09-12T01:16:49.935796+0000","last_active":"2024-09-12T01:16:49.935796+0000","last_peered":"2024-09-12T01:16:49.935796+0000","last_clean":"2024-09-12T01:16:49.935796+0000","last_became_active":"2024-09-12T00:39:26.639094+0000","last_became_peered":"2024-09-12T00:39:26.639094+0000","last_unstale":"2024-09-12T01:16:49.935796+0000","last_undegraded":"2024-09-12T01:16:49.935796+0000","last_fullsized":"2024-09-12T01:16:49.935796+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:49.935710+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:49.935710+0000","last_clean_scrub_stamp":"2024-09-12T01:16:49.935710+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:04.685767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.428970+0000","last_change":"2024-09-12T01:16:31.428970+0000","last_active":"2024-09-12T01:16:31.428970+0000","last_peered":"2024-09-12T01:16:31.428970+0000","last_clean":"2024-09-12T01:16:31.428970+0000","last_became_active":"2024-09-12T00:22:02.422922+0000","last_became_peered":"2024-09-12T00:22:02.422922+0000","last_unstale":"2024-09-12T01:16:31.428970+0000","last_undegraded":"2024-09-12T01:16:31.428970+0000","last_fullsized":"2024-09-12T01:16:31.428970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:31.428871+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:31.428871+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.428871+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:02.156672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.665189+0000","last_change":"2024-09-12T01:16:39.665189+0000","last_active":"2024-09-12T01:16:39.665189+0000","last_peered":"2024-09-12T01:16:39.665189+0000","last_clean":"2024-09-12T01:16:39.665189+0000","last_became_active":"2024-09-12T00:21:58.340910+0000","last_became_peered":"2024-09-12T00:21:58.340910+0000","last_unstale":"2024-09-12T01:16:39.665189+0000","last_undegraded":"2024-09-12T01:16:39.665189+0000","last_fullsized":"2024-09-12T01:16:39.665189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:39.665098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:39.665098+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.665098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:33.548976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'59","reported_seq":228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.651854+0000","last_change":"2024-09-12T01:16:34.651854+0000","last_active":"2024-09-12T01:16:34.651854+0000","last_peered":"2024-09-12T01:16:34.651854+0000","last_clean":"2024-09-12T01:16:34.651854+0000","last_became_active":"2024-09-12T00:17:58.351362+0000","last_became_peered":"2024-09-12T00:17:58.351362+0000","last_unstale":"2024-09-12T01:16:34.651854+0000","last_undegraded":"2024-09-12T01:16:34.651854+0000","last_fullsized":"2024-09-12T01:16:34.651854+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'59","last_scrub_stamp":"2024-09-12T01:16:34.651756+0000","last_deep_scrub":"267'59","last_deep_scrub_stamp":"2024-09-12T01:16:34.651756+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.651756+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:55.939904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":214,"num_write":104,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:51.674527+0000","last_change":"2024-09-12T01:16:51.674527+0000","last_active":"2024-09-12T01:16:51.674527+0000","last_peered":"2024-09-12T01:16:51.674527+0000","last_clean":"2024-09-12T01:16:51.674527+0000","last_became_active":"2024-09-12T00:39:26.631491+0000","last_became_peered":"2024-09-12T00:39:26.631491+0000","last_unstale":"2024-09-12T01:16:51.674527+0000","last_undegraded":"2024-09-12T01:16:51.674527+0000","last_fullsized":"2024-09-12T01:16:51.674527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:51.674440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:51.674440+0000","last_clean_scrub_stamp":"2024-09-12T01:16:51.674440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:18.887352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:44.952881+0000","last_change":"2024-09-12T01:16:44.952881+0000","last_active":"2024-09-12T01:16:44.952881+0000","last_peered":"2024-09-12T01:16:44.952881+0000","last_clean":"2024-09-12T01:16:44.952881+0000","last_became_active":"2024-09-12T00:22:02.430209+0000","last_became_peered":"2024-09-12T00:22:02.430209+0000","last_unstale":"2024-09-12T01:16:44.952881+0000","last_undegraded":"2024-09-12T01:16:44.952881+0000","last_fullsized":"2024-09-12T01:16:44.952881+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:44.952759+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:44.952759+0000","last_clean_scrub_stamp":"2024-09-12T01:16:44.952759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:06.163666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.877239+0000","last_change":"2024-09-12T01:16:32.877239+0000","last_active":"2024-09-12T01:16:32.877239+0000","last_peered":"2024-09-12T01:16:32.877239+0000","last_clean":"2024-09-12T01:16:32.877239+0000","last_became_active":"2024-09-12T00:21:58.339248+0000","last_became_peered":"2024-09-12T00:21:58.339248+0000","last_unstale":"2024-09-12T01:16:32.877239+0000","last_undegraded":"2024-09-12T01:16:32.877239+0000","last_fullsized":"2024-09-12T01:16:32.877239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.877145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.877145+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.877145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:27.966100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'36","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.339033+0000","last_change":"2024-09-12T01:16:21.338959+0000","last_active":"2024-09-12T01:16:21.339033+0000","last_peered":"2024-09-12T01:16:21.339033+0000","last_clean":"2024-09-12T01:16:21.339033+0000","last_became_active":"2024-09-12T00:17:58.358022+0000","last_became_peered":"2024-09-12T00:17:58.358022+0000","last_unstale":"2024-09-12T01:16:21.339033+0000","last_undegraded":"2024-09-12T01:16:21.339033+0000","last_fullsized":"2024-09-12T01:16:21.339033+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-09-12T01:16:21.338872+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-09-12T01:16:21.338872+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.338872+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:40.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":54,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:45.929939+0000","last_change":"2024-09-12T01:16:45.929939+0000","last_active":"2024-09-12T01:16:45.929939+0000","last_peered":"2024-09-12T01:16:45.929939+0000","last_clean":"2024-09-12T01:16:45.929939+0000","last_became_active":"2024-09-12T00:39:26.644935+0000","last_became_peered":"2024-09-12T00:39:26.644935+0000","last_unstale":"2024-09-12T01:16:45.929939+0000","last_undegraded":"2024-09-12T01:16:45.929939+0000","last_fullsized":"2024-09-12T01:16:45.929939+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:45.929842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:45.929842+0000","last_clean_scrub_stamp":"2024-09-12T01:16:45.929842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.011091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:48.611004+0000","last_change":"2024-09-12T01:16:48.611004+0000","last_active":"2024-09-12T01:16:48.611004+0000","last_peered":"2024-09-12T01:16:48.611004+0000","last_clean":"2024-09-12T01:16:48.611004+0000","last_became_active":"2024-09-12T00:22:02.424116+0000","last_became_peered":"2024-09-12T00:22:02.424116+0000","last_unstale":"2024-09-12T01:16:48.611004+0000","last_undegraded":"2024-09-12T01:16:48.611004+0000","last_fullsized":"2024-09-12T01:16:48.611004+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:16:48.610899+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:16:48.610899+0000","last_clean_scrub_stamp":"2024-09-12T01:16:48.610899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:06.705152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'6","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.935455+0000","last_change":"2024-09-12T01:16:38.935455+0000","last_active":"2024-09-12T01:16:38.935455+0000","last_peered":"2024-09-12T01:16:38.935455+0000","last_clean":"2024-09-12T01:16:38.935455+0000","last_became_active":"2024-09-12T00:21:58.331839+0000","last_became_peered":"2024-09-12T00:21:58.331839+0000","last_unstale":"2024-09-12T01:16:38.935455+0000","last_undegraded":"2024-09-12T01:16:38.935455+0000","last_fullsized":"2024-09-12T01:16:38.935455+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:38.935350+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:38.935350+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.935350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:56.869476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'6","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.647193+0000","last_change":"2024-09-12T01:16:33.647193+0000","last_active":"2024-09-12T01:16:33.647193+0000","last_peered":"2024-09-12T01:16:33.647193+0000","last_clean":"2024-09-12T01:16:33.647193+0000","last_became_active":"2024-09-12T00:17:58.354568+0000","last_became_peered":"2024-09-12T00:17:58.354568+0000","last_unstale":"2024-09-12T01:16:33.647193+0000","last_undegraded":"2024-09-12T01:16:33.647193+0000","last_fullsized":"2024-09-12T01:16:33.647193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:16:33.647093+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:16:33.647093+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.647093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:35.308243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:44.167194+0000","last_change":"2024-09-12T01:16:44.167194+0000","last_active":"2024-09-12T01:16:44.167194+0000","last_peered":"2024-09-12T01:16:44.167194+0000","last_clean":"2024-09-12T01:16:44.167194+0000","last_became_active":"2024-09-12T00:39:26.635679+0000","last_became_peered":"2024-09-12T00:39:26.635679+0000","last_unstale":"2024-09-12T01:16:44.167194+0000","last_undegraded":"2024-09-12T01:16:44.167194+0000","last_fullsized":"2024-09-12T01:16:44.167194+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:44.167094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:44.167094+0000","last_clean_scrub_stamp":"2024-09-12T01:16:44.167094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:52.494525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'15","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:45.622786+0000","last_change":"2024-09-12T01:16:45.622786+0000","last_active":"2024-09-12T01:16:45.622786+0000","last_peered":"2024-09-12T01:16:45.622786+0000","last_clean":"2024-09-12T01:16:45.622786+0000","last_became_active":"2024-09-12T00:22:02.420246+0000","last_became_peered":"2024-09-12T00:22:02.420246+0000","last_unstale":"2024-09-12T01:16:45.622786+0000","last_undegraded":"2024-09-12T01:16:45.622786+0000","last_fullsized":"2024-09-12T01:16:45.622786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T01:16:45.622694+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T01:16:45.622694+0000","last_clean_scrub_stamp":"2024-09-12T01:16:45.622694+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:28.415837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.255683+0000","last_change":"2024-09-12T01:16:19.255683+0000","last_active":"2024-09-12T01:16:19.255683+0000","last_peered":"2024-09-12T01:16:19.255683+0000","last_clean":"2024-09-12T01:16:19.255683+0000","last_became_active":"2024-09-12T00:21:58.332362+0000","last_became_peered":"2024-09-12T00:21:58.332362+0000","last_unstale":"2024-09-12T01:16:19.255683+0000","last_undegraded":"2024-09-12T01:16:19.255683+0000","last_fullsized":"2024-09-12T01:16:19.255683+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:16:19.255591+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:16:19.255591+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.255591+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:22.082056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'54","reported_seq":208,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.379318+0000","last_change":"2024-09-12T01:16:22.379248+0000","last_active":"2024-09-12T01:16:22.379318+0000","last_peered":"2024-09-12T01:16:22.379318+0000","last_clean":"2024-09-12T01:16:22.379318+0000","last_became_active":"2024-09-12T00:17:58.356120+0000","last_became_peered":"2024-09-12T00:17:58.356120+0000","last_unstale":"2024-09-12T01:16:22.379318+0000","last_undegraded":"2024-09-12T01:16:22.379318+0000","last_fullsized":"2024-09-12T01:16:22.379318+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'54","last_scrub_stamp":"2024-09-12T01:16:22.379129+0000","last_deep_scrub":"267'54","last_deep_scrub_stamp":"2024-09-12T01:16:22.379129+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.379129+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:19.689178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":175,"num_write":100,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.544177+0000","last_change":"2024-09-12T01:16:35.544177+0000","last_active":"2024-09-12T01:16:35.544177+0000","last_peered":"2024-09-12T01:16:35.544177+0000","last_clean":"2024-09-12T01:16:35.544177+0000","last_became_active":"2024-09-12T00:39:26.624994+0000","last_became_peered":"2024-09-12T00:39:26.624994+0000","last_unstale":"2024-09-12T01:16:35.544177+0000","last_undegraded":"2024-09-12T01:16:35.544177+0000","last_fullsized":"2024-09-12T01:16:35.544177+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:35.544051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:35.544051+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.544051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:01.280277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:43.970286+0000","last_change":"2024-09-12T01:16:43.970286+0000","last_active":"2024-09-12T01:16:43.970286+0000","last_peered":"2024-09-12T01:16:43.970286+0000","last_clean":"2024-09-12T01:16:43.970286+0000","last_became_active":"2024-09-12T00:22:02.424412+0000","last_became_peered":"2024-09-12T00:22:02.424412+0000","last_unstale":"2024-09-12T01:16:43.970286+0000","last_undegraded":"2024-09-12T01:16:43.970286+0000","last_fullsized":"2024-09-12T01:16:43.970286+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:43.970187+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:43.970187+0000","last_clean_scrub_stamp":"2024-09-12T01:16:43.970187+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.315284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.177937+0000","last_change":"2024-09-12T01:16:37.177937+0000","last_active":"2024-09-12T01:16:37.177937+0000","last_peered":"2024-09-12T01:16:37.177937+0000","last_clean":"2024-09-12T01:16:37.177937+0000","last_became_active":"2024-09-12T00:21:58.334536+0000","last_became_peered":"2024-09-12T00:21:58.334536+0000","last_unstale":"2024-09-12T01:16:37.177937+0000","last_undegraded":"2024-09-12T01:16:37.177937+0000","last_fullsized":"2024-09-12T01:16:37.177937+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:37.177816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:37.177816+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.177816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:40.079483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'42","reported_seq":189,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.893081+0000","last_change":"2024-09-12T01:16:31.893081+0000","last_active":"2024-09-12T01:16:31.893081+0000","last_peered":"2024-09-12T01:16:31.893081+0000","last_clean":"2024-09-12T01:16:31.893081+0000","last_became_active":"2024-09-12T00:17:58.353219+0000","last_became_peered":"2024-09-12T00:17:58.353219+0000","last_unstale":"2024-09-12T01:16:31.893081+0000","last_undegraded":"2024-09-12T01:16:31.893081+0000","last_fullsized":"2024-09-12T01:16:31.893081+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:16:31.892979+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:16:31.892979+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.892979+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:55.483672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":151,"num_write":85,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.876316+0000","last_change":"2024-09-12T01:16:42.876316+0000","last_active":"2024-09-12T01:16:42.876316+0000","last_peered":"2024-09-12T01:16:42.876316+0000","last_clean":"2024-09-12T01:16:42.876316+0000","last_became_active":"2024-09-12T00:39:26.638008+0000","last_became_peered":"2024-09-12T00:39:26.638008+0000","last_unstale":"2024-09-12T01:16:42.876316+0000","last_undegraded":"2024-09-12T01:16:42.876316+0000","last_fullsized":"2024-09-12T01:16:42.876316+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:42.876216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:42.876216+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.876216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:19.960666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'3","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.835134+0000","last_change":"2024-09-12T01:16:37.835134+0000","last_active":"2024-09-12T01:16:37.835134+0000","last_peered":"2024-09-12T01:16:37.835134+0000","last_clean":"2024-09-12T01:16:37.835134+0000","last_became_active":"2024-09-12T00:22:02.419443+0000","last_became_peered":"2024-09-12T00:22:02.419443+0000","last_unstale":"2024-09-12T01:16:37.835134+0000","last_undegraded":"2024-09-12T01:16:37.835134+0000","last_fullsized":"2024-09-12T01:16:37.835134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:37.835031+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:37.835031+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.835031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:50.050566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.939809+0000","last_change":"2024-09-12T01:16:41.939809+0000","last_active":"2024-09-12T01:16:41.939809+0000","last_peered":"2024-09-12T01:16:41.939809+0000","last_clean":"2024-09-12T01:16:41.939809+0000","last_became_active":"2024-09-12T00:21:58.335360+0000","last_became_peered":"2024-09-12T00:21:58.335360+0000","last_unstale":"2024-09-12T01:16:41.939809+0000","last_undegraded":"2024-09-12T01:16:41.939809+0000","last_fullsized":"2024-09-12T01:16:41.939809+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:41.939724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:41.939724+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.939724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:37.893755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'111","reported_seq":439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.319503+0000","last_change":"2024-09-12T01:16:24.319503+0000","last_active":"2024-09-12T01:16:24.319503+0000","last_peered":"2024-09-12T01:16:24.319503+0000","last_clean":"2024-09-12T01:16:24.319503+0000","last_became_active":"2024-09-12T00:17:58.355688+0000","last_became_peered":"2024-09-12T00:17:58.355688+0000","last_unstale":"2024-09-12T01:16:24.319503+0000","last_undegraded":"2024-09-12T01:16:24.319503+0000","last_fullsized":"2024-09-12T01:16:24.319503+0000","mapping_epoch":254,"log_start":"267'100","ondisk_log_start":"267'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-12T01:16:24.319420+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-12T01:16:24.319420+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.319420+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:44.709514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":717,"num_read_kb":507,"num_write":143,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4194,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.193803+0000","last_change":"2024-09-12T01:16:23.193803+0000","last_active":"2024-09-12T01:16:23.193803+0000","last_peered":"2024-09-12T01:16:23.193803+0000","last_clean":"2024-09-12T01:16:23.193803+0000","last_became_active":"2024-09-12T00:39:26.637393+0000","last_became_peered":"2024-09-12T00:39:26.637393+0000","last_unstale":"2024-09-12T01:16:23.193803+0000","last_undegraded":"2024-09-12T01:16:23.193803+0000","last_fullsized":"2024-09-12T01:16:23.193803+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:23.193699+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:23.193699+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.193699+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:41.499806+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.413263+0000","last_change":"2024-09-12T01:16:30.413263+0000","last_active":"2024-09-12T01:16:30.413263+0000","last_peered":"2024-09-12T01:16:30.413263+0000","last_clean":"2024-09-12T01:16:30.413263+0000","last_became_active":"2024-09-12T00:22:02.423601+0000","last_became_peered":"2024-09-12T00:22:02.423601+0000","last_unstale":"2024-09-12T01:16:30.413263+0000","last_undegraded":"2024-09-12T01:16:30.413263+0000","last_fullsized":"2024-09-12T01:16:30.413263+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:30.413173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:30.413173+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.413173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:07.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.935181+0000","last_change":"2024-09-12T01:16:36.935181+0000","last_active":"2024-09-12T01:16:36.935181+0000","last_peered":"2024-09-12T01:16:36.935181+0000","last_clean":"2024-09-12T01:16:36.935181+0000","last_became_active":"2024-09-12T00:21:58.339625+0000","last_became_peered":"2024-09-12T00:21:58.339625+0000","last_unstale":"2024-09-12T01:16:36.935181+0000","last_undegraded":"2024-09-12T01:16:36.935181+0000","last_fullsized":"2024-09-12T01:16:36.935181+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:36.935029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:36.935029+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.935029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:15.977188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":189,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.156628+0000","last_change":"2024-09-12T01:16:35.156628+0000","last_active":"2024-09-12T01:16:35.156628+0000","last_peered":"2024-09-12T01:16:35.156628+0000","last_clean":"2024-09-12T01:16:35.156628+0000","last_became_active":"2024-09-12T00:17:58.356906+0000","last_became_peered":"2024-09-12T00:17:58.356906+0000","last_unstale":"2024-09-12T01:16:35.156628+0000","last_undegraded":"2024-09-12T01:16:35.156628+0000","last_fullsized":"2024-09-12T01:16:35.156628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:16:35.156512+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:16:35.156512+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.156512+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:34.815941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":164,"num_write":72,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:49.637341+0000","last_change":"2024-09-12T01:16:49.637341+0000","last_active":"2024-09-12T01:16:49.637341+0000","last_peered":"2024-09-12T01:16:49.637341+0000","last_clean":"2024-09-12T01:16:49.637341+0000","last_became_active":"2024-09-12T00:39:26.628244+0000","last_became_peered":"2024-09-12T00:39:26.628244+0000","last_unstale":"2024-09-12T01:16:49.637341+0000","last_undegraded":"2024-09-12T01:16:49.637341+0000","last_fullsized":"2024-09-12T01:16:49.637341+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:49.637243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:49.637243+0000","last_clean_scrub_stamp":"2024-09-12T01:16:49.637243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:19.034655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.136566+0000","last_change":"2024-09-12T01:16:40.136566+0000","last_active":"2024-09-12T01:16:40.136566+0000","last_peered":"2024-09-12T01:16:40.136566+0000","last_clean":"2024-09-12T01:16:40.136566+0000","last_became_active":"2024-09-12T00:22:02.417237+0000","last_became_peered":"2024-09-12T00:22:02.417237+0000","last_unstale":"2024-09-12T01:16:40.136566+0000","last_undegraded":"2024-09-12T01:16:40.136566+0000","last_fullsized":"2024-09-12T01:16:40.136566+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:16:40.136484+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:16:40.136484+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.136484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:51.291503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.901441+0000","last_change":"2024-09-12T01:16:37.901441+0000","last_active":"2024-09-12T01:16:37.901441+0000","last_peered":"2024-09-12T01:16:37.901441+0000","last_clean":"2024-09-12T01:16:37.901441+0000","last_became_active":"2024-09-12T00:21:58.335541+0000","last_became_peered":"2024-09-12T00:21:58.335541+0000","last_unstale":"2024-09-12T01:16:37.901441+0000","last_undegraded":"2024-09-12T01:16:37.901441+0000","last_fullsized":"2024-09-12T01:16:37.901441+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:37.901354+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:37.901354+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.901354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:28.799591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'21","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.956697+0000","last_change":"2024-09-12T01:16:29.956697+0000","last_active":"2024-09-12T01:16:29.956697+0000","last_peered":"2024-09-12T01:16:29.956697+0000","last_clean":"2024-09-12T01:16:29.956697+0000","last_became_active":"2024-09-12T00:17:58.349428+0000","last_became_peered":"2024-09-12T00:17:58.349428+0000","last_unstale":"2024-09-12T01:16:29.956697+0000","last_undegraded":"2024-09-12T01:16:29.956697+0000","last_fullsized":"2024-09-12T01:16:29.956697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T01:16:29.956611+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T01:16:29.956611+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.956611+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:47.110997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":78,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:46.621594+0000","last_change":"2024-09-12T01:16:46.621594+0000","last_active":"2024-09-12T01:16:46.621594+0000","last_peered":"2024-09-12T01:16:46.621594+0000","last_clean":"2024-09-12T01:16:46.621594+0000","last_became_active":"2024-09-12T00:39:26.641360+0000","last_became_peered":"2024-09-12T00:39:26.641360+0000","last_unstale":"2024-09-12T01:16:46.621594+0000","last_undegraded":"2024-09-12T01:16:46.621594+0000","last_fullsized":"2024-09-12T01:16:46.621594+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:46.621489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:46.621489+0000","last_clean_scrub_stamp":"2024-09-12T01:16:46.621489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:43.539260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.370474+0000","last_change":"2024-09-12T01:16:28.370474+0000","last_active":"2024-09-12T01:16:28.370474+0000","last_peered":"2024-09-12T01:16:28.370474+0000","last_clean":"2024-09-12T01:16:28.370474+0000","last_became_active":"2024-09-12T00:22:02.430041+0000","last_became_peered":"2024-09-12T00:22:02.430041+0000","last_unstale":"2024-09-12T01:16:28.370474+0000","last_undegraded":"2024-09-12T01:16:28.370474+0000","last_fullsized":"2024-09-12T01:16:28.370474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:28.370379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:28.370379+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.370379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:20.727022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.284671+0000","last_change":"2024-09-12T01:16:25.284671+0000","last_active":"2024-09-12T01:16:25.284671+0000","last_peered":"2024-09-12T01:16:25.284671+0000","last_clean":"2024-09-12T01:16:25.284671+0000","last_became_active":"2024-09-12T00:21:58.327094+0000","last_became_peered":"2024-09-12T00:21:58.327094+0000","last_unstale":"2024-09-12T01:16:25.284671+0000","last_undegraded":"2024-09-12T01:16:25.284671+0000","last_fullsized":"2024-09-12T01:16:25.284671+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:25.284582+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:25.284582+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.284582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:40.941677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'15","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.344360+0000","last_change":"2024-09-12T01:16:23.344360+0000","last_active":"2024-09-12T01:16:23.344360+0000","last_peered":"2024-09-12T01:16:23.344360+0000","last_clean":"2024-09-12T01:16:23.344360+0000","last_became_active":"2024-09-12T00:17:58.354797+0000","last_became_peered":"2024-09-12T00:17:58.354797+0000","last_unstale":"2024-09-12T01:16:23.344360+0000","last_undegraded":"2024-09-12T01:16:23.344360+0000","last_fullsized":"2024-09-12T01:16:23.344360+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T01:16:23.344276+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T01:16:23.344276+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.344276+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.699579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:46.949976+0000","last_change":"2024-09-12T01:16:46.949976+0000","last_active":"2024-09-12T01:16:46.949976+0000","last_peered":"2024-09-12T01:16:46.949976+0000","last_clean":"2024-09-12T01:16:46.949976+0000","last_became_active":"2024-09-12T00:39:26.640877+0000","last_became_peered":"2024-09-12T00:39:26.640877+0000","last_unstale":"2024-09-12T01:16:46.949976+0000","last_undegraded":"2024-09-12T01:16:46.949976+0000","last_fullsized":"2024-09-12T01:16:46.949976+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:46.949887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:46.949887+0000","last_clean_scrub_stamp":"2024-09-12T01:16:46.949887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:26.608756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.839692+0000","last_change":"2024-09-12T01:16:38.839692+0000","last_active":"2024-09-12T01:16:38.839692+0000","last_peered":"2024-09-12T01:16:38.839692+0000","last_clean":"2024-09-12T01:16:38.839692+0000","last_became_active":"2024-09-12T00:22:02.418588+0000","last_became_peered":"2024-09-12T00:22:02.418588+0000","last_unstale":"2024-09-12T01:16:38.839692+0000","last_undegraded":"2024-09-12T01:16:38.839692+0000","last_fullsized":"2024-09-12T01:16:38.839692+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:38.839599+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:38.839599+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.839599+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:57.753923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.292266+0000","last_change":"2024-09-12T01:16:26.292266+0000","last_active":"2024-09-12T01:16:26.292266+0000","last_peered":"2024-09-12T01:16:26.292266+0000","last_clean":"2024-09-12T01:16:26.292266+0000","last_became_active":"2024-09-12T00:21:58.331972+0000","last_became_peered":"2024-09-12T00:21:58.331972+0000","last_unstale":"2024-09-12T01:16:26.292266+0000","last_undegraded":"2024-09-12T01:16:26.292266+0000","last_fullsized":"2024-09-12T01:16:26.292266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:16:26.292184+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:16:26.292184+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.292184+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:49.501286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'16","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.891043+0000","last_change":"2024-09-12T01:16:32.891043+0000","last_active":"2024-09-12T01:16:32.891043+0000","last_peered":"2024-09-12T01:16:32.891043+0000","last_clean":"2024-09-12T01:16:32.891043+0000","last_became_active":"2024-09-12T00:17:58.357689+0000","last_became_peered":"2024-09-12T00:17:58.357689+0000","last_unstale":"2024-09-12T01:16:32.891043+0000","last_undegraded":"2024-09-12T01:16:32.891043+0000","last_fullsized":"2024-09-12T01:16:32.891043+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'16","last_scrub_stamp":"2024-09-12T01:16:32.890932+0000","last_deep_scrub":"267'16","last_deep_scrub_stamp":"2024-09-12T01:16:32.890932+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.890932+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.754132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'204","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.772916+0000","last_change":"2024-09-12T01:16:08.772916+0000","last_active":"2024-09-12T01:16:08.772916+0000","last_peered":"2024-09-12T01:16:08.772916+0000","last_clean":"2024-09-12T01:16:08.772916+0000","last_became_active":"2024-09-12T00:02:48.051117+0000","last_became_peered":"2024-09-12T00:02:48.051117+0000","last_unstale":"2024-09-12T01:16:08.772916+0000","last_undegraded":"2024-09-12T01:16:08.772916+0000","last_fullsized":"2024-09-12T01:16:08.772916+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'204","last_scrub_stamp":"2024-09-12T01:16:08.772784+0000","last_deep_scrub":"267'204","last_deep_scrub_stamp":"2024-09-12T01:16:08.772784+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.772784+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:49.188552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342064,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":17555,"num_write":999,"num_write_kb":27178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'739","reported_seq":2138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.217058+0000","last_change":"2024-09-12T01:16:17.217058+0000","last_active":"2024-09-12T01:16:17.217058+0000","last_peered":"2024-09-12T01:16:17.217058+0000","last_clean":"2024-09-12T01:16:17.217058+0000","last_became_active":"2024-09-12T00:02:50.065257+0000","last_became_peered":"2024-09-12T00:02:50.065257+0000","last_unstale":"2024-09-12T01:16:17.217058+0000","last_undegraded":"2024-09-12T01:16:17.217058+0000","last_fullsized":"2024-09-12T01:16:17.217058+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'739","last_scrub_stamp":"2024-09-12T01:16:17.216970+0000","last_deep_scrub":"267'739","last_deep_scrub_stamp":"2024-09-12T01:16:17.216970+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.216970+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:41.588976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3376,"num_read_kb":3036,"num_write":968,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'285","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.132495+0000","last_change":"2024-09-12T01:16:02.132495+0000","last_active":"2024-09-12T01:16:02.132495+0000","last_peered":"2024-09-12T01:16:02.132495+0000","last_clean":"2024-09-12T01:16:02.132495+0000","last_became_active":"2024-09-12T00:02:48.049002+0000","last_became_peered":"2024-09-12T00:02:48.049002+0000","last_unstale":"2024-09-12T01:16:02.132495+0000","last_undegraded":"2024-09-12T01:16:02.132495+0000","last_fullsized":"2024-09-12T01:16:02.132495+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-12T01:16:02.132389+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-12T01:16:02.132389+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.132389+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:19.692843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":975,"num_read_kb":18236,"num_write":1256,"num_write_kb":26545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'696","reported_seq":2340,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.782508+0000","last_change":"2024-09-12T01:16:13.782508+0000","last_active":"2024-09-12T01:16:13.782508+0000","last_peered":"2024-09-12T01:16:13.782508+0000","last_clean":"2024-09-12T01:16:13.782508+0000","last_became_active":"2024-09-12T00:02:50.063612+0000","last_became_peered":"2024-09-12T00:02:50.063612+0000","last_unstale":"2024-09-12T01:16:13.782508+0000","last_undegraded":"2024-09-12T01:16:13.782508+0000","last_fullsized":"2024-09-12T01:16:13.782508+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'696","last_scrub_stamp":"2024-09-12T01:16:13.782407+0000","last_deep_scrub":"267'696","last_deep_scrub_stamp":"2024-09-12T01:16:13.782407+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.782407+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:05.284371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3358,"num_read_kb":3023,"num_write":921,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'219","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.835122+0000","last_change":"2024-09-12T01:16:01.835122+0000","last_active":"2024-09-12T01:16:01.835122+0000","last_peered":"2024-09-12T01:16:01.835122+0000","last_clean":"2024-09-12T01:16:01.835122+0000","last_became_active":"2024-09-12T00:02:48.045960+0000","last_became_peered":"2024-09-12T00:02:48.045960+0000","last_unstale":"2024-09-12T01:16:01.835122+0000","last_undegraded":"2024-09-12T01:16:01.835122+0000","last_fullsized":"2024-09-12T01:16:01.835122+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T01:16:01.835001+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T01:16:01.835001+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.835001+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.564621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1118647,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":21329,"num_write":1072,"num_write_kb":32132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'462","reported_seq":2030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.917023+0000","last_change":"2024-09-12T01:16:12.917023+0000","last_active":"2024-09-12T01:16:12.917023+0000","last_peered":"2024-09-12T01:16:12.917023+0000","last_clean":"2024-09-12T01:16:12.917023+0000","last_became_active":"2024-09-12T00:02:50.060902+0000","last_became_peered":"2024-09-12T00:02:50.060902+0000","last_unstale":"2024-09-12T01:16:12.917023+0000","last_undegraded":"2024-09-12T01:16:12.917023+0000","last_fullsized":"2024-09-12T01:16:12.917023+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'462","last_scrub_stamp":"2024-09-12T01:16:12.916931+0000","last_deep_scrub":"267'462","last_deep_scrub_stamp":"2024-09-12T01:16:12.916931+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.916931+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:30.139448+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2604,"num_read_kb":2455,"num_write":536,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'260","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.248731+0000","last_change":"2024-09-12T01:16:09.248640+0000","last_active":"2024-09-12T01:16:09.248731+0000","last_peered":"2024-09-12T01:16:09.248731+0000","last_clean":"2024-09-12T01:16:09.248731+0000","last_became_active":"2024-09-12T00:02:48.052802+0000","last_became_peered":"2024-09-12T00:02:48.052802+0000","last_unstale":"2024-09-12T01:16:09.248731+0000","last_undegraded":"2024-09-12T01:16:09.248731+0000","last_fullsized":"2024-09-12T01:16:09.248731+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'260","last_scrub_stamp":"2024-09-12T01:16:09.248507+0000","last_deep_scrub":"267'260","last_deep_scrub_stamp":"2024-09-12T01:16:09.248507+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.248507+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.932847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":8609,"num_write":1124,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'1279","reported_seq":2874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.692636+0000","last_change":"2024-09-12T01:16:10.692636+0000","last_active":"2024-09-12T01:16:10.692636+0000","last_peered":"2024-09-12T01:16:10.692636+0000","last_clean":"2024-09-12T01:16:10.692636+0000","last_became_active":"2024-09-12T00:02:50.072574+0000","last_became_peered":"2024-09-12T00:02:50.072574+0000","last_unstale":"2024-09-12T01:16:10.692636+0000","last_undegraded":"2024-09-12T01:16:10.692636+0000","last_fullsized":"2024-09-12T01:16:10.692636+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1279","last_scrub_stamp":"2024-09-12T01:16:10.692530+0000","last_deep_scrub":"267'1279","last_deep_scrub_stamp":"2024-09-12T01:16:10.692530+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.692530+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":1200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:40.321730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5797,"num_read_kb":5069,"num_write":1818,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'162","reported_seq":797,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.708655+0000","last_change":"2024-09-12T01:16:10.708655+0000","last_active":"2024-09-12T01:16:10.708655+0000","last_peered":"2024-09-12T01:16:10.708655+0000","last_clean":"2024-09-12T01:16:10.708655+0000","last_became_active":"2024-09-12T00:02:48.052778+0000","last_became_peered":"2024-09-12T00:02:48.052778+0000","last_unstale":"2024-09-12T01:16:10.708655+0000","last_undegraded":"2024-09-12T01:16:10.708655+0000","last_fullsized":"2024-09-12T01:16:10.708655+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:10.708562+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:10.708562+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.708562+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:36.850671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":373,"num_read_kb":36558,"num_write":790,"num_write_kb":25424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'762","reported_seq":2180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.447646+0000","last_change":"2024-09-12T01:16:08.447646+0000","last_active":"2024-09-12T01:16:08.447646+0000","last_peered":"2024-09-12T01:16:08.447646+0000","last_clean":"2024-09-12T01:16:08.447646+0000","last_became_active":"2024-09-12T00:02:50.062257+0000","last_became_peered":"2024-09-12T00:02:50.062257+0000","last_unstale":"2024-09-12T01:16:08.447646+0000","last_undegraded":"2024-09-12T01:16:08.447646+0000","last_fullsized":"2024-09-12T01:16:08.447646+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-09-12T01:16:08.447540+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-09-12T01:16:08.447540+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.447540+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:13.108811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3047,"num_write":970,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'225","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.223498+0000","last_change":"2024-09-12T01:16:06.223498+0000","last_active":"2024-09-12T01:16:06.223498+0000","last_peered":"2024-09-12T01:16:06.223498+0000","last_clean":"2024-09-12T01:16:06.223498+0000","last_became_active":"2024-09-12T00:02:48.052257+0000","last_became_peered":"2024-09-12T00:02:48.052257+0000","last_unstale":"2024-09-12T01:16:06.223498+0000","last_undegraded":"2024-09-12T01:16:06.223498+0000","last_fullsized":"2024-09-12T01:16:06.223498+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-12T01:16:06.223377+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-12T01:16:06.223377+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.223377+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:59.368626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798278,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":39161,"num_write":992,"num_write_kb":40171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'409","reported_seq":1883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.938341+0000","last_change":"2024-09-12T01:16:17.938341+0000","last_active":"2024-09-12T01:16:17.938341+0000","last_peered":"2024-09-12T01:16:17.938341+0000","last_clean":"2024-09-12T01:16:17.938341+0000","last_became_active":"2024-09-12T00:02:50.060756+0000","last_became_peered":"2024-09-12T00:02:50.060756+0000","last_unstale":"2024-09-12T01:16:17.938341+0000","last_undegraded":"2024-09-12T01:16:17.938341+0000","last_fullsized":"2024-09-12T01:16:17.938341+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-09-12T01:16:17.938263+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-09-12T01:16:17.938263+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.938263+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:29.171795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2108,"num_read_kb":1993,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'193","reported_seq":860,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.759441+0000","last_change":"2024-09-12T01:16:05.759441+0000","last_active":"2024-09-12T01:16:05.759441+0000","last_peered":"2024-09-12T01:16:05.759441+0000","last_clean":"2024-09-12T01:16:05.759441+0000","last_became_active":"2024-09-12T00:03:21.143840+0000","last_became_peered":"2024-09-12T00:03:21.143840+0000","last_unstale":"2024-09-12T01:16:05.759441+0000","last_undegraded":"2024-09-12T01:16:05.759441+0000","last_fullsized":"2024-09-12T01:16:05.759441+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:16:05.759305+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:16:05.759305+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.759305+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:05.625596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":20506,"num_write":998,"num_write_kb":32663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'433","reported_seq":1997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.238800+0000","last_change":"2024-09-12T01:16:16.238800+0000","last_active":"2024-09-12T01:16:16.238800+0000","last_peered":"2024-09-12T01:16:16.238800+0000","last_clean":"2024-09-12T01:16:16.238800+0000","last_became_active":"2024-09-12T00:02:50.064658+0000","last_became_peered":"2024-09-12T00:02:50.064658+0000","last_unstale":"2024-09-12T01:16:16.238800+0000","last_undegraded":"2024-09-12T01:16:16.238800+0000","last_fullsized":"2024-09-12T01:16:16.238800+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'433","last_scrub_stamp":"2024-09-12T01:16:16.238682+0000","last_deep_scrub":"267'433","last_deep_scrub_stamp":"2024-09-12T01:16:16.238682+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.238682+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:40.925562+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":488,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'181","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.718672+0000","last_change":"2024-09-12T01:16:02.718672+0000","last_active":"2024-09-12T01:16:02.718672+0000","last_peered":"2024-09-12T01:16:02.718672+0000","last_clean":"2024-09-12T01:16:02.718672+0000","last_became_active":"2024-09-12T00:02:48.058678+0000","last_became_peered":"2024-09-12T00:02:48.058678+0000","last_unstale":"2024-09-12T01:16:02.718672+0000","last_undegraded":"2024-09-12T01:16:02.718672+0000","last_fullsized":"2024-09-12T01:16:02.718672+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T01:16:02.718561+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T01:16:02.718561+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.718561+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:30.288718+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170390,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1879,"num_write":959,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'893","reported_seq":2468,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.250161+0000","last_change":"2024-09-12T01:16:11.250161+0000","last_active":"2024-09-12T01:16:11.250161+0000","last_peered":"2024-09-12T01:16:11.250161+0000","last_clean":"2024-09-12T01:16:11.250161+0000","last_became_active":"2024-09-12T00:02:50.069840+0000","last_became_peered":"2024-09-12T00:02:50.069840+0000","last_unstale":"2024-09-12T01:16:11.250161+0000","last_undegraded":"2024-09-12T01:16:11.250161+0000","last_fullsized":"2024-09-12T01:16:11.250161+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'893","last_scrub_stamp":"2024-09-12T01:16:11.250063+0000","last_deep_scrub":"267'893","last_deep_scrub_stamp":"2024-09-12T01:16:11.250063+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.250063+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:33.826482+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4122,"num_read_kb":3699,"num_write":1233,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'601","reported_seq":2192,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.878551+0000","last_change":"2024-09-12T01:16:09.878551+0000","last_active":"2024-09-12T01:16:09.878551+0000","last_peered":"2024-09-12T01:16:09.878551+0000","last_clean":"2024-09-12T01:16:09.878551+0000","last_became_active":"2024-09-12T00:02:50.060919+0000","last_became_peered":"2024-09-12T00:02:50.060919+0000","last_unstale":"2024-09-12T01:16:09.878551+0000","last_undegraded":"2024-09-12T01:16:09.878551+0000","last_fullsized":"2024-09-12T01:16:09.878551+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'601","last_scrub_stamp":"2024-09-12T01:16:09.878461+0000","last_deep_scrub":"267'601","last_deep_scrub_stamp":"2024-09-12T01:16:09.878461+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.878461+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:51.104915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3046,"num_read_kb":2788,"num_write":785,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'202","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.738292+0000","last_change":"2024-09-12T01:16:07.738292+0000","last_active":"2024-09-12T01:16:07.738292+0000","last_peered":"2024-09-12T01:16:07.738292+0000","last_clean":"2024-09-12T01:16:07.738292+0000","last_became_active":"2024-09-12T00:02:48.050909+0000","last_became_peered":"2024-09-12T00:02:48.050909+0000","last_unstale":"2024-09-12T01:16:07.738292+0000","last_undegraded":"2024-09-12T01:16:07.738292+0000","last_fullsized":"2024-09-12T01:16:07.738292+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'202","last_scrub_stamp":"2024-09-12T01:16:07.738154+0000","last_deep_scrub":"267'202","last_deep_scrub_stamp":"2024-09-12T01:16:07.738154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.738154+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.887555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":10751,"num_write":911,"num_write_kb":36355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'827","reported_seq":2323,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.741265+0000","last_change":"2024-09-12T01:16:12.741265+0000","last_active":"2024-09-12T01:16:12.741265+0000","last_peered":"2024-09-12T01:16:12.741265+0000","last_clean":"2024-09-12T01:16:12.741265+0000","last_became_active":"2024-09-12T00:02:50.072791+0000","last_became_peered":"2024-09-12T00:02:50.072791+0000","last_unstale":"2024-09-12T01:16:12.741265+0000","last_undegraded":"2024-09-12T01:16:12.741265+0000","last_fullsized":"2024-09-12T01:16:12.741265+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-12T01:16:12.741138+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-12T01:16:12.741138+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.741138+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:18.033096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3382,"num_write":1095,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'201","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.501668+0000","last_change":"2024-09-12T01:16:03.501668+0000","last_active":"2024-09-12T01:16:03.501668+0000","last_peered":"2024-09-12T01:16:03.501668+0000","last_clean":"2024-09-12T01:16:03.501668+0000","last_became_active":"2024-09-12T00:02:48.053452+0000","last_became_peered":"2024-09-12T00:02:48.053452+0000","last_unstale":"2024-09-12T01:16:03.501668+0000","last_undegraded":"2024-09-12T01:16:03.501668+0000","last_fullsized":"2024-09-12T01:16:03.501668+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:16:03.501500+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:16:03.501500+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.501500+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:08.370323+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684145,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":6281,"num_write":1001,"num_write_kb":31607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'859","reported_seq":2564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.283793+0000","last_change":"2024-09-12T01:16:14.283793+0000","last_active":"2024-09-12T01:16:14.283793+0000","last_peered":"2024-09-12T01:16:14.283793+0000","last_clean":"2024-09-12T01:16:14.283793+0000","last_became_active":"2024-09-12T00:02:50.072128+0000","last_became_peered":"2024-09-12T00:02:50.072128+0000","last_unstale":"2024-09-12T01:16:14.283793+0000","last_undegraded":"2024-09-12T01:16:14.283793+0000","last_fullsized":"2024-09-12T01:16:14.283793+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'859","last_scrub_stamp":"2024-09-12T01:16:14.283708+0000","last_deep_scrub":"267'859","last_deep_scrub_stamp":"2024-09-12T01:16:14.283708+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.283708+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:57.648491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4255,"num_read_kb":3837,"num_write":1128,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3450,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'188","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.512321+0000","last_change":"2024-09-12T01:16:01.512321+0000","last_active":"2024-09-12T01:16:01.512321+0000","last_peered":"2024-09-12T01:16:01.512321+0000","last_clean":"2024-09-12T01:16:01.512321+0000","last_became_active":"2024-09-12T00:02:48.059289+0000","last_became_peered":"2024-09-12T00:02:48.059289+0000","last_unstale":"2024-09-12T01:16:01.512321+0000","last_undegraded":"2024-09-12T01:16:01.512321+0000","last_fullsized":"2024-09-12T01:16:01.512321+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'188","last_scrub_stamp":"2024-09-12T01:16:01.512172+0000","last_deep_scrub":"267'188","last_deep_scrub_stamp":"2024-09-12T01:16:01.512172+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.512172+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:19.543793+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342107,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":40439,"num_write":973,"num_write_kb":33156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'1000","reported_seq":2691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.288328+0000","last_change":"2024-09-12T01:16:03.288328+0000","last_active":"2024-09-12T01:16:03.288328+0000","last_peered":"2024-09-12T01:16:03.288328+0000","last_clean":"2024-09-12T01:16:03.288328+0000","last_became_active":"2024-09-12T00:02:50.069775+0000","last_became_peered":"2024-09-12T00:02:50.069775+0000","last_unstale":"2024-09-12T01:16:03.288328+0000","last_undegraded":"2024-09-12T01:16:03.288328+0000","last_fullsized":"2024-09-12T01:16:03.288328+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1000","last_scrub_stamp":"2024-09-12T01:16:03.288239+0000","last_deep_scrub":"267'1000","last_deep_scrub_stamp":"2024-09-12T01:16:03.288239+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.288239+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":900,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:44.983401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4692,"num_read_kb":4217,"num_write":1368,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'201","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.214554+0000","last_change":"2024-09-12T01:15:59.214490+0000","last_active":"2024-09-12T01:15:59.214554+0000","last_peered":"2024-09-12T01:15:59.214554+0000","last_clean":"2024-09-12T01:15:59.214554+0000","last_became_active":"2024-09-12T00:04:21.322881+0000","last_became_peered":"2024-09-12T00:04:21.322881+0000","last_unstale":"2024-09-12T01:15:59.214554+0000","last_undegraded":"2024-09-12T01:15:59.214554+0000","last_fullsized":"2024-09-12T01:15:59.214554+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:15:59.214384+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:15:59.214384+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.214384+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:08.684418+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10550637,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":44397,"num_write":1009,"num_write_kb":26074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"267'851","reported_seq":2426,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.298099+0000","last_change":"2024-09-12T01:16:06.298099+0000","last_active":"2024-09-12T01:16:06.298099+0000","last_peered":"2024-09-12T01:16:06.298099+0000","last_clean":"2024-09-12T01:16:06.298099+0000","last_became_active":"2024-09-12T00:02:50.061055+0000","last_became_peered":"2024-09-12T00:02:50.061055+0000","last_unstale":"2024-09-12T01:16:06.298099+0000","last_undegraded":"2024-09-12T01:16:06.298099+0000","last_fullsized":"2024-09-12T01:16:06.298099+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-12T01:16:06.298021+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-12T01:16:06.298021+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.298021+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:35.804703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3601,"num_write":1146,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'246","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.246926+0000","last_change":"2024-09-12T01:16:00.246926+0000","last_active":"2024-09-12T01:16:00.246926+0000","last_peered":"2024-09-12T01:16:00.246926+0000","last_clean":"2024-09-12T01:16:00.246926+0000","last_became_active":"2024-09-12T00:03:22.073294+0000","last_became_peered":"2024-09-12T00:03:22.073294+0000","last_unstale":"2024-09-12T01:16:00.246926+0000","last_undegraded":"2024-09-12T01:16:00.246926+0000","last_fullsized":"2024-09-12T01:16:00.246926+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-12T01:16:00.246812+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-12T01:16:00.246812+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.246812+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:30.922054+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5592646,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":9461,"num_write":1068,"num_write_kb":47816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"267'877","reported_seq":2509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.919530+0000","last_change":"2024-09-12T01:16:10.919530+0000","last_active":"2024-09-12T01:16:10.919530+0000","last_peered":"2024-09-12T01:16:10.919530+0000","last_clean":"2024-09-12T01:16:10.919530+0000","last_became_active":"2024-09-12T00:02:50.067334+0000","last_became_peered":"2024-09-12T00:02:50.067334+0000","last_unstale":"2024-09-12T01:16:10.919530+0000","last_undegraded":"2024-09-12T01:16:10.919530+0000","last_fullsized":"2024-09-12T01:16:10.919530+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'877","last_scrub_stamp":"2024-09-12T01:16:10.919444+0000","last_deep_scrub":"267'877","last_deep_scrub_stamp":"2024-09-12T01:16:10.919444+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.919444+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:06.787118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4129,"num_read_kb":3712,"num_write":1142,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'242","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.787967+0000","last_change":"2024-09-12T01:16:00.787967+0000","last_active":"2024-09-12T01:16:00.787967+0000","last_peered":"2024-09-12T01:16:00.787967+0000","last_clean":"2024-09-12T01:16:00.787967+0000","last_became_active":"2024-09-12T00:02:48.049926+0000","last_became_peered":"2024-09-12T00:02:48.049926+0000","last_unstale":"2024-09-12T01:16:00.787967+0000","last_undegraded":"2024-09-12T01:16:00.787967+0000","last_fullsized":"2024-09-12T01:16:00.787967+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-12T01:16:00.787782+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-12T01:16:00.787782+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.787782+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.123434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399169,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":41400,"num_write":1181,"num_write_kb":37207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'140","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.982957+0000","last_change":"2024-09-12T01:16:27.982957+0000","last_active":"2024-09-12T01:16:27.982957+0000","last_peered":"2024-09-12T01:16:27.982957+0000","last_clean":"2024-09-12T01:16:27.982957+0000","last_became_active":"2024-09-12T00:02:58.094271+0000","last_became_peered":"2024-09-12T00:02:58.094271+0000","last_unstale":"2024-09-12T01:16:27.982957+0000","last_undegraded":"2024-09-12T01:16:27.982957+0000","last_fullsized":"2024-09-12T01:16:27.982957+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'140","last_scrub_stamp":"2024-09-12T01:16:27.982842+0000","last_deep_scrub":"267'140","last_deep_scrub_stamp":"2024-09-12T01:16:27.982842+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.982842+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:44.482595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":142,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'583","reported_seq":2357,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.701641+0000","last_change":"2024-09-12T01:16:03.701641+0000","last_active":"2024-09-12T01:16:03.701641+0000","last_peered":"2024-09-12T01:16:03.701641+0000","last_clean":"2024-09-12T01:16:03.701641+0000","last_became_active":"2024-09-12T00:02:50.073327+0000","last_became_peered":"2024-09-12T00:02:50.073327+0000","last_unstale":"2024-09-12T01:16:03.701641+0000","last_undegraded":"2024-09-12T01:16:03.701641+0000","last_fullsized":"2024-09-12T01:16:03.701641+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'583","last_scrub_stamp":"2024-09-12T01:16:03.701558+0000","last_deep_scrub":"267'583","last_deep_scrub_stamp":"2024-09-12T01:16:03.701558+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.701558+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:50.578518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3161,"num_read_kb":2955,"num_write":696,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'270","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.760685+0000","last_change":"2024-09-12T01:16:04.760685+0000","last_active":"2024-09-12T01:16:04.760685+0000","last_peered":"2024-09-12T01:16:04.760685+0000","last_clean":"2024-09-12T01:16:04.760685+0000","last_became_active":"2024-09-12T00:03:21.143543+0000","last_became_peered":"2024-09-12T00:03:21.143543+0000","last_unstale":"2024-09-12T01:16:04.760685+0000","last_undegraded":"2024-09-12T01:16:04.760685+0000","last_fullsized":"2024-09-12T01:16:04.760685+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:16:04.760551+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:16:04.760551+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.760551+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:44.290335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":789,"num_read_kb":207403,"num_write":1277,"num_write_kb":65033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.333381+0000","last_change":"2024-09-12T01:16:21.333381+0000","last_active":"2024-09-12T01:16:21.333381+0000","last_peered":"2024-09-12T01:16:21.333381+0000","last_clean":"2024-09-12T01:16:21.333381+0000","last_became_active":"2024-09-12T00:02:52.067288+0000","last_became_peered":"2024-09-12T00:02:52.067288+0000","last_unstale":"2024-09-12T01:16:21.333381+0000","last_undegraded":"2024-09-12T01:16:21.333381+0000","last_fullsized":"2024-09-12T01:16:21.333381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:21.333295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:21.333295+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.333295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:06.501565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'241","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.666793+0000","last_change":"2024-09-12T01:16:17.666793+0000","last_active":"2024-09-12T01:16:17.666793+0000","last_peered":"2024-09-12T01:16:17.666793+0000","last_clean":"2024-09-12T01:16:17.666793+0000","last_became_active":"2024-09-12T00:02:54.070547+0000","last_became_peered":"2024-09-12T00:02:54.070547+0000","last_unstale":"2024-09-12T01:16:17.666793+0000","last_undegraded":"2024-09-12T01:16:17.666793+0000","last_fullsized":"2024-09-12T01:16:17.666793+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-12T01:16:17.666675+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-12T01:16:17.666675+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.666675+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.550527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9977,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":320,"num_read_kb":418,"num_write":196,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.837474+0000","last_change":"2024-09-12T01:16:27.837474+0000","last_active":"2024-09-12T01:16:27.837474+0000","last_peered":"2024-09-12T01:16:27.837474+0000","last_clean":"2024-09-12T01:16:27.837474+0000","last_became_active":"2024-09-12T00:02:56.081086+0000","last_became_peered":"2024-09-12T00:02:56.081086+0000","last_unstale":"2024-09-12T01:16:27.837474+0000","last_undegraded":"2024-09-12T01:16:27.837474+0000","last_fullsized":"2024-09-12T01:16:27.837474+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:27.837373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:27.837373+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.837373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:04.504964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'2435","reported_seq":4352,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.178737+0000","last_change":"2024-09-12T01:16:33.178737+0000","last_active":"2024-09-12T01:16:33.178737+0000","last_peered":"2024-09-12T01:16:33.178737+0000","last_clean":"2024-09-12T01:16:33.178737+0000","last_became_active":"2024-09-12T00:02:58.095948+0000","last_became_peered":"2024-09-12T00:02:58.095948+0000","last_unstale":"2024-09-12T01:16:33.178737+0000","last_undegraded":"2024-09-12T01:16:33.178737+0000","last_fullsized":"2024-09-12T01:16:33.178737+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2435","last_scrub_stamp":"2024-09-12T01:16:33.178632+0000","last_deep_scrub":"267'2435","last_deep_scrub_stamp":"2024-09-12T01:16:33.178632+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.178632+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":2400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:35.648901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6163,"num_read_kb":6149,"num_write":4865,"num_write_kb":1796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'433","reported_seq":1968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.277489+0000","last_change":"2024-09-12T01:16:12.277489+0000","last_active":"2024-09-12T01:16:12.277489+0000","last_peered":"2024-09-12T01:16:12.277489+0000","last_clean":"2024-09-12T01:16:12.277489+0000","last_became_active":"2024-09-12T00:02:50.065654+0000","last_became_peered":"2024-09-12T00:02:50.065654+0000","last_unstale":"2024-09-12T01:16:12.277489+0000","last_undegraded":"2024-09-12T01:16:12.277489+0000","last_fullsized":"2024-09-12T01:16:12.277489+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'433","last_scrub_stamp":"2024-09-12T01:16:12.277405+0000","last_deep_scrub":"267'433","last_deep_scrub_stamp":"2024-09-12T01:16:12.277405+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.277405+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:57.117394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2304,"num_read_kb":2172,"num_write":510,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'198","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.924085+0000","last_change":"2024-09-12T01:15:55.924085+0000","last_active":"2024-09-12T01:15:55.924085+0000","last_peered":"2024-09-12T01:15:55.924085+0000","last_clean":"2024-09-12T01:15:55.924085+0000","last_became_active":"2024-09-12T00:02:48.050499+0000","last_became_peered":"2024-09-12T00:02:48.050499+0000","last_unstale":"2024-09-12T01:15:55.924085+0000","last_undegraded":"2024-09-12T01:15:55.924085+0000","last_fullsized":"2024-09-12T01:15:55.924085+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:15:55.924011+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:15:55.924011+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.924011+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.010889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":23205,"num_write":930,"num_write_kb":52906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.658857+0000","last_change":"2024-09-12T01:16:09.658857+0000","last_active":"2024-09-12T01:16:09.658857+0000","last_peered":"2024-09-12T01:16:09.658857+0000","last_clean":"2024-09-12T01:16:09.658857+0000","last_became_active":"2024-09-12T00:02:52.068519+0000","last_became_peered":"2024-09-12T00:02:52.068519+0000","last_unstale":"2024-09-12T01:16:09.658857+0000","last_undegraded":"2024-09-12T01:16:09.658857+0000","last_fullsized":"2024-09-12T01:16:09.658857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.658760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.658760+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.658760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:31.485302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'119","reported_seq":675,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.979691+0000","last_change":"2024-09-12T01:16:20.979691+0000","last_active":"2024-09-12T01:16:20.979691+0000","last_peered":"2024-09-12T01:16:20.979691+0000","last_clean":"2024-09-12T01:16:20.979691+0000","last_became_active":"2024-09-12T00:02:54.060334+0000","last_became_peered":"2024-09-12T00:02:54.060334+0000","last_unstale":"2024-09-12T01:16:20.979691+0000","last_undegraded":"2024-09-12T01:16:20.979691+0000","last_fullsized":"2024-09-12T01:16:20.979691+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'119","last_scrub_stamp":"2024-09-12T01:16:20.979573+0000","last_deep_scrub":"267'119","last_deep_scrub_stamp":"2024-09-12T01:16:20.979573+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.979573+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:17.324078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.924434+0000","last_change":"2024-09-12T01:16:24.924434+0000","last_active":"2024-09-12T01:16:24.924434+0000","last_peered":"2024-09-12T01:16:24.924434+0000","last_clean":"2024-09-12T01:16:24.924434+0000","last_became_active":"2024-09-12T00:02:56.085222+0000","last_became_peered":"2024-09-12T00:02:56.085222+0000","last_unstale":"2024-09-12T01:16:24.924434+0000","last_undegraded":"2024-09-12T01:16:24.924434+0000","last_fullsized":"2024-09-12T01:16:24.924434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.924316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.924316+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.924316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.301751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'148","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.649202+0000","last_change":"2024-09-12T01:16:30.649202+0000","last_active":"2024-09-12T01:16:30.649202+0000","last_peered":"2024-09-12T01:16:30.649202+0000","last_clean":"2024-09-12T01:16:30.649202+0000","last_became_active":"2024-09-12T00:02:58.094312+0000","last_became_peered":"2024-09-12T00:02:58.094312+0000","last_unstale":"2024-09-12T01:16:30.649202+0000","last_undegraded":"2024-09-12T01:16:30.649202+0000","last_fullsized":"2024-09-12T01:16:30.649202+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'148","last_scrub_stamp":"2024-09-12T01:16:30.649112+0000","last_deep_scrub":"267'148","last_deep_scrub_stamp":"2024-09-12T01:16:30.649112+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.649112+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.047313+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":193,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'830","reported_seq":2439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.807881+0000","last_change":"2024-09-12T01:16:05.807881+0000","last_active":"2024-09-12T01:16:05.807881+0000","last_peered":"2024-09-12T01:16:05.807881+0000","last_clean":"2024-09-12T01:16:05.807881+0000","last_became_active":"2024-09-12T00:02:50.071219+0000","last_became_peered":"2024-09-12T00:02:50.071219+0000","last_unstale":"2024-09-12T01:16:05.807881+0000","last_undegraded":"2024-09-12T01:16:05.807881+0000","last_fullsized":"2024-09-12T01:16:05.807881+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'830","last_scrub_stamp":"2024-09-12T01:16:05.807733+0000","last_deep_scrub":"267'830","last_deep_scrub_stamp":"2024-09-12T01:16:05.807733+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.807733+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:00.465607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4069,"num_read_kb":3661,"num_write":1104,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2553,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'211","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.726231+0000","last_change":"2024-09-12T01:16:01.726231+0000","last_active":"2024-09-12T01:16:01.726231+0000","last_peered":"2024-09-12T01:16:01.726231+0000","last_clean":"2024-09-12T01:16:01.726231+0000","last_became_active":"2024-09-12T00:02:48.059132+0000","last_became_peered":"2024-09-12T00:02:48.059132+0000","last_unstale":"2024-09-12T01:16:01.726231+0000","last_undegraded":"2024-09-12T01:16:01.726231+0000","last_fullsized":"2024-09-12T01:16:01.726231+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'211","last_scrub_stamp":"2024-09-12T01:16:01.726101+0000","last_deep_scrub":"267'211","last_deep_scrub_stamp":"2024-09-12T01:16:01.726101+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.726101+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:47.889650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":5763,"num_write":993,"num_write_kb":32529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.547500+0000","last_change":"2024-09-12T01:16:15.547500+0000","last_active":"2024-09-12T01:16:15.547500+0000","last_peered":"2024-09-12T01:16:15.547500+0000","last_clean":"2024-09-12T01:16:15.547500+0000","last_became_active":"2024-09-12T00:02:52.064216+0000","last_became_peered":"2024-09-12T00:02:52.064216+0000","last_unstale":"2024-09-12T01:16:15.547500+0000","last_undegraded":"2024-09-12T01:16:15.547500+0000","last_fullsized":"2024-09-12T01:16:15.547500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.547409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.547409+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.547409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:49.762131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'162","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.200793+0000","last_change":"2024-09-12T01:16:13.200793+0000","last_active":"2024-09-12T01:16:13.200793+0000","last_peered":"2024-09-12T01:16:13.200793+0000","last_clean":"2024-09-12T01:16:13.200793+0000","last_became_active":"2024-09-12T00:02:54.060501+0000","last_became_peered":"2024-09-12T00:02:54.060501+0000","last_unstale":"2024-09-12T01:16:13.200793+0000","last_undegraded":"2024-09-12T01:16:13.200793+0000","last_fullsized":"2024-09-12T01:16:13.200793+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:13.200687+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:13.200687+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.200687+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:11.033202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":182,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'767","reported_seq":2671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.846701+0000","last_change":"2024-09-12T01:16:26.846701+0000","last_active":"2024-09-12T01:16:26.846701+0000","last_peered":"2024-09-12T01:16:26.846701+0000","last_clean":"2024-09-12T01:16:26.846701+0000","last_became_active":"2024-09-12T00:02:56.087506+0000","last_became_peered":"2024-09-12T00:02:56.087506+0000","last_unstale":"2024-09-12T01:16:26.846701+0000","last_undegraded":"2024-09-12T01:16:26.846701+0000","last_fullsized":"2024-09-12T01:16:26.846701+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'767","last_scrub_stamp":"2024-09-12T01:16:26.846570+0000","last_deep_scrub":"267'767","last_deep_scrub_stamp":"2024-09-12T01:16:26.846570+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.846570+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:02.349841+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.928869+0000","last_change":"2024-09-12T01:16:30.928869+0000","last_active":"2024-09-12T01:16:30.928869+0000","last_peered":"2024-09-12T01:16:30.928869+0000","last_clean":"2024-09-12T01:16:30.928869+0000","last_became_active":"2024-09-12T00:02:58.090424+0000","last_became_peered":"2024-09-12T00:02:58.090424+0000","last_unstale":"2024-09-12T01:16:30.928869+0000","last_undegraded":"2024-09-12T01:16:30.928869+0000","last_fullsized":"2024-09-12T01:16:30.928869+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:16:30.928770+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:16:30.928770+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.928770+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:56.460749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":609,"num_read_kb":603,"num_write":442,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'494","reported_seq":2303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.683501+0000","last_change":"2024-09-12T01:16:04.683501+0000","last_active":"2024-09-12T01:16:04.683501+0000","last_peered":"2024-09-12T01:16:04.683501+0000","last_clean":"2024-09-12T01:16:04.683501+0000","last_became_active":"2024-09-12T00:02:50.067933+0000","last_became_peered":"2024-09-12T00:02:50.067933+0000","last_unstale":"2024-09-12T01:16:04.683501+0000","last_undegraded":"2024-09-12T01:16:04.683501+0000","last_fullsized":"2024-09-12T01:16:04.683501+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-09-12T01:16:04.683410+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-09-12T01:16:04.683410+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.683410+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:55.086027+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2745,"num_read_kb":2618,"num_write":566,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'210","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.550622+0000","last_change":"2024-09-12T01:15:57.550622+0000","last_active":"2024-09-12T01:15:57.550622+0000","last_peered":"2024-09-12T01:15:57.550622+0000","last_clean":"2024-09-12T01:15:57.550622+0000","last_became_active":"2024-09-12T00:02:48.052566+0000","last_became_peered":"2024-09-12T00:02:48.052566+0000","last_unstale":"2024-09-12T01:15:57.550622+0000","last_undegraded":"2024-09-12T01:15:57.550622+0000","last_fullsized":"2024-09-12T01:15:57.550622+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:15:57.550505+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:15:57.550505+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.550505+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.920796+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":572,"num_read_kb":73907,"num_write":996,"num_write_kb":20895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.287740+0000","last_change":"2024-09-12T01:16:20.287740+0000","last_active":"2024-09-12T01:16:20.287740+0000","last_peered":"2024-09-12T01:16:20.287740+0000","last_clean":"2024-09-12T01:16:20.287740+0000","last_became_active":"2024-09-12T00:02:52.066171+0000","last_became_peered":"2024-09-12T00:02:52.066171+0000","last_unstale":"2024-09-12T01:16:20.287740+0000","last_undegraded":"2024-09-12T01:16:20.287740+0000","last_fullsized":"2024-09-12T01:16:20.287740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:20.287615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:20.287615+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.287615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:13.634610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'173","reported_seq":769,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.883046+0000","last_change":"2024-09-12T01:16:22.883046+0000","last_active":"2024-09-12T01:16:22.883046+0000","last_peered":"2024-09-12T01:16:22.883046+0000","last_clean":"2024-09-12T01:16:22.883046+0000","last_became_active":"2024-09-12T00:02:54.239618+0000","last_became_peered":"2024-09-12T00:02:54.239618+0000","last_unstale":"2024-09-12T01:16:22.883046+0000","last_undegraded":"2024-09-12T01:16:22.883046+0000","last_fullsized":"2024-09-12T01:16:22.883046+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-09-12T01:16:22.882915+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-09-12T01:16:22.882915+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.882915+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:17.059053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":308,"num_write":128,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'808","reported_seq":2639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.568661+0000","last_change":"2024-09-12T01:16:27.568661+0000","last_active":"2024-09-12T01:16:27.568661+0000","last_peered":"2024-09-12T01:16:27.568661+0000","last_clean":"2024-09-12T01:16:27.568661+0000","last_became_active":"2024-09-12T00:02:56.082567+0000","last_became_peered":"2024-09-12T00:02:56.082567+0000","last_unstale":"2024-09-12T01:16:27.568661+0000","last_undegraded":"2024-09-12T01:16:27.568661+0000","last_fullsized":"2024-09-12T01:16:27.568661+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'808","last_scrub_stamp":"2024-09-12T01:16:27.568577+0000","last_deep_scrub":"267'808","last_deep_scrub_stamp":"2024-09-12T01:16:27.568577+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.568577+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:18.717470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'364","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.242131+0000","last_change":"2024-09-12T01:16:11.242073+0000","last_active":"2024-09-12T01:16:11.242131+0000","last_peered":"2024-09-12T01:16:11.242131+0000","last_clean":"2024-09-12T01:16:11.242131+0000","last_became_active":"2024-09-12T00:02:50.063707+0000","last_became_peered":"2024-09-12T00:02:50.063707+0000","last_unstale":"2024-09-12T01:16:11.242131+0000","last_undegraded":"2024-09-12T01:16:11.242131+0000","last_fullsized":"2024-09-12T01:16:11.242131+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T01:16:11.241987+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T01:16:11.241987+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.241987+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:49.086172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1902,"num_write":425,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'196","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.757332+0000","last_change":"2024-09-12T01:16:03.757332+0000","last_active":"2024-09-12T01:16:03.757332+0000","last_peered":"2024-09-12T01:16:03.757332+0000","last_clean":"2024-09-12T01:16:03.757332+0000","last_became_active":"2024-09-12T00:02:48.056135+0000","last_became_peered":"2024-09-12T00:02:48.056135+0000","last_unstale":"2024-09-12T01:16:03.757332+0000","last_undegraded":"2024-09-12T01:16:03.757332+0000","last_fullsized":"2024-09-12T01:16:03.757332+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T01:16:03.757211+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T01:16:03.757211+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.757211+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:10.396944+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":40539,"num_write":934,"num_write_kb":46911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.853035+0000","last_change":"2024-09-12T01:16:15.852946+0000","last_active":"2024-09-12T01:16:15.853035+0000","last_peered":"2024-09-12T01:16:15.853035+0000","last_clean":"2024-09-12T01:16:15.853035+0000","last_became_active":"2024-09-12T00:02:52.068747+0000","last_became_peered":"2024-09-12T00:02:52.068747+0000","last_unstale":"2024-09-12T01:16:15.853035+0000","last_undegraded":"2024-09-12T01:16:15.853035+0000","last_fullsized":"2024-09-12T01:16:15.853035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.852843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.852843+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.852843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:15.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'285","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.263662+0000","last_change":"2024-09-12T01:16:25.263604+0000","last_active":"2024-09-12T01:16:25.263662+0000","last_peered":"2024-09-12T01:16:25.263662+0000","last_clean":"2024-09-12T01:16:25.263662+0000","last_became_active":"2024-09-12T00:02:54.239475+0000","last_became_peered":"2024-09-12T00:02:54.239475+0000","last_unstale":"2024-09-12T01:16:25.263662+0000","last_undegraded":"2024-09-12T01:16:25.263662+0000","last_fullsized":"2024-09-12T01:16:25.263662+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-12T01:16:25.263492+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-12T01:16:25.263492+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.263492+0000","objects_scrubbed":10,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:39.629858+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5743,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":380,"num_read_kb":454,"num_write":232,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.295945+0000","last_change":"2024-09-12T01:16:16.295945+0000","last_active":"2024-09-12T01:16:16.295945+0000","last_peered":"2024-09-12T01:16:16.295945+0000","last_clean":"2024-09-12T01:16:16.295945+0000","last_became_active":"2024-09-12T00:02:56.080748+0000","last_became_peered":"2024-09-12T00:02:56.080748+0000","last_unstale":"2024-09-12T01:16:16.295945+0000","last_undegraded":"2024-09-12T01:16:16.295945+0000","last_fullsized":"2024-09-12T01:16:16.295945+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.295864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.295864+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.295864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:13.823929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'530","reported_seq":1354,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.276181+0000","last_change":"2024-09-12T01:16:29.276181+0000","last_active":"2024-09-12T01:16:29.276181+0000","last_peered":"2024-09-12T01:16:29.276181+0000","last_clean":"2024-09-12T01:16:29.276181+0000","last_became_active":"2024-09-12T00:02:58.095311+0000","last_became_peered":"2024-09-12T00:02:58.095311+0000","last_unstale":"2024-09-12T01:16:29.276181+0000","last_undegraded":"2024-09-12T01:16:29.276181+0000","last_fullsized":"2024-09-12T01:16:29.276181+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'530","last_scrub_stamp":"2024-09-12T01:16:29.276083+0000","last_deep_scrub":"267'530","last_deep_scrub_stamp":"2024-09-12T01:16:29.276083+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.276083+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:26.727522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1247,"num_read_kb":1245,"num_write":1070,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'399","reported_seq":1710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.751966+0000","last_change":"2024-09-12T01:16:03.751890+0000","last_active":"2024-09-12T01:16:03.751966+0000","last_peered":"2024-09-12T01:16:03.751966+0000","last_clean":"2024-09-12T01:16:03.751966+0000","last_became_active":"2024-09-12T00:02:50.068223+0000","last_became_peered":"2024-09-12T00:02:50.068223+0000","last_unstale":"2024-09-12T01:16:03.751966+0000","last_undegraded":"2024-09-12T01:16:03.751966+0000","last_fullsized":"2024-09-12T01:16:03.751966+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-12T01:16:03.751752+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-12T01:16:03.751752+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.751752+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:31.247244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1919,"num_read_kb":1778,"num_write":479,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'153","reported_seq":792,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.760986+0000","last_change":"2024-09-12T01:16:00.760986+0000","last_active":"2024-09-12T01:16:00.760986+0000","last_peered":"2024-09-12T01:16:00.760986+0000","last_clean":"2024-09-12T01:16:00.760986+0000","last_became_active":"2024-09-12T00:02:48.055480+0000","last_became_peered":"2024-09-12T00:02:48.055480+0000","last_unstale":"2024-09-12T01:16:00.760986+0000","last_undegraded":"2024-09-12T01:16:00.760986+0000","last_fullsized":"2024-09-12T01:16:00.760986+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-12T01:16:00.760880+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-12T01:16:00.760880+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.760880+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.310424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250607,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":416,"num_read_kb":43431,"num_write":767,"num_write_kb":28983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.264636+0000","last_change":"2024-09-12T01:16:09.264574+0000","last_active":"2024-09-12T01:16:09.264636+0000","last_peered":"2024-09-12T01:16:09.264636+0000","last_clean":"2024-09-12T01:16:09.264636+0000","last_became_active":"2024-09-12T00:02:52.062219+0000","last_became_peered":"2024-09-12T00:02:52.062219+0000","last_unstale":"2024-09-12T01:16:09.264636+0000","last_undegraded":"2024-09-12T01:16:09.264636+0000","last_fullsized":"2024-09-12T01:16:09.264636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.264489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.264489+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.264489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:41.480353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'161","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.553910+0000","last_change":"2024-09-12T01:16:17.553910+0000","last_active":"2024-09-12T01:16:17.553910+0000","last_peered":"2024-09-12T01:16:17.553910+0000","last_clean":"2024-09-12T01:16:17.553910+0000","last_became_active":"2024-09-12T00:02:54.069656+0000","last_became_peered":"2024-09-12T00:02:54.069656+0000","last_unstale":"2024-09-12T01:16:17.553910+0000","last_undegraded":"2024-09-12T01:16:17.553910+0000","last_fullsized":"2024-09-12T01:16:17.553910+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:16:17.553833+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:16:17.553833+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.553833+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:30.758345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9092,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":201,"num_read_kb":271,"num_write":108,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.572092+0000","last_change":"2024-09-12T01:16:23.572021+0000","last_active":"2024-09-12T01:16:23.572092+0000","last_peered":"2024-09-12T01:16:23.572092+0000","last_clean":"2024-09-12T01:16:23.572092+0000","last_became_active":"2024-09-12T00:02:56.081804+0000","last_became_peered":"2024-09-12T00:02:56.081804+0000","last_unstale":"2024-09-12T01:16:23.572092+0000","last_undegraded":"2024-09-12T01:16:23.572092+0000","last_fullsized":"2024-09-12T01:16:23.572092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.571932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.571932+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.571932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:03.164700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'122","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.394034+0000","last_change":"2024-09-12T01:16:18.394034+0000","last_active":"2024-09-12T01:16:18.394034+0000","last_peered":"2024-09-12T01:16:18.394034+0000","last_clean":"2024-09-12T01:16:18.394034+0000","last_became_active":"2024-09-12T00:02:58.095068+0000","last_became_peered":"2024-09-12T00:02:58.095068+0000","last_unstale":"2024-09-12T01:16:18.394034+0000","last_undegraded":"2024-09-12T01:16:18.394034+0000","last_fullsized":"2024-09-12T01:16:18.394034+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-09-12T01:16:18.393945+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-09-12T01:16:18.393945+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.393945+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:24.673992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":135,"num_write":297,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'897","reported_seq":2428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.517789+0000","last_change":"2024-09-12T01:16:05.517733+0000","last_active":"2024-09-12T01:16:05.517789+0000","last_peered":"2024-09-12T01:16:05.517789+0000","last_clean":"2024-09-12T01:16:05.517789+0000","last_became_active":"2024-09-12T00:02:50.078033+0000","last_became_peered":"2024-09-12T00:02:50.078033+0000","last_unstale":"2024-09-12T01:16:05.517789+0000","last_undegraded":"2024-09-12T01:16:05.517789+0000","last_fullsized":"2024-09-12T01:16:05.517789+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'897","last_scrub_stamp":"2024-09-12T01:16:05.517647+0000","last_deep_scrub":"267'897","last_deep_scrub_stamp":"2024-09-12T01:16:05.517647+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.517647+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:04.806609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4128,"num_read_kb":3671,"num_write":1209,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'185","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.716184+0000","last_change":"2024-09-12T01:15:59.716184+0000","last_active":"2024-09-12T01:15:59.716184+0000","last_peered":"2024-09-12T01:15:59.716184+0000","last_clean":"2024-09-12T01:15:59.716184+0000","last_became_active":"2024-09-12T00:02:48.048973+0000","last_became_peered":"2024-09-12T00:02:48.048973+0000","last_unstale":"2024-09-12T01:15:59.716184+0000","last_undegraded":"2024-09-12T01:15:59.716184+0000","last_fullsized":"2024-09-12T01:15:59.716184+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:59.716068+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:59.716068+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.716068+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:27.806731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":6868,"num_write":918,"num_write_kb":34085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.262229+0000","last_change":"2024-09-12T01:16:10.262229+0000","last_active":"2024-09-12T01:16:10.262229+0000","last_peered":"2024-09-12T01:16:10.262229+0000","last_clean":"2024-09-12T01:16:10.262229+0000","last_became_active":"2024-09-12T00:02:52.065809+0000","last_became_peered":"2024-09-12T00:02:52.065809+0000","last_unstale":"2024-09-12T01:16:10.262229+0000","last_undegraded":"2024-09-12T01:16:10.262229+0000","last_fullsized":"2024-09-12T01:16:10.262229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.262136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.262136+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.262136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:54.718660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'220","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.905259+0000","last_change":"2024-09-12T01:16:19.905198+0000","last_active":"2024-09-12T01:16:19.905259+0000","last_peered":"2024-09-12T01:16:19.905259+0000","last_clean":"2024-09-12T01:16:19.905259+0000","last_became_active":"2024-09-12T00:02:54.066781+0000","last_became_peered":"2024-09-12T00:02:54.066781+0000","last_unstale":"2024-09-12T01:16:19.905259+0000","last_undegraded":"2024-09-12T01:16:19.905259+0000","last_fullsized":"2024-09-12T01:16:19.905259+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-12T01:16:19.905107+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-12T01:16:19.905107+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.905107+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:53.442084+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":282,"num_read_kb":329,"num_write":166,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'795","reported_seq":2827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.649273+0000","last_change":"2024-09-12T01:16:21.649211+0000","last_active":"2024-09-12T01:16:21.649273+0000","last_peered":"2024-09-12T01:16:21.649273+0000","last_clean":"2024-09-12T01:16:21.649273+0000","last_became_active":"2024-09-12T00:02:56.086692+0000","last_became_peered":"2024-09-12T00:02:56.086692+0000","last_unstale":"2024-09-12T01:16:21.649273+0000","last_undegraded":"2024-09-12T01:16:21.649273+0000","last_fullsized":"2024-09-12T01:16:21.649273+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'795","last_scrub_stamp":"2024-09-12T01:16:21.649118+0000","last_deep_scrub":"267'795","last_deep_scrub_stamp":"2024-09-12T01:16:21.649118+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.649118+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:17.175987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'116","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.584261+0000","last_change":"2024-09-12T01:16:26.584201+0000","last_active":"2024-09-12T01:16:26.584261+0000","last_peered":"2024-09-12T01:16:26.584261+0000","last_clean":"2024-09-12T01:16:26.584261+0000","last_became_active":"2024-09-12T00:02:58.093419+0000","last_became_peered":"2024-09-12T00:02:58.093419+0000","last_unstale":"2024-09-12T01:16:26.584261+0000","last_undegraded":"2024-09-12T01:16:26.584261+0000","last_fullsized":"2024-09-12T01:16:26.584261+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-12T01:16:26.584111+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-12T01:16:26.584111+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.584111+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:04.476681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":298,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'401","reported_seq":2002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.792877+0000","last_change":"2024-09-12T01:16:04.792877+0000","last_active":"2024-09-12T01:16:04.792877+0000","last_peered":"2024-09-12T01:16:04.792877+0000","last_clean":"2024-09-12T01:16:04.792877+0000","last_became_active":"2024-09-12T00:02:50.073986+0000","last_became_peered":"2024-09-12T00:02:50.073986+0000","last_unstale":"2024-09-12T01:16:04.792877+0000","last_undegraded":"2024-09-12T01:16:04.792877+0000","last_fullsized":"2024-09-12T01:16:04.792877+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T01:16:04.792766+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T01:16:04.792766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.792766+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:59.004193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2369,"num_read_kb":2271,"num_write":449,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'218","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.185384+0000","last_change":"2024-09-12T01:15:57.185384+0000","last_active":"2024-09-12T01:15:57.185384+0000","last_peered":"2024-09-12T01:15:57.185384+0000","last_clean":"2024-09-12T01:15:57.185384+0000","last_became_active":"2024-09-12T00:02:48.051190+0000","last_became_peered":"2024-09-12T00:02:48.051190+0000","last_unstale":"2024-09-12T01:15:57.185384+0000","last_undegraded":"2024-09-12T01:15:57.185384+0000","last_fullsized":"2024-09-12T01:15:57.185384+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:15:57.185281+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:15:57.185281+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.185281+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.188053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":21060,"num_write":1056,"num_write_kb":24204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.288309+0000","last_change":"2024-09-12T01:16:07.288239+0000","last_active":"2024-09-12T01:16:07.288309+0000","last_peered":"2024-09-12T01:16:07.288309+0000","last_clean":"2024-09-12T01:16:07.288309+0000","last_became_active":"2024-09-12T00:02:52.056676+0000","last_became_peered":"2024-09-12T00:02:52.056676+0000","last_unstale":"2024-09-12T01:16:07.288309+0000","last_undegraded":"2024-09-12T01:16:07.288309+0000","last_fullsized":"2024-09-12T01:16:07.288309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:07.288154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:07.288154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.288154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.787901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'230","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.671376+0000","last_change":"2024-09-12T01:16:15.671311+0000","last_active":"2024-09-12T01:16:15.671376+0000","last_peered":"2024-09-12T01:16:15.671376+0000","last_clean":"2024-09-12T01:16:15.671376+0000","last_became_active":"2024-09-12T00:02:54.066994+0000","last_became_peered":"2024-09-12T00:02:54.066994+0000","last_unstale":"2024-09-12T01:16:15.671376+0000","last_undegraded":"2024-09-12T01:16:15.671376+0000","last_fullsized":"2024-09-12T01:16:15.671376+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-12T01:16:15.671217+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-12T01:16:15.671217+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.671217+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:53.817921+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10683,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":318,"num_read_kb":432,"num_write":164,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.174390+0000","last_change":"2024-09-12T01:16:14.174290+0000","last_active":"2024-09-12T01:16:14.174390+0000","last_peered":"2024-09-12T01:16:14.174390+0000","last_clean":"2024-09-12T01:16:14.174390+0000","last_became_active":"2024-09-12T00:02:56.078740+0000","last_became_peered":"2024-09-12T00:02:56.078740+0000","last_unstale":"2024-09-12T01:16:14.174390+0000","last_undegraded":"2024-09-12T01:16:14.174390+0000","last_fullsized":"2024-09-12T01:16:14.174390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.174189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.174189+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.174189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:29.216963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'110","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.272970+0000","last_change":"2024-09-12T01:16:23.272871+0000","last_active":"2024-09-12T01:16:23.272970+0000","last_peered":"2024-09-12T01:16:23.272970+0000","last_clean":"2024-09-12T01:16:23.272970+0000","last_became_active":"2024-09-12T00:02:58.092520+0000","last_became_peered":"2024-09-12T00:02:58.092520+0000","last_unstale":"2024-09-12T01:16:23.272970+0000","last_undegraded":"2024-09-12T01:16:23.272970+0000","last_fullsized":"2024-09-12T01:16:23.272970+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'110","last_scrub_stamp":"2024-09-12T01:16:23.272757+0000","last_deep_scrub":"267'110","last_deep_scrub_stamp":"2024-09-12T01:16:23.272757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.272757+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.827113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":241,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'522","reported_seq":2244,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.702966+0000","last_change":"2024-09-12T01:15:57.702966+0000","last_active":"2024-09-12T01:15:57.702966+0000","last_peered":"2024-09-12T01:15:57.702966+0000","last_clean":"2024-09-12T01:15:57.702966+0000","last_became_active":"2024-09-12T00:02:50.068691+0000","last_became_peered":"2024-09-12T00:02:50.068691+0000","last_unstale":"2024-09-12T01:15:57.702966+0000","last_undegraded":"2024-09-12T01:15:57.702966+0000","last_fullsized":"2024-09-12T01:15:57.702966+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'522","last_scrub_stamp":"2024-09-12T01:15:57.702886+0000","last_deep_scrub":"267'522","last_deep_scrub_stamp":"2024-09-12T01:15:57.702886+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.702886+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:32.128046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2837,"num_read_kb":2668,"num_write":620,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'204","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.771129+0000","last_change":"2024-09-12T01:15:57.771129+0000","last_active":"2024-09-12T01:15:57.771129+0000","last_peered":"2024-09-12T01:15:57.771129+0000","last_clean":"2024-09-12T01:15:57.771129+0000","last_became_active":"2024-09-12T00:02:48.050513+0000","last_became_peered":"2024-09-12T00:02:48.050513+0000","last_unstale":"2024-09-12T01:15:57.771129+0000","last_undegraded":"2024-09-12T01:15:57.771129+0000","last_fullsized":"2024-09-12T01:15:57.771129+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'204","last_scrub_stamp":"2024-09-12T01:15:57.771000+0000","last_deep_scrub":"267'204","last_deep_scrub_stamp":"2024-09-12T01:15:57.771000+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.771000+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:32.870808+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342067,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":923,"num_read_kb":76851,"num_write":1040,"num_write_kb":50138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.275148+0000","last_change":"2024-09-12T01:16:08.275148+0000","last_active":"2024-09-12T01:16:08.275148+0000","last_peered":"2024-09-12T01:16:08.275148+0000","last_clean":"2024-09-12T01:16:08.275148+0000","last_became_active":"2024-09-12T00:02:52.064333+0000","last_became_peered":"2024-09-12T00:02:52.064333+0000","last_unstale":"2024-09-12T01:16:08.275148+0000","last_undegraded":"2024-09-12T01:16:08.275148+0000","last_fullsized":"2024-09-12T01:16:08.275148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:08.275061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:08.275061+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.275061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:43.190059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'182","reported_seq":793,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.987536+0000","last_change":"2024-09-12T01:16:19.987536+0000","last_active":"2024-09-12T01:16:19.987536+0000","last_peered":"2024-09-12T01:16:19.987536+0000","last_clean":"2024-09-12T01:16:19.987536+0000","last_became_active":"2024-09-12T00:02:54.068732+0000","last_became_peered":"2024-09-12T00:02:54.068732+0000","last_unstale":"2024-09-12T01:16:19.987536+0000","last_undegraded":"2024-09-12T01:16:19.987536+0000","last_fullsized":"2024-09-12T01:16:19.987536+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'182","last_scrub_stamp":"2024-09-12T01:16:19.987427+0000","last_deep_scrub":"267'182","last_deep_scrub_stamp":"2024-09-12T01:16:19.987427+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.987427+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:27.573352+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":259,"num_read_kb":329,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.610657+0000","last_change":"2024-09-12T01:16:22.610657+0000","last_active":"2024-09-12T01:16:22.610657+0000","last_peered":"2024-09-12T01:16:22.610657+0000","last_clean":"2024-09-12T01:16:22.610657+0000","last_became_active":"2024-09-12T00:02:56.088527+0000","last_became_peered":"2024-09-12T00:02:56.088527+0000","last_unstale":"2024-09-12T01:16:22.610657+0000","last_undegraded":"2024-09-12T01:16:22.610657+0000","last_fullsized":"2024-09-12T01:16:22.610657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:22.610554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:22.610554+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.610554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:15.716696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'113","reported_seq":627,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.629020+0000","last_change":"2024-09-12T01:16:29.629020+0000","last_active":"2024-09-12T01:16:29.629020+0000","last_peered":"2024-09-12T01:16:29.629020+0000","last_clean":"2024-09-12T01:16:29.629020+0000","last_became_active":"2024-09-12T00:02:58.100726+0000","last_became_peered":"2024-09-12T00:02:58.100726+0000","last_unstale":"2024-09-12T01:16:29.629020+0000","last_undegraded":"2024-09-12T01:16:29.629020+0000","last_fullsized":"2024-09-12T01:16:29.629020+0000","mapping_epoch":36,"log_start":"267'101","ondisk_log_start":"267'101","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T01:16:29.628930+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T01:16:29.628930+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.628930+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:01.386299+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":109,"num_write":270,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'822","reported_seq":2447,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.677185+0000","last_change":"2024-09-12T01:16:00.677185+0000","last_active":"2024-09-12T01:16:00.677185+0000","last_peered":"2024-09-12T01:16:00.677185+0000","last_clean":"2024-09-12T01:16:00.677185+0000","last_became_active":"2024-09-12T00:02:50.059646+0000","last_became_peered":"2024-09-12T00:02:50.059646+0000","last_unstale":"2024-09-12T01:16:00.677185+0000","last_undegraded":"2024-09-12T01:16:00.677185+0000","last_fullsized":"2024-09-12T01:16:00.677185+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'822","last_scrub_stamp":"2024-09-12T01:16:00.677097+0000","last_deep_scrub":"267'822","last_deep_scrub_stamp":"2024-09-12T01:16:00.677097+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.677097+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:43.127120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3626,"num_write":1074,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'218","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.584277+0000","last_change":"2024-09-12T01:15:56.584216+0000","last_active":"2024-09-12T01:15:56.584277+0000","last_peered":"2024-09-12T01:15:56.584277+0000","last_clean":"2024-09-12T01:15:56.584277+0000","last_became_active":"2024-09-12T00:02:48.046424+0000","last_became_peered":"2024-09-12T00:02:48.046424+0000","last_unstale":"2024-09-12T01:15:56.584277+0000","last_undegraded":"2024-09-12T01:15:56.584277+0000","last_fullsized":"2024-09-12T01:15:56.584277+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:15:56.584071+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:15:56.584071+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.584071+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:34.930249+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":142057,"num_write":895,"num_write_kb":42631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.169805+0000","last_change":"2024-09-12T01:16:10.169805+0000","last_active":"2024-09-12T01:16:10.169805+0000","last_peered":"2024-09-12T01:16:10.169805+0000","last_clean":"2024-09-12T01:16:10.169805+0000","last_became_active":"2024-09-12T00:02:52.063641+0000","last_became_peered":"2024-09-12T00:02:52.063641+0000","last_unstale":"2024-09-12T01:16:10.169805+0000","last_undegraded":"2024-09-12T01:16:10.169805+0000","last_fullsized":"2024-09-12T01:16:10.169805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.169703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.169703+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.169703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:33.997915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'192","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.214623+0000","last_change":"2024-09-12T01:16:12.214623+0000","last_active":"2024-09-12T01:16:12.214623+0000","last_peered":"2024-09-12T01:16:12.214623+0000","last_clean":"2024-09-12T01:16:12.214623+0000","last_became_active":"2024-09-12T00:02:54.067328+0000","last_became_peered":"2024-09-12T00:02:54.067328+0000","last_unstale":"2024-09-12T01:16:12.214623+0000","last_undegraded":"2024-09-12T01:16:12.214623+0000","last_fullsized":"2024-09-12T01:16:12.214623+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-12T01:16:12.214526+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-12T01:16:12.214526+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.214526+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:31.671601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":308,"num_write":148,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'744","reported_seq":2626,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.218202+0000","last_change":"2024-09-12T01:16:15.218202+0000","last_active":"2024-09-12T01:16:15.218202+0000","last_peered":"2024-09-12T01:16:15.218202+0000","last_clean":"2024-09-12T01:16:15.218202+0000","last_became_active":"2024-09-12T00:02:56.079167+0000","last_became_peered":"2024-09-12T00:02:56.079167+0000","last_unstale":"2024-09-12T01:16:15.218202+0000","last_undegraded":"2024-09-12T01:16:15.218202+0000","last_fullsized":"2024-09-12T01:16:15.218202+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'744","last_scrub_stamp":"2024-09-12T01:16:15.218093+0000","last_deep_scrub":"267'744","last_deep_scrub_stamp":"2024-09-12T01:16:15.218093+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.218093+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:12.282880+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.305272+0000","last_change":"2024-09-12T01:16:20.305272+0000","last_active":"2024-09-12T01:16:20.305272+0000","last_peered":"2024-09-12T01:16:20.305272+0000","last_clean":"2024-09-12T01:16:20.305272+0000","last_became_active":"2024-09-12T00:02:58.097332+0000","last_became_peered":"2024-09-12T00:02:58.097332+0000","last_unstale":"2024-09-12T01:16:20.305272+0000","last_undegraded":"2024-09-12T01:16:20.305272+0000","last_fullsized":"2024-09-12T01:16:20.305272+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'128","last_scrub_stamp":"2024-09-12T01:16:20.305137+0000","last_deep_scrub":"267'128","last_deep_scrub_stamp":"2024-09-12T01:16:20.305137+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.305137+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:42.624853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'387","reported_seq":2005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.709242+0000","last_change":"2024-09-12T01:15:59.709242+0000","last_active":"2024-09-12T01:15:59.709242+0000","last_peered":"2024-09-12T01:15:59.709242+0000","last_clean":"2024-09-12T01:15:59.709242+0000","last_became_active":"2024-09-12T00:02:50.063676+0000","last_became_peered":"2024-09-12T00:02:50.063676+0000","last_unstale":"2024-09-12T01:15:59.709242+0000","last_undegraded":"2024-09-12T01:15:59.709242+0000","last_fullsized":"2024-09-12T01:15:59.709242+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-09-12T01:15:59.709154+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-09-12T01:15:59.709154+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.709154+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:48.504412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2187,"num_read_kb":2115,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'185","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.700248+0000","last_change":"2024-09-12T01:15:58.700181+0000","last_active":"2024-09-12T01:15:58.700248+0000","last_peered":"2024-09-12T01:15:58.700248+0000","last_clean":"2024-09-12T01:15:58.700248+0000","last_became_active":"2024-09-12T00:02:48.046457+0000","last_became_peered":"2024-09-12T00:02:48.046457+0000","last_unstale":"2024-09-12T01:15:58.700248+0000","last_undegraded":"2024-09-12T01:15:58.700248+0000","last_fullsized":"2024-09-12T01:15:58.700248+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:58.700097+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:58.700097+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.700097+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:20.069674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":408,"num_read_kb":52839,"num_write":877,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1465,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.244747+0000","last_change":"2024-09-12T01:16:19.244747+0000","last_active":"2024-09-12T01:16:19.244747+0000","last_peered":"2024-09-12T01:16:19.244747+0000","last_clean":"2024-09-12T01:16:19.244747+0000","last_became_active":"2024-09-12T00:02:52.068535+0000","last_became_peered":"2024-09-12T00:02:52.068535+0000","last_unstale":"2024-09-12T01:16:19.244747+0000","last_undegraded":"2024-09-12T01:16:19.244747+0000","last_fullsized":"2024-09-12T01:16:19.244747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:16:19.244653+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:16:19.244653+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.244653+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:05.379037+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'108","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.637945+0000","last_change":"2024-09-12T01:16:11.637945+0000","last_active":"2024-09-12T01:16:11.637945+0000","last_peered":"2024-09-12T01:16:11.637945+0000","last_clean":"2024-09-12T01:16:11.637945+0000","last_became_active":"2024-09-12T00:02:54.239924+0000","last_became_peered":"2024-09-12T00:02:54.239924+0000","last_unstale":"2024-09-12T01:16:11.637945+0000","last_undegraded":"2024-09-12T01:16:11.637945+0000","last_fullsized":"2024-09-12T01:16:11.637945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'108","last_scrub_stamp":"2024-09-12T01:16:11.637836+0000","last_deep_scrub":"267'108","last_deep_scrub_stamp":"2024-09-12T01:16:11.637836+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.637836+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:14.647602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":4504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.454795+0000","last_change":"2024-09-12T01:16:14.454795+0000","last_active":"2024-09-12T01:16:14.454795+0000","last_peered":"2024-09-12T01:16:14.454795+0000","last_clean":"2024-09-12T01:16:14.454795+0000","last_became_active":"2024-09-12T00:02:56.086668+0000","last_became_peered":"2024-09-12T00:02:56.086668+0000","last_unstale":"2024-09-12T01:16:14.454795+0000","last_undegraded":"2024-09-12T01:16:14.454795+0000","last_fullsized":"2024-09-12T01:16:14.454795+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'773","last_scrub_stamp":"2024-09-12T01:16:14.454708+0000","last_deep_scrub":"267'773","last_deep_scrub_stamp":"2024-09-12T01:16:14.454708+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.454708+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:26.916302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'150","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.955992+0000","last_change":"2024-09-12T01:16:26.955992+0000","last_active":"2024-09-12T01:16:26.955992+0000","last_peered":"2024-09-12T01:16:26.955992+0000","last_clean":"2024-09-12T01:16:26.955992+0000","last_became_active":"2024-09-12T00:02:58.097435+0000","last_became_peered":"2024-09-12T00:02:58.097435+0000","last_unstale":"2024-09-12T01:16:26.955992+0000","last_undegraded":"2024-09-12T01:16:26.955992+0000","last_fullsized":"2024-09-12T01:16:26.955992+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'150","last_scrub_stamp":"2024-09-12T01:16:26.955889+0000","last_deep_scrub":"267'150","last_deep_scrub_stamp":"2024-09-12T01:16:26.955889+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.955889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:30.719695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":180,"num_write":378,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'763","reported_seq":2624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.126650+0000","last_change":"2024-09-12T01:16:05.126650+0000","last_active":"2024-09-12T01:16:05.126650+0000","last_peered":"2024-09-12T01:16:05.126650+0000","last_clean":"2024-09-12T01:16:05.126650+0000","last_became_active":"2024-09-12T00:02:50.069661+0000","last_became_peered":"2024-09-12T00:02:50.069661+0000","last_unstale":"2024-09-12T01:16:05.126650+0000","last_undegraded":"2024-09-12T01:16:05.126650+0000","last_fullsized":"2024-09-12T01:16:05.126650+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'763","last_scrub_stamp":"2024-09-12T01:16:05.126551+0000","last_deep_scrub":"267'763","last_deep_scrub_stamp":"2024-09-12T01:16:05.126551+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.126551+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:05.494723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4159,"num_read_kb":3799,"num_write":1082,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5109,"num_omap_keys":21,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'214","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.740174+0000","last_change":"2024-09-12T01:15:56.740095+0000","last_active":"2024-09-12T01:15:56.740174+0000","last_peered":"2024-09-12T01:15:56.740174+0000","last_clean":"2024-09-12T01:15:56.740174+0000","last_became_active":"2024-09-12T00:02:48.046527+0000","last_became_peered":"2024-09-12T00:02:48.046527+0000","last_unstale":"2024-09-12T01:15:56.740174+0000","last_undegraded":"2024-09-12T01:15:56.740174+0000","last_fullsized":"2024-09-12T01:15:56.740174+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-12T01:15:56.739986+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-12T01:15:56.739986+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.739986+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:08.369987+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":898,"num_read_kb":26543,"num_write":1077,"num_write_kb":24642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"267'5","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.918274+0000","last_change":"2024-09-12T01:16:13.918274+0000","last_active":"2024-09-12T01:16:13.918274+0000","last_peered":"2024-09-12T01:16:13.918274+0000","last_clean":"2024-09-12T01:16:13.918274+0000","last_became_active":"2024-09-12T00:02:52.064186+0000","last_became_peered":"2024-09-12T00:02:52.064186+0000","last_unstale":"2024-09-12T01:16:13.918274+0000","last_undegraded":"2024-09-12T01:16:13.918274+0000","last_fullsized":"2024-09-12T01:16:13.918274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:13.918187+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:13.918187+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.918187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:12.455769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'304","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.307202+0000","last_change":"2024-09-12T01:16:24.307202+0000","last_active":"2024-09-12T01:16:24.307202+0000","last_peered":"2024-09-12T01:16:24.307202+0000","last_clean":"2024-09-12T01:16:24.307202+0000","last_became_active":"2024-09-12T00:02:54.072431+0000","last_became_peered":"2024-09-12T00:02:54.072431+0000","last_unstale":"2024-09-12T01:16:24.307202+0000","last_undegraded":"2024-09-12T01:16:24.307202+0000","last_fullsized":"2024-09-12T01:16:24.307202+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'304","last_scrub_stamp":"2024-09-12T01:16:24.307101+0000","last_deep_scrub":"267'304","last_deep_scrub_stamp":"2024-09-12T01:16:24.307101+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.307101+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:18.118573+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1000,"num_write":1544,"num_write_kb":1370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488644,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.426217+0000","last_change":"2024-09-12T01:16:13.426217+0000","last_active":"2024-09-12T01:16:13.426217+0000","last_peered":"2024-09-12T01:16:13.426217+0000","last_clean":"2024-09-12T01:16:13.426217+0000","last_became_active":"2024-09-12T00:02:56.083643+0000","last_became_peered":"2024-09-12T00:02:56.083643+0000","last_unstale":"2024-09-12T01:16:13.426217+0000","last_undegraded":"2024-09-12T01:16:13.426217+0000","last_fullsized":"2024-09-12T01:16:13.426217+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.426122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.426122+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.426122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:16.827180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'156","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.268505+0000","last_change":"2024-09-12T01:16:21.268505+0000","last_active":"2024-09-12T01:16:21.268505+0000","last_peered":"2024-09-12T01:16:21.268505+0000","last_clean":"2024-09-12T01:16:21.268505+0000","last_became_active":"2024-09-12T00:02:58.096337+0000","last_became_peered":"2024-09-12T00:02:58.096337+0000","last_unstale":"2024-09-12T01:16:21.268505+0000","last_undegraded":"2024-09-12T01:16:21.268505+0000","last_fullsized":"2024-09-12T01:16:21.268505+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:21.268392+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:21.268392+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.268392+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:54.802343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":374,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'346","reported_seq":1750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.525322+0000","last_change":"2024-09-12T01:16:04.525322+0000","last_active":"2024-09-12T01:16:04.525322+0000","last_peered":"2024-09-12T01:16:04.525322+0000","last_clean":"2024-09-12T01:16:04.525322+0000","last_became_active":"2024-09-12T00:02:50.063141+0000","last_became_peered":"2024-09-12T00:02:50.063141+0000","last_unstale":"2024-09-12T01:16:04.525322+0000","last_undegraded":"2024-09-12T01:16:04.525322+0000","last_fullsized":"2024-09-12T01:16:04.525322+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T01:16:04.525232+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T01:16:04.525232+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.525232+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:47.471239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1807,"num_write":392,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.712129+0000","last_change":"2024-09-12T01:15:56.712040+0000","last_active":"2024-09-12T01:15:56.712129+0000","last_peered":"2024-09-12T01:15:56.712129+0000","last_clean":"2024-09-12T01:15:56.712129+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T01:15:56.712129+0000","last_undegraded":"2024-09-12T01:15:56.712129+0000","last_fullsized":"2024-09-12T01:15:56.712129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:15:56.711929+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:15:56.711929+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.711929+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.441635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.202303+0000","last_change":"2024-09-12T01:16:00.202303+0000","last_active":"2024-09-12T01:16:00.202303+0000","last_peered":"2024-09-12T01:16:00.202303+0000","last_clean":"2024-09-12T01:16:00.202303+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T01:16:00.202303+0000","last_undegraded":"2024-09-12T01:16:00.202303+0000","last_fullsized":"2024-09-12T01:16:00.202303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:00.202177+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:00.202177+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.202177+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:38.507294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'199","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.725025+0000","last_change":"2024-09-12T01:15:55.725025+0000","last_active":"2024-09-12T01:15:55.725025+0000","last_peered":"2024-09-12T01:15:55.725025+0000","last_clean":"2024-09-12T01:15:55.725025+0000","last_became_active":"2024-09-12T00:02:48.047739+0000","last_became_peered":"2024-09-12T00:02:48.047739+0000","last_unstale":"2024-09-12T01:15:55.725025+0000","last_undegraded":"2024-09-12T01:15:55.725025+0000","last_fullsized":"2024-09-12T01:15:55.725025+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'199","last_scrub_stamp":"2024-09-12T01:15:55.724921+0000","last_deep_scrub":"267'199","last_deep_scrub_stamp":"2024-09-12T01:15:55.724921+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.724921+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:06.864180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":439,"num_read_kb":34702,"num_write":919,"num_write_kb":51263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.805994+0000","last_change":"2024-09-12T01:16:14.805994+0000","last_active":"2024-09-12T01:16:14.805994+0000","last_peered":"2024-09-12T01:16:14.805994+0000","last_clean":"2024-09-12T01:16:14.805994+0000","last_became_active":"2024-09-12T00:02:52.065587+0000","last_became_peered":"2024-09-12T00:02:52.065587+0000","last_unstale":"2024-09-12T01:16:14.805994+0000","last_undegraded":"2024-09-12T01:16:14.805994+0000","last_fullsized":"2024-09-12T01:16:14.805994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.805908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.805908+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.805908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:19.064794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'340","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.278652+0000","last_change":"2024-09-12T01:16:23.278578+0000","last_active":"2024-09-12T01:16:23.278652+0000","last_peered":"2024-09-12T01:16:23.278652+0000","last_clean":"2024-09-12T01:16:23.278652+0000","last_became_active":"2024-09-12T00:02:54.069167+0000","last_became_peered":"2024-09-12T00:02:54.069167+0000","last_unstale":"2024-09-12T01:16:23.278652+0000","last_undegraded":"2024-09-12T01:16:23.278652+0000","last_fullsized":"2024-09-12T01:16:23.278652+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T01:16:23.278472+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T01:16:23.278472+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.278472+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.673031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":868,"num_write":580,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106956,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.650166+0000","last_change":"2024-09-12T01:16:20.650107+0000","last_active":"2024-09-12T01:16:20.650166+0000","last_peered":"2024-09-12T01:16:20.650166+0000","last_clean":"2024-09-12T01:16:20.650166+0000","last_became_active":"2024-09-12T00:02:56.082981+0000","last_became_peered":"2024-09-12T00:02:56.082981+0000","last_unstale":"2024-09-12T01:16:20.650166+0000","last_undegraded":"2024-09-12T01:16:20.650166+0000","last_fullsized":"2024-09-12T01:16:20.650166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:20.650022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:20.650022+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.650022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:11.460289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'224","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.388219+0000","last_change":"2024-09-12T01:16:20.388159+0000","last_active":"2024-09-12T01:16:20.388219+0000","last_peered":"2024-09-12T01:16:20.388219+0000","last_clean":"2024-09-12T01:16:20.388219+0000","last_became_active":"2024-09-12T00:02:58.099655+0000","last_became_peered":"2024-09-12T00:02:58.099655+0000","last_unstale":"2024-09-12T01:16:20.388219+0000","last_undegraded":"2024-09-12T01:16:20.388219+0000","last_fullsized":"2024-09-12T01:16:20.388219+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'224","last_scrub_stamp":"2024-09-12T01:16:20.388069+0000","last_deep_scrub":"267'224","last_deep_scrub_stamp":"2024-09-12T01:16:20.388069+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.388069+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.275567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1237,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":468,"num_write":474,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'877","reported_seq":2636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.833351+0000","last_change":"2024-09-12T01:16:03.833288+0000","last_active":"2024-09-12T01:16:03.833351+0000","last_peered":"2024-09-12T01:16:03.833351+0000","last_clean":"2024-09-12T01:16:03.833351+0000","last_became_active":"2024-09-12T00:02:50.075700+0000","last_became_peered":"2024-09-12T00:02:50.075700+0000","last_unstale":"2024-09-12T01:16:03.833351+0000","last_undegraded":"2024-09-12T01:16:03.833351+0000","last_fullsized":"2024-09-12T01:16:03.833351+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'877","last_scrub_stamp":"2024-09-12T01:16:03.833186+0000","last_deep_scrub":"267'877","last_deep_scrub_stamp":"2024-09-12T01:16:03.833186+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.833186+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:45.011515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4451,"num_read_kb":4025,"num_write":1186,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.692638+0000","last_change":"2024-09-12T01:15:58.692568+0000","last_active":"2024-09-12T01:15:58.692638+0000","last_peered":"2024-09-12T01:15:58.692638+0000","last_clean":"2024-09-12T01:15:58.692638+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T01:15:58.692638+0000","last_undegraded":"2024-09-12T01:15:58.692638+0000","last_fullsized":"2024-09-12T01:15:58.692638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:58.692481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:58.692481+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.692481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:48.738124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'216","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.934809+0000","last_change":"2024-09-12T01:15:54.934809+0000","last_active":"2024-09-12T01:15:54.934809+0000","last_peered":"2024-09-12T01:15:54.934809+0000","last_clean":"2024-09-12T01:15:54.934809+0000","last_became_active":"2024-09-12T00:02:48.057849+0000","last_became_peered":"2024-09-12T00:02:48.057849+0000","last_unstale":"2024-09-12T01:15:54.934809+0000","last_undegraded":"2024-09-12T01:15:54.934809+0000","last_fullsized":"2024-09-12T01:15:54.934809+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'216","last_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_deep_scrub":"267'216","last_deep_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.934711+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.315677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079943,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":138068,"num_write":1057,"num_write_kb":57312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.217101+0000","last_change":"2024-09-12T01:16:18.217024+0000","last_active":"2024-09-12T01:16:18.217101+0000","last_peered":"2024-09-12T01:16:18.217101+0000","last_clean":"2024-09-12T01:16:18.217101+0000","last_became_active":"2024-09-12T00:02:52.066352+0000","last_became_peered":"2024-09-12T00:02:52.066352+0000","last_unstale":"2024-09-12T01:16:18.217101+0000","last_undegraded":"2024-09-12T01:16:18.217101+0000","last_fullsized":"2024-09-12T01:16:18.217101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.216903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.216903+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.216903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:57.836293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'947","reported_seq":2795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.250857+0000","last_change":"2024-09-12T01:16:14.250857+0000","last_active":"2024-09-12T01:16:14.250857+0000","last_peered":"2024-09-12T01:16:14.250857+0000","last_clean":"2024-09-12T01:16:14.250857+0000","last_became_active":"2024-09-12T00:02:54.070061+0000","last_became_peered":"2024-09-12T00:02:54.070061+0000","last_unstale":"2024-09-12T01:16:14.250857+0000","last_undegraded":"2024-09-12T01:16:14.250857+0000","last_fullsized":"2024-09-12T01:16:14.250857+0000","mapping_epoch":32,"log_start":"267'901","ondisk_log_start":"267'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'947","last_scrub_stamp":"2024-09-12T01:16:14.250736+0000","last_deep_scrub":"267'947","last_deep_scrub_stamp":"2024-09-12T01:16:14.250736+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.250736+0000","objects_scrubbed":12,"log_size":46,"log_dups_size":901,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.703976+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20817,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1281,"num_read_kb":1476,"num_write":392,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.913627+0000","last_change":"2024-09-12T01:16:24.913627+0000","last_active":"2024-09-12T01:16:24.913627+0000","last_peered":"2024-09-12T01:16:24.913627+0000","last_clean":"2024-09-12T01:16:24.913627+0000","last_became_active":"2024-09-12T00:02:56.078658+0000","last_became_peered":"2024-09-12T00:02:56.078658+0000","last_unstale":"2024-09-12T01:16:24.913627+0000","last_undegraded":"2024-09-12T01:16:24.913627+0000","last_fullsized":"2024-09-12T01:16:24.913627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.913532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.913532+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.913532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:54.477216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'172","reported_seq":763,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.262611+0000","last_change":"2024-09-12T01:16:22.262539+0000","last_active":"2024-09-12T01:16:22.262611+0000","last_peered":"2024-09-12T01:16:22.262611+0000","last_clean":"2024-09-12T01:16:22.262611+0000","last_became_active":"2024-09-12T00:02:58.089378+0000","last_became_peered":"2024-09-12T00:02:58.089378+0000","last_unstale":"2024-09-12T01:16:22.262611+0000","last_undegraded":"2024-09-12T01:16:22.262611+0000","last_fullsized":"2024-09-12T01:16:22.262611+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'172","last_scrub_stamp":"2024-09-12T01:16:22.262447+0000","last_deep_scrub":"267'172","last_deep_scrub_stamp":"2024-09-12T01:16:22.262447+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.262447+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:23.907893+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":336,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'1109","reported_seq":2835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.124023+0000","last_change":"2024-09-12T01:16:03.123960+0000","last_active":"2024-09-12T01:16:03.124023+0000","last_peered":"2024-09-12T01:16:03.124023+0000","last_clean":"2024-09-12T01:16:03.124023+0000","last_became_active":"2024-09-12T00:02:50.067002+0000","last_became_peered":"2024-09-12T00:02:50.067002+0000","last_unstale":"2024-09-12T01:16:03.124023+0000","last_undegraded":"2024-09-12T01:16:03.124023+0000","last_fullsized":"2024-09-12T01:16:03.124023+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1109","last_scrub_stamp":"2024-09-12T01:16:03.123868+0000","last_deep_scrub":"267'1109","last_deep_scrub_stamp":"2024-09-12T01:16:03.123868+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.123868+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":1000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.293606+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5247,"num_read_kb":4613,"num_write":1599,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":551,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.086300+0000","last_change":"2024-09-12T01:15:54.086300+0000","last_active":"2024-09-12T01:15:54.086300+0000","last_peered":"2024-09-12T01:15:54.086300+0000","last_clean":"2024-09-12T01:15:54.086300+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T01:15:54.086300+0000","last_undegraded":"2024-09-12T01:15:54.086300+0000","last_fullsized":"2024-09-12T01:15:54.086300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:54.086226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:54.086226+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.086226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:56.605178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'185","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.053418+0000","last_change":"2024-09-12T01:15:56.053418+0000","last_active":"2024-09-12T01:15:56.053418+0000","last_peered":"2024-09-12T01:15:56.053418+0000","last_clean":"2024-09-12T01:15:56.053418+0000","last_became_active":"2024-09-12T00:02:48.044126+0000","last_became_peered":"2024-09-12T00:02:48.044126+0000","last_unstale":"2024-09-12T01:15:56.053418+0000","last_undegraded":"2024-09-12T01:15:56.053418+0000","last_fullsized":"2024-09-12T01:15:56.053418+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:56.053326+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:56.053326+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.053326+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.310181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4751719,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":400,"num_read_kb":27065,"num_write":781,"num_write_kb":40333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.261642+0000","last_change":"2024-09-12T01:16:05.261538+0000","last_active":"2024-09-12T01:16:05.261642+0000","last_peered":"2024-09-12T01:16:05.261642+0000","last_clean":"2024-09-12T01:16:05.261642+0000","last_became_active":"2024-09-12T00:02:52.068351+0000","last_became_peered":"2024-09-12T00:02:52.068351+0000","last_unstale":"2024-09-12T01:16:05.261642+0000","last_undegraded":"2024-09-12T01:16:05.261642+0000","last_fullsized":"2024-09-12T01:16:05.261642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:05.261339+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:05.261339+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.261339+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:53.809383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'311","reported_seq":1750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.874033+0000","last_change":"2024-09-12T01:16:21.874033+0000","last_active":"2024-09-12T01:16:21.874033+0000","last_peered":"2024-09-12T01:16:21.874033+0000","last_clean":"2024-09-12T01:16:21.874033+0000","last_became_active":"2024-09-12T00:02:54.241581+0000","last_became_peered":"2024-09-12T00:02:54.241581+0000","last_unstale":"2024-09-12T01:16:21.874033+0000","last_undegraded":"2024-09-12T01:16:21.874033+0000","last_fullsized":"2024-09-12T01:16:21.874033+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:16:21.873938+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:16:21.873938+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.873938+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:16.952197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":254,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.668167+0000","last_change":"2024-09-12T01:16:18.668167+0000","last_active":"2024-09-12T01:16:18.668167+0000","last_peered":"2024-09-12T01:16:18.668167+0000","last_clean":"2024-09-12T01:16:18.668167+0000","last_became_active":"2024-09-12T00:02:56.081641+0000","last_became_peered":"2024-09-12T00:02:56.081641+0000","last_unstale":"2024-09-12T01:16:18.668167+0000","last_undegraded":"2024-09-12T01:16:18.668167+0000","last_fullsized":"2024-09-12T01:16:18.668167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.668049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.668049+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.668049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:09.740334+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'277","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.612937+0000","last_change":"2024-09-12T01:16:28.612937+0000","last_active":"2024-09-12T01:16:28.612937+0000","last_peered":"2024-09-12T01:16:28.612937+0000","last_clean":"2024-09-12T01:16:28.612937+0000","last_became_active":"2024-09-12T00:02:58.088442+0000","last_became_peered":"2024-09-12T00:02:58.088442+0000","last_unstale":"2024-09-12T01:16:28.612937+0000","last_undegraded":"2024-09-12T01:16:28.612937+0000","last_fullsized":"2024-09-12T01:16:28.612937+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T01:16:28.612850+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T01:16:28.612850+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.612850+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.460954+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":615,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'439","reported_seq":2024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.247988+0000","last_change":"2024-09-12T01:16:10.247891+0000","last_active":"2024-09-12T01:16:10.247988+0000","last_peered":"2024-09-12T01:16:10.247988+0000","last_clean":"2024-09-12T01:16:10.247988+0000","last_became_active":"2024-09-12T00:03:21.140691+0000","last_became_peered":"2024-09-12T00:03:21.140691+0000","last_unstale":"2024-09-12T01:16:10.247988+0000","last_undegraded":"2024-09-12T01:16:10.247988+0000","last_fullsized":"2024-09-12T01:16:10.247988+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'439","last_scrub_stamp":"2024-09-12T01:16:10.247775+0000","last_deep_scrub":"267'439","last_deep_scrub_stamp":"2024-09-12T01:16:10.247775+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.247775+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:43.615955+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2439,"num_read_kb":2322,"num_write":494,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.160871+0000","last_change":"2024-09-12T01:15:56.160871+0000","last_active":"2024-09-12T01:15:56.160871+0000","last_peered":"2024-09-12T01:15:56.160871+0000","last_clean":"2024-09-12T01:15:56.160871+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T01:15:56.160871+0000","last_undegraded":"2024-09-12T01:15:56.160871+0000","last_fullsized":"2024-09-12T01:15:56.160871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:15:56.160739+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:15:56.160739+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.160739+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:36.791017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'207","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.693700+0000","last_change":"2024-09-12T01:15:55.693700+0000","last_active":"2024-09-12T01:15:55.693700+0000","last_peered":"2024-09-12T01:15:55.693700+0000","last_clean":"2024-09-12T01:15:55.693700+0000","last_became_active":"2024-09-12T00:02:48.049260+0000","last_became_peered":"2024-09-12T00:02:48.049260+0000","last_unstale":"2024-09-12T01:15:55.693700+0000","last_undegraded":"2024-09-12T01:15:55.693700+0000","last_fullsized":"2024-09-12T01:15:55.693700+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-12T01:15:55.693558+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-12T01:15:55.693558+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.693558+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.593673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":103584,"num_write":943,"num_write_kb":20218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.641153+0000","last_change":"2024-09-12T01:16:12.641153+0000","last_active":"2024-09-12T01:16:12.641153+0000","last_peered":"2024-09-12T01:16:12.641153+0000","last_clean":"2024-09-12T01:16:12.641153+0000","last_became_active":"2024-09-12T00:02:52.066289+0000","last_became_peered":"2024-09-12T00:02:52.066289+0000","last_unstale":"2024-09-12T01:16:12.641153+0000","last_undegraded":"2024-09-12T01:16:12.641153+0000","last_fullsized":"2024-09-12T01:16:12.641153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:12.641053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:12.641053+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.641053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:37.049985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'166","reported_seq":741,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.578322+0000","last_change":"2024-09-12T01:16:20.578250+0000","last_active":"2024-09-12T01:16:20.578322+0000","last_peered":"2024-09-12T01:16:20.578322+0000","last_clean":"2024-09-12T01:16:20.578322+0000","last_became_active":"2024-09-12T00:02:54.066864+0000","last_became_peered":"2024-09-12T00:02:54.066864+0000","last_unstale":"2024-09-12T01:16:20.578322+0000","last_undegraded":"2024-09-12T01:16:20.578322+0000","last_fullsized":"2024-09-12T01:16:20.578322+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-09-12T01:16:20.578154+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-09-12T01:16:20.578154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.578154+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:07.312869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":203,"num_read_kb":195,"num_write":150,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.459032+0000","last_change":"2024-09-12T01:16:12.458972+0000","last_active":"2024-09-12T01:16:12.459032+0000","last_peered":"2024-09-12T01:16:12.459032+0000","last_clean":"2024-09-12T01:16:12.459032+0000","last_became_active":"2024-09-12T00:02:56.085437+0000","last_became_peered":"2024-09-12T00:02:56.085437+0000","last_unstale":"2024-09-12T01:16:12.459032+0000","last_undegraded":"2024-09-12T01:16:12.459032+0000","last_fullsized":"2024-09-12T01:16:12.459032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:12.458882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:12.458882+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.458882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:11.334322+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'109","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.260098+0000","last_change":"2024-09-12T01:16:30.260026+0000","last_active":"2024-09-12T01:16:30.260098+0000","last_peered":"2024-09-12T01:16:30.260098+0000","last_clean":"2024-09-12T01:16:30.260098+0000","last_became_active":"2024-09-12T00:02:58.095419+0000","last_became_peered":"2024-09-12T00:02:58.095419+0000","last_unstale":"2024-09-12T01:16:30.260098+0000","last_undegraded":"2024-09-12T01:16:30.260098+0000","last_fullsized":"2024-09-12T01:16:30.260098+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'109","last_scrub_stamp":"2024-09-12T01:16:30.259943+0000","last_deep_scrub":"267'109","last_deep_scrub_stamp":"2024-09-12T01:16:30.259943+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.259943+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:03.848903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":189,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'417","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.135125+0000","last_change":"2024-09-12T01:16:04.135125+0000","last_active":"2024-09-12T01:16:04.135125+0000","last_peered":"2024-09-12T01:16:04.135125+0000","last_clean":"2024-09-12T01:16:04.135125+0000","last_became_active":"2024-09-12T00:02:50.075209+0000","last_became_peered":"2024-09-12T00:02:50.075209+0000","last_unstale":"2024-09-12T01:16:04.135125+0000","last_undegraded":"2024-09-12T01:16:04.135125+0000","last_fullsized":"2024-09-12T01:16:04.135125+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'417","last_scrub_stamp":"2024-09-12T01:16:04.135003+0000","last_deep_scrub":"267'417","last_deep_scrub_stamp":"2024-09-12T01:16:04.135003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.135003+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.259816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2214,"num_read_kb":2093,"num_write":483,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'191","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.197783+0000","last_change":"2024-09-12T01:15:58.197783+0000","last_active":"2024-09-12T01:15:58.197783+0000","last_peered":"2024-09-12T01:15:58.197783+0000","last_clean":"2024-09-12T01:15:58.197783+0000","last_became_active":"2024-09-12T00:02:48.052751+0000","last_became_peered":"2024-09-12T00:02:48.052751+0000","last_unstale":"2024-09-12T01:15:58.197783+0000","last_undegraded":"2024-09-12T01:15:58.197783+0000","last_fullsized":"2024-09-12T01:15:58.197783+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'191","last_scrub_stamp":"2024-09-12T01:15:58.197662+0000","last_deep_scrub":"267'191","last_deep_scrub_stamp":"2024-09-12T01:15:58.197662+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.197662+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:11.307806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493417,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":26295,"num_write":910,"num_write_kb":36863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.106575+0000","last_change":"2024-09-12T01:15:54.106575+0000","last_active":"2024-09-12T01:15:54.106575+0000","last_peered":"2024-09-12T01:15:54.106575+0000","last_clean":"2024-09-12T01:15:54.106575+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T01:15:54.106575+0000","last_undegraded":"2024-09-12T01:15:54.106575+0000","last_fullsized":"2024-09-12T01:15:54.106575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:54.106483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:54.106483+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.106483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:20.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.681070+0000","last_change":"2024-09-12T01:16:11.681070+0000","last_active":"2024-09-12T01:16:11.681070+0000","last_peered":"2024-09-12T01:16:11.681070+0000","last_clean":"2024-09-12T01:16:11.681070+0000","last_became_active":"2024-09-12T00:02:52.067200+0000","last_became_peered":"2024-09-12T00:02:52.067200+0000","last_unstale":"2024-09-12T01:16:11.681070+0000","last_undegraded":"2024-09-12T01:16:11.681070+0000","last_fullsized":"2024-09-12T01:16:11.681070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:11.680981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:11.680981+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.680981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:51.075341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'316","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.694954+0000","last_change":"2024-09-12T01:16:14.694954+0000","last_active":"2024-09-12T01:16:14.694954+0000","last_peered":"2024-09-12T01:16:14.694954+0000","last_clean":"2024-09-12T01:16:14.694954+0000","last_became_active":"2024-09-12T00:02:54.069071+0000","last_became_peered":"2024-09-12T00:02:54.069071+0000","last_unstale":"2024-09-12T01:16:14.694954+0000","last_undegraded":"2024-09-12T01:16:14.694954+0000","last_fullsized":"2024-09-12T01:16:14.694954+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'316","last_scrub_stamp":"2024-09-12T01:16:14.694854+0000","last_deep_scrub":"267'316","last_deep_scrub_stamp":"2024-09-12T01:16:14.694854+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.694854+0000","objects_scrubbed":11,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:57.933950+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":450,"num_read_kb":594,"num_write":258,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.951234+0000","last_change":"2024-09-12T01:16:23.951234+0000","last_active":"2024-09-12T01:16:23.951234+0000","last_peered":"2024-09-12T01:16:23.951234+0000","last_clean":"2024-09-12T01:16:23.951234+0000","last_became_active":"2024-09-12T00:02:56.082046+0000","last_became_peered":"2024-09-12T00:02:56.082046+0000","last_unstale":"2024-09-12T01:16:23.951234+0000","last_undegraded":"2024-09-12T01:16:23.951234+0000","last_fullsized":"2024-09-12T01:16:23.951234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.951113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.951113+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.951113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.037004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'167","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.583861+0000","last_change":"2024-09-12T01:16:28.583861+0000","last_active":"2024-09-12T01:16:28.583861+0000","last_peered":"2024-09-12T01:16:28.583861+0000","last_clean":"2024-09-12T01:16:28.583861+0000","last_became_active":"2024-09-12T00:02:58.091590+0000","last_became_peered":"2024-09-12T00:02:58.091590+0000","last_unstale":"2024-09-12T01:16:28.583861+0000","last_undegraded":"2024-09-12T01:16:28.583861+0000","last_fullsized":"2024-09-12T01:16:28.583861+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T01:16:28.583748+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T01:16:28.583748+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.583748+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:57.607309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1150,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":174,"num_write":425,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'452","reported_seq":2003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.829586+0000","last_change":"2024-09-12T01:16:02.829586+0000","last_active":"2024-09-12T01:16:02.829586+0000","last_peered":"2024-09-12T01:16:02.829586+0000","last_clean":"2024-09-12T01:16:02.829586+0000","last_became_active":"2024-09-12T00:02:50.073262+0000","last_became_peered":"2024-09-12T00:02:50.073262+0000","last_unstale":"2024-09-12T01:16:02.829586+0000","last_undegraded":"2024-09-12T01:16:02.829586+0000","last_fullsized":"2024-09-12T01:16:02.829586+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'452","last_scrub_stamp":"2024-09-12T01:16:02.829503+0000","last_deep_scrub":"267'452","last_deep_scrub_stamp":"2024-09-12T01:16:02.829503+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.829503+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:27.994764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2298,"num_read_kb":2165,"num_write":516,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'158","reported_seq":798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.086308+0000","last_change":"2024-09-12T01:15:57.086308+0000","last_active":"2024-09-12T01:15:57.086308+0000","last_peered":"2024-09-12T01:15:57.086308+0000","last_clean":"2024-09-12T01:15:57.086308+0000","last_became_active":"2024-09-12T00:02:48.052768+0000","last_became_peered":"2024-09-12T00:02:48.052768+0000","last_unstale":"2024-09-12T01:15:57.086308+0000","last_undegraded":"2024-09-12T01:15:57.086308+0000","last_fullsized":"2024-09-12T01:15:57.086308+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:15:57.086208+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:15:57.086208+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.086208+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:33.822235+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3687654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":16851,"num_write":770,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.680047+0000","last_change":"2024-09-12T01:15:57.680047+0000","last_active":"2024-09-12T01:15:57.680047+0000","last_peered":"2024-09-12T01:15:57.680047+0000","last_clean":"2024-09-12T01:15:57.680047+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T01:15:57.680047+0000","last_undegraded":"2024-09-12T01:15:57.680047+0000","last_fullsized":"2024-09-12T01:15:57.680047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:57.679926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:57.679926+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.679926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:28.341226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.404382+0000","last_change":"2024-09-12T01:16:09.404382+0000","last_active":"2024-09-12T01:16:09.404382+0000","last_peered":"2024-09-12T01:16:09.404382+0000","last_clean":"2024-09-12T01:16:09.404382+0000","last_became_active":"2024-09-12T00:02:52.069469+0000","last_became_peered":"2024-09-12T00:02:52.069469+0000","last_unstale":"2024-09-12T01:16:09.404382+0000","last_undegraded":"2024-09-12T01:16:09.404382+0000","last_fullsized":"2024-09-12T01:16:09.404382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.404244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.404244+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.404244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:48.154706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'268","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.257925+0000","last_change":"2024-09-12T01:16:15.257925+0000","last_active":"2024-09-12T01:16:15.257925+0000","last_peered":"2024-09-12T01:16:15.257925+0000","last_clean":"2024-09-12T01:16:15.257925+0000","last_became_active":"2024-09-12T00:02:54.239879+0000","last_became_peered":"2024-09-12T00:02:54.239879+0000","last_unstale":"2024-09-12T01:16:15.257925+0000","last_undegraded":"2024-09-12T01:16:15.257925+0000","last_fullsized":"2024-09-12T01:16:15.257925+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'268","last_scrub_stamp":"2024-09-12T01:16:15.257819+0000","last_deep_scrub":"267'268","last_deep_scrub_stamp":"2024-09-12T01:16:15.257819+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.257819+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:05.117332+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":332,"num_read_kb":322,"num_write":304,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'794","reported_seq":5272,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.307983+0000","last_change":"2024-09-12T01:16:27.307983+0000","last_active":"2024-09-12T01:16:27.307983+0000","last_peered":"2024-09-12T01:16:27.307983+0000","last_clean":"2024-09-12T01:16:27.307983+0000","last_became_active":"2024-09-12T00:02:56.086704+0000","last_became_peered":"2024-09-12T00:02:56.086704+0000","last_unstale":"2024-09-12T01:16:27.307983+0000","last_undegraded":"2024-09-12T01:16:27.307983+0000","last_fullsized":"2024-09-12T01:16:27.307983+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'794","last_scrub_stamp":"2024-09-12T01:16:27.307879+0000","last_deep_scrub":"267'794","last_deep_scrub_stamp":"2024-09-12T01:16:27.307879+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.307879+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.008848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'156","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.602075+0000","last_change":"2024-09-12T01:16:30.602075+0000","last_active":"2024-09-12T01:16:30.602075+0000","last_peered":"2024-09-12T01:16:30.602075+0000","last_clean":"2024-09-12T01:16:30.602075+0000","last_became_active":"2024-09-12T00:02:58.091466+0000","last_became_peered":"2024-09-12T00:02:58.091466+0000","last_unstale":"2024-09-12T01:16:30.602075+0000","last_undegraded":"2024-09-12T01:16:30.602075+0000","last_fullsized":"2024-09-12T01:16:30.602075+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:30.601983+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:30.601983+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.601983+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:41.138937+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":335,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'992","reported_seq":2663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.642819+0000","last_change":"2024-09-12T01:16:05.642819+0000","last_active":"2024-09-12T01:16:05.642819+0000","last_peered":"2024-09-12T01:16:05.642819+0000","last_clean":"2024-09-12T01:16:05.642819+0000","last_became_active":"2024-09-12T00:02:50.067868+0000","last_became_peered":"2024-09-12T00:02:50.067868+0000","last_unstale":"2024-09-12T01:16:05.642819+0000","last_undegraded":"2024-09-12T01:16:05.642819+0000","last_fullsized":"2024-09-12T01:16:05.642819+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'992","last_scrub_stamp":"2024-09-12T01:16:05.642648+0000","last_deep_scrub":"267'992","last_deep_scrub_stamp":"2024-09-12T01:16:05.642648+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.642648+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":900,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.830523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4764,"num_read_kb":4246,"num_write":1341,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'174","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.765888+0000","last_change":"2024-09-12T01:15:54.765840+0000","last_active":"2024-09-12T01:15:54.765888+0000","last_peered":"2024-09-12T01:15:54.765888+0000","last_clean":"2024-09-12T01:15:54.765888+0000","last_became_active":"2024-09-12T00:02:48.052431+0000","last_became_peered":"2024-09-12T00:02:48.052431+0000","last_unstale":"2024-09-12T01:15:54.765888+0000","last_undegraded":"2024-09-12T01:15:54.765888+0000","last_fullsized":"2024-09-12T01:15:54.765888+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-12T01:15:54.765727+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-12T01:15:54.765727+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.765727+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:58.196722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1211576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":121623,"num_write":832,"num_write_kb":33084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.074501+0000","last_change":"2024-09-12T01:15:55.074456+0000","last_active":"2024-09-12T01:15:55.074501+0000","last_peered":"2024-09-12T01:15:55.074501+0000","last_clean":"2024-09-12T01:15:55.074501+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T01:15:55.074501+0000","last_undegraded":"2024-09-12T01:15:55.074501+0000","last_fullsized":"2024-09-12T01:15:55.074501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:55.074392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:55.074392+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.074392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:33.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.904718+0000","last_change":"2024-09-12T01:16:14.904718+0000","last_active":"2024-09-12T01:16:14.904718+0000","last_peered":"2024-09-12T01:16:14.904718+0000","last_clean":"2024-09-12T01:16:14.904718+0000","last_became_active":"2024-09-12T00:02:52.062631+0000","last_became_peered":"2024-09-12T00:02:52.062631+0000","last_unstale":"2024-09-12T01:16:14.904718+0000","last_undegraded":"2024-09-12T01:16:14.904718+0000","last_fullsized":"2024-09-12T01:16:14.904718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.904620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.904620+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.904620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:52.933314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'143","reported_seq":720,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.989354+0000","last_change":"2024-09-12T01:16:18.989354+0000","last_active":"2024-09-12T01:16:18.989354+0000","last_peered":"2024-09-12T01:16:18.989354+0000","last_clean":"2024-09-12T01:16:18.989354+0000","last_became_active":"2024-09-12T00:02:54.068812+0000","last_became_peered":"2024-09-12T00:02:54.068812+0000","last_unstale":"2024-09-12T01:16:18.989354+0000","last_undegraded":"2024-09-12T01:16:18.989354+0000","last_fullsized":"2024-09-12T01:16:18.989354+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'143","last_scrub_stamp":"2024-09-12T01:16:18.989240+0000","last_deep_scrub":"267'143","last_deep_scrub_stamp":"2024-09-12T01:16:18.989240+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.989240+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:18.570760+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":169,"num_write":118,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'809","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.552525+0000","last_change":"2024-09-12T01:16:26.552525+0000","last_active":"2024-09-12T01:16:26.552525+0000","last_peered":"2024-09-12T01:16:26.552525+0000","last_clean":"2024-09-12T01:16:26.552525+0000","last_became_active":"2024-09-12T00:02:56.083894+0000","last_became_peered":"2024-09-12T00:02:56.083894+0000","last_unstale":"2024-09-12T01:16:26.552525+0000","last_undegraded":"2024-09-12T01:16:26.552525+0000","last_fullsized":"2024-09-12T01:16:26.552525+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'809","last_scrub_stamp":"2024-09-12T01:16:26.552439+0000","last_deep_scrub":"267'809","last_deep_scrub_stamp":"2024-09-12T01:16:26.552439+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.552439+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:42.339646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'277","reported_seq":814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.621041+0000","last_change":"2024-09-12T01:16:27.621041+0000","last_active":"2024-09-12T01:16:27.621041+0000","last_peered":"2024-09-12T01:16:27.621041+0000","last_clean":"2024-09-12T01:16:27.621041+0000","last_became_active":"2024-09-12T00:02:58.093442+0000","last_became_peered":"2024-09-12T00:02:58.093442+0000","last_unstale":"2024-09-12T01:16:27.621041+0000","last_undegraded":"2024-09-12T01:16:27.621041+0000","last_fullsized":"2024-09-12T01:16:27.621041+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T01:16:27.620900+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T01:16:27.620900+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.620900+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:52.669324+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":340,"num_read_kb":339,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'414","reported_seq":1929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.721059+0000","last_change":"2024-09-12T01:16:01.721059+0000","last_active":"2024-09-12T01:16:01.721059+0000","last_peered":"2024-09-12T01:16:01.721059+0000","last_clean":"2024-09-12T01:16:01.721059+0000","last_became_active":"2024-09-12T00:02:50.057999+0000","last_became_peered":"2024-09-12T00:02:50.057999+0000","last_unstale":"2024-09-12T01:16:01.721059+0000","last_undegraded":"2024-09-12T01:16:01.721059+0000","last_fullsized":"2024-09-12T01:16:01.721059+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-12T01:16:01.720958+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-12T01:16:01.720958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.720958+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:36.846886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2267,"num_read_kb":2133,"num_write":493,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'270","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:53.943397+0000","last_change":"2024-09-12T01:15:53.943324+0000","last_active":"2024-09-12T01:15:53.943397+0000","last_peered":"2024-09-12T01:15:53.943397+0000","last_clean":"2024-09-12T01:15:53.943397+0000","last_became_active":"2024-09-12T00:02:48.051495+0000","last_became_peered":"2024-09-12T00:02:48.051495+0000","last_unstale":"2024-09-12T01:15:53.943397+0000","last_undegraded":"2024-09-12T01:15:53.943397+0000","last_fullsized":"2024-09-12T01:15:53.943397+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_clean_scrub_stamp":"2024-09-12T01:15:53.943232+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:48.709674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598650,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":670,"num_read_kb":18611,"num_write":1220,"num_write_kb":43211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.519319+0000","last_change":"2024-09-12T01:16:00.519255+0000","last_active":"2024-09-12T01:16:00.519319+0000","last_peered":"2024-09-12T01:16:00.519319+0000","last_clean":"2024-09-12T01:16:00.519319+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T01:16:00.519319+0000","last_undegraded":"2024-09-12T01:16:00.519319+0000","last_fullsized":"2024-09-12T01:16:00.519319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:00.519172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:00.519172+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.519172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:56.447826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.594306+0000","last_change":"2024-09-12T01:16:13.594306+0000","last_active":"2024-09-12T01:16:13.594306+0000","last_peered":"2024-09-12T01:16:13.594306+0000","last_clean":"2024-09-12T01:16:13.594306+0000","last_became_active":"2024-09-12T00:02:52.062544+0000","last_became_peered":"2024-09-12T00:02:52.062544+0000","last_unstale":"2024-09-12T01:16:13.594306+0000","last_undegraded":"2024-09-12T01:16:13.594306+0000","last_fullsized":"2024-09-12T01:16:13.594306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.594219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.594219+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.594219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:10.561944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'364","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.903838+0000","last_change":"2024-09-12T01:16:17.903838+0000","last_active":"2024-09-12T01:16:17.903838+0000","last_peered":"2024-09-12T01:16:17.903838+0000","last_clean":"2024-09-12T01:16:17.903838+0000","last_became_active":"2024-09-12T00:02:54.239355+0000","last_became_peered":"2024-09-12T00:02:54.239355+0000","last_unstale":"2024-09-12T01:16:17.903838+0000","last_undegraded":"2024-09-12T01:16:17.903838+0000","last_fullsized":"2024-09-12T01:16:17.903838+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T01:16:17.903729+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T01:16:17.903729+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.903729+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:31.614604+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":736,"num_write":272,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.603312+0000","last_change":"2024-09-12T01:16:19.603312+0000","last_active":"2024-09-12T01:16:19.603312+0000","last_peered":"2024-09-12T01:16:19.603312+0000","last_clean":"2024-09-12T01:16:19.603312+0000","last_became_active":"2024-09-12T00:02:56.087448+0000","last_became_peered":"2024-09-12T00:02:56.087448+0000","last_unstale":"2024-09-12T01:16:19.603312+0000","last_undegraded":"2024-09-12T01:16:19.603312+0000","last_fullsized":"2024-09-12T01:16:19.603312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:19.603217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:19.603217+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.603217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:11.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'131","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.257024+0000","last_change":"2024-09-12T01:16:31.257024+0000","last_active":"2024-09-12T01:16:31.257024+0000","last_peered":"2024-09-12T01:16:31.257024+0000","last_clean":"2024-09-12T01:16:31.257024+0000","last_became_active":"2024-09-12T00:02:58.099906+0000","last_became_peered":"2024-09-12T00:02:58.099906+0000","last_unstale":"2024-09-12T01:16:31.257024+0000","last_undegraded":"2024-09-12T01:16:31.257024+0000","last_fullsized":"2024-09-12T01:16:31.257024+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:16:31.256911+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:16:31.256911+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.256911+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:58.144369+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":140,"num_write":299,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'131","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.682118+0000","last_change":"2024-09-12T01:16:31.682118+0000","last_active":"2024-09-12T01:16:31.682118+0000","last_peered":"2024-09-12T01:16:31.682118+0000","last_clean":"2024-09-12T01:16:31.682118+0000","last_became_active":"2024-09-12T00:02:58.099564+0000","last_became_peered":"2024-09-12T00:02:58.099564+0000","last_unstale":"2024-09-12T01:16:31.682118+0000","last_undegraded":"2024-09-12T01:16:31.682118+0000","last_fullsized":"2024-09-12T01:16:31.682118+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:16:31.682035+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:16:31.682035+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.682035+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:49.336012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":201,"num_write":295,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'832","reported_seq":2385,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.713433+0000","last_change":"2024-09-12T01:16:02.713433+0000","last_active":"2024-09-12T01:16:02.713433+0000","last_peered":"2024-09-12T01:16:02.713433+0000","last_clean":"2024-09-12T01:16:02.713433+0000","last_became_active":"2024-09-12T00:02:50.063351+0000","last_became_peered":"2024-09-12T00:02:50.063351+0000","last_unstale":"2024-09-12T01:16:02.713433+0000","last_undegraded":"2024-09-12T01:16:02.713433+0000","last_fullsized":"2024-09-12T01:16:02.713433+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'832","last_scrub_stamp":"2024-09-12T01:16:02.713331+0000","last_deep_scrub":"267'832","last_deep_scrub_stamp":"2024-09-12T01:16:02.713331+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.713331+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:01.106721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3851,"num_read_kb":3457,"num_write":1080,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'158","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.711008+0000","last_change":"2024-09-12T01:15:56.711008+0000","last_active":"2024-09-12T01:15:56.711008+0000","last_peered":"2024-09-12T01:15:56.711008+0000","last_clean":"2024-09-12T01:15:56.711008+0000","last_became_active":"2024-09-12T00:02:48.047723+0000","last_became_peered":"2024-09-12T00:02:48.047723+0000","last_unstale":"2024-09-12T01:15:56.711008+0000","last_undegraded":"2024-09-12T01:15:56.711008+0000","last_fullsized":"2024-09-12T01:15:56.711008+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:15:56.710861+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:15:56.710861+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.710861+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:41.398940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":26182,"num_write":818,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.127605+0000","last_change":"2024-09-12T01:16:09.127605+0000","last_active":"2024-09-12T01:16:09.127605+0000","last_peered":"2024-09-12T01:16:09.127605+0000","last_clean":"2024-09-12T01:16:09.127605+0000","last_became_active":"2024-09-12T00:02:52.066702+0000","last_became_peered":"2024-09-12T00:02:52.066702+0000","last_unstale":"2024-09-12T01:16:09.127605+0000","last_undegraded":"2024-09-12T01:16:09.127605+0000","last_fullsized":"2024-09-12T01:16:09.127605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.127494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.127494+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.127494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:35.855938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'201","reported_seq":808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.591460+0000","last_change":"2024-09-12T01:16:16.591460+0000","last_active":"2024-09-12T01:16:16.591460+0000","last_peered":"2024-09-12T01:16:16.591460+0000","last_clean":"2024-09-12T01:16:16.591460+0000","last_became_active":"2024-09-12T00:02:54.066679+0000","last_became_peered":"2024-09-12T00:02:54.066679+0000","last_unstale":"2024-09-12T01:16:16.591460+0000","last_undegraded":"2024-09-12T01:16:16.591460+0000","last_fullsized":"2024-09-12T01:16:16.591460+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:16:16.591267+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:16:16.591267+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.591267+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:25.553404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":343,"num_write":152,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.556234+0000","last_change":"2024-09-12T01:16:24.556234+0000","last_active":"2024-09-12T01:16:24.556234+0000","last_peered":"2024-09-12T01:16:24.556234+0000","last_clean":"2024-09-12T01:16:24.556234+0000","last_became_active":"2024-09-12T00:02:56.081445+0000","last_became_peered":"2024-09-12T00:02:56.081445+0000","last_unstale":"2024-09-12T01:16:24.556234+0000","last_undegraded":"2024-09-12T01:16:24.556234+0000","last_fullsized":"2024-09-12T01:16:24.556234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.556139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.556139+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.556139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:06.184503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'152","reported_seq":669,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.654927+0000","last_change":"2024-09-12T01:16:33.654927+0000","last_active":"2024-09-12T01:16:33.654927+0000","last_peered":"2024-09-12T01:16:33.654927+0000","last_clean":"2024-09-12T01:16:33.654927+0000","last_became_active":"2024-09-12T00:02:58.096979+0000","last_became_peered":"2024-09-12T00:02:58.096979+0000","last_unstale":"2024-09-12T01:16:33.654927+0000","last_undegraded":"2024-09-12T01:16:33.654927+0000","last_fullsized":"2024-09-12T01:16:33.654927+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:16:33.654838+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:16:33.654838+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.654838+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:04.524814+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":142,"num_write":377,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'431","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.142244+0000","last_change":"2024-09-12T01:16:06.142244+0000","last_active":"2024-09-12T01:16:06.142244+0000","last_peered":"2024-09-12T01:16:06.142244+0000","last_clean":"2024-09-12T01:16:06.142244+0000","last_became_active":"2024-09-12T00:02:50.065307+0000","last_became_peered":"2024-09-12T00:02:50.065307+0000","last_unstale":"2024-09-12T01:16:06.142244+0000","last_undegraded":"2024-09-12T01:16:06.142244+0000","last_fullsized":"2024-09-12T01:16:06.142244+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'431","last_scrub_stamp":"2024-09-12T01:16:06.142162+0000","last_deep_scrub":"267'431","last_deep_scrub_stamp":"2024-09-12T01:16:06.142162+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.142162+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:57.029036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2299,"num_read_kb":2174,"num_write":505,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'162","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.721269+0000","last_change":"2024-09-12T01:16:02.721269+0000","last_active":"2024-09-12T01:16:02.721269+0000","last_peered":"2024-09-12T01:16:02.721269+0000","last_clean":"2024-09-12T01:16:02.721269+0000","last_became_active":"2024-09-12T00:02:48.048506+0000","last_became_peered":"2024-09-12T00:02:48.048506+0000","last_unstale":"2024-09-12T01:16:02.721269+0000","last_undegraded":"2024-09-12T01:16:02.721269+0000","last_fullsized":"2024-09-12T01:16:02.721269+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:02.721132+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:02.721132+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.721132+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:27.676261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":321,"num_read_kb":61867,"num_write":777,"num_write_kb":44911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.589857+0000","last_change":"2024-09-12T01:16:14.589857+0000","last_active":"2024-09-12T01:16:14.589857+0000","last_peered":"2024-09-12T01:16:14.589857+0000","last_clean":"2024-09-12T01:16:14.589857+0000","last_became_active":"2024-09-12T00:02:52.064967+0000","last_became_peered":"2024-09-12T00:02:52.064967+0000","last_unstale":"2024-09-12T01:16:14.589857+0000","last_undegraded":"2024-09-12T01:16:14.589857+0000","last_fullsized":"2024-09-12T01:16:14.589857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.589757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.589757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.589757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:08.739218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'62","reported_seq":587,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.684858+0000","last_change":"2024-09-12T01:16:19.684858+0000","last_active":"2024-09-12T01:16:19.684858+0000","last_peered":"2024-09-12T01:16:19.684858+0000","last_clean":"2024-09-12T01:16:19.684858+0000","last_became_active":"2024-09-12T00:02:54.067255+0000","last_became_peered":"2024-09-12T00:02:54.067255+0000","last_unstale":"2024-09-12T01:16:19.684858+0000","last_undegraded":"2024-09-12T01:16:19.684858+0000","last_fullsized":"2024-09-12T01:16:19.684858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'62","last_scrub_stamp":"2024-09-12T01:16:19.684757+0000","last_deep_scrub":"267'62","last_deep_scrub_stamp":"2024-09-12T01:16:19.684757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.684757+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:16.708129+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.885028+0000","last_change":"2024-09-12T01:16:25.885028+0000","last_active":"2024-09-12T01:16:25.885028+0000","last_peered":"2024-09-12T01:16:25.885028+0000","last_clean":"2024-09-12T01:16:25.885028+0000","last_became_active":"2024-09-12T00:02:56.079057+0000","last_became_peered":"2024-09-12T00:02:56.079057+0000","last_unstale":"2024-09-12T01:16:25.885028+0000","last_undegraded":"2024-09-12T01:16:25.885028+0000","last_fullsized":"2024-09-12T01:16:25.885028+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.884902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.884902+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.884902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:53.091760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'187","reported_seq":719,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.610921+0000","last_change":"2024-09-12T01:16:29.610921+0000","last_active":"2024-09-12T01:16:29.610921+0000","last_peered":"2024-09-12T01:16:29.610921+0000","last_clean":"2024-09-12T01:16:29.610921+0000","last_became_active":"2024-09-12T00:02:58.091505+0000","last_became_peered":"2024-09-12T00:02:58.091505+0000","last_unstale":"2024-09-12T01:16:29.610921+0000","last_undegraded":"2024-09-12T01:16:29.610921+0000","last_fullsized":"2024-09-12T01:16:29.610921+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:16:29.610820+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:16:29.610820+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.610820+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:21.995692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":268,"num_read_kb":263,"num_write":396,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'447","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.608031+0000","last_change":"2024-09-12T01:16:06.608031+0000","last_active":"2024-09-12T01:16:06.608031+0000","last_peered":"2024-09-12T01:16:06.608031+0000","last_clean":"2024-09-12T01:16:06.608031+0000","last_became_active":"2024-09-12T00:02:50.068129+0000","last_became_peered":"2024-09-12T00:02:50.068129+0000","last_unstale":"2024-09-12T01:16:06.608031+0000","last_undegraded":"2024-09-12T01:16:06.608031+0000","last_fullsized":"2024-09-12T01:16:06.608031+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-12T01:16:06.607930+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-12T01:16:06.607930+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.607930+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:54.520447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2203,"num_read_kb":2070,"num_write":514,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'206","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.193472+0000","last_change":"2024-09-12T01:15:59.193472+0000","last_active":"2024-09-12T01:15:59.193472+0000","last_peered":"2024-09-12T01:15:59.193472+0000","last_clean":"2024-09-12T01:15:59.193472+0000","last_became_active":"2024-09-12T00:02:48.049791+0000","last_became_peered":"2024-09-12T00:02:48.049791+0000","last_unstale":"2024-09-12T01:15:59.193472+0000","last_undegraded":"2024-09-12T01:15:59.193472+0000","last_fullsized":"2024-09-12T01:15:59.193472+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'206","last_scrub_stamp":"2024-09-12T01:15:59.193369+0000","last_deep_scrub":"267'206","last_deep_scrub_stamp":"2024-09-12T01:15:59.193369+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.193369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:40.264107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":116478,"num_write":1001,"num_write_kb":35286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.873485+0000","last_change":"2024-09-12T01:16:16.873485+0000","last_active":"2024-09-12T01:16:16.873485+0000","last_peered":"2024-09-12T01:16:16.873485+0000","last_clean":"2024-09-12T01:16:16.873485+0000","last_became_active":"2024-09-12T00:02:52.071502+0000","last_became_peered":"2024-09-12T00:02:52.071502+0000","last_unstale":"2024-09-12T01:16:16.873485+0000","last_undegraded":"2024-09-12T01:16:16.873485+0000","last_fullsized":"2024-09-12T01:16:16.873485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.873383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.873383+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.873383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:10.546043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'208","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.605684+0000","last_change":"2024-09-12T01:16:21.605684+0000","last_active":"2024-09-12T01:16:21.605684+0000","last_peered":"2024-09-12T01:16:21.605684+0000","last_clean":"2024-09-12T01:16:21.605684+0000","last_became_active":"2024-09-12T00:02:54.067314+0000","last_became_peered":"2024-09-12T00:02:54.067314+0000","last_unstale":"2024-09-12T01:16:21.605684+0000","last_undegraded":"2024-09-12T01:16:21.605684+0000","last_fullsized":"2024-09-12T01:16:21.605684+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-12T01:16:21.605595+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-12T01:16:21.605595+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.605595+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.268586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18955,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":388,"num_write":160,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.477221+0000","last_change":"2024-09-12T01:16:15.477221+0000","last_active":"2024-09-12T01:16:15.477221+0000","last_peered":"2024-09-12T01:16:15.477221+0000","last_clean":"2024-09-12T01:16:15.477221+0000","last_became_active":"2024-09-12T00:02:56.084651+0000","last_became_peered":"2024-09-12T00:02:56.084651+0000","last_unstale":"2024-09-12T01:16:15.477221+0000","last_undegraded":"2024-09-12T01:16:15.477221+0000","last_fullsized":"2024-09-12T01:16:15.477221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.477139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.477139+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.477139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:59.506909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'157","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.147570+0000","last_change":"2024-09-12T01:16:34.147570+0000","last_active":"2024-09-12T01:16:34.147570+0000","last_peered":"2024-09-12T01:16:34.147570+0000","last_clean":"2024-09-12T01:16:34.147570+0000","last_became_active":"2024-09-12T00:02:58.099635+0000","last_became_peered":"2024-09-12T00:02:58.099635+0000","last_unstale":"2024-09-12T01:16:34.147570+0000","last_undegraded":"2024-09-12T01:16:34.147570+0000","last_fullsized":"2024-09-12T01:16:34.147570+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T01:16:34.147484+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T01:16:34.147484+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.147484+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:26.283946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":359,"num_read_kb":309,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'638","reported_seq":2530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.622238+0000","last_change":"2024-09-12T01:16:07.622238+0000","last_active":"2024-09-12T01:16:07.622238+0000","last_peered":"2024-09-12T01:16:07.622238+0000","last_clean":"2024-09-12T01:16:07.622238+0000","last_became_active":"2024-09-12T00:02:50.068518+0000","last_became_peered":"2024-09-12T00:02:50.068518+0000","last_unstale":"2024-09-12T01:16:07.622238+0000","last_undegraded":"2024-09-12T01:16:07.622238+0000","last_fullsized":"2024-09-12T01:16:07.622238+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'638","last_scrub_stamp":"2024-09-12T01:16:07.622152+0000","last_deep_scrub":"267'638","last_deep_scrub_stamp":"2024-09-12T01:16:07.622152+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.622152+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:11.149565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3685,"num_read_kb":3433,"num_write":846,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'197","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.883669+0000","last_change":"2024-09-12T01:15:57.883669+0000","last_active":"2024-09-12T01:15:57.883669+0000","last_peered":"2024-09-12T01:15:57.883669+0000","last_clean":"2024-09-12T01:15:57.883669+0000","last_became_active":"2024-09-12T00:02:48.054056+0000","last_became_peered":"2024-09-12T00:02:48.054056+0000","last_unstale":"2024-09-12T01:15:57.883669+0000","last_undegraded":"2024-09-12T01:15:57.883669+0000","last_fullsized":"2024-09-12T01:15:57.883669+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'197","last_scrub_stamp":"2024-09-12T01:15:57.883525+0000","last_deep_scrub":"267'197","last_deep_scrub_stamp":"2024-09-12T01:15:57.883525+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.883525+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.780477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493919,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":69874,"num_write":900,"num_write_kb":25144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.392046+0000","last_change":"2024-09-12T01:16:10.392046+0000","last_active":"2024-09-12T01:16:10.392046+0000","last_peered":"2024-09-12T01:16:10.392046+0000","last_clean":"2024-09-12T01:16:10.392046+0000","last_became_active":"2024-09-12T00:02:52.064441+0000","last_became_peered":"2024-09-12T00:02:52.064441+0000","last_unstale":"2024-09-12T01:16:10.392046+0000","last_undegraded":"2024-09-12T01:16:10.392046+0000","last_fullsized":"2024-09-12T01:16:10.392046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.391958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.391958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.391958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:22.111524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'145","reported_seq":736,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.891145+0000","last_change":"2024-09-12T01:16:20.891145+0000","last_active":"2024-09-12T01:16:20.891145+0000","last_peered":"2024-09-12T01:16:20.891145+0000","last_clean":"2024-09-12T01:16:20.891145+0000","last_became_active":"2024-09-12T00:02:54.066900+0000","last_became_peered":"2024-09-12T00:02:54.066900+0000","last_unstale":"2024-09-12T01:16:20.891145+0000","last_undegraded":"2024-09-12T01:16:20.891145+0000","last_fullsized":"2024-09-12T01:16:20.891145+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'145","last_scrub_stamp":"2024-09-12T01:16:20.891064+0000","last_deep_scrub":"267'145","last_deep_scrub_stamp":"2024-09-12T01:16:20.891064+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.891064+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:59.572392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.562956+0000","last_change":"2024-09-12T01:16:23.562956+0000","last_active":"2024-09-12T01:16:23.562956+0000","last_peered":"2024-09-12T01:16:23.562956+0000","last_clean":"2024-09-12T01:16:23.562956+0000","last_became_active":"2024-09-12T00:02:56.084454+0000","last_became_peered":"2024-09-12T00:02:56.084454+0000","last_unstale":"2024-09-12T01:16:23.562956+0000","last_undegraded":"2024-09-12T01:16:23.562956+0000","last_fullsized":"2024-09-12T01:16:23.562956+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.562866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.562866+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.562866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.666113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'814","reported_seq":2296,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.492864+0000","last_change":"2024-09-12T01:16:06.492864+0000","last_active":"2024-09-12T01:16:06.492864+0000","last_peered":"2024-09-12T01:16:06.492864+0000","last_clean":"2024-09-12T01:16:06.492864+0000","last_became_active":"2024-09-12T00:02:50.072570+0000","last_became_peered":"2024-09-12T00:02:50.072570+0000","last_unstale":"2024-09-12T01:16:06.492864+0000","last_undegraded":"2024-09-12T01:16:06.492864+0000","last_fullsized":"2024-09-12T01:16:06.492864+0000","mapping_epoch":28,"log_start":"267'801","ondisk_log_start":"267'801","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'814","last_scrub_stamp":"2024-09-12T01:16:06.492765+0000","last_deep_scrub":"267'814","last_deep_scrub_stamp":"2024-09-12T01:16:06.492765+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.492765+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":801,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.698227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3795,"num_read_kb":3393,"num_write":1092,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1437,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'152","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.794883+0000","last_change":"2024-09-12T01:15:58.794883+0000","last_active":"2024-09-12T01:15:58.794883+0000","last_peered":"2024-09-12T01:15:58.794883+0000","last_clean":"2024-09-12T01:15:58.794883+0000","last_became_active":"2024-09-12T00:02:48.050025+0000","last_became_peered":"2024-09-12T00:02:48.050025+0000","last_unstale":"2024-09-12T01:15:58.794883+0000","last_undegraded":"2024-09-12T01:15:58.794883+0000","last_fullsized":"2024-09-12T01:15:58.794883+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:15:58.794742+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:15:58.794742+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.794742+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:46.260076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":278,"num_read_kb":9330,"num_write":746,"num_write_kb":34876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.683097+0000","last_change":"2024-09-12T01:16:13.683097+0000","last_active":"2024-09-12T01:16:13.683097+0000","last_peered":"2024-09-12T01:16:13.683097+0000","last_clean":"2024-09-12T01:16:13.683097+0000","last_became_active":"2024-09-12T00:02:52.071201+0000","last_became_peered":"2024-09-12T00:02:52.071201+0000","last_unstale":"2024-09-12T01:16:13.683097+0000","last_undegraded":"2024-09-12T01:16:13.683097+0000","last_fullsized":"2024-09-12T01:16:13.683097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.683003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.683003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.683003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:16.153780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'230","reported_seq":893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.270920+0000","last_change":"2024-09-12T01:16:17.270920+0000","last_active":"2024-09-12T01:16:17.270920+0000","last_peered":"2024-09-12T01:16:17.270920+0000","last_clean":"2024-09-12T01:16:17.270920+0000","last_became_active":"2024-09-12T00:02:54.073541+0000","last_became_peered":"2024-09-12T00:02:54.073541+0000","last_unstale":"2024-09-12T01:16:17.270920+0000","last_undegraded":"2024-09-12T01:16:17.270920+0000","last_fullsized":"2024-09-12T01:16:17.270920+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-12T01:16:17.270842+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-12T01:16:17.270842+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.270842+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:18.778181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15168,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":358,"num_read_kb":528,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.303594+0000","last_change":"2024-09-12T01:16:28.303594+0000","last_active":"2024-09-12T01:16:28.303594+0000","last_peered":"2024-09-12T01:16:28.303594+0000","last_clean":"2024-09-12T01:16:28.303594+0000","last_became_active":"2024-09-12T00:02:56.084627+0000","last_became_peered":"2024-09-12T00:02:56.084627+0000","last_unstale":"2024-09-12T01:16:28.303594+0000","last_undegraded":"2024-09-12T01:16:28.303594+0000","last_fullsized":"2024-09-12T01:16:28.303594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:28.303500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:28.303500+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.303500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:20.250220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'186","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.631872+0000","last_change":"2024-09-12T01:16:31.631872+0000","last_active":"2024-09-12T01:16:31.631872+0000","last_peered":"2024-09-12T01:16:31.631872+0000","last_clean":"2024-09-12T01:16:31.631872+0000","last_became_active":"2024-09-12T00:02:58.089750+0000","last_became_peered":"2024-09-12T00:02:58.089750+0000","last_unstale":"2024-09-12T01:16:31.631872+0000","last_undegraded":"2024-09-12T01:16:31.631872+0000","last_fullsized":"2024-09-12T01:16:31.631872+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-12T01:16:31.631772+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-12T01:16:31.631772+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.631772+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:29.946650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":234,"num_read_kb":235,"num_write":422,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'480","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.730708+0000","last_change":"2024-09-12T01:16:08.730708+0000","last_active":"2024-09-12T01:16:08.730708+0000","last_peered":"2024-09-12T01:16:08.730708+0000","last_clean":"2024-09-12T01:16:08.730708+0000","last_became_active":"2024-09-12T00:02:50.064157+0000","last_became_peered":"2024-09-12T00:02:50.064157+0000","last_unstale":"2024-09-12T01:16:08.730708+0000","last_undegraded":"2024-09-12T01:16:08.730708+0000","last_fullsized":"2024-09-12T01:16:08.730708+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'480","last_scrub_stamp":"2024-09-12T01:16:08.730614+0000","last_deep_scrub":"267'480","last_deep_scrub_stamp":"2024-09-12T01:16:08.730614+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.730614+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:57.895222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2183,"num_write":585,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1892,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'252","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.084847+0000","last_change":"2024-09-12T01:15:58.084847+0000","last_active":"2024-09-12T01:15:58.084847+0000","last_peered":"2024-09-12T01:15:58.084847+0000","last_clean":"2024-09-12T01:15:58.084847+0000","last_became_active":"2024-09-12T00:02:48.053055+0000","last_became_peered":"2024-09-12T00:02:48.053055+0000","last_unstale":"2024-09-12T01:15:58.084847+0000","last_undegraded":"2024-09-12T01:15:58.084847+0000","last_fullsized":"2024-09-12T01:15:58.084847+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'252","last_scrub_stamp":"2024-09-12T01:15:58.084728+0000","last_deep_scrub":"267'252","last_deep_scrub_stamp":"2024-09-12T01:15:58.084728+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.084728+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:42.507269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":662,"num_read_kb":2689,"num_write":1334,"num_write_kb":25481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.423609+0000","last_change":"2024-09-12T01:16:11.423609+0000","last_active":"2024-09-12T01:16:11.423609+0000","last_peered":"2024-09-12T01:16:11.423609+0000","last_clean":"2024-09-12T01:16:11.423609+0000","last_became_active":"2024-09-12T00:02:52.060034+0000","last_became_peered":"2024-09-12T00:02:52.060034+0000","last_unstale":"2024-09-12T01:16:11.423609+0000","last_undegraded":"2024-09-12T01:16:11.423609+0000","last_fullsized":"2024-09-12T01:16:11.423609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:11.423519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:11.423519+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.423519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:10.571986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'205","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.878921+0000","last_change":"2024-09-12T01:16:23.878921+0000","last_active":"2024-09-12T01:16:23.878921+0000","last_peered":"2024-09-12T01:16:23.878921+0000","last_clean":"2024-09-12T01:16:23.878921+0000","last_became_active":"2024-09-12T00:02:54.066854+0000","last_became_peered":"2024-09-12T00:02:54.066854+0000","last_unstale":"2024-09-12T01:16:23.878921+0000","last_undegraded":"2024-09-12T01:16:23.878921+0000","last_fullsized":"2024-09-12T01:16:23.878921+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'205","last_scrub_stamp":"2024-09-12T01:16:23.878805+0000","last_deep_scrub":"267'205","last_deep_scrub_stamp":"2024-09-12T01:16:23.878805+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.878805+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:02.656337+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":290,"num_read_kb":407,"num_write":194,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.314619+0000","last_change":"2024-09-12T01:16:18.314619+0000","last_active":"2024-09-12T01:16:18.314619+0000","last_peered":"2024-09-12T01:16:18.314619+0000","last_clean":"2024-09-12T01:16:18.314619+0000","last_became_active":"2024-09-12T00:02:56.086349+0000","last_became_peered":"2024-09-12T00:02:56.086349+0000","last_unstale":"2024-09-12T01:16:18.314619+0000","last_undegraded":"2024-09-12T01:16:18.314619+0000","last_fullsized":"2024-09-12T01:16:18.314619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.314499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.314499+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.314499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:29.781773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'176","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.366518+0000","last_change":"2024-09-12T01:16:19.366518+0000","last_active":"2024-09-12T01:16:19.366518+0000","last_peered":"2024-09-12T01:16:19.366518+0000","last_clean":"2024-09-12T01:16:19.366518+0000","last_became_active":"2024-09-12T00:02:58.100646+0000","last_became_peered":"2024-09-12T00:02:58.100646+0000","last_unstale":"2024-09-12T01:16:19.366518+0000","last_undegraded":"2024-09-12T01:16:19.366518+0000","last_fullsized":"2024-09-12T01:16:19.366518+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'176","last_scrub_stamp":"2024-09-12T01:16:19.366420+0000","last_deep_scrub":"267'176","last_deep_scrub_stamp":"2024-09-12T01:16:19.366420+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.366420+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:32.801190+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":591,"num_write":465,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'697","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.619187+0000","last_change":"2024-09-12T01:16:10.619187+0000","last_active":"2024-09-12T01:16:10.619187+0000","last_peered":"2024-09-12T01:16:10.619187+0000","last_clean":"2024-09-12T01:16:10.619187+0000","last_became_active":"2024-09-12T00:02:50.072665+0000","last_became_peered":"2024-09-12T00:02:50.072665+0000","last_unstale":"2024-09-12T01:16:10.619187+0000","last_undegraded":"2024-09-12T01:16:10.619187+0000","last_fullsized":"2024-09-12T01:16:10.619187+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'697","last_scrub_stamp":"2024-09-12T01:16:10.619098+0000","last_deep_scrub":"267'697","last_deep_scrub_stamp":"2024-09-12T01:16:10.619098+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.619098+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:07.282926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3202,"num_read_kb":2877,"num_write":917,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'241","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.110405+0000","last_change":"2024-09-12T01:15:56.110405+0000","last_active":"2024-09-12T01:15:56.110405+0000","last_peered":"2024-09-12T01:15:56.110405+0000","last_clean":"2024-09-12T01:15:56.110405+0000","last_became_active":"2024-09-12T00:03:21.140095+0000","last_became_peered":"2024-09-12T00:03:21.140095+0000","last_unstale":"2024-09-12T01:15:56.110405+0000","last_undegraded":"2024-09-12T01:15:56.110405+0000","last_fullsized":"2024-09-12T01:15:56.110405+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-12T01:15:56.110316+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-12T01:15:56.110316+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.110316+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:39.287721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":39289,"num_write":1009,"num_write_kb":58524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.903046+0000","last_change":"2024-09-12T01:16:16.903046+0000","last_active":"2024-09-12T01:16:16.903046+0000","last_peered":"2024-09-12T01:16:16.903046+0000","last_clean":"2024-09-12T01:16:16.903046+0000","last_became_active":"2024-09-12T00:02:52.063334+0000","last_became_peered":"2024-09-12T00:02:52.063334+0000","last_unstale":"2024-09-12T01:16:16.903046+0000","last_undegraded":"2024-09-12T01:16:16.903046+0000","last_fullsized":"2024-09-12T01:16:16.903046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.902950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.902950+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.902950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:50.260846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'178","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.600551+0000","last_change":"2024-09-12T01:16:18.600551+0000","last_active":"2024-09-12T01:16:18.600551+0000","last_peered":"2024-09-12T01:16:18.600551+0000","last_clean":"2024-09-12T01:16:18.600551+0000","last_became_active":"2024-09-12T00:02:54.240007+0000","last_became_peered":"2024-09-12T00:02:54.240007+0000","last_unstale":"2024-09-12T01:16:18.600551+0000","last_undegraded":"2024-09-12T01:16:18.600551+0000","last_fullsized":"2024-09-12T01:16:18.600551+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'178","last_scrub_stamp":"2024-09-12T01:16:18.600451+0000","last_deep_scrub":"267'178","last_deep_scrub_stamp":"2024-09-12T01:16:18.600451+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.600451+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:24.259892+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":288,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.309231+0000","last_change":"2024-09-12T01:16:19.309231+0000","last_active":"2024-09-12T01:16:19.309231+0000","last_peered":"2024-09-12T01:16:19.309231+0000","last_clean":"2024-09-12T01:16:19.309231+0000","last_became_active":"2024-09-12T00:02:56.087317+0000","last_became_peered":"2024-09-12T00:02:56.087317+0000","last_unstale":"2024-09-12T01:16:19.309231+0000","last_undegraded":"2024-09-12T01:16:19.309231+0000","last_fullsized":"2024-09-12T01:16:19.309231+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:19.309148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:19.309148+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.309148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:20.598859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'151","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.214600+0000","last_change":"2024-09-12T01:16:32.214600+0000","last_active":"2024-09-12T01:16:32.214600+0000","last_peered":"2024-09-12T01:16:32.214600+0000","last_clean":"2024-09-12T01:16:32.214600+0000","last_became_active":"2024-09-12T00:02:58.099712+0000","last_became_peered":"2024-09-12T00:02:58.099712+0000","last_unstale":"2024-09-12T01:16:32.214600+0000","last_undegraded":"2024-09-12T01:16:32.214600+0000","last_fullsized":"2024-09-12T01:16:32.214600+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-12T01:16:32.214514+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-12T01:16:32.214514+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.214514+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.161826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'710","reported_seq":2420,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.262576+0000","last_change":"2024-09-12T01:16:02.262576+0000","last_active":"2024-09-12T01:16:02.262576+0000","last_peered":"2024-09-12T01:16:02.262576+0000","last_clean":"2024-09-12T01:16:02.262576+0000","last_became_active":"2024-09-12T00:02:50.061909+0000","last_became_peered":"2024-09-12T00:02:50.061909+0000","last_unstale":"2024-09-12T01:16:02.262576+0000","last_undegraded":"2024-09-12T01:16:02.262576+0000","last_fullsized":"2024-09-12T01:16:02.262576+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'710","last_scrub_stamp":"2024-09-12T01:16:02.262485+0000","last_deep_scrub":"267'710","last_deep_scrub_stamp":"2024-09-12T01:16:02.262485+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.262485+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":600,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:26.931797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3690,"num_read_kb":3334,"num_write":961,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1922,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'201","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.918024+0000","last_change":"2024-09-12T01:15:56.918024+0000","last_active":"2024-09-12T01:15:56.918024+0000","last_peered":"2024-09-12T01:15:56.918024+0000","last_clean":"2024-09-12T01:15:56.918024+0000","last_became_active":"2024-09-12T00:02:48.050894+0000","last_became_peered":"2024-09-12T00:02:48.050894+0000","last_unstale":"2024-09-12T01:15:56.918024+0000","last_undegraded":"2024-09-12T01:15:56.918024+0000","last_fullsized":"2024-09-12T01:15:56.918024+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:15:56.917926+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:15:56.917926+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.917926+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:57.174009+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409979,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":20890,"num_write":1012,"num_write_kb":39832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.203493+0000","last_change":"2024-09-12T01:16:13.203493+0000","last_active":"2024-09-12T01:16:13.203493+0000","last_peered":"2024-09-12T01:16:13.203493+0000","last_clean":"2024-09-12T01:16:13.203493+0000","last_became_active":"2024-09-12T00:02:52.064125+0000","last_became_peered":"2024-09-12T00:02:52.064125+0000","last_unstale":"2024-09-12T01:16:13.203493+0000","last_undegraded":"2024-09-12T01:16:13.203493+0000","last_fullsized":"2024-09-12T01:16:13.203493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.203371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.203371+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.203371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:07.040646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'118","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.966454+0000","last_change":"2024-09-12T01:16:22.966454+0000","last_active":"2024-09-12T01:16:22.966454+0000","last_peered":"2024-09-12T01:16:22.966454+0000","last_clean":"2024-09-12T01:16:22.966454+0000","last_became_active":"2024-09-12T00:02:54.239412+0000","last_became_peered":"2024-09-12T00:02:54.239412+0000","last_unstale":"2024-09-12T01:16:22.966454+0000","last_undegraded":"2024-09-12T01:16:22.966454+0000","last_fullsized":"2024-09-12T01:16:22.966454+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:16:22.966358+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:16:22.966358+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.966358+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:38.921115+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'772","reported_seq":2654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.441107+0000","last_change":"2024-09-12T01:16:17.441107+0000","last_active":"2024-09-12T01:16:17.441107+0000","last_peered":"2024-09-12T01:16:17.441107+0000","last_clean":"2024-09-12T01:16:17.441107+0000","last_became_active":"2024-09-12T00:02:56.080374+0000","last_became_peered":"2024-09-12T00:02:56.080374+0000","last_unstale":"2024-09-12T01:16:17.441107+0000","last_undegraded":"2024-09-12T01:16:17.441107+0000","last_fullsized":"2024-09-12T01:16:17.441107+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'772","last_scrub_stamp":"2024-09-12T01:16:17.441017+0000","last_deep_scrub":"267'772","last_deep_scrub_stamp":"2024-09-12T01:16:17.441017+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.441017+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:39.610983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'117","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.798101+0000","last_change":"2024-09-12T01:16:28.798101+0000","last_active":"2024-09-12T01:16:28.798101+0000","last_peered":"2024-09-12T01:16:28.798101+0000","last_clean":"2024-09-12T01:16:28.798101+0000","last_became_active":"2024-09-12T00:02:58.100777+0000","last_became_peered":"2024-09-12T00:02:58.100777+0000","last_unstale":"2024-09-12T01:16:28.798101+0000","last_undegraded":"2024-09-12T01:16:28.798101+0000","last_fullsized":"2024-09-12T01:16:28.798101+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:16:28.798015+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:16:28.798015+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.798015+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:32.708838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'476","reported_seq":2046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.851836+0000","last_change":"2024-09-12T01:16:06.851836+0000","last_active":"2024-09-12T01:16:06.851836+0000","last_peered":"2024-09-12T01:16:06.851836+0000","last_clean":"2024-09-12T01:16:06.851836+0000","last_became_active":"2024-09-12T00:02:50.070186+0000","last_became_peered":"2024-09-12T00:02:50.070186+0000","last_unstale":"2024-09-12T01:16:06.851836+0000","last_undegraded":"2024-09-12T01:16:06.851836+0000","last_fullsized":"2024-09-12T01:16:06.851836+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'476","last_scrub_stamp":"2024-09-12T01:16:06.851723+0000","last_deep_scrub":"267'476","last_deep_scrub_stamp":"2024-09-12T01:16:06.851723+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.851723+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:58.941621+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2560,"num_read_kb":2381,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'280","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.159485+0000","last_change":"2024-09-12T01:16:01.159485+0000","last_active":"2024-09-12T01:16:01.159485+0000","last_peered":"2024-09-12T01:16:01.159485+0000","last_clean":"2024-09-12T01:16:01.159485+0000","last_became_active":"2024-09-12T00:02:48.054303+0000","last_became_peered":"2024-09-12T00:02:48.054303+0000","last_unstale":"2024-09-12T01:16:01.159485+0000","last_undegraded":"2024-09-12T01:16:01.159485+0000","last_fullsized":"2024-09-12T01:16:01.159485+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'280","last_scrub_stamp":"2024-09-12T01:16:01.159368+0000","last_deep_scrub":"267'280","last_deep_scrub_stamp":"2024-09-12T01:16:01.159368+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.159368+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:04.113014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":47582,"num_write":1191,"num_write_kb":28572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.873818+0000","last_change":"2024-09-12T01:16:18.873818+0000","last_active":"2024-09-12T01:16:18.873818+0000","last_peered":"2024-09-12T01:16:18.873818+0000","last_clean":"2024-09-12T01:16:18.873818+0000","last_became_active":"2024-09-12T00:02:52.071580+0000","last_became_peered":"2024-09-12T00:02:52.071580+0000","last_unstale":"2024-09-12T01:16:18.873818+0000","last_undegraded":"2024-09-12T01:16:18.873818+0000","last_fullsized":"2024-09-12T01:16:18.873818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.873734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.873734+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.873734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:59.300868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'240","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.283472+0000","last_change":"2024-09-12T01:16:26.283472+0000","last_active":"2024-09-12T01:16:26.283472+0000","last_peered":"2024-09-12T01:16:26.283472+0000","last_clean":"2024-09-12T01:16:26.283472+0000","last_became_active":"2024-09-12T00:02:54.068806+0000","last_became_peered":"2024-09-12T00:02:54.068806+0000","last_unstale":"2024-09-12T01:16:26.283472+0000","last_undegraded":"2024-09-12T01:16:26.283472+0000","last_fullsized":"2024-09-12T01:16:26.283472+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-12T01:16:26.283363+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-12T01:16:26.283363+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.283363+0000","objects_scrubbed":11,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:44.646018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9605,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":355,"num_write":182,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.608463+0000","last_change":"2024-09-12T01:16:24.608463+0000","last_active":"2024-09-12T01:16:24.608463+0000","last_peered":"2024-09-12T01:16:24.608463+0000","last_clean":"2024-09-12T01:16:24.608463+0000","last_became_active":"2024-09-12T00:02:56.082924+0000","last_became_peered":"2024-09-12T00:02:56.082924+0000","last_unstale":"2024-09-12T01:16:24.608463+0000","last_undegraded":"2024-09-12T01:16:24.608463+0000","last_fullsized":"2024-09-12T01:16:24.608463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.608368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.608368+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.608368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:33.741139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'111","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.807213+0000","last_change":"2024-09-12T01:16:29.807213+0000","last_active":"2024-09-12T01:16:29.807213+0000","last_peered":"2024-09-12T01:16:29.807213+0000","last_clean":"2024-09-12T01:16:29.807213+0000","last_became_active":"2024-09-12T00:02:58.099683+0000","last_became_peered":"2024-09-12T00:02:58.099683+0000","last_unstale":"2024-09-12T01:16:29.807213+0000","last_undegraded":"2024-09-12T01:16:29.807213+0000","last_fullsized":"2024-09-12T01:16:29.807213+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-12T01:16:29.807131+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-12T01:16:29.807131+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.807131+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:24.107285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":199,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'542","reported_seq":2277,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.811930+0000","last_change":"2024-09-12T01:16:05.811930+0000","last_active":"2024-09-12T01:16:05.811930+0000","last_peered":"2024-09-12T01:16:05.811930+0000","last_clean":"2024-09-12T01:16:05.811930+0000","last_became_active":"2024-09-12T00:02:50.069907+0000","last_became_peered":"2024-09-12T00:02:50.069907+0000","last_unstale":"2024-09-12T01:16:05.811930+0000","last_undegraded":"2024-09-12T01:16:05.811930+0000","last_fullsized":"2024-09-12T01:16:05.811930+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'542","last_scrub_stamp":"2024-09-12T01:16:05.811845+0000","last_deep_scrub":"267'542","last_deep_scrub_stamp":"2024-09-12T01:16:05.811845+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.811845+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:24.596886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2946,"num_read_kb":2752,"num_write":643,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2534,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'210","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.207922+0000","last_change":"2024-09-12T01:16:02.207922+0000","last_active":"2024-09-12T01:16:02.207922+0000","last_peered":"2024-09-12T01:16:02.207922+0000","last_clean":"2024-09-12T01:16:02.207922+0000","last_became_active":"2024-09-12T00:02:48.052303+0000","last_became_peered":"2024-09-12T00:02:48.052303+0000","last_unstale":"2024-09-12T01:16:02.207922+0000","last_undegraded":"2024-09-12T01:16:02.207922+0000","last_fullsized":"2024-09-12T01:16:02.207922+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:16:02.207773+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:16:02.207773+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.207773+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:42.794663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":51729,"num_write":985,"num_write_kb":45446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.309309+0000","last_change":"2024-09-12T01:16:22.309309+0000","last_active":"2024-09-12T01:16:22.309309+0000","last_peered":"2024-09-12T01:16:22.309309+0000","last_clean":"2024-09-12T01:16:22.309309+0000","last_became_active":"2024-09-12T00:02:52.065653+0000","last_became_peered":"2024-09-12T00:02:52.065653+0000","last_unstale":"2024-09-12T01:16:22.309309+0000","last_undegraded":"2024-09-12T01:16:22.309309+0000","last_fullsized":"2024-09-12T01:16:22.309309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:22.309220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:22.309220+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.309220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:12.264453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'156","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.658573+0000","last_change":"2024-09-12T01:16:16.658573+0000","last_active":"2024-09-12T01:16:16.658573+0000","last_peered":"2024-09-12T01:16:16.658573+0000","last_clean":"2024-09-12T01:16:16.658573+0000","last_became_active":"2024-09-12T00:02:54.073930+0000","last_became_peered":"2024-09-12T00:02:54.073930+0000","last_unstale":"2024-09-12T01:16:16.658573+0000","last_undegraded":"2024-09-12T01:16:16.658573+0000","last_fullsized":"2024-09-12T01:16:16.658573+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:16.658478+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:16.658478+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.658478+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:59.460201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4988,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":267,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.429953+0000","last_change":"2024-09-12T01:16:16.429953+0000","last_active":"2024-09-12T01:16:16.429953+0000","last_peered":"2024-09-12T01:16:16.429953+0000","last_clean":"2024-09-12T01:16:16.429953+0000","last_became_active":"2024-09-12T00:02:56.078528+0000","last_became_peered":"2024-09-12T00:02:56.078528+0000","last_unstale":"2024-09-12T01:16:16.429953+0000","last_undegraded":"2024-09-12T01:16:16.429953+0000","last_fullsized":"2024-09-12T01:16:16.429953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.429865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.429865+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.429865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:38.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'100","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.619012+0000","last_change":"2024-09-12T01:16:32.619012+0000","last_active":"2024-09-12T01:16:32.619012+0000","last_peered":"2024-09-12T01:16:32.619012+0000","last_clean":"2024-09-12T01:16:32.619012+0000","last_became_active":"2024-09-12T00:02:58.087199+0000","last_became_peered":"2024-09-12T00:02:58.087199+0000","last_unstale":"2024-09-12T01:16:32.619012+0000","last_undegraded":"2024-09-12T01:16:32.619012+0000","last_fullsized":"2024-09-12T01:16:32.619012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-09-12T01:16:32.618924+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-09-12T01:16:32.618924+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.618924+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:51.132932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":246,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'470","reported_seq":2094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.613518+0000","last_change":"2024-09-12T01:16:08.613518+0000","last_active":"2024-09-12T01:16:08.613518+0000","last_peered":"2024-09-12T01:16:08.613518+0000","last_clean":"2024-09-12T01:16:08.613518+0000","last_became_active":"2024-09-12T00:02:50.072920+0000","last_became_peered":"2024-09-12T00:02:50.072920+0000","last_unstale":"2024-09-12T01:16:08.613518+0000","last_undegraded":"2024-09-12T01:16:08.613518+0000","last_fullsized":"2024-09-12T01:16:08.613518+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'470","last_scrub_stamp":"2024-09-12T01:16:08.613412+0000","last_deep_scrub":"267'470","last_deep_scrub_stamp":"2024-09-12T01:16:08.613412+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.613412+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:17.773006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2371,"num_write":566,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'212","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.772435+0000","last_change":"2024-09-12T01:15:59.772435+0000","last_active":"2024-09-12T01:15:59.772435+0000","last_peered":"2024-09-12T01:15:59.772435+0000","last_clean":"2024-09-12T01:15:59.772435+0000","last_became_active":"2024-09-12T00:02:48.048308+0000","last_became_peered":"2024-09-12T00:02:48.048308+0000","last_unstale":"2024-09-12T01:15:59.772435+0000","last_undegraded":"2024-09-12T01:15:59.772435+0000","last_fullsized":"2024-09-12T01:15:59.772435+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-12T01:15:59.772317+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-12T01:15:59.772317+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.772317+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:08.055567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":37398,"num_write":997,"num_write_kb":57972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.947366+0000","last_change":"2024-09-12T01:16:15.947366+0000","last_active":"2024-09-12T01:16:15.947366+0000","last_peered":"2024-09-12T01:16:15.947366+0000","last_clean":"2024-09-12T01:16:15.947366+0000","last_became_active":"2024-09-12T00:02:52.060283+0000","last_became_peered":"2024-09-12T00:02:52.060283+0000","last_unstale":"2024-09-12T01:16:15.947366+0000","last_undegraded":"2024-09-12T01:16:15.947366+0000","last_fullsized":"2024-09-12T01:16:15.947366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.947271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.947271+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.947271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:50.354609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'129","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.553123+0000","last_change":"2024-09-12T01:16:25.553123+0000","last_active":"2024-09-12T01:16:25.553123+0000","last_peered":"2024-09-12T01:16:25.553123+0000","last_clean":"2024-09-12T01:16:25.553123+0000","last_became_active":"2024-09-12T00:02:54.067770+0000","last_became_peered":"2024-09-12T00:02:54.067770+0000","last_unstale":"2024-09-12T01:16:25.553123+0000","last_undegraded":"2024-09-12T01:16:25.553123+0000","last_fullsized":"2024-09-12T01:16:25.553123+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:16:25.553018+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:16:25.553018+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.553018+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:22.835758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4641,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":72,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.958170+0000","last_change":"2024-09-12T01:16:25.958170+0000","last_active":"2024-09-12T01:16:25.958170+0000","last_peered":"2024-09-12T01:16:25.958170+0000","last_clean":"2024-09-12T01:16:25.958170+0000","last_became_active":"2024-09-12T00:02:56.077573+0000","last_became_peered":"2024-09-12T00:02:56.077573+0000","last_unstale":"2024-09-12T01:16:25.958170+0000","last_undegraded":"2024-09-12T01:16:25.958170+0000","last_fullsized":"2024-09-12T01:16:25.958170+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.958065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.958065+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.958065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:05.572857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'152","reported_seq":1261,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.845895+0000","last_change":"2024-09-12T01:16:30.845895+0000","last_active":"2024-09-12T01:16:30.845895+0000","last_peered":"2024-09-12T01:16:30.845895+0000","last_clean":"2024-09-12T01:16:30.845895+0000","last_became_active":"2024-09-12T00:02:58.099426+0000","last_became_peered":"2024-09-12T00:02:58.099426+0000","last_unstale":"2024-09-12T01:16:30.845895+0000","last_undegraded":"2024-09-12T01:16:30.845895+0000","last_fullsized":"2024-09-12T01:16:30.845895+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:16:30.845804+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:16:30.845804+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.845804+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:58.749136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":755,"num_read_kb":754,"num_write":338,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'471","reported_seq":1967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.778780+0000","last_change":"2024-09-12T01:16:04.778780+0000","last_active":"2024-09-12T01:16:04.778780+0000","last_peered":"2024-09-12T01:16:04.778780+0000","last_clean":"2024-09-12T01:16:04.778780+0000","last_became_active":"2024-09-12T00:02:50.063959+0000","last_became_peered":"2024-09-12T00:02:50.063959+0000","last_unstale":"2024-09-12T01:16:04.778780+0000","last_undegraded":"2024-09-12T01:16:04.778780+0000","last_fullsized":"2024-09-12T01:16:04.778780+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'471","last_scrub_stamp":"2024-09-12T01:16:04.778701+0000","last_deep_scrub":"267'471","last_deep_scrub_stamp":"2024-09-12T01:16:04.778701+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.778701+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:30.342027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2471,"num_read_kb":2277,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":708,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'193","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.857061+0000","last_change":"2024-09-12T01:15:58.857061+0000","last_active":"2024-09-12T01:15:58.857061+0000","last_peered":"2024-09-12T01:15:58.857061+0000","last_clean":"2024-09-12T01:15:58.857061+0000","last_became_active":"2024-09-12T00:02:48.054650+0000","last_became_peered":"2024-09-12T00:02:48.054650+0000","last_unstale":"2024-09-12T01:15:58.857061+0000","last_undegraded":"2024-09-12T01:15:58.857061+0000","last_fullsized":"2024-09-12T01:15:58.857061+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:15:58.856935+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:15:58.856935+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.856935+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:00.850043+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250177,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":59687,"num_write":954,"num_write_kb":41766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'6","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.157400+0000","last_change":"2024-09-12T01:16:11.157400+0000","last_active":"2024-09-12T01:16:11.157400+0000","last_peered":"2024-09-12T01:16:11.157400+0000","last_clean":"2024-09-12T01:16:11.157400+0000","last_became_active":"2024-09-12T00:02:52.065804+0000","last_became_peered":"2024-09-12T00:02:52.065804+0000","last_unstale":"2024-09-12T01:16:11.157400+0000","last_undegraded":"2024-09-12T01:16:11.157400+0000","last_fullsized":"2024-09-12T01:16:11.157400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:11.157309+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:11.157309+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.157309+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.232298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'187","reported_seq":809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.015357+0000","last_change":"2024-09-12T01:16:22.015357+0000","last_active":"2024-09-12T01:16:22.015357+0000","last_peered":"2024-09-12T01:16:22.015357+0000","last_clean":"2024-09-12T01:16:22.015357+0000","last_became_active":"2024-09-12T00:02:54.066918+0000","last_became_peered":"2024-09-12T00:02:54.066918+0000","last_unstale":"2024-09-12T01:16:22.015357+0000","last_undegraded":"2024-09-12T01:16:22.015357+0000","last_fullsized":"2024-09-12T01:16:22.015357+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:16:22.015263+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:16:22.015263+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.015263+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:07.799810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":266,"num_write":140,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.606996+0000","last_change":"2024-09-12T01:16:25.606996+0000","last_active":"2024-09-12T01:16:25.606996+0000","last_peered":"2024-09-12T01:16:25.606996+0000","last_clean":"2024-09-12T01:16:25.606996+0000","last_became_active":"2024-09-12T00:02:56.084768+0000","last_became_peered":"2024-09-12T00:02:56.084768+0000","last_unstale":"2024-09-12T01:16:25.606996+0000","last_undegraded":"2024-09-12T01:16:25.606996+0000","last_fullsized":"2024-09-12T01:16:25.606996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.606905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.606905+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.606905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:39.095761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'157","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.961917+0000","last_change":"2024-09-12T01:16:28.961917+0000","last_active":"2024-09-12T01:16:28.961917+0000","last_peered":"2024-09-12T01:16:28.961917+0000","last_clean":"2024-09-12T01:16:28.961917+0000","last_became_active":"2024-09-12T00:02:58.097725+0000","last_became_peered":"2024-09-12T00:02:58.097725+0000","last_unstale":"2024-09-12T01:16:28.961917+0000","last_undegraded":"2024-09-12T01:16:28.961917+0000","last_fullsized":"2024-09-12T01:16:28.961917+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T01:16:28.961825+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T01:16:28.961825+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.961825+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:36.526169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":109,"num_write":343,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'692","reported_seq":2204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.205253+0000","last_change":"2024-09-12T01:16:12.205191+0000","last_active":"2024-09-12T01:16:12.205253+0000","last_peered":"2024-09-12T01:16:12.205253+0000","last_clean":"2024-09-12T01:16:12.205253+0000","last_became_active":"2024-09-12T00:02:50.064354+0000","last_became_peered":"2024-09-12T00:02:50.064354+0000","last_unstale":"2024-09-12T01:16:12.205253+0000","last_undegraded":"2024-09-12T01:16:12.205253+0000","last_fullsized":"2024-09-12T01:16:12.205253+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'692","last_scrub_stamp":"2024-09-12T01:16:12.205104+0000","last_deep_scrub":"267'692","last_deep_scrub_stamp":"2024-09-12T01:16:12.205104+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.205104+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:42.512342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3412,"num_read_kb":3118,"num_write":870,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'187","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.538591+0000","last_change":"2024-09-12T01:15:59.538591+0000","last_active":"2024-09-12T01:15:59.538591+0000","last_peered":"2024-09-12T01:15:59.538591+0000","last_clean":"2024-09-12T01:15:59.538591+0000","last_became_active":"2024-09-12T00:02:48.049242+0000","last_became_peered":"2024-09-12T00:02:48.049242+0000","last_unstale":"2024-09-12T01:15:59.538591+0000","last_undegraded":"2024-09-12T01:15:59.538591+0000","last_fullsized":"2024-09-12T01:15:59.538591+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:15:59.538483+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:15:59.538483+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.538483+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:48.772077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":39372,"num_write":875,"num_write_kb":46728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'352","reported_seq":1698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.151473+0000","last_change":"2024-09-12T01:16:08.151351+0000","last_active":"2024-09-12T01:16:08.151473+0000","last_peered":"2024-09-12T01:16:08.151473+0000","last_clean":"2024-09-12T01:16:08.151473+0000","last_became_active":"2024-09-12T00:02:50.065060+0000","last_became_peered":"2024-09-12T00:02:50.065060+0000","last_unstale":"2024-09-12T01:16:08.151473+0000","last_undegraded":"2024-09-12T01:16:08.151473+0000","last_fullsized":"2024-09-12T01:16:08.151473+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-09-12T01:16:08.151246+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-09-12T01:16:08.151246+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.151246+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:32.866300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1806,"num_read_kb":1710,"num_write":413,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'203","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.099431+0000","last_change":"2024-09-12T01:15:55.099431+0000","last_active":"2024-09-12T01:15:55.099431+0000","last_peered":"2024-09-12T01:15:55.099431+0000","last_clean":"2024-09-12T01:15:55.099431+0000","last_became_active":"2024-09-12T00:02:48.041842+0000","last_became_peered":"2024-09-12T00:02:48.041842+0000","last_unstale":"2024-09-12T01:15:55.099431+0000","last_undegraded":"2024-09-12T01:15:55.099431+0000","last_fullsized":"2024-09-12T01:15:55.099431+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'203","last_scrub_stamp":"2024-09-12T01:15:55.099312+0000","last_deep_scrub":"267'203","last_deep_scrub_stamp":"2024-09-12T01:15:55.099312+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.099312+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:35.347299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":13124,"num_write":1044,"num_write_kb":38354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'458","reported_seq":2075,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.265565+0000","last_change":"2024-09-12T01:16:13.265508+0000","last_active":"2024-09-12T01:16:13.265565+0000","last_peered":"2024-09-12T01:16:13.265565+0000","last_clean":"2024-09-12T01:16:13.265565+0000","last_became_active":"2024-09-12T00:02:50.066341+0000","last_became_peered":"2024-09-12T00:02:50.066341+0000","last_unstale":"2024-09-12T01:16:13.265565+0000","last_undegraded":"2024-09-12T01:16:13.265565+0000","last_fullsized":"2024-09-12T01:16:13.265565+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'458","last_scrub_stamp":"2024-09-12T01:16:13.265421+0000","last_deep_scrub":"267'458","last_deep_scrub_stamp":"2024-09-12T01:16:13.265421+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.265421+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:02.745745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2383,"num_read_kb":2262,"num_write":523,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'185","reported_seq":819,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.199885+0000","last_change":"2024-09-12T01:16:03.199885+0000","last_active":"2024-09-12T01:16:03.199885+0000","last_peered":"2024-09-12T01:16:03.199885+0000","last_clean":"2024-09-12T01:16:03.199885+0000","last_became_active":"2024-09-12T00:02:48.052205+0000","last_became_peered":"2024-09-12T00:02:48.052205+0000","last_unstale":"2024-09-12T01:16:03.199885+0000","last_undegraded":"2024-09-12T01:16:03.199885+0000","last_fullsized":"2024-09-12T01:16:03.199885+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:16:03.199736+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:16:03.199736+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.199736+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:22.555181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":389,"num_read_kb":19493,"num_write":855,"num_write_kb":24928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'368","reported_seq":1887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.149350+0000","last_change":"2024-09-12T01:16:07.149286+0000","last_active":"2024-09-12T01:16:07.149350+0000","last_peered":"2024-09-12T01:16:07.149350+0000","last_clean":"2024-09-12T01:16:07.149350+0000","last_became_active":"2024-09-12T00:02:50.065534+0000","last_became_peered":"2024-09-12T00:02:50.065534+0000","last_unstale":"2024-09-12T01:16:07.149350+0000","last_undegraded":"2024-09-12T01:16:07.149350+0000","last_fullsized":"2024-09-12T01:16:07.149350+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'368","last_scrub_stamp":"2024-09-12T01:16:07.149197+0000","last_deep_scrub":"267'368","last_deep_scrub_stamp":"2024-09-12T01:16:07.149197+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.149197+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:26.769112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1966,"num_read_kb":1903,"num_write":390,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'155","reported_seq":760,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.132577+0000","last_change":"2024-09-12T01:15:57.132517+0000","last_active":"2024-09-12T01:15:57.132577+0000","last_peered":"2024-09-12T01:15:57.132577+0000","last_clean":"2024-09-12T01:15:57.132577+0000","last_became_active":"2024-09-12T00:03:21.720441+0000","last_became_peered":"2024-09-12T00:03:21.720441+0000","last_unstale":"2024-09-12T01:15:57.132577+0000","last_undegraded":"2024-09-12T01:15:57.132577+0000","last_fullsized":"2024-09-12T01:15:57.132577+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-12T01:15:57.132438+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-12T01:15:57.132438+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.132438+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:56.866362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":16297,"num_write":778,"num_write_kb":33256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"267'1242","reported_seq":3065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.610318+0000","last_change":"2024-09-12T01:16:22.610318+0000","last_active":"2024-09-12T01:16:22.610318+0000","last_peered":"2024-09-12T01:16:22.610318+0000","last_clean":"2024-09-12T01:16:22.610318+0000","last_became_active":"2024-09-12T00:02:50.070406+0000","last_became_peered":"2024-09-12T00:02:50.070406+0000","last_unstale":"2024-09-12T01:16:22.610318+0000","last_undegraded":"2024-09-12T01:16:22.610318+0000","last_fullsized":"2024-09-12T01:16:22.610318+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1242","last_scrub_stamp":"2024-09-12T01:16:22.610208+0000","last_deep_scrub":"267'1242","last_deep_scrub_stamp":"2024-09-12T01:16:22.610208+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.610208+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":1200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.017549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5822,"num_read_kb":5176,"num_write":1694,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2225,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'195","reported_seq":851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.695089+0000","last_change":"2024-09-12T01:16:01.695026+0000","last_active":"2024-09-12T01:16:01.695089+0000","last_peered":"2024-09-12T01:16:01.695089+0000","last_clean":"2024-09-12T01:16:01.695089+0000","last_became_active":"2024-09-12T00:02:48.051454+0000","last_became_peered":"2024-09-12T00:02:48.051454+0000","last_unstale":"2024-09-12T01:16:01.695089+0000","last_undegraded":"2024-09-12T01:16:01.695089+0000","last_fullsized":"2024-09-12T01:16:01.695089+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'195","last_scrub_stamp":"2024-09-12T01:16:01.694929+0000","last_deep_scrub":"267'195","last_deep_scrub_stamp":"2024-09-12T01:16:01.694929+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.694929+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:50.288118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":27281,"num_write":913,"num_write_kb":43596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'811","reported_seq":2275,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.823457+0000","last_change":"2024-09-12T01:16:07.823457+0000","last_active":"2024-09-12T01:16:07.823457+0000","last_peered":"2024-09-12T01:16:07.823457+0000","last_clean":"2024-09-12T01:16:07.823457+0000","last_became_active":"2024-09-12T00:02:50.065615+0000","last_became_peered":"2024-09-12T00:02:50.065615+0000","last_unstale":"2024-09-12T01:16:07.823457+0000","last_undegraded":"2024-09-12T01:16:07.823457+0000","last_fullsized":"2024-09-12T01:16:07.823457+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'811","last_scrub_stamp":"2024-09-12T01:16:07.823369+0000","last_deep_scrub":"267'811","last_deep_scrub_stamp":"2024-09-12T01:16:07.823369+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.823369+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:09.542904+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3886,"num_read_kb":3508,"num_write":1123,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'223","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.095128+0000","last_change":"2024-09-12T01:15:59.095055+0000","last_active":"2024-09-12T01:15:59.095128+0000","last_peered":"2024-09-12T01:15:59.095128+0000","last_clean":"2024-09-12T01:15:59.095128+0000","last_became_active":"2024-09-12T00:02:48.047357+0000","last_became_peered":"2024-09-12T00:02:48.047357+0000","last_unstale":"2024-09-12T01:15:59.095128+0000","last_undegraded":"2024-09-12T01:15:59.095128+0000","last_fullsized":"2024-09-12T01:15:59.095128+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-12T01:15:59.094931+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-12T01:15:59.094931+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.094931+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:21.356655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":6089,"num_write":1092,"num_write_kb":27766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1104","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.628883+0000","last_change":"2024-09-12T01:16:12.628883+0000","last_active":"2024-09-12T01:16:12.628883+0000","last_peered":"2024-09-12T01:16:12.628883+0000","last_clean":"2024-09-12T01:16:12.628883+0000","last_became_active":"2024-09-12T00:02:50.075265+0000","last_became_peered":"2024-09-12T00:02:50.075265+0000","last_unstale":"2024-09-12T01:16:12.628883+0000","last_undegraded":"2024-09-12T01:16:12.628883+0000","last_fullsized":"2024-09-12T01:16:12.628883+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1104","last_scrub_stamp":"2024-09-12T01:16:12.628783+0000","last_deep_scrub":"267'1104","last_deep_scrub_stamp":"2024-09-12T01:16:12.628783+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.628783+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:31.330763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4403,"num_write":1512,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'200","reported_seq":831,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.554304+0000","last_change":"2024-09-12T01:15:58.554239+0000","last_active":"2024-09-12T01:15:58.554304+0000","last_peered":"2024-09-12T01:15:58.554304+0000","last_clean":"2024-09-12T01:15:58.554304+0000","last_became_active":"2024-09-12T00:02:48.047266+0000","last_became_peered":"2024-09-12T00:02:48.047266+0000","last_unstale":"2024-09-12T01:15:58.554304+0000","last_undegraded":"2024-09-12T01:15:58.554304+0000","last_fullsized":"2024-09-12T01:15:58.554304+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-12T01:15:58.554118+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-12T01:15:58.554118+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.554118+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:22.527176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":23654,"num_write":912,"num_write_kb":39021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'477","reported_seq":2131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.473365+0000","last_change":"2024-09-12T01:16:07.473365+0000","last_active":"2024-09-12T01:16:07.473365+0000","last_peered":"2024-09-12T01:16:07.473365+0000","last_clean":"2024-09-12T01:16:07.473365+0000","last_became_active":"2024-09-12T00:02:50.067919+0000","last_became_peered":"2024-09-12T00:02:50.067919+0000","last_unstale":"2024-09-12T01:16:07.473365+0000","last_undegraded":"2024-09-12T01:16:07.473365+0000","last_fullsized":"2024-09-12T01:16:07.473365+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'477","last_scrub_stamp":"2024-09-12T01:16:07.473283+0000","last_deep_scrub":"267'477","last_deep_scrub_stamp":"2024-09-12T01:16:07.473283+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.473283+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:57.980949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2453,"num_write":580,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'153","reported_seq":740,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.103312+0000","last_change":"2024-09-12T01:16:00.103312+0000","last_active":"2024-09-12T01:16:00.103312+0000","last_peered":"2024-09-12T01:16:00.103312+0000","last_clean":"2024-09-12T01:16:00.103312+0000","last_became_active":"2024-09-12T00:03:21.143091+0000","last_became_peered":"2024-09-12T00:03:21.143091+0000","last_unstale":"2024-09-12T01:16:00.103312+0000","last_undegraded":"2024-09-12T01:16:00.103312+0000","last_fullsized":"2024-09-12T01:16:00.103312+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-12T01:16:00.103180+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-12T01:16:00.103180+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.103180+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:22.971120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":6539,"num_write":770,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'875","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.732349+0000","last_change":"2024-09-12T01:16:07.732349+0000","last_active":"2024-09-12T01:16:07.732349+0000","last_peered":"2024-09-12T01:16:07.732349+0000","last_clean":"2024-09-12T01:16:07.732349+0000","last_became_active":"2024-09-12T00:02:50.076097+0000","last_became_peered":"2024-09-12T00:02:50.076097+0000","last_unstale":"2024-09-12T01:16:07.732349+0000","last_undegraded":"2024-09-12T01:16:07.732349+0000","last_fullsized":"2024-09-12T01:16:07.732349+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'875","last_scrub_stamp":"2024-09-12T01:16:07.732265+0000","last_deep_scrub":"267'875","last_deep_scrub_stamp":"2024-09-12T01:16:07.732265+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.732265+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.381212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3804,"num_write":1206,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'185","reported_seq":798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.251693+0000","last_change":"2024-09-12T01:16:05.251637+0000","last_active":"2024-09-12T01:16:05.251693+0000","last_peered":"2024-09-12T01:16:05.251693+0000","last_clean":"2024-09-12T01:16:05.251693+0000","last_became_active":"2024-09-12T00:02:48.057693+0000","last_became_peered":"2024-09-12T00:02:48.057693+0000","last_unstale":"2024-09-12T01:16:05.251693+0000","last_undegraded":"2024-09-12T01:16:05.251693+0000","last_fullsized":"2024-09-12T01:16:05.251693+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:16:05.251527+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:16:05.251527+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.251527+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:53.355948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":352,"num_read_kb":5525,"num_write":905,"num_write_kb":35074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'842","reported_seq":2623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.930794+0000","last_change":"2024-09-12T01:16:11.930794+0000","last_active":"2024-09-12T01:16:11.930794+0000","last_peered":"2024-09-12T01:16:11.930794+0000","last_clean":"2024-09-12T01:16:11.930794+0000","last_became_active":"2024-09-12T00:02:50.062524+0000","last_became_peered":"2024-09-12T00:02:50.062524+0000","last_unstale":"2024-09-12T01:16:11.930794+0000","last_undegraded":"2024-09-12T01:16:11.930794+0000","last_fullsized":"2024-09-12T01:16:11.930794+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'842","last_scrub_stamp":"2024-09-12T01:16:11.930681+0000","last_deep_scrub":"267'842","last_deep_scrub_stamp":"2024-09-12T01:16:11.930681+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.930681+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:21.897504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4232,"num_read_kb":3859,"num_write":1078,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4832,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'258","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.730568+0000","last_change":"2024-09-12T01:16:00.730568+0000","last_active":"2024-09-12T01:16:00.730568+0000","last_peered":"2024-09-12T01:16:00.730568+0000","last_clean":"2024-09-12T01:16:00.730568+0000","last_became_active":"2024-09-12T00:02:48.050574+0000","last_became_peered":"2024-09-12T00:02:48.050574+0000","last_unstale":"2024-09-12T01:16:00.730568+0000","last_undegraded":"2024-09-12T01:16:00.730568+0000","last_fullsized":"2024-09-12T01:16:00.730568+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:16:00.730443+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:16:00.730443+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.730443+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:08.715998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67790,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":15341,"num_write":1132,"num_write_kb":29230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'815","reported_seq":2290,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.253395+0000","last_change":"2024-09-12T01:16:04.253395+0000","last_active":"2024-09-12T01:16:04.253395+0000","last_peered":"2024-09-12T01:16:04.253395+0000","last_clean":"2024-09-12T01:16:04.253395+0000","last_became_active":"2024-09-12T00:02:50.063668+0000","last_became_peered":"2024-09-12T00:02:50.063668+0000","last_unstale":"2024-09-12T01:16:04.253395+0000","last_undegraded":"2024-09-12T01:16:04.253395+0000","last_fullsized":"2024-09-12T01:16:04.253395+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'815","last_scrub_stamp":"2024-09-12T01:16:04.253299+0000","last_deep_scrub":"267'815","last_deep_scrub_stamp":"2024-09-12T01:16:04.253299+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.253299+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:04.727166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3770,"num_read_kb":3367,"num_write":1118,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'211","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.220264+0000","last_change":"2024-09-12T01:16:04.220264+0000","last_active":"2024-09-12T01:16:04.220264+0000","last_peered":"2024-09-12T01:16:04.220264+0000","last_clean":"2024-09-12T01:16:04.220264+0000","last_became_active":"2024-09-12T00:02:48.048851+0000","last_became_peered":"2024-09-12T00:02:48.048851+0000","last_unstale":"2024-09-12T01:16:04.220264+0000","last_undegraded":"2024-09-12T01:16:04.220264+0000","last_fullsized":"2024-09-12T01:16:04.220264+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'211","last_scrub_stamp":"2024-09-12T01:16:04.220141+0000","last_deep_scrub":"267'211","last_deep_scrub_stamp":"2024-09-12T01:16:04.220141+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.220141+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:47.525059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":48639,"num_write":1072,"num_write_kb":41735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'815","reported_seq":2281,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.835311+0000","last_change":"2024-09-12T01:16:08.835311+0000","last_active":"2024-09-12T01:16:08.835311+0000","last_peered":"2024-09-12T01:16:08.835311+0000","last_clean":"2024-09-12T01:16:08.835311+0000","last_became_active":"2024-09-12T00:02:50.063615+0000","last_became_peered":"2024-09-12T00:02:50.063615+0000","last_unstale":"2024-09-12T01:16:08.835311+0000","last_undegraded":"2024-09-12T01:16:08.835311+0000","last_fullsized":"2024-09-12T01:16:08.835311+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'815","last_scrub_stamp":"2024-09-12T01:16:08.835219+0000","last_deep_scrub":"267'815","last_deep_scrub_stamp":"2024-09-12T01:16:08.835219+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.835219+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:58.732596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3747,"num_read_kb":3346,"num_write":1068,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'284","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.821132+0000","last_change":"2024-09-12T01:15:59.821132+0000","last_active":"2024-09-12T01:15:59.821132+0000","last_peered":"2024-09-12T01:15:59.821132+0000","last_clean":"2024-09-12T01:15:59.821132+0000","last_became_active":"2024-09-12T00:02:48.046828+0000","last_became_peered":"2024-09-12T00:02:48.046828+0000","last_unstale":"2024-09-12T01:15:59.821132+0000","last_undegraded":"2024-09-12T01:15:59.821132+0000","last_fullsized":"2024-09-12T01:15:59.821132+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'284","last_scrub_stamp":"2024-09-12T01:15:59.821026+0000","last_deep_scrub":"267'284","last_deep_scrub_stamp":"2024-09-12T01:15:59.821026+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.821026+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.732125+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":12026,"num_write":1074,"num_write_kb":33544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'754","reported_seq":2269,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.720788+0000","last_change":"2024-09-12T01:16:11.720788+0000","last_active":"2024-09-12T01:16:11.720788+0000","last_peered":"2024-09-12T01:16:11.720788+0000","last_clean":"2024-09-12T01:16:11.720788+0000","last_became_active":"2024-09-12T00:02:50.069844+0000","last_became_peered":"2024-09-12T00:02:50.069844+0000","last_unstale":"2024-09-12T01:16:11.720788+0000","last_undegraded":"2024-09-12T01:16:11.720788+0000","last_fullsized":"2024-09-12T01:16:11.720788+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'754","last_scrub_stamp":"2024-09-12T01:16:11.720709+0000","last_deep_scrub":"267'754","last_deep_scrub_stamp":"2024-09-12T01:16:11.720709+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.720709+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:50.677876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3535,"num_read_kb":3209,"num_write":983,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'198","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.521700+0000","last_change":"2024-09-12T01:16:02.521700+0000","last_active":"2024-09-12T01:16:02.521700+0000","last_peered":"2024-09-12T01:16:02.521700+0000","last_clean":"2024-09-12T01:16:02.521700+0000","last_became_active":"2024-09-12T00:02:48.046397+0000","last_became_peered":"2024-09-12T00:02:48.046397+0000","last_unstale":"2024-09-12T01:16:02.521700+0000","last_undegraded":"2024-09-12T01:16:02.521700+0000","last_fullsized":"2024-09-12T01:16:02.521700+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:16:02.521590+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:16:02.521590+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.521590+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:52.392814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":38047,"num_write":933,"num_write_kb":24740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'854","reported_seq":2486,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.774581+0000","last_change":"2024-09-12T01:16:06.774581+0000","last_active":"2024-09-12T01:16:06.774581+0000","last_peered":"2024-09-12T01:16:06.774581+0000","last_clean":"2024-09-12T01:16:06.774581+0000","last_became_active":"2024-09-12T00:02:50.078018+0000","last_became_peered":"2024-09-12T00:02:50.078018+0000","last_unstale":"2024-09-12T01:16:06.774581+0000","last_undegraded":"2024-09-12T01:16:06.774581+0000","last_fullsized":"2024-09-12T01:16:06.774581+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'854","last_scrub_stamp":"2024-09-12T01:16:06.774436+0000","last_deep_scrub":"267'854","last_deep_scrub_stamp":"2024-09-12T01:16:06.774436+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.774436+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:12.958179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4154,"num_read_kb":3748,"num_write":1160,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'171","reported_seq":784,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.723711+0000","last_change":"2024-09-12T01:16:06.723711+0000","last_active":"2024-09-12T01:16:06.723711+0000","last_peered":"2024-09-12T01:16:06.723711+0000","last_clean":"2024-09-12T01:16:06.723711+0000","last_became_active":"2024-09-12T00:02:48.047945+0000","last_became_peered":"2024-09-12T00:02:48.047945+0000","last_unstale":"2024-09-12T01:16:06.723711+0000","last_undegraded":"2024-09-12T01:16:06.723711+0000","last_fullsized":"2024-09-12T01:16:06.723711+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-12T01:16:06.723583+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-12T01:16:06.723583+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.723583+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:29.604328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":324,"num_read_kb":25981,"num_write":829,"num_write_kb":31809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'534","reported_seq":2303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.235496+0000","last_change":"2024-09-12T01:16:01.235496+0000","last_active":"2024-09-12T01:16:01.235496+0000","last_peered":"2024-09-12T01:16:01.235496+0000","last_clean":"2024-09-12T01:16:01.235496+0000","last_became_active":"2024-09-12T00:03:21.133475+0000","last_became_peered":"2024-09-12T00:03:21.133475+0000","last_unstale":"2024-09-12T01:16:01.235496+0000","last_undegraded":"2024-09-12T01:16:01.235496+0000","last_fullsized":"2024-09-12T01:16:01.235496+0000","mapping_epoch":39,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'534","last_scrub_stamp":"2024-09-12T01:16:01.235392+0000","last_deep_scrub":"267'534","last_deep_scrub_stamp":"2024-09-12T01:16:01.235392+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.235392+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:42.656876+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2976,"num_read_kb":2811,"num_write":614,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":436,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"267'233","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.161645+0000","last_change":"2024-09-12T01:15:58.161645+0000","last_active":"2024-09-12T01:15:58.161645+0000","last_peered":"2024-09-12T01:15:58.161645+0000","last_clean":"2024-09-12T01:15:58.161645+0000","last_became_active":"2024-09-12T00:02:48.049104+0000","last_became_peered":"2024-09-12T00:02:48.049104+0000","last_unstale":"2024-09-12T01:15:58.161645+0000","last_undegraded":"2024-09-12T01:15:58.161645+0000","last_fullsized":"2024-09-12T01:15:58.161645+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'233","last_scrub_stamp":"2024-09-12T01:15:58.161506+0000","last_deep_scrub":"267'233","last_deep_scrub_stamp":"2024-09-12T01:15:58.161506+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.161506+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.839368+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456491,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":11103,"num_write":1027,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'910","reported_seq":2510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.736530+0000","last_change":"2024-09-12T01:16:09.736466+0000","last_active":"2024-09-12T01:16:09.736530+0000","last_peered":"2024-09-12T01:16:09.736530+0000","last_clean":"2024-09-12T01:16:09.736530+0000","last_became_active":"2024-09-12T00:02:50.069494+0000","last_became_peered":"2024-09-12T00:02:50.069494+0000","last_unstale":"2024-09-12T01:16:09.736530+0000","last_undegraded":"2024-09-12T01:16:09.736530+0000","last_fullsized":"2024-09-12T01:16:09.736530+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'910","last_scrub_stamp":"2024-09-12T01:16:09.736373+0000","last_deep_scrub":"267'910","last_deep_scrub_stamp":"2024-09-12T01:16:09.736373+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.736373+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:52.193047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4355,"num_read_kb":3868,"num_write":1227,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'175","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.268258+0000","last_change":"2024-09-12T01:16:07.268258+0000","last_active":"2024-09-12T01:16:07.268258+0000","last_peered":"2024-09-12T01:16:07.268258+0000","last_clean":"2024-09-12T01:16:07.268258+0000","last_became_active":"2024-09-12T00:04:21.225148+0000","last_became_peered":"2024-09-12T00:04:21.225148+0000","last_unstale":"2024-09-12T01:16:07.268258+0000","last_undegraded":"2024-09-12T01:16:07.268258+0000","last_fullsized":"2024-09-12T01:16:07.268258+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-12T01:16:07.268138+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-12T01:16:07.268138+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.268138+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:34.383522+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7533161,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":15843,"num_write":853,"num_write_kb":25246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'175","reported_seq":804,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.287894+0000","last_change":"2024-09-12T01:16:08.287894+0000","last_active":"2024-09-12T01:16:08.287894+0000","last_peered":"2024-09-12T01:16:08.287894+0000","last_clean":"2024-09-12T01:16:08.287894+0000","last_became_active":"2024-09-12T00:03:21.140871+0000","last_became_peered":"2024-09-12T00:03:21.140871+0000","last_unstale":"2024-09-12T01:16:08.287894+0000","last_undegraded":"2024-09-12T01:16:08.287894+0000","last_fullsized":"2024-09-12T01:16:08.287894+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-12T01:16:08.287766+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-12T01:16:08.287766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.287766+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:57.597678+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2728229,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":36071,"num_write":841,"num_write_kb":27237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'835","reported_seq":2470,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.688636+0000","last_change":"2024-09-12T01:16:09.688636+0000","last_active":"2024-09-12T01:16:09.688636+0000","last_peered":"2024-09-12T01:16:09.688636+0000","last_clean":"2024-09-12T01:16:09.688636+0000","last_became_active":"2024-09-12T00:02:50.076513+0000","last_became_peered":"2024-09-12T00:02:50.076513+0000","last_unstale":"2024-09-12T01:16:09.688636+0000","last_undegraded":"2024-09-12T01:16:09.688636+0000","last_fullsized":"2024-09-12T01:16:09.688636+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'835","last_scrub_stamp":"2024-09-12T01:16:09.688553+0000","last_deep_scrub":"267'835","last_deep_scrub_stamp":"2024-09-12T01:16:09.688553+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.688553+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:38.082389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4096,"num_read_kb":3692,"num_write":1085,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'193","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.147640+0000","last_change":"2024-09-12T01:16:01.147640+0000","last_active":"2024-09-12T01:16:01.147640+0000","last_peered":"2024-09-12T01:16:01.147640+0000","last_clean":"2024-09-12T01:16:01.147640+0000","last_became_active":"2024-09-12T00:03:21.143160+0000","last_became_peered":"2024-09-12T00:03:21.143160+0000","last_unstale":"2024-09-12T01:16:01.147640+0000","last_undegraded":"2024-09-12T01:16:01.147640+0000","last_fullsized":"2024-09-12T01:16:01.147640+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:16:01.147530+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:16:01.147530+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.147530+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:27.265957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":434,"num_read_kb":67077,"num_write":937,"num_write_kb":29840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'450","reported_seq":1973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.274158+0000","last_change":"2024-09-12T01:16:15.274158+0000","last_active":"2024-09-12T01:16:15.274158+0000","last_peered":"2024-09-12T01:16:15.274158+0000","last_clean":"2024-09-12T01:16:15.274158+0000","last_became_active":"2024-09-12T00:02:50.060457+0000","last_became_peered":"2024-09-12T00:02:50.060457+0000","last_unstale":"2024-09-12T01:16:15.274158+0000","last_undegraded":"2024-09-12T01:16:15.274158+0000","last_fullsized":"2024-09-12T01:16:15.274158+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'450","last_scrub_stamp":"2024-09-12T01:16:15.274064+0000","last_deep_scrub":"267'450","last_deep_scrub_stamp":"2024-09-12T01:16:15.274064+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.274064+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:18.935122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2366,"num_read_kb":2209,"num_write":518,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5804,"num_read_kb":4071,"num_write":1920,"num_write_kb":818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8194,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":993,"ondisk_log_size":993,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15077,"num_read_kb":14728,"num_write":16720,"num_write_kb":4882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1747,"ondisk_log_size":1747,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662,"ondisk_log_size":662,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":259874,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":10212,"num_read_kb":12359,"num_write":7103,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":676584,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1890,"ondisk_log_size":1890,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212469,"num_read_kb":193861,"num_write":55201,"num_write_kb":18788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43525,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3924,"ondisk_log_size":3924,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":93137464,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":33184,"num_read_kb":2494324,"num_write":62091,"num_write_kb":2229204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":141545472,"data_stored":141545472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4519,"ondisk_log_size":4519,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196988,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185720,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510339,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243796,"kb_used_data":14084,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94128044,"statfs":{"total":96636764160,"available":96387117056,"internally_reserved":0,"allocated":14422016,"data_stored":12282601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510341,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259840,"kb_used_data":25968,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94112000,"statfs":{"total":96636764160,"available":96370688000,"internally_reserved":0,"allocated":26591232,"data_stored":24503671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510343,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97016,"kb_used_data":15848,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94274824,"statfs":{"total":96636764160,"available":96537419776,"internally_reserved":0,"allocated":16228352,"data_stored":14061021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510338,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106528,"kb_used_data":25360,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94265312,"statfs":{"total":96636764160,"available":96527679488,"internally_reserved":0,"allocated":25968640,"data_stored":23900981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510337,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245988,"kb_used_data":16276,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94125852,"statfs":{"total":96636764160,"available":96384872448,"internally_reserved":0,"allocated":16666624,"data_stored":14539294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510335,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101516,"kb_used_data":25916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94270324,"statfs":{"total":96636764160,"available":96532811776,"internally_reserved":0,"allocated":26537984,"data_stored":24477318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510336,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154136,"kb_used_data":28616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94217704,"statfs":{"total":96636764160,"available":96478928896,"internally_reserved":0,"allocated":29302784,"data_stored":27210308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575747,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273592,"kb_used_data":21736,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098248,"statfs":{"total":96636764160,"available":96356605952,"internally_reserved":0,"allocated":22257664,"data_stored":20146116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17256448,"data_stored":17256448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24911872,"data_stored":24911872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22179840,"data_stored":22179840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12238848,"data_stored":12238848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21602304,"data_stored":21602304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11759616,"data_stored":11759616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22204416,"data_stored":22204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:16:58.091 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:58.092 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:58.092 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:39:25.603778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=15, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:16:58.096 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:17:18.097 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:17:18.452 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-12T01:17:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-12T01:17:18.467 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":2506,"stamp":"2024-09-12T01:17:17.358952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":94005387,"num_objects":732,"num_object_clones":0,"num_object_copies":1697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":279494,"num_read_kb":3104975,"num_write":143492,"num_write_kb":2513046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":732228,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14039,"ondisk_log_size":14039,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1482412,"kb_used_data":173804,"kb_used_omap":12,"kb_used_meta":1308467,"kb_avail":753492308,"statfs":{"total":773094113280,"available":771576123392,"internally_reserved":0,"allocated":177975296,"data_stored":161121310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1339870769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005434"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:46.201122+0000","last_change":"2024-09-12T01:16:46.201045+0000","last_active":"2024-09-12T01:16:46.201122+0000","last_peered":"2024-09-12T01:16:46.201122+0000","last_clean":"2024-09-12T01:16:46.201122+0000","last_became_active":"2024-09-12T00:39:26.642090+0000","last_became_peered":"2024-09-12T00:39:26.642090+0000","last_unstale":"2024-09-12T01:16:46.201122+0000","last_undegraded":"2024-09-12T01:16:46.201122+0000","last_fullsized":"2024-09-12T01:16:46.201122+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:46.200953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:46.200953+0000","last_clean_scrub_stamp":"2024-09-12T01:16:46.200953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:36.950269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:43.144230+0000","last_change":"2024-09-12T01:16:43.144170+0000","last_active":"2024-09-12T01:16:43.144230+0000","last_peered":"2024-09-12T01:16:43.144230+0000","last_clean":"2024-09-12T01:16:43.144230+0000","last_became_active":"2024-09-12T00:22:02.423867+0000","last_became_peered":"2024-09-12T00:22:02.423867+0000","last_unstale":"2024-09-12T01:16:43.144230+0000","last_undegraded":"2024-09-12T01:16:43.144230+0000","last_fullsized":"2024-09-12T01:16:43.144230+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:16:43.144081+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:16:43.144081+0000","last_clean_scrub_stamp":"2024-09-12T01:16:43.144081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:54.007496+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.753962+0000","last_change":"2024-09-12T01:16:41.753894+0000","last_active":"2024-09-12T01:16:41.753962+0000","last_peered":"2024-09-12T01:16:41.753962+0000","last_clean":"2024-09-12T01:16:41.753962+0000","last_became_active":"2024-09-12T00:21:58.335882+0000","last_became_peered":"2024-09-12T00:21:58.335882+0000","last_unstale":"2024-09-12T01:16:41.753962+0000","last_undegraded":"2024-09-12T01:16:41.753962+0000","last_fullsized":"2024-09-12T01:16:41.753962+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:16:41.753805+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:16:41.753805+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.753805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:40.280055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":322,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'60","reported_seq":232,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.666715+0000","last_change":"2024-09-12T01:16:41.666715+0000","last_active":"2024-09-12T01:16:41.666715+0000","last_peered":"2024-09-12T01:16:41.666715+0000","last_clean":"2024-09-12T01:16:41.666715+0000","last_became_active":"2024-09-12T00:17:58.353889+0000","last_became_peered":"2024-09-12T00:17:58.353889+0000","last_unstale":"2024-09-12T01:16:41.666715+0000","last_undegraded":"2024-09-12T01:16:41.666715+0000","last_fullsized":"2024-09-12T01:16:41.666715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'60","last_scrub_stamp":"2024-09-12T01:16:41.666624+0000","last_deep_scrub":"267'60","last_deep_scrub_stamp":"2024-09-12T01:16:41.666624+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.666624+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.041466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":209,"num_write":117,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.272226+0000","last_change":"2024-09-12T01:16:26.272165+0000","last_active":"2024-09-12T01:16:26.272226+0000","last_peered":"2024-09-12T01:16:26.272226+0000","last_clean":"2024-09-12T01:16:26.272226+0000","last_became_active":"2024-09-12T00:39:26.637244+0000","last_became_peered":"2024-09-12T00:39:26.637244+0000","last_unstale":"2024-09-12T01:16:26.272226+0000","last_undegraded":"2024-09-12T01:16:26.272226+0000","last_fullsized":"2024-09-12T01:16:26.272226+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:26.272076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:26.272076+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.272076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:45.460900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.885993+0000","last_change":"2024-09-12T01:16:41.885921+0000","last_active":"2024-09-12T01:16:41.885993+0000","last_peered":"2024-09-12T01:16:41.885993+0000","last_clean":"2024-09-12T01:16:41.885993+0000","last_became_active":"2024-09-12T00:22:02.420774+0000","last_became_peered":"2024-09-12T00:22:02.420774+0000","last_unstale":"2024-09-12T01:16:41.885993+0000","last_undegraded":"2024-09-12T01:16:41.885993+0000","last_fullsized":"2024-09-12T01:16:41.885993+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:41.885786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:41.885786+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.885786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:42.094189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.399616+0000","last_change":"2024-09-12T01:16:29.399546+0000","last_active":"2024-09-12T01:16:29.399616+0000","last_peered":"2024-09-12T01:16:29.399616+0000","last_clean":"2024-09-12T01:16:29.399616+0000","last_became_active":"2024-09-12T00:21:58.336723+0000","last_became_peered":"2024-09-12T00:21:58.336723+0000","last_unstale":"2024-09-12T01:16:29.399616+0000","last_undegraded":"2024-09-12T01:16:29.399616+0000","last_fullsized":"2024-09-12T01:16:29.399616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:29.399457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:29.399457+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.399457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:53.257732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'21","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.253525+0000","last_change":"2024-09-12T01:16:18.253525+0000","last_active":"2024-09-12T01:16:18.253525+0000","last_peered":"2024-09-12T01:16:18.253525+0000","last_clean":"2024-09-12T01:16:18.253525+0000","last_became_active":"2024-09-12T00:17:58.361306+0000","last_became_peered":"2024-09-12T00:17:58.361306+0000","last_unstale":"2024-09-12T01:16:18.253525+0000","last_undegraded":"2024-09-12T01:16:18.253525+0000","last_fullsized":"2024-09-12T01:16:18.253525+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T01:16:18.253413+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T01:16:18.253413+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.253413+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:00.534994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.395558+0000","last_change":"2024-09-12T01:16:32.395558+0000","last_active":"2024-09-12T01:16:32.395558+0000","last_peered":"2024-09-12T01:16:32.395558+0000","last_clean":"2024-09-12T01:16:32.395558+0000","last_became_active":"2024-09-12T00:39:26.625454+0000","last_became_peered":"2024-09-12T00:39:26.625454+0000","last_unstale":"2024-09-12T01:16:32.395558+0000","last_undegraded":"2024-09-12T01:16:32.395558+0000","last_fullsized":"2024-09-12T01:16:32.395558+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.395472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.395472+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.395472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:47.842934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:47.641389+0000","last_change":"2024-09-12T01:16:47.641389+0000","last_active":"2024-09-12T01:16:47.641389+0000","last_peered":"2024-09-12T01:16:47.641389+0000","last_clean":"2024-09-12T01:16:47.641389+0000","last_became_active":"2024-09-12T00:22:02.421689+0000","last_became_peered":"2024-09-12T00:22:02.421689+0000","last_unstale":"2024-09-12T01:16:47.641389+0000","last_undegraded":"2024-09-12T01:16:47.641389+0000","last_fullsized":"2024-09-12T01:16:47.641389+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:47.641297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:47.641297+0000","last_clean_scrub_stamp":"2024-09-12T01:16:47.641297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:12.624272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.198466+0000","last_change":"2024-09-12T01:16:22.198466+0000","last_active":"2024-09-12T01:16:22.198466+0000","last_peered":"2024-09-12T01:16:22.198466+0000","last_clean":"2024-09-12T01:16:22.198466+0000","last_became_active":"2024-09-12T00:21:58.332782+0000","last_became_peered":"2024-09-12T00:21:58.332782+0000","last_unstale":"2024-09-12T01:16:22.198466+0000","last_undegraded":"2024-09-12T01:16:22.198466+0000","last_fullsized":"2024-09-12T01:16:22.198466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:22.198371+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:22.198371+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.198371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:01.472421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'34","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.613784+0000","last_change":"2024-09-12T01:16:36.613784+0000","last_active":"2024-09-12T01:16:36.613784+0000","last_peered":"2024-09-12T01:16:36.613784+0000","last_clean":"2024-09-12T01:16:36.613784+0000","last_became_active":"2024-09-12T00:17:58.353045+0000","last_became_peered":"2024-09-12T00:17:58.353045+0000","last_unstale":"2024-09-12T01:16:36.613784+0000","last_undegraded":"2024-09-12T01:16:36.613784+0000","last_fullsized":"2024-09-12T01:16:36.613784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-12T01:16:36.613699+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-12T01:16:36.613699+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.613699+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:44.318488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:52.692306+0000","last_change":"2024-09-12T01:16:52.692306+0000","last_active":"2024-09-12T01:16:52.692306+0000","last_peered":"2024-09-12T01:16:52.692306+0000","last_clean":"2024-09-12T01:16:52.692306+0000","last_became_active":"2024-09-12T00:39:26.637185+0000","last_became_peered":"2024-09-12T00:39:26.637185+0000","last_unstale":"2024-09-12T01:16:52.692306+0000","last_undegraded":"2024-09-12T01:16:52.692306+0000","last_fullsized":"2024-09-12T01:16:52.692306+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:52.692217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:52.692217+0000","last_clean_scrub_stamp":"2024-09-12T01:16:52.692217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:44.772129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:49.747098+0000","last_change":"2024-09-12T01:16:49.747098+0000","last_active":"2024-09-12T01:16:49.747098+0000","last_peered":"2024-09-12T01:16:49.747098+0000","last_clean":"2024-09-12T01:16:49.747098+0000","last_became_active":"2024-09-12T00:22:02.427612+0000","last_became_peered":"2024-09-12T00:22:02.427612+0000","last_unstale":"2024-09-12T01:16:49.747098+0000","last_undegraded":"2024-09-12T01:16:49.747098+0000","last_fullsized":"2024-09-12T01:16:49.747098+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:49.747017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:49.747017+0000","last_clean_scrub_stamp":"2024-09-12T01:16:49.747017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:29.496472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.810747+0000","last_change":"2024-09-12T01:16:36.810747+0000","last_active":"2024-09-12T01:16:36.810747+0000","last_peered":"2024-09-12T01:16:36.810747+0000","last_clean":"2024-09-12T01:16:36.810747+0000","last_became_active":"2024-09-12T00:21:58.335619+0000","last_became_peered":"2024-09-12T00:21:58.335619+0000","last_unstale":"2024-09-12T01:16:36.810747+0000","last_undegraded":"2024-09-12T01:16:36.810747+0000","last_fullsized":"2024-09-12T01:16:36.810747+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:16:36.810657+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:16:36.810657+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.810657+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.449800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.790742+0000","last_change":"2024-09-12T01:16:39.790742+0000","last_active":"2024-09-12T01:16:39.790742+0000","last_peered":"2024-09-12T01:16:39.790742+0000","last_clean":"2024-09-12T01:16:39.790742+0000","last_became_active":"2024-09-12T00:17:58.355691+0000","last_became_peered":"2024-09-12T00:17:58.355691+0000","last_unstale":"2024-09-12T01:16:39.790742+0000","last_undegraded":"2024-09-12T01:16:39.790742+0000","last_fullsized":"2024-09-12T01:16:39.790742+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:39.790647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:39.790647+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.790647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:47.087881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:53.697096+0000","last_change":"2024-09-12T01:16:53.697096+0000","last_active":"2024-09-12T01:16:53.697096+0000","last_peered":"2024-09-12T01:16:53.697096+0000","last_clean":"2024-09-12T01:16:53.697096+0000","last_became_active":"2024-09-12T00:39:26.635537+0000","last_became_peered":"2024-09-12T00:39:26.635537+0000","last_unstale":"2024-09-12T01:16:53.697096+0000","last_undegraded":"2024-09-12T01:16:53.697096+0000","last_fullsized":"2024-09-12T01:16:53.697096+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:53.696999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:53.696999+0000","last_clean_scrub_stamp":"2024-09-12T01:16:53.696999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:40.671349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.112205+0000","last_change":"2024-09-12T01:16:41.112205+0000","last_active":"2024-09-12T01:16:41.112205+0000","last_peered":"2024-09-12T01:16:41.112205+0000","last_clean":"2024-09-12T01:16:41.112205+0000","last_became_active":"2024-09-12T00:22:02.429230+0000","last_became_peered":"2024-09-12T00:22:02.429230+0000","last_unstale":"2024-09-12T01:16:41.112205+0000","last_undegraded":"2024-09-12T01:16:41.112205+0000","last_fullsized":"2024-09-12T01:16:41.112205+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:41.112113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:41.112113+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.112113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:15.069560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"267'5","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:43.638511+0000","last_change":"2024-09-12T01:16:43.638511+0000","last_active":"2024-09-12T01:16:43.638511+0000","last_peered":"2024-09-12T01:16:43.638511+0000","last_clean":"2024-09-12T01:16:43.638511+0000","last_became_active":"2024-09-12T00:21:58.338021+0000","last_became_peered":"2024-09-12T00:21:58.338021+0000","last_unstale":"2024-09-12T01:16:43.638511+0000","last_undegraded":"2024-09-12T01:16:43.638511+0000","last_fullsized":"2024-09-12T01:16:43.638511+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:43.638414+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:43.638414+0000","last_clean_scrub_stamp":"2024-09-12T01:16:43.638414+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:21.866097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'22","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.809299+0000","last_change":"2024-09-12T01:16:38.809299+0000","last_active":"2024-09-12T01:16:38.809299+0000","last_peered":"2024-09-12T01:16:38.809299+0000","last_clean":"2024-09-12T01:16:38.809299+0000","last_became_active":"2024-09-12T00:17:58.357755+0000","last_became_peered":"2024-09-12T00:17:58.357755+0000","last_unstale":"2024-09-12T01:16:38.809299+0000","last_undegraded":"2024-09-12T01:16:38.809299+0000","last_fullsized":"2024-09-12T01:16:38.809299+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-12T01:16:38.809205+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-12T01:16:38.809205+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.809205+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.962679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.552766+0000","last_change":"2024-09-12T01:16:36.552696+0000","last_active":"2024-09-12T01:16:36.552766+0000","last_peered":"2024-09-12T01:16:36.552766+0000","last_clean":"2024-09-12T01:16:36.552766+0000","last_became_active":"2024-09-12T00:39:26.630758+0000","last_became_peered":"2024-09-12T00:39:26.630758+0000","last_unstale":"2024-09-12T01:16:36.552766+0000","last_undegraded":"2024-09-12T01:16:36.552766+0000","last_fullsized":"2024-09-12T01:16:36.552766+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:36.552611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:36.552611+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.552611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.494798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'5","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.401417+0000","last_change":"2024-09-12T01:16:30.401417+0000","last_active":"2024-09-12T01:16:30.401417+0000","last_peered":"2024-09-12T01:16:30.401417+0000","last_clean":"2024-09-12T01:16:30.401417+0000","last_became_active":"2024-09-12T00:22:02.427863+0000","last_became_peered":"2024-09-12T00:22:02.427863+0000","last_unstale":"2024-09-12T01:16:30.401417+0000","last_undegraded":"2024-09-12T01:16:30.401417+0000","last_fullsized":"2024-09-12T01:16:30.401417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:30.401321+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:30.401321+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.401321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:49.965892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":40,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.841235+0000","last_change":"2024-09-12T01:16:34.841235+0000","last_active":"2024-09-12T01:16:34.841235+0000","last_peered":"2024-09-12T01:16:34.841235+0000","last_clean":"2024-09-12T01:16:34.841235+0000","last_became_active":"2024-09-12T00:21:58.330308+0000","last_became_peered":"2024-09-12T00:21:58.330308+0000","last_unstale":"2024-09-12T01:16:34.841235+0000","last_undegraded":"2024-09-12T01:16:34.841235+0000","last_fullsized":"2024-09-12T01:16:34.841235+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:16:34.841149+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:16:34.841149+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.841149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:14.738628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'33","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.322083+0000","last_change":"2024-09-12T01:16:25.322083+0000","last_active":"2024-09-12T01:16:25.322083+0000","last_peered":"2024-09-12T01:16:25.322083+0000","last_clean":"2024-09-12T01:16:25.322083+0000","last_became_active":"2024-09-12T00:17:58.360394+0000","last_became_peered":"2024-09-12T00:17:58.360394+0000","last_unstale":"2024-09-12T01:16:25.322083+0000","last_undegraded":"2024-09-12T01:16:25.322083+0000","last_fullsized":"2024-09-12T01:16:25.322083+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-12T01:16:25.322003+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-12T01:16:25.322003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.322003+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:07.467681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":120,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:51.941578+0000","last_change":"2024-09-12T01:16:51.941518+0000","last_active":"2024-09-12T01:16:51.941578+0000","last_peered":"2024-09-12T01:16:51.941578+0000","last_clean":"2024-09-12T01:16:51.941578+0000","last_became_active":"2024-09-12T00:39:26.638443+0000","last_became_peered":"2024-09-12T00:39:26.638443+0000","last_unstale":"2024-09-12T01:16:51.941578+0000","last_undegraded":"2024-09-12T01:16:51.941578+0000","last_fullsized":"2024-09-12T01:16:51.941578+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:51.941429+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:51.941429+0000","last_clean_scrub_stamp":"2024-09-12T01:16:51.941429+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:02.798904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"264'5","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.404450+0000","last_change":"2024-09-12T01:16:31.404392+0000","last_active":"2024-09-12T01:16:31.404450+0000","last_peered":"2024-09-12T01:16:31.404450+0000","last_clean":"2024-09-12T01:16:31.404450+0000","last_became_active":"2024-09-12T00:22:02.419920+0000","last_became_peered":"2024-09-12T00:22:02.419920+0000","last_unstale":"2024-09-12T01:16:31.404450+0000","last_undegraded":"2024-09-12T01:16:31.404450+0000","last_fullsized":"2024-09-12T01:16:31.404450+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:31.404304+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:31.404304+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.404304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:38.209811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6462,"num_write":5,"num_write_kb":6462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"267'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.826392+0000","last_change":"2024-09-12T01:16:35.826278+0000","last_active":"2024-09-12T01:16:35.826392+0000","last_peered":"2024-09-12T01:16:35.826392+0000","last_clean":"2024-09-12T01:16:35.826392+0000","last_became_active":"2024-09-12T00:21:58.334622+0000","last_became_peered":"2024-09-12T00:21:58.334622+0000","last_unstale":"2024-09-12T01:16:35.826392+0000","last_undegraded":"2024-09-12T01:16:35.826392+0000","last_fullsized":"2024-09-12T01:16:35.826392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:35.826174+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:35.826174+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.826174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:31.878816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'18","reported_seq":116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.622681+0000","last_change":"2024-09-12T01:16:35.622681+0000","last_active":"2024-09-12T01:16:35.622681+0000","last_peered":"2024-09-12T01:16:35.622681+0000","last_clean":"2024-09-12T01:16:35.622681+0000","last_became_active":"2024-09-12T00:17:58.361620+0000","last_became_peered":"2024-09-12T00:17:58.361620+0000","last_unstale":"2024-09-12T01:16:35.622681+0000","last_undegraded":"2024-09-12T01:16:35.622681+0000","last_fullsized":"2024-09-12T01:16:35.622681+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'18","last_scrub_stamp":"2024-09-12T01:16:35.622592+0000","last_deep_scrub":"267'18","last_deep_scrub_stamp":"2024-09-12T01:16:35.622592+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.622592+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:23.160375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:53.967814+0000","last_change":"2024-09-12T01:16:53.967704+0000","last_active":"2024-09-12T01:16:53.967814+0000","last_peered":"2024-09-12T01:16:53.967814+0000","last_clean":"2024-09-12T01:16:53.967814+0000","last_became_active":"2024-09-12T00:39:26.643223+0000","last_became_peered":"2024-09-12T00:39:26.643223+0000","last_unstale":"2024-09-12T01:16:53.967814+0000","last_undegraded":"2024-09-12T01:16:53.967814+0000","last_fullsized":"2024-09-12T01:16:53.967814+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:53.967599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:53.967599+0000","last_clean_scrub_stamp":"2024-09-12T01:16:53.967599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:34.491609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'5","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.158764+0000","last_change":"2024-09-12T01:16:42.158764+0000","last_active":"2024-09-12T01:16:42.158764+0000","last_peered":"2024-09-12T01:16:42.158764+0000","last_clean":"2024-09-12T01:16:42.158764+0000","last_became_active":"2024-09-12T00:22:22.311701+0000","last_became_peered":"2024-09-12T00:22:22.311701+0000","last_unstale":"2024-09-12T01:16:42.158764+0000","last_undegraded":"2024-09-12T01:16:42.158764+0000","last_fullsized":"2024-09-12T01:16:42.158764+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:42.158660+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:42.158660+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.158660+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:46.648688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12292,"num_write":5,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:44.666304+0000","last_change":"2024-09-12T01:16:44.666231+0000","last_active":"2024-09-12T01:16:44.666304+0000","last_peered":"2024-09-12T01:16:44.666304+0000","last_clean":"2024-09-12T01:16:44.666304+0000","last_became_active":"2024-09-12T00:21:58.339586+0000","last_became_peered":"2024-09-12T00:21:58.339586+0000","last_unstale":"2024-09-12T01:16:44.666304+0000","last_undegraded":"2024-09-12T01:16:44.666304+0000","last_fullsized":"2024-09-12T01:16:44.666304+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:44.666134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:44.666134+0000","last_clean_scrub_stamp":"2024-09-12T01:16:44.666134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:10.501441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'26","reported_seq":137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.278337+0000","last_change":"2024-09-12T01:16:26.278337+0000","last_active":"2024-09-12T01:16:26.278337+0000","last_peered":"2024-09-12T01:16:26.278337+0000","last_clean":"2024-09-12T01:16:26.278337+0000","last_became_active":"2024-09-12T00:17:58.352129+0000","last_became_peered":"2024-09-12T00:17:58.352129+0000","last_unstale":"2024-09-12T01:16:26.278337+0000","last_undegraded":"2024-09-12T01:16:26.278337+0000","last_fullsized":"2024-09-12T01:16:26.278337+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T01:16:26.278250+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T01:16:26.278250+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.278250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:58.119622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.513104+0000","last_change":"2024-09-12T01:16:37.513017+0000","last_active":"2024-09-12T01:16:37.513104+0000","last_peered":"2024-09-12T01:16:37.513104+0000","last_clean":"2024-09-12T01:16:37.513104+0000","last_became_active":"2024-09-12T00:39:26.635558+0000","last_became_peered":"2024-09-12T00:39:26.635558+0000","last_unstale":"2024-09-12T01:16:37.513104+0000","last_undegraded":"2024-09-12T01:16:37.513104+0000","last_fullsized":"2024-09-12T01:16:37.513104+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:37.512935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:37.512935+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.512935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:39.574872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:47.705340+0000","last_change":"2024-09-12T01:16:47.705340+0000","last_active":"2024-09-12T01:16:47.705340+0000","last_peered":"2024-09-12T01:16:47.705340+0000","last_clean":"2024-09-12T01:16:47.705340+0000","last_became_active":"2024-09-12T00:22:02.427180+0000","last_became_peered":"2024-09-12T00:22:02.427180+0000","last_unstale":"2024-09-12T01:16:47.705340+0000","last_undegraded":"2024-09-12T01:16:47.705340+0000","last_fullsized":"2024-09-12T01:16:47.705340+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:47.705221+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:47.705221+0000","last_clean_scrub_stamp":"2024-09-12T01:16:47.705221+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:52.237912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.153451+0000","last_change":"2024-09-12T01:16:39.153451+0000","last_active":"2024-09-12T01:16:39.153451+0000","last_peered":"2024-09-12T01:16:39.153451+0000","last_clean":"2024-09-12T01:16:39.153451+0000","last_became_active":"2024-09-12T00:21:58.334446+0000","last_became_peered":"2024-09-12T00:21:58.334446+0000","last_unstale":"2024-09-12T01:16:39.153451+0000","last_undegraded":"2024-09-12T01:16:39.153451+0000","last_fullsized":"2024-09-12T01:16:39.153451+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:39.153343+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:39.153343+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.153343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:17.459737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'14","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.710648+0000","last_change":"2024-09-12T01:16:38.710648+0000","last_active":"2024-09-12T01:16:38.710648+0000","last_peered":"2024-09-12T01:16:38.710648+0000","last_clean":"2024-09-12T01:16:38.710648+0000","last_became_active":"2024-09-12T00:17:58.360560+0000","last_became_peered":"2024-09-12T00:17:58.360560+0000","last_unstale":"2024-09-12T01:16:38.710648+0000","last_undegraded":"2024-09-12T01:16:38.710648+0000","last_fullsized":"2024-09-12T01:16:38.710648+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-12T01:16:38.710552+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-12T01:16:38.710552+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.710552+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:31.636846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.248067+0000","last_change":"2024-09-12T01:16:25.248007+0000","last_active":"2024-09-12T01:16:25.248067+0000","last_peered":"2024-09-12T01:16:25.248067+0000","last_clean":"2024-09-12T01:16:25.248067+0000","last_became_active":"2024-09-12T00:39:26.635359+0000","last_became_peered":"2024-09-12T00:39:26.635359+0000","last_unstale":"2024-09-12T01:16:25.248067+0000","last_undegraded":"2024-09-12T01:16:25.248067+0000","last_fullsized":"2024-09-12T01:16:25.248067+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:25.247921+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:25.247921+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.247921+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:23.777053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:46.682719+0000","last_change":"2024-09-12T01:16:46.682719+0000","last_active":"2024-09-12T01:16:46.682719+0000","last_peered":"2024-09-12T01:16:46.682719+0000","last_clean":"2024-09-12T01:16:46.682719+0000","last_became_active":"2024-09-12T00:22:02.431994+0000","last_became_peered":"2024-09-12T00:22:02.431994+0000","last_unstale":"2024-09-12T01:16:46.682719+0000","last_undegraded":"2024-09-12T01:16:46.682719+0000","last_fullsized":"2024-09-12T01:16:46.682719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:16:46.682635+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:16:46.682635+0000","last_clean_scrub_stamp":"2024-09-12T01:16:46.682635+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:32.497622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.930374+0000","last_change":"2024-09-12T01:16:40.930374+0000","last_active":"2024-09-12T01:16:40.930374+0000","last_peered":"2024-09-12T01:16:40.930374+0000","last_clean":"2024-09-12T01:16:40.930374+0000","last_became_active":"2024-09-12T00:21:58.327504+0000","last_became_peered":"2024-09-12T00:21:58.327504+0000","last_unstale":"2024-09-12T01:16:40.930374+0000","last_undegraded":"2024-09-12T01:16:40.930374+0000","last_fullsized":"2024-09-12T01:16:40.930374+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:40.930291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:40.930291+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.930291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.314624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'62","reported_seq":230,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.760835+0000","last_change":"2024-09-12T01:16:37.760835+0000","last_active":"2024-09-12T01:16:37.760835+0000","last_peered":"2024-09-12T01:16:37.760835+0000","last_clean":"2024-09-12T01:16:37.760835+0000","last_became_active":"2024-09-12T00:17:58.360095+0000","last_became_peered":"2024-09-12T00:17:58.360095+0000","last_unstale":"2024-09-12T01:16:37.760835+0000","last_undegraded":"2024-09-12T01:16:37.760835+0000","last_fullsized":"2024-09-12T01:16:37.760835+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'62","last_scrub_stamp":"2024-09-12T01:16:37.760756+0000","last_deep_scrub":"267'62","last_deep_scrub_stamp":"2024-09-12T01:16:37.760756+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.760756+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:08.529977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":213,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:52.944449+0000","last_change":"2024-09-12T01:16:52.944449+0000","last_active":"2024-09-12T01:16:52.944449+0000","last_peered":"2024-09-12T01:16:52.944449+0000","last_clean":"2024-09-12T01:16:52.944449+0000","last_became_active":"2024-09-12T00:39:26.639681+0000","last_became_peered":"2024-09-12T00:39:26.639681+0000","last_unstale":"2024-09-12T01:16:52.944449+0000","last_undegraded":"2024-09-12T01:16:52.944449+0000","last_fullsized":"2024-09-12T01:16:52.944449+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:52.944353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:52.944353+0000","last_clean_scrub_stamp":"2024-09-12T01:16:52.944353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:11.550310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:48.724424+0000","last_change":"2024-09-12T01:16:48.724424+0000","last_active":"2024-09-12T01:16:48.724424+0000","last_peered":"2024-09-12T01:16:48.724424+0000","last_clean":"2024-09-12T01:16:48.724424+0000","last_became_active":"2024-09-12T00:22:02.427285+0000","last_became_peered":"2024-09-12T00:22:02.427285+0000","last_unstale":"2024-09-12T01:16:48.724424+0000","last_undegraded":"2024-09-12T01:16:48.724424+0000","last_fullsized":"2024-09-12T01:16:48.724424+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:48.724330+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:48.724330+0000","last_clean_scrub_stamp":"2024-09-12T01:16:48.724330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:09.001256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.214116+0000","last_change":"2024-09-12T01:16:21.214116+0000","last_active":"2024-09-12T01:16:21.214116+0000","last_peered":"2024-09-12T01:16:21.214116+0000","last_clean":"2024-09-12T01:16:21.214116+0000","last_became_active":"2024-09-12T00:21:58.335100+0000","last_became_peered":"2024-09-12T00:21:58.335100+0000","last_unstale":"2024-09-12T01:16:21.214116+0000","last_undegraded":"2024-09-12T01:16:21.214116+0000","last_fullsized":"2024-09-12T01:16:21.214116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:21.214016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:21.214016+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.214016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:39.484612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'92","reported_seq":379,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.220753+0000","last_change":"2024-09-12T01:16:17.220753+0000","last_active":"2024-09-12T01:16:17.220753+0000","last_peered":"2024-09-12T01:16:17.220753+0000","last_clean":"2024-09-12T01:16:17.220753+0000","last_became_active":"2024-09-12T00:17:58.350522+0000","last_became_peered":"2024-09-12T00:17:58.350522+0000","last_unstale":"2024-09-12T01:16:17.220753+0000","last_undegraded":"2024-09-12T01:16:17.220753+0000","last_fullsized":"2024-09-12T01:16:17.220753+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'92","last_scrub_stamp":"2024-09-12T01:16:17.220682+0000","last_deep_scrub":"267'92","last_deep_scrub_stamp":"2024-09-12T01:16:17.220682+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.220682+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:17.904421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":413,"num_write":129,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4000,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:45.213940+0000","last_change":"2024-09-12T01:16:45.213868+0000","last_active":"2024-09-12T01:16:45.213940+0000","last_peered":"2024-09-12T01:16:45.213940+0000","last_clean":"2024-09-12T01:16:45.213940+0000","last_became_active":"2024-09-12T00:39:26.642486+0000","last_became_peered":"2024-09-12T00:39:26.642486+0000","last_unstale":"2024-09-12T01:16:45.213940+0000","last_undegraded":"2024-09-12T01:16:45.213940+0000","last_fullsized":"2024-09-12T01:16:45.213940+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:45.213766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:45.213766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:45.213766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:42.345841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.890049+0000","last_change":"2024-09-12T01:16:40.890049+0000","last_active":"2024-09-12T01:16:40.890049+0000","last_peered":"2024-09-12T01:16:40.890049+0000","last_clean":"2024-09-12T01:16:40.890049+0000","last_became_active":"2024-09-12T00:22:02.417518+0000","last_became_peered":"2024-09-12T00:22:02.417518+0000","last_unstale":"2024-09-12T01:16:40.890049+0000","last_undegraded":"2024-09-12T01:16:40.890049+0000","last_fullsized":"2024-09-12T01:16:40.890049+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:40.889958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:40.889958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.889958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:39.906774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.663632+0000","last_change":"2024-09-12T01:16:42.663632+0000","last_active":"2024-09-12T01:16:42.663632+0000","last_peered":"2024-09-12T01:16:42.663632+0000","last_clean":"2024-09-12T01:16:42.663632+0000","last_became_active":"2024-09-12T00:21:58.337079+0000","last_became_peered":"2024-09-12T00:21:58.337079+0000","last_unstale":"2024-09-12T01:16:42.663632+0000","last_undegraded":"2024-09-12T01:16:42.663632+0000","last_fullsized":"2024-09-12T01:16:42.663632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:16:42.663541+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:16:42.663541+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.663541+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:47.189751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24618,"num_write":22,"num_write_kb":14376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'26","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.960124+0000","last_change":"2024-09-12T01:16:35.960124+0000","last_active":"2024-09-12T01:16:35.960124+0000","last_peered":"2024-09-12T01:16:35.960124+0000","last_clean":"2024-09-12T01:16:35.960124+0000","last_became_active":"2024-09-12T00:17:58.360141+0000","last_became_peered":"2024-09-12T00:17:58.360141+0000","last_unstale":"2024-09-12T01:16:35.960124+0000","last_undegraded":"2024-09-12T01:16:35.960124+0000","last_fullsized":"2024-09-12T01:16:35.960124+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T01:16:35.960026+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T01:16:35.960026+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.960026+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:40.754856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:54.698623+0000","last_change":"2024-09-12T01:16:54.698623+0000","last_active":"2024-09-12T01:16:54.698623+0000","last_peered":"2024-09-12T01:16:54.698623+0000","last_clean":"2024-09-12T01:16:54.698623+0000","last_became_active":"2024-09-12T00:39:26.636434+0000","last_became_peered":"2024-09-12T00:39:26.636434+0000","last_unstale":"2024-09-12T01:16:54.698623+0000","last_undegraded":"2024-09-12T01:16:54.698623+0000","last_fullsized":"2024-09-12T01:16:54.698623+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:54.698481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:54.698481+0000","last_clean_scrub_stamp":"2024-09-12T01:16:54.698481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:34.330298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"267'2","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.494616+0000","last_change":"2024-09-12T01:16:33.494616+0000","last_active":"2024-09-12T01:16:33.494616+0000","last_peered":"2024-09-12T01:16:33.494616+0000","last_clean":"2024-09-12T01:16:33.494616+0000","last_became_active":"2024-09-12T00:22:02.420528+0000","last_became_peered":"2024-09-12T00:22:02.420528+0000","last_unstale":"2024-09-12T01:16:33.494616+0000","last_undegraded":"2024-09-12T01:16:33.494616+0000","last_fullsized":"2024-09-12T01:16:33.494616+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:33.494521+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:33.494521+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.494521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:20.312164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.862913+0000","last_change":"2024-09-12T01:16:33.862913+0000","last_active":"2024-09-12T01:16:33.862913+0000","last_peered":"2024-09-12T01:16:33.862913+0000","last_clean":"2024-09-12T01:16:33.862913+0000","last_became_active":"2024-09-12T00:21:58.337215+0000","last_became_peered":"2024-09-12T00:21:58.337215+0000","last_unstale":"2024-09-12T01:16:33.862913+0000","last_undegraded":"2024-09-12T01:16:33.862913+0000","last_fullsized":"2024-09-12T01:16:33.862913+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:33.862817+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:33.862817+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.862817+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:40.242997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.923759+0000","last_change":"2024-09-12T01:16:34.923759+0000","last_active":"2024-09-12T01:16:34.923759+0000","last_peered":"2024-09-12T01:16:34.923759+0000","last_clean":"2024-09-12T01:16:34.923759+0000","last_became_active":"2024-09-12T00:17:58.360592+0000","last_became_peered":"2024-09-12T00:17:58.360592+0000","last_unstale":"2024-09-12T01:16:34.923759+0000","last_undegraded":"2024-09-12T01:16:34.923759+0000","last_fullsized":"2024-09-12T01:16:34.923759+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-12T01:16:34.923677+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-12T01:16:34.923677+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.923677+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:39.921202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":36,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:52.665685+0000","last_change":"2024-09-12T01:16:52.665685+0000","last_active":"2024-09-12T01:16:52.665685+0000","last_peered":"2024-09-12T01:16:52.665685+0000","last_clean":"2024-09-12T01:16:52.665685+0000","last_became_active":"2024-09-12T00:39:26.641432+0000","last_became_peered":"2024-09-12T00:39:26.641432+0000","last_unstale":"2024-09-12T01:16:52.665685+0000","last_undegraded":"2024-09-12T01:16:52.665685+0000","last_fullsized":"2024-09-12T01:16:52.665685+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:52.665587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:52.665587+0000","last_clean_scrub_stamp":"2024-09-12T01:16:52.665587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:11.426799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":54,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.503347+0000","last_change":"2024-09-12T01:16:34.503347+0000","last_active":"2024-09-12T01:16:34.503347+0000","last_peered":"2024-09-12T01:16:34.503347+0000","last_clean":"2024-09-12T01:16:34.503347+0000","last_became_active":"2024-09-12T00:22:02.423012+0000","last_became_peered":"2024-09-12T00:22:02.423012+0000","last_unstale":"2024-09-12T01:16:34.503347+0000","last_undegraded":"2024-09-12T01:16:34.503347+0000","last_fullsized":"2024-09-12T01:16:34.503347+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:34.503246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:34.503246+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.503246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:49.517475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.765298+0000","last_change":"2024-09-12T01:16:40.765298+0000","last_active":"2024-09-12T01:16:40.765298+0000","last_peered":"2024-09-12T01:16:40.765298+0000","last_clean":"2024-09-12T01:16:40.765298+0000","last_became_active":"2024-09-12T00:21:58.334493+0000","last_became_peered":"2024-09-12T00:21:58.334493+0000","last_unstale":"2024-09-12T01:16:40.765298+0000","last_undegraded":"2024-09-12T01:16:40.765298+0000","last_fullsized":"2024-09-12T01:16:40.765298+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:40.765208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:40.765208+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.765208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:52.075681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'39","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.600584+0000","last_change":"2024-09-12T01:16:34.600584+0000","last_active":"2024-09-12T01:16:34.600584+0000","last_peered":"2024-09-12T01:16:34.600584+0000","last_clean":"2024-09-12T01:16:34.600584+0000","last_became_active":"2024-09-12T00:17:58.354989+0000","last_became_peered":"2024-09-12T00:17:58.354989+0000","last_unstale":"2024-09-12T01:16:34.600584+0000","last_undegraded":"2024-09-12T01:16:34.600584+0000","last_fullsized":"2024-09-12T01:16:34.600584+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'39","last_scrub_stamp":"2024-09-12T01:16:34.600480+0000","last_deep_scrub":"267'39","last_deep_scrub_stamp":"2024-09-12T01:16:34.600480+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.600480+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:20.236186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":70,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:50.626614+0000","last_change":"2024-09-12T01:16:50.626548+0000","last_active":"2024-09-12T01:16:50.626614+0000","last_peered":"2024-09-12T01:16:50.626614+0000","last_clean":"2024-09-12T01:16:50.626614+0000","last_became_active":"2024-09-12T00:39:26.627899+0000","last_became_peered":"2024-09-12T00:39:26.627899+0000","last_unstale":"2024-09-12T01:16:50.626614+0000","last_undegraded":"2024-09-12T01:16:50.626614+0000","last_fullsized":"2024-09-12T01:16:50.626614+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:50.626452+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:50.626452+0000","last_clean_scrub_stamp":"2024-09-12T01:16:50.626452+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:37.398315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'3","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:45.648640+0000","last_change":"2024-09-12T01:16:45.648640+0000","last_active":"2024-09-12T01:16:45.648640+0000","last_peered":"2024-09-12T01:16:45.648640+0000","last_clean":"2024-09-12T01:16:45.648640+0000","last_became_active":"2024-09-12T00:22:02.427322+0000","last_became_peered":"2024-09-12T00:22:02.427322+0000","last_unstale":"2024-09-12T01:16:45.648640+0000","last_undegraded":"2024-09-12T01:16:45.648640+0000","last_fullsized":"2024-09-12T01:16:45.648640+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:45.648552+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:45.648552+0000","last_clean_scrub_stamp":"2024-09-12T01:16:45.648552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:29.945712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.321361+0000","last_change":"2024-09-12T01:16:27.321361+0000","last_active":"2024-09-12T01:16:27.321361+0000","last_peered":"2024-09-12T01:16:27.321361+0000","last_clean":"2024-09-12T01:16:27.321361+0000","last_became_active":"2024-09-12T00:21:58.329166+0000","last_became_peered":"2024-09-12T00:21:58.329166+0000","last_unstale":"2024-09-12T01:16:27.321361+0000","last_undegraded":"2024-09-12T01:16:27.321361+0000","last_fullsized":"2024-09-12T01:16:27.321361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:16:27.321237+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:16:27.321237+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.321237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:45.617097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'42","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.914520+0000","last_change":"2024-09-12T01:16:31.914520+0000","last_active":"2024-09-12T01:16:31.914520+0000","last_peered":"2024-09-12T01:16:31.914520+0000","last_clean":"2024-09-12T01:16:31.914520+0000","last_became_active":"2024-09-12T00:17:58.355530+0000","last_became_peered":"2024-09-12T00:17:58.355530+0000","last_unstale":"2024-09-12T01:16:31.914520+0000","last_undegraded":"2024-09-12T01:16:31.914520+0000","last_fullsized":"2024-09-12T01:16:31.914520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:16:31.914428+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:16:31.914428+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.914428+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:59.113318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":155,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:51.705343+0000","last_change":"2024-09-12T01:16:51.705343+0000","last_active":"2024-09-12T01:16:51.705343+0000","last_peered":"2024-09-12T01:16:51.705343+0000","last_clean":"2024-09-12T01:16:51.705343+0000","last_became_active":"2024-09-12T00:39:26.635996+0000","last_became_peered":"2024-09-12T00:39:26.635996+0000","last_unstale":"2024-09-12T01:16:51.705343+0000","last_undegraded":"2024-09-12T01:16:51.705343+0000","last_fullsized":"2024-09-12T01:16:51.705343+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:51.705261+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:51.705261+0000","last_clean_scrub_stamp":"2024-09-12T01:16:51.705261+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:29.353144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.372292+0000","last_change":"2024-09-12T01:16:29.372292+0000","last_active":"2024-09-12T01:16:29.372292+0000","last_peered":"2024-09-12T01:16:29.372292+0000","last_clean":"2024-09-12T01:16:29.372292+0000","last_became_active":"2024-09-12T00:22:02.423766+0000","last_became_peered":"2024-09-12T00:22:02.423766+0000","last_unstale":"2024-09-12T01:16:29.372292+0000","last_undegraded":"2024-09-12T01:16:29.372292+0000","last_fullsized":"2024-09-12T01:16:29.372292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:29.372211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:29.372211+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.372211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:41.792146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.176235+0000","last_change":"2024-09-12T01:16:38.176235+0000","last_active":"2024-09-12T01:16:38.176235+0000","last_peered":"2024-09-12T01:16:38.176235+0000","last_clean":"2024-09-12T01:16:38.176235+0000","last_became_active":"2024-09-12T00:21:58.334482+0000","last_became_peered":"2024-09-12T00:21:58.334482+0000","last_unstale":"2024-09-12T01:16:38.176235+0000","last_undegraded":"2024-09-12T01:16:38.176235+0000","last_fullsized":"2024-09-12T01:16:38.176235+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:38.176146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:38.176146+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.176146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:16.851231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'8","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.717778+0000","last_change":"2024-09-12T01:16:36.717778+0000","last_active":"2024-09-12T01:16:36.717778+0000","last_peered":"2024-09-12T01:16:36.717778+0000","last_clean":"2024-09-12T01:16:36.717778+0000","last_became_active":"2024-09-12T00:17:58.357226+0000","last_became_peered":"2024-09-12T00:17:58.357226+0000","last_unstale":"2024-09-12T01:16:36.717778+0000","last_undegraded":"2024-09-12T01:16:36.717778+0000","last_fullsized":"2024-09-12T01:16:36.717778+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:16:36.717693+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:16:36.717693+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.717693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:30.380003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.234052+0000","last_change":"2024-09-12T01:16:24.233987+0000","last_active":"2024-09-12T01:16:24.234052+0000","last_peered":"2024-09-12T01:16:24.234052+0000","last_clean":"2024-09-12T01:16:24.234052+0000","last_became_active":"2024-09-12T00:39:26.638202+0000","last_became_peered":"2024-09-12T00:39:26.638202+0000","last_unstale":"2024-09-12T01:16:24.234052+0000","last_undegraded":"2024-09-12T01:16:24.234052+0000","last_fullsized":"2024-09-12T01:16:24.234052+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.233895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.233895+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.233895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:37.675094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:43.713595+0000","last_change":"2024-09-12T01:16:43.713595+0000","last_active":"2024-09-12T01:16:43.713595+0000","last_peered":"2024-09-12T01:16:43.713595+0000","last_clean":"2024-09-12T01:16:43.713595+0000","last_became_active":"2024-09-12T00:22:02.427762+0000","last_became_peered":"2024-09-12T00:22:02.427762+0000","last_unstale":"2024-09-12T01:16:43.713595+0000","last_undegraded":"2024-09-12T01:16:43.713595+0000","last_fullsized":"2024-09-12T01:16:43.713595+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:43.713502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:43.713502+0000","last_clean_scrub_stamp":"2024-09-12T01:16:43.713502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.949327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"267'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.889851+0000","last_change":"2024-09-12T01:16:39.889851+0000","last_active":"2024-09-12T01:16:39.889851+0000","last_peered":"2024-09-12T01:16:39.889851+0000","last_clean":"2024-09-12T01:16:39.889851+0000","last_became_active":"2024-09-12T00:21:58.338104+0000","last_became_peered":"2024-09-12T00:21:58.338104+0000","last_unstale":"2024-09-12T01:16:39.889851+0000","last_undegraded":"2024-09-12T01:16:39.889851+0000","last_fullsized":"2024-09-12T01:16:39.889851+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:39.889748+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:39.889748+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.889748+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:07.992079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10244,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'33","reported_seq":154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.688308+0000","last_change":"2024-09-12T01:16:35.688205+0000","last_active":"2024-09-12T01:16:35.688308+0000","last_peered":"2024-09-12T01:16:35.688308+0000","last_clean":"2024-09-12T01:16:35.688308+0000","last_became_active":"2024-09-12T00:17:58.351876+0000","last_became_peered":"2024-09-12T00:17:58.351876+0000","last_unstale":"2024-09-12T01:16:35.688308+0000","last_undegraded":"2024-09-12T01:16:35.688308+0000","last_fullsized":"2024-09-12T01:16:35.688308+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-12T01:16:35.688094+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-12T01:16:35.688094+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.688094+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:20.943350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":110,"num_write":71,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:48.967733+0000","last_change":"2024-09-12T01:16:48.967733+0000","last_active":"2024-09-12T01:16:48.967733+0000","last_peered":"2024-09-12T01:16:48.967733+0000","last_clean":"2024-09-12T01:16:48.967733+0000","last_became_active":"2024-09-12T00:39:26.639704+0000","last_became_peered":"2024-09-12T00:39:26.639704+0000","last_unstale":"2024-09-12T01:16:48.967733+0000","last_undegraded":"2024-09-12T01:16:48.967733+0000","last_fullsized":"2024-09-12T01:16:48.967733+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:48.967620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:48.967620+0000","last_clean_scrub_stamp":"2024-09-12T01:16:48.967620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:54.727707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'6","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.738041+0000","last_change":"2024-09-12T01:16:42.738041+0000","last_active":"2024-09-12T01:16:42.738041+0000","last_peered":"2024-09-12T01:16:42.738041+0000","last_clean":"2024-09-12T01:16:42.738041+0000","last_became_active":"2024-09-12T00:22:02.430034+0000","last_became_peered":"2024-09-12T00:22:02.430034+0000","last_unstale":"2024-09-12T01:16:42.738041+0000","last_undegraded":"2024-09-12T01:16:42.738041+0000","last_fullsized":"2024-09-12T01:16:42.738041+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:42.737940+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:42.737940+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.737940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:38.606599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.258175+0000","last_change":"2024-09-12T01:16:20.258175+0000","last_active":"2024-09-12T01:16:20.258175+0000","last_peered":"2024-09-12T01:16:20.258175+0000","last_clean":"2024-09-12T01:16:20.258175+0000","last_became_active":"2024-09-12T00:21:58.333135+0000","last_became_peered":"2024-09-12T00:21:58.333135+0000","last_unstale":"2024-09-12T01:16:20.258175+0000","last_undegraded":"2024-09-12T01:16:20.258175+0000","last_fullsized":"2024-09-12T01:16:20.258175+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:20.258077+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:20.258077+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.258077+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:41.884363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'34","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.202077+0000","last_change":"2024-09-12T01:16:36.202077+0000","last_active":"2024-09-12T01:16:36.202077+0000","last_peered":"2024-09-12T01:16:36.202077+0000","last_clean":"2024-09-12T01:16:36.202077+0000","last_became_active":"2024-09-12T00:17:58.360064+0000","last_became_peered":"2024-09-12T00:17:58.360064+0000","last_unstale":"2024-09-12T01:16:36.202077+0000","last_undegraded":"2024-09-12T01:16:36.202077+0000","last_fullsized":"2024-09-12T01:16:36.202077+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-12T01:16:36.201987+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-12T01:16:36.201987+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.201987+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:09.843005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":114,"num_write":67,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.433034+0000","last_change":"2024-09-12T01:16:33.433034+0000","last_active":"2024-09-12T01:16:33.433034+0000","last_peered":"2024-09-12T01:16:33.433034+0000","last_clean":"2024-09-12T01:16:33.433034+0000","last_became_active":"2024-09-12T00:39:26.620012+0000","last_became_peered":"2024-09-12T00:39:26.620012+0000","last_unstale":"2024-09-12T01:16:33.433034+0000","last_undegraded":"2024-09-12T01:16:33.433034+0000","last_fullsized":"2024-09-12T01:16:33.433034+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:33.432943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:33.432943+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.432943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.218370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.458122+0000","last_change":"2024-09-12T01:16:32.458122+0000","last_active":"2024-09-12T01:16:32.458122+0000","last_peered":"2024-09-12T01:16:32.458122+0000","last_clean":"2024-09-12T01:16:32.458122+0000","last_became_active":"2024-09-12T00:22:02.420536+0000","last_became_peered":"2024-09-12T00:22:02.420536+0000","last_unstale":"2024-09-12T01:16:32.458122+0000","last_undegraded":"2024-09-12T01:16:32.458122+0000","last_fullsized":"2024-09-12T01:16:32.458122+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.458032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.458032+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.458032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:19.110535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.686568+0000","last_change":"2024-09-12T01:16:40.686568+0000","last_active":"2024-09-12T01:16:40.686568+0000","last_peered":"2024-09-12T01:16:40.686568+0000","last_clean":"2024-09-12T01:16:40.686568+0000","last_became_active":"2024-09-12T00:21:58.339390+0000","last_became_peered":"2024-09-12T00:21:58.339390+0000","last_unstale":"2024-09-12T01:16:40.686568+0000","last_undegraded":"2024-09-12T01:16:40.686568+0000","last_fullsized":"2024-09-12T01:16:40.686568+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:40.686467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:40.686467+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.686467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:25.120844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'22","reported_seq":128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.334176+0000","last_change":"2024-09-12T01:16:24.334118+0000","last_active":"2024-09-12T01:16:24.334176+0000","last_peered":"2024-09-12T01:16:24.334176+0000","last_clean":"2024-09-12T01:16:24.334176+0000","last_became_active":"2024-09-12T00:17:58.355602+0000","last_became_peered":"2024-09-12T00:17:58.355602+0000","last_unstale":"2024-09-12T01:16:24.334176+0000","last_undegraded":"2024-09-12T01:16:24.334176+0000","last_fullsized":"2024-09-12T01:16:24.334176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-12T01:16:24.334043+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-12T01:16:24.334043+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.334043+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:35.826962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:47.979905+0000","last_change":"2024-09-12T01:16:47.979905+0000","last_active":"2024-09-12T01:16:47.979905+0000","last_peered":"2024-09-12T01:16:47.979905+0000","last_clean":"2024-09-12T01:16:47.979905+0000","last_became_active":"2024-09-12T00:39:26.644190+0000","last_became_peered":"2024-09-12T00:39:26.644190+0000","last_unstale":"2024-09-12T01:16:47.979905+0000","last_undegraded":"2024-09-12T01:16:47.979905+0000","last_fullsized":"2024-09-12T01:16:47.979905+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:47.979740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:47.979740+0000","last_clean_scrub_stamp":"2024-09-12T01:16:47.979740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:25.924065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:44.694235+0000","last_change":"2024-09-12T01:16:44.694235+0000","last_active":"2024-09-12T01:16:44.694235+0000","last_peered":"2024-09-12T01:16:44.694235+0000","last_clean":"2024-09-12T01:16:44.694235+0000","last_became_active":"2024-09-12T00:22:02.429289+0000","last_became_peered":"2024-09-12T00:22:02.429289+0000","last_unstale":"2024-09-12T01:16:44.694235+0000","last_undegraded":"2024-09-12T01:16:44.694235+0000","last_fullsized":"2024-09-12T01:16:44.694235+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:44.694135+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:44.694135+0000","last_clean_scrub_stamp":"2024-09-12T01:16:44.694135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:30.158612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'3","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.371187+0000","last_change":"2024-09-12T01:16:28.371187+0000","last_active":"2024-09-12T01:16:28.371187+0000","last_peered":"2024-09-12T01:16:28.371187+0000","last_clean":"2024-09-12T01:16:28.371187+0000","last_became_active":"2024-09-12T00:21:58.334362+0000","last_became_peered":"2024-09-12T00:21:58.334362+0000","last_unstale":"2024-09-12T01:16:28.371187+0000","last_undegraded":"2024-09-12T01:16:28.371187+0000","last_fullsized":"2024-09-12T01:16:28.371187+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:16:28.371086+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:16:28.371086+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.371086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:05.721958+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'50","reported_seq":207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.229496+0000","last_change":"2024-09-12T01:16:16.229433+0000","last_active":"2024-09-12T01:16:16.229496+0000","last_peered":"2024-09-12T01:16:16.229496+0000","last_clean":"2024-09-12T01:16:16.229496+0000","last_became_active":"2024-09-12T00:17:58.353253+0000","last_became_peered":"2024-09-12T00:17:58.353253+0000","last_unstale":"2024-09-12T01:16:16.229496+0000","last_undegraded":"2024-09-12T01:16:16.229496+0000","last_fullsized":"2024-09-12T01:16:16.229496+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'50","last_scrub_stamp":"2024-09-12T01:16:16.229344+0000","last_deep_scrub":"267'50","last_deep_scrub_stamp":"2024-09-12T01:16:16.229344+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.229344+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:06.509012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":79,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:50.721430+0000","last_change":"2024-09-12T01:16:50.721430+0000","last_active":"2024-09-12T01:16:50.721430+0000","last_peered":"2024-09-12T01:16:50.721430+0000","last_clean":"2024-09-12T01:16:50.721430+0000","last_became_active":"2024-09-12T00:39:26.633295+0000","last_became_peered":"2024-09-12T00:39:26.633295+0000","last_unstale":"2024-09-12T01:16:50.721430+0000","last_undegraded":"2024-09-12T01:16:50.721430+0000","last_fullsized":"2024-09-12T01:16:50.721430+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:50.721346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:50.721346+0000","last_clean_scrub_stamp":"2024-09-12T01:16:50.721346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:11.926748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.863570+0000","last_change":"2024-09-12T01:16:39.863570+0000","last_active":"2024-09-12T01:16:39.863570+0000","last_peered":"2024-09-12T01:16:39.863570+0000","last_clean":"2024-09-12T01:16:39.863570+0000","last_became_active":"2024-09-12T00:22:02.429088+0000","last_became_peered":"2024-09-12T00:22:02.429088+0000","last_unstale":"2024-09-12T01:16:39.863570+0000","last_undegraded":"2024-09-12T01:16:39.863570+0000","last_fullsized":"2024-09-12T01:16:39.863570+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:39.863475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:39.863475+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.863475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:48.586996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.663533+0000","last_change":"2024-09-12T01:16:37.663533+0000","last_active":"2024-09-12T01:16:37.663533+0000","last_peered":"2024-09-12T01:16:37.663533+0000","last_clean":"2024-09-12T01:16:37.663533+0000","last_became_active":"2024-09-12T00:21:58.338592+0000","last_became_peered":"2024-09-12T00:21:58.338592+0000","last_unstale":"2024-09-12T01:16:37.663533+0000","last_undegraded":"2024-09-12T01:16:37.663533+0000","last_fullsized":"2024-09-12T01:16:37.663533+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:37.663425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:37.663425+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.663425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:27.716808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'20","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.664247+0000","last_change":"2024-09-12T01:16:32.664247+0000","last_active":"2024-09-12T01:16:32.664247+0000","last_peered":"2024-09-12T01:16:32.664247+0000","last_clean":"2024-09-12T01:16:32.664247+0000","last_became_active":"2024-09-12T00:17:58.357219+0000","last_became_peered":"2024-09-12T00:17:58.357219+0000","last_unstale":"2024-09-12T01:16:32.664247+0000","last_undegraded":"2024-09-12T01:16:32.664247+0000","last_fullsized":"2024-09-12T01:16:32.664247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-12T01:16:32.664160+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-12T01:16:32.664160+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.664160+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:27.988848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":69,"num_write":37,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:50.964335+0000","last_change":"2024-09-12T01:16:50.964335+0000","last_active":"2024-09-12T01:16:50.964335+0000","last_peered":"2024-09-12T01:16:50.964335+0000","last_clean":"2024-09-12T01:16:50.964335+0000","last_became_active":"2024-09-12T00:39:26.643469+0000","last_became_peered":"2024-09-12T00:39:26.643469+0000","last_unstale":"2024-09-12T01:16:50.964335+0000","last_undegraded":"2024-09-12T01:16:50.964335+0000","last_fullsized":"2024-09-12T01:16:50.964335+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:50.964246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:50.964246+0000","last_clean_scrub_stamp":"2024-09-12T01:16:50.964246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:02.004587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.963637+0000","last_change":"2024-09-12T01:16:42.963637+0000","last_active":"2024-09-12T01:16:42.963637+0000","last_peered":"2024-09-12T01:16:42.963637+0000","last_clean":"2024-09-12T01:16:42.963637+0000","last_became_active":"2024-09-12T00:22:02.422532+0000","last_became_peered":"2024-09-12T00:22:02.422532+0000","last_unstale":"2024-09-12T01:16:42.963637+0000","last_undegraded":"2024-09-12T01:16:42.963637+0000","last_fullsized":"2024-09-12T01:16:42.963637+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:16:42.963514+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:16:42.963514+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.963514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:12.283873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.327600+0000","last_change":"2024-09-12T01:16:27.327600+0000","last_active":"2024-09-12T01:16:27.327600+0000","last_peered":"2024-09-12T01:16:27.327600+0000","last_clean":"2024-09-12T01:16:27.327600+0000","last_became_active":"2024-09-12T00:21:58.332715+0000","last_became_peered":"2024-09-12T00:21:58.332715+0000","last_unstale":"2024-09-12T01:16:27.327600+0000","last_undegraded":"2024-09-12T01:16:27.327600+0000","last_fullsized":"2024-09-12T01:16:27.327600+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:27.327505+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:27.327505+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.327505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:27.914435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'12","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.921421+0000","last_change":"2024-09-12T01:16:33.921334+0000","last_active":"2024-09-12T01:16:33.921421+0000","last_peered":"2024-09-12T01:16:33.921421+0000","last_clean":"2024-09-12T01:16:33.921421+0000","last_became_active":"2024-09-12T00:17:58.347709+0000","last_became_peered":"2024-09-12T00:17:58.347709+0000","last_unstale":"2024-09-12T01:16:33.921421+0000","last_undegraded":"2024-09-12T01:16:33.921421+0000","last_fullsized":"2024-09-12T01:16:33.921421+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-12T01:16:33.921216+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-12T01:16:33.921216+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.921216+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:14.561691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:49.935796+0000","last_change":"2024-09-12T01:16:49.935796+0000","last_active":"2024-09-12T01:16:49.935796+0000","last_peered":"2024-09-12T01:16:49.935796+0000","last_clean":"2024-09-12T01:16:49.935796+0000","last_became_active":"2024-09-12T00:39:26.639094+0000","last_became_peered":"2024-09-12T00:39:26.639094+0000","last_unstale":"2024-09-12T01:16:49.935796+0000","last_undegraded":"2024-09-12T01:16:49.935796+0000","last_fullsized":"2024-09-12T01:16:49.935796+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:49.935710+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:49.935710+0000","last_clean_scrub_stamp":"2024-09-12T01:16:49.935710+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:04.685767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.428970+0000","last_change":"2024-09-12T01:16:31.428970+0000","last_active":"2024-09-12T01:16:31.428970+0000","last_peered":"2024-09-12T01:16:31.428970+0000","last_clean":"2024-09-12T01:16:31.428970+0000","last_became_active":"2024-09-12T00:22:02.422922+0000","last_became_peered":"2024-09-12T00:22:02.422922+0000","last_unstale":"2024-09-12T01:16:31.428970+0000","last_undegraded":"2024-09-12T01:16:31.428970+0000","last_fullsized":"2024-09-12T01:16:31.428970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:31.428871+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:31.428871+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.428871+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:02.156672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:39.665189+0000","last_change":"2024-09-12T01:16:39.665189+0000","last_active":"2024-09-12T01:16:39.665189+0000","last_peered":"2024-09-12T01:16:39.665189+0000","last_clean":"2024-09-12T01:16:39.665189+0000","last_became_active":"2024-09-12T00:21:58.340910+0000","last_became_peered":"2024-09-12T00:21:58.340910+0000","last_unstale":"2024-09-12T01:16:39.665189+0000","last_undegraded":"2024-09-12T01:16:39.665189+0000","last_fullsized":"2024-09-12T01:16:39.665189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:39.665098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:39.665098+0000","last_clean_scrub_stamp":"2024-09-12T01:16:39.665098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:33.548976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'59","reported_seq":228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.651854+0000","last_change":"2024-09-12T01:16:34.651854+0000","last_active":"2024-09-12T01:16:34.651854+0000","last_peered":"2024-09-12T01:16:34.651854+0000","last_clean":"2024-09-12T01:16:34.651854+0000","last_became_active":"2024-09-12T00:17:58.351362+0000","last_became_peered":"2024-09-12T00:17:58.351362+0000","last_unstale":"2024-09-12T01:16:34.651854+0000","last_undegraded":"2024-09-12T01:16:34.651854+0000","last_fullsized":"2024-09-12T01:16:34.651854+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'59","last_scrub_stamp":"2024-09-12T01:16:34.651756+0000","last_deep_scrub":"267'59","last_deep_scrub_stamp":"2024-09-12T01:16:34.651756+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.651756+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:55.939904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":214,"num_write":104,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:51.674527+0000","last_change":"2024-09-12T01:16:51.674527+0000","last_active":"2024-09-12T01:16:51.674527+0000","last_peered":"2024-09-12T01:16:51.674527+0000","last_clean":"2024-09-12T01:16:51.674527+0000","last_became_active":"2024-09-12T00:39:26.631491+0000","last_became_peered":"2024-09-12T00:39:26.631491+0000","last_unstale":"2024-09-12T01:16:51.674527+0000","last_undegraded":"2024-09-12T01:16:51.674527+0000","last_fullsized":"2024-09-12T01:16:51.674527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:51.674440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:51.674440+0000","last_clean_scrub_stamp":"2024-09-12T01:16:51.674440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:18.887352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'3","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:44.952881+0000","last_change":"2024-09-12T01:16:44.952881+0000","last_active":"2024-09-12T01:16:44.952881+0000","last_peered":"2024-09-12T01:16:44.952881+0000","last_clean":"2024-09-12T01:16:44.952881+0000","last_became_active":"2024-09-12T00:22:02.430209+0000","last_became_peered":"2024-09-12T00:22:02.430209+0000","last_unstale":"2024-09-12T01:16:44.952881+0000","last_undegraded":"2024-09-12T01:16:44.952881+0000","last_fullsized":"2024-09-12T01:16:44.952881+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:44.952759+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:44.952759+0000","last_clean_scrub_stamp":"2024-09-12T01:16:44.952759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:06.163666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.877239+0000","last_change":"2024-09-12T01:16:32.877239+0000","last_active":"2024-09-12T01:16:32.877239+0000","last_peered":"2024-09-12T01:16:32.877239+0000","last_clean":"2024-09-12T01:16:32.877239+0000","last_became_active":"2024-09-12T00:21:58.339248+0000","last_became_peered":"2024-09-12T00:21:58.339248+0000","last_unstale":"2024-09-12T01:16:32.877239+0000","last_undegraded":"2024-09-12T01:16:32.877239+0000","last_fullsized":"2024-09-12T01:16:32.877239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:32.877145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:32.877145+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.877145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:27.966100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'36","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.339033+0000","last_change":"2024-09-12T01:16:21.338959+0000","last_active":"2024-09-12T01:16:21.339033+0000","last_peered":"2024-09-12T01:16:21.339033+0000","last_clean":"2024-09-12T01:16:21.339033+0000","last_became_active":"2024-09-12T00:17:58.358022+0000","last_became_peered":"2024-09-12T00:17:58.358022+0000","last_unstale":"2024-09-12T01:16:21.339033+0000","last_undegraded":"2024-09-12T01:16:21.339033+0000","last_fullsized":"2024-09-12T01:16:21.339033+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-09-12T01:16:21.338872+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-09-12T01:16:21.338872+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.338872+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:40.264927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":138,"num_write":54,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:45.930015+0000","last_change":"2024-09-12T01:16:45.929939+0000","last_active":"2024-09-12T01:16:45.930015+0000","last_peered":"2024-09-12T01:16:45.930015+0000","last_clean":"2024-09-12T01:16:45.930015+0000","last_became_active":"2024-09-12T00:39:26.644935+0000","last_became_peered":"2024-09-12T00:39:26.644935+0000","last_unstale":"2024-09-12T01:16:45.930015+0000","last_undegraded":"2024-09-12T01:16:45.930015+0000","last_fullsized":"2024-09-12T01:16:45.930015+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:45.929842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:45.929842+0000","last_clean_scrub_stamp":"2024-09-12T01:16:45.929842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.011091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:48.611004+0000","last_change":"2024-09-12T01:16:48.611004+0000","last_active":"2024-09-12T01:16:48.611004+0000","last_peered":"2024-09-12T01:16:48.611004+0000","last_clean":"2024-09-12T01:16:48.611004+0000","last_became_active":"2024-09-12T00:22:02.424116+0000","last_became_peered":"2024-09-12T00:22:02.424116+0000","last_unstale":"2024-09-12T01:16:48.611004+0000","last_undegraded":"2024-09-12T01:16:48.611004+0000","last_fullsized":"2024-09-12T01:16:48.611004+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:16:48.610899+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:16:48.610899+0000","last_clean_scrub_stamp":"2024-09-12T01:16:48.610899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:06.705152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"267'6","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.935455+0000","last_change":"2024-09-12T01:16:38.935455+0000","last_active":"2024-09-12T01:16:38.935455+0000","last_peered":"2024-09-12T01:16:38.935455+0000","last_clean":"2024-09-12T01:16:38.935455+0000","last_became_active":"2024-09-12T00:21:58.331839+0000","last_became_peered":"2024-09-12T00:21:58.331839+0000","last_unstale":"2024-09-12T01:16:38.935455+0000","last_undegraded":"2024-09-12T01:16:38.935455+0000","last_fullsized":"2024-09-12T01:16:38.935455+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:38.935350+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:38.935350+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.935350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:56.869476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'6","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.647193+0000","last_change":"2024-09-12T01:16:33.647193+0000","last_active":"2024-09-12T01:16:33.647193+0000","last_peered":"2024-09-12T01:16:33.647193+0000","last_clean":"2024-09-12T01:16:33.647193+0000","last_became_active":"2024-09-12T00:17:58.354568+0000","last_became_peered":"2024-09-12T00:17:58.354568+0000","last_unstale":"2024-09-12T01:16:33.647193+0000","last_undegraded":"2024-09-12T01:16:33.647193+0000","last_fullsized":"2024-09-12T01:16:33.647193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:16:33.647093+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:16:33.647093+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.647093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:35.308243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:44.167256+0000","last_change":"2024-09-12T01:16:44.167194+0000","last_active":"2024-09-12T01:16:44.167256+0000","last_peered":"2024-09-12T01:16:44.167256+0000","last_clean":"2024-09-12T01:16:44.167256+0000","last_became_active":"2024-09-12T00:39:26.635679+0000","last_became_peered":"2024-09-12T00:39:26.635679+0000","last_unstale":"2024-09-12T01:16:44.167256+0000","last_undegraded":"2024-09-12T01:16:44.167256+0000","last_fullsized":"2024-09-12T01:16:44.167256+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:44.167094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:44.167094+0000","last_clean_scrub_stamp":"2024-09-12T01:16:44.167094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:52.494525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'15","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:45.622786+0000","last_change":"2024-09-12T01:16:45.622786+0000","last_active":"2024-09-12T01:16:45.622786+0000","last_peered":"2024-09-12T01:16:45.622786+0000","last_clean":"2024-09-12T01:16:45.622786+0000","last_became_active":"2024-09-12T00:22:02.420246+0000","last_became_peered":"2024-09-12T00:22:02.420246+0000","last_unstale":"2024-09-12T01:16:45.622786+0000","last_undegraded":"2024-09-12T01:16:45.622786+0000","last_fullsized":"2024-09-12T01:16:45.622786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T01:16:45.622694+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T01:16:45.622694+0000","last_clean_scrub_stamp":"2024-09-12T01:16:45.622694+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:28.415837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":23552,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'8","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.255683+0000","last_change":"2024-09-12T01:16:19.255683+0000","last_active":"2024-09-12T01:16:19.255683+0000","last_peered":"2024-09-12T01:16:19.255683+0000","last_clean":"2024-09-12T01:16:19.255683+0000","last_became_active":"2024-09-12T00:21:58.332362+0000","last_became_peered":"2024-09-12T00:21:58.332362+0000","last_unstale":"2024-09-12T01:16:19.255683+0000","last_undegraded":"2024-09-12T01:16:19.255683+0000","last_fullsized":"2024-09-12T01:16:19.255683+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:16:19.255591+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:16:19.255591+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.255591+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:22.082056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'54","reported_seq":208,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.379318+0000","last_change":"2024-09-12T01:16:22.379248+0000","last_active":"2024-09-12T01:16:22.379318+0000","last_peered":"2024-09-12T01:16:22.379318+0000","last_clean":"2024-09-12T01:16:22.379318+0000","last_became_active":"2024-09-12T00:17:58.356120+0000","last_became_peered":"2024-09-12T00:17:58.356120+0000","last_unstale":"2024-09-12T01:16:22.379318+0000","last_undegraded":"2024-09-12T01:16:22.379318+0000","last_fullsized":"2024-09-12T01:16:22.379318+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'54","last_scrub_stamp":"2024-09-12T01:16:22.379129+0000","last_deep_scrub":"267'54","last_deep_scrub_stamp":"2024-09-12T01:16:22.379129+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.379129+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:19.689178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":175,"num_write":100,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.544177+0000","last_change":"2024-09-12T01:16:35.544177+0000","last_active":"2024-09-12T01:16:35.544177+0000","last_peered":"2024-09-12T01:16:35.544177+0000","last_clean":"2024-09-12T01:16:35.544177+0000","last_became_active":"2024-09-12T00:39:26.624994+0000","last_became_peered":"2024-09-12T00:39:26.624994+0000","last_unstale":"2024-09-12T01:16:35.544177+0000","last_undegraded":"2024-09-12T01:16:35.544177+0000","last_fullsized":"2024-09-12T01:16:35.544177+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:35.544051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:35.544051+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.544051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:01.280277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:43.970286+0000","last_change":"2024-09-12T01:16:43.970286+0000","last_active":"2024-09-12T01:16:43.970286+0000","last_peered":"2024-09-12T01:16:43.970286+0000","last_clean":"2024-09-12T01:16:43.970286+0000","last_became_active":"2024-09-12T00:22:02.424412+0000","last_became_peered":"2024-09-12T00:22:02.424412+0000","last_unstale":"2024-09-12T01:16:43.970286+0000","last_undegraded":"2024-09-12T01:16:43.970286+0000","last_fullsized":"2024-09-12T01:16:43.970286+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:16:43.970187+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:16:43.970187+0000","last_clean_scrub_stamp":"2024-09-12T01:16:43.970187+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.315284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.177937+0000","last_change":"2024-09-12T01:16:37.177937+0000","last_active":"2024-09-12T01:16:37.177937+0000","last_peered":"2024-09-12T01:16:37.177937+0000","last_clean":"2024-09-12T01:16:37.177937+0000","last_became_active":"2024-09-12T00:21:58.334536+0000","last_became_peered":"2024-09-12T00:21:58.334536+0000","last_unstale":"2024-09-12T01:16:37.177937+0000","last_undegraded":"2024-09-12T01:16:37.177937+0000","last_fullsized":"2024-09-12T01:16:37.177937+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:37.177816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:37.177816+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.177816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:40.079483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'42","reported_seq":189,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.893081+0000","last_change":"2024-09-12T01:16:31.893081+0000","last_active":"2024-09-12T01:16:31.893081+0000","last_peered":"2024-09-12T01:16:31.893081+0000","last_clean":"2024-09-12T01:16:31.893081+0000","last_became_active":"2024-09-12T00:17:58.353219+0000","last_became_peered":"2024-09-12T00:17:58.353219+0000","last_unstale":"2024-09-12T01:16:31.893081+0000","last_undegraded":"2024-09-12T01:16:31.893081+0000","last_fullsized":"2024-09-12T01:16:31.893081+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:16:31.892979+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:16:31.892979+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.892979+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:55.483672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":151,"num_write":85,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:42.876375+0000","last_change":"2024-09-12T01:16:42.876316+0000","last_active":"2024-09-12T01:16:42.876375+0000","last_peered":"2024-09-12T01:16:42.876375+0000","last_clean":"2024-09-12T01:16:42.876375+0000","last_became_active":"2024-09-12T00:39:26.638008+0000","last_became_peered":"2024-09-12T00:39:26.638008+0000","last_unstale":"2024-09-12T01:16:42.876375+0000","last_undegraded":"2024-09-12T01:16:42.876375+0000","last_fullsized":"2024-09-12T01:16:42.876375+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:42.876216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:42.876216+0000","last_clean_scrub_stamp":"2024-09-12T01:16:42.876216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:19.960666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'3","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.835134+0000","last_change":"2024-09-12T01:16:37.835134+0000","last_active":"2024-09-12T01:16:37.835134+0000","last_peered":"2024-09-12T01:16:37.835134+0000","last_clean":"2024-09-12T01:16:37.835134+0000","last_became_active":"2024-09-12T00:22:02.419443+0000","last_became_peered":"2024-09-12T00:22:02.419443+0000","last_unstale":"2024-09-12T01:16:37.835134+0000","last_undegraded":"2024-09-12T01:16:37.835134+0000","last_fullsized":"2024-09-12T01:16:37.835134+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:37.835031+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:37.835031+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.835031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:50.050566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:41.939809+0000","last_change":"2024-09-12T01:16:41.939809+0000","last_active":"2024-09-12T01:16:41.939809+0000","last_peered":"2024-09-12T01:16:41.939809+0000","last_clean":"2024-09-12T01:16:41.939809+0000","last_became_active":"2024-09-12T00:21:58.335360+0000","last_became_peered":"2024-09-12T00:21:58.335360+0000","last_unstale":"2024-09-12T01:16:41.939809+0000","last_undegraded":"2024-09-12T01:16:41.939809+0000","last_fullsized":"2024-09-12T01:16:41.939809+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:41.939724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:41.939724+0000","last_clean_scrub_stamp":"2024-09-12T01:16:41.939724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:37.893755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'111","reported_seq":439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.319503+0000","last_change":"2024-09-12T01:16:24.319503+0000","last_active":"2024-09-12T01:16:24.319503+0000","last_peered":"2024-09-12T01:16:24.319503+0000","last_clean":"2024-09-12T01:16:24.319503+0000","last_became_active":"2024-09-12T00:17:58.355688+0000","last_became_peered":"2024-09-12T00:17:58.355688+0000","last_unstale":"2024-09-12T01:16:24.319503+0000","last_undegraded":"2024-09-12T01:16:24.319503+0000","last_fullsized":"2024-09-12T01:16:24.319503+0000","mapping_epoch":254,"log_start":"267'100","ondisk_log_start":"267'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-12T01:16:24.319420+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-12T01:16:24.319420+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.319420+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:44.709514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":717,"num_read_kb":507,"num_write":143,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4194,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.193803+0000","last_change":"2024-09-12T01:16:23.193803+0000","last_active":"2024-09-12T01:16:23.193803+0000","last_peered":"2024-09-12T01:16:23.193803+0000","last_clean":"2024-09-12T01:16:23.193803+0000","last_became_active":"2024-09-12T00:39:26.637393+0000","last_became_peered":"2024-09-12T00:39:26.637393+0000","last_unstale":"2024-09-12T01:16:23.193803+0000","last_undegraded":"2024-09-12T01:16:23.193803+0000","last_fullsized":"2024-09-12T01:16:23.193803+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:23.193699+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:23.193699+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.193699+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:41.499806+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.413263+0000","last_change":"2024-09-12T01:16:30.413263+0000","last_active":"2024-09-12T01:16:30.413263+0000","last_peered":"2024-09-12T01:16:30.413263+0000","last_clean":"2024-09-12T01:16:30.413263+0000","last_became_active":"2024-09-12T00:22:02.423601+0000","last_became_peered":"2024-09-12T00:22:02.423601+0000","last_unstale":"2024-09-12T01:16:30.413263+0000","last_undegraded":"2024-09-12T01:16:30.413263+0000","last_fullsized":"2024-09-12T01:16:30.413263+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:30.413173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:30.413173+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.413173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:07.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:36.935181+0000","last_change":"2024-09-12T01:16:36.935181+0000","last_active":"2024-09-12T01:16:36.935181+0000","last_peered":"2024-09-12T01:16:36.935181+0000","last_clean":"2024-09-12T01:16:36.935181+0000","last_became_active":"2024-09-12T00:21:58.339625+0000","last_became_peered":"2024-09-12T00:21:58.339625+0000","last_unstale":"2024-09-12T01:16:36.935181+0000","last_undegraded":"2024-09-12T01:16:36.935181+0000","last_fullsized":"2024-09-12T01:16:36.935181+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:36.935029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:36.935029+0000","last_clean_scrub_stamp":"2024-09-12T01:16:36.935029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:15.977188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'42","reported_seq":189,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:35.156628+0000","last_change":"2024-09-12T01:16:35.156628+0000","last_active":"2024-09-12T01:16:35.156628+0000","last_peered":"2024-09-12T01:16:35.156628+0000","last_clean":"2024-09-12T01:16:35.156628+0000","last_became_active":"2024-09-12T00:17:58.356906+0000","last_became_peered":"2024-09-12T00:17:58.356906+0000","last_unstale":"2024-09-12T01:16:35.156628+0000","last_undegraded":"2024-09-12T01:16:35.156628+0000","last_fullsized":"2024-09-12T01:16:35.156628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T01:16:35.156512+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T01:16:35.156512+0000","last_clean_scrub_stamp":"2024-09-12T01:16:35.156512+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:34.815941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":164,"num_write":72,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:49.637341+0000","last_change":"2024-09-12T01:16:49.637341+0000","last_active":"2024-09-12T01:16:49.637341+0000","last_peered":"2024-09-12T01:16:49.637341+0000","last_clean":"2024-09-12T01:16:49.637341+0000","last_became_active":"2024-09-12T00:39:26.628244+0000","last_became_peered":"2024-09-12T00:39:26.628244+0000","last_unstale":"2024-09-12T01:16:49.637341+0000","last_undegraded":"2024-09-12T01:16:49.637341+0000","last_fullsized":"2024-09-12T01:16:49.637341+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:49.637243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:49.637243+0000","last_clean_scrub_stamp":"2024-09-12T01:16:49.637243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:19.034655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:40.136566+0000","last_change":"2024-09-12T01:16:40.136566+0000","last_active":"2024-09-12T01:16:40.136566+0000","last_peered":"2024-09-12T01:16:40.136566+0000","last_clean":"2024-09-12T01:16:40.136566+0000","last_became_active":"2024-09-12T00:22:02.417237+0000","last_became_peered":"2024-09-12T00:22:02.417237+0000","last_unstale":"2024-09-12T01:16:40.136566+0000","last_undegraded":"2024-09-12T01:16:40.136566+0000","last_fullsized":"2024-09-12T01:16:40.136566+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T01:16:40.136484+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T01:16:40.136484+0000","last_clean_scrub_stamp":"2024-09-12T01:16:40.136484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:51.291503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:37.901441+0000","last_change":"2024-09-12T01:16:37.901441+0000","last_active":"2024-09-12T01:16:37.901441+0000","last_peered":"2024-09-12T01:16:37.901441+0000","last_clean":"2024-09-12T01:16:37.901441+0000","last_became_active":"2024-09-12T00:21:58.335541+0000","last_became_peered":"2024-09-12T00:21:58.335541+0000","last_unstale":"2024-09-12T01:16:37.901441+0000","last_undegraded":"2024-09-12T01:16:37.901441+0000","last_fullsized":"2024-09-12T01:16:37.901441+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:37.901354+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:37.901354+0000","last_clean_scrub_stamp":"2024-09-12T01:16:37.901354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:28.799591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'21","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.956697+0000","last_change":"2024-09-12T01:16:29.956697+0000","last_active":"2024-09-12T01:16:29.956697+0000","last_peered":"2024-09-12T01:16:29.956697+0000","last_clean":"2024-09-12T01:16:29.956697+0000","last_became_active":"2024-09-12T00:17:58.349428+0000","last_became_peered":"2024-09-12T00:17:58.349428+0000","last_unstale":"2024-09-12T01:16:29.956697+0000","last_undegraded":"2024-09-12T01:16:29.956697+0000","last_fullsized":"2024-09-12T01:16:29.956697+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T01:16:29.956611+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T01:16:29.956611+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.956611+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:47.110997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":78,"num_write":43,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:46.621659+0000","last_change":"2024-09-12T01:16:46.621594+0000","last_active":"2024-09-12T01:16:46.621659+0000","last_peered":"2024-09-12T01:16:46.621659+0000","last_clean":"2024-09-12T01:16:46.621659+0000","last_became_active":"2024-09-12T00:39:26.641360+0000","last_became_peered":"2024-09-12T00:39:26.641360+0000","last_unstale":"2024-09-12T01:16:46.621659+0000","last_undegraded":"2024-09-12T01:16:46.621659+0000","last_fullsized":"2024-09-12T01:16:46.621659+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:46.621489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:46.621489+0000","last_clean_scrub_stamp":"2024-09-12T01:16:46.621489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:43.539260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.370474+0000","last_change":"2024-09-12T01:16:28.370474+0000","last_active":"2024-09-12T01:16:28.370474+0000","last_peered":"2024-09-12T01:16:28.370474+0000","last_clean":"2024-09-12T01:16:28.370474+0000","last_became_active":"2024-09-12T00:22:02.430041+0000","last_became_peered":"2024-09-12T00:22:02.430041+0000","last_unstale":"2024-09-12T01:16:28.370474+0000","last_undegraded":"2024-09-12T01:16:28.370474+0000","last_fullsized":"2024-09-12T01:16:28.370474+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:28.370379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:28.370379+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.370379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:20.727022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.284671+0000","last_change":"2024-09-12T01:16:25.284671+0000","last_active":"2024-09-12T01:16:25.284671+0000","last_peered":"2024-09-12T01:16:25.284671+0000","last_clean":"2024-09-12T01:16:25.284671+0000","last_became_active":"2024-09-12T00:21:58.327094+0000","last_became_peered":"2024-09-12T00:21:58.327094+0000","last_unstale":"2024-09-12T01:16:25.284671+0000","last_undegraded":"2024-09-12T01:16:25.284671+0000","last_fullsized":"2024-09-12T01:16:25.284671+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:16:25.284582+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:16:25.284582+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.284582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:40.941677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'15","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.344360+0000","last_change":"2024-09-12T01:16:23.344360+0000","last_active":"2024-09-12T01:16:23.344360+0000","last_peered":"2024-09-12T01:16:23.344360+0000","last_clean":"2024-09-12T01:16:23.344360+0000","last_became_active":"2024-09-12T00:17:58.354797+0000","last_became_peered":"2024-09-12T00:17:58.354797+0000","last_unstale":"2024-09-12T01:16:23.344360+0000","last_undegraded":"2024-09-12T01:16:23.344360+0000","last_fullsized":"2024-09-12T01:16:23.344360+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T01:16:23.344276+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T01:16:23.344276+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.344276+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:34.699579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:46.950038+0000","last_change":"2024-09-12T01:16:46.949976+0000","last_active":"2024-09-12T01:16:46.950038+0000","last_peered":"2024-09-12T01:16:46.950038+0000","last_clean":"2024-09-12T01:16:46.950038+0000","last_became_active":"2024-09-12T00:39:26.640877+0000","last_became_peered":"2024-09-12T00:39:26.640877+0000","last_unstale":"2024-09-12T01:16:46.950038+0000","last_undegraded":"2024-09-12T01:16:46.950038+0000","last_fullsized":"2024-09-12T01:16:46.950038+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:46.949887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:46.949887+0000","last_clean_scrub_stamp":"2024-09-12T01:16:46.949887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:26.608756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:38.839692+0000","last_change":"2024-09-12T01:16:38.839692+0000","last_active":"2024-09-12T01:16:38.839692+0000","last_peered":"2024-09-12T01:16:38.839692+0000","last_clean":"2024-09-12T01:16:38.839692+0000","last_became_active":"2024-09-12T00:22:02.418588+0000","last_became_peered":"2024-09-12T00:22:02.418588+0000","last_unstale":"2024-09-12T01:16:38.839692+0000","last_undegraded":"2024-09-12T01:16:38.839692+0000","last_fullsized":"2024-09-12T01:16:38.839692+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:38.839599+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:38.839599+0000","last_clean_scrub_stamp":"2024-09-12T01:16:38.839599+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:57.753923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.292266+0000","last_change":"2024-09-12T01:16:26.292266+0000","last_active":"2024-09-12T01:16:26.292266+0000","last_peered":"2024-09-12T01:16:26.292266+0000","last_clean":"2024-09-12T01:16:26.292266+0000","last_became_active":"2024-09-12T00:21:58.331972+0000","last_became_peered":"2024-09-12T00:21:58.331972+0000","last_unstale":"2024-09-12T01:16:26.292266+0000","last_undegraded":"2024-09-12T01:16:26.292266+0000","last_fullsized":"2024-09-12T01:16:26.292266+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-12T01:16:26.292184+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-12T01:16:26.292184+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.292184+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:49.501286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'16","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.891043+0000","last_change":"2024-09-12T01:16:32.891043+0000","last_active":"2024-09-12T01:16:32.891043+0000","last_peered":"2024-09-12T01:16:32.891043+0000","last_clean":"2024-09-12T01:16:32.891043+0000","last_became_active":"2024-09-12T00:17:58.357689+0000","last_became_peered":"2024-09-12T00:17:58.357689+0000","last_unstale":"2024-09-12T01:16:32.891043+0000","last_undegraded":"2024-09-12T01:16:32.891043+0000","last_fullsized":"2024-09-12T01:16:32.891043+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'16","last_scrub_stamp":"2024-09-12T01:16:32.890932+0000","last_deep_scrub":"267'16","last_deep_scrub_stamp":"2024-09-12T01:16:32.890932+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.890932+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.754132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'204","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.772916+0000","last_change":"2024-09-12T01:16:08.772916+0000","last_active":"2024-09-12T01:16:08.772916+0000","last_peered":"2024-09-12T01:16:08.772916+0000","last_clean":"2024-09-12T01:16:08.772916+0000","last_became_active":"2024-09-12T00:02:48.051117+0000","last_became_peered":"2024-09-12T00:02:48.051117+0000","last_unstale":"2024-09-12T01:16:08.772916+0000","last_undegraded":"2024-09-12T01:16:08.772916+0000","last_fullsized":"2024-09-12T01:16:08.772916+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'204","last_scrub_stamp":"2024-09-12T01:16:08.772784+0000","last_deep_scrub":"267'204","last_deep_scrub_stamp":"2024-09-12T01:16:08.772784+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.772784+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:49.188552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342064,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":17555,"num_write":999,"num_write_kb":27178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'739","reported_seq":2138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.217058+0000","last_change":"2024-09-12T01:16:17.217058+0000","last_active":"2024-09-12T01:16:17.217058+0000","last_peered":"2024-09-12T01:16:17.217058+0000","last_clean":"2024-09-12T01:16:17.217058+0000","last_became_active":"2024-09-12T00:02:50.065257+0000","last_became_peered":"2024-09-12T00:02:50.065257+0000","last_unstale":"2024-09-12T01:16:17.217058+0000","last_undegraded":"2024-09-12T01:16:17.217058+0000","last_fullsized":"2024-09-12T01:16:17.217058+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'739","last_scrub_stamp":"2024-09-12T01:16:17.216970+0000","last_deep_scrub":"267'739","last_deep_scrub_stamp":"2024-09-12T01:16:17.216970+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.216970+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:41.588976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3376,"num_read_kb":3036,"num_write":968,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'285","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.132495+0000","last_change":"2024-09-12T01:16:02.132495+0000","last_active":"2024-09-12T01:16:02.132495+0000","last_peered":"2024-09-12T01:16:02.132495+0000","last_clean":"2024-09-12T01:16:02.132495+0000","last_became_active":"2024-09-12T00:02:48.049002+0000","last_became_peered":"2024-09-12T00:02:48.049002+0000","last_unstale":"2024-09-12T01:16:02.132495+0000","last_undegraded":"2024-09-12T01:16:02.132495+0000","last_fullsized":"2024-09-12T01:16:02.132495+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-12T01:16:02.132389+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-12T01:16:02.132389+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.132389+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:19.692843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":975,"num_read_kb":18236,"num_write":1256,"num_write_kb":26545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'696","reported_seq":2340,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.782508+0000","last_change":"2024-09-12T01:16:13.782508+0000","last_active":"2024-09-12T01:16:13.782508+0000","last_peered":"2024-09-12T01:16:13.782508+0000","last_clean":"2024-09-12T01:16:13.782508+0000","last_became_active":"2024-09-12T00:02:50.063612+0000","last_became_peered":"2024-09-12T00:02:50.063612+0000","last_unstale":"2024-09-12T01:16:13.782508+0000","last_undegraded":"2024-09-12T01:16:13.782508+0000","last_fullsized":"2024-09-12T01:16:13.782508+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'696","last_scrub_stamp":"2024-09-12T01:16:13.782407+0000","last_deep_scrub":"267'696","last_deep_scrub_stamp":"2024-09-12T01:16:13.782407+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.782407+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:05.284371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3358,"num_read_kb":3023,"num_write":921,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'219","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.835122+0000","last_change":"2024-09-12T01:16:01.835122+0000","last_active":"2024-09-12T01:16:01.835122+0000","last_peered":"2024-09-12T01:16:01.835122+0000","last_clean":"2024-09-12T01:16:01.835122+0000","last_became_active":"2024-09-12T00:02:48.045960+0000","last_became_peered":"2024-09-12T00:02:48.045960+0000","last_unstale":"2024-09-12T01:16:01.835122+0000","last_undegraded":"2024-09-12T01:16:01.835122+0000","last_fullsized":"2024-09-12T01:16:01.835122+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T01:16:01.835001+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T01:16:01.835001+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.835001+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:11.564621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1118647,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":21329,"num_write":1072,"num_write_kb":32132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'462","reported_seq":2030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.917023+0000","last_change":"2024-09-12T01:16:12.917023+0000","last_active":"2024-09-12T01:16:12.917023+0000","last_peered":"2024-09-12T01:16:12.917023+0000","last_clean":"2024-09-12T01:16:12.917023+0000","last_became_active":"2024-09-12T00:02:50.060902+0000","last_became_peered":"2024-09-12T00:02:50.060902+0000","last_unstale":"2024-09-12T01:16:12.917023+0000","last_undegraded":"2024-09-12T01:16:12.917023+0000","last_fullsized":"2024-09-12T01:16:12.917023+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'462","last_scrub_stamp":"2024-09-12T01:16:12.916931+0000","last_deep_scrub":"267'462","last_deep_scrub_stamp":"2024-09-12T01:16:12.916931+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.916931+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:30.139448+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2604,"num_read_kb":2455,"num_write":536,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'260","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.248731+0000","last_change":"2024-09-12T01:16:09.248640+0000","last_active":"2024-09-12T01:16:09.248731+0000","last_peered":"2024-09-12T01:16:09.248731+0000","last_clean":"2024-09-12T01:16:09.248731+0000","last_became_active":"2024-09-12T00:02:48.052802+0000","last_became_peered":"2024-09-12T00:02:48.052802+0000","last_unstale":"2024-09-12T01:16:09.248731+0000","last_undegraded":"2024-09-12T01:16:09.248731+0000","last_fullsized":"2024-09-12T01:16:09.248731+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'260","last_scrub_stamp":"2024-09-12T01:16:09.248507+0000","last_deep_scrub":"267'260","last_deep_scrub_stamp":"2024-09-12T01:16:09.248507+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.248507+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.932847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":8609,"num_write":1124,"num_write_kb":24254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'1279","reported_seq":2874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.692636+0000","last_change":"2024-09-12T01:16:10.692636+0000","last_active":"2024-09-12T01:16:10.692636+0000","last_peered":"2024-09-12T01:16:10.692636+0000","last_clean":"2024-09-12T01:16:10.692636+0000","last_became_active":"2024-09-12T00:02:50.072574+0000","last_became_peered":"2024-09-12T00:02:50.072574+0000","last_unstale":"2024-09-12T01:16:10.692636+0000","last_undegraded":"2024-09-12T01:16:10.692636+0000","last_fullsized":"2024-09-12T01:16:10.692636+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1279","last_scrub_stamp":"2024-09-12T01:16:10.692530+0000","last_deep_scrub":"267'1279","last_deep_scrub_stamp":"2024-09-12T01:16:10.692530+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.692530+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":1200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:40.321730+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5797,"num_read_kb":5069,"num_write":1818,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'162","reported_seq":797,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.708655+0000","last_change":"2024-09-12T01:16:10.708655+0000","last_active":"2024-09-12T01:16:10.708655+0000","last_peered":"2024-09-12T01:16:10.708655+0000","last_clean":"2024-09-12T01:16:10.708655+0000","last_became_active":"2024-09-12T00:02:48.052778+0000","last_became_peered":"2024-09-12T00:02:48.052778+0000","last_unstale":"2024-09-12T01:16:10.708655+0000","last_undegraded":"2024-09-12T01:16:10.708655+0000","last_fullsized":"2024-09-12T01:16:10.708655+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:10.708562+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:10.708562+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.708562+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:36.850671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":373,"num_read_kb":36558,"num_write":790,"num_write_kb":25424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'762","reported_seq":2181,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.447741+0000","last_change":"2024-09-12T01:16:08.447646+0000","last_active":"2024-09-12T01:16:08.447741+0000","last_peered":"2024-09-12T01:16:08.447741+0000","last_clean":"2024-09-12T01:16:08.447741+0000","last_became_active":"2024-09-12T00:02:50.062257+0000","last_became_peered":"2024-09-12T00:02:50.062257+0000","last_unstale":"2024-09-12T01:16:08.447741+0000","last_undegraded":"2024-09-12T01:16:08.447741+0000","last_fullsized":"2024-09-12T01:16:08.447741+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-09-12T01:16:08.447540+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-09-12T01:16:08.447540+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.447540+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:13.108811+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3406,"num_read_kb":3047,"num_write":970,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'225","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.223498+0000","last_change":"2024-09-12T01:16:06.223498+0000","last_active":"2024-09-12T01:16:06.223498+0000","last_peered":"2024-09-12T01:16:06.223498+0000","last_clean":"2024-09-12T01:16:06.223498+0000","last_became_active":"2024-09-12T00:02:48.052257+0000","last_became_peered":"2024-09-12T00:02:48.052257+0000","last_unstale":"2024-09-12T01:16:06.223498+0000","last_undegraded":"2024-09-12T01:16:06.223498+0000","last_fullsized":"2024-09-12T01:16:06.223498+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-12T01:16:06.223377+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-12T01:16:06.223377+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.223377+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:59.368626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798278,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":954,"num_read_kb":39161,"num_write":992,"num_write_kb":40171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'409","reported_seq":1883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.938341+0000","last_change":"2024-09-12T01:16:17.938341+0000","last_active":"2024-09-12T01:16:17.938341+0000","last_peered":"2024-09-12T01:16:17.938341+0000","last_clean":"2024-09-12T01:16:17.938341+0000","last_became_active":"2024-09-12T00:02:50.060756+0000","last_became_peered":"2024-09-12T00:02:50.060756+0000","last_unstale":"2024-09-12T01:16:17.938341+0000","last_undegraded":"2024-09-12T01:16:17.938341+0000","last_fullsized":"2024-09-12T01:16:17.938341+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-09-12T01:16:17.938263+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-09-12T01:16:17.938263+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.938263+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:29.171795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2108,"num_read_kb":1993,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'193","reported_seq":860,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.759441+0000","last_change":"2024-09-12T01:16:05.759441+0000","last_active":"2024-09-12T01:16:05.759441+0000","last_peered":"2024-09-12T01:16:05.759441+0000","last_clean":"2024-09-12T01:16:05.759441+0000","last_became_active":"2024-09-12T00:03:21.143840+0000","last_became_peered":"2024-09-12T00:03:21.143840+0000","last_unstale":"2024-09-12T01:16:05.759441+0000","last_undegraded":"2024-09-12T01:16:05.759441+0000","last_fullsized":"2024-09-12T01:16:05.759441+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:16:05.759305+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:16:05.759305+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.759305+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:05.625596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":319265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":20506,"num_write":998,"num_write_kb":32663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'433","reported_seq":1997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.238800+0000","last_change":"2024-09-12T01:16:16.238800+0000","last_active":"2024-09-12T01:16:16.238800+0000","last_peered":"2024-09-12T01:16:16.238800+0000","last_clean":"2024-09-12T01:16:16.238800+0000","last_became_active":"2024-09-12T00:02:50.064658+0000","last_became_peered":"2024-09-12T00:02:50.064658+0000","last_unstale":"2024-09-12T01:16:16.238800+0000","last_undegraded":"2024-09-12T01:16:16.238800+0000","last_fullsized":"2024-09-12T01:16:16.238800+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'433","last_scrub_stamp":"2024-09-12T01:16:16.238682+0000","last_deep_scrub":"267'433","last_deep_scrub_stamp":"2024-09-12T01:16:16.238682+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.238682+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:40.925562+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":488,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'181","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.718672+0000","last_change":"2024-09-12T01:16:02.718672+0000","last_active":"2024-09-12T01:16:02.718672+0000","last_peered":"2024-09-12T01:16:02.718672+0000","last_clean":"2024-09-12T01:16:02.718672+0000","last_became_active":"2024-09-12T00:02:48.058678+0000","last_became_peered":"2024-09-12T00:02:48.058678+0000","last_unstale":"2024-09-12T01:16:02.718672+0000","last_undegraded":"2024-09-12T01:16:02.718672+0000","last_fullsized":"2024-09-12T01:16:02.718672+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T01:16:02.718561+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T01:16:02.718561+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.718561+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:30.288718+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170390,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1879,"num_write":959,"num_write_kb":28669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'893","reported_seq":2468,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.250161+0000","last_change":"2024-09-12T01:16:11.250161+0000","last_active":"2024-09-12T01:16:11.250161+0000","last_peered":"2024-09-12T01:16:11.250161+0000","last_clean":"2024-09-12T01:16:11.250161+0000","last_became_active":"2024-09-12T00:02:50.069840+0000","last_became_peered":"2024-09-12T00:02:50.069840+0000","last_unstale":"2024-09-12T01:16:11.250161+0000","last_undegraded":"2024-09-12T01:16:11.250161+0000","last_fullsized":"2024-09-12T01:16:11.250161+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'893","last_scrub_stamp":"2024-09-12T01:16:11.250063+0000","last_deep_scrub":"267'893","last_deep_scrub_stamp":"2024-09-12T01:16:11.250063+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.250063+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:33.826482+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4122,"num_read_kb":3699,"num_write":1233,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'601","reported_seq":2192,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.878551+0000","last_change":"2024-09-12T01:16:09.878551+0000","last_active":"2024-09-12T01:16:09.878551+0000","last_peered":"2024-09-12T01:16:09.878551+0000","last_clean":"2024-09-12T01:16:09.878551+0000","last_became_active":"2024-09-12T00:02:50.060919+0000","last_became_peered":"2024-09-12T00:02:50.060919+0000","last_unstale":"2024-09-12T01:16:09.878551+0000","last_undegraded":"2024-09-12T01:16:09.878551+0000","last_fullsized":"2024-09-12T01:16:09.878551+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'601","last_scrub_stamp":"2024-09-12T01:16:09.878461+0000","last_deep_scrub":"267'601","last_deep_scrub_stamp":"2024-09-12T01:16:09.878461+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.878461+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:51.104915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3046,"num_read_kb":2788,"num_write":785,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'202","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.738292+0000","last_change":"2024-09-12T01:16:07.738292+0000","last_active":"2024-09-12T01:16:07.738292+0000","last_peered":"2024-09-12T01:16:07.738292+0000","last_clean":"2024-09-12T01:16:07.738292+0000","last_became_active":"2024-09-12T00:02:48.050909+0000","last_became_peered":"2024-09-12T00:02:48.050909+0000","last_unstale":"2024-09-12T01:16:07.738292+0000","last_undegraded":"2024-09-12T01:16:07.738292+0000","last_fullsized":"2024-09-12T01:16:07.738292+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'202","last_scrub_stamp":"2024-09-12T01:16:07.738154+0000","last_deep_scrub":"267'202","last_deep_scrub_stamp":"2024-09-12T01:16:07.738154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.738154+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.887555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159806,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":10751,"num_write":911,"num_write_kb":36355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'827","reported_seq":2323,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.741265+0000","last_change":"2024-09-12T01:16:12.741265+0000","last_active":"2024-09-12T01:16:12.741265+0000","last_peered":"2024-09-12T01:16:12.741265+0000","last_clean":"2024-09-12T01:16:12.741265+0000","last_became_active":"2024-09-12T00:02:50.072791+0000","last_became_peered":"2024-09-12T00:02:50.072791+0000","last_unstale":"2024-09-12T01:16:12.741265+0000","last_undegraded":"2024-09-12T01:16:12.741265+0000","last_fullsized":"2024-09-12T01:16:12.741265+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-12T01:16:12.741138+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-12T01:16:12.741138+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.741138+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:18.033096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3382,"num_write":1095,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'201","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.501668+0000","last_change":"2024-09-12T01:16:03.501668+0000","last_active":"2024-09-12T01:16:03.501668+0000","last_peered":"2024-09-12T01:16:03.501668+0000","last_clean":"2024-09-12T01:16:03.501668+0000","last_became_active":"2024-09-12T00:02:48.053452+0000","last_became_peered":"2024-09-12T00:02:48.053452+0000","last_unstale":"2024-09-12T01:16:03.501668+0000","last_undegraded":"2024-09-12T01:16:03.501668+0000","last_fullsized":"2024-09-12T01:16:03.501668+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:16:03.501500+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:16:03.501500+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.501500+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:08.370323+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684145,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":6281,"num_write":1001,"num_write_kb":31607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'859","reported_seq":2564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.283793+0000","last_change":"2024-09-12T01:16:14.283793+0000","last_active":"2024-09-12T01:16:14.283793+0000","last_peered":"2024-09-12T01:16:14.283793+0000","last_clean":"2024-09-12T01:16:14.283793+0000","last_became_active":"2024-09-12T00:02:50.072128+0000","last_became_peered":"2024-09-12T00:02:50.072128+0000","last_unstale":"2024-09-12T01:16:14.283793+0000","last_undegraded":"2024-09-12T01:16:14.283793+0000","last_fullsized":"2024-09-12T01:16:14.283793+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'859","last_scrub_stamp":"2024-09-12T01:16:14.283708+0000","last_deep_scrub":"267'859","last_deep_scrub_stamp":"2024-09-12T01:16:14.283708+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.283708+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:57.648491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4255,"num_read_kb":3837,"num_write":1128,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3450,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'188","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.512321+0000","last_change":"2024-09-12T01:16:01.512321+0000","last_active":"2024-09-12T01:16:01.512321+0000","last_peered":"2024-09-12T01:16:01.512321+0000","last_clean":"2024-09-12T01:16:01.512321+0000","last_became_active":"2024-09-12T00:02:48.059289+0000","last_became_peered":"2024-09-12T00:02:48.059289+0000","last_unstale":"2024-09-12T01:16:01.512321+0000","last_undegraded":"2024-09-12T01:16:01.512321+0000","last_fullsized":"2024-09-12T01:16:01.512321+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'188","last_scrub_stamp":"2024-09-12T01:16:01.512172+0000","last_deep_scrub":"267'188","last_deep_scrub_stamp":"2024-09-12T01:16:01.512172+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.512172+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:19.543793+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342107,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":40439,"num_write":973,"num_write_kb":33156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'1000","reported_seq":2691,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.288328+0000","last_change":"2024-09-12T01:16:03.288328+0000","last_active":"2024-09-12T01:16:03.288328+0000","last_peered":"2024-09-12T01:16:03.288328+0000","last_clean":"2024-09-12T01:16:03.288328+0000","last_became_active":"2024-09-12T00:02:50.069775+0000","last_became_peered":"2024-09-12T00:02:50.069775+0000","last_unstale":"2024-09-12T01:16:03.288328+0000","last_undegraded":"2024-09-12T01:16:03.288328+0000","last_fullsized":"2024-09-12T01:16:03.288328+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1000","last_scrub_stamp":"2024-09-12T01:16:03.288239+0000","last_deep_scrub":"267'1000","last_deep_scrub_stamp":"2024-09-12T01:16:03.288239+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.288239+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":900,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:44.983401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4692,"num_read_kb":4217,"num_write":1368,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'201","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.214554+0000","last_change":"2024-09-12T01:15:59.214490+0000","last_active":"2024-09-12T01:15:59.214554+0000","last_peered":"2024-09-12T01:15:59.214554+0000","last_clean":"2024-09-12T01:15:59.214554+0000","last_became_active":"2024-09-12T00:04:21.322881+0000","last_became_peered":"2024-09-12T00:04:21.322881+0000","last_unstale":"2024-09-12T01:15:59.214554+0000","last_undegraded":"2024-09-12T01:15:59.214554+0000","last_fullsized":"2024-09-12T01:15:59.214554+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:15:59.214384+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:15:59.214384+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.214384+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:08.684418+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10550637,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":44397,"num_write":1009,"num_write_kb":26074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"267'851","reported_seq":2426,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.298099+0000","last_change":"2024-09-12T01:16:06.298099+0000","last_active":"2024-09-12T01:16:06.298099+0000","last_peered":"2024-09-12T01:16:06.298099+0000","last_clean":"2024-09-12T01:16:06.298099+0000","last_became_active":"2024-09-12T00:02:50.061055+0000","last_became_peered":"2024-09-12T00:02:50.061055+0000","last_unstale":"2024-09-12T01:16:06.298099+0000","last_undegraded":"2024-09-12T01:16:06.298099+0000","last_fullsized":"2024-09-12T01:16:06.298099+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-12T01:16:06.298021+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-12T01:16:06.298021+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.298021+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:35.804703+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3601,"num_write":1146,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'246","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.246926+0000","last_change":"2024-09-12T01:16:00.246926+0000","last_active":"2024-09-12T01:16:00.246926+0000","last_peered":"2024-09-12T01:16:00.246926+0000","last_clean":"2024-09-12T01:16:00.246926+0000","last_became_active":"2024-09-12T00:03:22.073294+0000","last_became_peered":"2024-09-12T00:03:22.073294+0000","last_unstale":"2024-09-12T01:16:00.246926+0000","last_undegraded":"2024-09-12T01:16:00.246926+0000","last_fullsized":"2024-09-12T01:16:00.246926+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-12T01:16:00.246812+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-12T01:16:00.246812+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.246812+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:30.922054+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5592646,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":9461,"num_write":1068,"num_write_kb":47816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"267'877","reported_seq":2509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.919530+0000","last_change":"2024-09-12T01:16:10.919530+0000","last_active":"2024-09-12T01:16:10.919530+0000","last_peered":"2024-09-12T01:16:10.919530+0000","last_clean":"2024-09-12T01:16:10.919530+0000","last_became_active":"2024-09-12T00:02:50.067334+0000","last_became_peered":"2024-09-12T00:02:50.067334+0000","last_unstale":"2024-09-12T01:16:10.919530+0000","last_undegraded":"2024-09-12T01:16:10.919530+0000","last_fullsized":"2024-09-12T01:16:10.919530+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'877","last_scrub_stamp":"2024-09-12T01:16:10.919444+0000","last_deep_scrub":"267'877","last_deep_scrub_stamp":"2024-09-12T01:16:10.919444+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.919444+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:06.787118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4129,"num_read_kb":3712,"num_write":1142,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'242","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.787967+0000","last_change":"2024-09-12T01:16:00.787967+0000","last_active":"2024-09-12T01:16:00.787967+0000","last_peered":"2024-09-12T01:16:00.787967+0000","last_clean":"2024-09-12T01:16:00.787967+0000","last_became_active":"2024-09-12T00:02:48.049926+0000","last_became_peered":"2024-09-12T00:02:48.049926+0000","last_unstale":"2024-09-12T01:16:00.787967+0000","last_undegraded":"2024-09-12T01:16:00.787967+0000","last_fullsized":"2024-09-12T01:16:00.787967+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-12T01:16:00.787782+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-12T01:16:00.787782+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.787782+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:54.123434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399169,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":41400,"num_write":1181,"num_write_kb":37207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'140","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.982957+0000","last_change":"2024-09-12T01:16:27.982957+0000","last_active":"2024-09-12T01:16:27.982957+0000","last_peered":"2024-09-12T01:16:27.982957+0000","last_clean":"2024-09-12T01:16:27.982957+0000","last_became_active":"2024-09-12T00:02:58.094271+0000","last_became_peered":"2024-09-12T00:02:58.094271+0000","last_unstale":"2024-09-12T01:16:27.982957+0000","last_undegraded":"2024-09-12T01:16:27.982957+0000","last_fullsized":"2024-09-12T01:16:27.982957+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'140","last_scrub_stamp":"2024-09-12T01:16:27.982842+0000","last_deep_scrub":"267'140","last_deep_scrub_stamp":"2024-09-12T01:16:27.982842+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.982842+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:44.482595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":142,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'583","reported_seq":2357,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.701641+0000","last_change":"2024-09-12T01:16:03.701641+0000","last_active":"2024-09-12T01:16:03.701641+0000","last_peered":"2024-09-12T01:16:03.701641+0000","last_clean":"2024-09-12T01:16:03.701641+0000","last_became_active":"2024-09-12T00:02:50.073327+0000","last_became_peered":"2024-09-12T00:02:50.073327+0000","last_unstale":"2024-09-12T01:16:03.701641+0000","last_undegraded":"2024-09-12T01:16:03.701641+0000","last_fullsized":"2024-09-12T01:16:03.701641+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'583","last_scrub_stamp":"2024-09-12T01:16:03.701558+0000","last_deep_scrub":"267'583","last_deep_scrub_stamp":"2024-09-12T01:16:03.701558+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.701558+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:50.578518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3161,"num_read_kb":2955,"num_write":696,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'270","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.760685+0000","last_change":"2024-09-12T01:16:04.760685+0000","last_active":"2024-09-12T01:16:04.760685+0000","last_peered":"2024-09-12T01:16:04.760685+0000","last_clean":"2024-09-12T01:16:04.760685+0000","last_became_active":"2024-09-12T00:03:21.143543+0000","last_became_peered":"2024-09-12T00:03:21.143543+0000","last_unstale":"2024-09-12T01:16:04.760685+0000","last_undegraded":"2024-09-12T01:16:04.760685+0000","last_fullsized":"2024-09-12T01:16:04.760685+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:16:04.760551+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:16:04.760551+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.760551+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:44.290335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":789,"num_read_kb":207403,"num_write":1277,"num_write_kb":65033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.333381+0000","last_change":"2024-09-12T01:16:21.333381+0000","last_active":"2024-09-12T01:16:21.333381+0000","last_peered":"2024-09-12T01:16:21.333381+0000","last_clean":"2024-09-12T01:16:21.333381+0000","last_became_active":"2024-09-12T00:02:52.067288+0000","last_became_peered":"2024-09-12T00:02:52.067288+0000","last_unstale":"2024-09-12T01:16:21.333381+0000","last_undegraded":"2024-09-12T01:16:21.333381+0000","last_fullsized":"2024-09-12T01:16:21.333381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:21.333295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:21.333295+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.333295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:06.501565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'241","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.666793+0000","last_change":"2024-09-12T01:16:17.666793+0000","last_active":"2024-09-12T01:16:17.666793+0000","last_peered":"2024-09-12T01:16:17.666793+0000","last_clean":"2024-09-12T01:16:17.666793+0000","last_became_active":"2024-09-12T00:02:54.070547+0000","last_became_peered":"2024-09-12T00:02:54.070547+0000","last_unstale":"2024-09-12T01:16:17.666793+0000","last_undegraded":"2024-09-12T01:16:17.666793+0000","last_fullsized":"2024-09-12T01:16:17.666793+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-12T01:16:17.666675+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-12T01:16:17.666675+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.666675+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.550527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9977,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":320,"num_read_kb":418,"num_write":196,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.837474+0000","last_change":"2024-09-12T01:16:27.837474+0000","last_active":"2024-09-12T01:16:27.837474+0000","last_peered":"2024-09-12T01:16:27.837474+0000","last_clean":"2024-09-12T01:16:27.837474+0000","last_became_active":"2024-09-12T00:02:56.081086+0000","last_became_peered":"2024-09-12T00:02:56.081086+0000","last_unstale":"2024-09-12T01:16:27.837474+0000","last_undegraded":"2024-09-12T01:16:27.837474+0000","last_fullsized":"2024-09-12T01:16:27.837474+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:27.837373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:27.837373+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.837373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:04.504964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'2435","reported_seq":4352,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.178737+0000","last_change":"2024-09-12T01:16:33.178737+0000","last_active":"2024-09-12T01:16:33.178737+0000","last_peered":"2024-09-12T01:16:33.178737+0000","last_clean":"2024-09-12T01:16:33.178737+0000","last_became_active":"2024-09-12T00:02:58.095948+0000","last_became_peered":"2024-09-12T00:02:58.095948+0000","last_unstale":"2024-09-12T01:16:33.178737+0000","last_undegraded":"2024-09-12T01:16:33.178737+0000","last_fullsized":"2024-09-12T01:16:33.178737+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2435","last_scrub_stamp":"2024-09-12T01:16:33.178632+0000","last_deep_scrub":"267'2435","last_deep_scrub_stamp":"2024-09-12T01:16:33.178632+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.178632+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":2400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:35.648901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6163,"num_read_kb":6149,"num_write":4865,"num_write_kb":1796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'433","reported_seq":1968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.277489+0000","last_change":"2024-09-12T01:16:12.277489+0000","last_active":"2024-09-12T01:16:12.277489+0000","last_peered":"2024-09-12T01:16:12.277489+0000","last_clean":"2024-09-12T01:16:12.277489+0000","last_became_active":"2024-09-12T00:02:50.065654+0000","last_became_peered":"2024-09-12T00:02:50.065654+0000","last_unstale":"2024-09-12T01:16:12.277489+0000","last_undegraded":"2024-09-12T01:16:12.277489+0000","last_fullsized":"2024-09-12T01:16:12.277489+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'433","last_scrub_stamp":"2024-09-12T01:16:12.277405+0000","last_deep_scrub":"267'433","last_deep_scrub_stamp":"2024-09-12T01:16:12.277405+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.277405+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:57.117394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2304,"num_read_kb":2172,"num_write":510,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'198","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.924085+0000","last_change":"2024-09-12T01:15:55.924085+0000","last_active":"2024-09-12T01:15:55.924085+0000","last_peered":"2024-09-12T01:15:55.924085+0000","last_clean":"2024-09-12T01:15:55.924085+0000","last_became_active":"2024-09-12T00:02:48.050499+0000","last_became_peered":"2024-09-12T00:02:48.050499+0000","last_unstale":"2024-09-12T01:15:55.924085+0000","last_undegraded":"2024-09-12T01:15:55.924085+0000","last_fullsized":"2024-09-12T01:15:55.924085+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:15:55.924011+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:15:55.924011+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.924011+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.010889+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":23205,"num_write":930,"num_write_kb":52906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.658857+0000","last_change":"2024-09-12T01:16:09.658857+0000","last_active":"2024-09-12T01:16:09.658857+0000","last_peered":"2024-09-12T01:16:09.658857+0000","last_clean":"2024-09-12T01:16:09.658857+0000","last_became_active":"2024-09-12T00:02:52.068519+0000","last_became_peered":"2024-09-12T00:02:52.068519+0000","last_unstale":"2024-09-12T01:16:09.658857+0000","last_undegraded":"2024-09-12T01:16:09.658857+0000","last_fullsized":"2024-09-12T01:16:09.658857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.658760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.658760+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.658760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:31.485302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'119","reported_seq":675,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.979691+0000","last_change":"2024-09-12T01:16:20.979691+0000","last_active":"2024-09-12T01:16:20.979691+0000","last_peered":"2024-09-12T01:16:20.979691+0000","last_clean":"2024-09-12T01:16:20.979691+0000","last_became_active":"2024-09-12T00:02:54.060334+0000","last_became_peered":"2024-09-12T00:02:54.060334+0000","last_unstale":"2024-09-12T01:16:20.979691+0000","last_undegraded":"2024-09-12T01:16:20.979691+0000","last_fullsized":"2024-09-12T01:16:20.979691+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'119","last_scrub_stamp":"2024-09-12T01:16:20.979573+0000","last_deep_scrub":"267'119","last_deep_scrub_stamp":"2024-09-12T01:16:20.979573+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.979573+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:17.324078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.924434+0000","last_change":"2024-09-12T01:16:24.924434+0000","last_active":"2024-09-12T01:16:24.924434+0000","last_peered":"2024-09-12T01:16:24.924434+0000","last_clean":"2024-09-12T01:16:24.924434+0000","last_became_active":"2024-09-12T00:02:56.085222+0000","last_became_peered":"2024-09-12T00:02:56.085222+0000","last_unstale":"2024-09-12T01:16:24.924434+0000","last_undegraded":"2024-09-12T01:16:24.924434+0000","last_fullsized":"2024-09-12T01:16:24.924434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.924316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.924316+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.924316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.301751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'148","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.649202+0000","last_change":"2024-09-12T01:16:30.649202+0000","last_active":"2024-09-12T01:16:30.649202+0000","last_peered":"2024-09-12T01:16:30.649202+0000","last_clean":"2024-09-12T01:16:30.649202+0000","last_became_active":"2024-09-12T00:02:58.094312+0000","last_became_peered":"2024-09-12T00:02:58.094312+0000","last_unstale":"2024-09-12T01:16:30.649202+0000","last_undegraded":"2024-09-12T01:16:30.649202+0000","last_fullsized":"2024-09-12T01:16:30.649202+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'148","last_scrub_stamp":"2024-09-12T01:16:30.649112+0000","last_deep_scrub":"267'148","last_deep_scrub_stamp":"2024-09-12T01:16:30.649112+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.649112+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.047313+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":193,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'830","reported_seq":2439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.807881+0000","last_change":"2024-09-12T01:16:05.807881+0000","last_active":"2024-09-12T01:16:05.807881+0000","last_peered":"2024-09-12T01:16:05.807881+0000","last_clean":"2024-09-12T01:16:05.807881+0000","last_became_active":"2024-09-12T00:02:50.071219+0000","last_became_peered":"2024-09-12T00:02:50.071219+0000","last_unstale":"2024-09-12T01:16:05.807881+0000","last_undegraded":"2024-09-12T01:16:05.807881+0000","last_fullsized":"2024-09-12T01:16:05.807881+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'830","last_scrub_stamp":"2024-09-12T01:16:05.807733+0000","last_deep_scrub":"267'830","last_deep_scrub_stamp":"2024-09-12T01:16:05.807733+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.807733+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:00.465607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4069,"num_read_kb":3661,"num_write":1104,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2553,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'211","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.726231+0000","last_change":"2024-09-12T01:16:01.726231+0000","last_active":"2024-09-12T01:16:01.726231+0000","last_peered":"2024-09-12T01:16:01.726231+0000","last_clean":"2024-09-12T01:16:01.726231+0000","last_became_active":"2024-09-12T00:02:48.059132+0000","last_became_peered":"2024-09-12T00:02:48.059132+0000","last_unstale":"2024-09-12T01:16:01.726231+0000","last_undegraded":"2024-09-12T01:16:01.726231+0000","last_fullsized":"2024-09-12T01:16:01.726231+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'211","last_scrub_stamp":"2024-09-12T01:16:01.726101+0000","last_deep_scrub":"267'211","last_deep_scrub_stamp":"2024-09-12T01:16:01.726101+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.726101+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:47.889650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":419,"num_read_kb":5763,"num_write":993,"num_write_kb":32529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.547500+0000","last_change":"2024-09-12T01:16:15.547500+0000","last_active":"2024-09-12T01:16:15.547500+0000","last_peered":"2024-09-12T01:16:15.547500+0000","last_clean":"2024-09-12T01:16:15.547500+0000","last_became_active":"2024-09-12T00:02:52.064216+0000","last_became_peered":"2024-09-12T00:02:52.064216+0000","last_unstale":"2024-09-12T01:16:15.547500+0000","last_undegraded":"2024-09-12T01:16:15.547500+0000","last_fullsized":"2024-09-12T01:16:15.547500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.547409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.547409+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.547409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:49.762131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'162","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.200793+0000","last_change":"2024-09-12T01:16:13.200793+0000","last_active":"2024-09-12T01:16:13.200793+0000","last_peered":"2024-09-12T01:16:13.200793+0000","last_clean":"2024-09-12T01:16:13.200793+0000","last_became_active":"2024-09-12T00:02:54.060501+0000","last_became_peered":"2024-09-12T00:02:54.060501+0000","last_unstale":"2024-09-12T01:16:13.200793+0000","last_undegraded":"2024-09-12T01:16:13.200793+0000","last_fullsized":"2024-09-12T01:16:13.200793+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:13.200687+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:13.200687+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.200687+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:11.033202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":182,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'767","reported_seq":2671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.846701+0000","last_change":"2024-09-12T01:16:26.846701+0000","last_active":"2024-09-12T01:16:26.846701+0000","last_peered":"2024-09-12T01:16:26.846701+0000","last_clean":"2024-09-12T01:16:26.846701+0000","last_became_active":"2024-09-12T00:02:56.087506+0000","last_became_peered":"2024-09-12T00:02:56.087506+0000","last_unstale":"2024-09-12T01:16:26.846701+0000","last_undegraded":"2024-09-12T01:16:26.846701+0000","last_fullsized":"2024-09-12T01:16:26.846701+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'767","last_scrub_stamp":"2024-09-12T01:16:26.846570+0000","last_deep_scrub":"267'767","last_deep_scrub_stamp":"2024-09-12T01:16:26.846570+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.846570+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:02.349841+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.928869+0000","last_change":"2024-09-12T01:16:30.928869+0000","last_active":"2024-09-12T01:16:30.928869+0000","last_peered":"2024-09-12T01:16:30.928869+0000","last_clean":"2024-09-12T01:16:30.928869+0000","last_became_active":"2024-09-12T00:02:58.090424+0000","last_became_peered":"2024-09-12T00:02:58.090424+0000","last_unstale":"2024-09-12T01:16:30.928869+0000","last_undegraded":"2024-09-12T01:16:30.928869+0000","last_fullsized":"2024-09-12T01:16:30.928869+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:16:30.928770+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:16:30.928770+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.928770+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:56.460749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":609,"num_read_kb":603,"num_write":442,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'494","reported_seq":2303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.683501+0000","last_change":"2024-09-12T01:16:04.683501+0000","last_active":"2024-09-12T01:16:04.683501+0000","last_peered":"2024-09-12T01:16:04.683501+0000","last_clean":"2024-09-12T01:16:04.683501+0000","last_became_active":"2024-09-12T00:02:50.067933+0000","last_became_peered":"2024-09-12T00:02:50.067933+0000","last_unstale":"2024-09-12T01:16:04.683501+0000","last_undegraded":"2024-09-12T01:16:04.683501+0000","last_fullsized":"2024-09-12T01:16:04.683501+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-09-12T01:16:04.683410+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-09-12T01:16:04.683410+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.683410+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:55.086027+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2745,"num_read_kb":2618,"num_write":566,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'210","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.550622+0000","last_change":"2024-09-12T01:15:57.550622+0000","last_active":"2024-09-12T01:15:57.550622+0000","last_peered":"2024-09-12T01:15:57.550622+0000","last_clean":"2024-09-12T01:15:57.550622+0000","last_became_active":"2024-09-12T00:02:48.052566+0000","last_became_peered":"2024-09-12T00:02:48.052566+0000","last_unstale":"2024-09-12T01:15:57.550622+0000","last_undegraded":"2024-09-12T01:15:57.550622+0000","last_fullsized":"2024-09-12T01:15:57.550622+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:15:57.550505+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:15:57.550505+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.550505+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.920796+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":572,"num_read_kb":73907,"num_write":996,"num_write_kb":20895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.287740+0000","last_change":"2024-09-12T01:16:20.287740+0000","last_active":"2024-09-12T01:16:20.287740+0000","last_peered":"2024-09-12T01:16:20.287740+0000","last_clean":"2024-09-12T01:16:20.287740+0000","last_became_active":"2024-09-12T00:02:52.066171+0000","last_became_peered":"2024-09-12T00:02:52.066171+0000","last_unstale":"2024-09-12T01:16:20.287740+0000","last_undegraded":"2024-09-12T01:16:20.287740+0000","last_fullsized":"2024-09-12T01:16:20.287740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:20.287615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:20.287615+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.287615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:13.634610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'173","reported_seq":769,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.883046+0000","last_change":"2024-09-12T01:16:22.883046+0000","last_active":"2024-09-12T01:16:22.883046+0000","last_peered":"2024-09-12T01:16:22.883046+0000","last_clean":"2024-09-12T01:16:22.883046+0000","last_became_active":"2024-09-12T00:02:54.239618+0000","last_became_peered":"2024-09-12T00:02:54.239618+0000","last_unstale":"2024-09-12T01:16:22.883046+0000","last_undegraded":"2024-09-12T01:16:22.883046+0000","last_fullsized":"2024-09-12T01:16:22.883046+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-09-12T01:16:22.882915+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-09-12T01:16:22.882915+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.882915+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:17.059053+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":308,"num_write":128,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'808","reported_seq":2639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.568661+0000","last_change":"2024-09-12T01:16:27.568661+0000","last_active":"2024-09-12T01:16:27.568661+0000","last_peered":"2024-09-12T01:16:27.568661+0000","last_clean":"2024-09-12T01:16:27.568661+0000","last_became_active":"2024-09-12T00:02:56.082567+0000","last_became_peered":"2024-09-12T00:02:56.082567+0000","last_unstale":"2024-09-12T01:16:27.568661+0000","last_undegraded":"2024-09-12T01:16:27.568661+0000","last_fullsized":"2024-09-12T01:16:27.568661+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'808","last_scrub_stamp":"2024-09-12T01:16:27.568577+0000","last_deep_scrub":"267'808","last_deep_scrub_stamp":"2024-09-12T01:16:27.568577+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.568577+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:18.717470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'364","reported_seq":1789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.242131+0000","last_change":"2024-09-12T01:16:11.242073+0000","last_active":"2024-09-12T01:16:11.242131+0000","last_peered":"2024-09-12T01:16:11.242131+0000","last_clean":"2024-09-12T01:16:11.242131+0000","last_became_active":"2024-09-12T00:02:50.063707+0000","last_became_peered":"2024-09-12T00:02:50.063707+0000","last_unstale":"2024-09-12T01:16:11.242131+0000","last_undegraded":"2024-09-12T01:16:11.242131+0000","last_fullsized":"2024-09-12T01:16:11.242131+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T01:16:11.241987+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T01:16:11.241987+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.241987+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:49.086172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1902,"num_write":425,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'196","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.757417+0000","last_change":"2024-09-12T01:16:03.757332+0000","last_active":"2024-09-12T01:16:03.757417+0000","last_peered":"2024-09-12T01:16:03.757417+0000","last_clean":"2024-09-12T01:16:03.757417+0000","last_became_active":"2024-09-12T00:02:48.056135+0000","last_became_peered":"2024-09-12T00:02:48.056135+0000","last_unstale":"2024-09-12T01:16:03.757417+0000","last_undegraded":"2024-09-12T01:16:03.757417+0000","last_fullsized":"2024-09-12T01:16:03.757417+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T01:16:03.757211+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T01:16:03.757211+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.757211+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:10.396944+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":40539,"num_write":934,"num_write_kb":46911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.853035+0000","last_change":"2024-09-12T01:16:15.852946+0000","last_active":"2024-09-12T01:16:15.853035+0000","last_peered":"2024-09-12T01:16:15.853035+0000","last_clean":"2024-09-12T01:16:15.853035+0000","last_became_active":"2024-09-12T00:02:52.068747+0000","last_became_peered":"2024-09-12T00:02:52.068747+0000","last_unstale":"2024-09-12T01:16:15.853035+0000","last_undegraded":"2024-09-12T01:16:15.853035+0000","last_fullsized":"2024-09-12T01:16:15.853035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.852843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.852843+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.852843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:15.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'285","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.263662+0000","last_change":"2024-09-12T01:16:25.263604+0000","last_active":"2024-09-12T01:16:25.263662+0000","last_peered":"2024-09-12T01:16:25.263662+0000","last_clean":"2024-09-12T01:16:25.263662+0000","last_became_active":"2024-09-12T00:02:54.239475+0000","last_became_peered":"2024-09-12T00:02:54.239475+0000","last_unstale":"2024-09-12T01:16:25.263662+0000","last_undegraded":"2024-09-12T01:16:25.263662+0000","last_fullsized":"2024-09-12T01:16:25.263662+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-12T01:16:25.263492+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-12T01:16:25.263492+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.263492+0000","objects_scrubbed":10,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:39.629858+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5743,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":380,"num_read_kb":454,"num_write":232,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.295993+0000","last_change":"2024-09-12T01:16:16.295945+0000","last_active":"2024-09-12T01:16:16.295993+0000","last_peered":"2024-09-12T01:16:16.295993+0000","last_clean":"2024-09-12T01:16:16.295993+0000","last_became_active":"2024-09-12T00:02:56.080748+0000","last_became_peered":"2024-09-12T00:02:56.080748+0000","last_unstale":"2024-09-12T01:16:16.295993+0000","last_undegraded":"2024-09-12T01:16:16.295993+0000","last_fullsized":"2024-09-12T01:16:16.295993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.295864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.295864+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.295864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:13.823929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'530","reported_seq":1354,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.276181+0000","last_change":"2024-09-12T01:16:29.276181+0000","last_active":"2024-09-12T01:16:29.276181+0000","last_peered":"2024-09-12T01:16:29.276181+0000","last_clean":"2024-09-12T01:16:29.276181+0000","last_became_active":"2024-09-12T00:02:58.095311+0000","last_became_peered":"2024-09-12T00:02:58.095311+0000","last_unstale":"2024-09-12T01:16:29.276181+0000","last_undegraded":"2024-09-12T01:16:29.276181+0000","last_fullsized":"2024-09-12T01:16:29.276181+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'530","last_scrub_stamp":"2024-09-12T01:16:29.276083+0000","last_deep_scrub":"267'530","last_deep_scrub_stamp":"2024-09-12T01:16:29.276083+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.276083+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:26.727522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1247,"num_read_kb":1245,"num_write":1070,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'399","reported_seq":1710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.751966+0000","last_change":"2024-09-12T01:16:03.751890+0000","last_active":"2024-09-12T01:16:03.751966+0000","last_peered":"2024-09-12T01:16:03.751966+0000","last_clean":"2024-09-12T01:16:03.751966+0000","last_became_active":"2024-09-12T00:02:50.068223+0000","last_became_peered":"2024-09-12T00:02:50.068223+0000","last_unstale":"2024-09-12T01:16:03.751966+0000","last_undegraded":"2024-09-12T01:16:03.751966+0000","last_fullsized":"2024-09-12T01:16:03.751966+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-12T01:16:03.751752+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-12T01:16:03.751752+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.751752+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:31.247244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1919,"num_read_kb":1778,"num_write":479,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'153","reported_seq":793,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.761046+0000","last_change":"2024-09-12T01:16:00.760986+0000","last_active":"2024-09-12T01:16:00.761046+0000","last_peered":"2024-09-12T01:16:00.761046+0000","last_clean":"2024-09-12T01:16:00.761046+0000","last_became_active":"2024-09-12T00:02:48.055480+0000","last_became_peered":"2024-09-12T00:02:48.055480+0000","last_unstale":"2024-09-12T01:16:00.761046+0000","last_undegraded":"2024-09-12T01:16:00.761046+0000","last_fullsized":"2024-09-12T01:16:00.761046+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-12T01:16:00.760880+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-12T01:16:00.760880+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.760880+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.310424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250607,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":416,"num_read_kb":43431,"num_write":767,"num_write_kb":28983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.264636+0000","last_change":"2024-09-12T01:16:09.264574+0000","last_active":"2024-09-12T01:16:09.264636+0000","last_peered":"2024-09-12T01:16:09.264636+0000","last_clean":"2024-09-12T01:16:09.264636+0000","last_became_active":"2024-09-12T00:02:52.062219+0000","last_became_peered":"2024-09-12T00:02:52.062219+0000","last_unstale":"2024-09-12T01:16:09.264636+0000","last_undegraded":"2024-09-12T01:16:09.264636+0000","last_fullsized":"2024-09-12T01:16:09.264636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.264489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.264489+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.264489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:41.480353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'161","reported_seq":762,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.553965+0000","last_change":"2024-09-12T01:16:17.553910+0000","last_active":"2024-09-12T01:16:17.553965+0000","last_peered":"2024-09-12T01:16:17.553965+0000","last_clean":"2024-09-12T01:16:17.553965+0000","last_became_active":"2024-09-12T00:02:54.069656+0000","last_became_peered":"2024-09-12T00:02:54.069656+0000","last_unstale":"2024-09-12T01:16:17.553965+0000","last_undegraded":"2024-09-12T01:16:17.553965+0000","last_fullsized":"2024-09-12T01:16:17.553965+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'161","last_scrub_stamp":"2024-09-12T01:16:17.553833+0000","last_deep_scrub":"267'161","last_deep_scrub_stamp":"2024-09-12T01:16:17.553833+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.553833+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:30.758345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9092,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":201,"num_read_kb":271,"num_write":108,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.572092+0000","last_change":"2024-09-12T01:16:23.572021+0000","last_active":"2024-09-12T01:16:23.572092+0000","last_peered":"2024-09-12T01:16:23.572092+0000","last_clean":"2024-09-12T01:16:23.572092+0000","last_became_active":"2024-09-12T00:02:56.081804+0000","last_became_peered":"2024-09-12T00:02:56.081804+0000","last_unstale":"2024-09-12T01:16:23.572092+0000","last_undegraded":"2024-09-12T01:16:23.572092+0000","last_fullsized":"2024-09-12T01:16:23.572092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.571932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.571932+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.571932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:03.164700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'122","reported_seq":641,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.394034+0000","last_change":"2024-09-12T01:16:18.394034+0000","last_active":"2024-09-12T01:16:18.394034+0000","last_peered":"2024-09-12T01:16:18.394034+0000","last_clean":"2024-09-12T01:16:18.394034+0000","last_became_active":"2024-09-12T00:02:58.095068+0000","last_became_peered":"2024-09-12T00:02:58.095068+0000","last_unstale":"2024-09-12T01:16:18.394034+0000","last_undegraded":"2024-09-12T01:16:18.394034+0000","last_fullsized":"2024-09-12T01:16:18.394034+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'122","last_scrub_stamp":"2024-09-12T01:16:18.393945+0000","last_deep_scrub":"267'122","last_deep_scrub_stamp":"2024-09-12T01:16:18.393945+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.393945+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:24.673992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":135,"num_write":297,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'897","reported_seq":2428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.517789+0000","last_change":"2024-09-12T01:16:05.517733+0000","last_active":"2024-09-12T01:16:05.517789+0000","last_peered":"2024-09-12T01:16:05.517789+0000","last_clean":"2024-09-12T01:16:05.517789+0000","last_became_active":"2024-09-12T00:02:50.078033+0000","last_became_peered":"2024-09-12T00:02:50.078033+0000","last_unstale":"2024-09-12T01:16:05.517789+0000","last_undegraded":"2024-09-12T01:16:05.517789+0000","last_fullsized":"2024-09-12T01:16:05.517789+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'897","last_scrub_stamp":"2024-09-12T01:16:05.517647+0000","last_deep_scrub":"267'897","last_deep_scrub_stamp":"2024-09-12T01:16:05.517647+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.517647+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:04.806609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4128,"num_read_kb":3671,"num_write":1209,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'185","reported_seq":819,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.716246+0000","last_change":"2024-09-12T01:15:59.716184+0000","last_active":"2024-09-12T01:15:59.716246+0000","last_peered":"2024-09-12T01:15:59.716246+0000","last_clean":"2024-09-12T01:15:59.716246+0000","last_became_active":"2024-09-12T00:02:48.048973+0000","last_became_peered":"2024-09-12T00:02:48.048973+0000","last_unstale":"2024-09-12T01:15:59.716246+0000","last_undegraded":"2024-09-12T01:15:59.716246+0000","last_fullsized":"2024-09-12T01:15:59.716246+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:59.716068+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:59.716068+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.716068+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:27.806731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":6868,"num_write":918,"num_write_kb":34085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.262291+0000","last_change":"2024-09-12T01:16:10.262229+0000","last_active":"2024-09-12T01:16:10.262291+0000","last_peered":"2024-09-12T01:16:10.262291+0000","last_clean":"2024-09-12T01:16:10.262291+0000","last_became_active":"2024-09-12T00:02:52.065809+0000","last_became_peered":"2024-09-12T00:02:52.065809+0000","last_unstale":"2024-09-12T01:16:10.262291+0000","last_undegraded":"2024-09-12T01:16:10.262291+0000","last_fullsized":"2024-09-12T01:16:10.262291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.262136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.262136+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.262136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:54.718660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'220","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.905259+0000","last_change":"2024-09-12T01:16:19.905198+0000","last_active":"2024-09-12T01:16:19.905259+0000","last_peered":"2024-09-12T01:16:19.905259+0000","last_clean":"2024-09-12T01:16:19.905259+0000","last_became_active":"2024-09-12T00:02:54.066781+0000","last_became_peered":"2024-09-12T00:02:54.066781+0000","last_unstale":"2024-09-12T01:16:19.905259+0000","last_undegraded":"2024-09-12T01:16:19.905259+0000","last_fullsized":"2024-09-12T01:16:19.905259+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-12T01:16:19.905107+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-12T01:16:19.905107+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.905107+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:53.442084+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":282,"num_read_kb":329,"num_write":166,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'795","reported_seq":2827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.649273+0000","last_change":"2024-09-12T01:16:21.649211+0000","last_active":"2024-09-12T01:16:21.649273+0000","last_peered":"2024-09-12T01:16:21.649273+0000","last_clean":"2024-09-12T01:16:21.649273+0000","last_became_active":"2024-09-12T00:02:56.086692+0000","last_became_peered":"2024-09-12T00:02:56.086692+0000","last_unstale":"2024-09-12T01:16:21.649273+0000","last_undegraded":"2024-09-12T01:16:21.649273+0000","last_fullsized":"2024-09-12T01:16:21.649273+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'795","last_scrub_stamp":"2024-09-12T01:16:21.649118+0000","last_deep_scrub":"267'795","last_deep_scrub_stamp":"2024-09-12T01:16:21.649118+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.649118+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:17.175987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'116","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.584261+0000","last_change":"2024-09-12T01:16:26.584201+0000","last_active":"2024-09-12T01:16:26.584261+0000","last_peered":"2024-09-12T01:16:26.584261+0000","last_clean":"2024-09-12T01:16:26.584261+0000","last_became_active":"2024-09-12T00:02:58.093419+0000","last_became_peered":"2024-09-12T00:02:58.093419+0000","last_unstale":"2024-09-12T01:16:26.584261+0000","last_undegraded":"2024-09-12T01:16:26.584261+0000","last_fullsized":"2024-09-12T01:16:26.584261+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-12T01:16:26.584111+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-12T01:16:26.584111+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.584111+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:04.476681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":298,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'401","reported_seq":2003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.792983+0000","last_change":"2024-09-12T01:16:04.792877+0000","last_active":"2024-09-12T01:16:04.792983+0000","last_peered":"2024-09-12T01:16:04.792983+0000","last_clean":"2024-09-12T01:16:04.792983+0000","last_became_active":"2024-09-12T00:02:50.073986+0000","last_became_peered":"2024-09-12T00:02:50.073986+0000","last_unstale":"2024-09-12T01:16:04.792983+0000","last_undegraded":"2024-09-12T01:16:04.792983+0000","last_fullsized":"2024-09-12T01:16:04.792983+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T01:16:04.792766+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T01:16:04.792766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.792766+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:59.004193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2369,"num_read_kb":2271,"num_write":449,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'218","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.185443+0000","last_change":"2024-09-12T01:15:57.185384+0000","last_active":"2024-09-12T01:15:57.185443+0000","last_peered":"2024-09-12T01:15:57.185443+0000","last_clean":"2024-09-12T01:15:57.185443+0000","last_became_active":"2024-09-12T00:02:48.051190+0000","last_became_peered":"2024-09-12T00:02:48.051190+0000","last_unstale":"2024-09-12T01:15:57.185443+0000","last_undegraded":"2024-09-12T01:15:57.185443+0000","last_fullsized":"2024-09-12T01:15:57.185443+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:15:57.185281+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:15:57.185281+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.185281+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:03.188053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":21060,"num_write":1056,"num_write_kb":24204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.288309+0000","last_change":"2024-09-12T01:16:07.288239+0000","last_active":"2024-09-12T01:16:07.288309+0000","last_peered":"2024-09-12T01:16:07.288309+0000","last_clean":"2024-09-12T01:16:07.288309+0000","last_became_active":"2024-09-12T00:02:52.056676+0000","last_became_peered":"2024-09-12T00:02:52.056676+0000","last_unstale":"2024-09-12T01:16:07.288309+0000","last_undegraded":"2024-09-12T01:16:07.288309+0000","last_fullsized":"2024-09-12T01:16:07.288309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:07.288154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:07.288154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.288154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.787901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'230","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.671376+0000","last_change":"2024-09-12T01:16:15.671311+0000","last_active":"2024-09-12T01:16:15.671376+0000","last_peered":"2024-09-12T01:16:15.671376+0000","last_clean":"2024-09-12T01:16:15.671376+0000","last_became_active":"2024-09-12T00:02:54.066994+0000","last_became_peered":"2024-09-12T00:02:54.066994+0000","last_unstale":"2024-09-12T01:16:15.671376+0000","last_undegraded":"2024-09-12T01:16:15.671376+0000","last_fullsized":"2024-09-12T01:16:15.671376+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-12T01:16:15.671217+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-12T01:16:15.671217+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.671217+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:53.817921+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10683,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":318,"num_read_kb":432,"num_write":164,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.174390+0000","last_change":"2024-09-12T01:16:14.174290+0000","last_active":"2024-09-12T01:16:14.174390+0000","last_peered":"2024-09-12T01:16:14.174390+0000","last_clean":"2024-09-12T01:16:14.174390+0000","last_became_active":"2024-09-12T00:02:56.078740+0000","last_became_peered":"2024-09-12T00:02:56.078740+0000","last_unstale":"2024-09-12T01:16:14.174390+0000","last_undegraded":"2024-09-12T01:16:14.174390+0000","last_fullsized":"2024-09-12T01:16:14.174390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.174189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.174189+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.174189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:29.216963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'110","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.272970+0000","last_change":"2024-09-12T01:16:23.272871+0000","last_active":"2024-09-12T01:16:23.272970+0000","last_peered":"2024-09-12T01:16:23.272970+0000","last_clean":"2024-09-12T01:16:23.272970+0000","last_became_active":"2024-09-12T00:02:58.092520+0000","last_became_peered":"2024-09-12T00:02:58.092520+0000","last_unstale":"2024-09-12T01:16:23.272970+0000","last_undegraded":"2024-09-12T01:16:23.272970+0000","last_fullsized":"2024-09-12T01:16:23.272970+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'110","last_scrub_stamp":"2024-09-12T01:16:23.272757+0000","last_deep_scrub":"267'110","last_deep_scrub_stamp":"2024-09-12T01:16:23.272757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.272757+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.827113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":241,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'522","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.703037+0000","last_change":"2024-09-12T01:15:57.702966+0000","last_active":"2024-09-12T01:15:57.703037+0000","last_peered":"2024-09-12T01:15:57.703037+0000","last_clean":"2024-09-12T01:15:57.703037+0000","last_became_active":"2024-09-12T00:02:50.068691+0000","last_became_peered":"2024-09-12T00:02:50.068691+0000","last_unstale":"2024-09-12T01:15:57.703037+0000","last_undegraded":"2024-09-12T01:15:57.703037+0000","last_fullsized":"2024-09-12T01:15:57.703037+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'522","last_scrub_stamp":"2024-09-12T01:15:57.702886+0000","last_deep_scrub":"267'522","last_deep_scrub_stamp":"2024-09-12T01:15:57.702886+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.702886+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:32.128046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2837,"num_read_kb":2668,"num_write":620,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'204","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.771197+0000","last_change":"2024-09-12T01:15:57.771129+0000","last_active":"2024-09-12T01:15:57.771197+0000","last_peered":"2024-09-12T01:15:57.771197+0000","last_clean":"2024-09-12T01:15:57.771197+0000","last_became_active":"2024-09-12T00:02:48.050513+0000","last_became_peered":"2024-09-12T00:02:48.050513+0000","last_unstale":"2024-09-12T01:15:57.771197+0000","last_undegraded":"2024-09-12T01:15:57.771197+0000","last_fullsized":"2024-09-12T01:15:57.771197+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'204","last_scrub_stamp":"2024-09-12T01:15:57.771000+0000","last_deep_scrub":"267'204","last_deep_scrub_stamp":"2024-09-12T01:15:57.771000+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.771000+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:32.870808+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342067,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":923,"num_read_kb":76851,"num_write":1040,"num_write_kb":50138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.275210+0000","last_change":"2024-09-12T01:16:08.275148+0000","last_active":"2024-09-12T01:16:08.275210+0000","last_peered":"2024-09-12T01:16:08.275210+0000","last_clean":"2024-09-12T01:16:08.275210+0000","last_became_active":"2024-09-12T00:02:52.064333+0000","last_became_peered":"2024-09-12T00:02:52.064333+0000","last_unstale":"2024-09-12T01:16:08.275210+0000","last_undegraded":"2024-09-12T01:16:08.275210+0000","last_fullsized":"2024-09-12T01:16:08.275210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:08.275061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:08.275061+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.275061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:43.190059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'182","reported_seq":794,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.987607+0000","last_change":"2024-09-12T01:16:19.987536+0000","last_active":"2024-09-12T01:16:19.987607+0000","last_peered":"2024-09-12T01:16:19.987607+0000","last_clean":"2024-09-12T01:16:19.987607+0000","last_became_active":"2024-09-12T00:02:54.068732+0000","last_became_peered":"2024-09-12T00:02:54.068732+0000","last_unstale":"2024-09-12T01:16:19.987607+0000","last_undegraded":"2024-09-12T01:16:19.987607+0000","last_fullsized":"2024-09-12T01:16:19.987607+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'182","last_scrub_stamp":"2024-09-12T01:16:19.987427+0000","last_deep_scrub":"267'182","last_deep_scrub_stamp":"2024-09-12T01:16:19.987427+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.987427+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:27.573352+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":259,"num_read_kb":329,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.610657+0000","last_change":"2024-09-12T01:16:22.610657+0000","last_active":"2024-09-12T01:16:22.610657+0000","last_peered":"2024-09-12T01:16:22.610657+0000","last_clean":"2024-09-12T01:16:22.610657+0000","last_became_active":"2024-09-12T00:02:56.088527+0000","last_became_peered":"2024-09-12T00:02:56.088527+0000","last_unstale":"2024-09-12T01:16:22.610657+0000","last_undegraded":"2024-09-12T01:16:22.610657+0000","last_fullsized":"2024-09-12T01:16:22.610657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:22.610554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:22.610554+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.610554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:15.716696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'113","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.629079+0000","last_change":"2024-09-12T01:16:29.629020+0000","last_active":"2024-09-12T01:16:29.629079+0000","last_peered":"2024-09-12T01:16:29.629079+0000","last_clean":"2024-09-12T01:16:29.629079+0000","last_became_active":"2024-09-12T00:02:58.100726+0000","last_became_peered":"2024-09-12T00:02:58.100726+0000","last_unstale":"2024-09-12T01:16:29.629079+0000","last_undegraded":"2024-09-12T01:16:29.629079+0000","last_fullsized":"2024-09-12T01:16:29.629079+0000","mapping_epoch":36,"log_start":"267'101","ondisk_log_start":"267'101","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T01:16:29.628930+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T01:16:29.628930+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.628930+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:01.386299+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":109,"num_write":270,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'822","reported_seq":2448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.677250+0000","last_change":"2024-09-12T01:16:00.677185+0000","last_active":"2024-09-12T01:16:00.677250+0000","last_peered":"2024-09-12T01:16:00.677250+0000","last_clean":"2024-09-12T01:16:00.677250+0000","last_became_active":"2024-09-12T00:02:50.059646+0000","last_became_peered":"2024-09-12T00:02:50.059646+0000","last_unstale":"2024-09-12T01:16:00.677250+0000","last_undegraded":"2024-09-12T01:16:00.677250+0000","last_fullsized":"2024-09-12T01:16:00.677250+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'822","last_scrub_stamp":"2024-09-12T01:16:00.677097+0000","last_deep_scrub":"267'822","last_deep_scrub_stamp":"2024-09-12T01:16:00.677097+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.677097+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:43.127120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3626,"num_write":1074,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'218","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.584277+0000","last_change":"2024-09-12T01:15:56.584216+0000","last_active":"2024-09-12T01:15:56.584277+0000","last_peered":"2024-09-12T01:15:56.584277+0000","last_clean":"2024-09-12T01:15:56.584277+0000","last_became_active":"2024-09-12T00:02:48.046424+0000","last_became_peered":"2024-09-12T00:02:48.046424+0000","last_unstale":"2024-09-12T01:15:56.584277+0000","last_undegraded":"2024-09-12T01:15:56.584277+0000","last_fullsized":"2024-09-12T01:15:56.584277+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-12T01:15:56.584071+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-12T01:15:56.584071+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.584071+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:34.930249+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553656,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":142057,"num_write":895,"num_write_kb":42631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.169877+0000","last_change":"2024-09-12T01:16:10.169805+0000","last_active":"2024-09-12T01:16:10.169877+0000","last_peered":"2024-09-12T01:16:10.169877+0000","last_clean":"2024-09-12T01:16:10.169877+0000","last_became_active":"2024-09-12T00:02:52.063641+0000","last_became_peered":"2024-09-12T00:02:52.063641+0000","last_unstale":"2024-09-12T01:16:10.169877+0000","last_undegraded":"2024-09-12T01:16:10.169877+0000","last_fullsized":"2024-09-12T01:16:10.169877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.169703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.169703+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.169703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:33.997915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'192","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.214623+0000","last_change":"2024-09-12T01:16:12.214623+0000","last_active":"2024-09-12T01:16:12.214623+0000","last_peered":"2024-09-12T01:16:12.214623+0000","last_clean":"2024-09-12T01:16:12.214623+0000","last_became_active":"2024-09-12T00:02:54.067328+0000","last_became_peered":"2024-09-12T00:02:54.067328+0000","last_unstale":"2024-09-12T01:16:12.214623+0000","last_undegraded":"2024-09-12T01:16:12.214623+0000","last_fullsized":"2024-09-12T01:16:12.214623+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-12T01:16:12.214526+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-12T01:16:12.214526+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.214526+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:31.671601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":308,"num_write":148,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'744","reported_seq":2627,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.218326+0000","last_change":"2024-09-12T01:16:15.218202+0000","last_active":"2024-09-12T01:16:15.218326+0000","last_peered":"2024-09-12T01:16:15.218326+0000","last_clean":"2024-09-12T01:16:15.218326+0000","last_became_active":"2024-09-12T00:02:56.079167+0000","last_became_peered":"2024-09-12T00:02:56.079167+0000","last_unstale":"2024-09-12T01:16:15.218326+0000","last_undegraded":"2024-09-12T01:16:15.218326+0000","last_fullsized":"2024-09-12T01:16:15.218326+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'744","last_scrub_stamp":"2024-09-12T01:16:15.218093+0000","last_deep_scrub":"267'744","last_deep_scrub_stamp":"2024-09-12T01:16:15.218093+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.218093+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:12.282880+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.305272+0000","last_change":"2024-09-12T01:16:20.305272+0000","last_active":"2024-09-12T01:16:20.305272+0000","last_peered":"2024-09-12T01:16:20.305272+0000","last_clean":"2024-09-12T01:16:20.305272+0000","last_became_active":"2024-09-12T00:02:58.097332+0000","last_became_peered":"2024-09-12T00:02:58.097332+0000","last_unstale":"2024-09-12T01:16:20.305272+0000","last_undegraded":"2024-09-12T01:16:20.305272+0000","last_fullsized":"2024-09-12T01:16:20.305272+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'128","last_scrub_stamp":"2024-09-12T01:16:20.305137+0000","last_deep_scrub":"267'128","last_deep_scrub_stamp":"2024-09-12T01:16:20.305137+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.305137+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:42.624853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":119,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'387","reported_seq":2006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.709309+0000","last_change":"2024-09-12T01:15:59.709242+0000","last_active":"2024-09-12T01:15:59.709309+0000","last_peered":"2024-09-12T01:15:59.709309+0000","last_clean":"2024-09-12T01:15:59.709309+0000","last_became_active":"2024-09-12T00:02:50.063676+0000","last_became_peered":"2024-09-12T00:02:50.063676+0000","last_unstale":"2024-09-12T01:15:59.709309+0000","last_undegraded":"2024-09-12T01:15:59.709309+0000","last_fullsized":"2024-09-12T01:15:59.709309+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'387","last_scrub_stamp":"2024-09-12T01:15:59.709154+0000","last_deep_scrub":"267'387","last_deep_scrub_stamp":"2024-09-12T01:15:59.709154+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.709154+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:48.504412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2187,"num_read_kb":2115,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'185","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.700248+0000","last_change":"2024-09-12T01:15:58.700181+0000","last_active":"2024-09-12T01:15:58.700248+0000","last_peered":"2024-09-12T01:15:58.700248+0000","last_clean":"2024-09-12T01:15:58.700248+0000","last_became_active":"2024-09-12T00:02:48.046457+0000","last_became_peered":"2024-09-12T00:02:48.046457+0000","last_unstale":"2024-09-12T01:15:58.700248+0000","last_undegraded":"2024-09-12T01:15:58.700248+0000","last_fullsized":"2024-09-12T01:15:58.700248+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:58.700097+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:58.700097+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.700097+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:20.069674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":408,"num_read_kb":52839,"num_write":877,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1466,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.244807+0000","last_change":"2024-09-12T01:16:19.244747+0000","last_active":"2024-09-12T01:16:19.244807+0000","last_peered":"2024-09-12T01:16:19.244807+0000","last_clean":"2024-09-12T01:16:19.244807+0000","last_became_active":"2024-09-12T00:02:52.068535+0000","last_became_peered":"2024-09-12T00:02:52.068535+0000","last_unstale":"2024-09-12T01:16:19.244807+0000","last_undegraded":"2024-09-12T01:16:19.244807+0000","last_fullsized":"2024-09-12T01:16:19.244807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T01:16:19.244653+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T01:16:19.244653+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.244653+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:05.379037+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'108","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.638015+0000","last_change":"2024-09-12T01:16:11.637945+0000","last_active":"2024-09-12T01:16:11.638015+0000","last_peered":"2024-09-12T01:16:11.638015+0000","last_clean":"2024-09-12T01:16:11.638015+0000","last_became_active":"2024-09-12T00:02:54.239924+0000","last_became_peered":"2024-09-12T00:02:54.239924+0000","last_unstale":"2024-09-12T01:16:11.638015+0000","last_undegraded":"2024-09-12T01:16:11.638015+0000","last_fullsized":"2024-09-12T01:16:11.638015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'108","last_scrub_stamp":"2024-09-12T01:16:11.637836+0000","last_deep_scrub":"267'108","last_deep_scrub_stamp":"2024-09-12T01:16:11.637836+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.637836+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:14.647602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":4505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.454861+0000","last_change":"2024-09-12T01:16:14.454795+0000","last_active":"2024-09-12T01:16:14.454861+0000","last_peered":"2024-09-12T01:16:14.454861+0000","last_clean":"2024-09-12T01:16:14.454861+0000","last_became_active":"2024-09-12T00:02:56.086668+0000","last_became_peered":"2024-09-12T00:02:56.086668+0000","last_unstale":"2024-09-12T01:16:14.454861+0000","last_undegraded":"2024-09-12T01:16:14.454861+0000","last_fullsized":"2024-09-12T01:16:14.454861+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'773","last_scrub_stamp":"2024-09-12T01:16:14.454708+0000","last_deep_scrub":"267'773","last_deep_scrub_stamp":"2024-09-12T01:16:14.454708+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.454708+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:26.916302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'150","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.955992+0000","last_change":"2024-09-12T01:16:26.955992+0000","last_active":"2024-09-12T01:16:26.955992+0000","last_peered":"2024-09-12T01:16:26.955992+0000","last_clean":"2024-09-12T01:16:26.955992+0000","last_became_active":"2024-09-12T00:02:58.097435+0000","last_became_peered":"2024-09-12T00:02:58.097435+0000","last_unstale":"2024-09-12T01:16:26.955992+0000","last_undegraded":"2024-09-12T01:16:26.955992+0000","last_fullsized":"2024-09-12T01:16:26.955992+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'150","last_scrub_stamp":"2024-09-12T01:16:26.955889+0000","last_deep_scrub":"267'150","last_deep_scrub_stamp":"2024-09-12T01:16:26.955889+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.955889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:30.719695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":180,"num_write":378,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'763","reported_seq":2624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.126650+0000","last_change":"2024-09-12T01:16:05.126650+0000","last_active":"2024-09-12T01:16:05.126650+0000","last_peered":"2024-09-12T01:16:05.126650+0000","last_clean":"2024-09-12T01:16:05.126650+0000","last_became_active":"2024-09-12T00:02:50.069661+0000","last_became_peered":"2024-09-12T00:02:50.069661+0000","last_unstale":"2024-09-12T01:16:05.126650+0000","last_undegraded":"2024-09-12T01:16:05.126650+0000","last_fullsized":"2024-09-12T01:16:05.126650+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'763","last_scrub_stamp":"2024-09-12T01:16:05.126551+0000","last_deep_scrub":"267'763","last_deep_scrub_stamp":"2024-09-12T01:16:05.126551+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.126551+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:05.494723+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4159,"num_read_kb":3799,"num_write":1082,"num_write_kb":511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5109,"num_omap_keys":21,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'214","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.740174+0000","last_change":"2024-09-12T01:15:56.740095+0000","last_active":"2024-09-12T01:15:56.740174+0000","last_peered":"2024-09-12T01:15:56.740174+0000","last_clean":"2024-09-12T01:15:56.740174+0000","last_became_active":"2024-09-12T00:02:48.046527+0000","last_became_peered":"2024-09-12T00:02:48.046527+0000","last_unstale":"2024-09-12T01:15:56.740174+0000","last_undegraded":"2024-09-12T01:15:56.740174+0000","last_fullsized":"2024-09-12T01:15:56.740174+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-12T01:15:56.739986+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-12T01:15:56.739986+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.739986+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:08.369987+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":898,"num_read_kb":26543,"num_write":1077,"num_write_kb":24642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"267'5","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.918342+0000","last_change":"2024-09-12T01:16:13.918274+0000","last_active":"2024-09-12T01:16:13.918342+0000","last_peered":"2024-09-12T01:16:13.918342+0000","last_clean":"2024-09-12T01:16:13.918342+0000","last_became_active":"2024-09-12T00:02:52.064186+0000","last_became_peered":"2024-09-12T00:02:52.064186+0000","last_unstale":"2024-09-12T01:16:13.918342+0000","last_undegraded":"2024-09-12T01:16:13.918342+0000","last_fullsized":"2024-09-12T01:16:13.918342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T01:16:13.918187+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T01:16:13.918187+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.918187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:12.455769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'304","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.307299+0000","last_change":"2024-09-12T01:16:24.307202+0000","last_active":"2024-09-12T01:16:24.307299+0000","last_peered":"2024-09-12T01:16:24.307299+0000","last_clean":"2024-09-12T01:16:24.307299+0000","last_became_active":"2024-09-12T00:02:54.072431+0000","last_became_peered":"2024-09-12T00:02:54.072431+0000","last_unstale":"2024-09-12T01:16:24.307299+0000","last_undegraded":"2024-09-12T01:16:24.307299+0000","last_fullsized":"2024-09-12T01:16:24.307299+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'304","last_scrub_stamp":"2024-09-12T01:16:24.307101+0000","last_deep_scrub":"267'304","last_deep_scrub_stamp":"2024-09-12T01:16:24.307101+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.307101+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:18.118573+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":998,"num_read_kb":1000,"num_write":1544,"num_write_kb":1370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488644,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.426285+0000","last_change":"2024-09-12T01:16:13.426217+0000","last_active":"2024-09-12T01:16:13.426285+0000","last_peered":"2024-09-12T01:16:13.426285+0000","last_clean":"2024-09-12T01:16:13.426285+0000","last_became_active":"2024-09-12T00:02:56.083643+0000","last_became_peered":"2024-09-12T00:02:56.083643+0000","last_unstale":"2024-09-12T01:16:13.426285+0000","last_undegraded":"2024-09-12T01:16:13.426285+0000","last_fullsized":"2024-09-12T01:16:13.426285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.426122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.426122+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.426122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:16.827180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'156","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.268505+0000","last_change":"2024-09-12T01:16:21.268505+0000","last_active":"2024-09-12T01:16:21.268505+0000","last_peered":"2024-09-12T01:16:21.268505+0000","last_clean":"2024-09-12T01:16:21.268505+0000","last_became_active":"2024-09-12T00:02:58.096337+0000","last_became_peered":"2024-09-12T00:02:58.096337+0000","last_unstale":"2024-09-12T01:16:21.268505+0000","last_undegraded":"2024-09-12T01:16:21.268505+0000","last_fullsized":"2024-09-12T01:16:21.268505+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:21.268392+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:21.268392+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.268392+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:54.802343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":162,"num_write":374,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'346","reported_seq":1750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.525322+0000","last_change":"2024-09-12T01:16:04.525322+0000","last_active":"2024-09-12T01:16:04.525322+0000","last_peered":"2024-09-12T01:16:04.525322+0000","last_clean":"2024-09-12T01:16:04.525322+0000","last_became_active":"2024-09-12T00:02:50.063141+0000","last_became_peered":"2024-09-12T00:02:50.063141+0000","last_unstale":"2024-09-12T01:16:04.525322+0000","last_undegraded":"2024-09-12T01:16:04.525322+0000","last_fullsized":"2024-09-12T01:16:04.525322+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T01:16:04.525232+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T01:16:04.525232+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.525232+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:47.471239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1807,"num_write":392,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.712129+0000","last_change":"2024-09-12T01:15:56.712040+0000","last_active":"2024-09-12T01:15:56.712129+0000","last_peered":"2024-09-12T01:15:56.712129+0000","last_clean":"2024-09-12T01:15:56.712129+0000","last_became_active":"2024-09-12T00:02:31.949283+0000","last_became_peered":"2024-09-12T00:02:31.949283+0000","last_unstale":"2024-09-12T01:15:56.712129+0000","last_undegraded":"2024-09-12T01:15:56.712129+0000","last_fullsized":"2024-09-12T01:15:56.712129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T01:15:56.711929+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T01:15:56.711929+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.711929+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:37.441635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.202303+0000","last_change":"2024-09-12T01:16:00.202303+0000","last_active":"2024-09-12T01:16:00.202303+0000","last_peered":"2024-09-12T01:16:00.202303+0000","last_clean":"2024-09-12T01:16:00.202303+0000","last_became_active":"2024-09-12T00:02:35.992795+0000","last_became_peered":"2024-09-12T00:02:35.992795+0000","last_unstale":"2024-09-12T01:16:00.202303+0000","last_undegraded":"2024-09-12T01:16:00.202303+0000","last_fullsized":"2024-09-12T01:16:00.202303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:00.202177+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:00.202177+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.202177+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:38.507294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00041072299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'199","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.725025+0000","last_change":"2024-09-12T01:15:55.725025+0000","last_active":"2024-09-12T01:15:55.725025+0000","last_peered":"2024-09-12T01:15:55.725025+0000","last_clean":"2024-09-12T01:15:55.725025+0000","last_became_active":"2024-09-12T00:02:48.047739+0000","last_became_peered":"2024-09-12T00:02:48.047739+0000","last_unstale":"2024-09-12T01:15:55.725025+0000","last_undegraded":"2024-09-12T01:15:55.725025+0000","last_fullsized":"2024-09-12T01:15:55.725025+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'199","last_scrub_stamp":"2024-09-12T01:15:55.724921+0000","last_deep_scrub":"267'199","last_deep_scrub_stamp":"2024-09-12T01:15:55.724921+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.724921+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:06.864180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":439,"num_read_kb":34702,"num_write":919,"num_write_kb":51263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.805994+0000","last_change":"2024-09-12T01:16:14.805994+0000","last_active":"2024-09-12T01:16:14.805994+0000","last_peered":"2024-09-12T01:16:14.805994+0000","last_clean":"2024-09-12T01:16:14.805994+0000","last_became_active":"2024-09-12T00:02:52.065587+0000","last_became_peered":"2024-09-12T00:02:52.065587+0000","last_unstale":"2024-09-12T01:16:14.805994+0000","last_undegraded":"2024-09-12T01:16:14.805994+0000","last_fullsized":"2024-09-12T01:16:14.805994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.805908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.805908+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.805908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:19.064794+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'340","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.278652+0000","last_change":"2024-09-12T01:16:23.278578+0000","last_active":"2024-09-12T01:16:23.278652+0000","last_peered":"2024-09-12T01:16:23.278652+0000","last_clean":"2024-09-12T01:16:23.278652+0000","last_became_active":"2024-09-12T00:02:54.069167+0000","last_became_peered":"2024-09-12T00:02:54.069167+0000","last_unstale":"2024-09-12T01:16:23.278652+0000","last_undegraded":"2024-09-12T01:16:23.278652+0000","last_fullsized":"2024-09-12T01:16:23.278652+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T01:16:23.278472+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T01:16:23.278472+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.278472+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.673031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":633,"num_read_kb":868,"num_write":580,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106956,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.650166+0000","last_change":"2024-09-12T01:16:20.650107+0000","last_active":"2024-09-12T01:16:20.650166+0000","last_peered":"2024-09-12T01:16:20.650166+0000","last_clean":"2024-09-12T01:16:20.650166+0000","last_became_active":"2024-09-12T00:02:56.082981+0000","last_became_peered":"2024-09-12T00:02:56.082981+0000","last_unstale":"2024-09-12T01:16:20.650166+0000","last_undegraded":"2024-09-12T01:16:20.650166+0000","last_fullsized":"2024-09-12T01:16:20.650166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:20.650022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:20.650022+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.650022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:11.460289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'224","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.388219+0000","last_change":"2024-09-12T01:16:20.388159+0000","last_active":"2024-09-12T01:16:20.388219+0000","last_peered":"2024-09-12T01:16:20.388219+0000","last_clean":"2024-09-12T01:16:20.388219+0000","last_became_active":"2024-09-12T00:02:58.099655+0000","last_became_peered":"2024-09-12T00:02:58.099655+0000","last_unstale":"2024-09-12T01:16:20.388219+0000","last_undegraded":"2024-09-12T01:16:20.388219+0000","last_fullsized":"2024-09-12T01:16:20.388219+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'224","last_scrub_stamp":"2024-09-12T01:16:20.388069+0000","last_deep_scrub":"267'224","last_deep_scrub_stamp":"2024-09-12T01:16:20.388069+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.388069+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.275567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1237,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":468,"num_write":474,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'877","reported_seq":2636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.833351+0000","last_change":"2024-09-12T01:16:03.833288+0000","last_active":"2024-09-12T01:16:03.833351+0000","last_peered":"2024-09-12T01:16:03.833351+0000","last_clean":"2024-09-12T01:16:03.833351+0000","last_became_active":"2024-09-12T00:02:50.075700+0000","last_became_peered":"2024-09-12T00:02:50.075700+0000","last_unstale":"2024-09-12T01:16:03.833351+0000","last_undegraded":"2024-09-12T01:16:03.833351+0000","last_fullsized":"2024-09-12T01:16:03.833351+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'877","last_scrub_stamp":"2024-09-12T01:16:03.833186+0000","last_deep_scrub":"267'877","last_deep_scrub_stamp":"2024-09-12T01:16:03.833186+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.833186+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:45.011515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4451,"num_read_kb":4025,"num_write":1186,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.692638+0000","last_change":"2024-09-12T01:15:58.692568+0000","last_active":"2024-09-12T01:15:58.692638+0000","last_peered":"2024-09-12T01:15:58.692638+0000","last_clean":"2024-09-12T01:15:58.692638+0000","last_became_active":"2024-09-12T00:02:35.992009+0000","last_became_peered":"2024-09-12T00:02:35.992009+0000","last_unstale":"2024-09-12T01:15:58.692638+0000","last_undegraded":"2024-09-12T01:15:58.692638+0000","last_fullsized":"2024-09-12T01:15:58.692638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:58.692481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:58.692481+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.692481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:48.738124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398312,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'216","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.934809+0000","last_change":"2024-09-12T01:15:54.934809+0000","last_active":"2024-09-12T01:15:54.934809+0000","last_peered":"2024-09-12T01:15:54.934809+0000","last_clean":"2024-09-12T01:15:54.934809+0000","last_became_active":"2024-09-12T00:02:48.057849+0000","last_became_peered":"2024-09-12T00:02:48.057849+0000","last_unstale":"2024-09-12T01:15:54.934809+0000","last_undegraded":"2024-09-12T01:15:54.934809+0000","last_fullsized":"2024-09-12T01:15:54.934809+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'216","last_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_deep_scrub":"267'216","last_deep_scrub_stamp":"2024-09-12T01:15:54.934711+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.934711+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.315677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079943,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":521,"num_read_kb":138068,"num_write":1057,"num_write_kb":57312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.217101+0000","last_change":"2024-09-12T01:16:18.217024+0000","last_active":"2024-09-12T01:16:18.217101+0000","last_peered":"2024-09-12T01:16:18.217101+0000","last_clean":"2024-09-12T01:16:18.217101+0000","last_became_active":"2024-09-12T00:02:52.066352+0000","last_became_peered":"2024-09-12T00:02:52.066352+0000","last_unstale":"2024-09-12T01:16:18.217101+0000","last_undegraded":"2024-09-12T01:16:18.217101+0000","last_fullsized":"2024-09-12T01:16:18.217101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.216903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.216903+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.216903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:57.836293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'947","reported_seq":2795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.250857+0000","last_change":"2024-09-12T01:16:14.250857+0000","last_active":"2024-09-12T01:16:14.250857+0000","last_peered":"2024-09-12T01:16:14.250857+0000","last_clean":"2024-09-12T01:16:14.250857+0000","last_became_active":"2024-09-12T00:02:54.070061+0000","last_became_peered":"2024-09-12T00:02:54.070061+0000","last_unstale":"2024-09-12T01:16:14.250857+0000","last_undegraded":"2024-09-12T01:16:14.250857+0000","last_fullsized":"2024-09-12T01:16:14.250857+0000","mapping_epoch":32,"log_start":"267'901","ondisk_log_start":"267'901","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'947","last_scrub_stamp":"2024-09-12T01:16:14.250736+0000","last_deep_scrub":"267'947","last_deep_scrub_stamp":"2024-09-12T01:16:14.250736+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.250736+0000","objects_scrubbed":12,"log_size":46,"log_dups_size":901,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.703976+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20817,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1281,"num_read_kb":1476,"num_write":392,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.913627+0000","last_change":"2024-09-12T01:16:24.913627+0000","last_active":"2024-09-12T01:16:24.913627+0000","last_peered":"2024-09-12T01:16:24.913627+0000","last_clean":"2024-09-12T01:16:24.913627+0000","last_became_active":"2024-09-12T00:02:56.078658+0000","last_became_peered":"2024-09-12T00:02:56.078658+0000","last_unstale":"2024-09-12T01:16:24.913627+0000","last_undegraded":"2024-09-12T01:16:24.913627+0000","last_fullsized":"2024-09-12T01:16:24.913627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.913532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.913532+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.913532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:54.477216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'172","reported_seq":763,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.262611+0000","last_change":"2024-09-12T01:16:22.262539+0000","last_active":"2024-09-12T01:16:22.262611+0000","last_peered":"2024-09-12T01:16:22.262611+0000","last_clean":"2024-09-12T01:16:22.262611+0000","last_became_active":"2024-09-12T00:02:58.089378+0000","last_became_peered":"2024-09-12T00:02:58.089378+0000","last_unstale":"2024-09-12T01:16:22.262611+0000","last_undegraded":"2024-09-12T01:16:22.262611+0000","last_fullsized":"2024-09-12T01:16:22.262611+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'172","last_scrub_stamp":"2024-09-12T01:16:22.262447+0000","last_deep_scrub":"267'172","last_deep_scrub_stamp":"2024-09-12T01:16:22.262447+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.262447+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:23.907893+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":336,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'1109","reported_seq":2835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.124023+0000","last_change":"2024-09-12T01:16:03.123960+0000","last_active":"2024-09-12T01:16:03.124023+0000","last_peered":"2024-09-12T01:16:03.124023+0000","last_clean":"2024-09-12T01:16:03.124023+0000","last_became_active":"2024-09-12T00:02:50.067002+0000","last_became_peered":"2024-09-12T00:02:50.067002+0000","last_unstale":"2024-09-12T01:16:03.124023+0000","last_undegraded":"2024-09-12T01:16:03.124023+0000","last_fullsized":"2024-09-12T01:16:03.124023+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1109","last_scrub_stamp":"2024-09-12T01:16:03.123868+0000","last_deep_scrub":"267'1109","last_deep_scrub_stamp":"2024-09-12T01:16:03.123868+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.123868+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":1000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.293606+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5247,"num_read_kb":4613,"num_write":1599,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":551,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.086300+0000","last_change":"2024-09-12T01:15:54.086300+0000","last_active":"2024-09-12T01:15:54.086300+0000","last_peered":"2024-09-12T01:15:54.086300+0000","last_clean":"2024-09-12T01:15:54.086300+0000","last_became_active":"2024-09-12T00:02:36.461485+0000","last_became_peered":"2024-09-12T00:02:36.461485+0000","last_unstale":"2024-09-12T01:15:54.086300+0000","last_undegraded":"2024-09-12T01:15:54.086300+0000","last_fullsized":"2024-09-12T01:15:54.086300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:54.086226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:54.086226+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.086226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:56.605178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000467374,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'185","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.053493+0000","last_change":"2024-09-12T01:15:56.053418+0000","last_active":"2024-09-12T01:15:56.053493+0000","last_peered":"2024-09-12T01:15:56.053493+0000","last_clean":"2024-09-12T01:15:56.053493+0000","last_became_active":"2024-09-12T00:02:48.044126+0000","last_became_peered":"2024-09-12T00:02:48.044126+0000","last_unstale":"2024-09-12T01:15:56.053493+0000","last_undegraded":"2024-09-12T01:15:56.053493+0000","last_fullsized":"2024-09-12T01:15:56.053493+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:15:56.053326+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:15:56.053326+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.053326+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.310181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4751719,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":400,"num_read_kb":27065,"num_write":781,"num_write_kb":40333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.261642+0000","last_change":"2024-09-12T01:16:05.261538+0000","last_active":"2024-09-12T01:16:05.261642+0000","last_peered":"2024-09-12T01:16:05.261642+0000","last_clean":"2024-09-12T01:16:05.261642+0000","last_became_active":"2024-09-12T00:02:52.068351+0000","last_became_peered":"2024-09-12T00:02:52.068351+0000","last_unstale":"2024-09-12T01:16:05.261642+0000","last_undegraded":"2024-09-12T01:16:05.261642+0000","last_fullsized":"2024-09-12T01:16:05.261642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T01:16:05.261339+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T01:16:05.261339+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.261339+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:53.809383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'311","reported_seq":1750,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.874033+0000","last_change":"2024-09-12T01:16:21.874033+0000","last_active":"2024-09-12T01:16:21.874033+0000","last_peered":"2024-09-12T01:16:21.874033+0000","last_clean":"2024-09-12T01:16:21.874033+0000","last_became_active":"2024-09-12T00:02:54.241581+0000","last_became_peered":"2024-09-12T00:02:54.241581+0000","last_unstale":"2024-09-12T01:16:21.874033+0000","last_undegraded":"2024-09-12T01:16:21.874033+0000","last_fullsized":"2024-09-12T01:16:21.874033+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T01:16:21.873938+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T01:16:21.873938+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.873938+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:16.952197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":262,"num_read_kb":254,"num_write":243,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.668167+0000","last_change":"2024-09-12T01:16:18.668167+0000","last_active":"2024-09-12T01:16:18.668167+0000","last_peered":"2024-09-12T01:16:18.668167+0000","last_clean":"2024-09-12T01:16:18.668167+0000","last_became_active":"2024-09-12T00:02:56.081641+0000","last_became_peered":"2024-09-12T00:02:56.081641+0000","last_unstale":"2024-09-12T01:16:18.668167+0000","last_undegraded":"2024-09-12T01:16:18.668167+0000","last_fullsized":"2024-09-12T01:16:18.668167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.668049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.668049+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.668049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:09.740334+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'277","reported_seq":891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.612994+0000","last_change":"2024-09-12T01:16:28.612937+0000","last_active":"2024-09-12T01:16:28.612994+0000","last_peered":"2024-09-12T01:16:28.612994+0000","last_clean":"2024-09-12T01:16:28.612994+0000","last_became_active":"2024-09-12T00:02:58.088442+0000","last_became_peered":"2024-09-12T00:02:58.088442+0000","last_unstale":"2024-09-12T01:16:28.612994+0000","last_undegraded":"2024-09-12T01:16:28.612994+0000","last_fullsized":"2024-09-12T01:16:28.612994+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T01:16:28.612850+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T01:16:28.612850+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.612850+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.460954+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":615,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'439","reported_seq":2024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.247988+0000","last_change":"2024-09-12T01:16:10.247891+0000","last_active":"2024-09-12T01:16:10.247988+0000","last_peered":"2024-09-12T01:16:10.247988+0000","last_clean":"2024-09-12T01:16:10.247988+0000","last_became_active":"2024-09-12T00:03:21.140691+0000","last_became_peered":"2024-09-12T00:03:21.140691+0000","last_unstale":"2024-09-12T01:16:10.247988+0000","last_undegraded":"2024-09-12T01:16:10.247988+0000","last_fullsized":"2024-09-12T01:16:10.247988+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'439","last_scrub_stamp":"2024-09-12T01:16:10.247775+0000","last_deep_scrub":"267'439","last_deep_scrub_stamp":"2024-09-12T01:16:10.247775+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.247775+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:43.615955+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2439,"num_read_kb":2322,"num_write":494,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.160871+0000","last_change":"2024-09-12T01:15:56.160871+0000","last_active":"2024-09-12T01:15:56.160871+0000","last_peered":"2024-09-12T01:15:56.160871+0000","last_clean":"2024-09-12T01:15:56.160871+0000","last_became_active":"2024-09-12T00:02:35.992045+0000","last_became_peered":"2024-09-12T00:02:35.992045+0000","last_unstale":"2024-09-12T01:15:56.160871+0000","last_undegraded":"2024-09-12T01:15:56.160871+0000","last_fullsized":"2024-09-12T01:15:56.160871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T01:15:56.160739+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T01:15:56.160739+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.160739+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:36.791017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010704320000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'207","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.693700+0000","last_change":"2024-09-12T01:15:55.693700+0000","last_active":"2024-09-12T01:15:55.693700+0000","last_peered":"2024-09-12T01:15:55.693700+0000","last_clean":"2024-09-12T01:15:55.693700+0000","last_became_active":"2024-09-12T00:02:48.049260+0000","last_became_peered":"2024-09-12T00:02:48.049260+0000","last_unstale":"2024-09-12T01:15:55.693700+0000","last_undegraded":"2024-09-12T01:15:55.693700+0000","last_fullsized":"2024-09-12T01:15:55.693700+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-12T01:15:55.693558+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-12T01:15:55.693558+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.693558+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.593673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291546,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":103584,"num_write":943,"num_write_kb":20218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.641153+0000","last_change":"2024-09-12T01:16:12.641153+0000","last_active":"2024-09-12T01:16:12.641153+0000","last_peered":"2024-09-12T01:16:12.641153+0000","last_clean":"2024-09-12T01:16:12.641153+0000","last_became_active":"2024-09-12T00:02:52.066289+0000","last_became_peered":"2024-09-12T00:02:52.066289+0000","last_unstale":"2024-09-12T01:16:12.641153+0000","last_undegraded":"2024-09-12T01:16:12.641153+0000","last_fullsized":"2024-09-12T01:16:12.641153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:12.641053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:12.641053+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.641053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:37.049985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'166","reported_seq":741,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.578322+0000","last_change":"2024-09-12T01:16:20.578250+0000","last_active":"2024-09-12T01:16:20.578322+0000","last_peered":"2024-09-12T01:16:20.578322+0000","last_clean":"2024-09-12T01:16:20.578322+0000","last_became_active":"2024-09-12T00:02:54.066864+0000","last_became_peered":"2024-09-12T00:02:54.066864+0000","last_unstale":"2024-09-12T01:16:20.578322+0000","last_undegraded":"2024-09-12T01:16:20.578322+0000","last_fullsized":"2024-09-12T01:16:20.578322+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'166","last_scrub_stamp":"2024-09-12T01:16:20.578154+0000","last_deep_scrub":"267'166","last_deep_scrub_stamp":"2024-09-12T01:16:20.578154+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.578154+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:07.312869+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":203,"num_read_kb":195,"num_write":150,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.459032+0000","last_change":"2024-09-12T01:16:12.458972+0000","last_active":"2024-09-12T01:16:12.459032+0000","last_peered":"2024-09-12T01:16:12.459032+0000","last_clean":"2024-09-12T01:16:12.459032+0000","last_became_active":"2024-09-12T00:02:56.085437+0000","last_became_peered":"2024-09-12T00:02:56.085437+0000","last_unstale":"2024-09-12T01:16:12.459032+0000","last_undegraded":"2024-09-12T01:16:12.459032+0000","last_fullsized":"2024-09-12T01:16:12.459032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:12.458882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:12.458882+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.458882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:11.334322+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'109","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.260098+0000","last_change":"2024-09-12T01:16:30.260026+0000","last_active":"2024-09-12T01:16:30.260098+0000","last_peered":"2024-09-12T01:16:30.260098+0000","last_clean":"2024-09-12T01:16:30.260098+0000","last_became_active":"2024-09-12T00:02:58.095419+0000","last_became_peered":"2024-09-12T00:02:58.095419+0000","last_unstale":"2024-09-12T01:16:30.260098+0000","last_undegraded":"2024-09-12T01:16:30.260098+0000","last_fullsized":"2024-09-12T01:16:30.260098+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'109","last_scrub_stamp":"2024-09-12T01:16:30.259943+0000","last_deep_scrub":"267'109","last_deep_scrub_stamp":"2024-09-12T01:16:30.259943+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.259943+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:03.848903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":189,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'417","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.135125+0000","last_change":"2024-09-12T01:16:04.135125+0000","last_active":"2024-09-12T01:16:04.135125+0000","last_peered":"2024-09-12T01:16:04.135125+0000","last_clean":"2024-09-12T01:16:04.135125+0000","last_became_active":"2024-09-12T00:02:50.075209+0000","last_became_peered":"2024-09-12T00:02:50.075209+0000","last_unstale":"2024-09-12T01:16:04.135125+0000","last_undegraded":"2024-09-12T01:16:04.135125+0000","last_fullsized":"2024-09-12T01:16:04.135125+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'417","last_scrub_stamp":"2024-09-12T01:16:04.135003+0000","last_deep_scrub":"267'417","last_deep_scrub_stamp":"2024-09-12T01:16:04.135003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.135003+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.259816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2214,"num_read_kb":2093,"num_write":483,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'191","reported_seq":842,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.197783+0000","last_change":"2024-09-12T01:15:58.197783+0000","last_active":"2024-09-12T01:15:58.197783+0000","last_peered":"2024-09-12T01:15:58.197783+0000","last_clean":"2024-09-12T01:15:58.197783+0000","last_became_active":"2024-09-12T00:02:48.052751+0000","last_became_peered":"2024-09-12T00:02:48.052751+0000","last_unstale":"2024-09-12T01:15:58.197783+0000","last_undegraded":"2024-09-12T01:15:58.197783+0000","last_fullsized":"2024-09-12T01:15:58.197783+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'191","last_scrub_stamp":"2024-09-12T01:15:58.197662+0000","last_deep_scrub":"267'191","last_deep_scrub_stamp":"2024-09-12T01:15:58.197662+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.197662+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:11.307806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493417,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":26295,"num_write":910,"num_write_kb":36863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.106575+0000","last_change":"2024-09-12T01:15:54.106575+0000","last_active":"2024-09-12T01:15:54.106575+0000","last_peered":"2024-09-12T01:15:54.106575+0000","last_clean":"2024-09-12T01:15:54.106575+0000","last_became_active":"2024-09-12T00:02:35.988595+0000","last_became_peered":"2024-09-12T00:02:35.988595+0000","last_unstale":"2024-09-12T01:15:54.106575+0000","last_undegraded":"2024-09-12T01:15:54.106575+0000","last_fullsized":"2024-09-12T01:15:54.106575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:54.106483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:54.106483+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.106483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:20.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047182300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.681070+0000","last_change":"2024-09-12T01:16:11.681070+0000","last_active":"2024-09-12T01:16:11.681070+0000","last_peered":"2024-09-12T01:16:11.681070+0000","last_clean":"2024-09-12T01:16:11.681070+0000","last_became_active":"2024-09-12T00:02:52.067200+0000","last_became_peered":"2024-09-12T00:02:52.067200+0000","last_unstale":"2024-09-12T01:16:11.681070+0000","last_undegraded":"2024-09-12T01:16:11.681070+0000","last_fullsized":"2024-09-12T01:16:11.681070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:11.680981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:11.680981+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.680981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:51.075341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'316","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.695019+0000","last_change":"2024-09-12T01:16:14.694954+0000","last_active":"2024-09-12T01:16:14.695019+0000","last_peered":"2024-09-12T01:16:14.695019+0000","last_clean":"2024-09-12T01:16:14.695019+0000","last_became_active":"2024-09-12T00:02:54.069071+0000","last_became_peered":"2024-09-12T00:02:54.069071+0000","last_unstale":"2024-09-12T01:16:14.695019+0000","last_undegraded":"2024-09-12T01:16:14.695019+0000","last_fullsized":"2024-09-12T01:16:14.695019+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'316","last_scrub_stamp":"2024-09-12T01:16:14.694854+0000","last_deep_scrub":"267'316","last_deep_scrub_stamp":"2024-09-12T01:16:14.694854+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.694854+0000","objects_scrubbed":11,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:57.933950+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13589,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":450,"num_read_kb":594,"num_write":258,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.951234+0000","last_change":"2024-09-12T01:16:23.951234+0000","last_active":"2024-09-12T01:16:23.951234+0000","last_peered":"2024-09-12T01:16:23.951234+0000","last_clean":"2024-09-12T01:16:23.951234+0000","last_became_active":"2024-09-12T00:02:56.082046+0000","last_became_peered":"2024-09-12T00:02:56.082046+0000","last_unstale":"2024-09-12T01:16:23.951234+0000","last_undegraded":"2024-09-12T01:16:23.951234+0000","last_fullsized":"2024-09-12T01:16:23.951234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.951113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.951113+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.951113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.037004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'167","reported_seq":693,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.583929+0000","last_change":"2024-09-12T01:16:28.583861+0000","last_active":"2024-09-12T01:16:28.583929+0000","last_peered":"2024-09-12T01:16:28.583929+0000","last_clean":"2024-09-12T01:16:28.583929+0000","last_became_active":"2024-09-12T00:02:58.091590+0000","last_became_peered":"2024-09-12T00:02:58.091590+0000","last_unstale":"2024-09-12T01:16:28.583929+0000","last_undegraded":"2024-09-12T01:16:28.583929+0000","last_fullsized":"2024-09-12T01:16:28.583929+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T01:16:28.583748+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T01:16:28.583748+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.583748+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:57.607309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1150,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":174,"num_write":425,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'452","reported_seq":2003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.829586+0000","last_change":"2024-09-12T01:16:02.829586+0000","last_active":"2024-09-12T01:16:02.829586+0000","last_peered":"2024-09-12T01:16:02.829586+0000","last_clean":"2024-09-12T01:16:02.829586+0000","last_became_active":"2024-09-12T00:02:50.073262+0000","last_became_peered":"2024-09-12T00:02:50.073262+0000","last_unstale":"2024-09-12T01:16:02.829586+0000","last_undegraded":"2024-09-12T01:16:02.829586+0000","last_fullsized":"2024-09-12T01:16:02.829586+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'452","last_scrub_stamp":"2024-09-12T01:16:02.829503+0000","last_deep_scrub":"267'452","last_deep_scrub_stamp":"2024-09-12T01:16:02.829503+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.829503+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:27.994764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2298,"num_read_kb":2165,"num_write":516,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'158","reported_seq":798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.086308+0000","last_change":"2024-09-12T01:15:57.086308+0000","last_active":"2024-09-12T01:15:57.086308+0000","last_peered":"2024-09-12T01:15:57.086308+0000","last_clean":"2024-09-12T01:15:57.086308+0000","last_became_active":"2024-09-12T00:02:48.052768+0000","last_became_peered":"2024-09-12T00:02:48.052768+0000","last_unstale":"2024-09-12T01:15:57.086308+0000","last_undegraded":"2024-09-12T01:15:57.086308+0000","last_fullsized":"2024-09-12T01:15:57.086308+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:15:57.086208+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:15:57.086208+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.086208+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:33.822235+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3687654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":16851,"num_write":770,"num_write_kb":9796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.680047+0000","last_change":"2024-09-12T01:15:57.680047+0000","last_active":"2024-09-12T01:15:57.680047+0000","last_peered":"2024-09-12T01:15:57.680047+0000","last_clean":"2024-09-12T01:15:57.680047+0000","last_became_active":"2024-09-12T00:02:35.992988+0000","last_became_peered":"2024-09-12T00:02:35.992988+0000","last_unstale":"2024-09-12T01:15:57.680047+0000","last_undegraded":"2024-09-12T01:15:57.680047+0000","last_fullsized":"2024-09-12T01:15:57.680047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:57.679926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:57.679926+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.679926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:28.341226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045773299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.404382+0000","last_change":"2024-09-12T01:16:09.404382+0000","last_active":"2024-09-12T01:16:09.404382+0000","last_peered":"2024-09-12T01:16:09.404382+0000","last_clean":"2024-09-12T01:16:09.404382+0000","last_became_active":"2024-09-12T00:02:52.069469+0000","last_became_peered":"2024-09-12T00:02:52.069469+0000","last_unstale":"2024-09-12T01:16:09.404382+0000","last_undegraded":"2024-09-12T01:16:09.404382+0000","last_fullsized":"2024-09-12T01:16:09.404382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.404244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.404244+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.404244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:48.154706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'268","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.257925+0000","last_change":"2024-09-12T01:16:15.257925+0000","last_active":"2024-09-12T01:16:15.257925+0000","last_peered":"2024-09-12T01:16:15.257925+0000","last_clean":"2024-09-12T01:16:15.257925+0000","last_became_active":"2024-09-12T00:02:54.239879+0000","last_became_peered":"2024-09-12T00:02:54.239879+0000","last_unstale":"2024-09-12T01:16:15.257925+0000","last_undegraded":"2024-09-12T01:16:15.257925+0000","last_fullsized":"2024-09-12T01:16:15.257925+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'268","last_scrub_stamp":"2024-09-12T01:16:15.257819+0000","last_deep_scrub":"267'268","last_deep_scrub_stamp":"2024-09-12T01:16:15.257819+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.257819+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:05.117332+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":332,"num_read_kb":322,"num_write":304,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'794","reported_seq":5273,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.308071+0000","last_change":"2024-09-12T01:16:27.307983+0000","last_active":"2024-09-12T01:16:27.308071+0000","last_peered":"2024-09-12T01:16:27.308071+0000","last_clean":"2024-09-12T01:16:27.308071+0000","last_became_active":"2024-09-12T00:02:56.086704+0000","last_became_peered":"2024-09-12T00:02:56.086704+0000","last_unstale":"2024-09-12T01:16:27.308071+0000","last_undegraded":"2024-09-12T01:16:27.308071+0000","last_fullsized":"2024-09-12T01:16:27.308071+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'794","last_scrub_stamp":"2024-09-12T01:16:27.307879+0000","last_deep_scrub":"267'794","last_deep_scrub_stamp":"2024-09-12T01:16:27.307879+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.307879+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.008848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'156","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.602075+0000","last_change":"2024-09-12T01:16:30.602075+0000","last_active":"2024-09-12T01:16:30.602075+0000","last_peered":"2024-09-12T01:16:30.602075+0000","last_clean":"2024-09-12T01:16:30.602075+0000","last_became_active":"2024-09-12T00:02:58.091466+0000","last_became_peered":"2024-09-12T00:02:58.091466+0000","last_unstale":"2024-09-12T01:16:30.602075+0000","last_undegraded":"2024-09-12T01:16:30.602075+0000","last_fullsized":"2024-09-12T01:16:30.602075+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:30.601983+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:30.601983+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.601983+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:41.138937+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":335,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'992","reported_seq":2664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.642892+0000","last_change":"2024-09-12T01:16:05.642819+0000","last_active":"2024-09-12T01:16:05.642892+0000","last_peered":"2024-09-12T01:16:05.642892+0000","last_clean":"2024-09-12T01:16:05.642892+0000","last_became_active":"2024-09-12T00:02:50.067868+0000","last_became_peered":"2024-09-12T00:02:50.067868+0000","last_unstale":"2024-09-12T01:16:05.642892+0000","last_undegraded":"2024-09-12T01:16:05.642892+0000","last_fullsized":"2024-09-12T01:16:05.642892+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'992","last_scrub_stamp":"2024-09-12T01:16:05.642648+0000","last_deep_scrub":"267'992","last_deep_scrub_stamp":"2024-09-12T01:16:05.642648+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.642648+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":900,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:51.830523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4764,"num_read_kb":4246,"num_write":1341,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'174","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:54.765888+0000","last_change":"2024-09-12T01:15:54.765840+0000","last_active":"2024-09-12T01:15:54.765888+0000","last_peered":"2024-09-12T01:15:54.765888+0000","last_clean":"2024-09-12T01:15:54.765888+0000","last_became_active":"2024-09-12T00:02:48.052431+0000","last_became_peered":"2024-09-12T00:02:48.052431+0000","last_unstale":"2024-09-12T01:15:54.765888+0000","last_undegraded":"2024-09-12T01:15:54.765888+0000","last_fullsized":"2024-09-12T01:15:54.765888+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-12T01:15:54.765727+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-12T01:15:54.765727+0000","last_clean_scrub_stamp":"2024-09-12T01:15:54.765727+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:58.196722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1211576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":121623,"num_write":832,"num_write_kb":33084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.074501+0000","last_change":"2024-09-12T01:15:55.074456+0000","last_active":"2024-09-12T01:15:55.074501+0000","last_peered":"2024-09-12T01:15:55.074501+0000","last_clean":"2024-09-12T01:15:55.074501+0000","last_became_active":"2024-09-12T00:02:35.993731+0000","last_became_peered":"2024-09-12T00:02:35.993731+0000","last_unstale":"2024-09-12T01:15:55.074501+0000","last_undegraded":"2024-09-12T01:15:55.074501+0000","last_fullsized":"2024-09-12T01:15:55.074501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:15:55.074392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:15:55.074392+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.074392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:33.741570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049841900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.904718+0000","last_change":"2024-09-12T01:16:14.904718+0000","last_active":"2024-09-12T01:16:14.904718+0000","last_peered":"2024-09-12T01:16:14.904718+0000","last_clean":"2024-09-12T01:16:14.904718+0000","last_became_active":"2024-09-12T00:02:52.062631+0000","last_became_peered":"2024-09-12T00:02:52.062631+0000","last_unstale":"2024-09-12T01:16:14.904718+0000","last_undegraded":"2024-09-12T01:16:14.904718+0000","last_fullsized":"2024-09-12T01:16:14.904718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.904620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.904620+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.904620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:52.933314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'143","reported_seq":720,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.989354+0000","last_change":"2024-09-12T01:16:18.989354+0000","last_active":"2024-09-12T01:16:18.989354+0000","last_peered":"2024-09-12T01:16:18.989354+0000","last_clean":"2024-09-12T01:16:18.989354+0000","last_became_active":"2024-09-12T00:02:54.068812+0000","last_became_peered":"2024-09-12T00:02:54.068812+0000","last_unstale":"2024-09-12T01:16:18.989354+0000","last_undegraded":"2024-09-12T01:16:18.989354+0000","last_fullsized":"2024-09-12T01:16:18.989354+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'143","last_scrub_stamp":"2024-09-12T01:16:18.989240+0000","last_deep_scrub":"267'143","last_deep_scrub_stamp":"2024-09-12T01:16:18.989240+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.989240+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:18.570760+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":169,"num_write":118,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'809","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.552525+0000","last_change":"2024-09-12T01:16:26.552525+0000","last_active":"2024-09-12T01:16:26.552525+0000","last_peered":"2024-09-12T01:16:26.552525+0000","last_clean":"2024-09-12T01:16:26.552525+0000","last_became_active":"2024-09-12T00:02:56.083894+0000","last_became_peered":"2024-09-12T00:02:56.083894+0000","last_unstale":"2024-09-12T01:16:26.552525+0000","last_undegraded":"2024-09-12T01:16:26.552525+0000","last_fullsized":"2024-09-12T01:16:26.552525+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'809","last_scrub_stamp":"2024-09-12T01:16:26.552439+0000","last_deep_scrub":"267'809","last_deep_scrub_stamp":"2024-09-12T01:16:26.552439+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.552439+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:42.339646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'277","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:27.621147+0000","last_change":"2024-09-12T01:16:27.621041+0000","last_active":"2024-09-12T01:16:27.621147+0000","last_peered":"2024-09-12T01:16:27.621147+0000","last_clean":"2024-09-12T01:16:27.621147+0000","last_became_active":"2024-09-12T00:02:58.093442+0000","last_became_peered":"2024-09-12T00:02:58.093442+0000","last_unstale":"2024-09-12T01:16:27.621147+0000","last_undegraded":"2024-09-12T01:16:27.621147+0000","last_fullsized":"2024-09-12T01:16:27.621147+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T01:16:27.620900+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T01:16:27.620900+0000","last_clean_scrub_stamp":"2024-09-12T01:16:27.620900+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:52.669324+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":340,"num_read_kb":339,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'414","reported_seq":1929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.721059+0000","last_change":"2024-09-12T01:16:01.721059+0000","last_active":"2024-09-12T01:16:01.721059+0000","last_peered":"2024-09-12T01:16:01.721059+0000","last_clean":"2024-09-12T01:16:01.721059+0000","last_became_active":"2024-09-12T00:02:50.057999+0000","last_became_peered":"2024-09-12T00:02:50.057999+0000","last_unstale":"2024-09-12T01:16:01.721059+0000","last_undegraded":"2024-09-12T01:16:01.721059+0000","last_fullsized":"2024-09-12T01:16:01.721059+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-12T01:16:01.720958+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-12T01:16:01.720958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.720958+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:36.846886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2267,"num_read_kb":2133,"num_write":493,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'270","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:53.943397+0000","last_change":"2024-09-12T01:15:53.943324+0000","last_active":"2024-09-12T01:15:53.943397+0000","last_peered":"2024-09-12T01:15:53.943397+0000","last_clean":"2024-09-12T01:15:53.943397+0000","last_became_active":"2024-09-12T00:02:48.051495+0000","last_became_peered":"2024-09-12T00:02:48.051495+0000","last_unstale":"2024-09-12T01:15:53.943397+0000","last_undegraded":"2024-09-12T01:15:53.943397+0000","last_fullsized":"2024-09-12T01:15:53.943397+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-12T01:15:53.943232+0000","last_clean_scrub_stamp":"2024-09-12T01:15:53.943232+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:48.709674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598650,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":670,"num_read_kb":18611,"num_write":1220,"num_write_kb":43211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.519319+0000","last_change":"2024-09-12T01:16:00.519255+0000","last_active":"2024-09-12T01:16:00.519319+0000","last_peered":"2024-09-12T01:16:00.519319+0000","last_clean":"2024-09-12T01:16:00.519319+0000","last_became_active":"2024-09-12T00:02:35.993796+0000","last_became_peered":"2024-09-12T00:02:35.993796+0000","last_unstale":"2024-09-12T01:16:00.519319+0000","last_undegraded":"2024-09-12T01:16:00.519319+0000","last_fullsized":"2024-09-12T01:16:00.519319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:00.519172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:00.519172+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.519172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:56.447826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000443731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.594374+0000","last_change":"2024-09-12T01:16:13.594306+0000","last_active":"2024-09-12T01:16:13.594374+0000","last_peered":"2024-09-12T01:16:13.594374+0000","last_clean":"2024-09-12T01:16:13.594374+0000","last_became_active":"2024-09-12T00:02:52.062544+0000","last_became_peered":"2024-09-12T00:02:52.062544+0000","last_unstale":"2024-09-12T01:16:13.594374+0000","last_undegraded":"2024-09-12T01:16:13.594374+0000","last_fullsized":"2024-09-12T01:16:13.594374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.594219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.594219+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.594219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:10.561944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'364","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.903838+0000","last_change":"2024-09-12T01:16:17.903838+0000","last_active":"2024-09-12T01:16:17.903838+0000","last_peered":"2024-09-12T01:16:17.903838+0000","last_clean":"2024-09-12T01:16:17.903838+0000","last_became_active":"2024-09-12T00:02:54.239355+0000","last_became_peered":"2024-09-12T00:02:54.239355+0000","last_unstale":"2024-09-12T01:16:17.903838+0000","last_undegraded":"2024-09-12T01:16:17.903838+0000","last_fullsized":"2024-09-12T01:16:17.903838+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T01:16:17.903729+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T01:16:17.903729+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.903729+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:31.614604+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26416,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":736,"num_write":272,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.603312+0000","last_change":"2024-09-12T01:16:19.603312+0000","last_active":"2024-09-12T01:16:19.603312+0000","last_peered":"2024-09-12T01:16:19.603312+0000","last_clean":"2024-09-12T01:16:19.603312+0000","last_became_active":"2024-09-12T00:02:56.087448+0000","last_became_peered":"2024-09-12T00:02:56.087448+0000","last_unstale":"2024-09-12T01:16:19.603312+0000","last_undegraded":"2024-09-12T01:16:19.603312+0000","last_fullsized":"2024-09-12T01:16:19.603312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:19.603217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:19.603217+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.603217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:11.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'131","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.257082+0000","last_change":"2024-09-12T01:16:31.257024+0000","last_active":"2024-09-12T01:16:31.257082+0000","last_peered":"2024-09-12T01:16:31.257082+0000","last_clean":"2024-09-12T01:16:31.257082+0000","last_became_active":"2024-09-12T00:02:58.099906+0000","last_became_peered":"2024-09-12T00:02:58.099906+0000","last_unstale":"2024-09-12T01:16:31.257082+0000","last_undegraded":"2024-09-12T01:16:31.257082+0000","last_fullsized":"2024-09-12T01:16:31.257082+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:16:31.256911+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:16:31.256911+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.256911+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:58.144369+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1262,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":140,"num_write":299,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'131","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.682118+0000","last_change":"2024-09-12T01:16:31.682118+0000","last_active":"2024-09-12T01:16:31.682118+0000","last_peered":"2024-09-12T01:16:31.682118+0000","last_clean":"2024-09-12T01:16:31.682118+0000","last_became_active":"2024-09-12T00:02:58.099564+0000","last_became_peered":"2024-09-12T00:02:58.099564+0000","last_unstale":"2024-09-12T01:16:31.682118+0000","last_undegraded":"2024-09-12T01:16:31.682118+0000","last_fullsized":"2024-09-12T01:16:31.682118+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T01:16:31.682035+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T01:16:31.682035+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.682035+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:49.336012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":201,"num_write":295,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'832","reported_seq":2385,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.713433+0000","last_change":"2024-09-12T01:16:02.713433+0000","last_active":"2024-09-12T01:16:02.713433+0000","last_peered":"2024-09-12T01:16:02.713433+0000","last_clean":"2024-09-12T01:16:02.713433+0000","last_became_active":"2024-09-12T00:02:50.063351+0000","last_became_peered":"2024-09-12T00:02:50.063351+0000","last_unstale":"2024-09-12T01:16:02.713433+0000","last_undegraded":"2024-09-12T01:16:02.713433+0000","last_fullsized":"2024-09-12T01:16:02.713433+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'832","last_scrub_stamp":"2024-09-12T01:16:02.713331+0000","last_deep_scrub":"267'832","last_deep_scrub_stamp":"2024-09-12T01:16:02.713331+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.713331+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:01.106721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3851,"num_read_kb":3457,"num_write":1080,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'158","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.711008+0000","last_change":"2024-09-12T01:15:56.711008+0000","last_active":"2024-09-12T01:15:56.711008+0000","last_peered":"2024-09-12T01:15:56.711008+0000","last_clean":"2024-09-12T01:15:56.711008+0000","last_became_active":"2024-09-12T00:02:48.047723+0000","last_became_peered":"2024-09-12T00:02:48.047723+0000","last_unstale":"2024-09-12T01:15:56.711008+0000","last_undegraded":"2024-09-12T01:15:56.711008+0000","last_fullsized":"2024-09-12T01:15:56.711008+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-12T01:15:56.710861+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-12T01:15:56.710861+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.710861+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:41.398940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":26182,"num_write":818,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.127605+0000","last_change":"2024-09-12T01:16:09.127605+0000","last_active":"2024-09-12T01:16:09.127605+0000","last_peered":"2024-09-12T01:16:09.127605+0000","last_clean":"2024-09-12T01:16:09.127605+0000","last_became_active":"2024-09-12T00:02:52.066702+0000","last_became_peered":"2024-09-12T00:02:52.066702+0000","last_unstale":"2024-09-12T01:16:09.127605+0000","last_undegraded":"2024-09-12T01:16:09.127605+0000","last_fullsized":"2024-09-12T01:16:09.127605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:09.127494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:09.127494+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.127494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:35.855938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'201","reported_seq":808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.591460+0000","last_change":"2024-09-12T01:16:16.591460+0000","last_active":"2024-09-12T01:16:16.591460+0000","last_peered":"2024-09-12T01:16:16.591460+0000","last_clean":"2024-09-12T01:16:16.591460+0000","last_became_active":"2024-09-12T00:02:54.066679+0000","last_became_peered":"2024-09-12T00:02:54.066679+0000","last_unstale":"2024-09-12T01:16:16.591460+0000","last_undegraded":"2024-09-12T01:16:16.591460+0000","last_fullsized":"2024-09-12T01:16:16.591460+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:16:16.591267+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:16:16.591267+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.591267+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:25.553404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9932,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":343,"num_write":152,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.556234+0000","last_change":"2024-09-12T01:16:24.556234+0000","last_active":"2024-09-12T01:16:24.556234+0000","last_peered":"2024-09-12T01:16:24.556234+0000","last_clean":"2024-09-12T01:16:24.556234+0000","last_became_active":"2024-09-12T00:02:56.081445+0000","last_became_peered":"2024-09-12T00:02:56.081445+0000","last_unstale":"2024-09-12T01:16:24.556234+0000","last_undegraded":"2024-09-12T01:16:24.556234+0000","last_fullsized":"2024-09-12T01:16:24.556234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.556139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.556139+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.556139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:06.184503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'152","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:33.654991+0000","last_change":"2024-09-12T01:16:33.654927+0000","last_active":"2024-09-12T01:16:33.654991+0000","last_peered":"2024-09-12T01:16:33.654991+0000","last_clean":"2024-09-12T01:16:33.654991+0000","last_became_active":"2024-09-12T00:02:58.096979+0000","last_became_peered":"2024-09-12T00:02:58.096979+0000","last_unstale":"2024-09-12T01:16:33.654991+0000","last_undegraded":"2024-09-12T01:16:33.654991+0000","last_fullsized":"2024-09-12T01:16:33.654991+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:16:33.654838+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:16:33.654838+0000","last_clean_scrub_stamp":"2024-09-12T01:16:33.654838+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:04.524814+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":142,"num_write":377,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'431","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.142244+0000","last_change":"2024-09-12T01:16:06.142244+0000","last_active":"2024-09-12T01:16:06.142244+0000","last_peered":"2024-09-12T01:16:06.142244+0000","last_clean":"2024-09-12T01:16:06.142244+0000","last_became_active":"2024-09-12T00:02:50.065307+0000","last_became_peered":"2024-09-12T00:02:50.065307+0000","last_unstale":"2024-09-12T01:16:06.142244+0000","last_undegraded":"2024-09-12T01:16:06.142244+0000","last_fullsized":"2024-09-12T01:16:06.142244+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'431","last_scrub_stamp":"2024-09-12T01:16:06.142162+0000","last_deep_scrub":"267'431","last_deep_scrub_stamp":"2024-09-12T01:16:06.142162+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.142162+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:57.029036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2299,"num_read_kb":2174,"num_write":505,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'162","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.721269+0000","last_change":"2024-09-12T01:16:02.721269+0000","last_active":"2024-09-12T01:16:02.721269+0000","last_peered":"2024-09-12T01:16:02.721269+0000","last_clean":"2024-09-12T01:16:02.721269+0000","last_became_active":"2024-09-12T00:02:48.048506+0000","last_became_peered":"2024-09-12T00:02:48.048506+0000","last_unstale":"2024-09-12T01:16:02.721269+0000","last_undegraded":"2024-09-12T01:16:02.721269+0000","last_fullsized":"2024-09-12T01:16:02.721269+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-12T01:16:02.721132+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-12T01:16:02.721132+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.721132+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:27.676261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":321,"num_read_kb":61867,"num_write":777,"num_write_kb":44911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:14.589857+0000","last_change":"2024-09-12T01:16:14.589857+0000","last_active":"2024-09-12T01:16:14.589857+0000","last_peered":"2024-09-12T01:16:14.589857+0000","last_clean":"2024-09-12T01:16:14.589857+0000","last_became_active":"2024-09-12T00:02:52.064967+0000","last_became_peered":"2024-09-12T00:02:52.064967+0000","last_unstale":"2024-09-12T01:16:14.589857+0000","last_undegraded":"2024-09-12T01:16:14.589857+0000","last_fullsized":"2024-09-12T01:16:14.589857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:14.589757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:14.589757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:14.589757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:08.739218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'62","reported_seq":587,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.684858+0000","last_change":"2024-09-12T01:16:19.684858+0000","last_active":"2024-09-12T01:16:19.684858+0000","last_peered":"2024-09-12T01:16:19.684858+0000","last_clean":"2024-09-12T01:16:19.684858+0000","last_became_active":"2024-09-12T00:02:54.067255+0000","last_became_peered":"2024-09-12T00:02:54.067255+0000","last_unstale":"2024-09-12T01:16:19.684858+0000","last_undegraded":"2024-09-12T01:16:19.684858+0000","last_fullsized":"2024-09-12T01:16:19.684858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'62","last_scrub_stamp":"2024-09-12T01:16:19.684757+0000","last_deep_scrub":"267'62","last_deep_scrub_stamp":"2024-09-12T01:16:19.684757+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.684757+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:16.708129+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":48,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.885028+0000","last_change":"2024-09-12T01:16:25.885028+0000","last_active":"2024-09-12T01:16:25.885028+0000","last_peered":"2024-09-12T01:16:25.885028+0000","last_clean":"2024-09-12T01:16:25.885028+0000","last_became_active":"2024-09-12T00:02:56.079057+0000","last_became_peered":"2024-09-12T00:02:56.079057+0000","last_unstale":"2024-09-12T01:16:25.885028+0000","last_undegraded":"2024-09-12T01:16:25.885028+0000","last_fullsized":"2024-09-12T01:16:25.885028+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.884902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.884902+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.884902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:53.091760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'187","reported_seq":719,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.610921+0000","last_change":"2024-09-12T01:16:29.610921+0000","last_active":"2024-09-12T01:16:29.610921+0000","last_peered":"2024-09-12T01:16:29.610921+0000","last_clean":"2024-09-12T01:16:29.610921+0000","last_became_active":"2024-09-12T00:02:58.091505+0000","last_became_peered":"2024-09-12T00:02:58.091505+0000","last_unstale":"2024-09-12T01:16:29.610921+0000","last_undegraded":"2024-09-12T01:16:29.610921+0000","last_fullsized":"2024-09-12T01:16:29.610921+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:16:29.610820+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:16:29.610820+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.610820+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:21.995692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":268,"num_read_kb":263,"num_write":396,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'447","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.608031+0000","last_change":"2024-09-12T01:16:06.608031+0000","last_active":"2024-09-12T01:16:06.608031+0000","last_peered":"2024-09-12T01:16:06.608031+0000","last_clean":"2024-09-12T01:16:06.608031+0000","last_became_active":"2024-09-12T00:02:50.068129+0000","last_became_peered":"2024-09-12T00:02:50.068129+0000","last_unstale":"2024-09-12T01:16:06.608031+0000","last_undegraded":"2024-09-12T01:16:06.608031+0000","last_fullsized":"2024-09-12T01:16:06.608031+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-12T01:16:06.607930+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-12T01:16:06.607930+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.607930+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:54.520447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2203,"num_read_kb":2070,"num_write":514,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'206","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.193472+0000","last_change":"2024-09-12T01:15:59.193472+0000","last_active":"2024-09-12T01:15:59.193472+0000","last_peered":"2024-09-12T01:15:59.193472+0000","last_clean":"2024-09-12T01:15:59.193472+0000","last_became_active":"2024-09-12T00:02:48.049791+0000","last_became_peered":"2024-09-12T00:02:48.049791+0000","last_unstale":"2024-09-12T01:15:59.193472+0000","last_undegraded":"2024-09-12T01:15:59.193472+0000","last_fullsized":"2024-09-12T01:15:59.193472+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'206","last_scrub_stamp":"2024-09-12T01:15:59.193369+0000","last_deep_scrub":"267'206","last_deep_scrub_stamp":"2024-09-12T01:15:59.193369+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.193369+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:40.264107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":116478,"num_write":1001,"num_write_kb":35286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.873485+0000","last_change":"2024-09-12T01:16:16.873485+0000","last_active":"2024-09-12T01:16:16.873485+0000","last_peered":"2024-09-12T01:16:16.873485+0000","last_clean":"2024-09-12T01:16:16.873485+0000","last_became_active":"2024-09-12T00:02:52.071502+0000","last_became_peered":"2024-09-12T00:02:52.071502+0000","last_unstale":"2024-09-12T01:16:16.873485+0000","last_undegraded":"2024-09-12T01:16:16.873485+0000","last_fullsized":"2024-09-12T01:16:16.873485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.873383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.873383+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.873383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:10.546043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'208","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:21.605684+0000","last_change":"2024-09-12T01:16:21.605684+0000","last_active":"2024-09-12T01:16:21.605684+0000","last_peered":"2024-09-12T01:16:21.605684+0000","last_clean":"2024-09-12T01:16:21.605684+0000","last_became_active":"2024-09-12T00:02:54.067314+0000","last_became_peered":"2024-09-12T00:02:54.067314+0000","last_unstale":"2024-09-12T01:16:21.605684+0000","last_undegraded":"2024-09-12T01:16:21.605684+0000","last_fullsized":"2024-09-12T01:16:21.605684+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-12T01:16:21.605595+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-12T01:16:21.605595+0000","last_clean_scrub_stamp":"2024-09-12T01:16:21.605595+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.268586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18955,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":272,"num_read_kb":388,"num_write":160,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.477221+0000","last_change":"2024-09-12T01:16:15.477221+0000","last_active":"2024-09-12T01:16:15.477221+0000","last_peered":"2024-09-12T01:16:15.477221+0000","last_clean":"2024-09-12T01:16:15.477221+0000","last_became_active":"2024-09-12T00:02:56.084651+0000","last_became_peered":"2024-09-12T00:02:56.084651+0000","last_unstale":"2024-09-12T01:16:15.477221+0000","last_undegraded":"2024-09-12T01:16:15.477221+0000","last_fullsized":"2024-09-12T01:16:15.477221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.477139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.477139+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.477139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:59.506909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'157","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:34.147570+0000","last_change":"2024-09-12T01:16:34.147570+0000","last_active":"2024-09-12T01:16:34.147570+0000","last_peered":"2024-09-12T01:16:34.147570+0000","last_clean":"2024-09-12T01:16:34.147570+0000","last_became_active":"2024-09-12T00:02:58.099635+0000","last_became_peered":"2024-09-12T00:02:58.099635+0000","last_unstale":"2024-09-12T01:16:34.147570+0000","last_undegraded":"2024-09-12T01:16:34.147570+0000","last_fullsized":"2024-09-12T01:16:34.147570+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T01:16:34.147484+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T01:16:34.147484+0000","last_clean_scrub_stamp":"2024-09-12T01:16:34.147484+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:26.283946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":359,"num_read_kb":309,"num_write":383,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'638","reported_seq":2530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.622238+0000","last_change":"2024-09-12T01:16:07.622238+0000","last_active":"2024-09-12T01:16:07.622238+0000","last_peered":"2024-09-12T01:16:07.622238+0000","last_clean":"2024-09-12T01:16:07.622238+0000","last_became_active":"2024-09-12T00:02:50.068518+0000","last_became_peered":"2024-09-12T00:02:50.068518+0000","last_unstale":"2024-09-12T01:16:07.622238+0000","last_undegraded":"2024-09-12T01:16:07.622238+0000","last_fullsized":"2024-09-12T01:16:07.622238+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'638","last_scrub_stamp":"2024-09-12T01:16:07.622152+0000","last_deep_scrub":"267'638","last_deep_scrub_stamp":"2024-09-12T01:16:07.622152+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.622152+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:11.149565+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3685,"num_read_kb":3433,"num_write":846,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'197","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.883669+0000","last_change":"2024-09-12T01:15:57.883669+0000","last_active":"2024-09-12T01:15:57.883669+0000","last_peered":"2024-09-12T01:15:57.883669+0000","last_clean":"2024-09-12T01:15:57.883669+0000","last_became_active":"2024-09-12T00:02:48.054056+0000","last_became_peered":"2024-09-12T00:02:48.054056+0000","last_unstale":"2024-09-12T01:15:57.883669+0000","last_undegraded":"2024-09-12T01:15:57.883669+0000","last_fullsized":"2024-09-12T01:15:57.883669+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'197","last_scrub_stamp":"2024-09-12T01:15:57.883525+0000","last_deep_scrub":"267'197","last_deep_scrub_stamp":"2024-09-12T01:15:57.883525+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.883525+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.780477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493919,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":69874,"num_write":900,"num_write_kb":25144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.392046+0000","last_change":"2024-09-12T01:16:10.392046+0000","last_active":"2024-09-12T01:16:10.392046+0000","last_peered":"2024-09-12T01:16:10.392046+0000","last_clean":"2024-09-12T01:16:10.392046+0000","last_became_active":"2024-09-12T00:02:52.064441+0000","last_became_peered":"2024-09-12T00:02:52.064441+0000","last_unstale":"2024-09-12T01:16:10.392046+0000","last_undegraded":"2024-09-12T01:16:10.392046+0000","last_fullsized":"2024-09-12T01:16:10.392046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:10.391958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:10.391958+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.391958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:22.111524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'145","reported_seq":736,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:20.891145+0000","last_change":"2024-09-12T01:16:20.891145+0000","last_active":"2024-09-12T01:16:20.891145+0000","last_peered":"2024-09-12T01:16:20.891145+0000","last_clean":"2024-09-12T01:16:20.891145+0000","last_became_active":"2024-09-12T00:02:54.066900+0000","last_became_peered":"2024-09-12T00:02:54.066900+0000","last_unstale":"2024-09-12T01:16:20.891145+0000","last_undegraded":"2024-09-12T01:16:20.891145+0000","last_fullsized":"2024-09-12T01:16:20.891145+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'145","last_scrub_stamp":"2024-09-12T01:16:20.891064+0000","last_deep_scrub":"267'145","last_deep_scrub_stamp":"2024-09-12T01:16:20.891064+0000","last_clean_scrub_stamp":"2024-09-12T01:16:20.891064+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:59.572392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.562956+0000","last_change":"2024-09-12T01:16:23.562956+0000","last_active":"2024-09-12T01:16:23.562956+0000","last_peered":"2024-09-12T01:16:23.562956+0000","last_clean":"2024-09-12T01:16:23.562956+0000","last_became_active":"2024-09-12T00:02:56.084454+0000","last_became_peered":"2024-09-12T00:02:56.084454+0000","last_unstale":"2024-09-12T01:16:23.562956+0000","last_undegraded":"2024-09-12T01:16:23.562956+0000","last_fullsized":"2024-09-12T01:16:23.562956+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:23.562866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:23.562866+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.562866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.666113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'814","reported_seq":2296,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.492864+0000","last_change":"2024-09-12T01:16:06.492864+0000","last_active":"2024-09-12T01:16:06.492864+0000","last_peered":"2024-09-12T01:16:06.492864+0000","last_clean":"2024-09-12T01:16:06.492864+0000","last_became_active":"2024-09-12T00:02:50.072570+0000","last_became_peered":"2024-09-12T00:02:50.072570+0000","last_unstale":"2024-09-12T01:16:06.492864+0000","last_undegraded":"2024-09-12T01:16:06.492864+0000","last_fullsized":"2024-09-12T01:16:06.492864+0000","mapping_epoch":28,"log_start":"267'801","ondisk_log_start":"267'801","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'814","last_scrub_stamp":"2024-09-12T01:16:06.492765+0000","last_deep_scrub":"267'814","last_deep_scrub_stamp":"2024-09-12T01:16:06.492765+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.492765+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":801,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.698227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3795,"num_read_kb":3393,"num_write":1092,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1437,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'152","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.794883+0000","last_change":"2024-09-12T01:15:58.794883+0000","last_active":"2024-09-12T01:15:58.794883+0000","last_peered":"2024-09-12T01:15:58.794883+0000","last_clean":"2024-09-12T01:15:58.794883+0000","last_became_active":"2024-09-12T00:02:48.050025+0000","last_became_peered":"2024-09-12T00:02:48.050025+0000","last_unstale":"2024-09-12T01:15:58.794883+0000","last_undegraded":"2024-09-12T01:15:58.794883+0000","last_fullsized":"2024-09-12T01:15:58.794883+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:15:58.794742+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:15:58.794742+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.794742+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:46.260076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":278,"num_read_kb":9330,"num_write":746,"num_write_kb":34876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.683166+0000","last_change":"2024-09-12T01:16:13.683097+0000","last_active":"2024-09-12T01:16:13.683166+0000","last_peered":"2024-09-12T01:16:13.683166+0000","last_clean":"2024-09-12T01:16:13.683166+0000","last_became_active":"2024-09-12T00:02:52.071201+0000","last_became_peered":"2024-09-12T00:02:52.071201+0000","last_unstale":"2024-09-12T01:16:13.683166+0000","last_undegraded":"2024-09-12T01:16:13.683166+0000","last_fullsized":"2024-09-12T01:16:13.683166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.683003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.683003+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.683003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:16.153780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'230","reported_seq":893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.270920+0000","last_change":"2024-09-12T01:16:17.270920+0000","last_active":"2024-09-12T01:16:17.270920+0000","last_peered":"2024-09-12T01:16:17.270920+0000","last_clean":"2024-09-12T01:16:17.270920+0000","last_became_active":"2024-09-12T00:02:54.073541+0000","last_became_peered":"2024-09-12T00:02:54.073541+0000","last_unstale":"2024-09-12T01:16:17.270920+0000","last_undegraded":"2024-09-12T01:16:17.270920+0000","last_fullsized":"2024-09-12T01:16:17.270920+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-12T01:16:17.270842+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-12T01:16:17.270842+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.270842+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:18.778181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15168,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":358,"num_read_kb":528,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.303594+0000","last_change":"2024-09-12T01:16:28.303594+0000","last_active":"2024-09-12T01:16:28.303594+0000","last_peered":"2024-09-12T01:16:28.303594+0000","last_clean":"2024-09-12T01:16:28.303594+0000","last_became_active":"2024-09-12T00:02:56.084627+0000","last_became_peered":"2024-09-12T00:02:56.084627+0000","last_unstale":"2024-09-12T01:16:28.303594+0000","last_undegraded":"2024-09-12T01:16:28.303594+0000","last_fullsized":"2024-09-12T01:16:28.303594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:28.303500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:28.303500+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.303500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:20.250220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'186","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:31.631872+0000","last_change":"2024-09-12T01:16:31.631872+0000","last_active":"2024-09-12T01:16:31.631872+0000","last_peered":"2024-09-12T01:16:31.631872+0000","last_clean":"2024-09-12T01:16:31.631872+0000","last_became_active":"2024-09-12T00:02:58.089750+0000","last_became_peered":"2024-09-12T00:02:58.089750+0000","last_unstale":"2024-09-12T01:16:31.631872+0000","last_undegraded":"2024-09-12T01:16:31.631872+0000","last_fullsized":"2024-09-12T01:16:31.631872+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-12T01:16:31.631772+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-12T01:16:31.631772+0000","last_clean_scrub_stamp":"2024-09-12T01:16:31.631772+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:29.946650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":234,"num_read_kb":235,"num_write":422,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'480","reported_seq":1938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.730773+0000","last_change":"2024-09-12T01:16:08.730708+0000","last_active":"2024-09-12T01:16:08.730773+0000","last_peered":"2024-09-12T01:16:08.730773+0000","last_clean":"2024-09-12T01:16:08.730773+0000","last_became_active":"2024-09-12T00:02:50.064157+0000","last_became_peered":"2024-09-12T00:02:50.064157+0000","last_unstale":"2024-09-12T01:16:08.730773+0000","last_undegraded":"2024-09-12T01:16:08.730773+0000","last_fullsized":"2024-09-12T01:16:08.730773+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'480","last_scrub_stamp":"2024-09-12T01:16:08.730614+0000","last_deep_scrub":"267'480","last_deep_scrub_stamp":"2024-09-12T01:16:08.730614+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.730614+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:57.895222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2356,"num_read_kb":2183,"num_write":585,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1892,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'252","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.084847+0000","last_change":"2024-09-12T01:15:58.084847+0000","last_active":"2024-09-12T01:15:58.084847+0000","last_peered":"2024-09-12T01:15:58.084847+0000","last_clean":"2024-09-12T01:15:58.084847+0000","last_became_active":"2024-09-12T00:02:48.053055+0000","last_became_peered":"2024-09-12T00:02:48.053055+0000","last_unstale":"2024-09-12T01:15:58.084847+0000","last_undegraded":"2024-09-12T01:15:58.084847+0000","last_fullsized":"2024-09-12T01:15:58.084847+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'252","last_scrub_stamp":"2024-09-12T01:15:58.084728+0000","last_deep_scrub":"267'252","last_deep_scrub_stamp":"2024-09-12T01:15:58.084728+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.084728+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:42.507269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":662,"num_read_kb":2689,"num_write":1334,"num_write_kb":25481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.423609+0000","last_change":"2024-09-12T01:16:11.423609+0000","last_active":"2024-09-12T01:16:11.423609+0000","last_peered":"2024-09-12T01:16:11.423609+0000","last_clean":"2024-09-12T01:16:11.423609+0000","last_became_active":"2024-09-12T00:02:52.060034+0000","last_became_peered":"2024-09-12T00:02:52.060034+0000","last_unstale":"2024-09-12T01:16:11.423609+0000","last_undegraded":"2024-09-12T01:16:11.423609+0000","last_fullsized":"2024-09-12T01:16:11.423609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:11.423519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:11.423519+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.423519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:10.571986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'205","reported_seq":818,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:23.878921+0000","last_change":"2024-09-12T01:16:23.878921+0000","last_active":"2024-09-12T01:16:23.878921+0000","last_peered":"2024-09-12T01:16:23.878921+0000","last_clean":"2024-09-12T01:16:23.878921+0000","last_became_active":"2024-09-12T00:02:54.066854+0000","last_became_peered":"2024-09-12T00:02:54.066854+0000","last_unstale":"2024-09-12T01:16:23.878921+0000","last_undegraded":"2024-09-12T01:16:23.878921+0000","last_fullsized":"2024-09-12T01:16:23.878921+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'205","last_scrub_stamp":"2024-09-12T01:16:23.878805+0000","last_deep_scrub":"267'205","last_deep_scrub_stamp":"2024-09-12T01:16:23.878805+0000","last_clean_scrub_stamp":"2024-09-12T01:16:23.878805+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:02.656337+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":290,"num_read_kb":407,"num_write":194,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.314619+0000","last_change":"2024-09-12T01:16:18.314619+0000","last_active":"2024-09-12T01:16:18.314619+0000","last_peered":"2024-09-12T01:16:18.314619+0000","last_clean":"2024-09-12T01:16:18.314619+0000","last_became_active":"2024-09-12T00:02:56.086349+0000","last_became_peered":"2024-09-12T00:02:56.086349+0000","last_unstale":"2024-09-12T01:16:18.314619+0000","last_undegraded":"2024-09-12T01:16:18.314619+0000","last_fullsized":"2024-09-12T01:16:18.314619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.314499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.314499+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.314499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:29.781773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'176","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.366518+0000","last_change":"2024-09-12T01:16:19.366518+0000","last_active":"2024-09-12T01:16:19.366518+0000","last_peered":"2024-09-12T01:16:19.366518+0000","last_clean":"2024-09-12T01:16:19.366518+0000","last_became_active":"2024-09-12T00:02:58.100646+0000","last_became_peered":"2024-09-12T00:02:58.100646+0000","last_unstale":"2024-09-12T01:16:19.366518+0000","last_undegraded":"2024-09-12T01:16:19.366518+0000","last_fullsized":"2024-09-12T01:16:19.366518+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'176","last_scrub_stamp":"2024-09-12T01:16:19.366420+0000","last_deep_scrub":"267'176","last_deep_scrub_stamp":"2024-09-12T01:16:19.366420+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.366420+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:32.801190+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":591,"num_write":465,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'697","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:10.619187+0000","last_change":"2024-09-12T01:16:10.619187+0000","last_active":"2024-09-12T01:16:10.619187+0000","last_peered":"2024-09-12T01:16:10.619187+0000","last_clean":"2024-09-12T01:16:10.619187+0000","last_became_active":"2024-09-12T00:02:50.072665+0000","last_became_peered":"2024-09-12T00:02:50.072665+0000","last_unstale":"2024-09-12T01:16:10.619187+0000","last_undegraded":"2024-09-12T01:16:10.619187+0000","last_fullsized":"2024-09-12T01:16:10.619187+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'697","last_scrub_stamp":"2024-09-12T01:16:10.619098+0000","last_deep_scrub":"267'697","last_deep_scrub_stamp":"2024-09-12T01:16:10.619098+0000","last_clean_scrub_stamp":"2024-09-12T01:16:10.619098+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:07.282926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3202,"num_read_kb":2877,"num_write":917,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'241","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.110405+0000","last_change":"2024-09-12T01:15:56.110405+0000","last_active":"2024-09-12T01:15:56.110405+0000","last_peered":"2024-09-12T01:15:56.110405+0000","last_clean":"2024-09-12T01:15:56.110405+0000","last_became_active":"2024-09-12T00:03:21.140095+0000","last_became_peered":"2024-09-12T00:03:21.140095+0000","last_unstale":"2024-09-12T01:15:56.110405+0000","last_undegraded":"2024-09-12T01:15:56.110405+0000","last_fullsized":"2024-09-12T01:15:56.110405+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-12T01:15:56.110316+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-12T01:15:56.110316+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.110316+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:39.287721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":39289,"num_write":1009,"num_write_kb":58524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.903046+0000","last_change":"2024-09-12T01:16:16.903046+0000","last_active":"2024-09-12T01:16:16.903046+0000","last_peered":"2024-09-12T01:16:16.903046+0000","last_clean":"2024-09-12T01:16:16.903046+0000","last_became_active":"2024-09-12T00:02:52.063334+0000","last_became_peered":"2024-09-12T00:02:52.063334+0000","last_unstale":"2024-09-12T01:16:16.903046+0000","last_undegraded":"2024-09-12T01:16:16.903046+0000","last_fullsized":"2024-09-12T01:16:16.903046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.902950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.902950+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.902950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:50.260846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'178","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.600551+0000","last_change":"2024-09-12T01:16:18.600551+0000","last_active":"2024-09-12T01:16:18.600551+0000","last_peered":"2024-09-12T01:16:18.600551+0000","last_clean":"2024-09-12T01:16:18.600551+0000","last_became_active":"2024-09-12T00:02:54.240007+0000","last_became_peered":"2024-09-12T00:02:54.240007+0000","last_unstale":"2024-09-12T01:16:18.600551+0000","last_undegraded":"2024-09-12T01:16:18.600551+0000","last_fullsized":"2024-09-12T01:16:18.600551+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'178","last_scrub_stamp":"2024-09-12T01:16:18.600451+0000","last_deep_scrub":"267'178","last_deep_scrub_stamp":"2024-09-12T01:16:18.600451+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.600451+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:24.259892+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8640,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":288,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:19.309303+0000","last_change":"2024-09-12T01:16:19.309231+0000","last_active":"2024-09-12T01:16:19.309303+0000","last_peered":"2024-09-12T01:16:19.309303+0000","last_clean":"2024-09-12T01:16:19.309303+0000","last_became_active":"2024-09-12T00:02:56.087317+0000","last_became_peered":"2024-09-12T00:02:56.087317+0000","last_unstale":"2024-09-12T01:16:19.309303+0000","last_undegraded":"2024-09-12T01:16:19.309303+0000","last_fullsized":"2024-09-12T01:16:19.309303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:19.309148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:19.309148+0000","last_clean_scrub_stamp":"2024-09-12T01:16:19.309148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:20.598859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'151","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.214600+0000","last_change":"2024-09-12T01:16:32.214600+0000","last_active":"2024-09-12T01:16:32.214600+0000","last_peered":"2024-09-12T01:16:32.214600+0000","last_clean":"2024-09-12T01:16:32.214600+0000","last_became_active":"2024-09-12T00:02:58.099712+0000","last_became_peered":"2024-09-12T00:02:58.099712+0000","last_unstale":"2024-09-12T01:16:32.214600+0000","last_undegraded":"2024-09-12T01:16:32.214600+0000","last_fullsized":"2024-09-12T01:16:32.214600+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-12T01:16:32.214514+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-12T01:16:32.214514+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.214514+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.161826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'710","reported_seq":2420,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.262576+0000","last_change":"2024-09-12T01:16:02.262576+0000","last_active":"2024-09-12T01:16:02.262576+0000","last_peered":"2024-09-12T01:16:02.262576+0000","last_clean":"2024-09-12T01:16:02.262576+0000","last_became_active":"2024-09-12T00:02:50.061909+0000","last_became_peered":"2024-09-12T00:02:50.061909+0000","last_unstale":"2024-09-12T01:16:02.262576+0000","last_undegraded":"2024-09-12T01:16:02.262576+0000","last_fullsized":"2024-09-12T01:16:02.262576+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'710","last_scrub_stamp":"2024-09-12T01:16:02.262485+0000","last_deep_scrub":"267'710","last_deep_scrub_stamp":"2024-09-12T01:16:02.262485+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.262485+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":600,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:26.931797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3690,"num_read_kb":3334,"num_write":961,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1922,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'201","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:56.918024+0000","last_change":"2024-09-12T01:15:56.918024+0000","last_active":"2024-09-12T01:15:56.918024+0000","last_peered":"2024-09-12T01:15:56.918024+0000","last_clean":"2024-09-12T01:15:56.918024+0000","last_became_active":"2024-09-12T00:02:48.050894+0000","last_became_peered":"2024-09-12T00:02:48.050894+0000","last_unstale":"2024-09-12T01:15:56.918024+0000","last_undegraded":"2024-09-12T01:15:56.918024+0000","last_fullsized":"2024-09-12T01:15:56.918024+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T01:15:56.917926+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T01:15:56.917926+0000","last_clean_scrub_stamp":"2024-09-12T01:15:56.917926+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:57.174009+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409979,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":20890,"num_write":1012,"num_write_kb":39832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.203493+0000","last_change":"2024-09-12T01:16:13.203493+0000","last_active":"2024-09-12T01:16:13.203493+0000","last_peered":"2024-09-12T01:16:13.203493+0000","last_clean":"2024-09-12T01:16:13.203493+0000","last_became_active":"2024-09-12T00:02:52.064125+0000","last_became_peered":"2024-09-12T00:02:52.064125+0000","last_unstale":"2024-09-12T01:16:13.203493+0000","last_undegraded":"2024-09-12T01:16:13.203493+0000","last_fullsized":"2024-09-12T01:16:13.203493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:13.203371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:13.203371+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.203371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:07.040646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'118","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.966515+0000","last_change":"2024-09-12T01:16:22.966454+0000","last_active":"2024-09-12T01:16:22.966515+0000","last_peered":"2024-09-12T01:16:22.966515+0000","last_clean":"2024-09-12T01:16:22.966515+0000","last_became_active":"2024-09-12T00:02:54.239412+0000","last_became_peered":"2024-09-12T00:02:54.239412+0000","last_unstale":"2024-09-12T01:16:22.966515+0000","last_undegraded":"2024-09-12T01:16:22.966515+0000","last_fullsized":"2024-09-12T01:16:22.966515+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'118","last_scrub_stamp":"2024-09-12T01:16:22.966358+0000","last_deep_scrub":"267'118","last_deep_scrub_stamp":"2024-09-12T01:16:22.966358+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.966358+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:38.921115+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'772","reported_seq":2654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:17.441107+0000","last_change":"2024-09-12T01:16:17.441107+0000","last_active":"2024-09-12T01:16:17.441107+0000","last_peered":"2024-09-12T01:16:17.441107+0000","last_clean":"2024-09-12T01:16:17.441107+0000","last_became_active":"2024-09-12T00:02:56.080374+0000","last_became_peered":"2024-09-12T00:02:56.080374+0000","last_unstale":"2024-09-12T01:16:17.441107+0000","last_undegraded":"2024-09-12T01:16:17.441107+0000","last_fullsized":"2024-09-12T01:16:17.441107+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'772","last_scrub_stamp":"2024-09-12T01:16:17.441017+0000","last_deep_scrub":"267'772","last_deep_scrub_stamp":"2024-09-12T01:16:17.441017+0000","last_clean_scrub_stamp":"2024-09-12T01:16:17.441017+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:39.610983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'117","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.798101+0000","last_change":"2024-09-12T01:16:28.798101+0000","last_active":"2024-09-12T01:16:28.798101+0000","last_peered":"2024-09-12T01:16:28.798101+0000","last_clean":"2024-09-12T01:16:28.798101+0000","last_became_active":"2024-09-12T00:02:58.100777+0000","last_became_peered":"2024-09-12T00:02:58.100777+0000","last_unstale":"2024-09-12T01:16:28.798101+0000","last_undegraded":"2024-09-12T01:16:28.798101+0000","last_fullsized":"2024-09-12T01:16:28.798101+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-12T01:16:28.798015+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-12T01:16:28.798015+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.798015+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:32.708838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":120,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'476","reported_seq":2046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.851836+0000","last_change":"2024-09-12T01:16:06.851836+0000","last_active":"2024-09-12T01:16:06.851836+0000","last_peered":"2024-09-12T01:16:06.851836+0000","last_clean":"2024-09-12T01:16:06.851836+0000","last_became_active":"2024-09-12T00:02:50.070186+0000","last_became_peered":"2024-09-12T00:02:50.070186+0000","last_unstale":"2024-09-12T01:16:06.851836+0000","last_undegraded":"2024-09-12T01:16:06.851836+0000","last_fullsized":"2024-09-12T01:16:06.851836+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'476","last_scrub_stamp":"2024-09-12T01:16:06.851723+0000","last_deep_scrub":"267'476","last_deep_scrub_stamp":"2024-09-12T01:16:06.851723+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.851723+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:58.941621+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2560,"num_read_kb":2381,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'280","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.159485+0000","last_change":"2024-09-12T01:16:01.159485+0000","last_active":"2024-09-12T01:16:01.159485+0000","last_peered":"2024-09-12T01:16:01.159485+0000","last_clean":"2024-09-12T01:16:01.159485+0000","last_became_active":"2024-09-12T00:02:48.054303+0000","last_became_peered":"2024-09-12T00:02:48.054303+0000","last_unstale":"2024-09-12T01:16:01.159485+0000","last_undegraded":"2024-09-12T01:16:01.159485+0000","last_fullsized":"2024-09-12T01:16:01.159485+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'280","last_scrub_stamp":"2024-09-12T01:16:01.159368+0000","last_deep_scrub":"267'280","last_deep_scrub_stamp":"2024-09-12T01:16:01.159368+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.159368+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:04.113014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":47582,"num_write":1191,"num_write_kb":28572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:18.873818+0000","last_change":"2024-09-12T01:16:18.873818+0000","last_active":"2024-09-12T01:16:18.873818+0000","last_peered":"2024-09-12T01:16:18.873818+0000","last_clean":"2024-09-12T01:16:18.873818+0000","last_became_active":"2024-09-12T00:02:52.071580+0000","last_became_peered":"2024-09-12T00:02:52.071580+0000","last_unstale":"2024-09-12T01:16:18.873818+0000","last_undegraded":"2024-09-12T01:16:18.873818+0000","last_fullsized":"2024-09-12T01:16:18.873818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:18.873734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:18.873734+0000","last_clean_scrub_stamp":"2024-09-12T01:16:18.873734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:59.300868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'240","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:26.283472+0000","last_change":"2024-09-12T01:16:26.283472+0000","last_active":"2024-09-12T01:16:26.283472+0000","last_peered":"2024-09-12T01:16:26.283472+0000","last_clean":"2024-09-12T01:16:26.283472+0000","last_became_active":"2024-09-12T00:02:54.068806+0000","last_became_peered":"2024-09-12T00:02:54.068806+0000","last_unstale":"2024-09-12T01:16:26.283472+0000","last_undegraded":"2024-09-12T01:16:26.283472+0000","last_fullsized":"2024-09-12T01:16:26.283472+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-12T01:16:26.283363+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-12T01:16:26.283363+0000","last_clean_scrub_stamp":"2024-09-12T01:16:26.283363+0000","objects_scrubbed":11,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:44.646018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9605,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":355,"num_write":182,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:24.608463+0000","last_change":"2024-09-12T01:16:24.608463+0000","last_active":"2024-09-12T01:16:24.608463+0000","last_peered":"2024-09-12T01:16:24.608463+0000","last_clean":"2024-09-12T01:16:24.608463+0000","last_became_active":"2024-09-12T00:02:56.082924+0000","last_became_peered":"2024-09-12T00:02:56.082924+0000","last_unstale":"2024-09-12T01:16:24.608463+0000","last_undegraded":"2024-09-12T01:16:24.608463+0000","last_fullsized":"2024-09-12T01:16:24.608463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:24.608368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:24.608368+0000","last_clean_scrub_stamp":"2024-09-12T01:16:24.608368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:33.741139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'111","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:29.807213+0000","last_change":"2024-09-12T01:16:29.807213+0000","last_active":"2024-09-12T01:16:29.807213+0000","last_peered":"2024-09-12T01:16:29.807213+0000","last_clean":"2024-09-12T01:16:29.807213+0000","last_became_active":"2024-09-12T00:02:58.099683+0000","last_became_peered":"2024-09-12T00:02:58.099683+0000","last_unstale":"2024-09-12T01:16:29.807213+0000","last_undegraded":"2024-09-12T01:16:29.807213+0000","last_fullsized":"2024-09-12T01:16:29.807213+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-12T01:16:29.807131+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-12T01:16:29.807131+0000","last_clean_scrub_stamp":"2024-09-12T01:16:29.807131+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:24.107285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":199,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'542","reported_seq":2277,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.811930+0000","last_change":"2024-09-12T01:16:05.811930+0000","last_active":"2024-09-12T01:16:05.811930+0000","last_peered":"2024-09-12T01:16:05.811930+0000","last_clean":"2024-09-12T01:16:05.811930+0000","last_became_active":"2024-09-12T00:02:50.069907+0000","last_became_peered":"2024-09-12T00:02:50.069907+0000","last_unstale":"2024-09-12T01:16:05.811930+0000","last_undegraded":"2024-09-12T01:16:05.811930+0000","last_fullsized":"2024-09-12T01:16:05.811930+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'542","last_scrub_stamp":"2024-09-12T01:16:05.811845+0000","last_deep_scrub":"267'542","last_deep_scrub_stamp":"2024-09-12T01:16:05.811845+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.811845+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:24.596886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2946,"num_read_kb":2752,"num_write":643,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2534,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'210","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.207922+0000","last_change":"2024-09-12T01:16:02.207922+0000","last_active":"2024-09-12T01:16:02.207922+0000","last_peered":"2024-09-12T01:16:02.207922+0000","last_clean":"2024-09-12T01:16:02.207922+0000","last_became_active":"2024-09-12T00:02:48.052303+0000","last_became_peered":"2024-09-12T00:02:48.052303+0000","last_unstale":"2024-09-12T01:16:02.207922+0000","last_undegraded":"2024-09-12T01:16:02.207922+0000","last_fullsized":"2024-09-12T01:16:02.207922+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T01:16:02.207773+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T01:16:02.207773+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.207773+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:42.794663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":51729,"num_write":985,"num_write_kb":45446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.309309+0000","last_change":"2024-09-12T01:16:22.309309+0000","last_active":"2024-09-12T01:16:22.309309+0000","last_peered":"2024-09-12T01:16:22.309309+0000","last_clean":"2024-09-12T01:16:22.309309+0000","last_became_active":"2024-09-12T00:02:52.065653+0000","last_became_peered":"2024-09-12T00:02:52.065653+0000","last_unstale":"2024-09-12T01:16:22.309309+0000","last_undegraded":"2024-09-12T01:16:22.309309+0000","last_fullsized":"2024-09-12T01:16:22.309309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:22.309220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:22.309220+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.309220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:12.264453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'156","reported_seq":755,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.658573+0000","last_change":"2024-09-12T01:16:16.658573+0000","last_active":"2024-09-12T01:16:16.658573+0000","last_peered":"2024-09-12T01:16:16.658573+0000","last_clean":"2024-09-12T01:16:16.658573+0000","last_became_active":"2024-09-12T00:02:54.073930+0000","last_became_peered":"2024-09-12T00:02:54.073930+0000","last_unstale":"2024-09-12T01:16:16.658573+0000","last_undegraded":"2024-09-12T01:16:16.658573+0000","last_fullsized":"2024-09-12T01:16:16.658573+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-12T01:16:16.658478+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-12T01:16:16.658478+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.658478+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:59.460201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4988,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":267,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:16.429953+0000","last_change":"2024-09-12T01:16:16.429953+0000","last_active":"2024-09-12T01:16:16.429953+0000","last_peered":"2024-09-12T01:16:16.429953+0000","last_clean":"2024-09-12T01:16:16.429953+0000","last_became_active":"2024-09-12T00:02:56.078528+0000","last_became_peered":"2024-09-12T00:02:56.078528+0000","last_unstale":"2024-09-12T01:16:16.429953+0000","last_undegraded":"2024-09-12T01:16:16.429953+0000","last_fullsized":"2024-09-12T01:16:16.429953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:16.429865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:16.429865+0000","last_clean_scrub_stamp":"2024-09-12T01:16:16.429865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:38.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'100","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:32.619012+0000","last_change":"2024-09-12T01:16:32.619012+0000","last_active":"2024-09-12T01:16:32.619012+0000","last_peered":"2024-09-12T01:16:32.619012+0000","last_clean":"2024-09-12T01:16:32.619012+0000","last_became_active":"2024-09-12T00:02:58.087199+0000","last_became_peered":"2024-09-12T00:02:58.087199+0000","last_unstale":"2024-09-12T01:16:32.619012+0000","last_undegraded":"2024-09-12T01:16:32.619012+0000","last_fullsized":"2024-09-12T01:16:32.619012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'100","last_scrub_stamp":"2024-09-12T01:16:32.618924+0000","last_deep_scrub":"267'100","last_deep_scrub_stamp":"2024-09-12T01:16:32.618924+0000","last_clean_scrub_stamp":"2024-09-12T01:16:32.618924+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:51.132932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":246,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'470","reported_seq":2094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.613518+0000","last_change":"2024-09-12T01:16:08.613518+0000","last_active":"2024-09-12T01:16:08.613518+0000","last_peered":"2024-09-12T01:16:08.613518+0000","last_clean":"2024-09-12T01:16:08.613518+0000","last_became_active":"2024-09-12T00:02:50.072920+0000","last_became_peered":"2024-09-12T00:02:50.072920+0000","last_unstale":"2024-09-12T01:16:08.613518+0000","last_undegraded":"2024-09-12T01:16:08.613518+0000","last_fullsized":"2024-09-12T01:16:08.613518+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'470","last_scrub_stamp":"2024-09-12T01:16:08.613412+0000","last_deep_scrub":"267'470","last_deep_scrub_stamp":"2024-09-12T01:16:08.613412+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.613412+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:17.773006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2371,"num_write":566,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'212","reported_seq":881,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.772498+0000","last_change":"2024-09-12T01:15:59.772435+0000","last_active":"2024-09-12T01:15:59.772498+0000","last_peered":"2024-09-12T01:15:59.772498+0000","last_clean":"2024-09-12T01:15:59.772498+0000","last_became_active":"2024-09-12T00:02:48.048308+0000","last_became_peered":"2024-09-12T00:02:48.048308+0000","last_unstale":"2024-09-12T01:15:59.772498+0000","last_undegraded":"2024-09-12T01:15:59.772498+0000","last_fullsized":"2024-09-12T01:15:59.772498+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-12T01:15:59.772317+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-12T01:15:59.772317+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.772317+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:08.055567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":37398,"num_write":997,"num_write_kb":57972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.947366+0000","last_change":"2024-09-12T01:16:15.947366+0000","last_active":"2024-09-12T01:16:15.947366+0000","last_peered":"2024-09-12T01:16:15.947366+0000","last_clean":"2024-09-12T01:16:15.947366+0000","last_became_active":"2024-09-12T00:02:52.060283+0000","last_became_peered":"2024-09-12T00:02:52.060283+0000","last_unstale":"2024-09-12T01:16:15.947366+0000","last_undegraded":"2024-09-12T01:16:15.947366+0000","last_fullsized":"2024-09-12T01:16:15.947366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:15.947271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:15.947271+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.947271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:50.354609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'129","reported_seq":711,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.553123+0000","last_change":"2024-09-12T01:16:25.553123+0000","last_active":"2024-09-12T01:16:25.553123+0000","last_peered":"2024-09-12T01:16:25.553123+0000","last_clean":"2024-09-12T01:16:25.553123+0000","last_became_active":"2024-09-12T00:02:54.067770+0000","last_became_peered":"2024-09-12T00:02:54.067770+0000","last_unstale":"2024-09-12T01:16:25.553123+0000","last_undegraded":"2024-09-12T01:16:25.553123+0000","last_fullsized":"2024-09-12T01:16:25.553123+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-12T01:16:25.553018+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-12T01:16:25.553018+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.553018+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:22.835758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4641,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":72,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.958170+0000","last_change":"2024-09-12T01:16:25.958170+0000","last_active":"2024-09-12T01:16:25.958170+0000","last_peered":"2024-09-12T01:16:25.958170+0000","last_clean":"2024-09-12T01:16:25.958170+0000","last_became_active":"2024-09-12T00:02:56.077573+0000","last_became_peered":"2024-09-12T00:02:56.077573+0000","last_unstale":"2024-09-12T01:16:25.958170+0000","last_undegraded":"2024-09-12T01:16:25.958170+0000","last_fullsized":"2024-09-12T01:16:25.958170+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.958065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.958065+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.958065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:05.572857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'152","reported_seq":1261,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:30.845895+0000","last_change":"2024-09-12T01:16:30.845895+0000","last_active":"2024-09-12T01:16:30.845895+0000","last_peered":"2024-09-12T01:16:30.845895+0000","last_clean":"2024-09-12T01:16:30.845895+0000","last_became_active":"2024-09-12T00:02:58.099426+0000","last_became_peered":"2024-09-12T00:02:58.099426+0000","last_unstale":"2024-09-12T01:16:30.845895+0000","last_undegraded":"2024-09-12T01:16:30.845895+0000","last_fullsized":"2024-09-12T01:16:30.845895+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'152","last_scrub_stamp":"2024-09-12T01:16:30.845804+0000","last_deep_scrub":"267'152","last_deep_scrub_stamp":"2024-09-12T01:16:30.845804+0000","last_clean_scrub_stamp":"2024-09-12T01:16:30.845804+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:58.749136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":755,"num_read_kb":754,"num_write":338,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'471","reported_seq":1967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.778780+0000","last_change":"2024-09-12T01:16:04.778780+0000","last_active":"2024-09-12T01:16:04.778780+0000","last_peered":"2024-09-12T01:16:04.778780+0000","last_clean":"2024-09-12T01:16:04.778780+0000","last_became_active":"2024-09-12T00:02:50.063959+0000","last_became_peered":"2024-09-12T00:02:50.063959+0000","last_unstale":"2024-09-12T01:16:04.778780+0000","last_undegraded":"2024-09-12T01:16:04.778780+0000","last_fullsized":"2024-09-12T01:16:04.778780+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'471","last_scrub_stamp":"2024-09-12T01:16:04.778701+0000","last_deep_scrub":"267'471","last_deep_scrub_stamp":"2024-09-12T01:16:04.778701+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.778701+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:30.342027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2471,"num_read_kb":2277,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":708,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'193","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.857061+0000","last_change":"2024-09-12T01:15:58.857061+0000","last_active":"2024-09-12T01:15:58.857061+0000","last_peered":"2024-09-12T01:15:58.857061+0000","last_clean":"2024-09-12T01:15:58.857061+0000","last_became_active":"2024-09-12T00:02:48.054650+0000","last_became_peered":"2024-09-12T00:02:48.054650+0000","last_unstale":"2024-09-12T01:15:58.857061+0000","last_undegraded":"2024-09-12T01:15:58.857061+0000","last_fullsized":"2024-09-12T01:15:58.857061+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:15:58.856935+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:15:58.856935+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.856935+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:00.850043+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250177,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":59687,"num_write":954,"num_write_kb":41766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'6","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.157400+0000","last_change":"2024-09-12T01:16:11.157400+0000","last_active":"2024-09-12T01:16:11.157400+0000","last_peered":"2024-09-12T01:16:11.157400+0000","last_clean":"2024-09-12T01:16:11.157400+0000","last_became_active":"2024-09-12T00:02:52.065804+0000","last_became_peered":"2024-09-12T00:02:52.065804+0000","last_unstale":"2024-09-12T01:16:11.157400+0000","last_undegraded":"2024-09-12T01:16:11.157400+0000","last_fullsized":"2024-09-12T01:16:11.157400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T01:16:11.157309+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T01:16:11.157309+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.157309+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.232298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'187","reported_seq":809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.015357+0000","last_change":"2024-09-12T01:16:22.015357+0000","last_active":"2024-09-12T01:16:22.015357+0000","last_peered":"2024-09-12T01:16:22.015357+0000","last_clean":"2024-09-12T01:16:22.015357+0000","last_became_active":"2024-09-12T00:02:54.066918+0000","last_became_peered":"2024-09-12T00:02:54.066918+0000","last_unstale":"2024-09-12T01:16:22.015357+0000","last_undegraded":"2024-09-12T01:16:22.015357+0000","last_fullsized":"2024-09-12T01:16:22.015357+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:16:22.015263+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:16:22.015263+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.015263+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:07.799810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":266,"num_write":140,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:25.606996+0000","last_change":"2024-09-12T01:16:25.606996+0000","last_active":"2024-09-12T01:16:25.606996+0000","last_peered":"2024-09-12T01:16:25.606996+0000","last_clean":"2024-09-12T01:16:25.606996+0000","last_became_active":"2024-09-12T00:02:56.084768+0000","last_became_peered":"2024-09-12T00:02:56.084768+0000","last_unstale":"2024-09-12T01:16:25.606996+0000","last_undegraded":"2024-09-12T01:16:25.606996+0000","last_fullsized":"2024-09-12T01:16:25.606996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:16:25.606905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:16:25.606905+0000","last_clean_scrub_stamp":"2024-09-12T01:16:25.606905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:39.095761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'157","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:28.961917+0000","last_change":"2024-09-12T01:16:28.961917+0000","last_active":"2024-09-12T01:16:28.961917+0000","last_peered":"2024-09-12T01:16:28.961917+0000","last_clean":"2024-09-12T01:16:28.961917+0000","last_became_active":"2024-09-12T00:02:58.097725+0000","last_became_peered":"2024-09-12T00:02:58.097725+0000","last_unstale":"2024-09-12T01:16:28.961917+0000","last_undegraded":"2024-09-12T01:16:28.961917+0000","last_fullsized":"2024-09-12T01:16:28.961917+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T01:16:28.961825+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T01:16:28.961825+0000","last_clean_scrub_stamp":"2024-09-12T01:16:28.961825+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:36.526169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":109,"num_write":343,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'692","reported_seq":2204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.205253+0000","last_change":"2024-09-12T01:16:12.205191+0000","last_active":"2024-09-12T01:16:12.205253+0000","last_peered":"2024-09-12T01:16:12.205253+0000","last_clean":"2024-09-12T01:16:12.205253+0000","last_became_active":"2024-09-12T00:02:50.064354+0000","last_became_peered":"2024-09-12T00:02:50.064354+0000","last_unstale":"2024-09-12T01:16:12.205253+0000","last_undegraded":"2024-09-12T01:16:12.205253+0000","last_fullsized":"2024-09-12T01:16:12.205253+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'692","last_scrub_stamp":"2024-09-12T01:16:12.205104+0000","last_deep_scrub":"267'692","last_deep_scrub_stamp":"2024-09-12T01:16:12.205104+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.205104+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:42.512342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3412,"num_read_kb":3118,"num_write":870,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'187","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.538591+0000","last_change":"2024-09-12T01:15:59.538591+0000","last_active":"2024-09-12T01:15:59.538591+0000","last_peered":"2024-09-12T01:15:59.538591+0000","last_clean":"2024-09-12T01:15:59.538591+0000","last_became_active":"2024-09-12T00:02:48.049242+0000","last_became_peered":"2024-09-12T00:02:48.049242+0000","last_unstale":"2024-09-12T01:15:59.538591+0000","last_undegraded":"2024-09-12T01:15:59.538591+0000","last_fullsized":"2024-09-12T01:15:59.538591+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-12T01:15:59.538483+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-12T01:15:59.538483+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.538483+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:48.772077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":424,"num_read_kb":39372,"num_write":875,"num_write_kb":46728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'352","reported_seq":1698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.151473+0000","last_change":"2024-09-12T01:16:08.151351+0000","last_active":"2024-09-12T01:16:08.151473+0000","last_peered":"2024-09-12T01:16:08.151473+0000","last_clean":"2024-09-12T01:16:08.151473+0000","last_became_active":"2024-09-12T00:02:50.065060+0000","last_became_peered":"2024-09-12T00:02:50.065060+0000","last_unstale":"2024-09-12T01:16:08.151473+0000","last_undegraded":"2024-09-12T01:16:08.151473+0000","last_fullsized":"2024-09-12T01:16:08.151473+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-09-12T01:16:08.151246+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-09-12T01:16:08.151246+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.151246+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:32.866300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1806,"num_read_kb":1710,"num_write":413,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'203","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:55.099431+0000","last_change":"2024-09-12T01:15:55.099431+0000","last_active":"2024-09-12T01:15:55.099431+0000","last_peered":"2024-09-12T01:15:55.099431+0000","last_clean":"2024-09-12T01:15:55.099431+0000","last_became_active":"2024-09-12T00:02:48.041842+0000","last_became_peered":"2024-09-12T00:02:48.041842+0000","last_unstale":"2024-09-12T01:15:55.099431+0000","last_undegraded":"2024-09-12T01:15:55.099431+0000","last_fullsized":"2024-09-12T01:15:55.099431+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'203","last_scrub_stamp":"2024-09-12T01:15:55.099312+0000","last_deep_scrub":"267'203","last_deep_scrub_stamp":"2024-09-12T01:15:55.099312+0000","last_clean_scrub_stamp":"2024-09-12T01:15:55.099312+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:35.347299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":447,"num_read_kb":13124,"num_write":1044,"num_write_kb":38354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'458","reported_seq":2075,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:13.265565+0000","last_change":"2024-09-12T01:16:13.265508+0000","last_active":"2024-09-12T01:16:13.265565+0000","last_peered":"2024-09-12T01:16:13.265565+0000","last_clean":"2024-09-12T01:16:13.265565+0000","last_became_active":"2024-09-12T00:02:50.066341+0000","last_became_peered":"2024-09-12T00:02:50.066341+0000","last_unstale":"2024-09-12T01:16:13.265565+0000","last_undegraded":"2024-09-12T01:16:13.265565+0000","last_fullsized":"2024-09-12T01:16:13.265565+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'458","last_scrub_stamp":"2024-09-12T01:16:13.265421+0000","last_deep_scrub":"267'458","last_deep_scrub_stamp":"2024-09-12T01:16:13.265421+0000","last_clean_scrub_stamp":"2024-09-12T01:16:13.265421+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:02.745745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2383,"num_read_kb":2262,"num_write":523,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'185","reported_seq":819,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:03.199885+0000","last_change":"2024-09-12T01:16:03.199885+0000","last_active":"2024-09-12T01:16:03.199885+0000","last_peered":"2024-09-12T01:16:03.199885+0000","last_clean":"2024-09-12T01:16:03.199885+0000","last_became_active":"2024-09-12T00:02:48.052205+0000","last_became_peered":"2024-09-12T00:02:48.052205+0000","last_unstale":"2024-09-12T01:16:03.199885+0000","last_undegraded":"2024-09-12T01:16:03.199885+0000","last_fullsized":"2024-09-12T01:16:03.199885+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:16:03.199736+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:16:03.199736+0000","last_clean_scrub_stamp":"2024-09-12T01:16:03.199736+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:22.555181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":389,"num_read_kb":19493,"num_write":855,"num_write_kb":24928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'368","reported_seq":1887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.149350+0000","last_change":"2024-09-12T01:16:07.149286+0000","last_active":"2024-09-12T01:16:07.149350+0000","last_peered":"2024-09-12T01:16:07.149350+0000","last_clean":"2024-09-12T01:16:07.149350+0000","last_became_active":"2024-09-12T00:02:50.065534+0000","last_became_peered":"2024-09-12T00:02:50.065534+0000","last_unstale":"2024-09-12T01:16:07.149350+0000","last_undegraded":"2024-09-12T01:16:07.149350+0000","last_fullsized":"2024-09-12T01:16:07.149350+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'368","last_scrub_stamp":"2024-09-12T01:16:07.149197+0000","last_deep_scrub":"267'368","last_deep_scrub_stamp":"2024-09-12T01:16:07.149197+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.149197+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:26.769112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1966,"num_read_kb":1903,"num_write":390,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'155","reported_seq":760,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:57.132577+0000","last_change":"2024-09-12T01:15:57.132517+0000","last_active":"2024-09-12T01:15:57.132577+0000","last_peered":"2024-09-12T01:15:57.132577+0000","last_clean":"2024-09-12T01:15:57.132577+0000","last_became_active":"2024-09-12T00:03:21.720441+0000","last_became_peered":"2024-09-12T00:03:21.720441+0000","last_unstale":"2024-09-12T01:15:57.132577+0000","last_undegraded":"2024-09-12T01:15:57.132577+0000","last_fullsized":"2024-09-12T01:15:57.132577+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-12T01:15:57.132438+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-12T01:15:57.132438+0000","last_clean_scrub_stamp":"2024-09-12T01:15:57.132438+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:56.866362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":351,"num_read_kb":16297,"num_write":778,"num_write_kb":33256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"267'1242","reported_seq":3065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:22.610318+0000","last_change":"2024-09-12T01:16:22.610318+0000","last_active":"2024-09-12T01:16:22.610318+0000","last_peered":"2024-09-12T01:16:22.610318+0000","last_clean":"2024-09-12T01:16:22.610318+0000","last_became_active":"2024-09-12T00:02:50.070406+0000","last_became_peered":"2024-09-12T00:02:50.070406+0000","last_unstale":"2024-09-12T01:16:22.610318+0000","last_undegraded":"2024-09-12T01:16:22.610318+0000","last_fullsized":"2024-09-12T01:16:22.610318+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1242","last_scrub_stamp":"2024-09-12T01:16:22.610208+0000","last_deep_scrub":"267'1242","last_deep_scrub_stamp":"2024-09-12T01:16:22.610208+0000","last_clean_scrub_stamp":"2024-09-12T01:16:22.610208+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":1200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.017549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5822,"num_read_kb":5176,"num_write":1694,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2225,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'195","reported_seq":851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.695089+0000","last_change":"2024-09-12T01:16:01.695026+0000","last_active":"2024-09-12T01:16:01.695089+0000","last_peered":"2024-09-12T01:16:01.695089+0000","last_clean":"2024-09-12T01:16:01.695089+0000","last_became_active":"2024-09-12T00:02:48.051454+0000","last_became_peered":"2024-09-12T00:02:48.051454+0000","last_unstale":"2024-09-12T01:16:01.695089+0000","last_undegraded":"2024-09-12T01:16:01.695089+0000","last_fullsized":"2024-09-12T01:16:01.695089+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'195","last_scrub_stamp":"2024-09-12T01:16:01.694929+0000","last_deep_scrub":"267'195","last_deep_scrub_stamp":"2024-09-12T01:16:01.694929+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.694929+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:50.288118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":27281,"num_write":913,"num_write_kb":43596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'811","reported_seq":2275,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.823457+0000","last_change":"2024-09-12T01:16:07.823457+0000","last_active":"2024-09-12T01:16:07.823457+0000","last_peered":"2024-09-12T01:16:07.823457+0000","last_clean":"2024-09-12T01:16:07.823457+0000","last_became_active":"2024-09-12T00:02:50.065615+0000","last_became_peered":"2024-09-12T00:02:50.065615+0000","last_unstale":"2024-09-12T01:16:07.823457+0000","last_undegraded":"2024-09-12T01:16:07.823457+0000","last_fullsized":"2024-09-12T01:16:07.823457+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'811","last_scrub_stamp":"2024-09-12T01:16:07.823369+0000","last_deep_scrub":"267'811","last_deep_scrub_stamp":"2024-09-12T01:16:07.823369+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.823369+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:09.542904+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3886,"num_read_kb":3508,"num_write":1123,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'223","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.095128+0000","last_change":"2024-09-12T01:15:59.095055+0000","last_active":"2024-09-12T01:15:59.095128+0000","last_peered":"2024-09-12T01:15:59.095128+0000","last_clean":"2024-09-12T01:15:59.095128+0000","last_became_active":"2024-09-12T00:02:48.047357+0000","last_became_peered":"2024-09-12T00:02:48.047357+0000","last_unstale":"2024-09-12T01:15:59.095128+0000","last_undegraded":"2024-09-12T01:15:59.095128+0000","last_fullsized":"2024-09-12T01:15:59.095128+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-12T01:15:59.094931+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-12T01:15:59.094931+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.094931+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:21.356655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":6089,"num_write":1092,"num_write_kb":27766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1104","reported_seq":2619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:12.628883+0000","last_change":"2024-09-12T01:16:12.628883+0000","last_active":"2024-09-12T01:16:12.628883+0000","last_peered":"2024-09-12T01:16:12.628883+0000","last_clean":"2024-09-12T01:16:12.628883+0000","last_became_active":"2024-09-12T00:02:50.075265+0000","last_became_peered":"2024-09-12T00:02:50.075265+0000","last_unstale":"2024-09-12T01:16:12.628883+0000","last_undegraded":"2024-09-12T01:16:12.628883+0000","last_fullsized":"2024-09-12T01:16:12.628883+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1104","last_scrub_stamp":"2024-09-12T01:16:12.628783+0000","last_deep_scrub":"267'1104","last_deep_scrub_stamp":"2024-09-12T01:16:12.628783+0000","last_clean_scrub_stamp":"2024-09-12T01:16:12.628783+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:31.330763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4403,"num_write":1512,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'200","reported_seq":831,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.554304+0000","last_change":"2024-09-12T01:15:58.554239+0000","last_active":"2024-09-12T01:15:58.554304+0000","last_peered":"2024-09-12T01:15:58.554304+0000","last_clean":"2024-09-12T01:15:58.554304+0000","last_became_active":"2024-09-12T00:02:48.047266+0000","last_became_peered":"2024-09-12T00:02:48.047266+0000","last_unstale":"2024-09-12T01:15:58.554304+0000","last_undegraded":"2024-09-12T01:15:58.554304+0000","last_fullsized":"2024-09-12T01:15:58.554304+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-12T01:15:58.554118+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-12T01:15:58.554118+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.554118+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:22.527176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549566,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":23654,"num_write":912,"num_write_kb":39021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'477","reported_seq":2131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.473365+0000","last_change":"2024-09-12T01:16:07.473365+0000","last_active":"2024-09-12T01:16:07.473365+0000","last_peered":"2024-09-12T01:16:07.473365+0000","last_clean":"2024-09-12T01:16:07.473365+0000","last_became_active":"2024-09-12T00:02:50.067919+0000","last_became_peered":"2024-09-12T00:02:50.067919+0000","last_unstale":"2024-09-12T01:16:07.473365+0000","last_undegraded":"2024-09-12T01:16:07.473365+0000","last_fullsized":"2024-09-12T01:16:07.473365+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'477","last_scrub_stamp":"2024-09-12T01:16:07.473283+0000","last_deep_scrub":"267'477","last_deep_scrub_stamp":"2024-09-12T01:16:07.473283+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.473283+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:57.980949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2609,"num_read_kb":2453,"num_write":580,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'153","reported_seq":741,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.103379+0000","last_change":"2024-09-12T01:16:00.103312+0000","last_active":"2024-09-12T01:16:00.103379+0000","last_peered":"2024-09-12T01:16:00.103379+0000","last_clean":"2024-09-12T01:16:00.103379+0000","last_became_active":"2024-09-12T00:03:21.143091+0000","last_became_peered":"2024-09-12T00:03:21.143091+0000","last_unstale":"2024-09-12T01:16:00.103379+0000","last_undegraded":"2024-09-12T01:16:00.103379+0000","last_fullsized":"2024-09-12T01:16:00.103379+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-12T01:16:00.103180+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-12T01:16:00.103180+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.103180+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:22.971120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":6539,"num_write":770,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'875","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.732349+0000","last_change":"2024-09-12T01:16:07.732349+0000","last_active":"2024-09-12T01:16:07.732349+0000","last_peered":"2024-09-12T01:16:07.732349+0000","last_clean":"2024-09-12T01:16:07.732349+0000","last_became_active":"2024-09-12T00:02:50.076097+0000","last_became_peered":"2024-09-12T00:02:50.076097+0000","last_unstale":"2024-09-12T01:16:07.732349+0000","last_undegraded":"2024-09-12T01:16:07.732349+0000","last_fullsized":"2024-09-12T01:16:07.732349+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'875","last_scrub_stamp":"2024-09-12T01:16:07.732265+0000","last_deep_scrub":"267'875","last_deep_scrub_stamp":"2024-09-12T01:16:07.732265+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.732265+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.381212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4258,"num_read_kb":3804,"num_write":1206,"num_write_kb":455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'185","reported_seq":798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:05.251693+0000","last_change":"2024-09-12T01:16:05.251637+0000","last_active":"2024-09-12T01:16:05.251693+0000","last_peered":"2024-09-12T01:16:05.251693+0000","last_clean":"2024-09-12T01:16:05.251693+0000","last_became_active":"2024-09-12T00:02:48.057693+0000","last_became_peered":"2024-09-12T00:02:48.057693+0000","last_unstale":"2024-09-12T01:16:05.251693+0000","last_undegraded":"2024-09-12T01:16:05.251693+0000","last_fullsized":"2024-09-12T01:16:05.251693+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'185","last_scrub_stamp":"2024-09-12T01:16:05.251527+0000","last_deep_scrub":"267'185","last_deep_scrub_stamp":"2024-09-12T01:16:05.251527+0000","last_clean_scrub_stamp":"2024-09-12T01:16:05.251527+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:53.355948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":352,"num_read_kb":5525,"num_write":905,"num_write_kb":35074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'842","reported_seq":2623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.930794+0000","last_change":"2024-09-12T01:16:11.930794+0000","last_active":"2024-09-12T01:16:11.930794+0000","last_peered":"2024-09-12T01:16:11.930794+0000","last_clean":"2024-09-12T01:16:11.930794+0000","last_became_active":"2024-09-12T00:02:50.062524+0000","last_became_peered":"2024-09-12T00:02:50.062524+0000","last_unstale":"2024-09-12T01:16:11.930794+0000","last_undegraded":"2024-09-12T01:16:11.930794+0000","last_fullsized":"2024-09-12T01:16:11.930794+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'842","last_scrub_stamp":"2024-09-12T01:16:11.930681+0000","last_deep_scrub":"267'842","last_deep_scrub_stamp":"2024-09-12T01:16:11.930681+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.930681+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:21.897504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4232,"num_read_kb":3859,"num_write":1078,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4832,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'258","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:00.730635+0000","last_change":"2024-09-12T01:16:00.730568+0000","last_active":"2024-09-12T01:16:00.730635+0000","last_peered":"2024-09-12T01:16:00.730635+0000","last_clean":"2024-09-12T01:16:00.730635+0000","last_became_active":"2024-09-12T00:02:48.050574+0000","last_became_peered":"2024-09-12T00:02:48.050574+0000","last_unstale":"2024-09-12T01:16:00.730635+0000","last_undegraded":"2024-09-12T01:16:00.730635+0000","last_fullsized":"2024-09-12T01:16:00.730635+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'258","last_scrub_stamp":"2024-09-12T01:16:00.730443+0000","last_deep_scrub":"267'258","last_deep_scrub_stamp":"2024-09-12T01:16:00.730443+0000","last_clean_scrub_stamp":"2024-09-12T01:16:00.730443+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:08.715998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67790,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":15341,"num_write":1132,"num_write_kb":29230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'815","reported_seq":2290,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.253395+0000","last_change":"2024-09-12T01:16:04.253395+0000","last_active":"2024-09-12T01:16:04.253395+0000","last_peered":"2024-09-12T01:16:04.253395+0000","last_clean":"2024-09-12T01:16:04.253395+0000","last_became_active":"2024-09-12T00:02:50.063668+0000","last_became_peered":"2024-09-12T00:02:50.063668+0000","last_unstale":"2024-09-12T01:16:04.253395+0000","last_undegraded":"2024-09-12T01:16:04.253395+0000","last_fullsized":"2024-09-12T01:16:04.253395+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'815","last_scrub_stamp":"2024-09-12T01:16:04.253299+0000","last_deep_scrub":"267'815","last_deep_scrub_stamp":"2024-09-12T01:16:04.253299+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.253299+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:04.727166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3770,"num_read_kb":3367,"num_write":1118,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'211","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:04.220321+0000","last_change":"2024-09-12T01:16:04.220264+0000","last_active":"2024-09-12T01:16:04.220321+0000","last_peered":"2024-09-12T01:16:04.220321+0000","last_clean":"2024-09-12T01:16:04.220321+0000","last_became_active":"2024-09-12T00:02:48.048851+0000","last_became_peered":"2024-09-12T00:02:48.048851+0000","last_unstale":"2024-09-12T01:16:04.220321+0000","last_undegraded":"2024-09-12T01:16:04.220321+0000","last_fullsized":"2024-09-12T01:16:04.220321+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'211","last_scrub_stamp":"2024-09-12T01:16:04.220141+0000","last_deep_scrub":"267'211","last_deep_scrub_stamp":"2024-09-12T01:16:04.220141+0000","last_clean_scrub_stamp":"2024-09-12T01:16:04.220141+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:47.525059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":48639,"num_write":1072,"num_write_kb":41735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'815","reported_seq":2282,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.835388+0000","last_change":"2024-09-12T01:16:08.835311+0000","last_active":"2024-09-12T01:16:08.835388+0000","last_peered":"2024-09-12T01:16:08.835388+0000","last_clean":"2024-09-12T01:16:08.835388+0000","last_became_active":"2024-09-12T00:02:50.063615+0000","last_became_peered":"2024-09-12T00:02:50.063615+0000","last_unstale":"2024-09-12T01:16:08.835388+0000","last_undegraded":"2024-09-12T01:16:08.835388+0000","last_fullsized":"2024-09-12T01:16:08.835388+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'815","last_scrub_stamp":"2024-09-12T01:16:08.835219+0000","last_deep_scrub":"267'815","last_deep_scrub_stamp":"2024-09-12T01:16:08.835219+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.835219+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:58.732596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3747,"num_read_kb":3346,"num_write":1068,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'284","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:59.821206+0000","last_change":"2024-09-12T01:15:59.821132+0000","last_active":"2024-09-12T01:15:59.821206+0000","last_peered":"2024-09-12T01:15:59.821206+0000","last_clean":"2024-09-12T01:15:59.821206+0000","last_became_active":"2024-09-12T00:02:48.046828+0000","last_became_peered":"2024-09-12T00:02:48.046828+0000","last_unstale":"2024-09-12T01:15:59.821206+0000","last_undegraded":"2024-09-12T01:15:59.821206+0000","last_fullsized":"2024-09-12T01:15:59.821206+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'284","last_scrub_stamp":"2024-09-12T01:15:59.821026+0000","last_deep_scrub":"267'284","last_deep_scrub_stamp":"2024-09-12T01:15:59.821026+0000","last_clean_scrub_stamp":"2024-09-12T01:15:59.821026+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:05.732125+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":12026,"num_write":1074,"num_write_kb":33544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'754","reported_seq":2270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:11.720864+0000","last_change":"2024-09-12T01:16:11.720788+0000","last_active":"2024-09-12T01:16:11.720864+0000","last_peered":"2024-09-12T01:16:11.720864+0000","last_clean":"2024-09-12T01:16:11.720864+0000","last_became_active":"2024-09-12T00:02:50.069844+0000","last_became_peered":"2024-09-12T00:02:50.069844+0000","last_unstale":"2024-09-12T01:16:11.720864+0000","last_undegraded":"2024-09-12T01:16:11.720864+0000","last_fullsized":"2024-09-12T01:16:11.720864+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'754","last_scrub_stamp":"2024-09-12T01:16:11.720709+0000","last_deep_scrub":"267'754","last_deep_scrub_stamp":"2024-09-12T01:16:11.720709+0000","last_clean_scrub_stamp":"2024-09-12T01:16:11.720709+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:50.677876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3535,"num_read_kb":3209,"num_write":983,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'198","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:02.521764+0000","last_change":"2024-09-12T01:16:02.521700+0000","last_active":"2024-09-12T01:16:02.521764+0000","last_peered":"2024-09-12T01:16:02.521764+0000","last_clean":"2024-09-12T01:16:02.521764+0000","last_became_active":"2024-09-12T00:02:48.046397+0000","last_became_peered":"2024-09-12T00:02:48.046397+0000","last_unstale":"2024-09-12T01:16:02.521764+0000","last_undegraded":"2024-09-12T01:16:02.521764+0000","last_fullsized":"2024-09-12T01:16:02.521764+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-12T01:16:02.521590+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-12T01:16:02.521590+0000","last_clean_scrub_stamp":"2024-09-12T01:16:02.521590+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:52.392814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":38047,"num_write":933,"num_write_kb":24740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'854","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.774688+0000","last_change":"2024-09-12T01:16:06.774581+0000","last_active":"2024-09-12T01:16:06.774688+0000","last_peered":"2024-09-12T01:16:06.774688+0000","last_clean":"2024-09-12T01:16:06.774688+0000","last_became_active":"2024-09-12T00:02:50.078018+0000","last_became_peered":"2024-09-12T00:02:50.078018+0000","last_unstale":"2024-09-12T01:16:06.774688+0000","last_undegraded":"2024-09-12T01:16:06.774688+0000","last_fullsized":"2024-09-12T01:16:06.774688+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'854","last_scrub_stamp":"2024-09-12T01:16:06.774436+0000","last_deep_scrub":"267'854","last_deep_scrub_stamp":"2024-09-12T01:16:06.774436+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.774436+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:12.958179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4154,"num_read_kb":3748,"num_write":1160,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'171","reported_seq":785,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:06.723825+0000","last_change":"2024-09-12T01:16:06.723711+0000","last_active":"2024-09-12T01:16:06.723825+0000","last_peered":"2024-09-12T01:16:06.723825+0000","last_clean":"2024-09-12T01:16:06.723825+0000","last_became_active":"2024-09-12T00:02:48.047945+0000","last_became_peered":"2024-09-12T00:02:48.047945+0000","last_unstale":"2024-09-12T01:16:06.723825+0000","last_undegraded":"2024-09-12T01:16:06.723825+0000","last_fullsized":"2024-09-12T01:16:06.723825+0000","mapping_epoch":26,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-12T01:16:06.723583+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-12T01:16:06.723583+0000","last_clean_scrub_stamp":"2024-09-12T01:16:06.723583+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:29.604328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":324,"num_read_kb":25981,"num_write":829,"num_write_kb":31809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'534","reported_seq":2303,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.235496+0000","last_change":"2024-09-12T01:16:01.235496+0000","last_active":"2024-09-12T01:16:01.235496+0000","last_peered":"2024-09-12T01:16:01.235496+0000","last_clean":"2024-09-12T01:16:01.235496+0000","last_became_active":"2024-09-12T00:03:21.133475+0000","last_became_peered":"2024-09-12T00:03:21.133475+0000","last_unstale":"2024-09-12T01:16:01.235496+0000","last_undegraded":"2024-09-12T01:16:01.235496+0000","last_fullsized":"2024-09-12T01:16:01.235496+0000","mapping_epoch":39,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'534","last_scrub_stamp":"2024-09-12T01:16:01.235392+0000","last_deep_scrub":"267'534","last_deep_scrub_stamp":"2024-09-12T01:16:01.235392+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.235392+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:42.656876+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2976,"num_read_kb":2811,"num_write":614,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":436,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"267'233","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:15:58.161645+0000","last_change":"2024-09-12T01:15:58.161645+0000","last_active":"2024-09-12T01:15:58.161645+0000","last_peered":"2024-09-12T01:15:58.161645+0000","last_clean":"2024-09-12T01:15:58.161645+0000","last_became_active":"2024-09-12T00:02:48.049104+0000","last_became_peered":"2024-09-12T00:02:48.049104+0000","last_unstale":"2024-09-12T01:15:58.161645+0000","last_undegraded":"2024-09-12T01:15:58.161645+0000","last_fullsized":"2024-09-12T01:15:58.161645+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'233","last_scrub_stamp":"2024-09-12T01:15:58.161506+0000","last_deep_scrub":"267'233","last_deep_scrub_stamp":"2024-09-12T01:15:58.161506+0000","last_clean_scrub_stamp":"2024-09-12T01:15:58.161506+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.839368+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456491,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":11103,"num_write":1027,"num_write_kb":31106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'910","reported_seq":2510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.736530+0000","last_change":"2024-09-12T01:16:09.736466+0000","last_active":"2024-09-12T01:16:09.736530+0000","last_peered":"2024-09-12T01:16:09.736530+0000","last_clean":"2024-09-12T01:16:09.736530+0000","last_became_active":"2024-09-12T00:02:50.069494+0000","last_became_peered":"2024-09-12T00:02:50.069494+0000","last_unstale":"2024-09-12T01:16:09.736530+0000","last_undegraded":"2024-09-12T01:16:09.736530+0000","last_fullsized":"2024-09-12T01:16:09.736530+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'910","last_scrub_stamp":"2024-09-12T01:16:09.736373+0000","last_deep_scrub":"267'910","last_deep_scrub_stamp":"2024-09-12T01:16:09.736373+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.736373+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:52.193047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4355,"num_read_kb":3868,"num_write":1227,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'175","reported_seq":816,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:07.268258+0000","last_change":"2024-09-12T01:16:07.268258+0000","last_active":"2024-09-12T01:16:07.268258+0000","last_peered":"2024-09-12T01:16:07.268258+0000","last_clean":"2024-09-12T01:16:07.268258+0000","last_became_active":"2024-09-12T00:04:21.225148+0000","last_became_peered":"2024-09-12T00:04:21.225148+0000","last_unstale":"2024-09-12T01:16:07.268258+0000","last_undegraded":"2024-09-12T01:16:07.268258+0000","last_fullsized":"2024-09-12T01:16:07.268258+0000","mapping_epoch":41,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-12T01:16:07.268138+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-12T01:16:07.268138+0000","last_clean_scrub_stamp":"2024-09-12T01:16:07.268138+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:34.383522+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7533161,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":15843,"num_write":853,"num_write_kb":25246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'175","reported_seq":804,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:08.287894+0000","last_change":"2024-09-12T01:16:08.287894+0000","last_active":"2024-09-12T01:16:08.287894+0000","last_peered":"2024-09-12T01:16:08.287894+0000","last_clean":"2024-09-12T01:16:08.287894+0000","last_became_active":"2024-09-12T00:03:21.140871+0000","last_became_peered":"2024-09-12T00:03:21.140871+0000","last_unstale":"2024-09-12T01:16:08.287894+0000","last_undegraded":"2024-09-12T01:16:08.287894+0000","last_fullsized":"2024-09-12T01:16:08.287894+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-12T01:16:08.287766+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-12T01:16:08.287766+0000","last_clean_scrub_stamp":"2024-09-12T01:16:08.287766+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:57.597678+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2728229,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":36071,"num_write":841,"num_write_kb":27237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'835","reported_seq":2470,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:09.688636+0000","last_change":"2024-09-12T01:16:09.688636+0000","last_active":"2024-09-12T01:16:09.688636+0000","last_peered":"2024-09-12T01:16:09.688636+0000","last_clean":"2024-09-12T01:16:09.688636+0000","last_became_active":"2024-09-12T00:02:50.076513+0000","last_became_peered":"2024-09-12T00:02:50.076513+0000","last_unstale":"2024-09-12T01:16:09.688636+0000","last_undegraded":"2024-09-12T01:16:09.688636+0000","last_fullsized":"2024-09-12T01:16:09.688636+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'835","last_scrub_stamp":"2024-09-12T01:16:09.688553+0000","last_deep_scrub":"267'835","last_deep_scrub_stamp":"2024-09-12T01:16:09.688553+0000","last_clean_scrub_stamp":"2024-09-12T01:16:09.688553+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:38.082389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4096,"num_read_kb":3692,"num_write":1085,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'193","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:01.147640+0000","last_change":"2024-09-12T01:16:01.147640+0000","last_active":"2024-09-12T01:16:01.147640+0000","last_peered":"2024-09-12T01:16:01.147640+0000","last_clean":"2024-09-12T01:16:01.147640+0000","last_became_active":"2024-09-12T00:03:21.143160+0000","last_became_peered":"2024-09-12T00:03:21.143160+0000","last_unstale":"2024-09-12T01:16:01.147640+0000","last_undegraded":"2024-09-12T01:16:01.147640+0000","last_fullsized":"2024-09-12T01:16:01.147640+0000","mapping_epoch":39,"log_start":"267'100","ondisk_log_start":"267'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T01:16:01.147530+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T01:16:01.147530+0000","last_clean_scrub_stamp":"2024-09-12T01:16:01.147530+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:27.265957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":434,"num_read_kb":67077,"num_write":937,"num_write_kb":29840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'450","reported_seq":1973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T01:16:15.274158+0000","last_change":"2024-09-12T01:16:15.274158+0000","last_active":"2024-09-12T01:16:15.274158+0000","last_peered":"2024-09-12T01:16:15.274158+0000","last_clean":"2024-09-12T01:16:15.274158+0000","last_became_active":"2024-09-12T00:02:50.060457+0000","last_became_peered":"2024-09-12T00:02:50.060457+0000","last_unstale":"2024-09-12T01:16:15.274158+0000","last_undegraded":"2024-09-12T01:16:15.274158+0000","last_fullsized":"2024-09-12T01:16:15.274158+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'450","last_scrub_stamp":"2024-09-12T01:16:15.274064+0000","last_deep_scrub":"267'450","last_deep_scrub_stamp":"2024-09-12T01:16:15.274064+0000","last_clean_scrub_stamp":"2024-09-12T01:16:15.274064+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:18.935122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2366,"num_read_kb":2209,"num_write":518,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5804,"num_read_kb":4071,"num_write":1920,"num_write_kb":818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8194,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":993,"ondisk_log_size":993,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15077,"num_read_kb":14728,"num_write":16720,"num_write_kb":4882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1747,"ondisk_log_size":1747,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662,"ondisk_log_size":662,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":259874,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":10212,"num_read_kb":12359,"num_write":7103,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":676584,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1890,"ondisk_log_size":1890,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212469,"num_read_kb":193861,"num_write":55201,"num_write_kb":18788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43525,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3924,"ondisk_log_size":3924,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":93137464,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":33184,"num_read_kb":2494324,"num_write":62091,"num_write_kb":2229204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":141545472,"data_stored":141545472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4519,"ondisk_log_size":4519,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196988,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185720,"num_write":158,"num_write_kb":127344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510343,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243796,"kb_used_data":14084,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94128044,"statfs":{"total":96636764160,"available":96387117056,"internally_reserved":0,"allocated":14422016,"data_stored":12282601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510345,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259840,"kb_used_data":25968,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94112000,"statfs":{"total":96636764160,"available":96370688000,"internally_reserved":0,"allocated":26591232,"data_stored":24503671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510347,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97016,"kb_used_data":15848,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94274824,"statfs":{"total":96636764160,"available":96537419776,"internally_reserved":0,"allocated":16228352,"data_stored":14061021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510342,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106528,"kb_used_data":25360,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94265312,"statfs":{"total":96636764160,"available":96527679488,"internally_reserved":0,"allocated":25968640,"data_stored":23900981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510341,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245988,"kb_used_data":16276,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94125852,"statfs":{"total":96636764160,"available":96384872448,"internally_reserved":0,"allocated":16666624,"data_stored":14539294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510339,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101516,"kb_used_data":25916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94270324,"statfs":{"total":96636764160,"available":96532811776,"internally_reserved":0,"allocated":26537984,"data_stored":24477318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510340,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154136,"kb_used_data":28616,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94217704,"statfs":{"total":96636764160,"available":96478928896,"internally_reserved":0,"allocated":29302784,"data_stored":27210308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575751,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273592,"kb_used_data":21736,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94098248,"statfs":{"total":96636764160,"available":96356605952,"internally_reserved":0,"allocated":22257664,"data_stored":20146116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17256448,"data_stored":17256448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24911872,"data_stored":24911872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22179840,"data_stored":22179840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12238848,"data_stored":12238848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21602304,"data_stored":21602304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11759616,"data_stored":11759616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22204416,"data_stored":22204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:17:18.493 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:17:18.833 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:17:18.833 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:17:18.833 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:17:18.833 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:18.882 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:17:18.883 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:17:18.883 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:18.927 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:17:18.928 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:17:18.928 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:18.978 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:17:18.979 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:17:18.979 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.029 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:17:19.029 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:17:19.029 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.079 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:17:19.079 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:17:19.079 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.124 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:17:19.124 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:17:19.124 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.176 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:17:19.177 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:17:19.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.228 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:17:19.228 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:17:19.228 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:17:19.229 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.256 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:17:19.257 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:17:19.257 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.284 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:17:19.284 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:17:19.284 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:17:19.284 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.315 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:17:19.315 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:17:19.315 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.368 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:17:19.368 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:17:19.369 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:17:19.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-12T01:17:19.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-12T01:17:19.382 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:17:19.382 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:17:19.382 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:17:19.451 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T01:17:19.451 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:17:19.700 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T01:17:19.700 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:17:19.866 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T01:17:19.866 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:17:19.947 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T01:17:19.947 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:17:20.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T01:17:20.048 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:17:20.263 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T01:17:20.263 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:17:20.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T01:17:20.371 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:17:20.451 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T01:17:20.452 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:17:20.533 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:17:20.535 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/data/mon.a.tgz 2024-09-12T01:17:20.535 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-09-12T01:17:20.567 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.K6dao5FXRl 2024-09-12T01:17:20.567 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.K6dao5FXRl 2024-09-12T01:17:20.789 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.K6dao5FXRl 2024-09-12T01:17:20.901 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.K6dao5FXRl is 560KB 2024-09-12T01:17:21.001 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.K6dao5FXRl 2024-09-12T01:17:21.030 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/data/mon.c.tgz 2024-09-12T01:17:21.031 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-09-12T01:17:21.099 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.WPDYxPqw8p 2024-09-12T01:17:21.100 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.WPDYxPqw8p 2024-09-12T01:17:21.321 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.WPDYxPqw8p 2024-09-12T01:17:21.434 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.WPDYxPqw8p is 595KB 2024-09-12T01:17:21.539 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.WPDYxPqw8p 2024-09-12T01:17:21.569 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/data/mon.b.tgz 2024-09-12T01:17:21.569 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-12T01:17:21.598 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.maLZG618Eg 2024-09-12T01:17:21.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.maLZG618Eg 2024-09-12T01:17:21.821 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.maLZG618Eg 2024-09-12T01:17:21.931 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.maLZG618Eg is 595KB 2024-09-12T01:17:22.016 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.maLZG618Eg 2024-09-12T01:17:22.046 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:17:22.047 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:17:22.049 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:17:22.236 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:17:22.265 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:17:22.266 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:17:22.267 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/remote/smithi033/crash 2024-09-12T01:17:22.268 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:17:22.309 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/remote/smithi162/crash 2024-09-12T01:17:22.310 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:17:22.348 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:17:22.348 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:17:22.353 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:17:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:17:22.393 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51552.log 2024-09-12T01:17:22.393 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123952.log 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.51552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121596.log 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51552.log.gz 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.123952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90967.log 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.123952.log.gz 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.121596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96857.log 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.90967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38326.log 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.90967.log.gz 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.96857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190560.log 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38326.log.gz 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96857.log.gz 2024-09-12T01:17:22.394 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42966.log 2024-09-12T01:17:22.438 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32822.log 2024-09-12T01:17:22.438 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32635.log 2024-09-12T01:17:22.438 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32866.log 2024-09-12T01:17:22.438 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.32822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32822.log.gz 2024-09-12T01:17:22.438 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.32635.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:17:22.438 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32635.log.gz 2024-09-12T01:17:22.438 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32954.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.32866.log: /var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.32954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32866.log.gz 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.4.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32954.log.gz 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32910.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32767.log 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.32910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32910.log.gz 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:17:22.439 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32723.log 2024-09-12T01:17:22.440 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:17:22.440 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.32767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32767.log.gz 2024-09-12T01:17:22.440 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.32723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32679.log 2024-09-12T01:17:22.440 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32723.log.gz 2024-09-12T01:17:22.440 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.32679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32679.log.gz 2024-09-12T01:17:22.441 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:17:22.486 INFO:teuthology.orchestra.run.smithi162.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:17:22.515 INFO:teuthology.orchestra.run.smithi033.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.121596.log.gz 2024-09-12T01:17:22.515 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158120.log 2024-09-12T01:17:22.515 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190560.log.gz 2024-09-12T01:17:22.515 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.42966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190422.log 2024-09-12T01:17:22.515 INFO:teuthology.orchestra.run.smithi033.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42966.log.gz 2024-09-12T01:17:22.515 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38757.log 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.158120.log.gz 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117473.log 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190422.log.gz 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171578.log 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38757.log.gz 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.117473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91556.log 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.117473.log.gz 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149280.log 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.91556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153997.log 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.171578.log.gz 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.91556.log.gz 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.149280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38754.log 2024-09-12T01:17:22.516 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.149280.log.gz 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38760.log 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.153997.log: /var/log/ceph/ceph-client.admin.38754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177132.log 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38754.log.gz 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38760.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38760.log.gz 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.188163.log 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.177132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190698.log 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr: 85.9% 79.9% -- replaced with /var/log/ceph/ceph-client.admin.153997.log.gz 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.0.177132.log.gz 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.188163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66006.log 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.188163.log.gz 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156353.log 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190698.log.gz 2024-09-12T01:17:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.66006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77153.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.156353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191479.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.156353.log.gz 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.77153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51576.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191479.log.gz 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191204.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.51576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51576.log.gz 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159298.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191204.log.gz 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64148.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73863.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64148.log: 80.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.159298.log.gz 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:17:22.518 INFO:teuthology.orchestra.run.smithi033.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.77153.log.gz 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.73863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95090.log 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131020.log 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.73863.log.gz 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.95090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125719.log 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95090.log.gz 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190790.log 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66006.log.gz 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.131020.log: /var/log/ceph/ceph-client.admin.125719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191066.log 2024-09-12T01:17:22.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38262.log 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125719.log.gz 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.131020.log.gz 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190790.log.gz 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191066.log.gz 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161087.log 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38262.log.gz 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61987.log 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138088.log 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.161087.log.gz 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr:gzip/var/log/ceph/ceph-client.admin.61987.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.98624.log 2024-09-12T01:17:22.520 INFO:teuthology.orchestra.run.smithi033.stderr: 61.9% -- replaced with /var/log/ceph/ceph-client.admin.61987.log.gz 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.138088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143978.log 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.138088.log.gz 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102158.log 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.143978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170362.log 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102158.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143978.log.gz 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39874.log 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.102158.log.gz 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5/var/log/ceph/ceph-client.admin.170362.log: --verbose -- /var/log/ceph/ceph-client.admin.39328.log 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.98624.log.gz 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39874.log.gz 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170362.log.gz 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190606.log 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39328.log: -- /var/log/ceph/ceph-client.admin.168584.log 2024-09-12T01:17:22.521 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39328.log.gz 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190606.log.gz 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85666.log 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100980.log 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.85666.log: gzip 92.3% -- replaced with /var/log/ceph/ceph-client.admin.168584.log.gz 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.79187.log 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.85666.log.gz/var/log/ceph/ceph-client.admin.100980.log: 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86844.log 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100980.log.gz 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.79187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70959.log 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.79187.log.gz 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.86844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191112.log 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.70959.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86844.log.gz 2024-09-12T01:17:22.522 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145156.log 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191112.log.gz 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39004.log 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.145156.log: gzip -5 --verbose 81.5% -- replaced with /var/log/ceph/ceph-client.admin.145156.log.gz 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr: -- /var/log/ceph/ceph-client.admin.163491.log 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39004.log.gz 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120418.log 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59918.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.163491.log.gz 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.120418.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.120418.log.gz 2024-09-12T01:17:22.523 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.81543.log 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.59918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59918.log.gz 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187430.log 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.81543.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.70959.log.gz 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 81.6% -- replaced with /var/log/ceph/ceph-client.admin.81543.log.gz 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38755.log 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.187430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187430.log.gz 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68483.log 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38755.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.64148.log.gz 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38755.log.gz /var/log/ceph/ceph-client.admin.158709.log 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.68483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148102.log 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94501.log 2024-09-12T01:17:22.524 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.158709.log.gz 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.148102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39698.log 81.9% -- replaced with /var/log/ceph/ceph-client.admin.148102.log.gz 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.94501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135143.log 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.94501.log.gz 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45301.log 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39698.log.gz 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.135143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190882.log 81.2% -- replaced with /var/log/ceph/ceph-client.admin.135143.log.gz 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191158.log 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.45301.log.gz 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56312.log 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190882.log.gz 2024-09-12T01:17:22.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188090.log 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191158.log.gz 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100391.log 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.56312.log: 85.2%/var/log/ceph/ceph-client.admin.188090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85077.log 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56312.log.gz 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188090.log.gz 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40506.log 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100391.log.gz 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr: -5/var/log/ceph/ceph-client.admin.85077.log: --verbose -- /var/log/ceph/ceph-client.admin.122774.log 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.40506.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.85077.log.gz 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 44.2% -- replaced with /var/log/ceph/ceph-client.0.40506.log.gz 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.157531.log 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.122774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159888.log 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122774.log.gz 2024-09-12T01:17:22.526 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191296.log 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157531.log.gz 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102747.log 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159888.log.gz 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60531.log 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191296.log.gz 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188859.log 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102747.log.gz 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.60531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99213.log 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.188859.log: gzip 86.1% -- replaced with /var/log/ceph/ceph-client.admin.60531.log.gz 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.93912.log 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.188859.log.gz 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99213.log: gzip 82.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.99213.log.gz --verbose 2024-09-12T01:17:22.527 INFO:teuthology.orchestra.run.smithi033.stderr: -- /var/log/ceph/ceph-client.admin.63559.log 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.93912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89200.log 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.63559.log: 81.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129842.log 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93912.log.gz 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.63559.log.gz 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.89200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55134.log 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89200.log.gz 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.129842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176523.log 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.129842.log.gz 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.55134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189565.log 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.176523.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.55134.log.gz 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 84.0% -- replaced with /var/log/ceph/ceph-client.0.176523.log.gz 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.178350.log 2024-09-12T01:17:22.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.189565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119829.log 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.178350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57514.log 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr: 80.1%/var/log/ceph/ceph-client.admin.119829.log: -- replaced with /var/log/ceph/ceph-client.0.178350.log.gz 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101569.log 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5%/var/log/ceph/ceph-client.admin.57514.log: -- replaced with /var/log/ceph/ceph-client.admin.119829.log.gz 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57514.log.gz 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136910.log 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.189565.log.gz 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101569.log: gzip -5 --verbose -- 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101569.log.gz 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr: /var/log/ceph/ceph-client.admin.124541.log 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.136910.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136910.log.gz 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.124541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181395.log 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.124541.log.gz 2024-09-12T01:17:22.529 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62836.log 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.181395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67245.log 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.62836.log: 80.3%gzip -- replaced with /var/log/ceph/ceph-client.0.181395.log.gz -5 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.188066.log 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr: 92.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39123.log 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62836.log.gz 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.67245.log: /var/log/ceph/ceph-client.admin.188066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188066.log.gz 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169754.log 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114528.log 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39123.log.gz 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62251.log 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr: 94.6% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.67245.log.gz 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:17:22.530 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.114528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59942.log 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.114528.log.gz 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.62251.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.169754.log.gz 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62251.log.gz -5 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47970.log 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.59942.log: /var/log/ceph/ceph-client.admin.47970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173551.log 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.59942.log.gz 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.47970.log.gz 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141622.log 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191435.log 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173551.log.gz 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.141622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38752.log 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 81.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.39742.log 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191435.log: -- replaced with /var/log/ceph/ceph-client.admin.141622.log.gz 2024-09-12T01:17:22.531 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191435.log.gz 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115706.log 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38752.log.gz 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75781.log 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39742.log.gz 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82132.log 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.115706.log: /var/log/ceph/ceph-client.0.75781.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.115706.log.gz 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191020.log 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.75781.log.gz 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.82132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113939.log 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.82132.log.gz 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191020.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146923.log 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191020.log.gz 2024-09-12T01:17:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.113939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182004.log 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.113939.log.gz 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.146923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62706.log 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.146923.log.gz 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.182004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52778.log 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.0.182004.log.gz 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.62706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74453.log 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.52778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38349.log 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.52778.log.gz 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.74453.log: gzip -5 --verbose -- 80.9% -- replaced with /var/log/ceph/ceph-client.admin.74453.log.gz 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr: /var/log/ceph/ceph-client.admin.131609.log 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38349.log.gz 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150458.log 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.131609.log: gzip -5 81.9% -- replaced with /var/log/ceph/ceph-client.admin.131609.log.gz 2024-09-12T01:17:22.533 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38546.log 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.150458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142800.log 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38546.log: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.68483.log.gz 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38546.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127486.log 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77762.log 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.142800.log: /var/log/ceph/ceph-client.admin.127486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134554.log 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.150458.log.gz 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr: 81.6%/var/log/ceph/ceph-client.0.77762.log: -- replaced with /var/log/ceph/ceph-client.admin.142800.log.gz 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose 79.9% -- replaced with /var/log/ceph/ceph-client.0.77762.log.gz 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr: -- /var/log/ceph/ceph-client.admin.128664.log 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.134554.log: gzip -5 --verbose -- 81.8% -- replaced with /var/log/ceph/ceph-client.admin.134554.log.gz 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr: /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.128664.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.127486.log.gz 2024-09-12T01:17:22.534 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 81.3% -- replaced with /var/log/ceph/ceph-client.admin.128664.log.gz 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39830.log 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162878.log 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39830.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39830.log.gz 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.107459.log 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162878.log.gz 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83899.log 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107459.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.107459.log.gz 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.80365.log 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.83899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39126.log 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.83899.log.gz/var/log/ceph/ceph-client.admin.80365.log: 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188044.log 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.80365.log.gz 2024-09-12T01:17:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38408.log 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39126.log: gzip/var/log/ceph/ceph-client.admin.188044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39126.log.gz 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.42363.log 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.188044.log.gz 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38408.log: -- /var/log/ceph/ceph-client.admin.32789.log 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38408.log.gz 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.42363.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42363.log.gz 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62644.log 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.32789.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32789.log.gz 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71623.log 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.62644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62644.log.gz 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147512.log 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.71623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133965.log 2024-09-12T01:17:22.536 INFO:teuthology.orchestra.run.smithi033.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.71623.log.gz 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.147512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98035.log 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.147512.log.gz 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161676.log 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.133965.log: /var/log/ceph/ceph-client.admin.98035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112172.log 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.98035.log.gz 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155175.log 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.161676.log.gz 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.112172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76390.log 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.112172.log.gz 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.155175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99802.log 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.76390.log: 85.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.155175.log.gz 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75635.log 2024-09-12T01:17:22.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99802.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.76390.log.gz 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.133965.log.gz 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.99802.log.gz 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119240.log 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.75635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95679.log 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.75635.log.gz 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.119240.log: gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62706.log.gz 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49196.log 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119240.log.gz 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.95679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49172.log 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95679.log.gz 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187406.log 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.49196.log.gz 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49172.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:17:22.538 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49172.log.gz 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138677.log 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.187406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187406.log.gz 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39124.log 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.138677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45908.log 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39124.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138677.log.gz 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39124.log.gz 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182613.log 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.45908.log.gz 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.182613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151636.log 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39786.log: gzip 84.2% -- replaced with /var/log/ceph/ceph-client.0.182613.log.gz 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr: -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 2024-09-12T01:17:22.539 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39008.log 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.151636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137499.log 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.151636.log.gz 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39008.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39008.log.gz 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.135732.log 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.137499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67864.log 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.137499.log.gz 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.135732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152819.log 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135732.log.gz 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.67864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183222.log 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.152819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126308.log 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.152819.log.gz 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.183222.log: gzip -5 --verbose -- 80.2% -- replaced with /var/log/ceph/ceph-client.0.183222.log.gz 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr: /var/log/ceph/ceph-client.admin.132787.log 2024-09-12T01:17:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.126308.log: gzip -5 --verbose 82.0% -- replaced with /var/log/ceph/ceph-client.admin.126308.log.gz 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr: -- /var/log/ceph/ceph-client.0.183831.log 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67864.log.gz 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.132787.log: gzip -5 --verbose 82.1% -- replaced with /var/log/ceph/ceph-client.admin.132787.log.gz 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr: -- /var/log/ceph/ceph-client.admin.191342.log 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.183831.log: gzip -5 --verbose 83.7% -- /var/log/ceph/ceph-client.admin.77100.log 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.0.183831.log.gz 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191342.log.gz 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78598.log 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.77100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86255.log 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr: 49.3% -- replaced with /var/log/ceph/ceph-client.admin.77100.log.gz 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.78598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97446.log 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.78598.log.gz 2024-09-12T01:17:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.86255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142211.log 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.86255.log.gz 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52189.log 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.97446.log.gz 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.142211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83310.log 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.52189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113350.log 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.52189.log.gz/var/log/ceph/ceph-client.admin.83310.log: 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66626.log 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.83310.log.gz 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133376.log 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.142211.log.gz 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.113350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190744.log 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.66626.log: /var/log/ceph/ceph-client.admin.133376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70340.log 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr: 81.5%/var/log/ceph/ceph-client.admin.190744.log: -- replaced with /var/log/ceph/ceph-client.admin.133376.log.gz 2024-09-12T01:17:22.542 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190744.log.gz 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105692.log 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.70340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178959.log 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105692.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.113350.log.gz 81.8% 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105692.log.gz 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59305.log 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.178959.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70340.log.gz 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180786.log 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.178959.log.gz 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185049.log 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.59305.log: /var/log/ceph/ceph-client.0.180786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58716.log 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr: 85.0%/var/log/ceph/ceph-client.0.185049.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.180786.log.gz 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59305.log.gz 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.185049.log.gz 2024-09-12T01:17:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57490.log 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.58716.log: gzip -5 --verbose -- 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58716.log.gz 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66626.log.gz 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr: /var/log/ceph/ceph-mon.a.log 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.57490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57490.log.gz 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38500.log 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48559.log 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38500.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38500.log.gz 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.152230.log 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48559.log: gzip -5 --verbose 84.1% -- replaced with /var/log/ceph/ceph-client.admin.48559.log.gz 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr: -- /var/log/ceph/ceph.tmp-client.admin.26696.log 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.152230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187384.log 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.tmp-client.admin.26696.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26696.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144567.log 2024-09-12T01:17:22.544 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.187384.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.187384.log.gz 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.152230.log.gz 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106281.log 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.144567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38756.log 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.144567.log.gz 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110994.log 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.106281.log.gz 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39897.log 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.110994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38756.log.gz 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159909.log 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.110994.log.gz 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.39897.log: -- /var/log/ceph/ceph-client.admin.172943.log 2024-09-12T01:17:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116295.log 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.159909.log.gz 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172943.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.39897.log.gz 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172943.log.gz 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.116295.log: gzip -5 81.6% -- replaced with /var/log/ceph/ceph-client.admin.116295.log.gz 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39122.log 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63383.log 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39122.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69721.log 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62567.log 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.63383.log: /var/log/ceph/ceph-client.admin.69721.log: 20.8% -- replaced with /var/log/ceph/ceph-client.admin.63383.log.gz 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69721.log.gz 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125130.log 2024-09-12T01:17:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.62567.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62567.log.gz 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.125130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140444.log 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125130.log.gz 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 62.7% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72682.log 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.140444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162902.log 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140444.log.gz 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.72682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164717.log 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162902.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.72682.log.gz 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.162902.log.gz 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190928.log 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62361.log 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.164717.log.gz 2024-09-12T01:17:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190928.log.gz 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164693.log 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.62361.log: 48.7% -- replaced with /var/log/ceph/ceph-client.admin.62361.log.gz 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92145.log 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164693.log.gzgzip 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49785.log 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90378.log 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49785.log: /var/log/ceph/ceph-client.admin.92145.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.49785.log.gz 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92145.log.gz 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.90378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172335.log 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mgr.y.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.90378.log.gz 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43569.log 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172335.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172335.log.gz 2024-09-12T01:17:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46792.log 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.43569.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43569.log.gz 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190974.log 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46792.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.46792.log.gz 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49148.log 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190974.log.gz 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155764.log 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49148.log.gz 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139266.log 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.155764.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.155764.log.gz 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190652.log 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.139266.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.139266.log.gz 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108638.log 2024-09-12T01:17:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190652.log.gz 2024-09-12T01:17:22.550 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123363.log 2024-09-12T01:17:22.550 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108638.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108638.log.gz 2024-09-12T01:17:22.550 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:17:22.550 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.123363.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.123363.log.gz 2024-09-12T01:17:22.550 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88611.log 2024-09-12T01:17:22.579 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.log: 93.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53367.log 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.88611.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88611.log.gz 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170970.log 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38758.log 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.53367.log: /var/log/ceph/ceph-client.admin.170970.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.53367.log.gz 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105103.log 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170970.log.gz 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41151.log 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38758.log.gz/var/log/ceph/ceph-client.admin.105103.log: 2024-09-12T01:17:22.580 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105103.log.gz 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.190376.log 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.41151.log: -- /var/log/ceph/ceph-client.admin.118062.log 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.41151.log.gz 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190376.log.gz 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103925.log 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.118062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111583.log 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118062.log.gz 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103925.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103925.log.gz 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190330.log 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191250.log 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.111583.log: /var/log/ceph/ceph-client.admin.190330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190330.log.gz 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111583.log.gz 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88022.log 2024-09-12T01:17:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39128.log 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191250.log.gz 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.88022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33222.log 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88022.log.gz 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39128.log.gz 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164080.log 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175884.log 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33222.log.gz 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112761.log 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.164080.log.gz 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175884.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175884.log.gz 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174159.log 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38759.log 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.112761.log: /var/log/ceph/ceph-client.admin.174159.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.112761.log.gz 2024-09-12T01:17:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87433.log 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174159.log.gz 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38759.log.gz 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141033.log 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56901.log 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.87433.log: /var/log/ceph/ceph-client.admin.141033.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87433.log.gz 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.141033.log.gz 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92734.log 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54545.log 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.56901.log: /var/log/ceph/ceph-client.admin.92734.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.56901.log.gz 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.92734.log.gz 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146334.log 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80954.log 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.54545.log: /var/log/ceph/ceph-client.admin.146334.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.54545.log.gz 2024-09-12T01:17:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53956.log 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.80954.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80954.log.gz 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39007.log 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.146334.log.gz 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.53956.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.53956.log.gz 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149869.log 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38160.log 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39007.log.gz 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.149869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82721.log 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38160.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.149869.log.gz 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38160.log.gz 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62772.log 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.82721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165306.log 2024-09-12T01:17:22.584 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82721.log.gz 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.62772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61120.log 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr: 57.0%/var/log/ceph/ceph-client.admin.165306.log: -- replaced with /var/log/ceph/ceph-client.admin.62772.log.gz 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.165306.log.gz 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55723.log 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58127.log 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.61120.log: 81.7%/var/log/ceph/ceph-client.admin.55723.log: -- replaced with /var/log/ceph/ceph-client.admin.61120.log.gz 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.55723.log.gz 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115117.log 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.58127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162265.log 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58127.log.gz 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.115117.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115117.log.gz 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39374.log 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190514.log 2024-09-12T01:17:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162265.log: /var/log/ceph/ceph-client.admin.39374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39374.log.gz 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162265.log.gz 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122185.log 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190514.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84488.log 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.122185.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.122185.log.gz 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186794.log 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109816.log 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.84488.log: /var/log/ceph/ceph-client.admin.186794.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.84488.log.gz 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.186794.log.gz 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186205.log 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75044.log 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.109816.log: /var/log/ceph/ceph-client.admin.186205.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.109816.log.gz 2024-09-12T01:17:22.586 INFO:teuthology.orchestra.run.smithi033.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.186205.log.gz 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190836.log 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.75044.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.75044.log.gz 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96268.log 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109227.log 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190836.log.gz 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.96268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50374.log 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.96268.log.gz 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.109227.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109227.log.gz 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179568.log 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187454.log 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.50374.log: /var/log/ceph/ceph-client.0.179568.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.50374.log.gz 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.179568.log.gz 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164669.log 2024-09-12T01:17:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154586.log 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.187454.log: /var/log/ceph/ceph-client.admin.164669.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.187454.log.gz 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164669.log.gz 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130431.log 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.154586.log: /var/log/ceph/ceph-client.admin.130431.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.154586.log.gz 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.130431.log.gz 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126897.log 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175276.log 2024-09-12T01:17:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.126897.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126897.log.gz 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128075.log 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175276.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.175276.log.gz 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121007.log 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.128075.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.128075.log.gz 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129253.log 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.121007.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.121007.log.gz 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191389.log 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.129253.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129253.log.gz 2024-09-12T01:17:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118651.log 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.191389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191389.log.gz 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167976.log 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.118651.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.118651.log.gz 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38454.log 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167976.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.167976.log.gz 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188139.log 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.38454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38454.log.gz 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57538.log 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.188139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188139.log.gz 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145745.log 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.57538.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.57538.log.gz 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41760.log 2024-09-12T01:17:22.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.145745.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.145745.log.gz 2024-09-12T01:17:22.598 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136321.log 2024-09-12T01:17:22.598 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.41760.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41760.log.gz 2024-09-12T01:17:22.598 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177741.log 2024-09-12T01:17:22.598 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.136321.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136321.log.gz 2024-09-12T01:17:22.598 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2024-09-12T01:17:22.598 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.177741.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.177741.log.gz 2024-09-12T01:17:22.598 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162854.log 2024-09-12T01:17:22.599 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.51600.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2024-09-12T01:17:22.600 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93323.log 2024-09-12T01:17:22.600 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162854.log.gz 2024-09-12T01:17:22.600 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106870.log 2024-09-12T01:17:22.600 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.93323.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93323.log.gz 2024-09-12T01:17:22.600 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63447.log 2024-09-12T01:17:22.601 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106870.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.106870.log.gz 2024-09-12T01:17:22.601 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33127.log 2024-09-12T01:17:22.602 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.63447.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.63447.log.gz 2024-09-12T01:17:22.602 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151047.log 2024-09-12T01:17:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.33127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33127.log.gz 2024-09-12T01:17:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69102.log 2024-09-12T01:17:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.151047.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.151047.log.gz 2024-09-12T01:17:22.604 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160498.log 2024-09-12T01:17:22.606 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.69102.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.69102.log.gz 2024-09-12T01:17:22.607 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139855.log 2024-09-12T01:17:22.607 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160498.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160498.log.gz 2024-09-12T01:17:22.608 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47381.log 2024-09-12T01:17:22.608 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.139855.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.139855.log.gz 2024-09-12T01:17:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110405.log 2024-09-12T01:17:22.609 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47381.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.47381.log.gz 2024-09-12T01:17:22.610 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59894.log 2024-09-12T01:17:22.611 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.110405.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110405.log.gz 2024-09-12T01:17:22.611 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132198.log 2024-09-12T01:17:22.612 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.59894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59894.log.gz 2024-09-12T01:17:22.612 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39420.log 2024-09-12T01:17:22.613 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.132198.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132198.log.gz 2024-09-12T01:17:22.613 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50963.log 2024-09-12T01:17:22.614 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39420.log.gz 2024-09-12T01:17:22.614 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184440.log 2024-09-12T01:17:22.614 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.50963.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50963.log.gz 2024-09-12T01:17:22.615 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148691.log 2024-09-12T01:17:22.616 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.184440.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.184440.log.gz 2024-09-12T01:17:22.616 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116884.log 2024-09-12T01:17:22.617 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.148691.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.148691.log.gz 2024-09-12T01:17:22.617 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190468.log 2024-09-12T01:17:22.618 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.116884.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116884.log.gz 2024-09-12T01:17:22.618 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167326.log 2024-09-12T01:17:22.619 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.190468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190468.log.gz 2024-09-12T01:17:22.619 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64767.log 2024-09-12T01:17:22.620 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.167326.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.167326.log.gz 2024-09-12T01:17:22.621 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188114.log 2024-09-12T01:17:22.621 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64767.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.64767.log.gz 2024-09-12T01:17:22.622 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165895.log 2024-09-12T01:17:22.622 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.188114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188114.log.gz 2024-09-12T01:17:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:17:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165895.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.165895.log.gz 2024-09-12T01:17:22.624 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180177.log 2024-09-12T01:17:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153408.log 2024-09-12T01:17:22.646 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.180177.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.180177.log.gz 2024-09-12T01:17:22.659 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143389.log 2024-09-12T01:17:22.659 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.153408.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.153408.log.gz 2024-09-12T01:17:22.673 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108048.log 2024-09-12T01:17:22.673 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.143389.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.143389.log.gz 2024-09-12T01:17:22.684 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104514.log 2024-09-12T01:17:22.684 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108048.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.108048.log.gz 2024-09-12T01:17:22.693 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65387.log 2024-09-12T01:17:22.693 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104514.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104514.log.gz 2024-09-12T01:17:22.711 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73271.log 2024-09-12T01:17:22.718 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.65387.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65387.log.gz 2024-09-12T01:17:22.724 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79776.log 2024-09-12T01:17:22.725 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.73271.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.73271.log.gz 2024-09-12T01:17:22.745 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89789.log 2024-09-12T01:17:22.746 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.79776.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.79776.log.gz 2024-09-12T01:17:22.757 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156942.log 2024-09-12T01:17:22.758 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.89789.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.89789.log.gz 2024-09-12T01:17:22.775 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103336.log 2024-09-12T01:17:22.775 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.156942.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.156942.log.gz 2024-09-12T01:17:22.788 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103336.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103336.log.gz 2024-09-12T01:17:23.221 INFO:teuthology.orchestra.run.smithi033.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:17:23.667 INFO:teuthology.orchestra.run.smithi162.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:17:23.782 INFO:teuthology.orchestra.run.smithi033.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:17:24.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-12T01:17:24.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-12T01:17:25.828 INFO:teuthology.orchestra.run.smithi033.stderr: 92.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:17:25.998 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:17:31.064 INFO:teuthology.orchestra.run.smithi033.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:17:32.021 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:17:32.051 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:17:33.042 INFO:teuthology.orchestra.run.smithi033.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:17:33.163 INFO:teuthology.orchestra.run.smithi162.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:17:37.558 INFO:teuthology.orchestra.run.smithi033.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:17:39.704 INFO:teuthology.orchestra.run.smithi162.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:17:39.706 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-12T01:17:39.706 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m17.287s 2024-09-12T01:17:39.706 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m46.725s 2024-09-12T01:17:39.706 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m1.725s 2024-09-12T01:17:45.634 INFO:teuthology.orchestra.run.smithi033.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:17:45.636 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-12T01:17:45.636 INFO:teuthology.orchestra.run.smithi033.stderr:real 0m23.255s 2024-09-12T01:17:45.637 INFO:teuthology.orchestra.run.smithi033.stderr:user 1m4.416s 2024-09-12T01:17:45.637 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m2.230s 2024-09-12T01:17:45.637 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:17:45.637 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/remote/smithi033/log 2024-09-12T01:17:45.638 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:17:54.249 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/remote/smithi162/log 2024-09-12T01:17:54.250 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:18:02.537 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:18:02.549 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:18:02.549 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:18:02.552 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:18:02.671 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:18:02.680 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:18:02.680 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:18:02.683 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:18:02.712 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:18:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:18:02.717 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:18:02.717 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-12T01:18:02.717 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -1004us[-1033us] +/- 41ms 2024-09-12T01:18:02.717 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -398us[ -398us] +/- 69ms 2024-09-12T01:18:02.717 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 64 +2138us[+2102us] +/- 82ms 2024-09-12T01:18:02.717 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:18:02.718 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:18:02.719 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-09-12T01:18:02.719 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 -1033us[-1025us] +/- 41ms 2024-09-12T01:18:02.719 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -460us[ -453us] +/- 68ms 2024-09-12T01:18:02.719 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 67 +2061us[+1914us] +/- 82ms 2024-09-12T01:18:02.719 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:18:02.719 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:18:02.730 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:18:02.730 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:18:02.741 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:18:02.843 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:18:02.922 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:18:02.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:18:02.967 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:18:03.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:18:03.009 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:18:03.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:18:03.034 INFO:teuthology.task.internal:Duration was 4957.445625 seconds 2024-09-12T01:18:03.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:18:03.044 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:18:03.045 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:18:03.047 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:18:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:18:03.101 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:18:03.390 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:18:03.390 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-09-12T01:18:03.391 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:18:03.426 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-12T01:18:03.426 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:18:03.461 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:18:03.461 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:18:03.468 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:18:03.540 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:18:03.541 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:18:03.548 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:18:03.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:18:03.706 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:18:03.706 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:18:03.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:18:03.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:18:03.797 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:18:03.799 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:18:03.836 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-09-12T01:18:03.864 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-12T01:18:03.899 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:18:03.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:18:03.928 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:18:03.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:18:03.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:18:03.984 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:18:03.985 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/remote/smithi033 2024-09-12T01:18:03.985 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:18:04.041 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901825/remote/smithi162 2024-09-12T01:18:04.041 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:18:04.087 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:18:04.087 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:18:04.090 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:18:04.151 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:18:04.165 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:18:04.165 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:18:04.176 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:18:04.176 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:18:04.179 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:18:04.206 INFO:teuthology.orchestra.run.smithi033.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:18 /home/ubuntu/cephtest 2024-09-12T01:18:04.219 INFO:teuthology.orchestra.run.smithi162.stdout: 265836 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:18 /home/ubuntu/cephtest 2024-09-12T01:18:04.221 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:18:04.232 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:18:04.259 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4957.445625066757 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:18:04.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:18:04.352 INFO:teuthology.run:pass